2024-03-04T12:24:18.888 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-03-04T12:24:18.888 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_prsrivas@teuthology --archive /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079 --name prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} --verbose -- /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079/orig.config.yaml 2024-03-04T12:24:18.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T12:24:19.087 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079 branch: wip-rgw-d4n description: rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7581079' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-d4n ceph: conf: client: debug rgw: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 3aec390336fdfdc8f927818b718cfb0361bd47c8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3aec390336fdfdc8f927818b718cfb0361bd47c8 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-d4n sha1: 3aec390336fdfdc8f927818b718cfb0361bd47c8 owner: scheduled_prsrivas@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 3236 sha1: 3aec390336fdfdc8f927818b718cfb0361bd47c8 sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-d4n suite_path: /home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa suite_relpath: qa suite_repo: https://github.com/pritha-srivastava/ceph.git suite_sha1: 3aec390336fdfdc8f927818b718cfb0361bd47c8 targets: smithi090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNlhke6ImRwW0tRTfdJzB0qBB7FXF7tOOlUe7oehwZ4Xt/w5ZH9ocT/GFTY4nc3Ud9M3URf3bSq2zbGIyyXGKCw= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGKwWZrWkCZxY/vImMGcz9W9FF7BM6FRmsTGM/jnEwtEWpOzNigHbATn/rXF/f2snFexK8u8oCCPWoXA57o/ao8= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-03-04_08:28:53 tube: smithi user: prsrivas verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-04T12:24:19.087 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa; will attempt to use it 2024-03-04T12:24:19.088 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks 2024-03-04T12:24:19.088 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-04T12:24:19.090 INFO:teuthology.task.internal:Checking packages... 2024-03-04T12:24:19.115 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3aec390336fdfdc8f927818b718cfb0361bd47c8' 2024-03-04T12:24:19.115 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-04T12:24:19.115 INFO:teuthology.packaging:ref: None 2024-03-04T12:24:19.115 INFO:teuthology.packaging:tag: None 2024-03-04T12:24:19.116 INFO:teuthology.packaging:branch: wip-rgw-d4n 2024-03-04T12:24:19.116 INFO:teuthology.packaging:sha1: 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:24:19.116 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-d4n 2024-03-04T12:24:19.280 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1871.g3aec3903 2024-03-04T12:24:19.281 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-04T12:24:19.288 INFO:teuthology.task.internal:no buildpackages task found 2024-03-04T12:24:19.288 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-04T12:24:19.328 INFO:teuthology.task.internal:Saving configuration 2024-03-04T12:24:19.345 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-04T12:24:19.353 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T12:24:19.376 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 12:18:46.746828', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNlhke6ImRwW0tRTfdJzB0qBB7FXF7tOOlUe7oehwZ4Xt/w5ZH9ocT/GFTY4nc3Ud9M3URf3bSq2zbGIyyXGKCw='} 2024-03-04T12:24:19.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 12:18:46.744734', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGKwWZrWkCZxY/vImMGcz9W9FF7BM6FRmsTGM/jnEwtEWpOzNigHbATn/rXF/f2snFexK8u8oCCPWoXA57o/ao8='} 2024-03-04T12:24:19.398 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-04T12:24:19.404 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-03-04T12:24:19.404 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-03-04T12:24:19.404 INFO:teuthology.run_tasks:Running task console_log... 2024-03-04T12:24:19.497 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb441a94dc0>, signals=[15]) 2024-03-04T12:24:19.497 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-04T12:24:19.506 INFO:teuthology.task.internal:Opening connections... 2024-03-04T12:24:19.506 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2024-03-04T12:24:19.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:24:19.601 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-03-04T12:24:19.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:24:19.736 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-04T12:24:19.743 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-03-04T12:24:19.762 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-03-04T12:24:19.762 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-03-04T12:24:19.820 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-03-04T12:24:19.820 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-03-04T12:24:19.820 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-03-04T12:24:19.820 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-03-04T12:24:19.820 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-03-04T12:24:19.820 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-03-04T12:24:19.820 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T12:24:19.820 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-03-04T12:24:19.821 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-03-04T12:24:19.821 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T12:24:19.821 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-03-04T12:24:19.821 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T12:24:19.821 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T12:24:19.821 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T12:24:19.821 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-03-04T12:24:19.847 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-03-04T12:24:19.865 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-03-04T12:24:19.865 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-03-04T12:24:19.922 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T12:24:19.923 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T12:24:19.924 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-03-04T12:24:19.955 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-04T12:24:19.965 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-04T12:24:19.986 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-04T12:24:19.987 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2024-03-04T12:24:19.989 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-03-04T12:24:20.005 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-04T12:24:20.013 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-04T12:24:20.013 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2024-03-04T12:24:20.048 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-03-04T12:24:20.151 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-04T12:24:20.204 INFO:teuthology.run_tasks:Running task kernel... 2024-03-04T12:24:20.225 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-04T12:24:20.225 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-04T12:24:20.226 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T12:24:20.226 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T12:24:20.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:24:20.242 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-03-04T12:24:20.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:24:20.244 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-03-04T12:24:20.300 INFO:teuthology.orchestra.run.smithi090.stdout:5.14.0-361.el9.x86_64 2024-03-04T12:24:20.300 INFO:teuthology.task.kernel:Running kernel on smithi090: 5.14.0-361.el9.x86_64 2024-03-04T12:24:20.300 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum install -y kernel 2024-03-04T12:24:20.301 INFO:teuthology.orchestra.run.smithi184.stdout:5.14.0-361.el9.x86_64 2024-03-04T12:24:20.302 INFO:teuthology.task.kernel:Running kernel on smithi184: 5.14.0-361.el9.x86_64 2024-03-04T12:24:20.302 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum install -y kernel 2024-03-04T12:24:22.548 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-04T12:24:22.835 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-03-04T12:24:23.907 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-03-04T12:24:24.269 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2024-03-04T12:24:25.234 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 8.1 MB/s | 8.0 MB 00:00 2024-03-04T12:24:25.555 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.0 MB 00:00 2024-03-04T12:24:27.216 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-03-04T12:24:31.673 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 4.0 MB/s | 19 MB 00:04 2024-03-04T12:24:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.1 MB 00:01 2024-03-04T12:24:34.576 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 15 kB 00:01 2024-03-04T12:24:36.277 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.1 MB 00:01 2024-03-04T12:24:36.821 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 9.7 MB/s | 20 MB 00:02 2024-03-04T12:24:37.550 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 15 kB 00:00 2024-03-04T12:24:38.535 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2024-03-04T12:24:41.685 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-03-04T12:24:43.411 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-04T12:24:43.934 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-04T12:24:43.934 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-04T12:24:44.030 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-03-04T12:24:44.039 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-03-04T12:24:44.039 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-03-04T12:24:44.040 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-03-04T12:24:44.040 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-03-04T12:24:44.040 INFO:teuthology.orchestra.run.smithi184.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-04T12:24:44.040 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-03-04T12:24:44.040 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-04T12:24:44.040 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-04T12:24:44.040 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-04T12:24:44.040 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:24:44.040 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-03-04T12:24:44.040 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-03-04T12:24:44.040 INFO:teuthology.orchestra.run.smithi184.stdout:Install 4 Packages 2024-03-04T12:24:44.040 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:24:44.041 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 100 M 2024-03-04T12:24:44.041 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 123 M 2024-03-04T12:24:44.041 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-03-04T12:24:45.660 INFO:teuthology.orchestra.run.smithi090.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-04T12:24:45.660 INFO:teuthology.orchestra.run.smithi090.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-04T12:24:45.778 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-03-04T12:24:45.783 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-03-04T12:24:45.783 INFO:teuthology.orchestra.run.smithi090.stdout: Package Architecture Version Repository Size 2024-03-04T12:24:45.783 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-03-04T12:24:45.783 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2024-03-04T12:24:45.784 INFO:teuthology.orchestra.run.smithi090.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-04T12:24:45.784 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2024-03-04T12:24:45.784 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-04T12:24:45.784 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-04T12:24:45.784 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-04T12:24:45.784 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:24:45.784 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-03-04T12:24:45.784 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-03-04T12:24:45.784 INFO:teuthology.orchestra.run.smithi090.stdout:Install 4 Packages 2024-03-04T12:24:45.784 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:24:45.785 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 100 M 2024-03-04T12:24:45.785 INFO:teuthology.orchestra.run.smithi090.stdout:Installed size: 123 M 2024-03-04T12:24:45.785 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-03-04T12:24:46.070 INFO:teuthology.orchestra.run.smithi184.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 3.2 MB/s | 6.0 MB 00:01 2024-03-04T12:24:47.023 INFO:teuthology.orchestra.run.smithi090.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 5.1 MB/s | 6.0 MB 00:01 2024-03-04T12:24:51.186 INFO:teuthology.orchestra.run.smithi184.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 3.0 MB/s | 21 MB 00:07 2024-03-04T12:24:57.165 INFO:teuthology.orchestra.run.smithi090.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 1.8 MB/s | 21 MB 00:11 2024-03-04T12:25:15.526 INFO:teuthology.orchestra.run.smithi184.stdout:(3/4): kernel-modules-core-5.14.0-427.el9.x86_6 1.1 MB/s | 33 MB 00:29 2024-03-04T12:25:19.640 INFO:teuthology.orchestra.run.smithi090.stdout:(3/4): kernel-modules-core-5.14.0-427.el9.x86_6 1.0 MB/s | 33 MB 00:32 2024-03-04T12:25:20.057 INFO:teuthology.orchestra.run.smithi090.stdout:(4/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 1.1 MB/s | 39 MB 00:34 2024-03-04T12:25:20.057 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-03-04T12:25:20.057 INFO:teuthology.orchestra.run.smithi090.stdout:Total 2.9 MB/s | 100 MB 00:34 2024-03-04T12:25:20.940 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-03-04T12:25:21.092 INFO:teuthology.orchestra.run.smithi184.stdout:(4/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 1.1 MB/s | 39 MB 00:36 2024-03-04T12:25:21.092 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-03-04T12:25:21.092 INFO:teuthology.orchestra.run.smithi184.stdout:Total 2.7 MB/s | 100 MB 00:37 2024-03-04T12:25:21.323 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-03-04T12:25:21.324 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-03-04T12:25:21.979 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-03-04T12:25:22.367 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-03-04T12:25:22.367 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-03-04T12:25:22.631 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-03-04T12:25:22.631 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-03-04T12:25:23.981 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-03-04T12:25:23.982 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-03-04T12:25:25.429 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-03-04T12:25:26.117 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-04T12:25:26.246 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T12:25:26.890 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-03-04T12:25:27.548 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-04T12:25:27.709 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T12:25:29.024 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T12:25:29.216 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T12:25:30.445 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T12:25:30.630 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T12:25:33.951 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T12:25:34.078 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:25:35.343 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T12:25:35.515 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:25:38.818 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:25:40.252 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:26:09.077 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:26:09.077 INFO:teuthology.orchestra.run.smithi090.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-04T12:26:09.077 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:26:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:26:09.617 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:26:09.617 INFO:teuthology.orchestra.run.smithi184.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-04T12:26:09.618 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:26:09.691 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:26:09.691 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-04T12:26:09.691 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T12:26:09.691 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T12:26:09.702 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:26:10.118 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:26:10.118 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:26:10.119 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2024-03-04T12:26:10.119 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-04T12:26:10.119 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-04T12:26:10.119 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-04T12:26:10.119 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-04T12:26:10.119 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:26:10.119 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-03-04T12:26:10.134 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:26:10.134 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-04T12:26:10.134 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T12:26:10.134 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T12:26:10.563 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:26:10.564 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:26:10.564 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-03-04T12:26:10.564 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-04T12:26:10.564 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-04T12:26:10.564 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-04T12:26:10.564 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-04T12:26:10.564 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:26:10.564 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-03-04T12:26:10.702 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T12:26:10.882 INFO:teuthology.orchestra.run.smithi090.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T12:26:10.883 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T12:26:10.883 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-04T12:26:10.883 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-04T12:26:10.883 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-04T12:26:10.883 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-04T12:26:10.883 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi090.front.sepia.ceph.com, path=None, version=distro) 2024-03-04T12:26:10.884 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T12:26:11.004 INFO:teuthology.orchestra.run.smithi090.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T12:26:11.004 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T12:26:11.004 DEBUG:teuthology.orchestra.run.smithi090:> sudo rpm -qi grub2-tools 2024-03-04T12:26:11.038 INFO:teuthology.orchestra.run.smithi090.stdout:Name : grub2-tools 2024-03-04T12:26:11.038 INFO:teuthology.orchestra.run.smithi090.stdout:Epoch : 1 2024-03-04T12:26:11.038 INFO:teuthology.orchestra.run.smithi090.stdout:Version : 2.06 2024-03-04T12:26:11.038 INFO:teuthology.orchestra.run.smithi090.stdout:Release : 68.el9 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:Architecture: x86_64 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:Group : Unspecified 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:Size : 8264254 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:License : GPLv3+ 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:Packager : builder@centos.org 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:Vendor : CentOS 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:Summary : Support tools for GRUB. 2024-03-04T12:26:11.039 INFO:teuthology.orchestra.run.smithi090.stdout:Description : 2024-03-04T12:26:11.040 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:26:11.040 INFO:teuthology.orchestra.run.smithi090.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-04T12:26:11.040 INFO:teuthology.orchestra.run.smithi090.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-04T12:26:11.040 INFO:teuthology.orchestra.run.smithi090.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-04T12:26:11.040 INFO:teuthology.orchestra.run.smithi090.stdout:hardware devices. 2024-03-04T12:26:11.040 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:26:11.040 INFO:teuthology.orchestra.run.smithi090.stdout:This subpackage provides tools for support of all platforms. 2024-03-04T12:26:11.041 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-04T12:26:11.041 INFO:teuthology.task.kernel:Updating grub on smithi090 to boot 5.14.0-427.el9.x86_64 2024-03-04T12:26:11.041 DEBUG:teuthology.orchestra.run.smithi090:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-04T12:26:11.081 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T12:26:11.267 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T12:26:11.267 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T12:26:11.267 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-04T12:26:11.267 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-04T12:26:11.267 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-04T12:26:11.268 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-04T12:26:11.268 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=None, version=distro) 2024-03-04T12:26:11.268 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T12:26:11.390 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T12:26:11.390 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T12:26:11.390 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -qi grub2-tools 2024-03-04T12:26:11.425 INFO:teuthology.orchestra.run.smithi184.stdout:Name : grub2-tools 2024-03-04T12:26:11.425 INFO:teuthology.orchestra.run.smithi184.stdout:Epoch : 1 2024-03-04T12:26:11.425 INFO:teuthology.orchestra.run.smithi184.stdout:Version : 2.06 2024-03-04T12:26:11.425 INFO:teuthology.orchestra.run.smithi184.stdout:Release : 68.el9 2024-03-04T12:26:11.425 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: x86_64 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:Group : Unspecified 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:Size : 8264254 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:License : GPLv3+ 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:Packager : builder@centos.org 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:Vendor : CentOS 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:Summary : Support tools for GRUB. 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout:Description : 2024-03-04T12:26:11.426 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:26:11.427 INFO:teuthology.orchestra.run.smithi184.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-04T12:26:11.427 INFO:teuthology.orchestra.run.smithi184.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-04T12:26:11.427 INFO:teuthology.orchestra.run.smithi184.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-04T12:26:11.427 INFO:teuthology.orchestra.run.smithi184.stdout:hardware devices. 2024-03-04T12:26:11.427 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:26:11.427 INFO:teuthology.orchestra.run.smithi184.stdout:This subpackage provides tools for support of all platforms. 2024-03-04T12:26:11.428 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-04T12:26:11.428 INFO:teuthology.task.kernel:Updating grub on smithi184 to boot 5.14.0-427.el9.x86_64 2024-03-04T12:26:11.428 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-04T12:26:11.639 INFO:teuthology.orchestra.run.smithi090.stderr:Generating grub configuration file ... 2024-03-04T12:26:12.076 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2024-03-04T12:26:13.379 INFO:teuthology.orchestra.run.smithi184.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-04T12:26:13.419 INFO:teuthology.orchestra.run.smithi184.stderr:done 2024-03-04T12:26:13.422 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-03-04T12:26:13.437 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.DxgzqlKsKA 2024-03-04T12:26:13.437 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DxgzqlKsKA 2024-03-04T12:26:13.473 INFO:teuthology.orchestra.run.smithi090.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-04T12:26:13.493 INFO:teuthology.orchestra.run.smithi090.stderr:done 2024-03-04T12:26:13.495 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-03-04T12:26:13.506 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.DxgzqlKsKA 2024-03-04T12:26:13.519 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.ugj0L9Ig7T 2024-03-04T12:26:13.519 DEBUG:teuthology.orchestra.run.smithi090:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ugj0L9Ig7T 2024-03-04T12:26:13.587 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.ugj0L9Ig7T 2024-03-04T12:26:13.648 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.DxgzqlKsKA is 6KB 2024-03-04T12:26:13.696 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.DxgzqlKsKA 2024-03-04T12:26:13.710 DEBUG:teuthology.orchestra.run.smithi184:> sudo /bin/ls /boot/loader/entries || true 2024-03-04T12:26:13.742 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.ugj0L9Ig7T is 6KB 2024-03-04T12:26:13.774 INFO:teuthology.orchestra.run.smithi184.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-04T12:26:13.774 INFO:teuthology.orchestra.run.smithi184.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-04T12:26:13.774 INFO:teuthology.orchestra.run.smithi184.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-04T12:26:13.774 INFO:teuthology.orchestra.run.smithi184.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-04T12:26:13.775 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-04T12:26:13.791 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.ugj0L9Ig7T 2024-03-04T12:26:13.804 DEBUG:teuthology.orchestra.run.smithi090:> sudo /bin/ls /boot/loader/entries || true 2024-03-04T12:26:13.869 INFO:teuthology.orchestra.run.smithi090.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-04T12:26:13.870 INFO:teuthology.orchestra.run.smithi090.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-04T12:26:13.870 INFO:teuthology.orchestra.run.smithi090.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-04T12:26:13.870 INFO:teuthology.orchestra.run.smithi090.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-04T12:26:13.871 DEBUG:teuthology.orchestra.run.smithi090:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-04T12:26:13.927 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2024-03-04T12:26:14.021 DEBUG:teuthology.orchestra.run.smithi090:> sudo shutdown -r now 2024-03-04T12:26:43.958 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-04T12:26:43.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-03-04T12:26:43.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:26:44.023 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-04T12:26:44.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-03-04T12:26:44.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:27:02.333 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-03-04T12:27:02.588 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-04T12:27:11.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-03-04T12:27:11.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:27:11.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-03-04T12:27:11.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:27:14.396 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-03-04T12:27:14.652 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-04T12:27:26.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-03-04T12:27:26.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:27:26.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-03-04T12:27:26.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:27:29.724 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-04T12:27:44.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-03-04T12:27:44.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:27:44.828 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-03-04T12:27:59.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-03-04T12:27:59.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:28:00.262 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-03-04T12:28:00.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-03-04T12:28:00.689 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-427.el9.x86_64"... 2024-03-04T12:28:00.690 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-03-04T12:28:00.703 INFO:teuthology.orchestra.run.smithi184.stdout:5.14.0-427.el9.x86_64 2024-03-04T12:28:00.704 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-04T12:28:00.704 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-04T12:28:00.704 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-04T12:28:01.704 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-04T12:28:01.705 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-04T12:28:01.804 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2024-03-04T12:28:01.870 DEBUG:teuthology.parallel:result is None 2024-03-04T12:28:16.779 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-03-04T12:28:17.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-03-04T12:28:17.410 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-427.el9.x86_64"... 2024-03-04T12:28:17.410 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-03-04T12:28:17.424 INFO:teuthology.orchestra.run.smithi090.stdout:5.14.0-427.el9.x86_64 2024-03-04T12:28:17.424 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-04T12:28:17.424 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-04T12:28:17.424 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-04T12:28:18.425 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-04T12:28:18.426 DEBUG:teuthology.orchestra.run.smithi090:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-04T12:28:18.549 INFO:teuthology.orchestra.run.smithi090.stdout:ttyS1 2024-03-04T12:28:18.591 DEBUG:teuthology.parallel:result is None 2024-03-04T12:28:18.592 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-04T12:28:18.599 INFO:teuthology.task.internal:Creating test directory... 2024-03-04T12:28:18.599 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T12:28:18.601 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T12:28:18.619 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-04T12:28:18.634 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-04T12:28:18.668 INFO:teuthology.task.internal:Creating archive directory... 2024-03-04T12:28:18.668 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T12:28:18.670 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T12:28:18.721 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-04T12:28:18.727 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-04T12:28:18.727 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T12:28:18.734 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T12:28:18.777 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T12:28:18.785 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T12:28:18.791 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T12:28:18.798 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T12:28:18.800 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-04T12:28:18.807 INFO:teuthology.task.internal:Configuring sudo... 2024-03-04T12:28:18.807 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T12:28:18.809 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T12:28:18.864 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-04T12:28:18.876 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-04T12:28:18.876 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T12:28:18.879 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T12:28:18.920 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T12:28:18.974 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T12:28:19.025 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T12:28:19.105 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T12:28:19.155 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:28:19.155 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T12:28:19.226 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T12:28:19.272 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T12:28:19.355 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T12:28:19.397 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T12:28:19.441 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:28:19.441 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T12:28:19.510 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2024-03-04T12:28:19.513 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-03-04T12:28:19.576 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T12:28:19.602 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T12:28:20.041 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-04T12:28:20.050 INFO:teuthology.task.internal:Starting timer... 2024-03-04T12:28:20.050 INFO:teuthology.run_tasks:Running task pcp... 2024-03-04T12:28:20.080 INFO:teuthology.run_tasks:Running task selinux... 2024-03-04T12:28:20.112 DEBUG:teuthology.orchestra.run.smithi090:> sudo service auditd rotate 2024-03-04T12:28:20.214 INFO:teuthology.orchestra.run.smithi090.stdout:Rotating logs: 2024-03-04T12:28:20.218 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2024-03-04T12:28:20.278 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2024-03-04T12:28:20.280 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-04T12:28:20.280 DEBUG:teuthology.orchestra.run.smithi090:> /usr/sbin/getenforce 2024-03-04T12:28:20.324 INFO:teuthology.orchestra.run.smithi090.stdout:Permissive 2024-03-04T12:28:20.324 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2024-03-04T12:28:20.349 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2024-03-04T12:28:20.350 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi090.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2024-03-04T12:28:20.350 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T12:28:20.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:28:20.416 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T12:28:20.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:28:20.447 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-04T12:28:20.447 DEBUG:teuthology.orchestra.run.smithi090:> sudo /usr/sbin/setenforce permissive 2024-03-04T12:28:20.516 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2024-03-04T12:28:20.551 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-04T12:28:20.561 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-04T12:28:20.566 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-04T12:28:20.676 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-04T12:28:20.692 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-04T12:28:20.693 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi090.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-04T12:32:32.938 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi090.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2024-03-04T12:32:32.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-03-04T12:32:32.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:32:33.090 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-03-04T12:32:33.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-03-04T12:32:33.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-03-04T12:32:33.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:32:33.327 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-03-04T12:32:33.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-03-04T12:32:33.400 INFO:teuthology.run_tasks:Running task clock... 2024-03-04T12:32:33.676 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-04T12:32:33.676 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T12:32:33.677 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T12:32:33.682 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T12:32:33.682 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T12:32:33.714 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T12:32:33.717 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T12:32:33.731 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T12:32:33.735 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T12:32:33.763 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: ntpd: command not found 2024-03-04T12:32:33.766 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2024-03-04T12:32:33.776 INFO:teuthology.orchestra.run.smithi090.stdout:506 Cannot talk to daemon 2024-03-04T12:32:33.780 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2024-03-04T12:32:33.794 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T12:32:33.797 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T12:32:33.810 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T12:32:33.816 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T12:32:33.864 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-03-04T12:32:33.865 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-03-04T12:32:33.867 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T12:32:33.867 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-03-04T12:32:33.867 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:32:33.867 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:32:33.867 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:32:33.867 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:32:33.869 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T12:32:33.869 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-03-04T12:32:33.869 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:32:33.869 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:32:33.869 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:32:33.869 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:32:33.870 INFO:teuthology.run_tasks:Running task install... 2024-03-04T12:32:33.884 DEBUG:teuthology.task.install:project ceph 2024-03-04T12:32:33.884 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8'}} 2024-03-04T12:32:33.884 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8'} 2024-03-04T12:32:33.884 INFO:teuthology.task.install:Using flavor: default 2024-03-04T12:32:33.890 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-04T12:32:33.890 INFO:teuthology.task.install:extra packages: [] 2024-03-04T12:32:33.890 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8', 'tag': None, 'wait_for_package': False} 2024-03-04T12:32:33.891 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:32:33.893 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8', 'tag': None, 'wait_for_package': False} 2024-03-04T12:32:33.893 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:32:34.044 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/ 2024-03-04T12:32:34.045 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1871.g3aec3903 2024-03-04T12:32:34.112 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/ 2024-03-04T12:32:34.112 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1871.g3aec3903 2024-03-04T12:32:34.215 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T12:32:34.215 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:32:34.215 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T12:32:34.217 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T12:32:34.218 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:32:34.218 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T12:32:34.245 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-03-04T12:32:34.245 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3aec390336fdfdc8f927818b718cfb0361bd47c8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T12:32:34.246 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-03-04T12:32:34.247 DEBUG:teuthology.orchestra.run.smithi090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3aec390336fdfdc8f927818b718cfb0361bd47c8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T12:32:34.313 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T12:32:34.315 DEBUG:teuthology.orchestra.run.smithi090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T12:32:34.392 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T12:32:34.394 DEBUG:teuthology.orchestra.run.smithi090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T12:32:34.458 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2024-03-04T12:32:34.460 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2024-03-04T12:32:34.461 INFO:teuthology.orchestra.run.smithi090.stdout:check_obsoletes = 1 2024-03-04T12:32:34.462 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum clean all 2024-03-04T12:32:34.701 INFO:teuthology.orchestra.run.smithi184.stdout:74 files removed 2024-03-04T12:32:34.703 INFO:teuthology.orchestra.run.smithi090.stdout:74 files removed 2024-03-04T12:32:34.728 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-03-04T12:32:34.730 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-03-04T12:32:35.460 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 199 kB/s | 82 kB 00:00 2024-03-04T12:32:35.535 INFO:teuthology.orchestra.run.smithi090.stdout:ceph packages for x86_64 168 kB/s | 82 kB 00:00 2024-03-04T12:32:35.918 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 24 kB/s | 10 kB 00:00 2024-03-04T12:32:36.145 INFO:teuthology.orchestra.run.smithi090.stdout:ceph noarch packages 18 kB/s | 10 kB 00:00 2024-03-04T12:32:36.577 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 3.1 kB/s | 1.9 kB 00:00 2024-03-04T12:32:36.645 INFO:teuthology.orchestra.run.smithi090.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-03-04T12:32:37.380 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - AppStream 8.8 MB/s | 6.7 MB 00:00 2024-03-04T12:32:37.464 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS-9 - AppStream 8.6 MB/s | 6.7 MB 00:00 2024-03-04T12:32:38.990 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS-9 - BaseOS 4.9 MB/s | 2.0 MB 00:00 2024-03-04T12:32:39.089 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2024-03-04T12:32:40.269 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.0 MB 00:00 2024-03-04T12:32:40.491 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 8.0 MB 00:01 2024-03-04T12:32:42.051 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-03-04T12:32:42.414 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-03-04T12:32:47.494 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.1 MB 00:01 2024-03-04T12:32:47.857 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.1 MB 00:02 2024-03-04T12:32:49.141 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 15 kB 00:00 2024-03-04T12:32:49.238 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 15 kB 00:00 2024-03-04T12:32:49.901 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 32 MB/s | 20 MB 00:00 2024-03-04T12:32:50.381 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 20 MB/s | 20 MB 00:01 2024-03-04T12:32:54.834 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-03-04T12:32:55.316 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-04T12:32:57.432 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T12:32:57.433 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T12:32:57.544 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-03-04T12:32:57.561 INFO:teuthology.orchestra.run.smithi184.stdout:=========================================================================================================== 2024-03-04T12:32:57.562 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-03-04T12:32:57.562 INFO:teuthology.orchestra.run.smithi184.stdout:=========================================================================================================== 2024-03-04T12:32:57.562 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-03-04T12:32:57.562 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 6.6 k 2024-03-04T12:32:57.562 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 5.3 M 2024-03-04T12:32:57.562 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 887 k 2024-03-04T12:32:57.562 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 145 k 2024-03-04T12:32:57.562 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 1.5 M 2024-03-04T12:32:57.562 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 138 k 2024-03-04T12:32:57.562 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 1.8 M 2024-03-04T12:32:57.562 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 7.4 M 2024-03-04T12:32:57.562 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 49 k 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 9.9 M 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 48 M 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 264 k 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 749 k 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 31 k 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 744 k 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 127 k 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: maven noarch 1:3.6.3-15.el9 CentOS-AppStream 17 k 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 161 k 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 320 k 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 299 k 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 99 k 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 85 k 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 3.1 M 2024-03-04T12:32:57.563 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 171 k 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 3.4 M 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 3.1 M 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: alsa-lib x86_64 1.2.10-2.el9 CentOS-AppStream 504 k 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: apache-commons-cli noarch 1.4-17.el9 CentOS-AppStream 70 k 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: apache-commons-codec noarch 1.15-7.el9 CentOS-AppStream 301 k 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: apache-commons-io noarch 1:2.8.0-8.el9 CentOS-AppStream 282 k 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 CentOS-AppStream 558 k 2024-03-04T12:32:57.564 INFO:teuthology.orchestra.run.smithi184.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: atinject noarch 1.0.3-6.el9 CentOS-AppStream 22 k 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: cdi-api noarch 2.0.2-6.el9 CentOS-AppStream 52 k 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 20 M 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 31 k 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 2.1 M 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 248 k 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 4.7 M 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 17 M 2024-03-04T12:32:57.565 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 16 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 25 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: cups-libs x86_64 1:2.3.3op2-24.el9 CentOS-BaseOS 261 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: flatpak-selinux noarch 1.12.8-1.el9 CentOS-AppStream 20 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 CentOS-AppStream 73 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T12:32:57.566 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: google-guice noarch 4.2.3-9.el9 CentOS-AppStream 472 k 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: gstreamer1 x86_64 1.22.1-2.el9 CentOS-AppStream 1.4 M 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 CentOS-AppStream 2.2 M 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: guava noarch 30.1-6.el9 CentOS-AppStream 2.3 M 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: httpcomponents-client noarch 4.5.13-3.el9 CentOS-AppStream 656 k 2024-03-04T12:32:57.567 INFO:teuthology.orchestra.run.smithi184.stdout: httpcomponents-core noarch 4.4.13-7.el9 CentOS-AppStream 630 k 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: jakarta-annotations noarch 1.3.5-13.el9 CentOS-AppStream 44 k 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: jansi x86_64 2.3.3-6.el9 CentOS-AppStream 108 k 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: java-11-openjdk x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 439 k 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: java-11-openjdk-headless x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 40 M 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 CentOS-AppStream 23 k 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: jsoup noarch 1.13.1-10.el9 CentOS-AppStream 376 k 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: jsr-305 noarch 3.0.2-6.el9 CentOS-AppStream 31 k 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: libX11-xcb x86_64 1.7.0-8.el9 appstream 11 k 2024-03-04T12:32:57.568 INFO:teuthology.orchestra.run.smithi184.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libcanberra x86_64 0.30-27.el9 CentOS-AppStream 85 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 163 k 2024-03-04T12:32:57.569 INFO:teuthology.orchestra.run.smithi184.stdout: libdrm x86_64 2.4.117-1.el9 CentOS-AppStream 158 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2024-03-04T12:32:57.570 INFO:teuthology.orchestra.run.smithi184.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 501 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 5.2 M 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: libsndfile x86_64 1.0.31-8.el9 CentOS-AppStream 205 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: libtiff x86_64 4.4.0-12.el9 CentOS-AppStream 197 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2024-03-04T12:32:57.571 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: libwebp x86_64 1.2.0-8.el9 CentOS-AppStream 276 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-04T12:32:57.572 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: maven-lib noarch 1:3.6.3-15.el9 CentOS-AppStream 1.5 M 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 CentOS-AppStream 7.9 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: maven-resolver noarch 1:1.6.1-10.el9 CentOS-AppStream 512 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: maven-shared-utils noarch 3.3.4-3.el9 CentOS-AppStream 150 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: maven-wagon noarch 3.4.2-7.el9 CentOS-AppStream 111 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: mesa-libEGL x86_64 23.3.3-1.el9 CentOS-AppStream 126 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: mesa-libGL x86_64 23.3.3-1.el9 CentOS-AppStream 167 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: mesa-libgbm x86_64 23.3.3-1.el9 CentOS-AppStream 37 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: mesa-libglapi x86_64 23.3.3-1.el9 CentOS-AppStream 43 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T12:32:57.573 INFO:teuthology.orchestra.run.smithi184.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: osinfo-db noarch 20231215-1.el9 CentOS-AppStream 283 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: ostree-libs x86_64 2024.4-3.el9 appstream 487 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 CentOS-AppStream 134 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: pipewire-libs x86_64 1.0.1-1.el9 CentOS-AppStream 1.9 M 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: plexus-cipher noarch 1.7-27.el9 CentOS-AppStream 25 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: plexus-classworlds noarch 2.6.0-11.el9 CentOS-AppStream 59 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 CentOS-AppStream 17 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: plexus-interpolation noarch 1.26-11.el9 CentOS-AppStream 79 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 CentOS-AppStream 33 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: plexus-utils noarch 3.3.0-10.el9 CentOS-AppStream 253 k 2024-03-04T12:32:57.574 INFO:teuthology.orchestra.run.smithi184.stdout: poppler x86_64 21.01.0-19.el9 CentOS-AppStream 1.1 M 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: poppler-glib x86_64 21.01.0-19.el9 CentOS-AppStream 151 k 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: publicsuffix-list noarch 20210518-3.el9 CentOS-AppStream 82 k 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 45 k 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 131 k 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T12:32:57.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T12:32:57.576 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T12:32:57.577 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T12:32:57.578 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: sisu noarch 1:0.3.4-10.el9 CentOS-AppStream 509 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: slf4j noarch 1.7.30-13.el9 CentOS-AppStream 68 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: tzdata-java noarch 2024a-1.el9 CentOS-AppStream 148 k 2024-03-04T12:32:57.579 INFO:teuthology.orchestra.run.smithi184.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: wireplumber x86_64 0.4.14-1.el9 CentOS-AppStream 83 k 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: wireplumber-libs x86_64 0.4.14-1.el9 CentOS-AppStream 337 k 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 CentOS-AppStream 367 k 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout:Installing weak dependencies: 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: flatpak x86_64 1.12.8-1.el9 CentOS-AppStream 1.7 M 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: java-11-openjdk-devel x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 3.3 M 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 CentOS-AppStream 31 k 2024-03-04T12:32:57.580 INFO:teuthology.orchestra.run.smithi184.stdout: p11-kit-server x86_64 0.24.1-2.el9 appstream 199 k 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout: pipewire x86_64 1.0.1-1.el9 CentOS-AppStream 101 k 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout: pipewire-alsa x86_64 1.0.1-1.el9 CentOS-AppStream 56 k 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 CentOS-AppStream 8.0 k 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 CentOS-AppStream 185 k 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout: tracker-miners x86_64 3.1.2-4.el9 CentOS-AppStream 893 k 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout:=========================================================================================================== 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout:Install 282 Packages 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 2 Packages 2024-03-04T12:32:57.581 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:32:57.582 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 296 M 2024-03-04T12:32:57.582 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-03-04T12:32:57.886 INFO:teuthology.orchestra.run.smithi090.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T12:32:57.887 INFO:teuthology.orchestra.run.smithi090.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T12:32:57.995 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-03-04T12:32:58.028 INFO:teuthology.orchestra.run.smithi090.stdout:=========================================================================================================== 2024-03-04T12:32:58.028 INFO:teuthology.orchestra.run.smithi090.stdout: Package Arch Version Repository Size 2024-03-04T12:32:58.028 INFO:teuthology.orchestra.run.smithi090.stdout:=========================================================================================================== 2024-03-04T12:32:58.028 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2024-03-04T12:32:58.028 INFO:teuthology.orchestra.run.smithi090.stdout: ceph x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 6.6 k 2024-03-04T12:32:58.028 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 5.3 M 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 887 k 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 145 k 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 1.5 M 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 138 k 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 1.8 M 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 7.4 M 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 49 k 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 9.9 M 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 48 M 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 264 k 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 749 k 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 31 k 2024-03-04T12:32:58.029 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 744 k 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 127 k 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout: maven noarch 1:3.6.3-15.el9 CentOS-AppStream 17 k 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 161 k 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 320 k 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 299 k 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 99 k 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 85 k 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 3.1 M 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 171 k 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrading: 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout: librados2 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 3.4 M 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 3.1 M 2024-03-04T12:32:58.030 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: alsa-lib x86_64 1.2.10-2.el9 CentOS-AppStream 504 k 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: apache-commons-cli noarch 1.4-17.el9 CentOS-AppStream 70 k 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: apache-commons-codec noarch 1.15-7.el9 CentOS-AppStream 301 k 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: apache-commons-io noarch 1:2.8.0-8.el9 CentOS-AppStream 282 k 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 CentOS-AppStream 558 k 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: atinject noarch 1.0.3-6.el9 CentOS-AppStream 22 k 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2024-03-04T12:32:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: cdi-api noarch 2.0.2-6.el9 CentOS-AppStream 52 k 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 20 M 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 31 k 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 2.1 M 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 248 k 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 4.7 M 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 17 M 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 16 k 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 25 k 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2024-03-04T12:32:58.032 INFO:teuthology.orchestra.run.smithi090.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: cups-libs x86_64 1:2.3.3op2-24.el9 CentOS-BaseOS 261 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: flatpak-selinux noarch 1.12.8-1.el9 CentOS-AppStream 20 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 CentOS-AppStream 73 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2024-03-04T12:32:58.033 INFO:teuthology.orchestra.run.smithi090.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: google-guice noarch 4.2.3-9.el9 CentOS-AppStream 472 k 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: gstreamer1 x86_64 1.22.1-2.el9 CentOS-AppStream 1.4 M 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 CentOS-AppStream 2.2 M 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: guava noarch 30.1-6.el9 CentOS-AppStream 2.3 M 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: httpcomponents-client noarch 4.5.13-3.el9 CentOS-AppStream 656 k 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: httpcomponents-core noarch 4.4.13-7.el9 CentOS-AppStream 630 k 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2024-03-04T12:32:58.034 INFO:teuthology.orchestra.run.smithi090.stdout: jakarta-annotations noarch 1.3.5-13.el9 CentOS-AppStream 44 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: jansi x86_64 2.3.3-6.el9 CentOS-AppStream 108 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: java-11-openjdk x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 439 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: java-11-openjdk-headless x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 40 M 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 CentOS-AppStream 23 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: jsoup noarch 1.13.1-10.el9 CentOS-AppStream 376 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: jsr-305 noarch 3.0.2-6.el9 CentOS-AppStream 31 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: libX11-xcb x86_64 1.7.0-8.el9 appstream 11 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2024-03-04T12:32:58.035 INFO:teuthology.orchestra.run.smithi090.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2024-03-04T12:32:58.036 INFO:teuthology.orchestra.run.smithi090.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2024-03-04T12:32:58.036 INFO:teuthology.orchestra.run.smithi090.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2024-03-04T12:32:58.036 INFO:teuthology.orchestra.run.smithi090.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2024-03-04T12:32:58.036 INFO:teuthology.orchestra.run.smithi090.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2024-03-04T12:32:58.036 INFO:teuthology.orchestra.run.smithi090.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2024-03-04T12:32:58.036 INFO:teuthology.orchestra.run.smithi090.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2024-03-04T12:32:58.036 INFO:teuthology.orchestra.run.smithi090.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2024-03-04T12:32:58.036 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T12:32:58.036 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T12:32:58.036 INFO:teuthology.orchestra.run.smithi090.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2024-03-04T12:32:58.036 INFO:teuthology.orchestra.run.smithi090.stdout: libcanberra x86_64 0.30-27.el9 CentOS-AppStream 85 k 2024-03-04T12:32:58.036 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 163 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libdrm x86_64 2.4.117-1.el9 CentOS-AppStream 158 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2024-03-04T12:32:58.037 INFO:teuthology.orchestra.run.smithi090.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 501 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 5.2 M 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: libsndfile x86_64 1.0.31-8.el9 CentOS-AppStream 205 k 2024-03-04T12:32:58.038 INFO:teuthology.orchestra.run.smithi090.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libtiff x86_64 4.4.0-12.el9 CentOS-AppStream 197 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libwebp x86_64 1.2.0-8.el9 CentOS-AppStream 276 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2024-03-04T12:32:58.039 INFO:teuthology.orchestra.run.smithi090.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: maven-lib noarch 1:3.6.3-15.el9 CentOS-AppStream 1.5 M 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 CentOS-AppStream 7.9 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: maven-resolver noarch 1:1.6.1-10.el9 CentOS-AppStream 512 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: maven-shared-utils noarch 3.3.4-3.el9 CentOS-AppStream 150 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: maven-wagon noarch 3.4.2-7.el9 CentOS-AppStream 111 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: mesa-libEGL x86_64 23.3.3-1.el9 CentOS-AppStream 126 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: mesa-libGL x86_64 23.3.3-1.el9 CentOS-AppStream 167 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: mesa-libgbm x86_64 23.3.3-1.el9 CentOS-AppStream 37 k 2024-03-04T12:32:58.040 INFO:teuthology.orchestra.run.smithi090.stdout: mesa-libglapi x86_64 23.3.3-1.el9 CentOS-AppStream 43 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: osinfo-db noarch 20231215-1.el9 CentOS-AppStream 283 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: ostree-libs x86_64 2024.4-3.el9 appstream 487 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 CentOS-AppStream 134 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: pipewire-libs x86_64 1.0.1-1.el9 CentOS-AppStream 1.9 M 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: plexus-cipher noarch 1.7-27.el9 CentOS-AppStream 25 k 2024-03-04T12:32:58.041 INFO:teuthology.orchestra.run.smithi090.stdout: plexus-classworlds noarch 2.6.0-11.el9 CentOS-AppStream 59 k 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 CentOS-AppStream 17 k 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: plexus-interpolation noarch 1.26-11.el9 CentOS-AppStream 79 k 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 CentOS-AppStream 33 k 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: plexus-utils noarch 3.3.0-10.el9 CentOS-AppStream 253 k 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: poppler x86_64 21.01.0-19.el9 CentOS-AppStream 1.1 M 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: poppler-glib x86_64 21.01.0-19.el9 CentOS-AppStream 151 k 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: publicsuffix-list noarch 20210518-3.el9 CentOS-AppStream 82 k 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T12:32:58.042 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 45 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 131 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T12:32:58.043 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T12:32:58.044 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T12:32:58.045 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-03-04T12:32:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: sisu noarch 1:0.3.4-10.el9 CentOS-AppStream 509 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: slf4j noarch 1.7.30-13.el9 CentOS-AppStream 68 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: tzdata-java noarch 2024a-1.el9 CentOS-AppStream 148 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: wireplumber x86_64 0.4.14-1.el9 CentOS-AppStream 83 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: wireplumber-libs x86_64 0.4.14-1.el9 CentOS-AppStream 337 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2024-03-04T12:32:58.047 INFO:teuthology.orchestra.run.smithi090.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 CentOS-AppStream 367 k 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout:Installing weak dependencies: 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: flatpak x86_64 1.12.8-1.el9 CentOS-AppStream 1.7 M 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: java-11-openjdk-devel x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 3.3 M 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 CentOS-AppStream 31 k 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: p11-kit-server x86_64 0.24.1-2.el9 appstream 199 k 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: pipewire x86_64 1.0.1-1.el9 CentOS-AppStream 101 k 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: pipewire-alsa x86_64 1.0.1-1.el9 CentOS-AppStream 56 k 2024-03-04T12:32:58.048 INFO:teuthology.orchestra.run.smithi090.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 CentOS-AppStream 8.0 k 2024-03-04T12:32:58.049 INFO:teuthology.orchestra.run.smithi090.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 CentOS-AppStream 185 k 2024-03-04T12:32:58.049 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-03-04T12:32:58.049 INFO:teuthology.orchestra.run.smithi090.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2024-03-04T12:32:58.049 INFO:teuthology.orchestra.run.smithi090.stdout: tracker-miners x86_64 3.1.2-4.el9 CentOS-AppStream 893 k 2024-03-04T12:32:58.049 INFO:teuthology.orchestra.run.smithi090.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2024-03-04T12:32:58.049 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:32:58.049 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-03-04T12:32:58.049 INFO:teuthology.orchestra.run.smithi090.stdout:=========================================================================================================== 2024-03-04T12:32:58.049 INFO:teuthology.orchestra.run.smithi090.stdout:Install 282 Packages 2024-03-04T12:32:58.049 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrade 2 Packages 2024-03-04T12:32:58.049 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:32:58.050 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 296 M 2024-03-04T12:32:58.050 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-03-04T12:32:58.327 INFO:teuthology.orchestra.run.smithi184.stdout:(1/284): ceph-19.0.0-1871.g3aec3903.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-03-04T12:32:58.560 INFO:teuthology.orchestra.run.smithi090.stdout:(1/284): ceph-19.0.0-1871.g3aec3903.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-03-04T12:32:58.586 INFO:teuthology.orchestra.run.smithi184.stdout:(2/284): ceph-fuse-19.0.0-1871.g3aec3903.el9.x8 3.4 MB/s | 887 kB 00:00 2024-03-04T12:32:58.661 INFO:teuthology.orchestra.run.smithi184.stdout:(3/284): ceph-immutable-object-cache-19.0.0-187 1.9 MB/s | 145 kB 00:00 2024-03-04T12:32:59.086 INFO:teuthology.orchestra.run.smithi184.stdout:(4/284): ceph-mds-19.0.0-1871.g3aec3903.el9.x86 5.0 MB/s | 2.1 MB 00:00 2024-03-04T12:32:59.170 INFO:teuthology.orchestra.run.smithi184.stdout:(5/284): ceph-base-19.0.0-1871.g3aec3903.el9.x8 5.0 MB/s | 5.3 MB 00:01 2024-03-04T12:32:59.318 INFO:teuthology.orchestra.run.smithi090.stdout:(2/284): ceph-fuse-19.0.0-1871.g3aec3903.el9.x8 1.1 MB/s | 887 kB 00:00 2024-03-04T12:32:59.387 INFO:teuthology.orchestra.run.smithi184.stdout:(6/284): ceph-mgr-19.0.0-1871.g3aec3903.el9.x86 5.0 MB/s | 1.5 MB 00:00 2024-03-04T12:32:59.493 INFO:teuthology.orchestra.run.smithi090.stdout:(3/284): ceph-immutable-object-cache-19.0.0-187 830 kB/s | 145 kB 00:00 2024-03-04T12:32:59.887 INFO:teuthology.orchestra.run.smithi184.stdout:(7/284): ceph-mon-19.0.0-1871.g3aec3903.el9.x86 6.5 MB/s | 4.7 MB 00:00 2024-03-04T12:33:01.202 INFO:teuthology.orchestra.run.smithi090.stdout:(4/284): ceph-base-19.0.0-1871.g3aec3903.el9.x8 1.9 MB/s | 5.3 MB 00:02 2024-03-04T12:33:01.262 INFO:teuthology.orchestra.run.smithi184.stdout:(8/284): ceph-osd-19.0.0-1871.g3aec3903.el9.x86 9.0 MB/s | 17 MB 00:01 2024-03-04T12:33:01.337 INFO:teuthology.orchestra.run.smithi184.stdout:(9/284): ceph-selinux-19.0.0-1871.g3aec3903.el9 337 kB/s | 25 kB 00:00 2024-03-04T12:33:01.519 INFO:teuthology.orchestra.run.smithi090.stdout:(5/284): ceph-mds-19.0.0-1871.g3aec3903.el9.x86 1.0 MB/s | 2.1 MB 00:02 2024-03-04T12:33:01.629 INFO:teuthology.orchestra.run.smithi184.stdout:(10/284): ceph-common-19.0.0-1871.g3aec3903.el9 5.7 MB/s | 20 MB 00:03 2024-03-04T12:33:01.703 INFO:teuthology.orchestra.run.smithi090.stdout:(6/284): ceph-mgr-19.0.0-1871.g3aec3903.el9.x86 3.0 MB/s | 1.5 MB 00:00 2024-03-04T12:33:01.713 INFO:teuthology.orchestra.run.smithi184.stdout:(11/284): libcephfs-devel-19.0.0-1871.g3aec3903 374 kB/s | 31 kB 00:00 2024-03-04T12:33:01.863 INFO:teuthology.orchestra.run.smithi184.stdout:(12/284): ceph-radosgw-19.0.0-1871.g3aec3903.el 5.0 MB/s | 9.9 MB 00:01 2024-03-04T12:33:01.972 INFO:teuthology.orchestra.run.smithi184.stdout:(13/284): libcephsqlite-19.0.0-1871.g3aec3903.e 1.5 MB/s | 163 kB 00:00 2024-03-04T12:33:02.014 INFO:teuthology.orchestra.run.smithi184.stdout:(14/284): libcephfs2-19.0.0-1871.g3aec3903.el9. 2.4 MB/s | 744 kB 00:00 2024-03-04T12:33:02.072 INFO:teuthology.orchestra.run.smithi184.stdout:(15/284): librados-devel-19.0.0-1871.g3aec3903. 1.2 MB/s | 127 kB 00:00 2024-03-04T12:33:02.489 INFO:teuthology.orchestra.run.smithi184.stdout:(16/284): libradosstriper1-19.0.0-1871.g3aec390 1.0 MB/s | 501 kB 00:00 2024-03-04T12:33:02.598 INFO:teuthology.orchestra.run.smithi184.stdout:(17/284): python3-ceph-argparse-19.0.0-1871.g3a 416 kB/s | 45 kB 00:00 2024-03-04T12:33:02.782 INFO:teuthology.orchestra.run.smithi184.stdout:(18/284): python3-ceph-common-19.0.0-1871.g3aec 714 kB/s | 131 kB 00:00 2024-03-04T12:33:02.974 INFO:teuthology.orchestra.run.smithi184.stdout:(19/284): python3-cephfs-19.0.0-1871.g3aec3903. 843 kB/s | 161 kB 00:00 2024-03-04T12:33:03.211 INFO:teuthology.orchestra.run.smithi090.stdout:(7/284): ceph-common-19.0.0-1871.g3aec3903.el9. 4.1 MB/s | 20 MB 00:04 2024-03-04T12:33:03.224 INFO:teuthology.orchestra.run.smithi184.stdout:(20/284): python3-rados-19.0.0-1871.g3aec3903.e 1.3 MB/s | 320 kB 00:00 2024-03-04T12:33:03.433 INFO:teuthology.orchestra.run.smithi184.stdout:(21/284): python3-rbd-19.0.0-1871.g3aec3903.el9 1.4 MB/s | 299 kB 00:00 2024-03-04T12:33:03.778 INFO:teuthology.orchestra.run.smithi184.stdout:(22/284): librgw2-19.0.0-1871.g3aec3903.el9.x86 3.6 MB/s | 5.2 MB 00:01 2024-03-04T12:33:03.778 INFO:teuthology.orchestra.run.smithi184.stdout:(23/284): python3-rgw-19.0.0-1871.g3aec3903.el9 993 kB/s | 99 kB 00:00 2024-03-04T12:33:03.778 INFO:teuthology.orchestra.run.smithi184.stdout:(24/284): rbd-fuse-19.0.0-1871.g3aec3903.el9.x8 787 kB/s | 85 kB 00:00 2024-03-04T12:33:03.779 INFO:teuthology.orchestra.run.smithi184.stdout:(25/284): rbd-nbd-19.0.0-1871.g3aec3903.el9.x86 1.5 MB/s | 171 kB 00:00 2024-03-04T12:33:03.834 INFO:teuthology.orchestra.run.smithi184.stdout:(26/284): ceph-grafana-dashboards-19.0.0-1871.g 290 kB/s | 31 kB 00:00 2024-03-04T12:33:03.951 INFO:teuthology.orchestra.run.smithi184.stdout:(27/284): ceph-mgr-cephadm-19.0.0-1871.g3aec390 1.2 MB/s | 138 kB 00:00 2024-03-04T12:33:04.679 INFO:teuthology.orchestra.run.smithi184.stdout:(28/284): ceph-test-19.0.0-1871.g3aec3903.el9.x 14 MB/s | 48 MB 00:03 2024-03-04T12:33:04.727 INFO:teuthology.orchestra.run.smithi184.stdout:(29/284): ceph-mgr-dashboard-19.0.0-1871.g3aec3 2.3 MB/s | 1.8 MB 00:00 2024-03-04T12:33:04.902 INFO:teuthology.orchestra.run.smithi184.stdout:(30/284): rbd-mirror-19.0.0-1871.g3aec3903.el9. 2.3 MB/s | 3.1 MB 00:01 2024-03-04T12:33:04.920 INFO:teuthology.orchestra.run.smithi090.stdout:(8/284): ceph-radosgw-19.0.0-1871.g3aec3903.el9 5.8 MB/s | 9.9 MB 00:01 2024-03-04T12:33:04.927 INFO:teuthology.orchestra.run.smithi184.stdout:(31/284): ceph-mgr-modules-core-19.0.0-1871.g3a 1.2 MB/s | 248 kB 00:00 2024-03-04T12:33:04.994 INFO:teuthology.orchestra.run.smithi184.stdout:(32/284): ceph-mgr-rook-19.0.0-1871.g3aec3903.e 537 kB/s | 49 kB 00:00 2024-03-04T12:33:05.019 INFO:teuthology.orchestra.run.smithi184.stdout:(33/284): ceph-prometheus-alerts-19.0.0-1871.g3 179 kB/s | 16 kB 00:00 2024-03-04T12:33:05.020 INFO:teuthology.orchestra.run.smithi090.stdout:(9/284): ceph-mon-19.0.0-1871.g3aec3903.el9.x86 1.3 MB/s | 4.7 MB 00:03 2024-03-04T12:33:05.046 INFO:teuthology.orchestra.run.smithi090.stdout:(10/284): ceph-selinux-19.0.0-1871.g3aec3903.el 201 kB/s | 25 kB 00:00 2024-03-04T12:33:05.096 INFO:teuthology.orchestra.run.smithi090.stdout:(11/284): libcephfs-devel-19.0.0-1871.g3aec3903 624 kB/s | 31 kB 00:00 2024-03-04T12:33:05.170 INFO:teuthology.orchestra.run.smithi184.stdout:(34/284): ceph-mgr-diskprediction-local-19.0.0- 15 MB/s | 7.4 MB 00:00 2024-03-04T12:33:05.195 INFO:teuthology.orchestra.run.smithi184.stdout:(35/284): ceph-volume-19.0.0-1871.g3aec3903.el9 1.3 MB/s | 264 kB 00:00 2024-03-04T12:33:05.205 INFO:teuthology.orchestra.run.smithi090.stdout:(12/284): libcephfs2-19.0.0-1871.g3aec3903.el9. 6.7 MB/s | 744 kB 00:00 2024-03-04T12:33:05.263 INFO:teuthology.orchestra.run.smithi090.stdout:(13/284): libcephsqlite-19.0.0-1871.g3aec3903.e 2.7 MB/s | 163 kB 00:00 2024-03-04T12:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout:(36/284): cephadm-19.0.0-1871.g3aec3903.el9.noa 2.7 MB/s | 749 kB 00:00 2024-03-04T12:33:05.313 INFO:teuthology.orchestra.run.smithi090.stdout:(14/284): librados-devel-19.0.0-1871.g3aec3903. 2.5 MB/s | 127 kB 00:00 2024-03-04T12:33:05.397 INFO:teuthology.orchestra.run.smithi090.stdout:(15/284): libradosstriper1-19.0.0-1871.g3aec390 5.9 MB/s | 501 kB 00:00 2024-03-04T12:33:05.437 INFO:teuthology.orchestra.run.smithi184.stdout:(37/284): adwaita-cursor-theme-40.1.1-3.el9.noa 2.3 MB/s | 625 kB 00:00 2024-03-04T12:33:05.521 INFO:teuthology.orchestra.run.smithi184.stdout:(38/284): alsa-lib-1.2.10-2.el9.x86_64.rpm 2.1 MB/s | 504 kB 00:00 2024-03-04T12:33:05.571 INFO:teuthology.orchestra.run.smithi184.stdout:(39/284): apache-commons-cli-1.4-17.el9.noarch. 525 kB/s | 70 kB 00:00 2024-03-04T12:33:05.596 INFO:teuthology.orchestra.run.smithi184.stdout:(40/284): apache-commons-codec-1.15-7.el9.noarc 3.9 MB/s | 301 kB 00:00 2024-03-04T12:33:05.638 INFO:teuthology.orchestra.run.smithi184.stdout:(41/284): apache-commons-io-2.8.0-8.el9.noarch. 4.2 MB/s | 282 kB 00:00 2024-03-04T12:33:05.680 INFO:teuthology.orchestra.run.smithi184.stdout:(42/284): apache-commons-lang3-3.12.0-6.el9.noa 6.5 MB/s | 558 kB 00:00 2024-03-04T12:33:05.706 INFO:teuthology.orchestra.run.smithi184.stdout:(43/284): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2024-03-04T12:33:05.740 INFO:teuthology.orchestra.run.smithi184.stdout:(44/284): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.0 MB/s | 176 kB 00:00 2024-03-04T12:33:05.765 INFO:teuthology.orchestra.run.smithi184.stdout:(45/284): atinject-1.0.3-6.el9.noarch.rpm 379 kB/s | 22 kB 00:00 2024-03-04T12:33:05.790 INFO:teuthology.orchestra.run.smithi184.stdout:(46/284): atk-2.36.0-5.el9.x86_64.rpm 5.3 MB/s | 270 kB 00:00 2024-03-04T12:33:05.824 INFO:teuthology.orchestra.run.smithi184.stdout:(47/284): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-03-04T12:33:05.849 INFO:teuthology.orchestra.run.smithi184.stdout:(48/284): cdi-api-2.0.2-6.el9.noarch.rpm 893 kB/s | 52 kB 00:00 2024-03-04T12:33:05.874 INFO:teuthology.orchestra.run.smithi184.stdout:(49/284): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 228 kB 00:00 2024-03-04T12:33:05.900 INFO:teuthology.orchestra.run.smithi184.stdout:(50/284): copy-jdk-configs-4.0-3.el9.noarch.rpm 547 kB/s | 27 kB 00:00 2024-03-04T12:33:05.923 INFO:teuthology.orchestra.run.smithi090.stdout:(16/284): librgw2-19.0.0-1871.g3aec3903.el9.x86 9.9 MB/s | 5.2 MB 00:00 2024-03-04T12:33:05.942 INFO:teuthology.orchestra.run.smithi184.stdout:(51/284): dconf-0.40.0-6.el9.x86_64.rpm 1.6 MB/s | 108 kB 00:00 2024-03-04T12:33:05.967 INFO:teuthology.orchestra.run.smithi184.stdout:(52/284): exempi-2.6.0-0.2.20211007gite23c213.e 7.6 MB/s | 524 kB 00:00 2024-03-04T12:33:06.017 INFO:teuthology.orchestra.run.smithi184.stdout:(53/284): exiv2-0.27.5-2.el9.x86_64.rpm 13 MB/s | 978 kB 00:00 2024-03-04T12:33:06.059 INFO:teuthology.orchestra.run.smithi184.stdout:(54/284): exiv2-libs-0.27.5-2.el9.x86_64.rpm 8.3 MB/s | 780 kB 00:00 2024-03-04T12:33:06.093 INFO:teuthology.orchestra.run.smithi184.stdout:(55/284): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 4.3 MB/s | 324 kB 00:00 2024-03-04T12:33:06.123 INFO:teuthology.orchestra.run.smithi090.stdout:(17/284): ceph-osd-19.0.0-1871.g3aec3903.el9.x8 3.8 MB/s | 17 MB 00:04 2024-03-04T12:33:06.148 INFO:teuthology.orchestra.run.smithi090.stdout:(18/284): python3-ceph-argparse-19.0.0-1871.g3a 200 kB/s | 45 kB 00:00 2024-03-04T12:33:06.151 INFO:teuthology.orchestra.run.smithi184.stdout:(56/284): flatpak-1.12.8-1.el9.x86_64.rpm 19 MB/s | 1.7 MB 00:00 2024-03-04T12:33:06.177 INFO:teuthology.orchestra.run.smithi184.stdout:(57/284): flatpak-selinux-1.12.8-1.el9.noarch.r 250 kB/s | 20 kB 00:00 2024-03-04T12:33:06.202 INFO:teuthology.orchestra.run.smithi184.stdout:(58/284): flatpak-session-helper-1.12.8-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-03-04T12:33:06.228 INFO:teuthology.orchestra.run.smithi184.stdout:(59/284): flexiblas-3.0.4-8.el9.x86_64.rpm 638 kB/s | 32 kB 00:00 2024-03-04T12:33:06.233 INFO:teuthology.orchestra.run.smithi090.stdout:(19/284): python3-cephfs-19.0.0-1871.g3aec3903. 1.9 MB/s | 161 kB 00:00 2024-03-04T12:33:06.258 INFO:teuthology.orchestra.run.smithi090.stdout:(20/284): python3-ceph-common-19.0.0-1871.g3aec 971 kB/s | 131 kB 00:00 2024-03-04T12:33:06.309 INFO:teuthology.orchestra.run.smithi090.stdout:(21/284): python3-rados-19.0.0-1871.g3aec3903.e 4.2 MB/s | 320 kB 00:00 2024-03-04T12:33:06.328 INFO:teuthology.orchestra.run.smithi184.stdout:(60/284): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-03-04T12:33:06.351 INFO:teuthology.orchestra.run.smithi090.stdout:(22/284): python3-rgw-19.0.0-1871.g3aec3903.el9 2.3 MB/s | 99 kB 00:00 2024-03-04T12:33:06.353 INFO:teuthology.orchestra.run.smithi184.stdout:(61/284): flexiblas-openblas-openmp-3.0.4-8.el9 137 kB/s | 17 kB 00:00 2024-03-04T12:33:06.395 INFO:teuthology.orchestra.run.smithi184.stdout:(62/284): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 1.2 MB/s | 84 kB 00:00 2024-03-04T12:33:06.401 INFO:teuthology.orchestra.run.smithi090.stdout:(23/284): python3-rbd-19.0.0-1871.g3aec3903.el9 2.1 MB/s | 299 kB 00:00 2024-03-04T12:33:06.420 INFO:teuthology.orchestra.run.smithi184.stdout:(63/284): geoclue2-2.6.0-7.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2024-03-04T12:33:06.426 INFO:teuthology.orchestra.run.smithi090.stdout:(24/284): rbd-fuse-19.0.0-1871.g3aec3903.el9.x8 1.1 MB/s | 85 kB 00:00 2024-03-04T12:33:06.446 INFO:teuthology.orchestra.run.smithi184.stdout:(64/284): giflib-5.2.1-9.el9.x86_64.rpm 966 kB/s | 47 kB 00:00 2024-03-04T12:33:06.477 INFO:teuthology.orchestra.run.smithi090.stdout:(25/284): rbd-nbd-19.0.0-1871.g3aec3903.el9.x86 3.3 MB/s | 171 kB 00:00 2024-03-04T12:33:06.496 INFO:teuthology.orchestra.run.smithi184.stdout:(65/284): google-guice-4.2.3-9.el9.noarch.rpm 6.2 MB/s | 472 kB 00:00 2024-03-04T12:33:06.519 INFO:teuthology.orchestra.run.smithi090.stdout:(26/284): ceph-grafana-dashboards-19.0.0-1871.g 761 kB/s | 31 kB 00:00 2024-03-04T12:33:06.521 INFO:teuthology.orchestra.run.smithi184.stdout:(66/284): graphene-1.10.6-2.el9.x86_64.rpm 843 kB/s | 63 kB 00:00 2024-03-04T12:33:06.547 INFO:teuthology.orchestra.run.smithi184.stdout:(67/284): gsm-1.0.19-6.el9.x86_64.rpm 667 kB/s | 33 kB 00:00 2024-03-04T12:33:06.569 INFO:teuthology.orchestra.run.smithi090.stdout:(27/284): ceph-mgr-cephadm-19.0.0-1871.g3aec390 2.7 MB/s | 138 kB 00:00 2024-03-04T12:33:06.613 INFO:teuthology.orchestra.run.smithi184.stdout:(68/284): gstreamer1-1.22.1-2.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-03-04T12:33:06.761 INFO:teuthology.orchestra.run.smithi090.stdout:(28/284): ceph-mgr-dashboard-19.0.0-1871.g3aec3 9.3 MB/s | 1.8 MB 00:00 2024-03-04T12:33:06.764 INFO:teuthology.orchestra.run.smithi184.stdout:(69/284): adwaita-icon-theme-40.1.1-3.el9.noarc 6.8 MB/s | 11 MB 00:01 2024-03-04T12:33:06.806 INFO:teuthology.orchestra.run.smithi184.stdout:(70/284): gstreamer1-plugins-base-1.22.1-2.el9. 8.5 MB/s | 2.2 MB 00:00 2024-03-04T12:33:06.822 INFO:teuthology.orchestra.run.smithi184.stdout:(71/284): gtk-update-icon-cache-3.24.31-2.el9.x 166 kB/s | 34 kB 00:00 2024-03-04T12:33:06.990 INFO:teuthology.orchestra.run.smithi184.stdout:(72/284): gtk3-3.24.31-2.el9.x86_64.rpm 22 MB/s | 4.8 MB 00:00 2024-03-04T12:33:07.124 INFO:teuthology.orchestra.run.smithi184.stdout:(73/284): hicolor-icon-theme-0.17-13.el9.noarch 219 kB/s | 65 kB 00:00 2024-03-04T12:33:07.178 INFO:teuthology.orchestra.run.smithi090.stdout:(29/284): rbd-mirror-19.0.0-1871.g3aec3903.el9. 4.0 MB/s | 3.1 MB 00:00 2024-03-04T12:33:07.232 INFO:teuthology.orchestra.run.smithi184.stdout:(74/284): guava-30.1-6.el9.noarch.rpm 5.7 MB/s | 2.3 MB 00:00 2024-03-04T12:33:07.253 INFO:teuthology.orchestra.run.smithi090.stdout:(30/284): ceph-mgr-modules-core-19.0.0-1871.g3a 3.2 MB/s | 248 kB 00:00 2024-03-04T12:33:07.266 INFO:teuthology.orchestra.run.smithi184.stdout:(75/284): httpcomponents-client-4.5.13-3.el9.no 2.3 MB/s | 656 kB 00:00 2024-03-04T12:33:07.291 INFO:teuthology.orchestra.run.smithi184.stdout:(76/284): httpcomponents-core-4.4.13-7.el9.noar 3.8 MB/s | 630 kB 00:00 2024-03-04T12:33:07.316 INFO:teuthology.orchestra.run.smithi184.stdout:(77/284): jakarta-annotations-1.3.5-13.el9.noar 903 kB/s | 44 kB 00:00 2024-03-04T12:33:07.329 INFO:teuthology.orchestra.run.smithi090.stdout:(31/284): ceph-mgr-rook-19.0.0-1871.g3aec3903.e 659 kB/s | 49 kB 00:00 2024-03-04T12:33:07.413 INFO:teuthology.orchestra.run.smithi090.stdout:(32/284): ceph-prometheus-alerts-19.0.0-1871.g3 197 kB/s | 16 kB 00:00 2024-03-04T12:33:07.425 INFO:teuthology.orchestra.run.smithi184.stdout:(78/284): iso-codes-4.6.0-3.el9.noarch.rpm 21 MB/s | 3.3 MB 00:00 2024-03-04T12:33:07.450 INFO:teuthology.orchestra.run.smithi184.stdout:(79/284): jansi-2.3.3-6.el9.x86_64.rpm 687 kB/s | 108 kB 00:00 2024-03-04T12:33:07.475 INFO:teuthology.orchestra.run.smithi184.stdout:(80/284): java-11-openjdk-11.0.18.0.10-3.el9.x8 2.7 MB/s | 439 kB 00:00 2024-03-04T12:33:07.521 INFO:teuthology.orchestra.run.smithi090.stdout:(33/284): ceph-mgr-diskprediction-local-19.0.0- 9.7 MB/s | 7.4 MB 00:00 2024-03-04T12:33:07.546 INFO:teuthology.orchestra.run.smithi090.stdout:(34/284): ceph-volume-19.0.0-1871.g3aec3903.el9 1.9 MB/s | 264 kB 00:00 2024-03-04T12:33:07.567 INFO:teuthology.orchestra.run.smithi184.stdout:(81/284): java-11-openjdk-devel-11.0.18.0.10-3. 23 MB/s | 3.3 MB 00:00 2024-03-04T12:33:07.592 INFO:teuthology.orchestra.run.smithi184.stdout:(82/284): javapackages-filesystem-6.0.0-4.el9.n 92 kB/s | 10 kB 00:00 2024-03-04T12:33:07.647 INFO:teuthology.orchestra.run.smithi090.stdout:(35/284): cephadm-19.0.0-1871.g3aec3903.el9.noa 5.8 MB/s | 749 kB 00:00 2024-03-04T12:33:07.810 INFO:teuthology.orchestra.run.smithi184.stdout:(83/284): jbigkit-libs-2.1-23.el9.x86_64.rpm 215 kB/s | 52 kB 00:00 2024-03-04T12:33:07.893 INFO:teuthology.orchestra.run.smithi184.stdout:(84/284): jcl-over-slf4j-1.7.30-13.el9.noarch.r 77 kB/s | 23 kB 00:00 2024-03-04T12:33:08.131 INFO:teuthology.orchestra.run.smithi090.stdout:(36/284): adwaita-cursor-theme-40.1.1-3.el9.noa 1.0 MB/s | 625 kB 00:00 2024-03-04T12:33:08.160 INFO:teuthology.orchestra.run.smithi184.stdout:(85/284): jsoup-1.13.1-10.el9.noarch.rpm 1.1 MB/s | 376 kB 00:00 2024-03-04T12:33:08.185 INFO:teuthology.orchestra.run.smithi184.stdout:(86/284): jsr-305-3.0.2-6.el9.noarch.rpm 106 kB/s | 31 kB 00:00 2024-03-04T12:33:08.397 INFO:teuthology.orchestra.run.smithi090.stdout:(37/284): alsa-lib-1.2.10-2.el9.x86_64.rpm 1.9 MB/s | 504 kB 00:00 2024-03-04T12:33:08.727 INFO:teuthology.orchestra.run.smithi184.stdout:(87/284): java-11-openjdk-headless-11.0.18.0.10 32 MB/s | 40 MB 00:01 2024-03-04T12:33:08.752 INFO:teuthology.orchestra.run.smithi184.stdout:(88/284): lcms2-2.12-3.el9.x86_64.rpm 281 kB/s | 166 kB 00:00 2024-03-04T12:33:08.778 INFO:teuthology.orchestra.run.smithi184.stdout:(89/284): libXcomposite-0.4.5-7.el9.x86_64.rpm 39 kB/s | 23 kB 00:00 2024-03-04T12:33:08.803 INFO:teuthology.orchestra.run.smithi184.stdout:(90/284): libXcursor-1.2.0-7.el9.x86_64.rpm 398 kB/s | 30 kB 00:00 2024-03-04T12:33:08.806 INFO:teuthology.orchestra.run.smithi090.stdout:(38/284): adwaita-icon-theme-40.1.1-3.el9.noarc 9.2 MB/s | 11 MB 00:01 2024-03-04T12:33:08.828 INFO:teuthology.orchestra.run.smithi184.stdout:(91/284): libXfixes-5.0.3-16.el9.x86_64.rpm 375 kB/s | 19 kB 00:00 2024-03-04T12:33:08.831 INFO:teuthology.orchestra.run.smithi090.stdout:(39/284): apache-commons-cli-1.4-17.el9.noarch. 161 kB/s | 70 kB 00:00 2024-03-04T12:33:08.853 INFO:teuthology.orchestra.run.smithi184.stdout:(92/284): libXdamage-1.1.5-7.el9.x86_64.rpm 289 kB/s | 22 kB 00:00 2024-03-04T12:33:08.857 INFO:teuthology.orchestra.run.smithi090.stdout:(40/284): apache-commons-codec-1.15-7.el9.noarc 5.9 MB/s | 301 kB 00:00 2024-03-04T12:33:08.878 INFO:teuthology.orchestra.run.smithi184.stdout:(93/284): libXi-1.7.10-8.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-03-04T12:33:08.899 INFO:teuthology.orchestra.run.smithi090.stdout:(41/284): apache-commons-io-2.8.0-8.el9.noarch. 4.1 MB/s | 282 kB 00:00 2024-03-04T12:33:08.904 INFO:teuthology.orchestra.run.smithi184.stdout:(94/284): libXinerama-1.1.4-10.el9.x86_64.rpm 186 kB/s | 14 kB 00:00 2024-03-04T12:33:08.929 INFO:teuthology.orchestra.run.smithi184.stdout:(95/284): libXrandr-1.5.2-8.el9.x86_64.rpm 545 kB/s | 27 kB 00:00 2024-03-04T12:33:08.932 INFO:teuthology.orchestra.run.smithi090.stdout:(42/284): apache-commons-lang3-3.12.0-6.el9.noa 7.3 MB/s | 558 kB 00:00 2024-03-04T12:33:08.954 INFO:teuthology.orchestra.run.smithi184.stdout:(96/284): libXtst-1.2.3-16.el9.x86_64.rpm 270 kB/s | 20 kB 00:00 2024-03-04T12:33:08.967 INFO:teuthology.orchestra.run.smithi090.stdout:(43/284): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2024-03-04T12:33:08.980 INFO:teuthology.orchestra.run.smithi184.stdout:(97/284): libXv-1.0.11-16.el9.x86_64.rpm 240 kB/s | 18 kB 00:00 2024-03-04T12:33:09.001 INFO:teuthology.orchestra.run.smithi090.stdout:(44/284): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.5 MB/s | 176 kB 00:00 2024-03-04T12:33:09.005 INFO:teuthology.orchestra.run.smithi184.stdout:(98/284): libXxf86vm-1.1.4-18.el9.x86_64.rpm 355 kB/s | 18 kB 00:00 2024-03-04T12:33:09.026 INFO:teuthology.orchestra.run.smithi090.stdout:(45/284): atinject-1.0.3-6.el9.noarch.rpm 379 kB/s | 22 kB 00:00 2024-03-04T12:33:09.030 INFO:teuthology.orchestra.run.smithi184.stdout:(99/284): libasyncns-0.8-22.el9.x86_64.rpm 391 kB/s | 29 kB 00:00 2024-03-04T12:33:09.055 INFO:teuthology.orchestra.run.smithi184.stdout:(100/284): libcanberra-0.30-27.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2024-03-04T12:33:09.068 INFO:teuthology.orchestra.run.smithi090.stdout:(46/284): atk-2.36.0-5.el9.x86_64.rpm 4.0 MB/s | 270 kB 00:00 2024-03-04T12:33:09.080 INFO:teuthology.orchestra.run.smithi184.stdout:(101/284): libcanberra-gtk3-0.30-27.el9.x86_64. 408 kB/s | 31 kB 00:00 2024-03-04T12:33:09.093 INFO:teuthology.orchestra.run.smithi090.stdout:(47/284): boost-program-options-1.75.0-8.el9.x8 1.5 MB/s | 106 kB 00:00 2024-03-04T12:33:09.119 INFO:teuthology.orchestra.run.smithi090.stdout:(48/284): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 52 kB 00:00 2024-03-04T12:33:09.122 INFO:teuthology.orchestra.run.smithi184.stdout:(102/284): libdrm-2.4.117-1.el9.x86_64.rpm 2.3 MB/s | 158 kB 00:00 2024-03-04T12:33:09.144 INFO:teuthology.orchestra.run.smithi090.stdout:(49/284): colord-libs-1.4.5-4.el9.x86_64.rpm 4.4 MB/s | 228 kB 00:00 2024-03-04T12:33:09.156 INFO:teuthology.orchestra.run.smithi184.stdout:(103/284): libepoxy-1.5.5-4.el9.x86_64.rpm 2.3 MB/s | 240 kB 00:00 2024-03-04T12:33:09.161 INFO:teuthology.orchestra.run.smithi090.stdout:(50/284): copy-jdk-configs-4.0-3.el9.noarch.rpm 646 kB/s | 27 kB 00:00 2024-03-04T12:33:09.183 INFO:teuthology.orchestra.run.smithi184.stdout:(104/284): libexif-0.6.22-6.el9.x86_64.rpm 4.2 MB/s | 431 kB 00:00 2024-03-04T12:33:09.195 INFO:teuthology.orchestra.run.smithi090.stdout:(51/284): dconf-0.40.0-6.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-04T12:33:09.207 INFO:teuthology.orchestra.run.smithi184.stdout:(105/284): libfontenc-1.1.3-17.el9.x86_64.rpm 362 kB/s | 30 kB 00:00 2024-03-04T12:33:09.245 INFO:teuthology.orchestra.run.smithi090.stdout:(52/284): exempi-2.6.0-0.2.20211007gite23c213.e 6.1 MB/s | 524 kB 00:00 2024-03-04T12:33:09.249 INFO:teuthology.orchestra.run.smithi184.stdout:(106/284): libglvnd-1.3.4-1.el9.x86_64.rpm 2.0 MB/s | 134 kB 00:00 2024-03-04T12:33:09.274 INFO:teuthology.orchestra.run.smithi184.stdout:(107/284): libgexiv2-0.12.3-1.el9.x86_64.rpm 886 kB/s | 82 kB 00:00 2024-03-04T12:33:09.287 INFO:teuthology.orchestra.run.smithi090.stdout:(53/284): exiv2-0.27.5-2.el9.x86_64.rpm 10 MB/s | 978 kB 00:00 2024-03-04T12:33:09.299 INFO:teuthology.orchestra.run.smithi184.stdout:(108/284): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 386 kB/s | 36 kB 00:00 2024-03-04T12:33:09.324 INFO:teuthology.orchestra.run.smithi184.stdout:(109/284): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 141 kB 00:00 2024-03-04T12:33:09.337 INFO:teuthology.orchestra.run.smithi090.stdout:(54/284): exiv2-libs-0.27.5-2.el9.x86_64.rpm 8.4 MB/s | 780 kB 00:00 2024-03-04T12:33:09.363 INFO:teuthology.orchestra.run.smithi090.stdout:(55/284): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 4.3 MB/s | 324 kB 00:00 2024-03-04T12:33:09.366 INFO:teuthology.orchestra.run.smithi184.stdout:(110/284): libgsf-1.14.47-5.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-03-04T12:33:09.392 INFO:teuthology.orchestra.run.smithi184.stdout:(111/284): libgxps-0.3.2-3.el9.x86_64.rpm 849 kB/s | 78 kB 00:00 2024-03-04T12:33:09.417 INFO:teuthology.orchestra.run.smithi184.stdout:(112/284): libiptcdata-1.0.5-9.el9.x86_64.rpm 658 kB/s | 61 kB 00:00 2024-03-04T12:33:09.442 INFO:teuthology.orchestra.run.smithi184.stdout:(113/284): libldac-2.0.2.3-10.el9.x86_64.rpm 534 kB/s | 40 kB 00:00 2024-03-04T12:33:09.476 INFO:teuthology.orchestra.run.smithi184.stdout:(114/284): libnotify-0.7.9-8.el9.x86_64.rpm 732 kB/s | 43 kB 00:00 2024-03-04T12:33:09.501 INFO:teuthology.orchestra.run.smithi184.stdout:(115/284): libogg-1.3.4-6.el9.x86_64.rpm 389 kB/s | 32 kB 00:00 2024-03-04T12:33:09.505 INFO:teuthology.orchestra.run.smithi090.stdout:(56/284): flatpak-1.12.8-1.el9.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2024-03-04T12:33:09.527 INFO:teuthology.orchestra.run.smithi184.stdout:(116/284): libosinfo-1.10.0-1.el9.x86_64.rpm 3.6 MB/s | 312 kB 00:00 2024-03-04T12:33:09.530 INFO:teuthology.orchestra.run.smithi090.stdout:(57/284): flatpak-selinux-1.12.8-1.el9.noarch.r 121 kB/s | 20 kB 00:00 2024-03-04T12:33:09.552 INFO:teuthology.orchestra.run.smithi184.stdout:(117/284): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-03-04T12:33:09.564 INFO:teuthology.orchestra.run.smithi090.stdout:(58/284): flatpak-session-helper-1.12.8-1.el9.x 1.2 MB/s | 73 kB 00:00 2024-03-04T12:33:09.577 INFO:teuthology.orchestra.run.smithi184.stdout:(118/284): librabbitmq-0.11.0-7.el9.x86_64.rpm 591 kB/s | 44 kB 00:00 2024-03-04T12:33:09.589 INFO:teuthology.orchestra.run.smithi090.stdout:(59/284): flexiblas-3.0.4-8.el9.x86_64.rpm 540 kB/s | 32 kB 00:00 2024-03-04T12:33:09.602 INFO:teuthology.orchestra.run.smithi184.stdout:(119/284): libsbc-1.4-9.el9.x86_64.rpm 878 kB/s | 44 kB 00:00 2024-03-04T12:33:09.636 INFO:teuthology.orchestra.run.smithi184.stdout:(120/284): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 661 kB 00:00 2024-03-04T12:33:09.661 INFO:teuthology.orchestra.run.smithi184.stdout:(121/284): libsndfile-1.0.31-8.el9.x86_64.rpm 2.4 MB/s | 205 kB 00:00 2024-03-04T12:33:09.686 INFO:teuthology.orchestra.run.smithi184.stdout:(122/284): libtheora-1.1.1-31.el9.x86_64.rpm 1.9 MB/s | 163 kB 00:00 2024-03-04T12:33:09.712 INFO:teuthology.orchestra.run.smithi184.stdout:(123/284): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 723 kB/s | 36 kB 00:00 2024-03-04T12:33:09.737 INFO:teuthology.orchestra.run.smithi184.stdout:(124/284): libtiff-4.4.0-12.el9.x86_64.rpm 2.6 MB/s | 197 kB 00:00 2024-03-04T12:33:09.762 INFO:teuthology.orchestra.run.smithi184.stdout:(125/284): libtracker-sparql-3.1.2-3.el9.x86_64 4.1 MB/s | 316 kB 00:00 2024-03-04T12:33:09.787 INFO:teuthology.orchestra.run.smithi184.stdout:(126/284): libvisual-0.4.0-34.el9.x86_64.rpm 1.9 MB/s | 143 kB 00:00 2024-03-04T12:33:09.798 INFO:teuthology.orchestra.run.smithi090.stdout:(60/284): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-03-04T12:33:09.813 INFO:teuthology.orchestra.run.smithi184.stdout:(127/284): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-04T12:33:09.823 INFO:teuthology.orchestra.run.smithi090.stdout:(61/284): flexiblas-openblas-openmp-3.0.4-8.el9 73 kB/s | 17 kB 00:00 2024-03-04T12:33:09.838 INFO:teuthology.orchestra.run.smithi184.stdout:(128/284): libwayland-client-1.21.0-1.el9.x86_6 647 kB/s | 32 kB 00:00 2024-03-04T12:33:09.848 INFO:teuthology.orchestra.run.smithi090.stdout:(62/284): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 1.6 MB/s | 84 kB 00:00 2024-03-04T12:33:09.855 INFO:teuthology.orchestra.run.smithi184.stdout:(129/284): libwayland-cursor-1.21.0-1.el9.x86_6 275 kB/s | 18 kB 00:00 2024-03-04T12:33:09.874 INFO:teuthology.orchestra.run.smithi090.stdout:(63/284): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 122 kB 00:00 2024-03-04T12:33:09.880 INFO:teuthology.orchestra.run.smithi184.stdout:(130/284): libwayland-egl-1.21.0-1.el9.x86_64.r 176 kB/s | 12 kB 00:00 2024-03-04T12:33:09.899 INFO:teuthology.orchestra.run.smithi090.stdout:(64/284): giflib-5.2.1-9.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-03-04T12:33:09.905 INFO:teuthology.orchestra.run.smithi184.stdout:(131/284): libwayland-server-1.21.0-1.el9.x86_6 814 kB/s | 41 kB 00:00 2024-03-04T12:33:09.931 INFO:teuthology.orchestra.run.smithi184.stdout:(132/284): libwebp-1.2.0-8.el9.x86_64.rpm 3.6 MB/s | 276 kB 00:00 2024-03-04T12:33:09.950 INFO:teuthology.orchestra.run.smithi090.stdout:(65/284): google-guice-4.2.3-9.el9.noarch.rpm 6.1 MB/s | 472 kB 00:00 2024-03-04T12:33:09.956 INFO:teuthology.orchestra.run.smithi184.stdout:(133/284): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.7 MB/s | 132 kB 00:00 2024-03-04T12:33:09.973 INFO:teuthology.orchestra.run.smithi184.stdout:(134/284): libxshmfence-1.3-10.el9.x86_64.rpm 278 kB/s | 12 kB 00:00 2024-03-04T12:33:09.975 INFO:teuthology.orchestra.run.smithi090.stdout:(66/284): graphene-1.10.6-2.el9.x86_64.rpm 843 kB/s | 63 kB 00:00 2024-03-04T12:33:09.990 INFO:teuthology.orchestra.run.smithi184.stdout:(135/284): low-memory-monitor-2.1-4.el9.x86_64. 595 kB/s | 35 kB 00:00 2024-03-04T12:33:10.000 INFO:teuthology.orchestra.run.smithi090.stdout:(67/284): gsm-1.0.19-6.el9.x86_64.rpm 658 kB/s | 33 kB 00:00 2024-03-04T12:33:10.015 INFO:teuthology.orchestra.run.smithi184.stdout:(136/284): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-03-04T12:33:10.040 INFO:teuthology.orchestra.run.smithi184.stdout:(137/284): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-04T12:33:10.111 INFO:teuthology.orchestra.run.smithi090.stdout:(68/284): gstreamer1-1.22.1-2.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-03-04T12:33:10.134 INFO:teuthology.orchestra.run.smithi184.stdout:(138/284): lua-posix-35.0-8.el9.x86_64.rpm 915 kB/s | 131 kB 00:00 2024-03-04T12:33:10.191 INFO:teuthology.orchestra.run.smithi184.stdout:(139/284): maven-3.6.3-15.el9.noarch.rpm 95 kB/s | 17 kB 00:00 2024-03-04T12:33:10.216 INFO:teuthology.orchestra.run.smithi184.stdout:(140/284): maven-openjdk11-3.6.3-15.el9.noarch. 97 kB/s | 7.9 kB 00:00 2024-03-04T12:33:10.236 INFO:teuthology.orchestra.run.smithi090.stdout:(69/284): gstreamer1-plugins-base-1.22.1-2.el9. 9.4 MB/s | 2.2 MB 00:00 2024-03-04T12:33:10.258 INFO:teuthology.orchestra.run.smithi184.stdout:(141/284): maven-lib-3.6.3-15.el9.noarch.rpm 12 MB/s | 1.5 MB 00:00 2024-03-04T12:33:10.261 INFO:teuthology.orchestra.run.smithi090.stdout:(70/284): gtk-update-icon-cache-3.24.31-2.el9.x 230 kB/s | 34 kB 00:00 2024-03-04T12:33:10.284 INFO:teuthology.orchestra.run.smithi184.stdout:(142/284): maven-resolver-1.6.1-10.el9.noarch.r 5.4 MB/s | 512 kB 00:00 2024-03-04T12:33:10.309 INFO:teuthology.orchestra.run.smithi184.stdout:(143/284): maven-shared-utils-3.3.4-3.el9.noarc 1.6 MB/s | 150 kB 00:00 2024-03-04T12:33:10.334 INFO:teuthology.orchestra.run.smithi184.stdout:(144/284): maven-wagon-3.4.2-7.el9.noarch.rpm 1.4 MB/s | 111 kB 00:00 2024-03-04T12:33:10.359 INFO:teuthology.orchestra.run.smithi184.stdout:(145/284): mesa-libEGL-23.3.3-1.el9.x86_64.rpm 2.5 MB/s | 126 kB 00:00 2024-03-04T12:33:10.385 INFO:teuthology.orchestra.run.smithi184.stdout:(146/284): mesa-libGL-23.3.3-1.el9.x86_64.rpm 2.2 MB/s | 167 kB 00:00 2024-03-04T12:33:10.410 INFO:teuthology.orchestra.run.smithi184.stdout:(147/284): mesa-libgbm-23.3.3-1.el9.x86_64.rpm 486 kB/s | 37 kB 00:00 2024-03-04T12:33:10.435 INFO:teuthology.orchestra.run.smithi184.stdout:(148/284): mesa-libglapi-23.3.3-1.el9.x86_64.rp 573 kB/s | 43 kB 00:00 2024-03-04T12:33:10.460 INFO:teuthology.orchestra.run.smithi184.stdout:(149/284): mkfontscale-1.2.1-3.el9.x86_64.rpm 416 kB/s | 31 kB 00:00 2024-03-04T12:33:10.486 INFO:teuthology.orchestra.run.smithi184.stdout:(150/284): openblas-0.3.21-2.el9.x86_64.rpm 685 kB/s | 34 kB 00:00 2024-03-04T12:33:10.487 INFO:teuthology.orchestra.run.smithi090.stdout:(71/284): gtk3-3.24.31-2.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2024-03-04T12:33:10.554 INFO:teuthology.orchestra.run.smithi090.stdout:(72/284): guava-30.1-6.el9.noarch.rpm 7.9 MB/s | 2.3 MB 00:00 2024-03-04T12:33:10.579 INFO:teuthology.orchestra.run.smithi090.stdout:(73/284): hicolor-icon-theme-0.17-13.el9.noarch 735 kB/s | 65 kB 00:00 2024-03-04T12:33:10.636 INFO:teuthology.orchestra.run.smithi184.stdout:(151/284): openblas-openmp-0.3.21-2.el9.x86_64. 24 MB/s | 4.7 MB 00:00 2024-03-04T12:33:10.637 INFO:teuthology.orchestra.run.smithi090.stdout:(74/284): httpcomponents-client-4.5.13-3.el9.no 7.7 MB/s | 656 kB 00:00 2024-03-04T12:33:10.661 INFO:teuthology.orchestra.run.smithi184.stdout:(152/284): openjpeg2-2.4.0-7.el9.x86_64.rpm 808 kB/s | 162 kB 00:00 2024-03-04T12:33:10.671 INFO:teuthology.orchestra.run.smithi090.stdout:(75/284): httpcomponents-core-4.4.13-7.el9.noar 6.7 MB/s | 630 kB 00:00 2024-03-04T12:33:10.686 INFO:teuthology.orchestra.run.smithi184.stdout:(153/284): opus-1.3.1-10.el9.x86_64.rpm 1.0 MB/s | 199 kB 00:00 2024-03-04T12:33:10.712 INFO:teuthology.orchestra.run.smithi184.stdout:(154/284): orc-0.4.31-6.el9.x86_64.rpm 2.4 MB/s | 183 kB 00:00 2024-03-04T12:33:10.745 INFO:teuthology.orchestra.run.smithi184.stdout:(155/284): osinfo-db-20231215-1.el9.noarch.rpm 4.8 MB/s | 283 kB 00:00 2024-03-04T12:33:10.771 INFO:teuthology.orchestra.run.smithi184.stdout:(156/284): osinfo-db-tools-1.10.0-1.el9.x86_64. 820 kB/s | 68 kB 00:00 2024-03-04T12:33:10.796 INFO:teuthology.orchestra.run.smithi184.stdout:(157/284): pipewire-1.0.1-1.el9.x86_64.rpm 1.2 MB/s | 101 kB 00:00 2024-03-04T12:33:10.805 INFO:teuthology.orchestra.run.smithi090.stdout:(76/284): iso-codes-4.6.0-3.el9.noarch.rpm 20 MB/s | 3.3 MB 00:00 2024-03-04T12:33:10.823 INFO:teuthology.orchestra.run.smithi184.stdout:(158/284): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 748 kB/s | 56 kB 00:00 2024-03-04T12:33:10.830 INFO:teuthology.orchestra.run.smithi090.stdout:(77/284): jakarta-annotations-1.3.5-13.el9.noar 279 kB/s | 44 kB 00:00 2024-03-04T12:33:10.846 INFO:teuthology.orchestra.run.smithi184.stdout:(159/284): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 134 kB 00:00 2024-03-04T12:33:10.855 INFO:teuthology.orchestra.run.smithi090.stdout:(78/284): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-04T12:33:10.871 INFO:teuthology.orchestra.run.smithi184.stdout:(160/284): pipewire-jack-audio-connection-kit-1 107 kB/s | 8.0 kB 00:00 2024-03-04T12:33:10.889 INFO:teuthology.orchestra.run.smithi090.stdout:(79/284): java-11-openjdk-11.0.18.0.10-3.el9.x8 7.4 MB/s | 439 kB 00:00 2024-03-04T12:33:10.939 INFO:teuthology.orchestra.run.smithi184.stdout:(161/284): pipewire-libs-1.0.1-1.el9.x86_64.rpm 16 MB/s | 1.9 MB 00:00 2024-03-04T12:33:10.964 INFO:teuthology.orchestra.run.smithi184.stdout:(162/284): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.6 MB/s | 185 kB 00:00 2024-03-04T12:33:10.989 INFO:teuthology.orchestra.run.smithi184.stdout:(163/284): plexus-cipher-1.7-27.el9.noarch.rpm 215 kB/s | 25 kB 00:00 2024-03-04T12:33:11.014 INFO:teuthology.orchestra.run.smithi184.stdout:(164/284): plexus-classworlds-2.6.0-11.el9.noar 786 kB/s | 59 kB 00:00 2024-03-04T12:33:11.040 INFO:teuthology.orchestra.run.smithi184.stdout:(165/284): plexus-interpolation-1.26-11.el9.noa 1.5 MB/s | 79 kB 00:00 2024-03-04T12:33:11.048 INFO:teuthology.orchestra.run.smithi090.stdout:(80/284): java-11-openjdk-devel-11.0.18.0.10-3. 17 MB/s | 3.3 MB 00:00 2024-03-04T12:33:11.065 INFO:teuthology.orchestra.run.smithi184.stdout:(166/284): plexus-containers-component-annotati 229 kB/s | 17 kB 00:00 2024-03-04T12:33:11.099 INFO:teuthology.orchestra.run.smithi184.stdout:(167/284): plexus-sec-dispatcher-1.4-37.el9.noa 387 kB/s | 33 kB 00:00 2024-03-04T12:33:11.124 INFO:teuthology.orchestra.run.smithi184.stdout:(168/284): plexus-utils-3.3.0-10.el9.noarch.rpm 3.0 MB/s | 253 kB 00:00 2024-03-04T12:33:11.174 INFO:teuthology.orchestra.run.smithi184.stdout:(169/284): poppler-21.01.0-19.el9.x86_64.rpm 9.8 MB/s | 1.1 MB 00:00 2024-03-04T12:33:11.258 INFO:teuthology.orchestra.run.smithi184.stdout:(170/284): poppler-data-0.4.9-9.el9.noarch.rpm 12 MB/s | 1.8 MB 00:00 2024-03-04T12:33:11.283 INFO:teuthology.orchestra.run.smithi184.stdout:(171/284): poppler-glib-21.01.0-19.el9.x86_64.r 960 kB/s | 151 kB 00:00 2024-03-04T12:33:11.317 INFO:teuthology.orchestra.run.smithi184.stdout:(172/284): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-03-04T12:33:11.359 INFO:teuthology.orchestra.run.smithi184.stdout:(173/284): publicsuffix-list-20210518-3.el9.noa 1.1 MB/s | 82 kB 00:00 2024-03-04T12:33:11.373 INFO:teuthology.orchestra.run.smithi090.stdout:(81/284): javapackages-filesystem-6.0.0-4.el9.n 32 kB/s | 10 kB 00:00 2024-03-04T12:33:11.393 INFO:teuthology.orchestra.run.smithi184.stdout:(174/284): pulseaudio-libs-15.0-2.el9.x86_64.rp 6.1 MB/s | 666 kB 00:00 2024-03-04T12:33:11.593 INFO:teuthology.orchestra.run.smithi184.stdout:(175/284): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2024-03-04T12:33:11.607 INFO:teuthology.orchestra.run.smithi090.stdout:(82/284): jbigkit-libs-2.1-23.el9.x86_64.rpm 223 kB/s | 52 kB 00:00 2024-03-04T12:33:11.618 INFO:teuthology.orchestra.run.smithi184.stdout:(176/284): python3-jinja2-2.11.3-5.el9.noarch.r 879 kB/s | 227 kB 00:00 2024-03-04T12:33:11.643 INFO:teuthology.orchestra.run.smithi184.stdout:(177/284): python3-jsonpatch-1.21-16.el9.noarch 98 kB/s | 24 kB 00:00 2024-03-04T12:33:11.669 INFO:teuthology.orchestra.run.smithi184.stdout:(178/284): python3-jsonpointer-2.0-4.el9.noarch 241 kB/s | 18 kB 00:00 2024-03-04T12:33:11.694 INFO:teuthology.orchestra.run.smithi184.stdout:(179/284): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-04T12:33:11.728 INFO:teuthology.orchestra.run.smithi184.stdout:(180/284): python3-markupsafe-1.1.1-12.el9.x86_ 375 kB/s | 32 kB 00:00 2024-03-04T12:33:11.874 INFO:teuthology.orchestra.run.smithi090.stdout:(83/284): jcl-over-slf4j-1.7.30-13.el9.noarch.r 86 kB/s | 23 kB 00:00 2024-03-04T12:33:11.912 INFO:teuthology.orchestra.run.smithi184.stdout:(181/284): python3-numpy-1.20.1-5.el9.x86_64.rp 20 MB/s | 4.8 MB 00:00 2024-03-04T12:33:11.937 INFO:teuthology.orchestra.run.smithi184.stdout:(182/284): python3-oauthlib-3.1.1-5.el9.noarch. 845 kB/s | 174 kB 00:00 2024-03-04T12:33:11.962 INFO:teuthology.orchestra.run.smithi184.stdout:(183/284): python3-numpy-f2py-1.20.1-5.el9.x86_ 936 kB/s | 217 kB 00:00 2024-03-04T12:33:11.988 INFO:teuthology.orchestra.run.smithi184.stdout:(184/284): python3-packaging-20.9-5.el9.noarch. 913 kB/s | 69 kB 00:00 2024-03-04T12:33:12.013 INFO:teuthology.orchestra.run.smithi184.stdout:(185/284): python3-prettytable-0.7.2-27.el9.noa 546 kB/s | 41 kB 00:00 2024-03-04T12:33:12.038 INFO:teuthology.orchestra.run.smithi184.stdout:(186/284): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.6 MB/s | 132 kB 00:00 2024-03-04T12:33:12.064 INFO:teuthology.orchestra.run.smithi184.stdout:(187/284): python3-protobuf-3.14.0-13.el9.noarc 3.1 MB/s | 238 kB 00:00 2024-03-04T12:33:12.089 INFO:teuthology.orchestra.run.smithi184.stdout:(188/284): python3-pyasn1-modules-0.4.8-6.el9.n 2.7 MB/s | 211 kB 00:00 2024-03-04T12:33:12.114 INFO:teuthology.orchestra.run.smithi184.stdout:(189/284): python3-pytz-2021.1-5.el9.noarch.rpm 632 kB/s | 47 kB 00:00 2024-03-04T12:33:12.140 INFO:teuthology.orchestra.run.smithi184.stdout:(190/284): python3-requests-oauthlib-1.3.0-12.e 856 kB/s | 43 kB 00:00 2024-03-04T12:33:12.332 INFO:teuthology.orchestra.run.smithi184.stdout:(191/284): python3-toml-0.10.2-6.el9.noarch.rpm 179 kB/s | 39 kB 00:00 2024-03-04T12:33:12.341 INFO:teuthology.orchestra.run.smithi090.stdout:(84/284): java-11-openjdk-headless-11.0.18.0.10 27 MB/s | 40 MB 00:01 2024-03-04T12:33:12.366 INFO:teuthology.orchestra.run.smithi090.stdout:(85/284): jsoup-1.13.1-10.el9.noarch.rpm 765 kB/s | 376 kB 00:00 2024-03-04T12:33:12.392 INFO:teuthology.orchestra.run.smithi090.stdout:(86/284): jsr-305-3.0.2-6.el9.noarch.rpm 624 kB/s | 31 kB 00:00 2024-03-04T12:33:12.417 INFO:teuthology.orchestra.run.smithi090.stdout:(87/284): lcms2-2.12-3.el9.x86_64.rpm 3.2 MB/s | 166 kB 00:00 2024-03-04T12:33:12.442 INFO:teuthology.orchestra.run.smithi090.stdout:(88/284): libXcomposite-0.4.5-7.el9.x86_64.rpm 462 kB/s | 23 kB 00:00 2024-03-04T12:33:12.468 INFO:teuthology.orchestra.run.smithi090.stdout:(89/284): libXcursor-1.2.0-7.el9.x86_64.rpm 590 kB/s | 30 kB 00:00 2024-03-04T12:33:12.493 INFO:teuthology.orchestra.run.smithi090.stdout:(90/284): libXdamage-1.1.5-7.el9.x86_64.rpm 433 kB/s | 22 kB 00:00 2024-03-04T12:33:12.520 INFO:teuthology.orchestra.run.smithi090.stdout:(91/284): libXfixes-5.0.3-16.el9.x86_64.rpm 365 kB/s | 19 kB 00:00 2024-03-04T12:33:12.540 INFO:teuthology.orchestra.run.smithi184.stdout:(192/284): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-03-04T12:33:12.545 INFO:teuthology.orchestra.run.smithi090.stdout:(92/284): libXi-1.7.10-8.el9.x86_64.rpm 752 kB/s | 38 kB 00:00 2024-03-04T12:33:12.570 INFO:teuthology.orchestra.run.smithi090.stdout:(93/284): libXinerama-1.1.4-10.el9.x86_64.rpm 279 kB/s | 14 kB 00:00 2024-03-04T12:33:12.593 INFO:teuthology.orchestra.run.smithi184.stdout:(193/284): qatlib-23.11.0-1.el9.x86_64.rpm 477 kB/s | 215 kB 00:00 2024-03-04T12:33:12.596 INFO:teuthology.orchestra.run.smithi090.stdout:(94/284): libXrandr-1.5.2-8.el9.x86_64.rpm 543 kB/s | 27 kB 00:00 2024-03-04T12:33:12.615 INFO:teuthology.orchestra.run.smithi184.stdout:(194/284): qatlib-service-23.11.0-1.el9.x86_64. 120 kB/s | 34 kB 00:00 2024-03-04T12:33:12.621 INFO:teuthology.orchestra.run.smithi090.stdout:(95/284): libXtst-1.2.3-16.el9.x86_64.rpm 406 kB/s | 20 kB 00:00 2024-03-04T12:33:12.641 INFO:teuthology.orchestra.run.smithi184.stdout:(195/284): qatzip-libs-1.1.2-2.el9.x86_64.rpm 435 kB/s | 43 kB 00:00 2024-03-04T12:33:12.646 INFO:teuthology.orchestra.run.smithi090.stdout:(96/284): libXv-1.0.11-16.el9.x86_64.rpm 359 kB/s | 18 kB 00:00 2024-03-04T12:33:12.666 INFO:teuthology.orchestra.run.smithi184.stdout:(196/284): rtkit-0.11-28.el9.x86_64.rpm 1.1 MB/s | 55 kB 00:00 2024-03-04T12:33:12.671 INFO:teuthology.orchestra.run.smithi090.stdout:(97/284): libXxf86vm-1.1.4-18.el9.x86_64.rpm 352 kB/s | 18 kB 00:00 2024-03-04T12:33:12.691 INFO:teuthology.orchestra.run.smithi184.stdout:(197/284): sisu-0.3.4-10.el9.noarch.rpm 6.6 MB/s | 509 kB 00:00 2024-03-04T12:33:12.697 INFO:teuthology.orchestra.run.smithi090.stdout:(98/284): libasyncns-0.8-22.el9.x86_64.rpm 586 kB/s | 29 kB 00:00 2024-03-04T12:33:12.716 INFO:teuthology.orchestra.run.smithi184.stdout:(198/284): slf4j-1.7.30-13.el9.noarch.rpm 912 kB/s | 68 kB 00:00 2024-03-04T12:33:12.722 INFO:teuthology.orchestra.run.smithi090.stdout:(99/284): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 85 kB 00:00 2024-03-04T12:33:12.742 INFO:teuthology.orchestra.run.smithi184.stdout:(199/284): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-03-04T12:33:12.748 INFO:teuthology.orchestra.run.smithi090.stdout:(100/284): libcanberra-gtk3-0.30-27.el9.x86_64. 613 kB/s | 31 kB 00:00 2024-03-04T12:33:12.767 INFO:teuthology.orchestra.run.smithi184.stdout:(200/284): sound-theme-freedesktop-0.8-17.el9.n 4.9 MB/s | 377 kB 00:00 2024-03-04T12:33:12.773 INFO:teuthology.orchestra.run.smithi090.stdout:(101/284): libdrm-2.4.117-1.el9.x86_64.rpm 3.1 MB/s | 158 kB 00:00 2024-03-04T12:33:12.792 INFO:teuthology.orchestra.run.smithi184.stdout:(201/284): totem-pl-parser-3.26.6-2.el9.x86_64. 1.7 MB/s | 130 kB 00:00 2024-03-04T12:33:12.807 INFO:teuthology.orchestra.run.smithi090.stdout:(102/284): libepoxy-1.5.5-4.el9.x86_64.rpm 4.0 MB/s | 240 kB 00:00 2024-03-04T12:33:12.834 INFO:teuthology.orchestra.run.smithi184.stdout:(202/284): tracker-3.1.2-3.el9.x86_64.rpm 7.9 MB/s | 537 kB 00:00 2024-03-04T12:33:12.840 INFO:teuthology.orchestra.run.smithi090.stdout:(103/284): libexif-0.6.22-6.el9.x86_64.rpm 6.3 MB/s | 431 kB 00:00 2024-03-04T12:33:12.865 INFO:teuthology.orchestra.run.smithi090.stdout:(104/284): libfontenc-1.1.3-17.el9.x86_64.rpm 517 kB/s | 30 kB 00:00 2024-03-04T12:33:12.876 INFO:teuthology.orchestra.run.smithi184.stdout:(203/284): tracker-miners-3.1.2-4.el9.x86_64.rp 8.0 MB/s | 893 kB 00:00 2024-03-04T12:33:12.891 INFO:teuthology.orchestra.run.smithi090.stdout:(105/284): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 82 kB 00:00 2024-03-04T12:33:12.901 INFO:teuthology.orchestra.run.smithi184.stdout:(204/284): ttmkfdir-3.0.9-65.el9.x86_64.rpm 481 kB/s | 52 kB 00:00 2024-03-04T12:33:12.917 INFO:teuthology.orchestra.run.smithi090.stdout:(106/284): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 134 kB 00:00 2024-03-04T12:33:12.927 INFO:teuthology.orchestra.run.smithi184.stdout:(205/284): tzdata-java-2024a-1.el9.noarch.rpm 1.6 MB/s | 148 kB 00:00 2024-03-04T12:33:12.933 INFO:teuthology.orchestra.run.smithi090.stdout:(107/284): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 857 kB/s | 36 kB 00:00 2024-03-04T12:33:12.952 INFO:teuthology.orchestra.run.smithi184.stdout:(206/284): upower-0.99.11-11.el9.x86_64.rpm 3.3 MB/s | 168 kB 00:00 2024-03-04T12:33:12.959 INFO:teuthology.orchestra.run.smithi090.stdout:(108/284): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 3.3 MB/s | 141 kB 00:00 2024-03-04T12:33:12.977 INFO:teuthology.orchestra.run.smithi184.stdout:(207/284): webrtc-audio-processing-0.3.1-8.el9. 3.9 MB/s | 305 kB 00:00 2024-03-04T12:33:12.992 INFO:teuthology.orchestra.run.smithi090.stdout:(109/284): libgsf-1.14.47-5.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-03-04T12:33:13.003 INFO:teuthology.orchestra.run.smithi184.stdout:(208/284): wireplumber-0.4.14-1.el9.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2024-03-04T12:33:13.018 INFO:teuthology.orchestra.run.smithi090.stdout:(110/284): libgxps-0.3.2-3.el9.x86_64.rpm 1.3 MB/s | 78 kB 00:00 2024-03-04T12:33:13.028 INFO:teuthology.orchestra.run.smithi184.stdout:(209/284): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 828 kB/s | 41 kB 00:00 2024-03-04T12:33:13.043 INFO:teuthology.orchestra.run.smithi090.stdout:(111/284): libiptcdata-1.0.5-9.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-03-04T12:33:13.062 INFO:teuthology.orchestra.run.smithi184.stdout:(210/284): wireplumber-libs-0.4.14-1.el9.x86_64 3.9 MB/s | 337 kB 00:00 2024-03-04T12:33:13.068 INFO:teuthology.orchestra.run.smithi090.stdout:(112/284): libldac-2.0.2.3-10.el9.x86_64.rpm 802 kB/s | 40 kB 00:00 2024-03-04T12:33:13.087 INFO:teuthology.orchestra.run.smithi184.stdout:(211/284): xdg-desktop-portal-1.12.6-1.el9.x86_ 4.3 MB/s | 367 kB 00:00 2024-03-04T12:33:13.094 INFO:teuthology.orchestra.run.smithi090.stdout:(113/284): libnotify-0.7.9-8.el9.x86_64.rpm 849 kB/s | 43 kB 00:00 2024-03-04T12:33:13.112 INFO:teuthology.orchestra.run.smithi184.stdout:(212/284): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.5 MB/s | 130 kB 00:00 2024-03-04T12:33:13.119 INFO:teuthology.orchestra.run.smithi090.stdout:(114/284): libogg-1.3.4-6.el9.x86_64.rpm 649 kB/s | 32 kB 00:00 2024-03-04T12:33:13.146 INFO:teuthology.orchestra.run.smithi184.stdout:(213/284): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-03-04T12:33:13.161 INFO:teuthology.orchestra.run.smithi090.stdout:(115/284): libosinfo-1.10.0-1.el9.x86_64.rpm 4.6 MB/s | 312 kB 00:00 2024-03-04T12:33:13.171 INFO:teuthology.orchestra.run.smithi184.stdout:(214/284): xkeyboard-config-2.33-2.el9.noarch.r 9.1 MB/s | 780 kB 00:00 2024-03-04T12:33:13.188 INFO:teuthology.orchestra.run.smithi090.stdout:(116/284): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 159 kB 00:00 2024-03-04T12:33:13.205 INFO:teuthology.orchestra.run.smithi184.stdout:(215/284): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.3 MB/s | 499 kB 00:00 2024-03-04T12:33:13.221 INFO:teuthology.orchestra.run.smithi090.stdout:(117/284): librabbitmq-0.11.0-7.el9.x86_64.rpm 742 kB/s | 44 kB 00:00 2024-03-04T12:33:13.230 INFO:teuthology.orchestra.run.smithi184.stdout:(216/284): ModemManager-glib-1.20.2-1.el9.x86_6 3.9 MB/s | 334 kB 00:00 2024-03-04T12:33:13.255 INFO:teuthology.orchestra.run.smithi184.stdout:(217/284): bluez-libs-5.64-1.el9.x86_64.rpm 996 kB/s | 83 kB 00:00 2024-03-04T12:33:13.263 INFO:teuthology.orchestra.run.smithi090.stdout:(118/284): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-04T12:33:13.281 INFO:teuthology.orchestra.run.smithi184.stdout:(218/284): bubblewrap-0.4.1-6.el9.x86_64.rpm 656 kB/s | 49 kB 00:00 2024-03-04T12:33:13.289 INFO:teuthology.orchestra.run.smithi090.stdout:(119/284): libsbc-1.4-9.el9.x86_64.rpm 657 kB/s | 44 kB 00:00 2024-03-04T12:33:13.306 INFO:teuthology.orchestra.run.smithi184.stdout:(219/284): cups-libs-2.3.3op2-24.el9.x86_64.rpm 3.4 MB/s | 261 kB 00:00 2024-03-04T12:33:13.322 INFO:teuthology.orchestra.run.smithi090.stdout:(120/284): libsndfile-1.0.31-8.el9.x86_64.rpm 3.4 MB/s | 205 kB 00:00 2024-03-04T12:33:13.331 INFO:teuthology.orchestra.run.smithi184.stdout:(220/284): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-04T12:33:13.356 INFO:teuthology.orchestra.run.smithi090.stdout:(121/284): libtheora-1.1.1-31.el9.x86_64.rpm 2.4 MB/s | 163 kB 00:00 2024-03-04T12:33:13.357 INFO:teuthology.orchestra.run.smithi184.stdout:(221/284): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2024-03-04T12:33:13.382 INFO:teuthology.orchestra.run.smithi184.stdout:(222/284): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 802 kB 00:00 2024-03-04T12:33:13.398 INFO:teuthology.orchestra.run.smithi090.stdout:(122/284): libtiff-4.4.0-12.el9.x86_64.rpm 2.6 MB/s | 197 kB 00:00 2024-03-04T12:33:13.407 INFO:teuthology.orchestra.run.smithi184.stdout:(223/284): libpciaccess-0.16-6.el9.x86_64.rpm 354 kB/s | 27 kB 00:00 2024-03-04T12:33:13.415 INFO:teuthology.orchestra.run.smithi090.stdout:(123/284): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 613 kB/s | 36 kB 00:00 2024-03-04T12:33:13.432 INFO:teuthology.orchestra.run.smithi184.stdout:(224/284): libquadmath-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 194 kB 00:00 2024-03-04T12:33:13.449 INFO:teuthology.orchestra.run.smithi090.stdout:(124/284): libtracker-sparql-3.1.2-3.el9.x86_64 6.2 MB/s | 316 kB 00:00 2024-03-04T12:33:13.457 INFO:teuthology.orchestra.run.smithi184.stdout:(225/284): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.2 MB/s | 90 kB 00:00 2024-03-04T12:33:13.474 INFO:teuthology.orchestra.run.smithi090.stdout:(125/284): libvisual-0.4.0-34.el9.x86_64.rpm 2.4 MB/s | 143 kB 00:00 2024-03-04T12:33:13.483 INFO:teuthology.orchestra.run.smithi184.stdout:(226/284): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-03-04T12:33:13.508 INFO:teuthology.orchestra.run.smithi090.stdout:(126/284): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-03-04T12:33:13.508 INFO:teuthology.orchestra.run.smithi184.stdout:(227/284): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-04T12:33:13.533 INFO:teuthology.orchestra.run.smithi090.stdout:(127/284): libwayland-client-1.21.0-1.el9.x86_6 554 kB/s | 32 kB 00:00 2024-03-04T12:33:13.542 INFO:teuthology.orchestra.run.smithi184.stdout:(228/284): python3-cryptography-36.0.1-4.el9.x8 14 MB/s | 1.1 MB 00:00 2024-03-04T12:33:13.559 INFO:teuthology.orchestra.run.smithi090.stdout:(128/284): libwayland-cursor-1.21.0-1.el9.x86_6 365 kB/s | 18 kB 00:00 2024-03-04T12:33:13.567 INFO:teuthology.orchestra.run.smithi184.stdout:(229/284): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-04T12:33:13.584 INFO:teuthology.orchestra.run.smithi090.stdout:(129/284): libwayland-egl-1.21.0-1.el9.x86_64.r 234 kB/s | 12 kB 00:00 2024-03-04T12:33:13.601 INFO:teuthology.orchestra.run.smithi184.stdout:(230/284): python3-pycparser-2.20-6.el9.noarch. 1.3 MB/s | 124 kB 00:00 2024-03-04T12:33:13.609 INFO:teuthology.orchestra.run.smithi090.stdout:(130/284): libwayland-server-1.21.0-1.el9.x86_6 811 kB/s | 41 kB 00:00 2024-03-04T12:33:13.626 INFO:teuthology.orchestra.run.smithi184.stdout:(231/284): python3-requests-2.25.1-8.el9.noarch 1.9 MB/s | 113 kB 00:00 2024-03-04T12:33:13.643 INFO:teuthology.orchestra.run.smithi090.stdout:(131/284): libwebp-1.2.0-8.el9.x86_64.rpm 4.6 MB/s | 276 kB 00:00 2024-03-04T12:33:13.651 INFO:teuthology.orchestra.run.smithi184.stdout:(232/284): python3-urllib3-1.26.5-5.el9.noarch. 2.2 MB/s | 187 kB 00:00 2024-03-04T12:33:13.668 INFO:teuthology.orchestra.run.smithi090.stdout:(132/284): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 132 kB 00:00 2024-03-04T12:33:13.693 INFO:teuthology.orchestra.run.smithi090.stdout:(133/284): libxshmfence-1.3-10.el9.x86_64.rpm 231 kB/s | 12 kB 00:00 2024-03-04T12:33:13.701 INFO:teuthology.orchestra.run.smithi184.stdout:(233/284): avahi-glib-0.8-12.el9.x86_64.rpm 147 kB/s | 15 kB 00:00 2024-03-04T12:33:13.718 INFO:teuthology.orchestra.run.smithi184.stdout:(234/284): libX11-xcb-1.7.0-8.el9.x86_64.rpm 163 kB/s | 11 kB 00:00 2024-03-04T12:33:13.719 INFO:teuthology.orchestra.run.smithi090.stdout:(134/284): low-memory-monitor-2.1-4.el9.x86_64. 694 kB/s | 35 kB 00:00 2024-03-04T12:33:13.744 INFO:teuthology.orchestra.run.smithi090.stdout:(135/284): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-04T12:33:13.769 INFO:teuthology.orchestra.run.smithi090.stdout:(136/284): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-04T12:33:13.785 INFO:teuthology.orchestra.run.smithi184.stdout:(235/284): flac-libs-1.3.3-12.el9.x86_64.rpm 1.6 MB/s | 218 kB 00:00 2024-03-04T12:33:13.803 INFO:teuthology.orchestra.run.smithi090.stdout:(137/284): lua-posix-35.0-8.el9.x86_64.rpm 2.2 MB/s | 131 kB 00:00 2024-03-04T12:33:13.824 INFO:teuthology.orchestra.run.smithi184.stdout:(236/284): p11-kit-server-0.24.1-2.el9.x86_64.r 1.8 MB/s | 199 kB 00:00 2024-03-04T12:33:13.828 INFO:teuthology.orchestra.run.smithi090.stdout:(138/284): maven-3.6.3-15.el9.noarch.rpm 285 kB/s | 17 kB 00:00 2024-03-04T12:33:13.866 INFO:teuthology.orchestra.run.smithi184.stdout:(237/284): ostree-libs-2024.4-3.el9.x86_64.rpm 2.9 MB/s | 487 kB 00:00 2024-03-04T12:33:13.891 INFO:teuthology.orchestra.run.smithi184.stdout:(238/284): python3-devel-3.9.17-2.el9.x86_64.rp 2.3 MB/s | 245 kB 00:00 2024-03-04T12:33:13.904 INFO:teuthology.orchestra.run.smithi090.stdout:(139/284): maven-lib-3.6.3-15.el9.noarch.rpm 15 MB/s | 1.5 MB 00:00 2024-03-04T12:33:13.930 INFO:teuthology.orchestra.run.smithi090.stdout:(140/284): maven-openjdk11-3.6.3-15.el9.noarch. 79 kB/s | 7.9 kB 00:00 2024-03-04T12:33:13.958 INFO:teuthology.orchestra.run.smithi184.stdout:(239/284): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-03-04T12:33:13.989 INFO:teuthology.orchestra.run.smithi090.stdout:(141/284): maven-resolver-1.6.1-10.el9.noarch.r 8.6 MB/s | 512 kB 00:00 2024-03-04T12:33:14.014 INFO:teuthology.orchestra.run.smithi090.stdout:(142/284): maven-shared-utils-3.3.4-3.el9.noarc 1.8 MB/s | 150 kB 00:00 2024-03-04T12:33:14.039 INFO:teuthology.orchestra.run.smithi090.stdout:(143/284): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 111 kB 00:00 2024-03-04T12:33:14.073 INFO:teuthology.orchestra.run.smithi090.stdout:(144/284): mesa-libEGL-23.3.3-1.el9.x86_64.rpm 2.1 MB/s | 126 kB 00:00 2024-03-04T12:33:14.075 INFO:teuthology.orchestra.run.smithi184.stdout:(240/284): abseil-cpp-20211102.0-3.el9.x86_64.r 2.9 MB/s | 548 kB 00:00 2024-03-04T12:33:14.099 INFO:teuthology.orchestra.run.smithi090.stdout:(145/284): mesa-libGL-23.3.3-1.el9.x86_64.rpm 2.8 MB/s | 167 kB 00:00 2024-03-04T12:33:14.115 INFO:teuthology.orchestra.run.smithi090.stdout:(146/284): mesa-libgbm-23.3.3-1.el9.x86_64.rpm 878 kB/s | 37 kB 00:00 2024-03-04T12:33:14.117 INFO:teuthology.orchestra.run.smithi184.stdout:(241/284): grpc-data-1.46.7-10.el9.noarch.rpm 470 kB/s | 19 kB 00:00 2024-03-04T12:33:14.133 INFO:teuthology.orchestra.run.smithi090.stdout:(147/284): mesa-libglapi-23.3.3-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-03-04T12:33:14.143 INFO:teuthology.orchestra.run.smithi184.stdout:(242/284): gperftools-libs-2.9.1-2.el9.x86_64.r 1.6 MB/s | 309 kB 00:00 2024-03-04T12:33:14.150 INFO:teuthology.orchestra.run.smithi090.stdout:(148/284): mkfontscale-1.2.1-3.el9.x86_64.rpm 930 kB/s | 31 kB 00:00 2024-03-04T12:33:14.167 INFO:teuthology.orchestra.run.smithi090.stdout:(149/284): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-03-04T12:33:14.184 INFO:teuthology.orchestra.run.smithi184.stdout:(243/284): libarrow-doc-9.0.0-10.el9.noarch.rpm 626 kB/s | 26 kB 00:00 2024-03-04T12:33:14.226 INFO:teuthology.orchestra.run.smithi184.stdout:(244/284): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-03-04T12:33:14.285 INFO:teuthology.orchestra.run.smithi184.stdout:(245/284): libarrow-9.0.0-10.el9.x86_64.rpm 26 MB/s | 4.4 MB 00:00 2024-03-04T12:33:14.302 INFO:teuthology.orchestra.run.smithi090.stdout:(150/284): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.2 MB/s | 162 kB 00:00 2024-03-04T12:33:14.310 INFO:teuthology.orchestra.run.smithi184.stdout:(246/284): libunwind-1.6.2-1.el9.x86_64.rpm 806 kB/s | 67 kB 00:00 2024-03-04T12:33:14.335 INFO:teuthology.orchestra.run.smithi184.stdout:(247/284): luarocks-3.9.2-1.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-03-04T12:33:14.394 INFO:teuthology.orchestra.run.smithi184.stdout:(248/284): python3-asyncssh-2.13.2-4.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-03-04T12:33:14.409 INFO:teuthology.orchestra.run.smithi090.stdout:(151/284): openblas-openmp-0.3.21-2.el9.x86_64. 18 MB/s | 4.7 MB 00:00 2024-03-04T12:33:14.427 INFO:teuthology.orchestra.run.smithi184.stdout:(249/284): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.0 MB/s | 838 kB 00:00 2024-03-04T12:33:14.434 INFO:teuthology.orchestra.run.smithi090.stdout:(152/284): opus-1.3.1-10.el9.x86_64.rpm 1.5 MB/s | 199 kB 00:00 2024-03-04T12:33:14.444 INFO:teuthology.orchestra.run.smithi184.stdout:(250/284): python3-bcrypt-3.2.2-1.el9.x86_64.rp 865 kB/s | 43 kB 00:00 2024-03-04T12:33:14.460 INFO:teuthology.orchestra.run.smithi090.stdout:(153/284): orc-0.4.31-6.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-03-04T12:33:14.461 INFO:teuthology.orchestra.run.smithi184.stdout:(251/284): python3-cachetools-4.2.4-1.el9.noarc 960 kB/s | 32 kB 00:00 2024-03-04T12:33:14.478 INFO:teuthology.orchestra.run.smithi184.stdout:(252/284): python3-certifi-2021.10.8-2.el9.noar 447 kB/s | 15 kB 00:00 2024-03-04T12:33:14.485 INFO:teuthology.orchestra.run.smithi090.stdout:(154/284): osinfo-db-20231215-1.el9.noarch.rpm 5.5 MB/s | 283 kB 00:00 2024-03-04T12:33:14.504 INFO:teuthology.orchestra.run.smithi184.stdout:(253/284): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-03-04T12:33:14.510 INFO:teuthology.orchestra.run.smithi090.stdout:(155/284): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.3 MB/s | 68 kB 00:00 2024-03-04T12:33:14.536 INFO:teuthology.orchestra.run.smithi090.stdout:(156/284): pipewire-1.0.1-1.el9.x86_64.rpm 2.0 MB/s | 101 kB 00:00 2024-03-04T12:33:14.537 INFO:teuthology.orchestra.run.smithi184.stdout:(254/284): protobuf-compiler-3.14.0-13.el9.x86_ 1.3 MB/s | 863 kB 00:00 2024-03-04T12:33:14.561 INFO:teuthology.orchestra.run.smithi090.stdout:(157/284): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-04T12:33:14.562 INFO:teuthology.orchestra.run.smithi184.stdout:(255/284): python3-google-auth-2.28.0-1.el9.noa 3.4 MB/s | 203 kB 00:00 2024-03-04T12:33:14.587 INFO:teuthology.orchestra.run.smithi090.stdout:(158/284): pipewire-jack-audio-connection-kit-1 160 kB/s | 8.0 kB 00:00 2024-03-04T12:33:14.587 INFO:teuthology.orchestra.run.smithi184.stdout:(256/284): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-03-04T12:33:14.612 INFO:teuthology.orchestra.run.smithi090.stdout:(159/284): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 134 kB 00:00 2024-03-04T12:33:14.612 INFO:teuthology.orchestra.run.smithi184.stdout:(257/284): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-03-04T12:33:14.638 INFO:teuthology.orchestra.run.smithi184.stdout:(258/284): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-03-04T12:33:14.663 INFO:teuthology.orchestra.run.smithi184.stdout:(259/284): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-03-04T12:33:14.689 INFO:teuthology.orchestra.run.smithi184.stdout:(260/284): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-03-04T12:33:14.712 INFO:teuthology.orchestra.run.smithi090.stdout:(160/284): pipewire-libs-1.0.1-1.el9.x86_64.rpm 15 MB/s | 1.9 MB 00:00 2024-03-04T12:33:14.722 INFO:teuthology.orchestra.run.smithi184.stdout:(261/284): python3-jaraco-functools-3.5.0-2.el9 331 kB/s | 19 kB 00:00 2024-03-04T12:33:14.737 INFO:teuthology.orchestra.run.smithi090.stdout:(161/284): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.5 MB/s | 185 kB 00:00 2024-03-04T12:33:14.748 INFO:teuthology.orchestra.run.smithi184.stdout:(262/284): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-03-04T12:33:14.763 INFO:teuthology.orchestra.run.smithi090.stdout:(162/284): plexus-cipher-1.7-27.el9.noarch.rpm 495 kB/s | 25 kB 00:00 2024-03-04T12:33:14.781 INFO:teuthology.orchestra.run.smithi184.stdout:(263/284): python3-kubernetes-26.1.0-2.el9.noar 17 MB/s | 1.0 MB 00:00 2024-03-04T12:33:14.788 INFO:teuthology.orchestra.run.smithi090.stdout:(163/284): plexus-classworlds-2.6.0-11.el9.noar 1.1 MB/s | 59 kB 00:00 2024-03-04T12:33:14.806 INFO:teuthology.orchestra.run.smithi184.stdout:(264/284): python3-logutils-0.3.5-21.el9.noarch 793 kB/s | 46 kB 00:00 2024-03-04T12:33:14.813 INFO:teuthology.orchestra.run.smithi090.stdout:(164/284): plexus-containers-component-annotati 346 kB/s | 17 kB 00:00 2024-03-04T12:33:14.832 INFO:teuthology.orchestra.run.smithi184.stdout:(265/284): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-03-04T12:33:14.840 INFO:teuthology.orchestra.run.smithi090.stdout:(165/284): plexus-interpolation-1.26-11.el9.noa 1.5 MB/s | 79 kB 00:00 2024-03-04T12:33:14.857 INFO:teuthology.orchestra.run.smithi184.stdout:(266/284): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-03-04T12:33:14.865 INFO:teuthology.orchestra.run.smithi090.stdout:(166/284): plexus-sec-dispatcher-1.4-37.el9.noa 635 kB/s | 33 kB 00:00 2024-03-04T12:33:14.882 INFO:teuthology.orchestra.run.smithi184.stdout:(267/284): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-03-04T12:33:14.891 INFO:teuthology.orchestra.run.smithi090.stdout:(167/284): plexus-utils-3.3.0-10.el9.noarch.rpm 4.9 MB/s | 253 kB 00:00 2024-03-04T12:33:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:(268/284): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-03-04T12:33:14.933 INFO:teuthology.orchestra.run.smithi184.stdout:(269/284): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-03-04T12:33:14.949 INFO:teuthology.orchestra.run.smithi090.stdout:(168/284): poppler-21.01.0-19.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-03-04T12:33:14.958 INFO:teuthology.orchestra.run.smithi184.stdout:(270/284): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-03-04T12:33:14.983 INFO:teuthology.orchestra.run.smithi184.stdout:(271/284): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-03-04T12:33:15.008 INFO:teuthology.orchestra.run.smithi184.stdout:(272/284): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-03-04T12:33:15.034 INFO:teuthology.orchestra.run.smithi184.stdout:(273/284): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-03-04T12:33:15.041 INFO:teuthology.orchestra.run.smithi090.stdout:(169/284): poppler-data-0.4.9-9.el9.noarch.rpm 12 MB/s | 1.8 MB 00:00 2024-03-04T12:33:15.059 INFO:teuthology.orchestra.run.smithi184.stdout:(274/284): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-03-04T12:33:15.066 INFO:teuthology.orchestra.run.smithi090.stdout:(170/284): poppler-glib-21.01.0-19.el9.x86_64.r 1.3 MB/s | 151 kB 00:00 2024-03-04T12:33:15.084 INFO:teuthology.orchestra.run.smithi184.stdout:(275/284): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-03-04T12:33:15.126 INFO:teuthology.orchestra.run.smithi184.stdout:(276/284): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-03-04T12:33:15.133 INFO:teuthology.orchestra.run.smithi090.stdout:(171/284): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-03-04T12:33:15.152 INFO:teuthology.orchestra.run.smithi184.stdout:(277/284): python3-websocket-client-1.2.3-2.el9 974 kB/s | 90 kB 00:00 2024-03-04T12:33:15.159 INFO:teuthology.orchestra.run.smithi090.stdout:(172/284): publicsuffix-list-20210518-3.el9.noa 893 kB/s | 82 kB 00:00 2024-03-04T12:33:15.201 INFO:teuthology.orchestra.run.smithi090.stdout:(173/284): pulseaudio-libs-15.0-2.el9.x86_64.rp 9.7 MB/s | 666 kB 00:00 2024-03-04T12:33:15.265 INFO:teuthology.orchestra.run.smithi184.stdout:(278/284): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-03-04T12:33:15.285 INFO:teuthology.orchestra.run.smithi184.stdout:(279/284): python3-zc-lockfile-2.0-10.el9.noarc 149 kB/s | 20 kB 00:00 2024-03-04T12:33:15.311 INFO:teuthology.orchestra.run.smithi184.stdout:(280/284): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-03-04T12:33:15.378 INFO:teuthology.orchestra.run.smithi184.stdout:(281/284): s3cmd-2.4.0-1.el9.noarch.rpm 1.8 MB/s | 206 kB 00:00 2024-03-04T12:33:15.420 INFO:teuthology.orchestra.run.smithi184.stdout:(282/284): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-03-04T12:33:15.505 INFO:teuthology.orchestra.run.smithi090.stdout:(174/284): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2024-03-04T12:33:15.702 INFO:teuthology.orchestra.run.smithi090.stdout:(175/284): python3-jinja2-2.11.3-5.el9.noarch.r 455 kB/s | 227 kB 00:00 2024-03-04T12:33:15.719 INFO:teuthology.orchestra.run.smithi090.stdout:(176/284): python3-jsonpatch-1.21-16.el9.noarch 114 kB/s | 24 kB 00:00 2024-03-04T12:33:15.736 INFO:teuthology.orchestra.run.smithi090.stdout:(177/284): python3-jsonpointer-2.0-4.el9.noarch 540 kB/s | 18 kB 00:00 2024-03-04T12:33:15.770 INFO:teuthology.orchestra.run.smithi090.stdout:(178/284): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-04T12:33:15.795 INFO:teuthology.orchestra.run.smithi090.stdout:(179/284): python3-markupsafe-1.1.1-12.el9.x86_ 540 kB/s | 32 kB 00:00 2024-03-04T12:33:15.887 INFO:teuthology.orchestra.run.smithi184.stdout:(283/284): librados2-19.0.0-1871.g3aec3903.el9. 5.9 MB/s | 3.4 MB 00:00 2024-03-04T12:33:15.954 INFO:teuthology.orchestra.run.smithi090.stdout:(180/284): python3-numpy-1.20.1-5.el9.x86_64.rp 26 MB/s | 4.8 MB 00:00 2024-03-04T12:33:15.987 INFO:teuthology.orchestra.run.smithi090.stdout:(181/284): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.1 MB/s | 217 kB 00:00 2024-03-04T12:33:16.013 INFO:teuthology.orchestra.run.smithi090.stdout:(182/284): python3-oauthlib-3.1.1-5.el9.noarch. 2.9 MB/s | 174 kB 00:00 2024-03-04T12:33:16.038 INFO:teuthology.orchestra.run.smithi090.stdout:(183/284): python3-packaging-20.9-5.el9.noarch. 1.3 MB/s | 69 kB 00:00 2024-03-04T12:33:16.062 INFO:teuthology.orchestra.run.smithi184.stdout:(284/284): librbd1-19.0.0-1871.g3aec3903.el9.x8 4.6 MB/s | 3.1 MB 00:00 2024-03-04T12:33:16.063 INFO:teuthology.orchestra.run.smithi090.stdout:(184/284): python3-prettytable-0.7.2-27.el9.noa 823 kB/s | 41 kB 00:00 2024-03-04T12:33:16.065 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-03-04T12:33:16.065 INFO:teuthology.orchestra.run.smithi184.stdout:Total 16 MB/s | 296 MB 00:18 2024-03-04T12:33:16.089 INFO:teuthology.orchestra.run.smithi090.stdout:(185/284): python3-protobuf-3.14.0-13.el9.noarc 4.6 MB/s | 238 kB 00:00 2024-03-04T12:33:16.114 INFO:teuthology.orchestra.run.smithi090.stdout:(186/284): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.6 MB/s | 132 kB 00:00 2024-03-04T12:33:16.139 INFO:teuthology.orchestra.run.smithi090.stdout:(187/284): python3-pyasn1-modules-0.4.8-6.el9.n 4.1 MB/s | 211 kB 00:00 2024-03-04T12:33:16.160 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-03-04T12:33:16.165 INFO:teuthology.orchestra.run.smithi090.stdout:(188/284): python3-pytz-2021.1-5.el9.noarch.rpm 948 kB/s | 47 kB 00:00 2024-03-04T12:33:16.191 INFO:teuthology.orchestra.run.smithi090.stdout:(189/284): python3-requests-oauthlib-1.3.0-12.e 835 kB/s | 43 kB 00:00 2024-03-04T12:33:16.319 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-03-04T12:33:16.319 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-03-04T12:33:16.492 INFO:teuthology.orchestra.run.smithi090.stdout:(190/284): python3-toml-0.10.2-6.el9.noarch.rpm 129 kB/s | 39 kB 00:00 2024-03-04T12:33:16.717 INFO:teuthology.orchestra.run.smithi090.stdout:(191/284): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-03-04T12:33:16.752 INFO:teuthology.orchestra.run.smithi090.stdout:(192/284): qatlib-23.11.0-1.el9.x86_64.rpm 840 kB/s | 215 kB 00:00 2024-03-04T12:33:16.776 INFO:teuthology.orchestra.run.smithi090.stdout:(193/284): qatlib-service-23.11.0-1.el9.x86_64. 580 kB/s | 34 kB 00:00 2024-03-04T12:33:16.801 INFO:teuthology.orchestra.run.smithi090.stdout:(194/284): qatzip-libs-1.1.2-2.el9.x86_64.rpm 862 kB/s | 43 kB 00:00 2024-03-04T12:33:16.827 INFO:teuthology.orchestra.run.smithi090.stdout:(195/284): rtkit-0.11-28.el9.x86_64.rpm 1.1 MB/s | 55 kB 00:00 2024-03-04T12:33:16.860 INFO:teuthology.orchestra.run.smithi090.stdout:(196/284): sisu-0.3.4-10.el9.noarch.rpm 8.5 MB/s | 509 kB 00:00 2024-03-04T12:33:16.886 INFO:teuthology.orchestra.run.smithi090.stdout:(197/284): slf4j-1.7.30-13.el9.noarch.rpm 1.1 MB/s | 68 kB 00:00 2024-03-04T12:33:16.920 INFO:teuthology.orchestra.run.smithi090.stdout:(198/284): socat-1.7.4.1-5.el9.x86_64.rpm 4.9 MB/s | 300 kB 00:00 2024-03-04T12:33:16.954 INFO:teuthology.orchestra.run.smithi090.stdout:(199/284): sound-theme-freedesktop-0.8-17.el9.n 5.5 MB/s | 377 kB 00:00 2024-03-04T12:33:16.979 INFO:teuthology.orchestra.run.smithi090.stdout:(200/284): totem-pl-parser-3.26.6-2.el9.x86_64. 2.2 MB/s | 130 kB 00:00 2024-03-04T12:33:17.013 INFO:teuthology.orchestra.run.smithi090.stdout:(201/284): tracker-3.1.2-3.el9.x86_64.rpm 8.9 MB/s | 537 kB 00:00 2024-03-04T12:33:17.047 INFO:teuthology.orchestra.run.smithi090.stdout:(202/284): tracker-miners-3.1.2-4.el9.x86_64.rp 13 MB/s | 893 kB 00:00 2024-03-04T12:33:17.064 INFO:teuthology.orchestra.run.smithi090.stdout:(203/284): ttmkfdir-3.0.9-65.el9.x86_64.rpm 1.0 MB/s | 52 kB 00:00 2024-03-04T12:33:17.089 INFO:teuthology.orchestra.run.smithi090.stdout:(204/284): tzdata-java-2024a-1.el9.noarch.rpm 3.5 MB/s | 148 kB 00:00 2024-03-04T12:33:17.115 INFO:teuthology.orchestra.run.smithi090.stdout:(205/284): upower-0.99.11-11.el9.x86_64.rpm 3.3 MB/s | 168 kB 00:00 2024-03-04T12:33:17.140 INFO:teuthology.orchestra.run.smithi090.stdout:(206/284): webrtc-audio-processing-0.3.1-8.el9. 5.9 MB/s | 305 kB 00:00 2024-03-04T12:33:17.165 INFO:teuthology.orchestra.run.smithi090.stdout:(207/284): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-03-04T12:33:17.199 INFO:teuthology.orchestra.run.smithi090.stdout:(208/284): wireplumber-libs-0.4.14-1.el9.x86_64 5.6 MB/s | 337 kB 00:00 2024-03-04T12:33:17.225 INFO:teuthology.orchestra.run.smithi090.stdout:(209/284): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 712 kB/s | 41 kB 00:00 2024-03-04T12:33:17.250 INFO:teuthology.orchestra.run.smithi090.stdout:(210/284): xdg-desktop-portal-1.12.6-1.el9.x86_ 7.2 MB/s | 367 kB 00:00 2024-03-04T12:33:17.275 INFO:teuthology.orchestra.run.smithi090.stdout:(211/284): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 130 kB 00:00 2024-03-04T12:33:17.318 INFO:teuthology.orchestra.run.smithi090.stdout:(212/284): xkeyboard-config-2.33-2.el9.noarch.r 11 MB/s | 780 kB 00:00 2024-03-04T12:33:17.343 INFO:teuthology.orchestra.run.smithi090.stdout:(213/284): xmlstarlet-1.6.1-20.el9.x86_64.rpm 944 kB/s | 63 kB 00:00 2024-03-04T12:33:17.376 INFO:teuthology.orchestra.run.smithi090.stdout:(214/284): xorg-x11-fonts-Type1-7.5-33.el9.noar 8.3 MB/s | 499 kB 00:00 2024-03-04T12:33:17.410 INFO:teuthology.orchestra.run.smithi090.stdout:(215/284): ModemManager-glib-1.20.2-1.el9.x86_6 4.9 MB/s | 334 kB 00:00 2024-03-04T12:33:17.435 INFO:teuthology.orchestra.run.smithi090.stdout:(216/284): bluez-libs-5.64-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-03-04T12:33:17.462 INFO:teuthology.orchestra.run.smithi090.stdout:(217/284): bubblewrap-0.4.1-6.el9.x86_64.rpm 958 kB/s | 49 kB 00:00 2024-03-04T12:33:17.487 INFO:teuthology.orchestra.run.smithi090.stdout:(218/284): cups-libs-2.3.3op2-24.el9.x86_64.rpm 5.0 MB/s | 261 kB 00:00 2024-03-04T12:33:17.513 INFO:teuthology.orchestra.run.smithi090.stdout:(219/284): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-04T12:33:17.538 INFO:teuthology.orchestra.run.smithi090.stdout:(220/284): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-03-04T12:33:17.580 INFO:teuthology.orchestra.run.smithi090.stdout:(221/284): libgfortran-11.4.1-3.el9.x86_64.rpm 12 MB/s | 802 kB 00:00 2024-03-04T12:33:17.597 INFO:teuthology.orchestra.run.smithi090.stdout:(222/284): libpciaccess-0.16-6.el9.x86_64.rpm 461 kB/s | 27 kB 00:00 2024-03-04T12:33:17.622 INFO:teuthology.orchestra.run.smithi090.stdout:(223/284): libquadmath-11.4.1-3.el9.x86_64.rpm 4.5 MB/s | 194 kB 00:00 2024-03-04T12:33:17.648 INFO:teuthology.orchestra.run.smithi090.stdout:(224/284): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 90 kB 00:00 2024-03-04T12:33:17.673 INFO:teuthology.orchestra.run.smithi090.stdout:(225/284): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-03-04T12:33:17.698 INFO:teuthology.orchestra.run.smithi090.stdout:(226/284): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-04T12:33:17.757 INFO:teuthology.orchestra.run.smithi090.stdout:(227/284): python3-cryptography-36.0.1-4.el9.x8 14 MB/s | 1.1 MB 00:00 2024-03-04T12:33:17.783 INFO:teuthology.orchestra.run.smithi090.stdout:(228/284): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-04T12:33:17.808 INFO:teuthology.orchestra.run.smithi090.stdout:(229/284): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2024-03-04T12:33:17.833 INFO:teuthology.orchestra.run.smithi090.stdout:(230/284): python3-requests-2.25.1-8.el9.noarch 2.2 MB/s | 113 kB 00:00 2024-03-04T12:33:17.859 INFO:teuthology.orchestra.run.smithi090.stdout:(231/284): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-03-04T12:33:17.992 INFO:teuthology.orchestra.run.smithi090.stdout:(232/284): avahi-glib-0.8-12.el9.x86_64.rpm 93 kB/s | 15 kB 00:00 2024-03-04T12:33:18.051 INFO:teuthology.orchestra.run.smithi090.stdout:(233/284): libX11-xcb-1.7.0-8.el9.x86_64.rpm 187 kB/s | 11 kB 00:00 2024-03-04T12:33:18.093 INFO:teuthology.orchestra.run.smithi090.stdout:(234/284): flac-libs-1.3.3-12.el9.x86_64.rpm 932 kB/s | 218 kB 00:00 2024-03-04T12:33:18.152 INFO:teuthology.orchestra.run.smithi090.stdout:(235/284): p11-kit-server-0.24.1-2.el9.x86_64.r 3.3 MB/s | 199 kB 00:00 2024-03-04T12:33:18.219 INFO:teuthology.orchestra.run.smithi090.stdout:(236/284): python3-devel-3.9.17-2.el9.x86_64.rp 3.6 MB/s | 245 kB 00:00 2024-03-04T12:33:18.277 INFO:teuthology.orchestra.run.smithi090.stdout:(237/284): ostree-libs-2024.4-3.el9.x86_64.rpm 2.1 MB/s | 487 kB 00:00 2024-03-04T12:33:18.353 INFO:teuthology.orchestra.run.smithi090.stdout:(238/284): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-03-04T12:33:18.503 INFO:teuthology.orchestra.run.smithi090.stdout:(239/284): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-03-04T12:33:18.603 INFO:teuthology.orchestra.run.smithi090.stdout:(240/284): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-03-04T12:33:18.663 INFO:teuthology.orchestra.run.smithi090.stdout:(241/284): grpc-data-1.46.7-10.el9.noarch.rpm 326 kB/s | 19 kB 00:00 2024-03-04T12:33:18.722 INFO:teuthology.orchestra.run.smithi090.stdout:(242/284): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2024-03-04T12:33:18.789 INFO:teuthology.orchestra.run.smithi090.stdout:(243/284): libarrow-doc-9.0.0-10.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-03-04T12:33:18.830 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-03-04T12:33:18.830 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-03-04T12:33:18.856 INFO:teuthology.orchestra.run.smithi090.stdout:(244/284): liboath-2.6.7-2.el9.x86_64.rpm 726 kB/s | 49 kB 00:00 2024-03-04T12:33:18.940 INFO:teuthology.orchestra.run.smithi090.stdout:(245/284): libunwind-1.6.2-1.el9.x86_64.rpm 809 kB/s | 67 kB 00:00 2024-03-04T12:33:19.074 INFO:teuthology.orchestra.run.smithi090.stdout:(246/284): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-03-04T12:33:19.099 INFO:teuthology.orchestra.run.smithi090.stdout:(247/284): luarocks-3.9.2-1.el9.noarch.rpm 952 kB/s | 151 kB 00:00 2024-03-04T12:33:19.191 INFO:teuthology.orchestra.run.smithi090.stdout:(248/284): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.0 MB/s | 838 kB 00:00 2024-03-04T12:33:19.225 INFO:teuthology.orchestra.run.smithi090.stdout:(249/284): python3-asyncssh-2.13.2-4.el9.noarch 4.2 MB/s | 548 kB 00:00 2024-03-04T12:33:19.251 INFO:teuthology.orchestra.run.smithi090.stdout:(250/284): python3-bcrypt-3.2.2-1.el9.x86_64.rp 733 kB/s | 43 kB 00:00 2024-03-04T12:33:19.284 INFO:teuthology.orchestra.run.smithi090.stdout:(251/284): python3-cachetools-4.2.4-1.el9.noarc 548 kB/s | 32 kB 00:00 2024-03-04T12:33:19.310 INFO:teuthology.orchestra.run.smithi090.stdout:(252/284): python3-certifi-2021.10.8-2.el9.noar 254 kB/s | 15 kB 00:00 2024-03-04T12:33:19.351 INFO:teuthology.orchestra.run.smithi090.stdout:(253/284): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-03-04T12:33:19.402 INFO:teuthology.orchestra.run.smithi090.stdout:(254/284): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-03-04T12:33:19.436 INFO:teuthology.orchestra.run.smithi090.stdout:(255/284): python3-google-auth-2.28.0-1.el9.noa 2.4 MB/s | 203 kB 00:00 2024-03-04T12:33:19.513 INFO:teuthology.orchestra.run.smithi090.stdout:(256/284): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-03-04T12:33:19.586 INFO:teuthology.orchestra.run.smithi090.stdout:(257/284): python3-jaraco-8.2.1-3.el9.noarch.rp 143 kB/s | 11 kB 00:00 2024-03-04T12:33:19.687 INFO:teuthology.orchestra.run.smithi090.stdout:(258/284): python3-grpcio-1.46.7-10.el9.x86_64. 7.2 MB/s | 2.0 MB 00:00 2024-03-04T12:33:19.713 INFO:teuthology.orchestra.run.smithi090.stdout:(259/284): python3-jaraco-classes-3.2.1-5.el9.n 140 kB/s | 18 kB 00:00 2024-03-04T12:33:19.747 INFO:teuthology.orchestra.run.smithi090.stdout:(260/284): python3-jaraco-collections-3.0.0-8.e 388 kB/s | 23 kB 00:00 2024-03-04T12:33:19.772 INFO:teuthology.orchestra.run.smithi090.stdout:(261/284): python3-jaraco-functools-3.5.0-2.el9 331 kB/s | 19 kB 00:00 2024-03-04T12:33:19.806 INFO:teuthology.orchestra.run.smithi090.stdout:(262/284): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-03-04T12:33:19.873 INFO:teuthology.orchestra.run.smithi090.stdout:(263/284): python3-logutils-0.3.5-21.el9.noarch 695 kB/s | 46 kB 00:00 2024-03-04T12:33:19.915 INFO:teuthology.orchestra.run.smithi090.stdout:(264/284): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-03-04T12:33:19.940 INFO:teuthology.orchestra.run.smithi090.stdout:(265/284): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-03-04T12:33:19.982 INFO:teuthology.orchestra.run.smithi090.stdout:(266/284): python3-natsort-7.1.1-5.el9.noarch.r 864 kB/s | 58 kB 00:00 2024-03-04T12:33:20.016 INFO:teuthology.orchestra.run.smithi090.stdout:(267/284): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-04T12:33:20.050 INFO:teuthology.orchestra.run.smithi090.stdout:(268/284): python3-portend-3.1.0-2.el9.noarch.r 244 kB/s | 16 kB 00:00 2024-03-04T12:33:20.075 INFO:teuthology.orchestra.run.smithi090.stdout:(269/284): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-03-04T12:33:20.109 INFO:teuthology.orchestra.run.smithi090.stdout:(270/284): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2024-03-04T12:33:20.151 INFO:teuthology.orchestra.run.smithi090.stdout:(271/284): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-04T12:33:20.176 INFO:teuthology.orchestra.run.smithi090.stdout:(272/284): python3-rsa-4.9-2.el9.noarch.rpm 883 kB/s | 59 kB 00:00 2024-03-04T12:33:20.210 INFO:teuthology.orchestra.run.smithi090.stdout:(273/284): python3-tempora-5.0.0-2.el9.noarch.r 610 kB/s | 36 kB 00:00 2024-03-04T12:33:20.235 INFO:teuthology.orchestra.run.smithi090.stdout:(274/284): python3-typing-extensions-4.4.0-2.el 869 kB/s | 51 kB 00:00 2024-03-04T12:33:20.277 INFO:teuthology.orchestra.run.smithi090.stdout:(275/284): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-03-04T12:33:20.303 INFO:teuthology.orchestra.run.smithi090.stdout:(276/284): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-03-04T12:33:20.353 INFO:teuthology.orchestra.run.smithi090.stdout:(277/284): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-03-04T12:33:20.379 INFO:teuthology.orchestra.run.smithi090.stdout:(278/284): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-03-04T12:33:20.420 INFO:teuthology.orchestra.run.smithi090.stdout:(279/284): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-03-04T12:33:20.454 INFO:teuthology.orchestra.run.smithi090.stdout:(280/284): s3cmd-2.4.0-1.el9.noarch.rpm 2.7 MB/s | 206 kB 00:00 2024-03-04T12:33:20.596 INFO:teuthology.orchestra.run.smithi090.stdout:(281/284): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-03-04T12:33:20.955 INFO:teuthology.orchestra.run.smithi090.stdout:(282/284): librbd1-19.0.0-1871.g3aec3903.el9.x8 8.8 MB/s | 3.1 MB 00:00 2024-03-04T12:33:21.618 INFO:teuthology.orchestra.run.smithi090.stdout:(283/284): ceph-test-19.0.0-1871.g3aec3903.el9. 2.9 MB/s | 48 MB 00:16 2024-03-04T12:33:21.682 INFO:teuthology.orchestra.run.smithi090.stdout:(284/284): librados2-19.0.0-1871.g3aec3903.el9. 2.8 MB/s | 3.4 MB 00:01 2024-03-04T12:33:21.686 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-03-04T12:33:21.686 INFO:teuthology.orchestra.run.smithi090.stdout:Total 13 MB/s | 296 MB 00:23 2024-03-04T12:33:21.784 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-03-04T12:33:21.945 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-03-04T12:33:21.945 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-03-04T12:33:24.483 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-03-04T12:33:24.483 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-03-04T12:33:28.460 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-03-04T12:33:28.610 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 1/1 2024-03-04T12:33:28.771 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-03-04T12:33:28.842 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/286 2024-03-04T12:33:28.874 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/286 2024-03-04T12:33:28.939 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/286 2024-03-04T12:33:28.980 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : alsa-lib-1.2.10-2.el9.x86_64 4/286 2024-03-04T12:33:29.038 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/286 2024-03-04T12:33:29.084 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/286 2024-03-04T12:33:29.151 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/286 2024-03-04T12:33:29.363 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/286 2024-03-04T12:33:29.706 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/286 2024-03-04T12:33:29.769 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 10/286 2024-03-04T12:33:29.890 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 10/286 2024-03-04T12:33:29.920 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 11/286 2024-03-04T12:33:30.011 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 11/286 2024-03-04T12:33:30.040 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:19.0.0-1871.g3aec3903.el9.x86_64 12/286 2024-03-04T12:33:30.084 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/286 2024-03-04T12:33:30.125 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/286 2024-03-04T12:33:30.151 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/286 2024-03-04T12:33:30.174 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/286 2024-03-04T12:33:30.202 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 17/286 2024-03-04T12:33:30.233 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : opus-1.3.1-10.el9.x86_64 18/286 2024-03-04T12:33:30.268 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-5.4.4-4.el9.x86_64 19/286 2024-03-04T12:33:30.404 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/286 2024-03-04T12:33:30.522 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/286 2024-03-04T12:33:30.572 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/286 2024-03-04T12:33:30.614 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/286 2024-03-04T12:33:30.641 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 24/286 2024-03-04T12:33:30.728 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 24/286 2024-03-04T12:33:30.751 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86 25/286 2024-03-04T12:33:30.813 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86 25/286 2024-03-04T12:33:30.844 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/286 2024-03-04T12:33:30.869 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-04T12:33:30.885 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-04T12:33:31.053 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-04T12:33:31.094 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-04T12:33:31.203 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : re2-1:20211101-3.el9.x86_64 29/286 2024-03-04T12:33:31.306 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 30/286 2024-03-04T12:33:31.342 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 31/286 2024-03-04T12:33:31.412 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/286 2024-03-04T12:33:31.466 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 33/286 2024-03-04T12:33:31.496 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 34/286 2024-03-04T12:33:31.539 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 35/286 2024-03-04T12:33:31.576 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 36/286 2024-03-04T12:33:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.9-15.el9.x86_64 37/286 2024-03-04T12:33:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cups-libs-1:2.3.3op2-24.el9.x86_64 38/286 2024-03-04T12:33:31.746 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 39/286 2024-03-04T12:33:31.789 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 40/286 2024-03-04T12:33:31.832 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 41/286 2024-03-04T12:33:31.858 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 42/286 2024-03-04T12:33:31.881 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : mesa-libglapi-23.3.3-1.el9.x86_64 43/286 2024-03-04T12:33:31.909 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 44/286 2024-03-04T12:33:31.938 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 45/286 2024-03-04T12:33:31.967 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 46/286 2024-03-04T12:33:31.996 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 47/286 2024-03-04T12:33:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 48/286 2024-03-04T12:33:32.053 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 49/286 2024-03-04T12:33:32.112 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 50/286 2024-03-04T12:33:32.143 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : dconf-0.40.0-6.el9.x86_64 51/286 2024-03-04T12:33:32.214 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 51/286 2024-03-04T12:33:32.251 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:19.0.0-1871.g3aec3903.el9. 52/286 2024-03-04T12:33:32.294 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:19.0.0-1871.g3aec3903.el 53/286 2024-03-04T12:33:32.336 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:19.0.0-1871.g3aec3903.el9.x86_6 54/286 2024-03-04T12:33:32.410 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/286 2024-03-04T12:33:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/286 2024-03-04T12:33:32.596 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/286 2024-03-04T12:33:33.136 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/286 2024-03-04T12:33:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/286 2024-03-04T12:33:33.245 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 60/286 2024-03-04T12:33:33.305 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 61/286 2024-03-04T12:33:33.343 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/286 2024-03-04T12:33:33.379 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/286 2024-03-04T12:33:33.409 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/286 2024-03-04T12:33:33.479 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/286 2024-03-04T12:33:33.519 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : luarocks-3.9.2-1.el9.noarch 66/286 2024-03-04T12:33:33.544 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/286 2024-03-04T12:33:33.579 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/286 2024-03-04T12:33:33.617 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:19.0.0-1871.g3aec3903.el9.x86_6 69/286 2024-03-04T12:33:33.648 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/286 2024-03-04T12:33:33.684 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/286 2024-03-04T12:33:33.732 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 72/286 2024-03-04T12:33:33.791 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/286 2024-03-04T12:33:33.826 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/286 2024-03-04T12:33:33.871 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/286 2024-03-04T12:33:33.926 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/286 2024-03-04T12:33:34.000 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/286 2024-03-04T12:33:34.030 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 78/286 2024-03-04T12:33:34.066 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 79/286 2024-03-04T12:33:34.113 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/286 2024-03-04T12:33:34.158 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/286 2024-03-04T12:33:34.200 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/286 2024-03-04T12:33:34.344 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/286 2024-03-04T12:33:34.394 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/286 2024-03-04T12:33:34.400 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-03-04T12:33:34.435 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 85/286 2024-03-04T12:33:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/286 2024-03-04T12:33:34.546 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 1/1 2024-03-04T12:33:34.577 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 87/286 2024-03-04T12:33:34.617 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/286 2024-03-04T12:33:34.642 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/286 2024-03-04T12:33:34.667 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 90/286 2024-03-04T12:33:34.707 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-03-04T12:33:34.750 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/286 2024-03-04T12:33:34.779 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/286 2024-03-04T12:33:34.812 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/286 2024-03-04T12:33:34.921 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/286 2024-03-04T12:33:34.921 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/286 2024-03-04T12:33:34.928 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : alsa-lib-1.2.10-2.el9.x86_64 4/286 2024-03-04T12:33:34.994 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/286 2024-03-04T12:33:35.003 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/286 2024-03-04T12:33:35.037 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 94/286 2024-03-04T12:33:35.048 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/286 2024-03-04T12:33:35.078 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 95/286 2024-03-04T12:33:35.083 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/286 2024-03-04T12:33:35.112 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ostree-libs-2024.4-3.el9.x86_64 96/286 2024-03-04T12:33:35.154 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/286 2024-03-04T12:33:35.159 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 97/286 2024-03-04T12:33:35.217 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/286 2024-03-04T12:33:35.273 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/286 2024-03-04T12:33:35.480 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/286 2024-03-04T12:33:35.489 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/286 2024-03-04T12:33:35.522 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/286 2024-03-04T12:33:35.568 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 10/286 2024-03-04T12:33:35.670 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/286 2024-03-04T12:33:35.689 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 10/286 2024-03-04T12:33:35.719 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 103/286 2024-03-04T12:33:35.719 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 11/286 2024-03-04T12:33:35.753 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 104/286 2024-03-04T12:33:35.785 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 105/286 2024-03-04T12:33:35.811 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 11/286 2024-03-04T12:33:35.822 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jq-1.6-16.el9.x86_64 106/286 2024-03-04T12:33:35.840 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rados-2:19.0.0-1871.g3aec3903.el9.x86_64 12/286 2024-03-04T12:33:35.850 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 107/286 2024-03-04T12:33:35.878 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/286 2024-03-04T12:33:35.885 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 108/286 2024-03-04T12:33:35.916 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/286 2024-03-04T12:33:35.917 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 109/286 2024-03-04T12:33:35.944 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : mesa-libgbm-23.3.3-1.el9.x86_64 110/286 2024-03-04T12:33:35.950 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/286 2024-03-04T12:33:35.978 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 111/286 2024-03-04T12:33:35.982 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/286 2024-03-04T12:33:36.012 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 17/286 2024-03-04T12:33:36.012 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : mesa-libEGL-23.3.3-1.el9.x86_64 112/286 2024-03-04T12:33:36.045 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 113/286 2024-03-04T12:33:36.051 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : opus-1.3.1-10.el9.x86_64 18/286 2024-03-04T12:33:36.077 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 114/286 2024-03-04T12:33:36.096 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-5.4.4-4.el9.x86_64 19/286 2024-03-04T12:33:36.108 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 115/286 2024-03-04T12:33:36.224 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/286 2024-03-04T12:33:36.313 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 116/286 2024-03-04T12:33:36.348 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/286 2024-03-04T12:33:36.359 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 117/286 2024-03-04T12:33:36.395 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/286 2024-03-04T12:33:36.408 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 118/286 2024-03-04T12:33:36.434 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/286 2024-03-04T12:33:36.446 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 119/286 2024-03-04T12:33:36.462 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 24/286 2024-03-04T12:33:36.495 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 120/286 2024-03-04T12:33:36.525 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : upower-0.99.11-11.el9.x86_64 121/286 2024-03-04T12:33:36.538 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 121/286 2024-03-04T12:33:36.539 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-03-04T12:33:36.539 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:33:36.566 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 24/286 2024-03-04T12:33:36.589 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86 25/286 2024-03-04T12:33:36.651 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86 25/286 2024-03-04T12:33:36.676 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/286 2024-03-04T12:33:36.699 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-04T12:33:36.715 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-04T12:33:36.720 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : tzdata-java-2024a-1.el9.noarch 122/286 2024-03-04T12:33:36.788 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 123/286 2024-03-04T12:33:36.839 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 124/286 2024-03-04T12:33:36.864 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 125/286 2024-03-04T12:33:36.889 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 125/286 2024-03-04T12:33:36.911 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-04T12:33:36.916 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 126/286 2024-03-04T12:33:36.961 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-04T12:33:37.066 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : re2-1:20211101-3.el9.x86_64 29/286 2024-03-04T12:33:37.164 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 30/286 2024-03-04T12:33:37.208 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 31/286 2024-03-04T12:33:37.278 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/286 2024-03-04T12:33:37.287 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 127/286 2024-03-04T12:33:37.319 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rtkit-0.11-28.el9.x86_64 127/286 2024-03-04T12:33:37.331 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 127/286 2024-03-04T12:33:37.331 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-03-04T12:33:37.331 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:33:37.339 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 33/286 2024-03-04T12:33:37.375 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 34/286 2024-03-04T12:33:37.376 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 128/286 2024-03-04T12:33:37.414 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 35/286 2024-03-04T12:33:37.450 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 36/286 2024-03-04T12:33:37.453 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 129/286 2024-03-04T12:33:37.483 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : fuse-2.9.9-15.el9.x86_64 37/286 2024-03-04T12:33:37.486 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 130/286 2024-03-04T12:33:37.519 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 131/286 2024-03-04T12:33:37.532 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cups-libs-1:2.3.3op2-24.el9.x86_64 38/286 2024-03-04T12:33:37.561 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 132/286 2024-03-04T12:33:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 133/286 2024-03-04T12:33:37.606 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 39/286 2024-03-04T12:33:37.656 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 40/286 2024-03-04T12:33:37.686 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 134/286 2024-03-04T12:33:37.700 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 41/286 2024-03-04T12:33:37.734 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 42/286 2024-03-04T12:33:37.758 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : mesa-libglapi-23.3.3-1.el9.x86_64 43/286 2024-03-04T12:33:37.785 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 44/286 2024-03-04T12:33:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 135/286 2024-03-04T12:33:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 45/286 2024-03-04T12:33:37.843 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 136/286 2024-03-04T12:33:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 46/286 2024-03-04T12:33:37.874 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 137/286 2024-03-04T12:33:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 47/286 2024-03-04T12:33:37.914 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 48/286 2024-03-04T12:33:37.921 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 138/286 2024-03-04T12:33:37.963 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 49/286 2024-03-04T12:33:38.019 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 50/286 2024-03-04T12:33:38.020 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-packaging-20.9-5.el9.noarch 139/286 2024-03-04T12:33:38.055 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : dconf-0.40.0-6.el9.x86_64 51/286 2024-03-04T12:33:38.067 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 140/286 2024-03-04T12:33:38.134 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 51/286 2024-03-04T12:33:38.171 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-common-2:19.0.0-1871.g3aec3903.el9. 52/286 2024-03-04T12:33:38.214 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-argparse-2:19.0.0-1871.g3aec3903.el 53/286 2024-03-04T12:33:38.256 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cephfs-2:19.0.0-1871.g3aec3903.el9.x86_6 54/286 2024-03-04T12:33:38.332 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/286 2024-03-04T12:33:38.478 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/286 2024-03-04T12:33:38.535 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/286 2024-03-04T12:33:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 141/286 2024-03-04T12:33:38.873 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 142/286 2024-03-04T12:33:38.906 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 143/286 2024-03-04T12:33:38.944 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 144/286 2024-03-04T12:33:39.075 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/286 2024-03-04T12:33:39.131 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 145/286 2024-03-04T12:33:39.167 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/286 2024-03-04T12:33:39.174 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 146/286 2024-03-04T12:33:39.201 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 60/286 2024-03-04T12:33:39.273 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 61/286 2024-03-04T12:33:39.317 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/286 2024-03-04T12:33:39.353 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/286 2024-03-04T12:33:39.383 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/286 2024-03-04T12:33:39.453 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/286 2024-03-04T12:33:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : luarocks-3.9.2-1.el9.noarch 66/286 2024-03-04T12:33:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/286 2024-03-04T12:33:39.572 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/286 2024-03-04T12:33:39.610 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librados-devel-2:19.0.0-1871.g3aec3903.el9.x86_6 69/286 2024-03-04T12:33:39.649 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/286 2024-03-04T12:33:39.659 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 147/286 2024-03-04T12:33:39.685 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/286 2024-03-04T12:33:39.719 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : osinfo-db-20231215-1.el9.noarch 148/286 2024-03-04T12:33:39.735 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 72/286 2024-03-04T12:33:39.766 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 149/286 2024-03-04T12:33:39.800 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/286 2024-03-04T12:33:39.807 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : orc-0.4.31-6.el9.x86_64 150/286 2024-03-04T12:33:39.827 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/286 2024-03-04T12:33:39.840 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 151/286 2024-03-04T12:33:39.864 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/286 2024-03-04T12:33:39.922 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/286 2024-03-04T12:33:39.996 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/286 2024-03-04T12:33:40.018 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.21-2.el9.x86_64 152/286 2024-03-04T12:33:40.033 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 78/286 2024-03-04T12:33:40.046 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 153/286 2024-03-04T12:33:40.070 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 79/286 2024-03-04T12:33:40.117 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/286 2024-03-04T12:33:40.124 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 154/286 2024-03-04T12:33:40.162 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/286 2024-03-04T12:33:40.213 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/286 2024-03-04T12:33:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/286 2024-03-04T12:33:40.398 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/286 2024-03-04T12:33:40.441 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 85/286 2024-03-04T12:33:40.536 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/286 2024-03-04T12:33:40.575 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 87/286 2024-03-04T12:33:40.615 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/286 2024-03-04T12:33:40.649 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/286 2024-03-04T12:33:40.682 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 90/286 2024-03-04T12:33:40.783 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/286 2024-03-04T12:33:40.787 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 155/286 2024-03-04T12:33:40.912 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 156/286 2024-03-04T12:33:40.926 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/286 2024-03-04T12:33:41.042 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/286 2024-03-04T12:33:41.095 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 94/286 2024-03-04T12:33:41.130 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 95/286 2024-03-04T12:33:41.157 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ostree-libs-2024.4-3.el9.x86_64 96/286 2024-03-04T12:33:41.193 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 97/286 2024-03-04T12:33:41.251 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/286 2024-03-04T12:33:41.315 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/286 2024-03-04T12:33:41.524 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/286 2024-03-04T12:33:41.582 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/286 2024-03-04T12:33:41.721 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/286 2024-03-04T12:33:41.764 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 103/286 2024-03-04T12:33:41.797 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 104/286 2024-03-04T12:33:41.836 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 105/286 2024-03-04T12:33:41.866 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : jq-1.6-16.el9.x86_64 106/286 2024-03-04T12:33:41.903 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 107/286 2024-03-04T12:33:41.942 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 108/286 2024-03-04T12:33:41.970 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 109/286 2024-03-04T12:33:42.005 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : mesa-libgbm-23.3.3-1.el9.x86_64 110/286 2024-03-04T12:33:42.083 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 111/286 2024-03-04T12:33:42.116 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : mesa-libEGL-23.3.3-1.el9.x86_64 112/286 2024-03-04T12:33:42.141 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 113/286 2024-03-04T12:33:42.168 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 157/286 2024-03-04T12:33:42.183 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 114/286 2024-03-04T12:33:42.222 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 115/286 2024-03-04T12:33:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 158/286 2024-03-04T12:33:42.299 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-posix-35.0-8.el9.x86_64 159/286 2024-03-04T12:33:42.436 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 116/286 2024-03-04T12:33:42.482 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 117/286 2024-03-04T12:33:42.514 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 118/286 2024-03-04T12:33:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 119/286 2024-03-04T12:33:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 120/286 2024-03-04T12:33:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : upower-0.99.11-11.el9.x86_64 121/286 2024-03-04T12:33:42.628 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 121/286 2024-03-04T12:33:42.628 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-03-04T12:33:42.628 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:33:42.812 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : tzdata-java-2024a-1.el9.noarch 122/286 2024-03-04T12:33:42.898 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 123/286 2024-03-04T12:33:42.948 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 124/286 2024-03-04T12:33:42.982 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 125/286 2024-03-04T12:33:43.006 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 125/286 2024-03-04T12:33:43.033 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 126/286 2024-03-04T12:33:43.207 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 160/286 2024-03-04T12:33:43.245 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-04T12:33:43.440 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 127/286 2024-03-04T12:33:43.465 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rtkit-0.11-28.el9.x86_64 127/286 2024-03-04T12:33:43.476 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 127/286 2024-03-04T12:33:43.476 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-03-04T12:33:43.476 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:33:43.521 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 128/286 2024-03-04T12:33:43.598 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 129/286 2024-03-04T12:33:43.600 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-04T12:33:43.640 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 130/286 2024-03-04T12:33:43.643 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 162/286 2024-03-04T12:33:43.673 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 131/286 2024-03-04T12:33:43.682 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : slf4j-1.7.30-13.el9.noarch 163/286 2024-03-04T12:33:43.709 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : atinject-1.0.3-6.el9.noarch 164/286 2024-03-04T12:33:43.716 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 132/286 2024-03-04T12:33:43.751 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 133/286 2024-03-04T12:33:43.753 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 165/286 2024-03-04T12:33:43.790 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 166/286 2024-03-04T12:33:43.817 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 167/286 2024-03-04T12:33:43.842 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 134/286 2024-03-04T12:33:43.843 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 168/286 2024-03-04T12:33:43.877 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 169/286 2024-03-04T12:33:43.902 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 170/286 2024-03-04T12:33:43.928 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 171/286 2024-03-04T12:33:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 135/286 2024-03-04T12:33:43.954 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 172/286 2024-03-04T12:33:43.980 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 173/286 2024-03-04T12:33:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 136/286 2024-03-04T12:33:44.019 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 174/286 2024-03-04T12:33:44.023 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 137/286 2024-03-04T12:33:44.047 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 175/286 2024-03-04T12:33:44.070 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 138/286 2024-03-04T12:33:44.073 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 176/286 2024-03-04T12:33:44.109 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 177/286 2024-03-04T12:33:44.140 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 178/286 2024-03-04T12:33:44.174 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 179/286 2024-03-04T12:33:44.177 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-packaging-20.9-5.el9.noarch 139/286 2024-03-04T12:33:44.208 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jansi-2.3.3-6.el9.x86_64 180/286 2024-03-04T12:33:44.233 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 140/286 2024-03-04T12:33:44.245 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jsoup-1.13.1-10.el9.noarch 181/286 2024-03-04T12:33:44.284 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 182/286 2024-03-04T12:33:44.351 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 183/286 2024-03-04T12:33:44.396 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 184/286 2024-03-04T12:33:44.427 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : guava-30.1-6.el9.noarch 185/286 2024-03-04T12:33:44.450 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : google-guice-4.2.3-9.el9.noarch 186/286 2024-03-04T12:33:44.505 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 187/286 2024-03-04T12:33:44.545 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 188/286 2024-03-04T12:33:44.577 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-04T12:33:44.587 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-04T12:33:44.587 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-03-04T12:33:44.587 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:33:44.652 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 190/286 2024-03-04T12:33:44.679 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 191/286 2024-03-04T12:33:44.707 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libsbc-1.4-9.el9.x86_64 192/286 2024-03-04T12:33:44.986 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 141/286 2024-03-04T12:33:45.023 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 193/286 2024-03-04T12:33:45.048 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 142/286 2024-03-04T12:33:45.054 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 194/286 2024-03-04T12:33:45.082 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 143/286 2024-03-04T12:33:45.124 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 144/286 2024-03-04T12:33:45.127 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 194/286 2024-03-04T12:33:45.160 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:19.0.0-1871.g3aec3903.el9.x86_64 195/286 2024-03-04T12:33:45.190 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 196/286 2024-03-04T12:33:45.315 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 145/286 2024-03-04T12:33:45.374 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 146/286 2024-03-04T12:33:45.614 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-04T12:33:45.644 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-04T12:33:45.661 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-04T12:33:45.693 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 198/286 2024-03-04T12:33:45.759 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 199/286 2024-03-04T12:33:45.802 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 200/286 2024-03-04T12:33:45.818 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 201/286 2024-03-04T12:33:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 202/286 2024-03-04T12:33:45.866 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 147/286 2024-03-04T12:33:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-04T12:33:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : osinfo-db-20231215-1.el9.noarch 148/286 2024-03-04T12:33:45.980 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 149/286 2024-03-04T12:33:46.012 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : orc-0.4.31-6.el9.x86_64 150/286 2024-03-04T12:33:46.046 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 151/286 2024-03-04T12:33:46.186 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-04T12:33:46.220 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libexif-0.6.22-6.el9.x86_64 204/286 2024-03-04T12:33:46.223 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-0.3.21-2.el9.x86_64 152/286 2024-03-04T12:33:46.248 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 205/286 2024-03-04T12:33:46.252 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 153/286 2024-03-04T12:33:46.273 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libasyncns-0.8-22.el9.x86_64 206/286 2024-03-04T12:33:46.301 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 207/286 2024-03-04T12:33:46.325 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 208/286 2024-03-04T12:33:46.330 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 154/286 2024-03-04T12:33:46.350 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : mesa-libGL-23.3.3-1.el9.x86_64 209/286 2024-03-04T12:33:46.375 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libXv-1.0.11-16.el9.x86_64 210/286 2024-03-04T12:33:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 211/286 2024-03-04T12:33:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 212/286 2024-03-04T12:33:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 213/286 2024-03-04T12:33:46.506 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtiff-4.4.0-12.el9.x86_64 214/286 2024-03-04T12:33:46.540 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 215/286 2024-03-04T12:33:46.588 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 216/286 2024-03-04T12:33:46.615 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : poppler-21.01.0-19.el9.x86_64 217/286 2024-03-04T12:33:47.016 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 155/286 2024-03-04T12:33:47.089 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 218/286 2024-03-04T12:33:47.154 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 156/286 2024-03-04T12:33:47.220 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 219/286 2024-03-04T12:33:47.279 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 220/286 2024-03-04T12:33:47.305 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 221/286 2024-03-04T12:33:47.333 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gsm-1.0.19-6.el9.x86_64 222/286 2024-03-04T12:33:47.405 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 223/286 2024-03-04T12:33:47.448 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 224/286 2024-03-04T12:33:47.473 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcanberra-0.30-27.el9.x86_64 225/286 2024-03-04T12:33:47.492 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 225/286 2024-03-04T12:33:47.602 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : graphene-1.10.6-2.el9.x86_64 226/286 2024-03-04T12:33:47.648 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 227/286 2024-03-04T12:33:47.673 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : giflib-5.2.1-9.el9.x86_64 228/286 2024-03-04T12:33:47.700 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 229/286 2024-03-04T12:33:47.729 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-04T12:33:48.457 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 157/286 2024-03-04T12:33:48.564 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 158/286 2024-03-04T12:33:48.607 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-posix-35.0-8.el9.x86_64 159/286 2024-03-04T12:33:49.498 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 160/286 2024-03-04T12:33:49.571 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-04T12:33:49.927 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-04T12:33:49.969 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 162/286 2024-03-04T12:33:50.000 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : slf4j-1.7.30-13.el9.noarch 163/286 2024-03-04T12:33:50.036 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : atinject-1.0.3-6.el9.noarch 164/286 2024-03-04T12:33:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 165/286 2024-03-04T12:33:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 166/286 2024-03-04T12:33:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 167/286 2024-03-04T12:33:50.161 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 168/286 2024-03-04T12:33:50.187 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 169/286 2024-03-04T12:33:50.212 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 170/286 2024-03-04T12:33:50.238 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 171/286 2024-03-04T12:33:50.272 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 172/286 2024-03-04T12:33:50.307 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 173/286 2024-03-04T12:33:50.337 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 174/286 2024-03-04T12:33:50.374 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 175/286 2024-03-04T12:33:50.410 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 176/286 2024-03-04T12:33:50.446 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 177/286 2024-03-04T12:33:50.477 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 178/286 2024-03-04T12:33:50.511 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 179/286 2024-03-04T12:33:50.545 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : jansi-2.3.3-6.el9.x86_64 180/286 2024-03-04T12:33:50.573 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : jsoup-1.13.1-10.el9.noarch 181/286 2024-03-04T12:33:50.621 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 182/286 2024-03-04T12:33:50.662 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 183/286 2024-03-04T12:33:50.707 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 184/286 2024-03-04T12:33:50.739 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : guava-30.1-6.el9.noarch 185/286 2024-03-04T12:33:50.771 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : google-guice-4.2.3-9.el9.noarch 186/286 2024-03-04T12:33:50.824 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 187/286 2024-03-04T12:33:50.866 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 188/286 2024-03-04T12:33:50.889 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-04T12:33:50.900 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-04T12:33:50.900 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-03-04T12:33:50.900 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:33:50.956 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 190/286 2024-03-04T12:33:50.985 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 191/286 2024-03-04T12:33:51.021 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libsbc-1.4-9.el9.x86_64 192/286 2024-03-04T12:33:51.335 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 193/286 2024-03-04T12:33:51.360 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 194/286 2024-03-04T12:33:51.450 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 194/286 2024-03-04T12:33:51.493 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rbd-2:19.0.0-1871.g3aec3903.el9.x86_64 195/286 2024-03-04T12:33:51.522 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 196/286 2024-03-04T12:33:51.924 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-04T12:33:51.953 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-04T12:33:51.971 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-04T12:33:52.011 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 198/286 2024-03-04T12:33:52.068 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 199/286 2024-03-04T12:33:52.112 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 200/286 2024-03-04T12:33:52.146 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 201/286 2024-03-04T12:33:52.200 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 202/286 2024-03-04T12:33:52.228 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-04T12:33:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-04T12:33:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libexif-0.6.22-6.el9.x86_64 204/286 2024-03-04T12:33:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 205/286 2024-03-04T12:33:52.675 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libasyncns-0.8-22.el9.x86_64 206/286 2024-03-04T12:33:52.704 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 207/286 2024-03-04T12:33:52.729 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 208/286 2024-03-04T12:33:52.753 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : mesa-libGL-23.3.3-1.el9.x86_64 209/286 2024-03-04T12:33:52.779 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libXv-1.0.11-16.el9.x86_64 210/286 2024-03-04T12:33:52.813 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 211/286 2024-03-04T12:33:52.849 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 212/286 2024-03-04T12:33:52.906 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 213/286 2024-03-04T12:33:52.961 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libtiff-4.4.0-12.el9.x86_64 214/286 2024-03-04T12:33:52.995 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 215/286 2024-03-04T12:33:53.043 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 216/286 2024-03-04T12:33:53.070 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : poppler-21.01.0-19.el9.x86_64 217/286 2024-03-04T12:33:53.526 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 218/286 2024-03-04T12:33:53.653 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 219/286 2024-03-04T12:33:53.711 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 220/286 2024-03-04T12:33:53.745 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 221/286 2024-03-04T12:33:53.781 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gsm-1.0.19-6.el9.x86_64 222/286 2024-03-04T12:33:53.848 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 223/286 2024-03-04T12:33:53.897 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 224/286 2024-03-04T12:33:53.924 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcanberra-0.30-27.el9.x86_64 225/286 2024-03-04T12:33:53.942 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 225/286 2024-03-04T12:33:54.055 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : graphene-1.10.6-2.el9.x86_64 226/286 2024-03-04T12:33:54.108 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 227/286 2024-03-04T12:33:54.142 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : giflib-5.2.1-9.el9.x86_64 228/286 2024-03-04T12:33:54.178 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 229/286 2024-03-04T12:33:54.206 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-04T12:34:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-04T12:34:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 231/286 2024-03-04T12:34:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 232/286 2024-03-04T12:34:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 232/286 2024-03-04T12:34:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 232/286 2024-03-04T12:34:01.357 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-03-04T12:34:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:01.603 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 233/286 2024-03-04T12:34:01.670 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 234/286 2024-03-04T12:34:01.703 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 235/286 2024-03-04T12:34:02.172 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 236/286 2024-03-04T12:34:02.258 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 236/286 2024-03-04T12:34:02.296 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 237/286 2024-03-04T12:34:02.323 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 237/286 2024-03-04T12:34:02.365 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 238/286 2024-03-04T12:34:02.411 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 239/286 2024-03-04T12:34:02.479 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 240/286 2024-03-04T12:34:02.509 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : tracker-3.1.2-3.el9.x86_64 241/286 2024-03-04T12:34:02.614 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 241/286 2024-03-04T12:34:02.665 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-04T12:34:02.679 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-04T12:34:02.730 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 243/286 2024-03-04T12:34:03.189 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 244/286 2024-03-04T12:34:03.216 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 245/286 2024-03-04T12:34:03.288 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 245/286 2024-03-04T12:34:03.318 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:19.0.0-1871.g3aec3903.el9.x86_64 246/286 2024-03-04T12:34:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 247/286 2024-03-04T12:34:05.559 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 247/286 2024-03-04T12:34:06.102 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 247/286 2024-03-04T12:34:06.143 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 248/286 2024-03-04T12:34:06.252 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 248/286 2024-03-04T12:34:06.252 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T12:34:06.252 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T12:34:06.253 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:06.286 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 249/286 2024-03-04T12:34:09.858 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-04T12:34:09.893 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 231/286 2024-03-04T12:34:10.363 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 232/286 2024-03-04T12:34:10.392 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 232/286 2024-03-04T12:34:10.408 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 232/286 2024-03-04T12:34:10.408 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-03-04T12:34:10.408 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:10.647 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 233/286 2024-03-04T12:34:10.714 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 234/286 2024-03-04T12:34:10.757 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 235/286 2024-03-04T12:34:11.272 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 236/286 2024-03-04T12:34:11.355 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 236/286 2024-03-04T12:34:11.396 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 237/286 2024-03-04T12:34:11.423 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 237/286 2024-03-04T12:34:11.465 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 238/286 2024-03-04T12:34:11.511 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 239/286 2024-03-04T12:34:11.593 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 240/286 2024-03-04T12:34:11.627 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : tracker-3.1.2-3.el9.x86_64 241/286 2024-03-04T12:34:11.737 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 241/286 2024-03-04T12:34:11.785 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-04T12:34:11.799 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-04T12:34:11.846 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 243/286 2024-03-04T12:34:12.310 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 244/286 2024-03-04T12:34:12.336 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 245/286 2024-03-04T12:34:12.410 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 245/286 2024-03-04T12:34:12.440 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rgw-2:19.0.0-1871.g3aec3903.el9.x86_64 246/286 2024-03-04T12:34:14.717 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 247/286 2024-03-04T12:34:14.780 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 247/286 2024-03-04T12:34:15.329 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 247/286 2024-03-04T12:34:15.377 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 248/286 2024-03-04T12:34:15.482 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 248/286 2024-03-04T12:34:15.482 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T12:34:15.482 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T12:34:15.482 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:15.512 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 249/286 2024-03-04T12:34:15.811 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 249/286 2024-03-04T12:34:15.811 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2024-03-04T12:34:15.811 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2024-03-04T12:34:15.811 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2024-03-04T12:34:15.811 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2024-03-04T12:34:15.811 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2024-03-04T12:34:15.811 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /root 2024-03-04T12:34:15.811 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2024-03-04T12:34:15.812 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:15.977 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 250/286 2024-03-04T12:34:15.991 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 250/286 2024-03-04T12:34:15.991 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:15.991 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-04T12:34:15.992 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:17.427 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 251/286 2024-03-04T12:34:17.453 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 251/286 2024-03-04T12:34:17.453 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:17.453 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T12:34:17.453 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T12:34:17.454 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T12:34:17.454 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:17.661 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 252/286 2024-03-04T12:34:17.683 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 252/286 2024-03-04T12:34:17.683 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:17.683 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T12:34:17.683 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T12:34:17.683 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T12:34:17.683 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 253/286 2024-03-04T12:34:18.151 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 253/286 2024-03-04T12:34:18.151 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:18.151 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T12:34:18.151 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T12:34:18.151 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T12:34:18.151 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:21.028 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 254/286 2024-03-04T12:34:21.130 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 255/286 2024-03-04T12:34:21.181 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 256/286 2024-03-04T12:34:21.218 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-04T12:34:21.400 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-04T12:34:21.450 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 258/286 2024-03-04T12:34:21.474 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-04T12:34:21.535 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-04T12:34:21.568 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-04T12:34:21.579 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-04T12:34:21.602 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : maven-1:3.6.3-15.el9.noarch 261/286 2024-03-04T12:34:21.620 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 261/286 2024-03-04T12:34:21.645 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 262/286 2024-03-04T12:34:22.087 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 263/286 2024-03-04T12:34:22.117 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 263/286 2024-03-04T12:34:22.150 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1871.g3aec3903.e 264/286 2024-03-04T12:34:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1871.g3aec3903. 265/286 2024-03-04T12:34:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noa 266/286 2024-03-04T12:34:22.461 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noa 266/286 2024-03-04T12:34:22.501 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.n 267/286 2024-03-04T12:34:23.471 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.n 267/286 2024-03-04T12:34:23.509 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1871.g3ae 268/286 2024-03-04T12:34:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1871.g3ae 268/286 2024-03-04T12:34:23.782 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1871.g3aec3903.el 269/286 2024-03-04T12:34:23.820 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 270/286 2024-03-04T12:34:23.842 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 270/286 2024-03-04T12:34:23.842 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:23.842 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T12:34:23.843 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T12:34:23.843 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T12:34:23.843 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:23.887 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 271/286 2024-03-04T12:34:23.898 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 271/286 2024-03-04T12:34:24.767 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:19.0.0-1871.g3aec3903.el9.x86_64 272/286 2024-03-04T12:34:24.796 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 273/286 2024-03-04T12:34:24.819 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 273/286 2024-03-04T12:34:24.820 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:24.820 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T12:34:24.820 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T12:34:24.820 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T12:34:24.820 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:24.864 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1871.g3aec3 274/286 2024-03-04T12:34:24.885 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1871.g3aec3 274/286 2024-03-04T12:34:24.885 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:24.885 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T12:34:24.886 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:25.189 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 275/286 2024-03-04T12:34:25.211 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 275/286 2024-03-04T12:34:25.211 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:25.212 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T12:34:25.212 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T12:34:25.212 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T12:34:25.212 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:25.580 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 249/286 2024-03-04T12:34:25.580 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /sys 2024-03-04T12:34:25.581 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /proc 2024-03-04T12:34:25.581 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /mnt 2024-03-04T12:34:25.581 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /var/tmp 2024-03-04T12:34:25.581 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /home 2024-03-04T12:34:25.581 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /root 2024-03-04T12:34:25.581 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /tmp 2024-03-04T12:34:25.581 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:25.748 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 250/286 2024-03-04T12:34:25.762 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 250/286 2024-03-04T12:34:25.762 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:25.763 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-04T12:34:25.763 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:27.215 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 251/286 2024-03-04T12:34:27.241 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 251/286 2024-03-04T12:34:27.241 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:27.241 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T12:34:27.241 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T12:34:27.241 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T12:34:27.241 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:27.450 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 252/286 2024-03-04T12:34:27.471 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 252/286 2024-03-04T12:34:27.471 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:27.472 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T12:34:27.472 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T12:34:27.472 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T12:34:27.472 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:27.909 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 253/286 2024-03-04T12:34:27.931 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 253/286 2024-03-04T12:34:27.931 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:27.931 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T12:34:27.931 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T12:34:27.931 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T12:34:27.931 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:29.718 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:19.0.0-1871.g3aec3903.el9.x86_64 276/286 2024-03-04T12:34:29.747 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 277/286 2024-03-04T12:34:29.804 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 278/286 2024-03-04T12:34:29.836 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-04T12:34:29.851 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-04T12:34:29.851 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-03-04T12:34:29.852 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:29.902 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 280/286 2024-03-04T12:34:29.934 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:19.0.0-1871.g3aec3903.el9.x86_64 281/286 2024-03-04T12:34:30.039 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:19.0.0-1871.g3aec3903.el9.x86_ 282/286 2024-03-04T12:34:30.095 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 283/286 2024-03-04T12:34:30.125 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 284/286 2024-03-04T12:34:30.125 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-04T12:34:30.209 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-04T12:34:30.209 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:34:30.283 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:34:30.312 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 286/286 2024-03-04T12:34:30.318 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 286/286 2024-03-04T12:34:30.326 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 286/286 2024-03-04T12:34:30.335 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 286/286 2024-03-04T12:34:30.335 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-04T12:34:30.335 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-04T12:34:30.336 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:30.413 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 286/286 2024-03-04T12:34:30.482 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 286/286 2024-03-04T12:34:30.835 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 254/286 2024-03-04T12:34:30.924 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 255/286 2024-03-04T12:34:30.968 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 256/286 2024-03-04T12:34:31.004 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-04T12:34:31.185 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-04T12:34:31.239 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 258/286 2024-03-04T12:34:31.271 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-04T12:34:31.331 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-04T12:34:31.367 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-04T12:34:31.378 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-04T12:34:31.409 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : maven-1:3.6.3-15.el9.noarch 261/286 2024-03-04T12:34:31.425 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 261/286 2024-03-04T12:34:31.452 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 262/286 2024-03-04T12:34:31.895 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 263/286 2024-03-04T12:34:31.925 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 263/286 2024-03-04T12:34:31.959 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1871.g3aec3903.e 264/286 2024-03-04T12:34:32.020 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1871.g3aec3903. 265/286 2024-03-04T12:34:32.051 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noa 266/286 2024-03-04T12:34:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noa 266/286 2024-03-04T12:34:32.310 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.n 267/286 2024-03-04T12:34:33.282 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.n 267/286 2024-03-04T12:34:33.311 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1871.g3ae 268/286 2024-03-04T12:34:33.411 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1871.g3ae 268/286 2024-03-04T12:34:33.565 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1871.g3aec3903.el 269/286 2024-03-04T12:34:33.589 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 270/286 2024-03-04T12:34:33.611 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 270/286 2024-03-04T12:34:33.611 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:33.612 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T12:34:33.612 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T12:34:33.612 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T12:34:33.612 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:33.664 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 271/286 2024-03-04T12:34:33.675 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 271/286 2024-03-04T12:34:34.568 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-2:19.0.0-1871.g3aec3903.el9.x86_64 272/286 2024-03-04T12:34:34.608 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 273/286 2024-03-04T12:34:34.630 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 273/286 2024-03-04T12:34:34.630 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:34.630 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T12:34:34.630 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T12:34:34.630 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T12:34:34.630 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:34.676 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1871.g3aec3 274/286 2024-03-04T12:34:34.698 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1871.g3aec3 274/286 2024-03-04T12:34:34.698 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:34.698 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T12:34:34.698 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:35.010 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 275/286 2024-03-04T12:34:35.033 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 275/286 2024-03-04T12:34:35.033 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:34:35.033 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T12:34:35.033 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T12:34:35.033 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T12:34:35.033 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:37.020 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:19.0.0-1871.g3aec3903.el9.x86_64 1/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 2/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 3/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 4/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1871.g3aec3 5/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 6/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 7/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 8/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 9/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 10/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 11/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:19.0.0-1871.g3aec3903.el9.x86_64 12/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:19.0.0-1871.g3aec3903.el9.x86_ 13/286 2024-03-04T12:34:37.021 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 14/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 15/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:19.0.0-1871.g3aec3903.el9.x86_6 16/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86 17/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 18/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1871.g3aec3903.el 19/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:19.0.0-1871.g3aec3903.el9. 20/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:19.0.0-1871.g3aec3903.el9.x86_6 21/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:19.0.0-1871.g3aec3903.el9.x86_64 22/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:19.0.0-1871.g3aec3903.el9.x86_64 23/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:19.0.0-1871.g3aec3903.el9.x86_64 24/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 25/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 26/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:19.0.0-1871.g3aec3903.el9.x86_64 27/286 2024-03-04T12:34:37.022 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1871.g3aec3903. 28/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noa 29/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.n 30/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1871.g3ae 31/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1871.g3aec3903.el 32/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 33/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1871.g3aec3903.e 34/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 35/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 36/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 37/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 38/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : alsa-lib-1.2.10-2.el9.x86_64 39/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 40/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 41/286 2024-03-04T12:34:37.023 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 42/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 43/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 44/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 45/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : atinject-1.0.3-6.el9.noarch 46/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : atk-2.36.0-5.el9.x86_64 47/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 49/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 50/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 51/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 52/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 53/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 54/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 55/286 2024-03-04T12:34:37.024 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 56/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 57/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 58/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 59/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 60/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 61/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 62/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 63/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 64/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 65/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 66/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 67/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 68/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 69/286 2024-03-04T12:34:37.025 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 70/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 71/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 72/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : guava-30.1-6.el9.noarch 73/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 74/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 75/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 76/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 77/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 78/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 79/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 80/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 81/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 82/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 83/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 84/286 2024-03-04T12:34:37.026 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 85/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 86/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 87/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lcms2-2.12-3.el9.x86_64 88/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 89/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 90/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 91/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 92/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 93/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 94/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 95/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 96/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 97/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 98/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 99/286 2024-03-04T12:34:37.027 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 100/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 101/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 102/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 103/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 104/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 105/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 106/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 107/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 108/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 109/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 110/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 111/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 112/286 2024-03-04T12:34:37.028 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 113/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 114/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 115/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 116/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 117/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 118/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 119/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libsbc-1.4-9.el9.x86_64 120/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 121/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 122/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtiff-4.4.0-12.el9.x86_64 123/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 124/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 125/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 126/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 127/286 2024-03-04T12:34:37.029 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 128/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 129/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 130/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 131/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 132/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 133/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 134/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 135/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 136/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-5.4.4-4.el9.x86_64 137/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 138/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 139/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 140/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 141/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 142/286 2024-03-04T12:34:37.030 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 143/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 144/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : mesa-libEGL-23.3.3-1.el9.x86_64 145/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : mesa-libGL-23.3.3-1.el9.x86_64 146/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : mesa-libgbm-23.3.3-1.el9.x86_64 147/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : mesa-libglapi-23.3.3-1.el9.x86_64 148/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 149/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 150/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 151/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 152/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : opus-1.3.1-10.el9.x86_64 153/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : orc-0.4.31-6.el9.x86_64 154/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : osinfo-db-20231215-1.el9.noarch 155/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 156/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 157/286 2024-03-04T12:34:37.031 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 158/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 159/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 160/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 161/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 162/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 163/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 164/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 165/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 166/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 167/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 168/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 169/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 170/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 171/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 172/286 2024-03-04T12:34:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 173/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 174/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 175/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 176/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 177/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 178/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 179/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 180/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 181/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 182/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 183/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 184/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 185/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 186/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 187/286 2024-03-04T12:34:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 188/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 189/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 190/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 191/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 192/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 193/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 194/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 195/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rtkit-0.11-28.el9.x86_64 196/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 197/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 198/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 199/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 200/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 201/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 202/286 2024-03-04T12:34:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 203/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 204/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : tzdata-java-2024a-1.el9.noarch 205/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : upower-0.99.11-11.el9.x86_64 206/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 207/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 208/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 209/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 210/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 211/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 212/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 213/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 214/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 215/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 216/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 217/286 2024-03-04T12:34:37.035 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 218/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cups-libs-1:2.3.3op2-24.el9.x86_64 219/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 220/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jq-1.6-16.el9.x86_64 221/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 222/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 223/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 224/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 225/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 226/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 227/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 228/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ply-3.11-14.el9.noarch 229/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 230/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 231/286 2024-03-04T12:34:37.036 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 232/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 233/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 234/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 235/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ostree-libs-2024.4-3.el9.x86_64 236/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 237/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 238/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 239/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 240/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 241/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 242/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 243/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 244/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 245/286 2024-03-04T12:34:37.037 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 246/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 247/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 248/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 249/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 250/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 251/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 252/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 253/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 254/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 255/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 256/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 257/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 258/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 259/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 260/286 2024-03-04T12:34:37.038 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 261/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 262/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 263/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 264/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 265/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 266/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 267/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 268/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 269/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 270/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 271/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 272/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 273/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 274/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 275/286 2024-03-04T12:34:37.039 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 276/286 2024-03-04T12:34:37.040 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 277/286 2024-03-04T12:34:37.040 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 278/286 2024-03-04T12:34:37.040 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 279/286 2024-03-04T12:34:37.040 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : re2-1:20211101-3.el9.x86_64 280/286 2024-03-04T12:34:37.040 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 281/286 2024-03-04T12:34:37.040 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 282/286 2024-03-04T12:34:37.040 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 283/286 2024-03-04T12:34:37.040 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 284/286 2024-03-04T12:34:37.040 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 285/286 2024-03-04T12:34:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-test-2:19.0.0-1871.g3aec3903.el9.x86_64 276/286 2024-03-04T12:34:39.570 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 277/286 2024-03-04T12:34:39.619 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 278/286 2024-03-04T12:34:39.652 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-04T12:34:39.667 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-04T12:34:39.667 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-03-04T12:34:39.667 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:39.718 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 280/286 2024-03-04T12:34:39.750 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-nbd-2:19.0.0-1871.g3aec3903.el9.x86_64 281/286 2024-03-04T12:34:39.854 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs-devel-2:19.0.0-1871.g3aec3903.el9.x86_ 282/286 2024-03-04T12:34:39.910 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 283/286 2024-03-04T12:34:39.942 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 284/286 2024-03-04T12:34:39.942 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-04T12:34:40.026 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-04T12:34:40.026 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:34:40.117 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:34:40.136 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 286/286 2024-03-04T12:34:40.141 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 286/286 2024-03-04T12:34:40.150 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 286/286 2024-03-04T12:34:40.159 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 286/286 2024-03-04T12:34:40.159 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-04T12:34:40.159 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-04T12:34:40.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:40.240 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 286/286 2024-03-04T12:34:40.308 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 286/286 2024-03-04T12:34:40.792 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:34:40.792 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:40.792 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2024-03-04T12:34:40.792 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.792 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.792 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-03-04T12:34:40.792 INFO:teuthology.orchestra.run.smithi184.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-03-04T12:34:40.792 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: alsa-lib-1.2.10-2.el9.x86_64 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: atinject-1.0.3-6.el9.noarch 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: atk-2.36.0-5.el9.x86_64 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: avahi-glib-0.8-12.el9.x86_64 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: bluez-libs-5.64-1.el9.x86_64 2024-03-04T12:34:40.793 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: bubblewrap-0.4.1-6.el9.x86_64 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: cdi-api-2.0.2-6.el9.noarch 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:40.794 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: cups-libs-1:2.3.3op2-24.el9.x86_64 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: dconf-0.40.0-6.el9.x86_64 2024-03-04T12:34:40.795 INFO:teuthology.orchestra.run.smithi184.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: exiv2-0.27.5-2.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: flatpak-1.12.8-1.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-03-04T12:34:40.796 INFO:teuthology.orchestra.run.smithi184.stdout: giflib-5.2.1-9.el9.x86_64 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: google-guice-4.2.3-9.el9.noarch 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: graphene-1.10.6-2.el9.x86_64 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: gsm-1.0.19-6.el9.x86_64 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: gtk3-3.24.31-2.el9.x86_64 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: guava-30.1-6.el9.noarch 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-03-04T12:34:40.797 INFO:teuthology.orchestra.run.smithi184.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: iso-codes-4.6.0-3.el9.noarch 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: jansi-2.3.3-6.el9.x86_64 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_64 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: jq-1.6-16.el9.x86_64 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: jsoup-1.13.1-10.el9.noarch 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: jsr-305-3.0.2-6.el9.noarch 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: lcms2-2.12-3.el9.x86_64 2024-03-04T12:34:40.798 INFO:teuthology.orchestra.run.smithi184.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libXi-1.7.10-8.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libXtst-1.2.3-16.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libXv-1.0.11-16.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libasyncns-0.8-22.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libcanberra-0.30-27.el9.x86_64 2024-03-04T12:34:40.799 INFO:teuthology.orchestra.run.smithi184.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libdrm-2.4.117-1.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libexif-0.6.22-6.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-03-04T12:34:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: libgsf-1.14.47-5.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: libgxps-0.3.2-3.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: libiptcdata-1.0.5-9.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: libnotify-0.7.9-8.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: libpciaccess-0.16-6.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.801 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libsbc-1.4-9.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libtiff-4.4.0-12.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-03-04T12:34:40.802 INFO:teuthology.orchestra.run.smithi184.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: libwebp-1.2.0-8.el9.x86_64 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: libxshmfence-1.3-10.el9.x86_64 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: lua-5.4.4-4.el9.x86_64 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: lua-posix-35.0-8.el9.x86_64 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: maven-1:3.6.3-15.el9.noarch 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-03-04T12:34:40.803 INFO:teuthology.orchestra.run.smithi184.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: mesa-libEGL-23.3.3-1.el9.x86_64 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: mesa-libGL-23.3.3-1.el9.x86_64 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: mesa-libgbm-23.3.3-1.el9.x86_64 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: mesa-libglapi-23.3.3-1.el9.x86_64 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: opus-1.3.1-10.el9.x86_64 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: orc-0.4.31-6.el9.x86_64 2024-03-04T12:34:40.804 INFO:teuthology.orchestra.run.smithi184.stdout: osinfo-db-20231215-1.el9.noarch 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: ostree-libs-2024.4-3.el9.x86_64 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: pipewire-1.0.1-1.el9.x86_64 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: plexus-cipher-1.7-27.el9.noarch 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-03-04T12:34:40.805 INFO:teuthology.orchestra.run.smithi184.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: poppler-21.01.0-19.el9.x86_64 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: poppler-data-0.4.9-9.el9.noarch 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: poppler-glib-21.01.0-19.el9.x86_64 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T12:34:40.806 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-04T12:34:40.807 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T12:34:40.808 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T12:34:40.809 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T12:34:40.810 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: rtkit-0.11-28.el9.x86_64 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: s3cmd-2.4.0-1.el9.noarch 2024-03-04T12:34:40.811 INFO:teuthology.orchestra.run.smithi184.stdout: sisu-1:0.3.4-10.el9.noarch 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: slf4j-1.7.30-13.el9.noarch 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: tracker-3.1.2-3.el9.x86_64 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: tzdata-java-2024a-1.el9.noarch 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: upower-0.99.11-11.el9.x86_64 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-03-04T12:34:40.812 INFO:teuthology.orchestra.run.smithi184.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-03-04T12:34:40.813 INFO:teuthology.orchestra.run.smithi184.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-03-04T12:34:40.813 INFO:teuthology.orchestra.run.smithi184.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-03-04T12:34:40.813 INFO:teuthology.orchestra.run.smithi184.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-03-04T12:34:40.813 INFO:teuthology.orchestra.run.smithi184.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-03-04T12:34:40.813 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T12:34:40.813 INFO:teuthology.orchestra.run.smithi184.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-03-04T12:34:40.813 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:40.813 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-03-04T12:34:41.172 DEBUG:teuthology.parallel:result is None 2024-03-04T12:34:48.073 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:34:48.073 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-2:19.0.0-1871.g3aec3903.el9.x86_64 1/286 2024-03-04T12:34:48.073 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 2/286 2024-03-04T12:34:48.073 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 3/286 2024-03-04T12:34:48.073 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 4/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1871.g3aec3 5/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 6/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 7/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 8/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 9/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 10/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 11/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-test-2:19.0.0-1871.g3aec3903.el9.x86_64 12/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs-devel-2:19.0.0-1871.g3aec3903.el9.x86_ 13/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 14/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 15/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados-devel-2:19.0.0-1871.g3aec3903.el9.x86_6 16/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86 17/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 18/286 2024-03-04T12:34:48.074 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1871.g3aec3903.el 19/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-common-2:19.0.0-1871.g3aec3903.el9. 20/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cephfs-2:19.0.0-1871.g3aec3903.el9.x86_6 21/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rados-2:19.0.0-1871.g3aec3903.el9.x86_64 22/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rbd-2:19.0.0-1871.g3aec3903.el9.x86_64 23/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rgw-2:19.0.0-1871.g3aec3903.el9.x86_64 24/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 25/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 26/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-nbd-2:19.0.0-1871.g3aec3903.el9.x86_64 27/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1871.g3aec3903. 28/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noa 29/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.n 30/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1871.g3ae 31/286 2024-03-04T12:34:48.075 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1871.g3aec3903.el 32/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 33/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1871.g3aec3903.e 34/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 35/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 36/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 37/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 38/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : alsa-lib-1.2.10-2.el9.x86_64 39/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 40/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 41/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 42/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 43/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 44/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 45/286 2024-03-04T12:34:48.076 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : atinject-1.0.3-6.el9.noarch 46/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : atk-2.36.0-5.el9.x86_64 47/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 49/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 50/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 51/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 52/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 53/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 54/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 55/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 56/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 57/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 58/286 2024-03-04T12:34:48.077 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 59/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 60/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 61/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 62/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 63/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 64/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 65/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 66/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 67/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 68/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 69/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 70/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 71/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 72/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : guava-30.1-6.el9.noarch 73/286 2024-03-04T12:34:48.078 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 74/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 75/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 76/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 77/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 78/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 79/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 80/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 81/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 82/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 83/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 84/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 85/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 86/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 87/286 2024-03-04T12:34:48.079 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lcms2-2.12-3.el9.x86_64 88/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 89/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 90/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 91/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 92/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 93/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 94/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 95/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 96/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 97/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 98/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 99/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 100/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 101/286 2024-03-04T12:34:48.080 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 102/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 103/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 104/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 105/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 106/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 107/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 108/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 109/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 110/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 111/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 112/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 113/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 114/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 115/286 2024-03-04T12:34:48.081 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 116/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 117/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 118/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 119/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libsbc-1.4-9.el9.x86_64 120/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 121/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 122/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libtiff-4.4.0-12.el9.x86_64 123/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 124/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 125/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 126/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 127/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 128/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 129/286 2024-03-04T12:34:48.082 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 130/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 131/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 132/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 133/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 134/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 135/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 136/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-5.4.4-4.el9.x86_64 137/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 138/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 139/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 140/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 141/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 142/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 143/286 2024-03-04T12:34:48.083 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 144/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : mesa-libEGL-23.3.3-1.el9.x86_64 145/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : mesa-libGL-23.3.3-1.el9.x86_64 146/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : mesa-libgbm-23.3.3-1.el9.x86_64 147/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : mesa-libglapi-23.3.3-1.el9.x86_64 148/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 149/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 150/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 151/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 152/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : opus-1.3.1-10.el9.x86_64 153/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : orc-0.4.31-6.el9.x86_64 154/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : osinfo-db-20231215-1.el9.noarch 155/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 156/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 157/286 2024-03-04T12:34:48.084 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 158/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 159/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 160/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 161/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 162/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 163/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 164/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 165/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 166/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 167/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 168/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 169/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 170/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 171/286 2024-03-04T12:34:48.085 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 172/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 173/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 174/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 175/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 176/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 177/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 178/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 179/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 180/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 181/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 182/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 183/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 184/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 185/286 2024-03-04T12:34:48.086 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 186/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 187/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 188/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 189/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 190/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 191/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 192/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 193/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 194/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 195/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rtkit-0.11-28.el9.x86_64 196/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 197/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 198/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 199/286 2024-03-04T12:34:48.087 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 200/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 201/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 202/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 203/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 204/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : tzdata-java-2024a-1.el9.noarch 205/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : upower-0.99.11-11.el9.x86_64 206/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 207/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 208/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 209/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 210/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 211/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 212/286 2024-03-04T12:34:48.088 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 213/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 214/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 215/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 216/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 217/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 218/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cups-libs-1:2.3.3op2-24.el9.x86_64 219/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 220/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : jq-1.6-16.el9.x86_64 221/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 222/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 223/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 224/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 225/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 226/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 227/286 2024-03-04T12:34:48.089 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 228/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ply-3.11-14.el9.noarch 229/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 230/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 231/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 232/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 233/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 234/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 235/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ostree-libs-2024.4-3.el9.x86_64 236/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 237/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 238/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 239/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 240/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 241/286 2024-03-04T12:34:48.090 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 242/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 243/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 244/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 245/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 246/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 247/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 248/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 249/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 250/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 251/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 252/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 253/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 254/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 255/286 2024-03-04T12:34:48.091 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 256/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 257/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 258/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 259/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 260/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 261/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 262/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 263/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 264/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 265/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 266/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 267/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 268/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 269/286 2024-03-04T12:34:48.092 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 270/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 271/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 272/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 273/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 274/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 275/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 276/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 277/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 278/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 279/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : re2-1:20211101-3.el9.x86_64 280/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 281/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 282/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 283/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 284/286 2024-03-04T12:34:48.093 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 285/286 2024-03-04T12:34:51.417 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout:Upgraded: 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout: librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout: alsa-lib-1.2.10-2.el9.x86_64 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-03-04T12:34:51.418 INFO:teuthology.orchestra.run.smithi090.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: atinject-1.0.3-6.el9.noarch 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: atk-2.36.0-5.el9.x86_64 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: avahi-glib-0.8-12.el9.x86_64 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: bluez-libs-5.64-1.el9.x86_64 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: bubblewrap-0.4.1-6.el9.x86_64 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: cdi-api-2.0.2-6.el9.noarch 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.419 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.420 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: cups-libs-1:2.3.3op2-24.el9.x86_64 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: dconf-0.40.0-6.el9.x86_64 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: exiv2-0.27.5-2.el9.x86_64 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-03-04T12:34:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: flatpak-1.12.8-1.el9.x86_64 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: giflib-5.2.1-9.el9.x86_64 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: google-guice-4.2.3-9.el9.noarch 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: graphene-1.10.6-2.el9.x86_64 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-04T12:34:51.422 INFO:teuthology.orchestra.run.smithi090.stdout: gsm-1.0.19-6.el9.x86_64 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: gtk3-3.24.31-2.el9.x86_64 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: guava-30.1-6.el9.noarch 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: iso-codes-4.6.0-3.el9.noarch 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: jansi-2.3.3-6.el9.x86_64 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_64 2024-03-04T12:34:51.423 INFO:teuthology.orchestra.run.smithi090.stdout: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 2024-03-04T12:34:51.424 INFO:teuthology.orchestra.run.smithi090.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-03-04T12:34:51.424 INFO:teuthology.orchestra.run.smithi090.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-03-04T12:34:51.424 INFO:teuthology.orchestra.run.smithi090.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-03-04T12:34:51.424 INFO:teuthology.orchestra.run.smithi090.stdout: jq-1.6-16.el9.x86_64 2024-03-04T12:34:51.424 INFO:teuthology.orchestra.run.smithi090.stdout: jsoup-1.13.1-10.el9.noarch 2024-03-04T12:34:51.424 INFO:teuthology.orchestra.run.smithi090.stdout: jsr-305-3.0.2-6.el9.noarch 2024-03-04T12:34:51.424 INFO:teuthology.orchestra.run.smithi090.stdout: lcms2-2.12-3.el9.x86_64 2024-03-04T12:34:51.424 INFO:teuthology.orchestra.run.smithi090.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2024-03-04T12:34:51.424 INFO:teuthology.orchestra.run.smithi090.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-03-04T12:34:51.424 INFO:teuthology.orchestra.run.smithi090.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-03-04T12:34:51.424 INFO:teuthology.orchestra.run.smithi090.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-03-04T12:34:51.424 INFO:teuthology.orchestra.run.smithi090.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libXi-1.7.10-8.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libXtst-1.2.3-16.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libXv-1.0.11-16.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libasyncns-0.8-22.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libcanberra-0.30-27.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.425 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libdrm-2.4.117-1.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libexif-0.6.22-6.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libgsf-1.14.47-5.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libgxps-0.3.2-3.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libiptcdata-1.0.5-9.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-03-04T12:34:51.426 INFO:teuthology.orchestra.run.smithi090.stdout: libnotify-0.7.9-8.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: libpciaccess-0.16-6.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: libsbc-1.4-9.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-03-04T12:34:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libtiff-4.4.0-12.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libwebp-1.2.0-8.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: libxshmfence-1.3-10.el9.x86_64 2024-03-04T12:34:51.428 INFO:teuthology.orchestra.run.smithi090.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: lua-5.4.4-4.el9.x86_64 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: lua-posix-35.0-8.el9.x86_64 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: maven-1:3.6.3-15.el9.noarch 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: mesa-libEGL-23.3.3-1.el9.x86_64 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: mesa-libGL-23.3.3-1.el9.x86_64 2024-03-04T12:34:51.429 INFO:teuthology.orchestra.run.smithi090.stdout: mesa-libgbm-23.3.3-1.el9.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: mesa-libglapi-23.3.3-1.el9.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: opus-1.3.1-10.el9.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: orc-0.4.31-6.el9.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: osinfo-db-20231215-1.el9.noarch 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: ostree-libs-2024.4-3.el9.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T12:34:51.430 INFO:teuthology.orchestra.run.smithi090.stdout: pipewire-1.0.1-1.el9.x86_64 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: plexus-cipher-1.7-27.el9.noarch 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: poppler-21.01.0-19.el9.x86_64 2024-03-04T12:34:51.431 INFO:teuthology.orchestra.run.smithi090.stdout: poppler-data-0.4.9-9.el9.noarch 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: poppler-glib-21.01.0-19.el9.x86_64 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.432 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T12:34:51.433 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T12:34:51.434 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T12:34:51.435 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-04T12:34:51.436 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: rtkit-0.11-28.el9.x86_64 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: s3cmd-2.4.0-1.el9.noarch 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: sisu-1:0.3.4-10.el9.noarch 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: slf4j-1.7.30-13.el9.noarch 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: tracker-3.1.2-3.el9.x86_64 2024-03-04T12:34:51.437 INFO:teuthology.orchestra.run.smithi090.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-03-04T12:34:51.438 INFO:teuthology.orchestra.run.smithi090.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-03-04T12:34:51.438 INFO:teuthology.orchestra.run.smithi090.stdout: tzdata-java-2024a-1.el9.noarch 2024-03-04T12:34:51.438 INFO:teuthology.orchestra.run.smithi090.stdout: upower-0.99.11-11.el9.x86_64 2024-03-04T12:34:51.438 INFO:teuthology.orchestra.run.smithi090.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-03-04T12:34:51.438 INFO:teuthology.orchestra.run.smithi090.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-03-04T12:34:51.438 INFO:teuthology.orchestra.run.smithi090.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-03-04T12:34:51.438 INFO:teuthology.orchestra.run.smithi090.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-03-04T12:34:51.438 INFO:teuthology.orchestra.run.smithi090.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-03-04T12:34:51.438 INFO:teuthology.orchestra.run.smithi090.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-03-04T12:34:51.438 INFO:teuthology.orchestra.run.smithi090.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-03-04T12:34:51.438 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T12:34:51.439 INFO:teuthology.orchestra.run.smithi090.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-03-04T12:34:51.439 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:51.439 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-03-04T12:34:51.859 DEBUG:teuthology.parallel:result is None 2024-03-04T12:34:51.860 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:34:52.006 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T12:34:52.109 INFO:teuthology.orchestra.run.smithi090.stdout:19.0.0-1871.g3aec3903.el9 2024-03-04T12:34:52.110 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1871.g3aec3903.el9 2024-03-04T12:34:52.110 INFO:teuthology.task.install:The correct ceph version 19.0.0-1871.g3aec3903 is installed. 2024-03-04T12:34:52.112 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:34:52.397 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T12:34:52.492 INFO:teuthology.orchestra.run.smithi184.stdout:19.0.0-1871.g3aec3903.el9 2024-03-04T12:34:52.493 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1871.g3aec3903.el9 2024-03-04T12:34:52.493 INFO:teuthology.task.install:The correct ceph version 19.0.0-1871.g3aec3903 is installed. 2024-03-04T12:34:52.495 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-04T12:34:52.495 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:34:52.495 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T12:34:52.540 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:34:52.540 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T12:34:52.589 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-04T12:34:52.590 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:34:52.590 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T12:34:52.630 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T12:34:52.710 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:34:52.710 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T12:34:52.755 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T12:34:52.840 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-04T12:34:52.840 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:34:52.840 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T12:34:52.880 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T12:34:52.960 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:34:52.960 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T12:34:53.001 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T12:34:53.083 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-04T12:34:53.083 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:34:53.083 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T12:34:53.123 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T12:34:53.202 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:34:53.203 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T12:34:53.242 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T12:34:53.323 INFO:teuthology.run_tasks:Running task ceph... 2024-03-04T12:34:53.408 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-04T12:34:53.408 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /var/log/ceph 2024-03-04T12:34:53.411 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2024-03-04T12:34:53.449 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-04T12:34:53.450 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-04T12:34:53.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-04T12:34:53.530 INFO:tasks.ceph:Creating extra log directories... 2024-03-04T12:34:53.530 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-04T12:34:53.569 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-04T12:34:53.625 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-04T12:34:53.625 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-04T12:34:53.625 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079', 'branch': 'wip-rgw-d4n', 'description': 'rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7581079', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-d4n'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-d4n', 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8'}}, 'owner': 'scheduled_prsrivas@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 3236, 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-d4n', 'suite_path': '/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/pritha-srivastava/ceph.git', 'suite_sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8', 'targets': {'smithi090.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNlhke6ImRwW0tRTfdJzB0qBB7FXF7tOOlUe7oehwZ4Xt/w5ZH9ocT/GFTY4nc3Ud9M3URf3bSq2zbGIyyXGKCw=', 'smithi184.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGKwWZrWkCZxY/vImMGcz9W9FF7BM6FRmsTGM/jnEwtEWpOzNigHbATn/rXF/f2snFexK8u8oCCPWoXA57o/ao8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-03-04_08:28:53', 'tube': 'smithi', 'user': 'prsrivas', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-04T12:34:53.626 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-04T12:34:53.649 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-04T12:34:53.678 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/run/ceph 2024-03-04T12:34:53.716 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2024-03-04T12:34:53.757 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:34:53.757 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T12:34:53.821 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T12:34:53.821 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 2024-03-04T12:34:53.890 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T12:34:53.890 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:34:53.890 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-03-04T12:34:53.891 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:34:53.891 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:34:53.891 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-03-04 12:34:41.216118728 +0000 2024-03-04T12:34:53.891 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-03-04 12:32:09.796855703 +0000 2024-03-04T12:34:53.891 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-03-04 12:32:09.796855703 +0000 2024-03-04T12:34:53.891 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-03-04 12:32:09.796855703 +0000 2024-03-04T12:34:53.891 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T12:34:53.969 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-03-04T12:34:53.969 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-03-04T12:34:53.970 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.00025443 s, 2.0 MB/s 2024-03-04T12:34:53.971 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T12:34:54.039 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 2024-03-04T12:34:54.108 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T12:34:54.108 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:34:54.108 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-04T12:34:54.108 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:34:54.108 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:34:54.108 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-03-04 12:34:41.216118728 +0000 2024-03-04T12:34:54.108 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-03-04 12:32:10.132850288 +0000 2024-03-04T12:34:54.109 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-03-04 12:32:10.132850288 +0000 2024-03-04T12:34:54.109 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-03-04 12:32:10.132850288 +0000 2024-03-04T12:34:54.109 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T12:34:54.186 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-03-04T12:34:54.186 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-03-04T12:34:54.186 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000202182 s, 2.5 MB/s 2024-03-04T12:34:54.187 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T12:34:54.256 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 2024-03-04T12:34:54.324 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T12:34:54.325 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:34:54.325 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-03-04T12:34:54.325 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:34:54.325 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:34:54.325 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-03-04 12:34:41.216118728 +0000 2024-03-04T12:34:54.325 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-03-04 12:32:10.464844938 +0000 2024-03-04T12:34:54.325 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-03-04 12:32:10.464844938 +0000 2024-03-04T12:34:54.325 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-03-04 12:32:10.464844938 +0000 2024-03-04T12:34:54.325 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T12:34:54.402 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-03-04T12:34:54.402 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-03-04T12:34:54.403 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000196271 s, 2.6 MB/s 2024-03-04T12:34:54.404 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T12:34:54.472 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 2024-03-04T12:34:54.540 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T12:34:54.540 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:34:54.540 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-03-04T12:34:54.540 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:34:54.540 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:34:54.540 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-03-04 12:34:41.217118712 +0000 2024-03-04T12:34:54.540 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-03-04 12:32:10.801839507 +0000 2024-03-04T12:34:54.540 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-03-04 12:32:10.801839507 +0000 2024-03-04T12:34:54.540 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-03-04 12:32:10.801839507 +0000 2024-03-04T12:34:54.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T12:34:54.617 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-03-04T12:34:54.617 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-03-04T12:34:54.617 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000186299 s, 2.7 MB/s 2024-03-04T12:34:54.618 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T12:34:54.686 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T12:34:54.686 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:34:54.686 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T12:34:54.717 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T12:34:54.718 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-03-04T12:34:54.788 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T12:34:54.788 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:34:54.788 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-03-04T12:34:54.788 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:34:54.788 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:34:54.788 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-03-04 12:34:31.330889502 +0000 2024-03-04T12:34:54.788 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-03-04 12:32:09.348591004 +0000 2024-03-04T12:34:54.788 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-03-04 12:32:09.348591004 +0000 2024-03-04T12:34:54.788 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-03-04 12:32:09.348591004 +0000 2024-03-04T12:34:54.789 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T12:34:54.868 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-03-04T12:34:54.868 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-03-04T12:34:54.869 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000212663 s, 2.4 MB/s 2024-03-04T12:34:54.870 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T12:34:54.940 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-03-04T12:34:55.008 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T12:34:55.009 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:34:55.009 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-03-04T12:34:55.009 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:34:55.009 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:34:55.009 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-03-04 12:34:31.330889502 +0000 2024-03-04T12:34:55.009 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-03-04 12:32:09.707583480 +0000 2024-03-04T12:34:55.009 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-03-04 12:32:09.707583480 +0000 2024-03-04T12:34:55.009 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-03-04 12:32:09.707583480 +0000 2024-03-04T12:34:55.009 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T12:34:55.087 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-03-04T12:34:55.088 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-03-04T12:34:55.088 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000242493 s, 2.1 MB/s 2024-03-04T12:34:55.089 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T12:34:55.157 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-03-04T12:34:55.224 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T12:34:55.224 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:34:55.224 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-04T12:34:55.224 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:34:55.224 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:34:55.225 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-03-04 12:34:31.331889481 +0000 2024-03-04T12:34:55.225 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-03-04 12:32:10.057576145 +0000 2024-03-04T12:34:55.225 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-03-04 12:32:10.057576145 +0000 2024-03-04T12:34:55.225 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-03-04 12:32:10.057576145 +0000 2024-03-04T12:34:55.225 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T12:34:55.302 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-03-04T12:34:55.303 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-03-04T12:34:55.303 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000226753 s, 2.3 MB/s 2024-03-04T12:34:55.304 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T12:34:55.372 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-03-04T12:34:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T12:34:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:34:55.439 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-03-04T12:34:55.439 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:34:55.439 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:34:55.440 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-03-04 12:34:31.331889481 +0000 2024-03-04T12:34:55.440 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-03-04 12:32:10.404568873 +0000 2024-03-04T12:34:55.440 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-03-04 12:32:10.404568873 +0000 2024-03-04T12:34:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-03-04 12:32:10.404568873 +0000 2024-03-04T12:34:55.440 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T12:34:55.517 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-03-04T12:34:55.517 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-03-04T12:34:55.517 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000169155 s, 3.0 MB/s 2024-03-04T12:34:55.518 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T12:34:55.586 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T12:34:55.586 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-04T12:34:55.586 INFO:tasks.ceph:Generating config... 2024-03-04T12:34:55.588 INFO:tasks.ceph:[client] debug rgw = 20 2024-03-04T12:34:55.588 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-03-04T12:34:55.588 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-03-04T12:34:55.588 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-03-04T12:34:55.588 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-04T12:34:55.588 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-03-04T12:34:55.588 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-03-04T12:34:55.588 INFO:tasks.ceph:[client] setgroup = ceph 2024-03-04T12:34:55.588 INFO:tasks.ceph:[client] setuser = ceph 2024-03-04T12:34:55.588 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-03-04T12:34:55.588 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-03-04T12:34:55.589 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-03-04T12:34:55.589 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-03-04T12:34:55.589 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-04T12:34:55.589 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-04T12:34:55.589 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-04T12:34:55.589 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-04T12:34:55.589 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-04T12:34:55.589 INFO:tasks.ceph:[mon] lockdep = True 2024-03-04T12:34:55.589 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-04T12:34:55.589 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-04T12:34:55.589 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-04T12:34:55.589 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-04T12:34:55.589 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-04T12:34:55.589 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-04T12:34:55.590 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-04T12:34:55.590 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-04T12:34:55.590 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-04T12:34:55.590 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-04T12:34:55.590 INFO:tasks.ceph:[osd] lockdep = True 2024-03-04T12:34:55.590 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-04T12:34:55.590 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-04T12:34:55.590 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-04T12:34:55.590 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-04T12:34:55.590 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-04T12:34:55.590 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-03-04T12:34:55.590 INFO:tasks.ceph:Setting up mon.a... 2024-03-04T12:34:55.591 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-04T12:34:55.672 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.keyring 2024-03-04T12:34:55.675 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-04T12:34:55.733 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-04T12:34:55.773 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.90'), ('mon.c', '[v2:172.21.15.90:3301,v1:172.21.15.90:6790]'), ('mon.b', '172.21.15.184')] 2024-03-04T12:34:55.774 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790],172.21.15.184', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-03-04T12:34:55.775 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:34:55.775 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-04T12:34:55.841 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.90 --addv c '[v2:172.21.15.90:3301,v1:172.21.15.90:6790]' --add b 172.21.15.184 --print /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:34:55.938 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:34:55.938 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:34:55.939 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:34:55.939 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: generated fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:34:55.939 INFO:teuthology.orchestra.run.smithi090.stdout:setting min_mon_release = quincy 2024-03-04T12:34:55.939 INFO:teuthology.orchestra.run.smithi090.stdout:epoch 0 2024-03-04T12:34:55.939 INFO:teuthology.orchestra.run.smithi090.stdout:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:34:55.939 INFO:teuthology.orchestra.run.smithi090.stdout:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:34:55.939 INFO:teuthology.orchestra.run.smithi090.stdout:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:34:55.939 INFO:teuthology.orchestra.run.smithi090.stdout:min_mon_release 17 (quincy) 2024-03-04T12:34:55.939 INFO:teuthology.orchestra.run.smithi090.stdout:election_strategy: 1 2024-03-04T12:34:55.940 INFO:teuthology.orchestra.run.smithi090.stdout:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:34:55.940 INFO:teuthology.orchestra.run.smithi090.stdout:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:34:55.940 INFO:teuthology.orchestra.run.smithi090.stdout:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:34:55.940 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-04T12:34:55.941 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-04T12:34:55.968 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0f6a7118-f776-445e-bdfb-0ec0be103287... 2024-03-04T12:34:55.968 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-04T12:34:56.010 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-04T12:34:56.070 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-03-04T12:34:56.070 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-03-04T12:34:56.070 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-04T12:34:56.071 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-03-04T12:34:56.071 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.071 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-03-04T12:34:56.071 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.071 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-03-04T12:34:56.071 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.071 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-03-04T12:34:56.071 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-03-04T12:34:56.071 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.071 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-03-04T12:34:56.071 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-03-04T12:34:56.071 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-03-04T12:34:56.072 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-03-04T12:34:56.073 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790],172.21.15.184" 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: mon client directed command retry = 5 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject socket failures = 5000 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: osd_max_pg_log_entries = 10 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: osd_min_pg_log_entries = 10 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-03-04T12:34:56.074 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-03-04T12:34:56.075 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: bdev async discard = True 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: bdev enable discard = True 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore allocator = bitmap 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 1/20 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 1/20 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-03-04T12:34:56.076 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 4/10 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: lockdep = True 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: osd shutdown pgref assert = True 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-03-04T12:34:56.077 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.078 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: lockdep = True 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-03-04T12:34:56.079 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: debug rgw = 20 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: rgw bucket counters cache = True 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: rgw crypt require ssl = False 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: rgw crypt s3 kms backend = testing 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: rgw torrent flag = True 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: rgw user counters cache = True 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: setgroup = ceph 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout: setuser = ceph 2024-03-04T12:34:56.080 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-03-04T12:34:56.081 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-03-04T12:34:56.081 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-03-04T12:34:56.081 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2024-03-04T12:34:56.081 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2024-03-04T12:34:56.081 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-04T12:34:56.081 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2024-03-04T12:34:56.081 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.081 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-04T12:34:56.082 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-04T12:34:56.083 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790],172.21.15.184" 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: mon client directed command retry = 5 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: ms inject socket failures = 5000 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: osd_max_pg_log_entries = 10 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: osd_min_pg_log_entries = 10 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.084 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug trim objects = true 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.085 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: bdev async discard = True 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: bdev enable discard = True 2024-03-04T12:34:56.086 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore allocator = bitmap 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 1/20 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 1/20 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 4/10 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: lockdep = True 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: osd shutdown pgref assert = True 2024-03-04T12:34:56.087 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-03-04T12:34:56.088 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-04T12:34:56.089 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout: lockdep = True 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-04T12:34:56.090 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-04T12:34:56.091 INFO:teuthology.orchestra.run.smithi184.stdout: debug rgw = 20 2024-03-04T12:34:56.091 INFO:teuthology.orchestra.run.smithi184.stdout: rgw bucket counters cache = True 2024-03-04T12:34:56.091 INFO:teuthology.orchestra.run.smithi184.stdout: rgw crypt require ssl = False 2024-03-04T12:34:56.091 INFO:teuthology.orchestra.run.smithi184.stdout: rgw crypt s3 kms backend = testing 2024-03-04T12:34:56.091 INFO:teuthology.orchestra.run.smithi184.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-04T12:34:56.091 INFO:teuthology.orchestra.run.smithi184.stdout: rgw torrent flag = True 2024-03-04T12:34:56.091 INFO:teuthology.orchestra.run.smithi184.stdout: rgw user counters cache = True 2024-03-04T12:34:56.091 INFO:teuthology.orchestra.run.smithi184.stdout: setgroup = ceph 2024-03-04T12:34:56.091 INFO:teuthology.orchestra.run.smithi184.stdout: setuser = ceph 2024-03-04T12:34:56.091 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2024-03-04T12:34:56.091 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2024-03-04T12:34:56.091 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2024-03-04T12:34:56.093 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-04T12:34:56.093 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-04T12:34:56.202 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-04T12:34:56.203 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:34:56.203 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-04T12:34:56.229 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:34:56.229 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-04T12:34:56.297 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi090.front.sepia.ceph.com 2024-03-04T12:34:56.297 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:34:56.297 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-04T12:34:56.297 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-04T12:34:56.388 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:34:56.388 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:34:56.454 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2024-03-04T12:34:56.454 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:34:56.454 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-04T12:34:56.454 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-04T12:34:56.507 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:34:56.507 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:34:56.574 INFO:tasks.ceph:Setting up mon nodes... 2024-03-04T12:34:56.574 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-04T12:34:56.574 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-04T12:34:56.643 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-04T12:34:56.645 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-04T12:34:56.728 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-04T12:34:56.730 INFO:tasks.ceph:Setting up mds nodes... 2024-03-04T12:34:56.730 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-04T12:34:56.731 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-04T12:34:56.786 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-04T12:34:56.801 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-04T12:34:56.856 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-04T12:34:56.872 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-04T12:34:56.872 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-04T12:34:56.872 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-04T12:34:56.911 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T12:34:56.911 INFO:tasks.ceph:role: osd.0 2024-03-04T12:34:56.911 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com 2024-03-04T12:34:56.911 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-04T12:34:56.998 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:34:56.998 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:34:56.998 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:34:56.998 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:34:56.998 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:34:56.998 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:34:56.999 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:34:56.999 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:34:56.999 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:34:56.999 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:34:57.497 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-03-04T12:34:57.499 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-03-04T12:34:57.500 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-04T12:34:57.578 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-04T12:34:57.623 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-04T12:34:57.662 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T12:34:57.662 INFO:tasks.ceph:role: osd.1 2024-03-04T12:34:57.662 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com 2024-03-04T12:34:57.662 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-04T12:34:57.749 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:34:57.749 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:34:57.749 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:34:57.749 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:34:57.749 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:34:57.749 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:34:57.749 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:34:57.750 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:34:57.750 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:34:57.750 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:34:58.192 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-03-04T12:34:58.194 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-03-04T12:34:58.194 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-04T12:34:58.243 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-04T12:34:58.286 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-04T12:34:58.365 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T12:34:58.365 INFO:tasks.ceph:role: osd.2 2024-03-04T12:34:58.365 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com 2024-03-04T12:34:58.365 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-04T12:34:58.451 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:34:58.452 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:34:58.452 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:34:58.452 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:34:58.452 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:34:58.452 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:34:58.452 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:34:58.452 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:34:58.452 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:34:58.452 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:34:58.938 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-03-04T12:34:58.940 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-03-04T12:34:58.940 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-04T12:34:59.014 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-04T12:34:59.060 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-04T12:34:59.099 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T12:34:59.099 INFO:tasks.ceph:role: osd.3 2024-03-04T12:34:59.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com 2024-03-04T12:34:59.099 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-04T12:34:59.186 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:34:59.186 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:34:59.186 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:34:59.186 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:34:59.186 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:34:59.186 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:34:59.186 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:34:59.186 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:34:59.186 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:34:59.186 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:34:59.706 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-03-04T12:34:59.708 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-03-04T12:34:59.708 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-04T12:34:59.813 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-04T12:34:59.860 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:34:59.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:34:59.922+0000 7f26221bd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-04T12:34:59.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:34:59.924+0000 7f26221bd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-04T12:34:59.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:34:59.924+0000 7f26221bd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-04T12:34:59.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:34:59.924+0000 7f26221bd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-04T12:34:59.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:34:59.924+0000 7f26221bd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-04T12:34:59.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:34:59.928+0000 7f26221bd640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-04T12:35:02.789 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-04T12:35:02.834 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:35:02.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:02.889+0000 7fda11d0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-04T12:35:02.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:02.890+0000 7fda11d0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-04T12:35:02.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:02.890+0000 7fda11d0f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-04T12:35:02.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:02.890+0000 7fda11d0f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-04T12:35:02.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:02.890+0000 7fda11d0f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-04T12:35:02.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:02.890+0000 7fda11d0f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-04T12:35:05.743 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-04T12:35:05.792 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:35:05.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:05.847+0000 7f7ed8022640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-04T12:35:05.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:05.848+0000 7f7ed8022640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-04T12:35:05.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:05.848+0000 7f7ed8022640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-04T12:35:05.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:05.848+0000 7f7ed8022640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-04T12:35:05.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:05.848+0000 7f7ed8022640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-04T12:35:05.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:05.848+0000 7f7ed8022640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-04T12:35:08.730 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-04T12:35:08.777 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:35:08.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:08.875+0000 7f1055d81640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-04T12:35:08.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:08.875+0000 7f1055d81640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-04T12:35:08.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:08.875+0000 7f1055d81640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-04T12:35:08.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:08.875+0000 7f1055d81640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-04T12:35:08.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:08.875+0000 7f1055d81640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-04T12:35:08.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:35:08.876+0000 7f1055d81640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-04T12:35:11.728 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-04T12:35:11.774 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-04T12:35:11.820 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T12:35:11.820 INFO:tasks.ceph:role: osd.4 2024-03-04T12:35:11.820 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2024-03-04T12:35:11.820 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-04T12:35:11.869 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:35:11.869 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:35:11.869 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:35:11.870 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:35:11.870 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:35:11.870 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:35:11.870 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:35:11.870 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:35:11.870 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:35:11.870 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:35:12.366 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-03-04T12:35:12.368 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-03-04T12:35:12.369 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-04T12:35:12.481 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-04T12:35:12.530 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-04T12:35:12.572 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T12:35:12.572 INFO:tasks.ceph:role: osd.5 2024-03-04T12:35:12.572 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2024-03-04T12:35:12.572 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-04T12:35:12.659 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:35:12.659 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:35:12.660 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:35:12.660 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:35:12.660 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:35:12.660 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:35:12.660 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:35:12.660 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:35:12.660 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:35:12.660 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:35:13.121 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-03-04T12:35:13.123 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-03-04T12:35:13.123 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-04T12:35:13.183 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-04T12:35:13.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-04T12:35:13.307 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T12:35:13.307 INFO:tasks.ceph:role: osd.6 2024-03-04T12:35:13.307 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2024-03-04T12:35:13.307 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-04T12:35:13.393 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:35:13.393 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:35:13.394 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:35:13.394 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:35:13.394 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:35:13.394 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:35:13.394 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:35:13.394 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:35:13.394 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:35:13.394 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:35:13.882 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-03-04T12:35:13.885 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-03-04T12:35:13.885 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-04T12:35:13.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-04T12:35:14.043 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-04T12:35:14.082 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T12:35:14.082 INFO:tasks.ceph:role: osd.7 2024-03-04T12:35:14.082 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2024-03-04T12:35:14.082 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-04T12:35:14.170 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:35:14.171 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:35:14.171 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:35:14.171 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:35:14.171 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:35:14.171 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:35:14.171 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:35:14.171 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:35:14.171 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:35:14.171 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:35:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-03-04T12:35:14.686 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-03-04T12:35:14.687 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-04T12:35:14.799 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-04T12:35:14.842 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:35:14.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:14.943+0000 7fbec2a0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-04T12:35:14.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:14.943+0000 7fbec2a0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-04T12:35:14.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:14.943+0000 7fbec2a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-04T12:35:14.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:14.943+0000 7fbec2a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-04T12:35:14.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:14.943+0000 7fbec2a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-04T12:35:14.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:14.944+0000 7fbec2a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-04T12:35:17.808 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-04T12:35:17.851 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:35:17.953 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:17.947+0000 7f452c422640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-04T12:35:17.953 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:17.947+0000 7f452c422640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-04T12:35:17.953 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:17.947+0000 7f452c422640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-04T12:35:17.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:17.947+0000 7f452c422640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-04T12:35:17.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:17.947+0000 7f452c422640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-04T12:35:17.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:17.947+0000 7f452c422640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-04T12:35:20.806 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-04T12:35:20.852 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:35:20.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:20.909+0000 7f0c36c0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-04T12:35:20.917 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:20.909+0000 7f0c36c0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-04T12:35:20.917 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:20.909+0000 7f0c36c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-04T12:35:20.917 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:20.909+0000 7f0c36c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-04T12:35:20.917 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:20.909+0000 7f0c36c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-04T12:35:20.917 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:20.910+0000 7f0c36c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-04T12:35:23.768 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-04T12:35:23.814 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:35:23.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:23.867+0000 7f3e7cbbd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-04T12:35:23.875 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:23.868+0000 7f3e7cbbd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-04T12:35:23.875 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:23.868+0000 7f3e7cbbd640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-04T12:35:23.875 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:23.868+0000 7f3e7cbbd640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-04T12:35:23.875 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:23.868+0000 7f3e7cbbd640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-04T12:35:23.875 INFO:teuthology.orchestra.run.smithi184.stderr:2024-03-04T12:35:23.868+0000 7f3e7cbbd640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-04T12:35:26.722 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-04T12:35:26.770 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-04T12:35:26.771 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:35:26.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-04T12:35:26.816 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:35:26.816 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-04T12:35:26.899 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:35:26.899 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-04T12:35:26.980 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:35:26.980 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-04T12:35:27.060 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:35:27.060 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-04T12:35:27.139 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:35:27.140 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-04T12:35:27.184 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:35:27.184 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-04T12:35:27.267 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:35:27.267 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-04T12:35:27.348 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:35:27.348 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-04T12:35:27.431 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:35:27.431 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-04T12:35:27.511 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:35:27.512 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-04T12:35:27.541 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:35:27.542 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-04T12:35:27.580 INFO:tasks.ceph:Adding keys to all mons... 2024-03-04T12:35:27.580 DEBUG:teuthology.orchestra.run.smithi090:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-04T12:35:27.584 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-04T12:35:27.623 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.y] 2024-03-04T12:35:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDwv+VlsdUFJhAADleggNHBV/2uYt5Gea93sA== 2024-03-04T12:35:27.624 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.0] 2024-03-04T12:35:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDzv+VlidsFNxAAUVg3aW+M2LLjoi77p+m5lg== 2024-03-04T12:35:27.624 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.1] 2024-03-04T12:35:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQD2v+VlEbYUNRAAU87oF4MvAyMPAZYHaxUDMw== 2024-03-04T12:35:27.624 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.2] 2024-03-04T12:35:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQD5v+VlMHmUMhAAEHVPSnn/in3vbiJhXJX6tg== 2024-03-04T12:35:27.624 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.3] 2024-03-04T12:35:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQD8v+Vl5E48NBAAMeDU2HN0dRJPmE4YbgHoGw== 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.x] 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDwv+Vl9TgVKxAA4LJ1szf2iRyr4N0Dck2CQg== 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.4] 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQACwOVl1IdHOBAA7qqpOI10JrD9ZmWUxyYVLA== 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.5] 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAFwOVlBOyCOBAA/0OdFziI6mqbcWfS+PcEyg== 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.6] 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQAIwOVlVvlFNhAAOginS3IXWacUb3Y6f00WLw== 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.7] 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQALwOVlMO7LMxAANXJMDhQzAlH0CnbUBqsQXQ== 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDwv+Vlp1uMLhAAJEwAnd1wEnIx0DtiaWgB3A== 2024-03-04T12:35:27.625 INFO:teuthology.orchestra.run.smithi090.stdout:[client.1] 2024-03-04T12:35:27.626 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDwv+VlVHzCMhAAAMnO1M1IlkJhddytNPbwzA== 2024-03-04T12:35:27.658 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2024-03-04T12:35:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDwv+VlsdUFJhAADleggNHBV/2uYt5Gea93sA== 2024-03-04T12:35:27.659 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2024-03-04T12:35:27.659 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDzv+VlidsFNxAAUVg3aW+M2LLjoi77p+m5lg== 2024-03-04T12:35:27.659 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2024-03-04T12:35:27.659 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD2v+VlEbYUNRAAU87oF4MvAyMPAZYHaxUDMw== 2024-03-04T12:35:27.659 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2024-03-04T12:35:27.659 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD5v+VlMHmUMhAAEHVPSnn/in3vbiJhXJX6tg== 2024-03-04T12:35:27.659 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2024-03-04T12:35:27.659 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD8v+Vl5E48NBAAMeDU2HN0dRJPmE4YbgHoGw== 2024-03-04T12:35:27.659 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2024-03-04T12:35:27.659 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDwv+Vl9TgVKxAA4LJ1szf2iRyr4N0Dck2CQg== 2024-03-04T12:35:27.659 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2024-03-04T12:35:27.660 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQACwOVl1IdHOBAA7qqpOI10JrD9ZmWUxyYVLA== 2024-03-04T12:35:27.660 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2024-03-04T12:35:27.660 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAFwOVlBOyCOBAA/0OdFziI6mqbcWfS+PcEyg== 2024-03-04T12:35:27.660 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2024-03-04T12:35:27.660 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAIwOVlVvlFNhAAOginS3IXWacUb3Y6f00WLw== 2024-03-04T12:35:27.660 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2024-03-04T12:35:27.660 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQALwOVlMO7LMxAANXJMDhQzAlH0CnbUBqsQXQ== 2024-03-04T12:35:27.660 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2024-03-04T12:35:27.660 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDwv+Vlp1uMLhAAJEwAnd1wEnIx0DtiaWgB3A== 2024-03-04T12:35:27.660 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2024-03-04T12:35:27.661 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDwv+VlVHzCMhAAAMnO1M1IlkJhddytNPbwzA== 2024-03-04T12:35:27.662 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T12:35:27.669 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T12:35:27.768 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:27.770 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:27.835 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:27.838 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:27.904 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:27.906 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:27.971 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:27.974 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:28.039 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T12:35:28.041 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T12:35:28.106 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:28.109 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:28.173 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:28.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:28.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:28.241 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:28.307 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:28.309 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:35:28.374 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T12:35:28.376 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T12:35:28.443 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T12:35:28.446 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T12:35:28.513 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-04T12:35:28.513 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-04T12:35:28.551 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-04T12:35:28.659 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-04T12:35:28.699 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-04T12:35:28.778 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-04T12:35:28.889 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-04T12:35:28.929 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-04T12:35:28.970 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-04T12:35:29.080 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-04T12:35:29.120 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:35:29.122 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:35:29.187 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-04T12:35:29.187 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-04T12:35:29.187 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-04T12:35:29.190 INFO:tasks.ceph.mon.a:Started 2024-03-04T12:35:29.190 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-04T12:35:29.190 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-04T12:35:29.192 INFO:tasks.ceph.mon.c:Started 2024-03-04T12:35:29.192 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-04T12:35:29.192 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-04T12:35:29.229 INFO:tasks.ceph.mon.b:Started 2024-03-04T12:35:29.229 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-04T12:35:29.230 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-04T12:35:29.230 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-04T12:35:29.232 INFO:tasks.ceph.mgr.y:Started 2024-03-04T12:35:29.232 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-04T12:35:29.232 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-04T12:35:29.235 INFO:tasks.ceph.mgr.x:Started 2024-03-04T12:35:29.236 INFO:tasks.ceph:Setting crush tunables to default 2024-03-04T12:35:29.236 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd crush tunables default 2024-03-04T12:35:34.641 INFO:teuthology.orchestra.run.smithi090.stderr:adjusted tunables profile to default 2024-03-04T12:35:34.653 INFO:tasks.ceph:check_enable_crimson: False 2024-03-04T12:35:34.653 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-04T12:35:34.653 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:35:34.653 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-04T12:35:34.693 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:35:34.694 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-04T12:35:34.774 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:35:34.775 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-04T12:35:34.860 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:35:34.860 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-04T12:35:34.941 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:35:34.941 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-04T12:35:34.981 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:35:34.981 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-04T12:35:35.049 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:35.043+0000 7fd308a14040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T12:35:35.061 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:35:35.061 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-04T12:35:35.105 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:35.099+0000 7fd308a14040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T12:35:35.141 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-03-04T12:35:35.141 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-04T12:35:35.220 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 8c7f3cf2-45d3-45de-9e96-f23658118260 0 2024-03-04T12:35:35.254 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:35.248+0000 7f428bc2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T12:35:35.307 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:35.301+0000 7f428bc2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T12:35:35.460 INFO:teuthology.orchestra.run.smithi184.stdout:0 2024-03-04T12:35:35.471 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new b89dd9e5-ffdd-4b15-b6d0-c676f7f43bdf 1 2024-03-04T12:35:35.660 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:35.654+0000 7fd308a14040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T12:35:35.671 INFO:teuthology.orchestra.run.smithi184.stdout:1 2024-03-04T12:35:35.683 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new ed82599b-7c3e-43e5-ba21-297d07356a35 2 2024-03-04T12:35:35.718 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:35.712+0000 7fd308a14040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T12:35:35.765 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:35.759+0000 7fd308a14040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T12:35:35.822 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:35.815+0000 7fd308a14040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T12:35:35.836 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:35.830+0000 7f428bc2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T12:35:35.865 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:35.859+0000 7fd308a14040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T12:35:35.886 INFO:teuthology.orchestra.run.smithi184.stdout:2 2024-03-04T12:35:35.891 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:35.885+0000 7f428bc2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T12:35:35.897 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new a4a85bc4-ad7a-4304-ab73-3048e867e8ef 3 2024-03-04T12:35:35.936 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:35.930+0000 7f428bc2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T12:35:35.987 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:35.981+0000 7fd308a14040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T12:35:35.988 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:35.982+0000 7f428bc2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T12:35:36.030 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:36.024+0000 7f428bc2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T12:35:36.061 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:36.055+0000 7fd308a14040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T12:35:36.109 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:36.103+0000 7fd308a14040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T12:35:36.140 INFO:teuthology.orchestra.run.smithi184.stdout:3 2024-03-04T12:35:36.146 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:36.140+0000 7f428bc2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T12:35:36.152 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 5a7d2b60-bf44-4630-9c7a-423a1fbcb44c 4 2024-03-04T12:35:36.164 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:36.158+0000 7fd308a14040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T12:35:36.214 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:36.208+0000 7fd308a14040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T12:35:36.215 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:36.209+0000 7f428bc2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T12:35:36.261 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:36.254+0000 7f428bc2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T12:35:36.314 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:36.308+0000 7f428bc2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T12:35:36.350 INFO:teuthology.orchestra.run.smithi184.stdout:4 2024-03-04T12:35:36.361 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 85c4324f-a91a-4fa2-9a6a-4dbe8ffb7e16 5 2024-03-04T12:35:36.361 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:36.355+0000 7f428bc2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T12:35:36.607 INFO:teuthology.orchestra.run.smithi184.stdout:5 2024-03-04T12:35:36.609 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:36.603+0000 7fd308a14040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T12:35:36.618 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new b645ef8b-e719-4c5d-b1db-f23fd3072384 6 2024-03-04T12:35:36.740 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:36.734+0000 7f428bc2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T12:35:36.752 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:36.746+0000 7fd308a14040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T12:35:36.820 INFO:teuthology.orchestra.run.smithi184.stdout:6 2024-03-04T12:35:36.831 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new c4bfe9ed-2753-4115-b557-ed757f670346 7 2024-03-04T12:35:36.874 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:36.868+0000 7f428bc2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T12:35:36.875 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:36.869+0000 7fd308a14040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T12:35:36.923 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:36.917+0000 7fd308a14040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T12:35:37.038 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:37.032+0000 7f428bc2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T12:35:37.049 INFO:teuthology.orchestra.run.smithi184.stdout:7 2024-03-04T12:35:37.053 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:37.047+0000 7fd308a14040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T12:35:37.060 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-04T12:35:37.060 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-04T12:35:37.062 INFO:tasks.ceph.osd.0:Started 2024-03-04T12:35:37.063 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-04T12:35:37.063 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-04T12:35:37.065 INFO:tasks.ceph.osd.1:Started 2024-03-04T12:35:37.065 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-04T12:35:37.065 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-04T12:35:37.067 INFO:tasks.ceph.osd.2:Started 2024-03-04T12:35:37.067 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-04T12:35:37.067 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-04T12:35:37.071 INFO:tasks.ceph.osd.3:Started 2024-03-04T12:35:37.072 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-04T12:35:37.072 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-04T12:35:37.074 INFO:tasks.ceph.osd.4:Started 2024-03-04T12:35:37.074 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-04T12:35:37.074 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-04T12:35:37.076 INFO:tasks.ceph.osd.5:Started 2024-03-04T12:35:37.076 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-04T12:35:37.076 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-04T12:35:37.078 INFO:tasks.ceph.osd.6:Started 2024-03-04T12:35:37.078 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-04T12:35:37.078 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-04T12:35:37.081 INFO:tasks.ceph.osd.7:Started 2024-03-04T12:35:37.081 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T12:35:37.091 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:37.085+0000 7f428bc2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T12:35:37.167 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:37.161+0000 7fd308a14040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T12:35:37.225 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:37.219+0000 7f428bc2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T12:35:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:35:37.284 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":10,"fsid":"0f6a7118-f776-445e-bdfb-0ec0be103287","created":"2024-03-04T12:35:34.533330+0000","modified":"2024-03-04T12:35:37.037125+0000","last_up_change":"0.000000","last_in_change":"2024-03-04T12:35:37.037125+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8c7f3cf2-45d3-45de-9e96-f23658118260","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b89dd9e5-ffdd-4b15-b6d0-c676f7f43bdf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ed82599b-7c3e-43e5-ba21-297d07356a35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a4a85bc4-ad7a-4304-ab73-3048e867e8ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5a7d2b60-bf44-4630-9c7a-423a1fbcb44c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"85c4324f-a91a-4fa2-9a6a-4dbe8ffb7e16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b645ef8b-e719-4c5d-b1db-f23fd3072384","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c4bfe9ed-2753-4115-b557-ed757f670346","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T12:35:37.295 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-04T12:35:37.295 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-04T12:35:37.323 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:37.317+0000 7f428bc2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T12:35:37.331 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:37.325+0000 7fd308a14040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T12:35:37.373 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:37.367+0000 7fd308a14040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T12:35:37.458 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-03-04T12:35:37.452+0000 7f95e7173640 -1 Falling back to public interface 2024-03-04T12:35:37.482 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:37.476+0000 7f428bc2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T12:35:37.525 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:37.519+0000 7f428bc2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T12:35:37.528 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:37.522+0000 7fd308a14040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T12:35:37.680 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:37.674+0000 7f428bc2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T12:35:37.698 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-03-04T12:35:37.692+0000 7fc29b8ac640 -1 Falling back to public interface 2024-03-04T12:35:37.702 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-03-04T12:35:37.696+0000 7efd83c15640 -1 Falling back to public interface 2024-03-04T12:35:37.703 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-03-04T12:35:37.697+0000 7efd9141b640 -1 Falling back to public interface 2024-03-04T12:35:37.710 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-03-04T12:35:37.704+0000 7ff25fb73640 -1 Falling back to public interface 2024-03-04T12:35:37.711 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-03-04T12:35:37.704+0000 7f19c8a15640 -1 Falling back to public interface 2024-03-04T12:35:37.716 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-03-04T12:35:37.710+0000 7f6d2d9df640 -1 Falling back to public interface 2024-03-04T12:35:37.725 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-03-04T12:35:37.719+0000 7fd4ea601640 -1 Falling back to public interface 2024-03-04T12:35:38.101 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-04T12:35:38.273 INFO:teuthology.misc.health.smithi090.stdout: 2024-03-04T12:35:38.274 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":10,"fsid":"0f6a7118-f776-445e-bdfb-0ec0be103287","created":"2024-03-04T12:35:34.533330+0000","modified":"2024-03-04T12:35:37.037125+0000","last_up_change":"0.000000","last_in_change":"2024-03-04T12:35:37.037125+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8c7f3cf2-45d3-45de-9e96-f23658118260","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b89dd9e5-ffdd-4b15-b6d0-c676f7f43bdf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ed82599b-7c3e-43e5-ba21-297d07356a35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a4a85bc4-ad7a-4304-ab73-3048e867e8ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5a7d2b60-bf44-4630-9c7a-423a1fbcb44c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"85c4324f-a91a-4fa2-9a6a-4dbe8ffb7e16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b645ef8b-e719-4c5d-b1db-f23fd3072384","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c4bfe9ed-2753-4115-b557-ed757f670346","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T12:35:38.285 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-04T12:35:38.356 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:38.350+0000 7fd308a14040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T12:35:38.556 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:38.550+0000 7f428bc2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T12:35:38.628 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:38.622+0000 7fd308a14040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T12:35:38.679 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:38.672+0000 7fd308a14040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T12:35:38.796 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:38.787+0000 7fd308a14040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T12:35:38.834 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:38.828+0000 7f428bc2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T12:35:38.892 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:38.885+0000 7f428bc2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T12:35:39.005 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-03-04T12:35:38.998+0000 7f428bc2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T12:35:39.820 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:39.814+0000 7fd2a92d1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-04T12:35:39.820 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-03-04T12:35:39.814+0000 7fd2a92d1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-04T12:35:40.970 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-03-04T12:35:40.964+0000 7f95e7173640 -1 osd.1 0 log_to_monitors true 2024-03-04T12:35:41.150 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-03-04T12:35:41.143+0000 7efd83c15640 -1 osd.0 0 log_to_monitors true 2024-03-04T12:35:41.180 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-03-04T12:35:41.174+0000 7fc29b8ac640 -1 osd.4 0 log_to_monitors true 2024-03-04T12:35:41.216 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-03-04T12:35:41.210+0000 7efd9141b640 -1 osd.6 0 log_to_monitors true 2024-03-04T12:35:41.216 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-03-04T12:35:41.210+0000 7f19c8a15640 -1 osd.3 0 log_to_monitors true 2024-03-04T12:35:41.225 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-03-04T12:35:41.219+0000 7ff25fb73640 -1 osd.2 0 log_to_monitors true 2024-03-04T12:35:41.242 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-03-04T12:35:41.236+0000 7f6d2d9df640 -1 osd.7 0 log_to_monitors true 2024-03-04T12:35:41.265 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-03-04T12:35:41.259+0000 7fd4ea601640 -1 osd.5 0 log_to_monitors true 2024-03-04T12:35:44.798 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-03-04T12:35:44.792+0000 7ff25b2e4640 -1 osd.2 0 waiting for initial osdmap 2024-03-04T12:35:44.812 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-03-04T12:35:44.806+0000 7ff253916640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:35:44.855 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-03-04T12:35:44.849+0000 7f19c3b58640 -1 osd.3 0 waiting for initial osdmap 2024-03-04T12:35:44.870 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-03-04T12:35:44.864+0000 7f19bc18a640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:35:44.872 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-03-04T12:35:44.866+0000 7fc29701d640 -1 osd.4 0 waiting for initial osdmap 2024-03-04T12:35:44.886 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-03-04T12:35:44.880+0000 7fc28f64f640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:35:44.896 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-03-04T12:35:44.890+0000 7efd8c4ca640 -1 osd.6 0 waiting for initial osdmap 2024-03-04T12:35:44.907 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-03-04T12:35:44.901+0000 7efd84afc640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:35:44.917 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-03-04T12:35:44.911+0000 7efd7ee50640 -1 osd.0 0 waiting for initial osdmap 2024-03-04T12:35:44.931 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-03-04T12:35:44.926+0000 7f95e411c640 -1 osd.1 0 waiting for initial osdmap 2024-03-04T12:35:44.935 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-03-04T12:35:44.929+0000 7efd77482640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:35:44.944 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-03-04T12:35:44.938+0000 7f95daf16640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:35:44.962 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-03-04T12:35:44.956+0000 7fd4e5d72640 -1 osd.5 0 waiting for initial osdmap 2024-03-04T12:35:44.970 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-03-04T12:35:44.964+0000 7f6d29150640 -1 osd.7 0 waiting for initial osdmap 2024-03-04T12:35:44.974 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-03-04T12:35:44.968+0000 7fd4de3a4640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:35:44.987 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-03-04T12:35:44.981+0000 7f6d21782640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:35:45.091 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-04T12:35:45.376 INFO:teuthology.misc.health.smithi090.stdout: 2024-03-04T12:35:45.376 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":12,"fsid":"0f6a7118-f776-445e-bdfb-0ec0be103287","created":"2024-03-04T12:35:34.533330+0000","modified":"2024-03-04T12:35:42.814607+0000","last_up_change":"0.000000","last_in_change":"2024-03-04T12:35:37.037125+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8c7f3cf2-45d3-45de-9e96-f23658118260","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b89dd9e5-ffdd-4b15-b6d0-c676f7f43bdf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ed82599b-7c3e-43e5-ba21-297d07356a35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a4a85bc4-ad7a-4304-ab73-3048e867e8ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5a7d2b60-bf44-4630-9c7a-423a1fbcb44c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"85c4324f-a91a-4fa2-9a6a-4dbe8ffb7e16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b645ef8b-e719-4c5d-b1db-f23fd3072384","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c4bfe9ed-2753-4115-b557-ed757f670346","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T12:35:45.387 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-04T12:35:52.194 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-04T12:35:52.490 INFO:teuthology.misc.health.smithi090.stdout: 2024-03-04T12:35:52.490 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":16,"fsid":"0f6a7118-f776-445e-bdfb-0ec0be103287","created":"2024-03-04T12:35:34.533330+0000","modified":"2024-03-04T12:35:48.859422+0000","last_up_change":"2024-03-04T12:35:45.797580+0000","last_in_change":"2024-03-04T12:35:37.037125+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T12:35:46.856371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8c7f3cf2-45d3-45de-9e96-f23658118260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6809","nonce":2300499759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6811","nonce":2300499759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6815","nonce":2300499759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6813","nonce":2300499759}]},"public_addr":"172.21.15.90:6809/2300499759","cluster_addr":"172.21.15.90:6811/2300499759","heartbeat_back_addr":"172.21.15.90:6815/2300499759","heartbeat_front_addr":"172.21.15.90:6813/2300499759","state":["exists","up"]},{"osd":1,"uuid":"b89dd9e5-ffdd-4b15-b6d0-c676f7f43bdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6801","nonce":1270080005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6803","nonce":1270080005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6807","nonce":1270080005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6805","nonce":1270080005}]},"public_addr":"172.21.15.90:6801/1270080005","cluster_addr":"172.21.15.90:6803/1270080005","heartbeat_back_addr":"172.21.15.90:6807/1270080005","heartbeat_front_addr":"172.21.15.90:6805/1270080005","state":["exists","up"]},{"osd":2,"uuid":"ed82599b-7c3e-43e5-ba21-297d07356a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6817","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6819","nonce":137526376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6824","nonce":137526376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6831","nonce":137526376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6827","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6829","nonce":137526376}]},"public_addr":"172.21.15.90:6819/137526376","cluster_addr":"172.21.15.90:6824/137526376","heartbeat_back_addr":"172.21.15.90:6831/137526376","heartbeat_front_addr":"172.21.15.90:6829/137526376","state":["exists","up"]},{"osd":3,"uuid":"a4a85bc4-ad7a-4304-ab73-3048e867e8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6818","nonce":543891292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6821","nonce":543891292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6828","nonce":543891292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6823","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6825","nonce":543891292}]},"public_addr":"172.21.15.90:6818/543891292","cluster_addr":"172.21.15.90:6821/543891292","heartbeat_back_addr":"172.21.15.90:6828/543891292","heartbeat_front_addr":"172.21.15.90:6825/543891292","state":["exists","up"]},{"osd":4,"uuid":"5a7d2b60-bf44-4630-9c7a-423a1fbcb44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6801","nonce":1721853619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6803","nonce":1721853619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6807","nonce":1721853619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6805","nonce":1721853619}]},"public_addr":"172.21.15.184:6801/1721853619","cluster_addr":"172.21.15.184:6803/1721853619","heartbeat_back_addr":"172.21.15.184:6807/1721853619","heartbeat_front_addr":"172.21.15.184:6805/1721853619","state":["exists","up"]},{"osd":5,"uuid":"85c4324f-a91a-4fa2-9a6a-4dbe8ffb7e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6825","nonce":1880219084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6827","nonce":1880219084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6831","nonce":1880219084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6829","nonce":1880219084}]},"public_addr":"172.21.15.184:6825/1880219084","cluster_addr":"172.21.15.184:6827/1880219084","heartbeat_back_addr":"172.21.15.184:6831/1880219084","heartbeat_front_addr":"172.21.15.184:6829/1880219084","state":["exists","up"]},{"osd":6,"uuid":"b645ef8b-e719-4c5d-b1db-f23fd3072384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6809","nonce":2808753711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6811","nonce":2808753711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6815","nonce":2808753711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6813","nonce":2808753711}]},"public_addr":"172.21.15.184:6809/2808753711","cluster_addr":"172.21.15.184:6811/2808753711","heartbeat_back_addr":"172.21.15.184:6815/2808753711","heartbeat_front_addr":"172.21.15.184:6813/2808753711","state":["exists","up"]},{"osd":7,"uuid":"c4bfe9ed-2753-4115-b557-ed757f670346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6817","nonce":2607900362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6819","nonce":2607900362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6823","nonce":2607900362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6821","nonce":2607900362}]},"public_addr":"172.21.15.184:6817/2607900362","cluster_addr":"172.21.15.184:6819/2607900362","heartbeat_back_addr":"172.21.15.184:6823/2607900362","heartbeat_front_addr":"172.21.15.184:6821/2607900362","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.155792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:41.963927+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.190840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.200510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.172570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.204375+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.250992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T12:35:52.501 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-04T12:35:52.502 INFO:tasks.ceph:Creating RBD pool 2024-03-04T12:35:52.502 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd pool create rbd 8 2024-03-04T12:35:53.230 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'rbd' created 2024-03-04T12:35:53.244 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-03-04T12:35:54.231 INFO:teuthology.orchestra.run.smithi090.stderr:enabled application 'rbd' on pool 'rbd' 2024-03-04T12:35:54.249 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-04T12:35:54.249 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-04T12:35:54.249 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-04T12:35:54.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-04T12:35:54.250 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-04T12:35:54.600 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:35:54.611 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1920793997},{"type":"v1","addr":"172.21.15.184:6833","nonce":1920793997}]},"active_addr":"172.21.15.184:6833/1920793997","active_change":"2024-03-04T12:35:38.801417+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":1401813499}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":3388819935}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":1092036850}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":1722389561}]}]} 2024-03-04T12:35:54.614 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-04T12:35:54.615 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-04T12:35:54.615 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T12:35:54.911 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:35:54.911 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":18,"fsid":"0f6a7118-f776-445e-bdfb-0ec0be103287","created":"2024-03-04T12:35:34.533330+0000","modified":"2024-03-04T12:35:54.224619+0000","last_up_change":"2024-03-04T12:35:45.797580+0000","last_in_change":"2024-03-04T12:35:37.037125+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T12:35:46.856371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-04T12:35:52.808458+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8c7f3cf2-45d3-45de-9e96-f23658118260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6809","nonce":2300499759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6811","nonce":2300499759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6815","nonce":2300499759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6813","nonce":2300499759}]},"public_addr":"172.21.15.90:6809/2300499759","cluster_addr":"172.21.15.90:6811/2300499759","heartbeat_back_addr":"172.21.15.90:6815/2300499759","heartbeat_front_addr":"172.21.15.90:6813/2300499759","state":["exists","up"]},{"osd":1,"uuid":"b89dd9e5-ffdd-4b15-b6d0-c676f7f43bdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6801","nonce":1270080005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6803","nonce":1270080005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6807","nonce":1270080005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6805","nonce":1270080005}]},"public_addr":"172.21.15.90:6801/1270080005","cluster_addr":"172.21.15.90:6803/1270080005","heartbeat_back_addr":"172.21.15.90:6807/1270080005","heartbeat_front_addr":"172.21.15.90:6805/1270080005","state":["exists","up"]},{"osd":2,"uuid":"ed82599b-7c3e-43e5-ba21-297d07356a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6817","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6819","nonce":137526376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6824","nonce":137526376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6831","nonce":137526376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6827","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6829","nonce":137526376}]},"public_addr":"172.21.15.90:6819/137526376","cluster_addr":"172.21.15.90:6824/137526376","heartbeat_back_addr":"172.21.15.90:6831/137526376","heartbeat_front_addr":"172.21.15.90:6829/137526376","state":["exists","up"]},{"osd":3,"uuid":"a4a85bc4-ad7a-4304-ab73-3048e867e8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6818","nonce":543891292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6821","nonce":543891292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6828","nonce":543891292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6823","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6825","nonce":543891292}]},"public_addr":"172.21.15.90:6818/543891292","cluster_addr":"172.21.15.90:6821/543891292","heartbeat_back_addr":"172.21.15.90:6828/543891292","heartbeat_front_addr":"172.21.15.90:6825/543891292","state":["exists","up"]},{"osd":4,"uuid":"5a7d2b60-bf44-4630-9c7a-423a1fbcb44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6801","nonce":1721853619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6803","nonce":1721853619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6807","nonce":1721853619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6805","nonce":1721853619}]},"public_addr":"172.21.15.184:6801/1721853619","cluster_addr":"172.21.15.184:6803/1721853619","heartbeat_back_addr":"172.21.15.184:6807/1721853619","heartbeat_front_addr":"172.21.15.184:6805/1721853619","state":["exists","up"]},{"osd":5,"uuid":"85c4324f-a91a-4fa2-9a6a-4dbe8ffb7e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6825","nonce":1880219084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6827","nonce":1880219084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6831","nonce":1880219084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6829","nonce":1880219084}]},"public_addr":"172.21.15.184:6825/1880219084","cluster_addr":"172.21.15.184:6827/1880219084","heartbeat_back_addr":"172.21.15.184:6831/1880219084","heartbeat_front_addr":"172.21.15.184:6829/1880219084","state":["exists","up"]},{"osd":6,"uuid":"b645ef8b-e719-4c5d-b1db-f23fd3072384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6809","nonce":2808753711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6811","nonce":2808753711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6815","nonce":2808753711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6813","nonce":2808753711}]},"public_addr":"172.21.15.184:6809/2808753711","cluster_addr":"172.21.15.184:6811/2808753711","heartbeat_back_addr":"172.21.15.184:6815/2808753711","heartbeat_front_addr":"172.21.15.184:6813/2808753711","state":["exists","up"]},{"osd":7,"uuid":"c4bfe9ed-2753-4115-b557-ed757f670346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6817","nonce":2607900362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6819","nonce":2607900362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6823","nonce":2607900362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6821","nonce":2607900362}]},"public_addr":"172.21.15.184:6817/2607900362","cluster_addr":"172.21.15.184:6819/2607900362","heartbeat_back_addr":"172.21.15.184:6823/2607900362","heartbeat_front_addr":"172.21.15.184:6821/2607900362","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.155792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:41.963927+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.190840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.200510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.172570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.204375+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.250992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T12:35:54.923 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-04T12:35:54.923 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T12:35:55.225 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:35:55.226 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":18,"fsid":"0f6a7118-f776-445e-bdfb-0ec0be103287","created":"2024-03-04T12:35:34.533330+0000","modified":"2024-03-04T12:35:54.224619+0000","last_up_change":"2024-03-04T12:35:45.797580+0000","last_in_change":"2024-03-04T12:35:37.037125+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T12:35:46.856371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-04T12:35:52.808458+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8c7f3cf2-45d3-45de-9e96-f23658118260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6809","nonce":2300499759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6811","nonce":2300499759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6815","nonce":2300499759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6813","nonce":2300499759}]},"public_addr":"172.21.15.90:6809/2300499759","cluster_addr":"172.21.15.90:6811/2300499759","heartbeat_back_addr":"172.21.15.90:6815/2300499759","heartbeat_front_addr":"172.21.15.90:6813/2300499759","state":["exists","up"]},{"osd":1,"uuid":"b89dd9e5-ffdd-4b15-b6d0-c676f7f43bdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6801","nonce":1270080005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6803","nonce":1270080005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6807","nonce":1270080005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6805","nonce":1270080005}]},"public_addr":"172.21.15.90:6801/1270080005","cluster_addr":"172.21.15.90:6803/1270080005","heartbeat_back_addr":"172.21.15.90:6807/1270080005","heartbeat_front_addr":"172.21.15.90:6805/1270080005","state":["exists","up"]},{"osd":2,"uuid":"ed82599b-7c3e-43e5-ba21-297d07356a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6817","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6819","nonce":137526376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6824","nonce":137526376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6831","nonce":137526376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6827","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6829","nonce":137526376}]},"public_addr":"172.21.15.90:6819/137526376","cluster_addr":"172.21.15.90:6824/137526376","heartbeat_back_addr":"172.21.15.90:6831/137526376","heartbeat_front_addr":"172.21.15.90:6829/137526376","state":["exists","up"]},{"osd":3,"uuid":"a4a85bc4-ad7a-4304-ab73-3048e867e8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6818","nonce":543891292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6821","nonce":543891292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6828","nonce":543891292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6823","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6825","nonce":543891292}]},"public_addr":"172.21.15.90:6818/543891292","cluster_addr":"172.21.15.90:6821/543891292","heartbeat_back_addr":"172.21.15.90:6828/543891292","heartbeat_front_addr":"172.21.15.90:6825/543891292","state":["exists","up"]},{"osd":4,"uuid":"5a7d2b60-bf44-4630-9c7a-423a1fbcb44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6801","nonce":1721853619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6803","nonce":1721853619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6807","nonce":1721853619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6805","nonce":1721853619}]},"public_addr":"172.21.15.184:6801/1721853619","cluster_addr":"172.21.15.184:6803/1721853619","heartbeat_back_addr":"172.21.15.184:6807/1721853619","heartbeat_front_addr":"172.21.15.184:6805/1721853619","state":["exists","up"]},{"osd":5,"uuid":"85c4324f-a91a-4fa2-9a6a-4dbe8ffb7e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6825","nonce":1880219084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6827","nonce":1880219084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6831","nonce":1880219084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6829","nonce":1880219084}]},"public_addr":"172.21.15.184:6825/1880219084","cluster_addr":"172.21.15.184:6827/1880219084","heartbeat_back_addr":"172.21.15.184:6831/1880219084","heartbeat_front_addr":"172.21.15.184:6829/1880219084","state":["exists","up"]},{"osd":6,"uuid":"b645ef8b-e719-4c5d-b1db-f23fd3072384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6809","nonce":2808753711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6811","nonce":2808753711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6815","nonce":2808753711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6813","nonce":2808753711}]},"public_addr":"172.21.15.184:6809/2808753711","cluster_addr":"172.21.15.184:6811/2808753711","heartbeat_back_addr":"172.21.15.184:6815/2808753711","heartbeat_front_addr":"172.21.15.184:6813/2808753711","state":["exists","up"]},{"osd":7,"uuid":"c4bfe9ed-2753-4115-b557-ed757f670346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6817","nonce":2607900362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6819","nonce":2607900362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6823","nonce":2607900362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6821","nonce":2607900362}]},"public_addr":"172.21.15.184:6817/2607900362","cluster_addr":"172.21.15.184:6819/2607900362","heartbeat_back_addr":"172.21.15.184:6823/2607900362","heartbeat_front_addr":"172.21.15.184:6821/2607900362","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.155792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:41.963927+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.190840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.200510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.172570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.204375+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.250992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T12:35:55.238 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-04T12:35:55.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-04T12:35:55.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-04T12:35:55.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-04T12:35:55.240 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-04T12:35:55.240 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-04T12:35:55.241 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-04T12:35:55.241 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-04T12:35:55.504 INFO:teuthology.orchestra.run.smithi090.stdout:55834574851 2024-03-04T12:35:55.505 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-04T12:35:55.506 INFO:teuthology.orchestra.run.smithi090.stdout:55834574852 2024-03-04T12:35:55.506 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-04T12:35:55.507 INFO:teuthology.orchestra.run.smithi090.stdout:55834574853 2024-03-04T12:35:55.507 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-04T12:35:55.508 INFO:teuthology.orchestra.run.smithi090.stdout:55834574853 2024-03-04T12:35:55.508 INFO:teuthology.orchestra.run.smithi090.stdout:55834574851 2024-03-04T12:35:55.509 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-04T12:35:55.510 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-04T12:35:55.511 INFO:teuthology.orchestra.run.smithi090.stdout:55834574852 2024-03-04T12:35:55.511 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-04T12:35:55.512 INFO:teuthology.orchestra.run.smithi090.stdout:55834574853 2024-03-04T12:35:55.512 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-04T12:35:55.514 INFO:teuthology.orchestra.run.smithi090.stdout:55834574851 2024-03-04T12:35:55.514 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-04T12:35:56.077 INFO:teuthology.orchestra.run.smithi090.stdout:55834574850 2024-03-04T12:35:56.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.4 2024-03-04T12:35:56.121 INFO:teuthology.orchestra.run.smithi090.stdout:55834574852 2024-03-04T12:35:56.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-03-04T12:35:56.165 INFO:teuthology.orchestra.run.smithi090.stdout:55834574850 2024-03-04T12:35:56.167 INFO:teuthology.orchestra.run.smithi090.stdout:55834574851 2024-03-04T12:35:56.168 INFO:teuthology.orchestra.run.smithi090.stdout:55834574852 2024-03-04T12:35:56.169 INFO:teuthology.orchestra.run.smithi090.stdout:55834574852 2024-03-04T12:35:56.178 INFO:teuthology.orchestra.run.smithi090.stdout:55834574850 2024-03-04T12:35:56.181 INFO:teuthology.orchestra.run.smithi090.stdout:55834574851 2024-03-04T12:35:56.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.7 2024-03-04T12:35:56.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-03-04T12:35:56.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2024-03-04T12:35:56.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-03-04T12:35:56.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.3 2024-03-04T12:35:56.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-03-04T12:35:57.098 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-04T12:35:57.135 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-04T12:35:57.185 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-04T12:35:57.190 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-04T12:35:57.192 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-04T12:35:57.192 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-04T12:35:57.197 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-04T12:35:57.198 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-04T12:35:57.629 INFO:teuthology.orchestra.run.smithi090.stdout:55834574852 2024-03-04T12:35:57.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.4 2024-03-04T12:35:57.649 DEBUG:teuthology.parallel:result is None 2024-03-04T12:35:57.692 INFO:teuthology.orchestra.run.smithi090.stdout:55834574854 2024-03-04T12:35:57.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2024-03-04T12:35:57.711 DEBUG:teuthology.parallel:result is None 2024-03-04T12:35:57.743 INFO:teuthology.orchestra.run.smithi090.stdout:55834574854 2024-03-04T12:35:57.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2024-03-04T12:35:57.761 DEBUG:teuthology.parallel:result is None 2024-03-04T12:35:57.777 INFO:teuthology.orchestra.run.smithi090.stdout:55834574854 2024-03-04T12:35:57.780 INFO:teuthology.orchestra.run.smithi090.stdout:55834574852 2024-03-04T12:35:57.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2024-03-04T12:35:57.791 DEBUG:teuthology.parallel:result is None 2024-03-04T12:35:57.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.7 2024-03-04T12:35:57.795 DEBUG:teuthology.parallel:result is None 2024-03-04T12:35:57.810 INFO:teuthology.orchestra.run.smithi090.stdout:55834574853 2024-03-04T12:35:57.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.5 2024-03-04T12:35:57.823 DEBUG:teuthology.parallel:result is None 2024-03-04T12:35:57.827 INFO:teuthology.orchestra.run.smithi090.stdout:55834574852 2024-03-04T12:35:57.830 INFO:teuthology.orchestra.run.smithi090.stdout:55834574853 2024-03-04T12:35:57.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.3 2024-03-04T12:35:57.841 DEBUG:teuthology.parallel:result is None 2024-03-04T12:35:57.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.6 2024-03-04T12:35:57.843 DEBUG:teuthology.parallel:result is None 2024-03-04T12:35:57.844 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-04T12:35:57.844 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T12:35:58.180 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:35:58.180 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-03-04T12:35:58.192 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-03-04T12:35:56.813872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218788,"kb_used_data":2592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755932,"statfs":{"total":773094113280,"available":772870074368,"internally_reserved":0,"allocated":2654208,"data_stored":1650760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000644"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-04T12:35:54.243124+0000","last_change":"2024-03-04T12:35:54.239095+0000","last_active":"2024-03-04T12:35:54.243124+0000","last_peered":"2024-03-04T12:35:54.243124+0000","last_clean":"2024-03-04T12:35:54.243124+0000","last_became_active":"2024-03-04T12:35:54.238580+0000","last_became_peered":"2024-03-04T12:35:54.238580+0000","last_unstale":"2024-03-04T12:35:54.243124+0000","last_undegraded":"2024-03-04T12:35:54.243124+0000","last_fullsized":"2024-03-04T12:35:54.243124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:25:07.224806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-04T12:35:54.240531+0000","last_change":"2024-03-04T12:35:54.239060+0000","last_active":"2024-03-04T12:35:54.240531+0000","last_peered":"2024-03-04T12:35:54.240531+0000","last_clean":"2024-03-04T12:35:54.240531+0000","last_became_active":"2024-03-04T12:35:54.238802+0000","last_became_peered":"2024-03-04T12:35:54.238802+0000","last_unstale":"2024-03-04T12:35:54.240531+0000","last_undegraded":"2024-03-04T12:35:54.240531+0000","last_fullsized":"2024-03-04T12:35:54.240531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:55:54.510247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:35:55.242208+0000","last_change":"2024-03-04T12:35:54.470913+0000","last_active":"2024-03-04T12:35:55.242208+0000","last_peered":"2024-03-04T12:35:55.242208+0000","last_clean":"2024-03-04T12:35:55.242208+0000","last_became_active":"2024-03-04T12:35:54.470620+0000","last_became_peered":"2024-03-04T12:35:54.470620+0000","last_unstale":"2024-03-04T12:35:55.242208+0000","last_undegraded":"2024-03-04T12:35:55.242208+0000","last_fullsized":"2024-03-04T12:35:55.242208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:00.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-04T12:35:54.471122+0000","last_change":"2024-03-04T12:35:54.470673+0000","last_active":"2024-03-04T12:35:54.471122+0000","last_peered":"2024-03-04T12:35:54.471122+0000","last_clean":"2024-03-04T12:35:54.471122+0000","last_became_active":"2024-03-04T12:35:54.470407+0000","last_became_peered":"2024-03-04T12:35:54.470407+0000","last_unstale":"2024-03-04T12:35:54.471122+0000","last_undegraded":"2024-03-04T12:35:54.471122+0000","last_fullsized":"2024-03-04T12:35:54.471122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:15.800825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:35:55.245400+0000","last_change":"2024-03-04T12:35:54.238657+0000","last_active":"2024-03-04T12:35:55.245400+0000","last_peered":"2024-03-04T12:35:55.245400+0000","last_clean":"2024-03-04T12:35:55.245400+0000","last_became_active":"2024-03-04T12:35:54.238357+0000","last_became_peered":"2024-03-04T12:35:54.238357+0000","last_unstale":"2024-03-04T12:35:55.245400+0000","last_undegraded":"2024-03-04T12:35:55.245400+0000","last_fullsized":"2024-03-04T12:35:55.245400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:33:05.241037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:35:55.243486+0000","last_change":"2024-03-04T12:35:54.236078+0000","last_active":"2024-03-04T12:35:55.243486+0000","last_peered":"2024-03-04T12:35:55.243486+0000","last_clean":"2024-03-04T12:35:55.243486+0000","last_became_active":"2024-03-04T12:35:54.235738+0000","last_became_peered":"2024-03-04T12:35:54.235738+0000","last_unstale":"2024-03-04T12:35:55.243486+0000","last_undegraded":"2024-03-04T12:35:55.243486+0000","last_fullsized":"2024-03-04T12:35:55.243486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:36:28.049431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:35:55.242206+0000","last_change":"2024-03-04T12:35:54.238692+0000","last_active":"2024-03-04T12:35:55.242206+0000","last_peered":"2024-03-04T12:35:55.242206+0000","last_clean":"2024-03-04T12:35:55.242206+0000","last_became_active":"2024-03-04T12:35:54.238351+0000","last_became_peered":"2024-03-04T12:35:54.238351+0000","last_unstale":"2024-03-04T12:35:55.242206+0000","last_undegraded":"2024-03-04T12:35:55.242206+0000","last_fullsized":"2024-03-04T12:35:55.242206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:37.144629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:35:55.245411+0000","last_change":"2024-03-04T12:35:54.235102+0000","last_active":"2024-03-04T12:35:55.245411+0000","last_peered":"2024-03-04T12:35:55.245411+0000","last_clean":"2024-03-04T12:35:55.245411+0000","last_became_active":"2024-03-04T12:35:54.234819+0000","last_became_peered":"2024-03-04T12:35:54.234819+0000","last_unstale":"2024-03-04T12:35:55.245411+0000","last_undegraded":"2024-03-04T12:35:55.245411+0000","last_fullsized":"2024-03-04T12:35:55.245411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:40.517488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:35:55.242082+0000","last_change":"2024-03-04T12:35:47.950593+0000","last_active":"2024-03-04T12:35:55.242082+0000","last_peered":"2024-03-04T12:35:55.242082+0000","last_clean":"2024-03-04T12:35:55.242082+0000","last_became_active":"2024-03-04T12:35:47.950213+0000","last_became_peered":"2024-03-04T12:35:47.950213+0000","last_unstale":"2024-03-04T12:35:55.242082+0000","last_undegraded":"2024-03-04T12:35:55.242082+0000","last_fullsized":"2024-03-04T12:35:55.242082+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_clean_scrub_stamp":"2024-03-04T12:35:46.856449+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:52:59.823887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T12:35:58.193 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T12:35:58.483 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:35:58.484 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-03-04T12:35:58.496 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-03-04T12:35:56.813872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218788,"kb_used_data":2592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755932,"statfs":{"total":773094113280,"available":772870074368,"internally_reserved":0,"allocated":2654208,"data_stored":1650760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000644"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-04T12:35:54.243124+0000","last_change":"2024-03-04T12:35:54.239095+0000","last_active":"2024-03-04T12:35:54.243124+0000","last_peered":"2024-03-04T12:35:54.243124+0000","last_clean":"2024-03-04T12:35:54.243124+0000","last_became_active":"2024-03-04T12:35:54.238580+0000","last_became_peered":"2024-03-04T12:35:54.238580+0000","last_unstale":"2024-03-04T12:35:54.243124+0000","last_undegraded":"2024-03-04T12:35:54.243124+0000","last_fullsized":"2024-03-04T12:35:54.243124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:25:07.224806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-04T12:35:54.240531+0000","last_change":"2024-03-04T12:35:54.239060+0000","last_active":"2024-03-04T12:35:54.240531+0000","last_peered":"2024-03-04T12:35:54.240531+0000","last_clean":"2024-03-04T12:35:54.240531+0000","last_became_active":"2024-03-04T12:35:54.238802+0000","last_became_peered":"2024-03-04T12:35:54.238802+0000","last_unstale":"2024-03-04T12:35:54.240531+0000","last_undegraded":"2024-03-04T12:35:54.240531+0000","last_fullsized":"2024-03-04T12:35:54.240531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:55:54.510247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:35:55.242208+0000","last_change":"2024-03-04T12:35:54.470913+0000","last_active":"2024-03-04T12:35:55.242208+0000","last_peered":"2024-03-04T12:35:55.242208+0000","last_clean":"2024-03-04T12:35:55.242208+0000","last_became_active":"2024-03-04T12:35:54.470620+0000","last_became_peered":"2024-03-04T12:35:54.470620+0000","last_unstale":"2024-03-04T12:35:55.242208+0000","last_undegraded":"2024-03-04T12:35:55.242208+0000","last_fullsized":"2024-03-04T12:35:55.242208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:00.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-04T12:35:54.471122+0000","last_change":"2024-03-04T12:35:54.470673+0000","last_active":"2024-03-04T12:35:54.471122+0000","last_peered":"2024-03-04T12:35:54.471122+0000","last_clean":"2024-03-04T12:35:54.471122+0000","last_became_active":"2024-03-04T12:35:54.470407+0000","last_became_peered":"2024-03-04T12:35:54.470407+0000","last_unstale":"2024-03-04T12:35:54.471122+0000","last_undegraded":"2024-03-04T12:35:54.471122+0000","last_fullsized":"2024-03-04T12:35:54.471122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:15.800825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:35:55.245400+0000","last_change":"2024-03-04T12:35:54.238657+0000","last_active":"2024-03-04T12:35:55.245400+0000","last_peered":"2024-03-04T12:35:55.245400+0000","last_clean":"2024-03-04T12:35:55.245400+0000","last_became_active":"2024-03-04T12:35:54.238357+0000","last_became_peered":"2024-03-04T12:35:54.238357+0000","last_unstale":"2024-03-04T12:35:55.245400+0000","last_undegraded":"2024-03-04T12:35:55.245400+0000","last_fullsized":"2024-03-04T12:35:55.245400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:33:05.241037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:35:55.243486+0000","last_change":"2024-03-04T12:35:54.236078+0000","last_active":"2024-03-04T12:35:55.243486+0000","last_peered":"2024-03-04T12:35:55.243486+0000","last_clean":"2024-03-04T12:35:55.243486+0000","last_became_active":"2024-03-04T12:35:54.235738+0000","last_became_peered":"2024-03-04T12:35:54.235738+0000","last_unstale":"2024-03-04T12:35:55.243486+0000","last_undegraded":"2024-03-04T12:35:55.243486+0000","last_fullsized":"2024-03-04T12:35:55.243486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:36:28.049431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:35:55.242206+0000","last_change":"2024-03-04T12:35:54.238692+0000","last_active":"2024-03-04T12:35:55.242206+0000","last_peered":"2024-03-04T12:35:55.242206+0000","last_clean":"2024-03-04T12:35:55.242206+0000","last_became_active":"2024-03-04T12:35:54.238351+0000","last_became_peered":"2024-03-04T12:35:54.238351+0000","last_unstale":"2024-03-04T12:35:55.242206+0000","last_undegraded":"2024-03-04T12:35:55.242206+0000","last_fullsized":"2024-03-04T12:35:55.242206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:37.144629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:35:55.245411+0000","last_change":"2024-03-04T12:35:54.235102+0000","last_active":"2024-03-04T12:35:55.245411+0000","last_peered":"2024-03-04T12:35:55.245411+0000","last_clean":"2024-03-04T12:35:55.245411+0000","last_became_active":"2024-03-04T12:35:54.234819+0000","last_became_peered":"2024-03-04T12:35:54.234819+0000","last_unstale":"2024-03-04T12:35:55.245411+0000","last_undegraded":"2024-03-04T12:35:55.245411+0000","last_fullsized":"2024-03-04T12:35:55.245411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:40.517488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:35:55.242082+0000","last_change":"2024-03-04T12:35:47.950593+0000","last_active":"2024-03-04T12:35:55.242082+0000","last_peered":"2024-03-04T12:35:55.242082+0000","last_clean":"2024-03-04T12:35:55.242082+0000","last_became_active":"2024-03-04T12:35:47.950213+0000","last_became_peered":"2024-03-04T12:35:47.950213+0000","last_unstale":"2024-03-04T12:35:55.242082+0000","last_undegraded":"2024-03-04T12:35:55.242082+0000","last_fullsized":"2024-03-04T12:35:55.242082+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_clean_scrub_stamp":"2024-03-04T12:35:46.856449+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:52:59.823887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T12:35:58.497 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-04T12:35:58.497 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-04T12:35:58.497 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-04T12:35:58.497 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-04T12:35:58.827 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:35:58.827 INFO:teuthology.orchestra.run.smithi090.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-04T12:35:58.839 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-04T12:35:58.840 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-03-04T12:35:58.851 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-03-04T12:35:58.851 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p /home/ubuntu/cephtest/ca 2024-03-04T12:35:58.878 DEBUG:teuthology.orchestra.run.smithi090:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-03-04T12:36:00.381 INFO:teuthology.orchestra.run.smithi090.stderr:..+.......+..+..........+...+...+..+..........+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+......+....+.........+.....+..........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+...+..........+..+.......+........+......+...............+.+.....+......+...+.+.......................+.+.........+............+...+...........+.........+.......+......+........+.........+...+.........+.+........+....+......+......+........+.+..+..........+........+....+......+..............+...+..........+............+...+...+.....+................+.........+........................+..+.+...+.................+...+...............+....+..+......+.......+...............+......+.....................+..................................................+.............+.....+.+......+.....+...+...+............+......+.+........+.............+..+...+...+.+..................+..+.+............+...+..+................+.....+..........+..+...+......+...............+...+.+..+............+...+..........+........+....+..+...+................+......+...+...+.....+..................+.+...........+.......+...+............+..+.+.....+.........+......+....+.......................+.+.....+.+..............+......+.+........+....+.................+.........+..........+......+...+.....+.+.....+.......+...+...........+....+......+.........+..+....+...+..+...+...+....+...........+.........+....+..+....+...+.....+.......+........+...+..........+.........+.........+............+..+............+.+........................+.....+....+..............+.+...........+...+.......+.....+.........+.+......+.........+...+...........+....+..+....+......+...........+...+.......+..+......+....+.....+..................+.........+...+...+...............+...............+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-04T12:36:02.090 INFO:teuthology.orchestra.run.smithi090.stderr:..+.......+......+...+..+..........+....................+............+.......+...+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+.......+..............+.+...........+...+....+...........+......+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+...............+...+...............+...+....+...+......+..+...............+.........+...+.+.....+.+...+...+..+......+.......+..............+....+.....+....+...............+...............+............+........................+............+..+............+..........+.....+......+....+..............................+.........+.........+............+.....+...+............+.........+.......+..+.......+.....................+...+...............+...............+..+...+.+...+..+.........+............+....+.....+.........+.......+...+..+.............+..+.........................+........+.+...............+........+..................+....+..............+....+.....+.......+...............+...+...+..............+.+...........................+...+..+......+....+........+...+......+.+.....+.......+..+...+......................+...+...+.........+...........+....+......+...............+...+.........+...+.....+.........+...+.........................+.....+.+...........+......+.......+..+...+......+......+....+..+.........+...+.+.................+...+....+......+.....+.+...+...+...+...........+.........+......+......+.......+..+................+..................+..+............+.+..+...+....+...........+..........+.........+..+...+...+....+...+......+.........+..+.+.......................+............+...+.........+.+.....+................+........................+.........+........+..................+....+...+..+................+.....+......+.+........+......+.....................+...+....+.....+.+.........+...........+.+........+.......+......+..+.......+..............+....+...+..+......+.+.....+.+.....+............+.+..+....+...+............+...........+.......+...+..+......+.........+..........+...+.....+......................+...+...+...........+.............+............+...+..+.....................+...+......+.+........+....+..+.............+........+.......+...............+.....+......+.+.........+.................+...+............+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-04T12:36:02.105 INFO:teuthology.orchestra.run.smithi090.stderr:----- 2024-03-04T12:36:02.112 DEBUG:teuthology.orchestra.run.smithi090:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-03-04T12:36:02.200 DEBUG:teuthology.orchestra.run.smithi090:> sudo update-ca-trust 2024-03-04T12:36:03.002 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p /home/ubuntu/cephtest/ca 2024-03-04T12:36:03.030 DEBUG:teuthology.orchestra.run.smithi090:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi090.front.sepia.ceph.com 2024-03-04T12:36:03.292 INFO:teuthology.orchestra.run.smithi090.stderr:.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...........+......+...........+...+...+....+.....+....+.........+...+.........+........+.+.....+...............+....+..+..........+.........+.....+......+....+.........+........+............+.+...........+.+..................+...........+...+...+...+.+...+...+........+....+...+...+.................+...+.......+........+......+.+........+......+.+...+.........+...+..+...+...+.+.....+...............+......+....+...+....................+...+...+....+..+.....................+...+....+........+...+..........+..+..........+..+...+.........+....+......+...+.....+.......+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-04T12:36:03.313 INFO:teuthology.orchestra.run.smithi090.stderr:.+.....+.+.....+.+...+...+..+.+...........+.+..+...+.......+............+...........+..........+..+.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+.+........+..........+......+..............+.......+........+......+....+...+..+...+.......+...+...+.....+.......+........+.......+.........+...+........+.........+.+.........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*............+.....+.+..............+.+.....+.......+..+............+....+.....................+...+...+........+....+...+.....+.......+...........+.........+......+.+...+..+.+........+.+......+..+.+.....+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-04T12:36:03.316 INFO:teuthology.orchestra.run.smithi090.stderr:----- 2024-03-04T12:36:03.318 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:36:03.318 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-03-04T12:36:03.386 DEBUG:teuthology.orchestra.run.smithi090:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-03-04T12:36:03.477 INFO:teuthology.orchestra.run.smithi090.stderr:Certificate request self-signature ok 2024-03-04T12:36:03.477 INFO:teuthology.orchestra.run.smithi090.stderr:subject=CN = smithi090.front.sepia.ceph.com 2024-03-04T12:36:03.485 DEBUG:teuthology.orchestra.run.smithi090:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-03-04T12:36:03.511 DEBUG:teuthology.orchestra.run.smithi090:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-03-04T12:36:03.581 INFO:teuthology.orchestra.run.smithi090.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-03-04T12:36:03.582 DEBUG:teuthology.orchestra.run.smithi090:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-03-04T12:36:03.649 INFO:teuthology.run_tasks:Running task rgw... 2024-03-04T12:36:03.664 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-03-04T12:36:03.664 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-03-04T12:36:03.664 INFO:tasks.rgw:Creating data pools 2024-03-04T12:36:03.664 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-03-04T12:36:03.664 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-03-04T12:36:04.270 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'default.rgw.buckets.data' created 2024-03-04T12:36:04.290 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-03-04T12:36:05.279 INFO:teuthology.orchestra.run.smithi090.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-03-04T12:36:05.306 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-03-04T12:36:06.282 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'default.rgw.buckets.index' created 2024-03-04T12:36:06.303 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-03-04T12:36:07.288 INFO:teuthology.orchestra.run.smithi090.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-03-04T12:36:07.321 DEBUG:tasks.rgw:Pools created 2024-03-04T12:36:07.321 INFO:tasks.rgw:Configuring compression type = random 2024-03-04T12:36:07.321 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-03-04T12:36:07.321 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-03-04T12:36:07.322 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-03-04T12:36:07.428 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:07.428 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:09.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.340+0000 7f6d63be9640 0 -- 172.21.15.90:0/2161293417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a1e3ee6440 msgr2=0x55a1e3ee68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:09.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.343+0000 7f6d643ea640 0 -- 172.21.15.90:0/1751474839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55a1e3ef0b00 msgr2=0x55a1e3ef0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:09.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.347+0000 7f6d67f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:36:09.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.349+0000 7f6d67f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:09.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.349+0000 7f6d67f1f800 20 realm 2024-03-04T12:36:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.349+0000 7f6d67f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:36:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.349+0000 7f6d67f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.349+0000 7f6d67f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.349+0000 7f6d67f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:36:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.349+0000 7f6d67f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:09.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.349+0000 7f6d67f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:36:09.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.350+0000 7f6d67f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:09.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.350+0000 7f6d67f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:36:09.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.351+0000 7f6d67f1f800 20 rados_obj.operate() r=0 bl.length=875 2024-03-04T12:36:09.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.351+0000 7f6d67f1f800 20 searching for the correct realm 2024-03-04T12:36:09.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.363+0000 7f6d67f1f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:36:09.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.363+0000 7f6d67f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:09.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.363+0000 7f6d67f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:09.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.363+0000 7f6d67f1f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:36:09.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.363+0000 7f6d67f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:09.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.363+0000 7f6d67f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:09.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.363+0000 7f6d67f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:36:09.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.363+0000 7f6d67f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:09.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.363+0000 7f6d67f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:36:09.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.364+0000 7f6d67f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:09.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.364+0000 7f6d67f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:36:09.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.365+0000 7f6d67f1f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-04T12:36:09.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.365+0000 7f6d67f1f800 20 zone default found 2024-03-04T12:36:09.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.365+0000 7f6d67f1f800 4 Realm: () 2024-03-04T12:36:09.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.365+0000 7f6d67f1f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:36:09.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.365+0000 7f6d67f1f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:36:09.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.365+0000 7f6d67f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:09.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.365+0000 7f6d67f1f800 20 zonegroup default 2024-03-04T12:36:09.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.365+0000 7f6d67f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:36:09.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.365+0000 7f6d67f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:09.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:09.365+0000 7f6d67f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:11.326+0000 7f6d67f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:11.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:11.326+0000 7f6d67f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:11.327+0000 7f6d67f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:11.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:11.327+0000 7f6d67f1f800 20 started sync module instance, tier type = 2024-03-04T12:36:11.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:11.327+0000 7f6d67f1f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:36:13.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.359+0000 7f6d67f1f800 20 add_watcher() i=0 2024-03-04T12:36:13.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.359+0000 7f6d67f1f800 20 add_watcher() i=1 2024-03-04T12:36:13.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.359+0000 7f6d67f1f800 20 add_watcher() i=2 2024-03-04T12:36:13.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.359+0000 7f6d67f1f800 20 add_watcher() i=3 2024-03-04T12:36:13.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.359+0000 7f6d67f1f800 20 add_watcher() i=4 2024-03-04T12:36:13.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.359+0000 7f6d67f1f800 20 add_watcher() i=5 2024-03-04T12:36:13.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.359+0000 7f6d67f1f800 20 add_watcher() i=6 2024-03-04T12:36:13.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.361+0000 7f6d67f1f800 20 add_watcher() i=7 2024-03-04T12:36:13.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.361+0000 7f6d67f1f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.361+0000 7f6d67f1f800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-03-04T12:36:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.361+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-03-04T12:36:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.361+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.362+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-03-04T12:36:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.362+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-03-04T12:36:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.362+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.362+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-03-04T12:36:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.362+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-03-04T12:36:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.362+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.362+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-03-04T12:36:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.362+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-03-04T12:36:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.362+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.363+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-03-04T12:36:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.363+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-03-04T12:36:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.363+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.364+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-03-04T12:36:13.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.364+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-03-04T12:36:13.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.364+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.364+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-03-04T12:36:13.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.364+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-03-04T12:36:13.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.364+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.364+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-03-04T12:36:13.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.364+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-03-04T12:36:13.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.364+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.365+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-03-04T12:36:13.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.365+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-03-04T12:36:13.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.365+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.365+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-03-04T12:36:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.365+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-03-04T12:36:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.365+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.365+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-03-04T12:36:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.365+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-03-04T12:36:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.365+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.365+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-03-04T12:36:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.365+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-03-04T12:36:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.365+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.366+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-03-04T12:36:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.366+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-03-04T12:36:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.366+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.366+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-03-04T12:36:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.366+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-03-04T12:36:13.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.366+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.367+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-03-04T12:36:13.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.367+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-03-04T12:36:13.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.367+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.367+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-03-04T12:36:13.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.367+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-03-04T12:36:13.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.367+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.367+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-03-04T12:36:13.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.367+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-03-04T12:36:13.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.367+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.367+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-03-04T12:36:13.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.367+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-03-04T12:36:13.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.367+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.368+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-03-04T12:36:13.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.368+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-03-04T12:36:13.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.368+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.368+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-03-04T12:36:13.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.368+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-03-04T12:36:13.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.368+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.368+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-03-04T12:36:13.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.368+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-03-04T12:36:13.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.368+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.368+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.368+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.368+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.369+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.369+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.369+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.369+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.369+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.369+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.370+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.370+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.370+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.370+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-03-04T12:36:13.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.370+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-03-04T12:36:13.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.370+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.370+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-03-04T12:36:13.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.370+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-03-04T12:36:13.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.370+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.370+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-03-04T12:36:13.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.370+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-03-04T12:36:13.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.370+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.371+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-03-04T12:36:13.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.371+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-03-04T12:36:13.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.371+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.371+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.371+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.371+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.371+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.371+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.371+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.372+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.372+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.372+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.372+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.372+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.372+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.372+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-03-04T12:36:13.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.372+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-03-04T12:36:13.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.372+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.373+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-03-04T12:36:13.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.373+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-03-04T12:36:13.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.373+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.373+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-03-04T12:36:13.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.373+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-03-04T12:36:13.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.373+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.373+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-03-04T12:36:13.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.373+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-03-04T12:36:13.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.373+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.373+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-03-04T12:36:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.373+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-03-04T12:36:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.373+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.374+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-03-04T12:36:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.374+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-03-04T12:36:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.374+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.374+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-03-04T12:36:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.374+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-03-04T12:36:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.374+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.374+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-03-04T12:36:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.374+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-03-04T12:36:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.374+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.375+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-03-04T12:36:13.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.375+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-03-04T12:36:13.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.375+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.375+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-03-04T12:36:13.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.375+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-03-04T12:36:13.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.375+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.375+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-03-04T12:36:13.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.375+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-03-04T12:36:13.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.375+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.376+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-03-04T12:36:13.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.376+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-03-04T12:36:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.376+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.376+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-03-04T12:36:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.376+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-03-04T12:36:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.376+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.376+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-03-04T12:36:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.376+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-03-04T12:36:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.376+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.376+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-03-04T12:36:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.376+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-03-04T12:36:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.376+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.377+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-03-04T12:36:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.377+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-03-04T12:36:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.377+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.377+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-03-04T12:36:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.377+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-03-04T12:36:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.377+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.377+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-03-04T12:36:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.377+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-03-04T12:36:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.377+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-03-04T12:36:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-03-04T12:36:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-03-04T12:36:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.378+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.379+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.379+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-03-04T12:36:13.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.379+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.379+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-03-04T12:36:13.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.379+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-03-04T12:36:13.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.379+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.379+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-03-04T12:36:13.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.379+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-03-04T12:36:13.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.379+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.380+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-03-04T12:36:13.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.380+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-03-04T12:36:13.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.380+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.380+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-03-04T12:36:13.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.380+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-03-04T12:36:13.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.380+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.380+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-03-04T12:36:13.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.380+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-03-04T12:36:13.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.380+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-03-04T12:36:13.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-03-04T12:36:13.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-03-04T12:36:13.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-03-04T12:36:13.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-03-04T12:36:13.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-03-04T12:36:13.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.381+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.382+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.382+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.382+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.382+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.382+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.382+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.382+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-03-04T12:36:13.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.382+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-03-04T12:36:13.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.382+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.383+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-03-04T12:36:13.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.383+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-03-04T12:36:13.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.383+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.383+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-03-04T12:36:13.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.383+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-03-04T12:36:13.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.383+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.383+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-03-04T12:36:13.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.383+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-03-04T12:36:13.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.383+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.384+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-03-04T12:36:13.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.384+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-03-04T12:36:13.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.384+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.384+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-03-04T12:36:13.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.384+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-03-04T12:36:13.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.384+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.384+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-03-04T12:36:13.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.384+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-03-04T12:36:13.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.384+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.384+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-03-04T12:36:13.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.384+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-03-04T12:36:13.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-03-04T12:36:13.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.385+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.386+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.386+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.386+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.386+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.386+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.386+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.386+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.386+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.386+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.386+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.386+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.386+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.387+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.387+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.387+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.387+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-03-04T12:36:13.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.387+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-03-04T12:36:13.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.387+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.387+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-03-04T12:36:13.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.387+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-03-04T12:36:13.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.387+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.388+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-03-04T12:36:13.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.388+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-03-04T12:36:13.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.388+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.388+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-03-04T12:36:13.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.388+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-03-04T12:36:13.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.388+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.388+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-03-04T12:36:13.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.388+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-03-04T12:36:13.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.388+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.388+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-03-04T12:36:13.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.388+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-03-04T12:36:13.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.388+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.389+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-03-04T12:36:13.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.389+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-03-04T12:36:13.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.389+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.389+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-03-04T12:36:13.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.389+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-03-04T12:36:13.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.389+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.389+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.389+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.389+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.390+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.390+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.390+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.390+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.390+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.390+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.390+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.390+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.390+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.390+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-03-04T12:36:13.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.390+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-03-04T12:36:13.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.390+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.391+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-03-04T12:36:13.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.391+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-03-04T12:36:13.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.391+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.391+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-03-04T12:36:13.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.391+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-03-04T12:36:13.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.391+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.391+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-03-04T12:36:13.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.391+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-03-04T12:36:13.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.391+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.391+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-03-04T12:36:13.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.391+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-03-04T12:36:13.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.391+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-03-04T12:36:13.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-03-04T12:36:13.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-03-04T12:36:13.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-03-04T12:36:13.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-03-04T12:36:13.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-03-04T12:36:13.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-03-04T12:36:13.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-03-04T12:36:13.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-03-04T12:36:13.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-03-04T12:36:13.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.392+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.393+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-03-04T12:36:13.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.393+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-03-04T12:36:13.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.393+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.393+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-03-04T12:36:13.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.393+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-03-04T12:36:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.393+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.393+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-03-04T12:36:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.393+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-03-04T12:36:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.393+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.393+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-03-04T12:36:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.393+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-03-04T12:36:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.393+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.394+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-03-04T12:36:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.394+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-03-04T12:36:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.394+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.394+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.394+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.394+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.394+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.394+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.394+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.394+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.394+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.394+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.395+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.395+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.395+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.395+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-03-04T12:36:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.395+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-03-04T12:36:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.395+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.395+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-03-04T12:36:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.395+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-03-04T12:36:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.395+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.395+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-03-04T12:36:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.395+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-03-04T12:36:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.395+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.396+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-03-04T12:36:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.396+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-03-04T12:36:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.396+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.396+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-03-04T12:36:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.396+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.396+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.396+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.396+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.396+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.397+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.397+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.397+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.397+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.397+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.397+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.397+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.397+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-03-04T12:36:13.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.397+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.397+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-03-04T12:36:13.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.397+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-03-04T12:36:13.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.397+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.398+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-03-04T12:36:13.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.398+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-03-04T12:36:13.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.398+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.398+0000 7f6d67f1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-03-04T12:36:13.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.398+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-03-04T12:36:13.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.399+0000 7f6d67f1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:36:13.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.403+0000 7f6c15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:13.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.403+0000 7f6d67f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:13.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:13.403+0000 7f6d67f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:16.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.342+0000 7f6d67f1f800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-03-04T12:36:16.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.342+0000 7f6d67f1f800 5 note: GC not initialized 2024-03-04T12:36:16.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.343+0000 7f6c14fe1640 20 reqs_thread_entry: start 2024-03-04T12:36:16.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.343+0000 7f6d67f1f800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:16.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.343+0000 7f6d67f1f800 20 Filter name: none 2024-03-04T12:36:16.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.343+0000 7f6b7e7fc640 20 reqs_thread_entry: start 2024-03-04T12:36:16.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.372+0000 7f6c15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:16.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.375+0000 7f6d67f1f800 20 remove_watcher() i=0 2024-03-04T12:36:16.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.375+0000 7f6d67f1f800 2 removed watcher, disabling cache 2024-03-04T12:36:16.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.376+0000 7f6d67f1f800 20 remove_watcher() i=1 2024-03-04T12:36:16.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.377+0000 7f6d67f1f800 20 remove_watcher() i=2 2024-03-04T12:36:16.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.379+0000 7f6d67f1f800 20 remove_watcher() i=3 2024-03-04T12:36:16.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.380+0000 7f6d67f1f800 20 remove_watcher() i=4 2024-03-04T12:36:16.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.382+0000 7f6d67f1f800 20 remove_watcher() i=5 2024-03-04T12:36:16.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.384+0000 7f6d67f1f800 20 remove_watcher() i=6 2024-03-04T12:36:16.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.386+0000 7f6d67f1f800 20 remove_watcher() i=7 2024-03-04T12:36:16.429 INFO:teuthology.orchestra.run.smithi090.stdout:[] 2024-03-04T12:36:16.429 DEBUG:tasks.util.rgw: json result: [] 2024-03-04T12:36:16.429 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-03-04T12:36:16.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-03-04T12:36:16.430 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-03-04T12:36:16.493 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:16.493 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:16.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.511+0000 7fe6d5013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:16.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.511+0000 7fe6d5013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:16.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.514+0000 7fe5167fc640 20 reqs_thread_entry: start 2024-03-04T12:36:16.535 INFO:teuthology.orchestra.run.smithi090.stdout:{"id":"9ff357d4-34bf-43e3-830f-e9301a1282c1","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-04T12:36:16.535 DEBUG:tasks.util.rgw: json result: {'id': '9ff357d4-34bf-43e3-830f-e9301a1282c1', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-04T12:36:16.535 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-03-04T12:36:16.535 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-03-04T12:36:16.535 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-03-04T12:36:16.588 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:16.588 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:16.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.611+0000 7f344ca44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.612+0000 7f344ca44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.612+0000 7f344ca44800 20 realm 2024-03-04T12:36:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.612+0000 7f344ca44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.612+0000 7f344ca44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.612+0000 7f344ca44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.612+0000 7f344ca44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.613+0000 7f344ca44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.613+0000 7f344ca44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.613+0000 7f344ca44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.613+0000 7f344ca44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.614+0000 7f344ca44800 20 rados_obj.operate() r=0 bl.length=891 2024-03-04T12:36:16.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.614+0000 7f344ca44800 20 searching for the correct realm 2024-03-04T12:36:16.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.618+0000 7f3449d3f640 0 -- 172.21.15.90:0/904064805 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f3440089040 msgr2=0x7f344008a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:16.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.621+0000 7f344ad41640 0 -- 172.21.15.90:0/904064805 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7f3440050030 msgr2=0x7f3440072930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:16.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.625+0000 7f344ca44800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:36:16.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.625+0000 7f344ca44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:16.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.625+0000 7f344ca44800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:16.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.625+0000 7f344ca44800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:36:16.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.625+0000 7f344ca44800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:16.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.625+0000 7f344ca44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:16.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.625+0000 7f344ca44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.625+0000 7f344ca44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.625+0000 7f344ca44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.625+0000 7f344ca44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.625+0000 7f344ca44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 20 rados_obj.operate() r=0 bl.length=398 2024-03-04T12:36:16.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 20 zone default found 2024-03-04T12:36:16.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 4 Realm: () 2024-03-04T12:36:16.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:36:16.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:36:16.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:16.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 20 zonegroup default 2024-03-04T12:36:16.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 20 started sync module instance, tier type = 2024-03-04T12:36:16.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.626+0000 7f344ca44800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:36:16.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.643+0000 7f344ca44800 20 add_watcher() i=0 2024-03-04T12:36:16.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.643+0000 7f344ca44800 20 add_watcher() i=1 2024-03-04T12:36:16.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.643+0000 7f344ca44800 20 add_watcher() i=2 2024-03-04T12:36:16.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.643+0000 7f344ca44800 20 add_watcher() i=3 2024-03-04T12:36:16.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.643+0000 7f344ca44800 20 add_watcher() i=4 2024-03-04T12:36:16.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.644+0000 7f344ca44800 20 add_watcher() i=5 2024-03-04T12:36:16.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.647+0000 7f344ca44800 20 add_watcher() i=6 2024-03-04T12:36:16.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.647+0000 7f344ca44800 20 add_watcher() i=7 2024-03-04T12:36:16.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.647+0000 7f344ca44800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:16.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.649+0000 7f3300fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:16.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.649+0000 7f344ca44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:16.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.649+0000 7f344ca44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:16.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.649+0000 7f344ca44800 5 note: GC not initialized 2024-03-04T12:36:16.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.649+0000 7f327b7fe640 20 reqs_thread_entry: start 2024-03-04T12:36:16.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.649+0000 7f344ca44800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:16.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.649+0000 7f344ca44800 20 Filter name: none 2024-03-04T12:36:16.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.649+0000 7f32797fa640 20 reqs_thread_entry: start 2024-03-04T12:36:16.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.659+0000 7f3300fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:16.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.661+0000 7f344ca44800 20 remove_watcher() i=0 2024-03-04T12:36:16.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.661+0000 7f344ca44800 2 removed watcher, disabling cache 2024-03-04T12:36:16.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.663+0000 7f344ca44800 20 remove_watcher() i=1 2024-03-04T12:36:16.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.664+0000 7f344ca44800 20 remove_watcher() i=2 2024-03-04T12:36:16.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.665+0000 7f344ca44800 20 remove_watcher() i=3 2024-03-04T12:36:16.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.666+0000 7f344ca44800 20 remove_watcher() i=4 2024-03-04T12:36:16.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.667+0000 7f344ca44800 20 remove_watcher() i=5 2024-03-04T12:36:16.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.668+0000 7f344ca44800 20 remove_watcher() i=6 2024-03-04T12:36:16.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.669+0000 7f344ca44800 20 remove_watcher() i=7 2024-03-04T12:36:16.685 INFO:teuthology.orchestra.run.smithi090.stdout:[] 2024-03-04T12:36:16.685 DEBUG:tasks.util.rgw: json result: [] 2024-03-04T12:36:16.685 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-03-04T12:36:16.685 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-03-04T12:36:16.686 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-03-04T12:36:16.744 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:16.744 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:16.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.760+0000 7f009ba12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:16.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.760+0000 7f009ba12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:16.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.763+0000 7eff54ff9640 20 reqs_thread_entry: start 2024-03-04T12:36:16.784 INFO:teuthology.orchestra.run.smithi090.stdout:{"id":"9ff357d4-34bf-43e3-830f-e9301a1282c1","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-04T12:36:16.784 DEBUG:tasks.util.rgw: json result: {'id': '9ff357d4-34bf-43e3-830f-e9301a1282c1', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-04T12:36:16.784 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-03-04T12:36:16.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-03-04T12:36:16.784 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-03-04T12:36:16.837 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:16.837 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.860+0000 7fbc55214800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.861+0000 7fbc55214800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.861+0000 7fbc55214800 20 realm 2024-03-04T12:36:16.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.861+0000 7fbc55214800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.861+0000 7fbc55214800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.861+0000 7fbc55214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:16.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.861+0000 7fbc55214800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.862+0000 7fbc55214800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.862+0000 7fbc55214800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.862+0000 7fbc55214800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.862+0000 7fbc55214800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.863+0000 7fbc55214800 20 rados_obj.operate() r=0 bl.length=891 2024-03-04T12:36:16.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.863+0000 7fbc55214800 20 searching for the correct realm 2024-03-04T12:36:16.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.867+0000 7fbc4815d640 0 -- 172.21.15.90:0/3803301634 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fbc380c2020 msgr2=0x7fbc380997d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:16.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.870+0000 7fbc5115f640 0 -- 172.21.15.90:0/3803301634 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7fbc3805b040 msgr2=0x7fbc380caa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:16.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.874+0000 7fbc55214800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:36:16.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.874+0000 7fbc55214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:16.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.874+0000 7fbc55214800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:16.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.874+0000 7fbc55214800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:36:16.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.874+0000 7fbc55214800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:16.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.874+0000 7fbc55214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:16.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.874+0000 7fbc55214800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.874+0000 7fbc55214800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.874+0000 7fbc55214800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.874+0000 7fbc55214800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.874+0000 7fbc55214800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.875+0000 7fbc55214800 20 rados_obj.operate() r=0 bl.length=398 2024-03-04T12:36:16.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.875+0000 7fbc55214800 20 zone default found 2024-03-04T12:36:16.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.875+0000 7fbc55214800 4 Realm: () 2024-03-04T12:36:16.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.875+0000 7fbc55214800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:36:16.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.875+0000 7fbc55214800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:36:16.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.875+0000 7fbc55214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:16.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.875+0000 7fbc55214800 20 zonegroup default 2024-03-04T12:36:16.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.875+0000 7fbc55214800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.875+0000 7fbc55214800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.875+0000 7fbc55214800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.875+0000 7fbc55214800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.875+0000 7fbc55214800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.876+0000 7fbc55214800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.876+0000 7fbc55214800 20 started sync module instance, tier type = 2024-03-04T12:36:16.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.876+0000 7fbc55214800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:36:16.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.895+0000 7fbc55214800 20 add_watcher() i=0 2024-03-04T12:36:16.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.895+0000 7fbc55214800 20 add_watcher() i=1 2024-03-04T12:36:16.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.895+0000 7fbc55214800 20 add_watcher() i=2 2024-03-04T12:36:16.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.895+0000 7fbc55214800 20 add_watcher() i=3 2024-03-04T12:36:16.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.895+0000 7fbc55214800 20 add_watcher() i=4 2024-03-04T12:36:16.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.895+0000 7fbc55214800 20 add_watcher() i=5 2024-03-04T12:36:16.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.895+0000 7fbc55214800 20 add_watcher() i=6 2024-03-04T12:36:16.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.896+0000 7fbc55214800 20 add_watcher() i=7 2024-03-04T12:36:16.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.896+0000 7fbc55214800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.899+0000 7fbb06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.899+0000 7fbc55214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.899+0000 7fbc55214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.899+0000 7fbc55214800 5 note: GC not initialized 2024-03-04T12:36:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.899+0000 7fbb05fe3640 20 reqs_thread_entry: start 2024-03-04T12:36:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.899+0000 7fbc55214800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.899+0000 7fbc55214800 20 Filter name: none 2024-03-04T12:36:16.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.899+0000 7fba777fe640 20 reqs_thread_entry: start 2024-03-04T12:36:16.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.910+0000 7fbb06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:16.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.912+0000 7fbc55214800 20 remove_watcher() i=0 2024-03-04T12:36:16.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.912+0000 7fbc55214800 2 removed watcher, disabling cache 2024-03-04T12:36:16.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.913+0000 7fbc55214800 20 remove_watcher() i=1 2024-03-04T12:36:16.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.914+0000 7fbc55214800 20 remove_watcher() i=2 2024-03-04T12:36:16.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.915+0000 7fbc55214800 20 remove_watcher() i=3 2024-03-04T12:36:16.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.916+0000 7fbc55214800 20 remove_watcher() i=4 2024-03-04T12:36:16.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.918+0000 7fbc55214800 20 remove_watcher() i=5 2024-03-04T12:36:16.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.921+0000 7fbc55214800 20 remove_watcher() i=6 2024-03-04T12:36:16.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:16.922+0000 7fbc55214800 20 remove_watcher() i=7 2024-03-04T12:36:16.937 INFO:teuthology.orchestra.run.smithi090.stdout:[] 2024-03-04T12:36:16.937 DEBUG:tasks.util.rgw: json result: [] 2024-03-04T12:36:16.937 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-03-04T12:36:16.938 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-03-04T12:36:16.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-03-04T12:36:16.938 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-03-04T12:36:16.997 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:16.997 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:17.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:17.013+0000 7ffadf816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:17.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:17.013+0000 7ffadf816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:17.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:17.016+0000 7ff998ff9640 20 reqs_thread_entry: start 2024-03-04T12:36:17.035 INFO:teuthology.orchestra.run.smithi090.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-03-04T12:36:17.035 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-03-04T12:36:17.036 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-03-04T12:36:17.036 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-03-04T12:36:17.036 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-03-04T12:36:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:17.113+0000 7fb766b31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:17.113+0000 7fb766b31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:17.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:17.116+0000 7fb620ff9640 20 reqs_thread_entry: start 2024-03-04T12:36:17.137 INFO:teuthology.orchestra.run.smithi090.stdout:{"id":"9ff357d4-34bf-43e3-830f-e9301a1282c1","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-04T12:36:17.138 DEBUG:tasks.util.rgw: json result: {'id': '9ff357d4-34bf-43e3-830f-e9301a1282c1', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-04T12:36:17.138 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-03-04T12:36:17.138 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-03-04T12:36:17.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-03-04T12:36:17.138 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-03-04T12:36:17.196 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:17.197 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:17.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:17.213+0000 7fed8cb2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:17.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:17.213+0000 7fed8cb2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:17.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:17.216+0000 7febce7fc640 20 reqs_thread_entry: start 2024-03-04T12:36:17.236 INFO:teuthology.orchestra.run.smithi090.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-03-04T12:36:17.236 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-03-04T12:36:17.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-03-04T12:36:17.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-03-04T12:36:17.237 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-03-04T12:36:17.297 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:17.297 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:17.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:17.315+0000 7ff0b2a24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:17.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:17.315+0000 7ff0b2a24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:36:17.319+0000 7fef2e7fc640 20 reqs_thread_entry: start 2024-03-04T12:36:17.541 INFO:teuthology.orchestra.run.smithi090.stdout:{"id":"9ff357d4-34bf-43e3-830f-e9301a1282c1","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-04T12:36:17.541 DEBUG:tasks.util.rgw: json result: {'id': '9ff357d4-34bf-43e3-830f-e9301a1282c1', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-04T12:36:17.541 INFO:tasks.rgw:Starting rgw... 2024-03-04T12:36:17.541 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-03-04T12:36:17.541 INFO:tasks.rgw:Using beast as radosgw frontend 2024-03-04T12:36:17.542 DEBUG:teuthology.orchestra.run.smithi090:> sudo echo -n https://smithi090.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-03-04T12:36:17.582 INFO:teuthology.orchestra.run.smithi090.stdout:https://smithi090.front.sepia.ceph.com:443 2024-03-04T12:36:17.583 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-03-04T12:36:17.662 DEBUG:teuthology.orchestra.run.smithi090:> sudo keytool -import -alias smithi090.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-03-04T12:36:17.863 INFO:teuthology.orchestra.run.smithi090.stderr:Warning: use -cacerts option to access cacerts keystore 2024-03-04T12:36:18.011 INFO:teuthology.orchestra.run.smithi090.stderr:Certificate was added to keystore 2024-03-04T12:36:18.034 INFO:tasks.rgw.client.0:Restarting daemon 2024-03-04T12:36:18.034 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-03-04T12:36:18.036 INFO:tasks.rgw.client.0:Started 2024-03-04T12:36:18.036 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi090.front.sepia.ceph.com:443/ 2024-03-04T12:36:18.037 DEBUG:teuthology.orchestra.run.smithi090:> curl https://smithi090.front.sepia.ceph.com:443/ 2024-03-04T12:36:18.075 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-04T12:36:18.075 INFO:teuthology.orchestra.run.smithi090.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-04T12:36:18.076 INFO:teuthology.orchestra.run.smithi090.stderr: Dload Upload Total Spent Left Speed 2024-03-04T12:36:18.076 INFO:teuthology.orchestra.run.smithi090.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-04T12:36:18.076 INFO:teuthology.orchestra.run.smithi090.stderr:curl: (7) Failed to connect to smithi090.front.sepia.ceph.com port 443: Connection refused 2024-03-04T12:36:18.506 INFO:tasks.rgw.client.0.smithi090.stdout:2024-03-04T12:36:18.500+0000 7f30f1d01880 -1 ssl_private_key was not found: rgw/cert//default.key 2024-03-04T12:36:19.077 DEBUG:teuthology.orchestra.run.smithi090:> curl https://smithi090.front.sepia.ceph.com:443/ 2024-03-04T12:36:19.108 INFO:teuthology.orchestra.run.smithi090.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-04T12:36:19.108 INFO:teuthology.orchestra.run.smithi090.stderr: Dload Upload Total Spent Left Speed 2024-03-04T12:36:19.178 INFO:teuthology.orchestra.run.smithi090.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 3147 0 --:--:-- --:--:-- --:--:-- 3147 2024-03-04T12:36:19.179 INFO:teuthology.orchestra.run.smithi090.stdout:anonymous 2024-03-04T12:36:19.179 INFO:teuthology.run_tasks:Running task tox... 2024-03-04T12:36:19.190 INFO:tasks.tox:Deploying tox from pip... 2024-03-04T12:36:19.190 DEBUG:teuthology.orchestra.run.smithi090:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-03-04T12:36:21.633 DEBUG:teuthology.orchestra.run.smithi090:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-03-04T12:36:22.175 INFO:teuthology.orchestra.run.smithi090.stdout:Collecting tox==3.15.0 2024-03-04T12:36:22.267 INFO:teuthology.orchestra.run.smithi090.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-03-04T12:36:22.424 INFO:teuthology.orchestra.run.smithi090.stdout:Collecting packaging>=14 2024-03-04T12:36:22.442 INFO:teuthology.orchestra.run.smithi090.stdout: Downloading packaging-23.2-py3-none-any.whl (53 kB) 2024-03-04T12:36:22.720 INFO:teuthology.orchestra.run.smithi090.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-03-04T12:36:22.738 INFO:teuthology.orchestra.run.smithi090.stdout: Downloading virtualenv-20.25.1-py3-none-any.whl (3.8 MB) 2024-03-04T12:36:22.967 INFO:teuthology.orchestra.run.smithi090.stdout:Collecting six<2,>=1.14.0 2024-03-04T12:36:22.984 INFO:teuthology.orchestra.run.smithi090.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-04T12:36:23.087 INFO:teuthology.orchestra.run.smithi090.stdout:Collecting filelock<4,>=3.0.0 2024-03-04T12:36:23.104 INFO:teuthology.orchestra.run.smithi090.stdout: Downloading filelock-3.13.1-py3-none-any.whl (11 kB) 2024-03-04T12:36:23.188 INFO:teuthology.orchestra.run.smithi090.stdout:Collecting pluggy<1,>=0.12.0 2024-03-04T12:36:23.212 INFO:teuthology.orchestra.run.smithi090.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-03-04T12:36:23.308 INFO:teuthology.orchestra.run.smithi090.stdout:Collecting py<2,>=1.4.17 2024-03-04T12:36:23.325 INFO:teuthology.orchestra.run.smithi090.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-03-04T12:36:23.413 INFO:teuthology.orchestra.run.smithi090.stdout:Collecting toml>=0.9.4 2024-03-04T12:36:23.430 INFO:teuthology.orchestra.run.smithi090.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-03-04T12:36:23.551 INFO:teuthology.orchestra.run.smithi090.stdout:Collecting distlib<1,>=0.3.7 2024-03-04T12:36:23.569 INFO:teuthology.orchestra.run.smithi090.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-03-04T12:36:23.680 INFO:teuthology.orchestra.run.smithi090.stdout:Collecting platformdirs<5,>=3.9.1 2024-03-04T12:36:23.697 INFO:teuthology.orchestra.run.smithi090.stdout: Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) 2024-03-04T12:36:23.814 INFO:teuthology.orchestra.run.smithi090.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-03-04T12:36:24.645 INFO:teuthology.orchestra.run.smithi090.stdout:Successfully installed distlib-0.3.8 filelock-3.13.1 packaging-23.2 platformdirs-4.2.0 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.25.1 2024-03-04T12:36:24.868 INFO:teuthology.orchestra.run.smithi090.stderr:WARNING: You are using pip version 21.2.3; however, version 24.0 is available. 2024-03-04T12:36:24.868 INFO:teuthology.orchestra.run.smithi090.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-03-04T12:36:24.930 INFO:teuthology.run_tasks:Running task workunit... 2024-03-04T12:36:25.000 INFO:tasks.workunit:Pulling workunits from ref 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:36:25.001 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-04T12:36:25.001 DEBUG:teuthology.orchestra.run.smithi090:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:36:25.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:36:25.029 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-04T12:36:25.029 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:36:25.097 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-04T12:36:25.097 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-04T12:36:25.169 INFO:tasks.workunit:timeout=3h 2024-03-04T12:36:25.170 INFO:tasks.workunit:cleanup=True 2024-03-04T12:36:25.170 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:36:25.237 INFO:tasks.workunit.client.0.smithi090.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-04T12:37:07.499 INFO:tasks.workunit.client.0.smithi090.stderr:Note: switching to '3aec390336fdfdc8f927818b718cfb0361bd47c8'. 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr:state without impacting any branches by switching back to a branch. 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr: git switch -c 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr:Or undo this operation with: 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:07.500 INFO:tasks.workunit.client.0.smithi090.stderr: git switch - 2024-03-04T12:37:07.501 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:07.501 INFO:tasks.workunit.client.0.smithi090.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-04T12:37:07.501 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:07.501 INFO:tasks.workunit.client.0.smithi090.stderr:HEAD is now at 3aec390336f qa/d4n: Start redis up before rgw 2024-03-04T12:37:07.504 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-04T12:37:07.580 INFO:tasks.workunit.client.0.smithi090.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-04T12:37:07.582 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:37:07.582 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-04T12:37:08.389 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-04T12:37:08.479 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-04T12:37:08.520 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:37:08.522 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:37:08.522 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-04T12:37:08.561 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:37:08.564 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:37:08.564 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-04T12:37:08.632 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-03-04T12:37:08.633 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-03-04T12:37:08.633 DEBUG:teuthology.orchestra.run.smithi090:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-03-04T12:37:08.703 INFO:tasks.workunit.client.0.smithi090.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-03-04T12:37:08.703 INFO:tasks.workunit.client.0.smithi090.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:37:08.703 INFO:tasks.workunit.client.0.smithi090.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:37:11.066 INFO:tasks.workunit.client.0.smithi090.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-03-04T12:37:11.066 INFO:tasks.workunit.client.0.smithi090.stderr:++ deactivate nondestructive 2024-03-04T12:37:11.066 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -n '' ']' 2024-03-04T12:37:11.066 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -n '' ']' 2024-03-04T12:37:11.066 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:37:11.066 INFO:tasks.workunit.client.0.smithi090.stderr:++ hash -r 2024-03-04T12:37:11.066 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -n '' ']' 2024-03-04T12:37:11.066 INFO:tasks.workunit.client.0.smithi090.stderr:++ unset VIRTUAL_ENV 2024-03-04T12:37:11.066 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-03-04T12:37:11.066 INFO:tasks.workunit.client.0.smithi090.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:37:11.066 INFO:tasks.workunit.client.0.smithi090.stderr:++ export VIRTUAL_ENV 2024-03-04T12:37:11.068 INFO:tasks.workunit.client.0.smithi090.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:37:11.068 INFO:tasks.workunit.client.0.smithi090.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:37:11.068 INFO:tasks.workunit.client.0.smithi090.stderr:++ export PATH 2024-03-04T12:37:11.068 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -n '' ']' 2024-03-04T12:37:11.068 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -z '' ']' 2024-03-04T12:37:11.068 INFO:tasks.workunit.client.0.smithi090.stderr:++ _OLD_VIRTUAL_PS1= 2024-03-04T12:37:11.068 INFO:tasks.workunit.client.0.smithi090.stderr:++ PS1='(rgw) ' 2024-03-04T12:37:11.068 INFO:tasks.workunit.client.0.smithi090.stderr:++ export PS1 2024-03-04T12:37:11.068 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:37:11.068 INFO:tasks.workunit.client.0.smithi090.stderr:++ hash -r 2024-03-04T12:37:11.068 INFO:tasks.workunit.client.0.smithi090.stderr:+ pip install pip --upgrade 2024-03-04T12:37:11.294 INFO:tasks.workunit.client.0.smithi090.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-04T12:37:11.498 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting pip 2024-03-04T12:37:11.592 INFO:tasks.workunit.client.0.smithi090.stdout: Downloading pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-04T12:37:11.787 INFO:tasks.workunit.client.0.smithi090.stdout:Installing collected packages: pip 2024-03-04T12:37:11.787 INFO:tasks.workunit.client.0.smithi090.stdout: Attempting uninstall: pip 2024-03-04T12:37:11.787 INFO:tasks.workunit.client.0.smithi090.stdout: Found existing installation: pip 21.2.3 2024-03-04T12:37:11.934 INFO:tasks.workunit.client.0.smithi090.stdout: Uninstalling pip-21.2.3: 2024-03-04T12:37:11.939 INFO:tasks.workunit.client.0.smithi090.stdout: Successfully uninstalled pip-21.2.3 2024-03-04T12:37:12.889 INFO:tasks.workunit.client.0.smithi090.stdout:Successfully installed pip-24.0 2024-03-04T12:37:13.143 INFO:tasks.workunit.client.0.smithi090.stderr:+ pip install boto3 2024-03-04T12:37:14.042 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting boto3 2024-03-04T12:37:14.117 INFO:tasks.workunit.client.0.smithi090.stdout: Downloading boto3-1.34.54-py3-none-any.whl.metadata (6.6 kB) 2024-03-04T12:37:14.769 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting botocore<1.35.0,>=1.34.54 (from boto3) 2024-03-04T12:37:14.786 INFO:tasks.workunit.client.0.smithi090.stdout: Downloading botocore-1.34.54-py3-none-any.whl.metadata (5.7 kB) 2024-03-04T12:37:14.944 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-04T12:37:14.960 INFO:tasks.workunit.client.0.smithi090.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-04T12:37:15.093 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-04T12:37:15.110 INFO:tasks.workunit.client.0.smithi090.stdout: Downloading s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-04T12:37:15.237 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:37:15.254 INFO:tasks.workunit.client.0.smithi090.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-04T12:37:15.422 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:37:15.439 INFO:tasks.workunit.client.0.smithi090.stdout: Downloading urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-03-04T12:37:15.509 INFO:tasks.workunit.client.0.smithi090.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 kB 591.0 kB/s eta 0:00:00 2024-03-04T12:37:15.686 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:37:15.709 INFO:tasks.workunit.client.0.smithi090.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-04T12:37:15.798 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading boto3-1.34.54-py3-none-any.whl (139 kB) 2024-03-04T12:37:15.869 INFO:tasks.workunit.client.0.smithi090.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.3/139.3 kB 1.9 MB/s eta 0:00:00 2024-03-04T12:37:15.888 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading botocore-1.34.54-py3-none-any.whl (12.0 MB) 2024-03-04T12:37:16.305 INFO:tasks.workunit.client.0.smithi090.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.0/12.0 MB 27.8 MB/s eta 0:00:00 2024-03-04T12:37:16.322 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-04T12:37:16.396 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-04T12:37:16.448 INFO:tasks.workunit.client.0.smithi090.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.1/82.1 kB 1.4 MB/s eta 0:00:00 2024-03-04T12:37:16.465 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-04T12:37:16.532 INFO:tasks.workunit.client.0.smithi090.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 229.9/229.9 kB 3.4 MB/s eta 0:00:00 2024-03-04T12:37:16.549 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-03-04T12:37:16.599 INFO:tasks.workunit.client.0.smithi090.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.8/143.8 kB 2.8 MB/s eta 0:00:00 2024-03-04T12:37:16.622 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-04T12:37:16.758 INFO:tasks.workunit.client.0.smithi090.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-04T12:37:17.862 INFO:tasks.workunit.client.0.smithi090.stdout:Successfully installed boto3-1.34.54 botocore-1.34.54 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-03-04T12:37:18.000 INFO:tasks.workunit.client.0.smithi090.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-03-04T12:37:18.131 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-03-04T12:37:18.166 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:18.167 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:18.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.195+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.196+0000 7fb32914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.196+0000 7fb32914b800 20 realm 2024-03-04T12:37:18.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.196+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.196+0000 7fb32914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.196+0000 7fb32914b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:18.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.196+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.196+0000 7fb32914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.196+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.197+0000 7fb32914b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:18.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.197+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.198+0000 7fb32914b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:18.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.198+0000 7fb32914b800 20 searching for the correct realm 2024-03-04T12:37:18.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.200+0000 7fb31ffff640 0 -- 172.21.15.90:0/3448430994 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fb310039b70 msgr2=0x7fb31003f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:18.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.205+0000 7fb326c4e640 0 -- 172.21.15.90:0/3448430994 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fb31005e8f0 msgr2=0x7fb310030400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:18.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.411+0000 7fb32914b800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:18.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.411+0000 7fb32914b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:18.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.411+0000 7fb32914b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:18.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.411+0000 7fb32914b800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:18.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.411+0000 7fb32914b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:18.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.411+0000 7fb32914b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:18.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.411+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.412+0000 7fb32914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.412+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.412+0000 7fb32914b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:18.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.412+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.412+0000 7fb32914b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:18.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.412+0000 7fb32914b800 20 zone default found 2024-03-04T12:37:18.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.412+0000 7fb32914b800 4 Realm: () 2024-03-04T12:37:18.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.412+0000 7fb32914b800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:18.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.412+0000 7fb32914b800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:18.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.412+0000 7fb32914b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:18.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.412+0000 7fb32914b800 20 zonegroup default 2024-03-04T12:37:18.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.412+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.413+0000 7fb32914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.413+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.413+0000 7fb32914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.413+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.413+0000 7fb32914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.413+0000 7fb32914b800 20 started sync module instance, tier type = 2024-03-04T12:37:18.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.413+0000 7fb32914b800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:18.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.432+0000 7fb32914b800 20 add_watcher() i=0 2024-03-04T12:37:18.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.432+0000 7fb32914b800 20 add_watcher() i=1 2024-03-04T12:37:18.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.432+0000 7fb32914b800 20 add_watcher() i=2 2024-03-04T12:37:18.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.432+0000 7fb32914b800 20 add_watcher() i=3 2024-03-04T12:37:18.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.432+0000 7fb32914b800 20 add_watcher() i=4 2024-03-04T12:37:18.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.432+0000 7fb32914b800 20 add_watcher() i=5 2024-03-04T12:37:18.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.433+0000 7fb32914b800 20 add_watcher() i=6 2024-03-04T12:37:18.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.434+0000 7fb32914b800 20 add_watcher() i=7 2024-03-04T12:37:18.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.434+0000 7fb32914b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:18.442 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.436+0000 7fb1dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:18.442 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.436+0000 7fb32914b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:18.442 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.436+0000 7fb32914b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:18.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.436+0000 7fb32914b800 5 note: GC not initialized 2024-03-04T12:37:18.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.436+0000 7fb157fff640 20 reqs_thread_entry: start 2024-03-04T12:37:18.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.436+0000 7fb32914b800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:18.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.436+0000 7fb32914b800 20 Filter name: none 2024-03-04T12:37:18.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.436+0000 7fb155ffb640 20 reqs_thread_entry: start 2024-03-04T12:37:18.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.437+0000 7fb32914b800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-03-04T12:37:18.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.437+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.437+0000 7fb32914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.437+0000 7fb32914b800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-03-04T12:37:18.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.437+0000 7fb32914b800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-04T12:37:18.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.437+0000 7fb32914b800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-03-04T12:37:18.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.437+0000 7fb32914b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.437+0000 7fb32914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.437+0000 7fb32914b800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-03-04T12:37:18.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.437+0000 7fb32914b800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-04T12:37:18.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.437+0000 7fb32914b800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-03-04T12:37:18.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.437+0000 7fb32914b800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-03-04T12:37:18.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.439+0000 7fb32914b800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-03-04T12:37:18.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.439+0000 7fb32914b800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-04T12:37:18.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.439+0000 7fb32914b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-03-04T12:37:18.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.439+0000 7fb20a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94781285148192 notifier 4686 bl.length()=560 2024-03-04T12:37:18.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.439+0000 7fb20a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-03-04T12:37:18.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.439+0000 7fb20a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-04T12:37:18.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.441+0000 7fb32914b800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-03-04T12:37:18.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.441+0000 7fb32914b800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-04T12:37:18.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.441+0000 7fb32914b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-03-04T12:37:18.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.441+0000 7fb20a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94781285137120 notifier 4686 bl.length()=186 2024-03-04T12:37:18.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.441+0000 7fb20a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-03-04T12:37:18.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.441+0000 7fb20a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-04T12:37:18.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.443+0000 7fb1dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:18.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.445+0000 7fb32914b800 20 remove_watcher() i=0 2024-03-04T12:37:18.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.445+0000 7fb32914b800 2 removed watcher, disabling cache 2024-03-04T12:37:18.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.446+0000 7fb32914b800 20 remove_watcher() i=1 2024-03-04T12:37:18.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.447+0000 7fb32914b800 20 remove_watcher() i=2 2024-03-04T12:37:18.454 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.448+0000 7fb32914b800 20 remove_watcher() i=3 2024-03-04T12:37:18.455 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.450+0000 7fb32914b800 20 remove_watcher() i=4 2024-03-04T12:37:18.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.451+0000 7fb32914b800 20 remove_watcher() i=5 2024-03-04T12:37:18.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.452+0000 7fb32914b800 20 remove_watcher() i=6 2024-03-04T12:37:18.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.453+0000 7fb32914b800 20 remove_watcher() i=7 2024-03-04T12:37:18.645 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.645 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.690 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.691 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.736 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.736 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.753 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.753 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.763 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.763 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.766 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.766 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.775 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.775 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.779 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.779 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.783 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.783 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.797 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.797 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.800 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.800 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.813 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.813 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.816 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.816 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.829 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.829 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.833 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.833 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.846 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:18.846 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:18.848 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: recalculated bucket check stats are correct 2024-03-04T12:37:18.848 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:18.849 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-03-04T12:37:18.880 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:18.880 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:18.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.906+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.908+0000 7f58df82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.908+0000 7f58df82e800 20 realm 2024-03-04T12:37:18.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.908+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.908+0000 7f58df82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.908+0000 7f58df82e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:18.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.908+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.908+0000 7f58df82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.908+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.909+0000 7f58df82e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:18.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.909+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.916 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.910+0000 7f58df82e800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:18.916 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.910+0000 7f58df82e800 20 searching for the correct realm 2024-03-04T12:37:18.919 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.913+0000 7f58db331640 0 -- 172.21.15.90:0/3917808527 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x55607b160170 msgr2=0x55607b1625e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:18.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.916+0000 7f58d232f640 0 -- 172.21.15.90:0/3917808527 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f58c407d260 msgr2=0x7f58c405d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:18.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.920+0000 7f58df82e800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:18.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.920+0000 7f58df82e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:18.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.920+0000 7f58df82e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:18.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.920+0000 7f58df82e800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:18.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.920+0000 7f58df82e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:18.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.920+0000 7f58df82e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:18.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.920+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.920+0000 7f58df82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.920+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.921+0000 7f58df82e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.921+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.921+0000 7f58df82e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.921+0000 7f58df82e800 20 zone default found 2024-03-04T12:37:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.921+0000 7f58df82e800 4 Realm: () 2024-03-04T12:37:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.921+0000 7f58df82e800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.921+0000 7f58df82e800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.921+0000 7f58df82e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.921+0000 7f58df82e800 20 zonegroup default 2024-03-04T12:37:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.921+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.921+0000 7f58df82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.921+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.922+0000 7f58df82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.922+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.922+0000 7f58df82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:18.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.922+0000 7f58df82e800 20 started sync module instance, tier type = 2024-03-04T12:37:18.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.922+0000 7f58df82e800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:18.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.934+0000 7f58df82e800 20 add_watcher() i=0 2024-03-04T12:37:18.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.934+0000 7f58df82e800 20 add_watcher() i=1 2024-03-04T12:37:18.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.934+0000 7f58df82e800 20 add_watcher() i=2 2024-03-04T12:37:18.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.934+0000 7f58df82e800 20 add_watcher() i=3 2024-03-04T12:37:18.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.934+0000 7f58df82e800 20 add_watcher() i=4 2024-03-04T12:37:18.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.934+0000 7f58df82e800 20 add_watcher() i=5 2024-03-04T12:37:18.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.934+0000 7f58df82e800 20 add_watcher() i=6 2024-03-04T12:37:18.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.935+0000 7f58df82e800 20 add_watcher() i=7 2024-03-04T12:37:18.941 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.935+0000 7f58df82e800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:18.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.937+0000 7f57917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:18.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.938+0000 7f58df82e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:18.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.938+0000 7f58df82e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:18.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.938+0000 7f58df82e800 5 note: GC not initialized 2024-03-04T12:37:18.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.938+0000 7f570bfff640 20 reqs_thread_entry: start 2024-03-04T12:37:18.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.938+0000 7f58df82e800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:18.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.938+0000 7f58df82e800 20 Filter name: none 2024-03-04T12:37:18.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.938+0000 7f5709ffb640 20 reqs_thread_entry: start 2024-03-04T12:37:18.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.938+0000 7f58df82e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:37:18.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.938+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:18.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:37:18.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 : miss 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 20 rados->read ofs=0 len=0 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 info.flags=0x17 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 to cache LRU end 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.939+0000 7f58df82e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.940+0000 7f58df82e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.940+0000 7f58df82e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.940+0000 7f58df82e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:37:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.940+0000 7f58df82e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:37:18.955 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.949+0000 7f57917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:18.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.952+0000 7f58df82e800 20 remove_watcher() i=0 2024-03-04T12:37:18.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.952+0000 7f58df82e800 2 removed watcher, disabling cache 2024-03-04T12:37:18.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.953+0000 7f58df82e800 20 remove_watcher() i=1 2024-03-04T12:37:18.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.956+0000 7f58df82e800 20 remove_watcher() i=2 2024-03-04T12:37:18.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.957+0000 7f58df82e800 20 remove_watcher() i=3 2024-03-04T12:37:18.964 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.958+0000 7f58df82e800 20 remove_watcher() i=4 2024-03-04T12:37:18.965 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.960+0000 7f58df82e800 20 remove_watcher() i=5 2024-03-04T12:37:18.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.963+0000 7f58df82e800 20 remove_watcher() i=6 2024-03-04T12:37:18.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:18.964+0000 7f58df82e800 20 remove_watcher() i=7 2024-03-04T12:37:18.980 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-03-04T12:37:19.007 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:19.007 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:19.040 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.034+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.041 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.035+0000 7fad0bc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.041 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.035+0000 7fad0bc9d800 20 realm 2024-03-04T12:37:19.041 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.035+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.035+0000 7fad0bc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.035+0000 7fad0bc9d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:19.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.035+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.036+0000 7fad0bc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.036+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.036+0000 7fad0bc9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:19.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.036+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.037+0000 7fad0bc9d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:19.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.037+0000 7fad0bc9d800 20 searching for the correct realm 2024-03-04T12:37:19.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.040+0000 7fad09f9a640 0 -- 172.21.15.90:0/4266228101 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x55b8a154f180 msgr2=0x55b8a1551620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:19.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.043+0000 7fad09799640 0 -- 172.21.15.90:0/4266228101 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fad00052470 msgr2=0x7fad000528f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:19.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.047+0000 7fad0bc9d800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:19.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.047+0000 7fad0bc9d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:19.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.047+0000 7fad0bc9d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:19.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.047+0000 7fad0bc9d800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:19.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.047+0000 7fad0bc9d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:19.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.047+0000 7fad0bc9d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:19.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.047+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.047+0000 7fad0bc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.047+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:19.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:19.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 20 zone default found 2024-03-04T12:37:19.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 4 Realm: () 2024-03-04T12:37:19.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:19.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:19.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:19.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 20 zonegroup default 2024-03-04T12:37:19.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.048+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.049+0000 7fad0bc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.049+0000 7fad0bc9d800 20 started sync module instance, tier type = 2024-03-04T12:37:19.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.049+0000 7fad0bc9d800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:19.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.066+0000 7fad0bc9d800 20 add_watcher() i=0 2024-03-04T12:37:19.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.066+0000 7fad0bc9d800 20 add_watcher() i=1 2024-03-04T12:37:19.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.066+0000 7fad0bc9d800 20 add_watcher() i=2 2024-03-04T12:37:19.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.066+0000 7fad0bc9d800 20 add_watcher() i=3 2024-03-04T12:37:19.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.066+0000 7fad0bc9d800 20 add_watcher() i=4 2024-03-04T12:37:19.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.066+0000 7fad0bc9d800 20 add_watcher() i=5 2024-03-04T12:37:19.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.069+0000 7fad0bc9d800 20 add_watcher() i=6 2024-03-04T12:37:19.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.069+0000 7fad0bc9d800 20 add_watcher() i=7 2024-03-04T12:37:19.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.069+0000 7fad0bc9d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:19.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.071+0000 7fabbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:19.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.071+0000 7fad0bc9d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:19.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.071+0000 7fad0bc9d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:19.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.071+0000 7fad0bc9d800 5 note: GC not initialized 2024-03-04T12:37:19.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.071+0000 7fabbe7e4640 20 reqs_thread_entry: start 2024-03-04T12:37:19.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.072+0000 7fad0bc9d800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:19.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.072+0000 7fad0bc9d800 20 Filter name: none 2024-03-04T12:37:19.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.072+0000 7fab2ffff640 20 reqs_thread_entry: start 2024-03-04T12:37:19.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.072+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.079 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.072+0000 7fad0bc9d800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:19.079 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.072+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.079 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.073+0000 7fad0bc9d800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:19.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.073+0000 7fad0bc9d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:19.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.073+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.073+0000 7fad0bc9d800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:19.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.073+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.073+0000 7fad0bc9d800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:19.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.073+0000 7fad0bc9d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:19.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.074+0000 7fad0bc9d800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.075+0000 7fad0bc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.075+0000 7fabbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:19.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.077+0000 7fad0bc9d800 20 remove_watcher() i=0 2024-03-04T12:37:19.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.077+0000 7fad0bc9d800 2 removed watcher, disabling cache 2024-03-04T12:37:19.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.079+0000 7fad0bc9d800 20 remove_watcher() i=1 2024-03-04T12:37:19.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.082+0000 7fad0bc9d800 20 remove_watcher() i=2 2024-03-04T12:37:19.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.083+0000 7fad0bc9d800 20 remove_watcher() i=3 2024-03-04T12:37:19.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.084+0000 7fad0bc9d800 20 remove_watcher() i=4 2024-03-04T12:37:19.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.086+0000 7fad0bc9d800 20 remove_watcher() i=5 2024-03-04T12:37:19.094 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.089+0000 7fad0bc9d800 20 remove_watcher() i=6 2024-03-04T12:37:19.095 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.090+0000 7fad0bc9d800 20 remove_watcher() i=7 2024-03-04T12:37:19.105 INFO:tasks.workunit.client.0.smithi090.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 91, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-03-04T12:37:19.105 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: bucket check unlinked does not report normal entries 2024-03-04T12:37:19.105 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:19.106 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-04T12:37:19.137 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:19.137 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:19.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.164+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.165+0000 7fa328533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.165+0000 7fa328533800 20 realm 2024-03-04T12:37:19.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.165+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.165+0000 7fa328533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.165+0000 7fa328533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:19.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.165+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.165+0000 7fa328533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.165+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.166+0000 7fa328533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:19.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.166+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.167+0000 7fa328533800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:19.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.167+0000 7fa328533800 20 searching for the correct realm 2024-03-04T12:37:19.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.169+0000 7fa31b9d2640 0 -- 172.21.15.90:0/1598205474 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fa30c017070 msgr2=0x7fa30c060ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:19.179 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.173+0000 7fa3241d3640 0 -- 172.21.15.90:0/1598205474 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fa30c06a200 msgr2=0x7fa30c056310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:19.385 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.379+0000 7fa328533800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:19.385 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.379+0000 7fa328533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:19.385 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.379+0000 7fa328533800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:19.385 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.379+0000 7fa328533800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:19.385 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.379+0000 7fa328533800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:19.385 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.379+0000 7fa328533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:19.385 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.379+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.379+0000 7fa328533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.379+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.380+0000 7fa328533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:19.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.380+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.380+0000 7fa328533800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:19.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.380+0000 7fa328533800 20 zone default found 2024-03-04T12:37:19.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.380+0000 7fa328533800 4 Realm: () 2024-03-04T12:37:19.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.380+0000 7fa328533800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:19.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.380+0000 7fa328533800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:19.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.380+0000 7fa328533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:19.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.380+0000 7fa328533800 20 zonegroup default 2024-03-04T12:37:19.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.380+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.381+0000 7fa328533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.381+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.381+0000 7fa328533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.381+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.381+0000 7fa328533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:19.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.381+0000 7fa328533800 20 started sync module instance, tier type = 2024-03-04T12:37:19.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.381+0000 7fa328533800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:19.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.403+0000 7fa328533800 20 add_watcher() i=0 2024-03-04T12:37:19.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.403+0000 7fa328533800 20 add_watcher() i=1 2024-03-04T12:37:19.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.403+0000 7fa328533800 20 add_watcher() i=2 2024-03-04T12:37:19.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.403+0000 7fa328533800 20 add_watcher() i=3 2024-03-04T12:37:19.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.403+0000 7fa328533800 20 add_watcher() i=4 2024-03-04T12:37:19.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.403+0000 7fa328533800 20 add_watcher() i=5 2024-03-04T12:37:19.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.403+0000 7fa328533800 20 add_watcher() i=6 2024-03-04T12:37:19.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.405+0000 7fa328533800 20 add_watcher() i=7 2024-03-04T12:37:19.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.405+0000 7fa328533800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:19.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.408+0000 7fa1dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.408+0000 7fa328533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.408+0000 7fa328533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.408+0000 7fa328533800 5 note: GC not initialized 2024-03-04T12:37:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.408+0000 7fa1d9fdb640 20 reqs_thread_entry: start 2024-03-04T12:37:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.409+0000 7fa328533800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.409+0000 7fa328533800 20 Filter name: none 2024-03-04T12:37:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.409+0000 7fa14b7fe640 20 reqs_thread_entry: start 2024-03-04T12:37:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.409+0000 7fa328533800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:37:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.409+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.409+0000 7fa328533800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.409+0000 7fa328533800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:37:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.409+0000 7fa328533800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:37:19.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.409+0000 7fa328533800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 : miss 2024-03-04T12:37:19.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.409+0000 7fa328533800 20 rados->read ofs=0 len=0 2024-03-04T12:37:19.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.410+0000 7fa328533800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:19.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.410+0000 7fa328533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 info.flags=0x17 2024-03-04T12:37:19.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.410+0000 7fa328533800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 to cache LRU end 2024-03-04T12:37:19.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.410+0000 7fa328533800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:19.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.410+0000 7fa328533800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:37:19.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.410+0000 7fa328533800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 2024-03-04T12:37:19.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.410+0000 7fa328533800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:19.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.410+0000 7fa328533800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-04T12:37:19.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.410+0000 7fa328533800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:19.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.411+0000 7fa328533800 1 NOTICE: finished shard 1 (0 entries found) 2024-03-04T12:37:19.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.411+0000 7fa328533800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:19.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.411+0000 7fa328533800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-04T12:37:19.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.411+0000 7fa328533800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:19.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.412+0000 7fa328533800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-04T12:37:19.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.412+0000 7fa328533800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:19.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.412+0000 7fa328533800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-04T12:37:19.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.412+0000 7fa328533800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:19.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.413+0000 7fa328533800 1 NOTICE: finished shard 5 (0 entries found) 2024-03-04T12:37:19.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.413+0000 7fa328533800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:19.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.413+0000 7fa328533800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-04T12:37:19.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.413+0000 7fa328533800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:19.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.414+0000 7fa328533800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-04T12:37:19.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.414+0000 7fa328533800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:19.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.414+0000 7fa328533800 1 NOTICE: finished shard 8 (0 entries found) 2024-03-04T12:37:19.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.414+0000 7fa328533800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:19.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.415+0000 7fa328533800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-04T12:37:19.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.415+0000 7fa328533800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:19.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.415+0000 7fa328533800 1 NOTICE: finished shard 10 (0 entries found) 2024-03-04T12:37:19.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.415+0000 7fa328533800 1 NOTICE: finished all shards (0 entries found) 2024-03-04T12:37:19.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.416+0000 7fa1dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:19.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.419+0000 7fa328533800 20 remove_watcher() i=0 2024-03-04T12:37:19.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.419+0000 7fa328533800 2 removed watcher, disabling cache 2024-03-04T12:37:19.427 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.421+0000 7fa328533800 20 remove_watcher() i=1 2024-03-04T12:37:19.430 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.424+0000 7fa328533800 20 remove_watcher() i=2 2024-03-04T12:37:19.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.425+0000 7fa328533800 20 remove_watcher() i=3 2024-03-04T12:37:19.432 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.427+0000 7fa328533800 20 remove_watcher() i=4 2024-03-04T12:37:19.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.427+0000 7fa328533800 20 remove_watcher() i=5 2024-03-04T12:37:19.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.429+0000 7fa328533800 20 remove_watcher() i=6 2024-03-04T12:37:19.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:19.430+0000 7fa328533800 20 remove_watcher() i=7 2024-03-04T12:37:19.447 INFO:tasks.workunit.client.0.smithi090.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-04T12:37:19.830 INFO:tasks.workunit.client.0.smithi090.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-04T12:37:21.213 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:21.213 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:21.265 INFO:tasks.workunit.client.0.smithi090.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:37:21.267 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-04T12:37:21.300 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:21.300 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:21.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.332+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.333+0000 7f9c65d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:21.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.333+0000 7f9c65d2c800 20 realm 2024-03-04T12:37:21.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.333+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.334+0000 7f9c65d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:21.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.334+0000 7f9c65d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:21.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.334+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.334+0000 7f9c65d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:21.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.334+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.335+0000 7f9c65d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:21.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.335+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.542 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.536+0000 7f9c65d2c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:21.542 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.536+0000 7f9c65d2c800 20 searching for the correct realm 2024-03-04T12:37:21.545 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.539+0000 7f9c61260640 0 -- 172.21.15.90:0/3592614046 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f9c58080060 msgr2=0x7f9c580d2280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:21.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.746+0000 7f9c61a61640 0 -- 172.21.15.90:0/3592614046 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f9c58060040 msgr2=0x7f9c58060730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.953+0000 7f9c65d2c800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.953+0000 7f9c65d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.953+0000 7f9c65d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.953+0000 7f9c65d2c800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.953+0000 7f9c65d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.954+0000 7f9c65d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.954+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.954+0000 7f9c65d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.954+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.961 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.954+0000 7f9c65d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.954+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.955+0000 7f9c65d2c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.955+0000 7f9c65d2c800 20 zone default found 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.955+0000 7f9c65d2c800 4 Realm: () 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.955+0000 7f9c65d2c800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.955+0000 7f9c65d2c800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.955+0000 7f9c65d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.955+0000 7f9c65d2c800 20 zonegroup default 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.955+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.955+0000 7f9c65d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.955+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.956+0000 7f9c65d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:21.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.956+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.956+0000 7f9c65d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:21.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.956+0000 7f9c65d2c800 20 started sync module instance, tier type = 2024-03-04T12:37:21.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.956+0000 7f9c65d2c800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:21.974 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.969+0000 7f9c65d2c800 20 add_watcher() i=0 2024-03-04T12:37:21.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.969+0000 7f9c65d2c800 20 add_watcher() i=1 2024-03-04T12:37:21.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.969+0000 7f9c65d2c800 20 add_watcher() i=2 2024-03-04T12:37:21.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.969+0000 7f9c65d2c800 20 add_watcher() i=3 2024-03-04T12:37:21.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.969+0000 7f9c65d2c800 20 add_watcher() i=4 2024-03-04T12:37:21.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.969+0000 7f9c65d2c800 20 add_watcher() i=5 2024-03-04T12:37:21.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.969+0000 7f9c65d2c800 20 add_watcher() i=6 2024-03-04T12:37:21.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.970+0000 7f9c65d2c800 20 add_watcher() i=7 2024-03-04T12:37:21.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.970+0000 7f9c65d2c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:21.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.972+0000 7f9b137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:21.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.972+0000 7f9c65d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:21.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.972+0000 7f9c65d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:21.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.972+0000 7f9c65d2c800 5 note: GC not initialized 2024-03-04T12:37:21.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.973+0000 7f9b127fc640 20 reqs_thread_entry: start 2024-03-04T12:37:21.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.973+0000 7f9c65d2c800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:21.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.973+0000 7f9c65d2c800 20 Filter name: none 2024-03-04T12:37:21.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.973+0000 7f9a83fff640 20 reqs_thread_entry: start 2024-03-04T12:37:21.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.973+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.973+0000 7f9c65d2c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.973+0000 7f9c65d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.974+0000 7f9c65d2c800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.974+0000 7f9c65d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.974+0000 7f9c65d2c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:37:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.974+0000 7f9c65d2c800 20 INFO: main: starting shard=0 2024-03-04T12:37:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.974+0000 7f9c65d2c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.975+0000 7f9c65d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.975+0000 7f9c65d2c800 20 INFO: main: starting shard=1 2024-03-04T12:37:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.975+0000 7f9c65d2c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:21.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.975+0000 7f9c65d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:21.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.975+0000 7f9c65d2c800 20 INFO: main: starting shard=2 2024-03-04T12:37:21.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.975+0000 7f9c65d2c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:21.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.976+0000 7f9c65d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:21.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.976+0000 7f9c65d2c800 20 INFO: main: starting shard=3 2024-03-04T12:37:21.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.976+0000 7f9c65d2c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:21.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.977+0000 7f9c65d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:21.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.977+0000 7f9c65d2c800 20 INFO: main: starting shard=4 2024-03-04T12:37:21.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.977+0000 7f9c65d2c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:21.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.977+0000 7f9c65d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:21.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.977+0000 7f9c65d2c800 20 INFO: main: starting shard=5 2024-03-04T12:37:21.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.977+0000 7f9c65d2c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:21.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.978+0000 7f9c65d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:21.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.978+0000 7f9c65d2c800 20 INFO: main: starting shard=6 2024-03-04T12:37:21.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.978+0000 7f9c65d2c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:21.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.978+0000 7f9c65d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:21.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.978+0000 7f9c65d2c800 20 INFO: main: starting shard=7 2024-03-04T12:37:21.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.978+0000 7f9c65d2c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:21.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.979+0000 7f9c65d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:21.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.979+0000 7f9c65d2c800 20 INFO: main: starting shard=8 2024-03-04T12:37:21.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.979+0000 7f9c65d2c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:21.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.979+0000 7f9c65d2c800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-04T12:37:21.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.979+0000 7f9c65d2c800 20 INFO: main: starting shard=9 2024-03-04T12:37:21.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.979+0000 7f9c65d2c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:21.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.980+0000 7f9c65d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:21.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.980+0000 7f9c65d2c800 20 INFO: main: starting shard=10 2024-03-04T12:37:21.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.980+0000 7f9c65d2c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:21.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.980+0000 7f9c65d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:21.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.980+0000 7f9c65d2c800 20 INFO: main: done 2024-03-04T12:37:21.987 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.981+0000 7f9b137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:21.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.984+0000 7f9c65d2c800 20 remove_watcher() i=0 2024-03-04T12:37:21.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.984+0000 7f9c65d2c800 2 removed watcher, disabling cache 2024-03-04T12:37:21.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.985+0000 7f9c65d2c800 20 remove_watcher() i=1 2024-03-04T12:37:21.993 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.987+0000 7f9c65d2c800 20 remove_watcher() i=2 2024-03-04T12:37:21.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.989+0000 7f9c65d2c800 20 remove_watcher() i=3 2024-03-04T12:37:21.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.990+0000 7f9c65d2c800 20 remove_watcher() i=4 2024-03-04T12:37:21.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.991+0000 7f9c65d2c800 20 remove_watcher() i=5 2024-03-04T12:37:21.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.992+0000 7f9c65d2c800 20 remove_watcher() i=6 2024-03-04T12:37:21.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:21.993+0000 7f9c65d2c800 20 remove_watcher() i=7 2024-03-04T12:37:22.013 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:22.013 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:22.016 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:22.016 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:22.067 INFO:tasks.workunit.client.0.smithi090.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:37:22.068 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-04T12:37:22.099 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:22.099 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:22.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.128+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.131+0000 7f374de14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.131+0000 7f374de14800 20 realm 2024-03-04T12:37:22.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.131+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.131+0000 7f374de14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.131+0000 7f374de14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:22.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.131+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.131+0000 7f374de14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.131+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.132+0000 7f374de14800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:22.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.132+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.133+0000 7f374de14800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:22.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.133+0000 7f374de14800 20 searching for the correct realm 2024-03-04T12:37:22.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.134+0000 7f3749481640 0 -- 172.21.15.90:0/440759540 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f374405c8a0 msgr2=0x7f374405b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:22.345 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.340+0000 7f3740c80640 0 -- 172.21.15.90:0/440759540 >> [v2:172.21.15.90:6817/137526376,v1:172.21.15.90:6819/137526376] conn(0x55b020567620 msgr2=0x55b020569a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:22.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.346+0000 7f374de14800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:22.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.346+0000 7f374de14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:22.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.346+0000 7f374de14800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:22.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.346+0000 7f374de14800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:22.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.346+0000 7f374de14800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:22.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.346+0000 7f374de14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:22.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.346+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.347+0000 7f374de14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.347+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.347+0000 7f374de14800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:22.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.347+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:22.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 20 zone default found 2024-03-04T12:37:22.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 4 Realm: () 2024-03-04T12:37:22.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:22.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:22.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:22.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 20 zonegroup default 2024-03-04T12:37:22.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 20 started sync module instance, tier type = 2024-03-04T12:37:22.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.348+0000 7f374de14800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:22.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.361+0000 7f374de14800 20 add_watcher() i=0 2024-03-04T12:37:22.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.361+0000 7f374de14800 20 add_watcher() i=1 2024-03-04T12:37:22.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.361+0000 7f374de14800 20 add_watcher() i=2 2024-03-04T12:37:22.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.361+0000 7f374de14800 20 add_watcher() i=3 2024-03-04T12:37:22.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.361+0000 7f374de14800 20 add_watcher() i=4 2024-03-04T12:37:22.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.361+0000 7f374de14800 20 add_watcher() i=5 2024-03-04T12:37:22.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.361+0000 7f374de14800 20 add_watcher() i=6 2024-03-04T12:37:22.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.362+0000 7f374de14800 20 add_watcher() i=7 2024-03-04T12:37:22.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.362+0000 7f374de14800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:22.370 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.364+0000 7f35ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:22.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.364+0000 7f374de14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:22.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.364+0000 7f374de14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:22.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.364+0000 7f374de14800 5 note: GC not initialized 2024-03-04T12:37:22.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.365+0000 7f35fe7e4640 20 reqs_thread_entry: start 2024-03-04T12:37:22.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.365+0000 7f374de14800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:22.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.365+0000 7f374de14800 20 Filter name: none 2024-03-04T12:37:22.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.365+0000 7f356ffff640 20 reqs_thread_entry: start 2024-03-04T12:37:22.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.365+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.365+0000 7f374de14800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:22.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.365+0000 7f374de14800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.366+0000 7f374de14800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:22.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.366+0000 7f374de14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:22.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.366+0000 7f374de14800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:37:22.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.366+0000 7f374de14800 20 INFO: main: starting shard=0 2024-03-04T12:37:22.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.366+0000 7f374de14800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:22.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.367+0000 7f374de14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.367+0000 7f374de14800 20 INFO: main: starting shard=1 2024-03-04T12:37:22.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.367+0000 7f374de14800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:22.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.367+0000 7f374de14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.367+0000 7f374de14800 20 INFO: main: starting shard=2 2024-03-04T12:37:22.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.367+0000 7f374de14800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:22.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.368+0000 7f374de14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.368+0000 7f374de14800 20 INFO: main: starting shard=3 2024-03-04T12:37:22.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.368+0000 7f374de14800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:22.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.368+0000 7f374de14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.368+0000 7f374de14800 20 INFO: main: starting shard=4 2024-03-04T12:37:22.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.368+0000 7f374de14800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:22.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.369+0000 7f374de14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.369+0000 7f374de14800 20 INFO: main: starting shard=5 2024-03-04T12:37:22.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.369+0000 7f374de14800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:22.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.369+0000 7f374de14800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-04T12:37:22.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.370+0000 7f374de14800 20 INFO: main: starting shard=6 2024-03-04T12:37:22.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.370+0000 7f374de14800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:22.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.370+0000 7f374de14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.370+0000 7f374de14800 20 INFO: main: starting shard=7 2024-03-04T12:37:22.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.370+0000 7f374de14800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:22.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.370+0000 7f374de14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.370+0000 7f374de14800 20 INFO: main: starting shard=8 2024-03-04T12:37:22.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.370+0000 7f374de14800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:22.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.371+0000 7f374de14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.371+0000 7f374de14800 20 INFO: main: starting shard=9 2024-03-04T12:37:22.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.371+0000 7f374de14800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:22.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.371+0000 7f374de14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.371+0000 7f374de14800 20 INFO: main: starting shard=10 2024-03-04T12:37:22.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.371+0000 7f374de14800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:22.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.372+0000 7f374de14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.372+0000 7f374de14800 20 INFO: main: done 2024-03-04T12:37:22.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.373+0000 7f35ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:22.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.375+0000 7f374de14800 20 remove_watcher() i=0 2024-03-04T12:37:22.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.375+0000 7f374de14800 2 removed watcher, disabling cache 2024-03-04T12:37:22.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.377+0000 7f374de14800 20 remove_watcher() i=1 2024-03-04T12:37:22.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.378+0000 7f374de14800 20 remove_watcher() i=2 2024-03-04T12:37:22.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.380+0000 7f374de14800 20 remove_watcher() i=3 2024-03-04T12:37:22.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.381+0000 7f374de14800 20 remove_watcher() i=4 2024-03-04T12:37:22.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.382+0000 7f374de14800 20 remove_watcher() i=5 2024-03-04T12:37:22.389 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.383+0000 7f374de14800 20 remove_watcher() i=6 2024-03-04T12:37:22.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.384+0000 7f374de14800 20 remove_watcher() i=7 2024-03-04T12:37:22.402 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:22.402 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:22.406 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:22.406 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:22.409 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:22.409 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:22.459 INFO:tasks.workunit.client.0.smithi090.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:37:22.460 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-03-04T12:37:22.490 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:22.490 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:22.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.517+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.518+0000 7f5427f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.518+0000 7f5427f11800 20 realm 2024-03-04T12:37:22.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.518+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.519+0000 7f5427f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.519+0000 7f5427f11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:22.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.519+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.519+0000 7f5427f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.519+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.520+0000 7f5427f11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:22.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.520+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.520+0000 7f5427f11800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:22.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.520+0000 7f5427f11800 20 searching for the correct realm 2024-03-04T12:37:22.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.523+0000 7f5425213640 0 -- 172.21.15.90:0/3628340578 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f541c06c800 msgr2=0x7f541c0695f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:22.532 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.526+0000 7f5425a14640 0 -- 172.21.15.90:0/3628340578 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f541c069b30 msgr2=0x7f541c067a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:22.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.732+0000 7f5427f11800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:22.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.732+0000 7f5427f11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:22.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.732+0000 7f5427f11800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:22.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.732+0000 7f5427f11800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:22.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.732+0000 7f5427f11800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:22.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.732+0000 7f5427f11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:22.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.732+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.732+0000 7f5427f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.732+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.733+0000 7f5427f11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:22.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.733+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.733+0000 7f5427f11800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.733+0000 7f5427f11800 20 zone default found 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.733+0000 7f5427f11800 4 Realm: () 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.733+0000 7f5427f11800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.733+0000 7f5427f11800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.733+0000 7f5427f11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.733+0000 7f5427f11800 20 zonegroup default 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.733+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.733+0000 7f5427f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.733+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.734+0000 7f5427f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.734+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.734+0000 7f5427f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.734+0000 7f5427f11800 20 started sync module instance, tier type = 2024-03-04T12:37:22.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.734+0000 7f5427f11800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:22.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.747+0000 7f5427f11800 20 add_watcher() i=0 2024-03-04T12:37:22.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.747+0000 7f5427f11800 20 add_watcher() i=1 2024-03-04T12:37:22.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.747+0000 7f5427f11800 20 add_watcher() i=2 2024-03-04T12:37:22.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.747+0000 7f5427f11800 20 add_watcher() i=3 2024-03-04T12:37:22.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.747+0000 7f5427f11800 20 add_watcher() i=4 2024-03-04T12:37:22.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.747+0000 7f5427f11800 20 add_watcher() i=5 2024-03-04T12:37:22.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.747+0000 7f5427f11800 20 add_watcher() i=6 2024-03-04T12:37:22.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.748+0000 7f5427f11800 20 add_watcher() i=7 2024-03-04T12:37:22.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.748+0000 7f5427f11800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:22.757 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.751+0000 7f52d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:22.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.752+0000 7f5427f11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:22.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.752+0000 7f5427f11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:22.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.752+0000 7f5427f11800 5 note: GC not initialized 2024-03-04T12:37:22.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.752+0000 7f52d67fc640 20 reqs_thread_entry: start 2024-03-04T12:37:22.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.752+0000 7f5427f11800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:22.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.752+0000 7f5427f11800 20 Filter name: none 2024-03-04T12:37:22.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.752+0000 7f5247fff640 20 reqs_thread_entry: start 2024-03-04T12:37:22.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.752+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.752+0000 7f5427f11800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:22.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.752+0000 7f5427f11800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.753+0000 7f5427f11800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:22.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.753+0000 7f5427f11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:22.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.753+0000 7f5427f11800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:37:22.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.753+0000 7f5427f11800 20 INFO: main: starting shard=0 2024-03-04T12:37:22.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.753+0000 7f5427f11800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:22.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.754+0000 7f5427f11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.754+0000 7f5427f11800 20 INFO: main: starting shard=1 2024-03-04T12:37:22.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.754+0000 7f5427f11800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:22.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.754+0000 7f5427f11800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:37:22.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.754+0000 7f5427f11800 20 INFO: main: starting shard=2 2024-03-04T12:37:22.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.754+0000 7f5427f11800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:22.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.755+0000 7f5427f11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.755+0000 7f5427f11800 20 INFO: main: starting shard=3 2024-03-04T12:37:22.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.755+0000 7f5427f11800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:22.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.755+0000 7f5427f11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.755+0000 7f5427f11800 20 INFO: main: starting shard=4 2024-03-04T12:37:22.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.755+0000 7f5427f11800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:22.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.756+0000 7f5427f11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.756+0000 7f5427f11800 20 INFO: main: starting shard=5 2024-03-04T12:37:22.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.756+0000 7f5427f11800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:22.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.756+0000 7f5427f11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.756+0000 7f5427f11800 20 INFO: main: starting shard=6 2024-03-04T12:37:22.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.756+0000 7f5427f11800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:22.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.757+0000 7f5427f11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.757+0000 7f5427f11800 20 INFO: main: starting shard=7 2024-03-04T12:37:22.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.757+0000 7f5427f11800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:22.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.757+0000 7f5427f11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.757+0000 7f5427f11800 20 INFO: main: starting shard=8 2024-03-04T12:37:22.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.757+0000 7f5427f11800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:22.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.758+0000 7f5427f11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.758+0000 7f5427f11800 20 INFO: main: starting shard=9 2024-03-04T12:37:22.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.758+0000 7f5427f11800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:22.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.758+0000 7f5427f11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.758+0000 7f5427f11800 20 INFO: main: starting shard=10 2024-03-04T12:37:22.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.758+0000 7f5427f11800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:22.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.759+0000 7f5427f11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:22.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.759+0000 7f5427f11800 20 INFO: main: done 2024-03-04T12:37:22.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.759+0000 7f52d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:22.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.762+0000 7f5427f11800 20 remove_watcher() i=0 2024-03-04T12:37:22.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.762+0000 7f5427f11800 2 removed watcher, disabling cache 2024-03-04T12:37:22.769 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.763+0000 7f5427f11800 20 remove_watcher() i=1 2024-03-04T12:37:22.770 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.764+0000 7f5427f11800 20 remove_watcher() i=2 2024-03-04T12:37:22.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.765+0000 7f5427f11800 20 remove_watcher() i=3 2024-03-04T12:37:22.772 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.766+0000 7f5427f11800 20 remove_watcher() i=4 2024-03-04T12:37:22.773 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.767+0000 7f5427f11800 20 remove_watcher() i=5 2024-03-04T12:37:22.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.768+0000 7f5427f11800 20 remove_watcher() i=6 2024-03-04T12:37:22.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.769+0000 7f5427f11800 20 remove_watcher() i=7 2024-03-04T12:37:22.787 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:22.787 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:22.790 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:22.790 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:22.840 INFO:tasks.workunit.client.0.smithi090.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:37:22.841 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-03-04T12:37:22.870 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:22.870 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:22.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.897+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.899+0000 7f9ecd0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.899+0000 7f9ecd0c0800 20 realm 2024-03-04T12:37:22.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.899+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.899+0000 7f9ecd0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.899+0000 7f9ecd0c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:22.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.899+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.899+0000 7f9ecd0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.899+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.900+0000 7f9ecd0c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:22.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.900+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.900+0000 7f9ecd0c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:22.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.900+0000 7f9ecd0c0800 20 searching for the correct realm 2024-03-04T12:37:22.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:22.901+0000 7f9ecabbc640 0 -- 172.21.15.90:0/2964947638 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f9ec4060020 msgr2=0x7f9ec4070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:23.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.107+0000 7f9eca3bb640 0 -- 172.21.15.90:0/2964947638 >> [v2:172.21.15.90:6817/137526376,v1:172.21.15.90:6819/137526376] conn(0x55d2d2874ae0 msgr2=0x55d2d2876ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:23.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.114+0000 7f9ecd0c0800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:23.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.114+0000 7f9ecd0c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:23.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.114+0000 7f9ecd0c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:23.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.114+0000 7f9ecd0c0800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:23.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.114+0000 7f9ecd0c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:23.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.114+0000 7f9ecd0c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:23.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.114+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:23.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:23.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 20 zone default found 2024-03-04T12:37:23.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 4 Realm: () 2024-03-04T12:37:23.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:23.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:23.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:23.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 20 zonegroup default 2024-03-04T12:37:23.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.115+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.116+0000 7f9ecd0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.116+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.116+0000 7f9ecd0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.116+0000 7f9ecd0c0800 20 started sync module instance, tier type = 2024-03-04T12:37:23.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.116+0000 7f9ecd0c0800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:23.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.138+0000 7f9ecd0c0800 20 add_watcher() i=0 2024-03-04T12:37:23.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.138+0000 7f9ecd0c0800 20 add_watcher() i=1 2024-03-04T12:37:23.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.138+0000 7f9ecd0c0800 20 add_watcher() i=2 2024-03-04T12:37:23.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.138+0000 7f9ecd0c0800 20 add_watcher() i=3 2024-03-04T12:37:23.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.138+0000 7f9ecd0c0800 20 add_watcher() i=4 2024-03-04T12:37:23.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.138+0000 7f9ecd0c0800 20 add_watcher() i=5 2024-03-04T12:37:23.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.140+0000 7f9ecd0c0800 20 add_watcher() i=6 2024-03-04T12:37:23.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.140+0000 7f9ecd0c0800 20 add_watcher() i=7 2024-03-04T12:37:23.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.140+0000 7f9ecd0c0800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:23.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.142+0000 7f9d817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:23.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.142+0000 7f9ecd0c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:23.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.142+0000 7f9ecd0c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:23.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.142+0000 7f9ecd0c0800 5 note: GC not initialized 2024-03-04T12:37:23.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.142+0000 7f9cfbfff640 20 reqs_thread_entry: start 2024-03-04T12:37:23.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.142+0000 7f9ecd0c0800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:23.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.142+0000 7f9ecd0c0800 20 Filter name: none 2024-03-04T12:37:23.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.142+0000 7f9cf9ffb640 20 reqs_thread_entry: start 2024-03-04T12:37:23.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.142+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.143+0000 7f9ecd0c0800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:23.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.143+0000 7f9ecd0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.143+0000 7f9ecd0c0800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:23.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.143+0000 7f9ecd0c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:23.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.143+0000 7f9ecd0c0800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:37:23.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.143+0000 7f9ecd0c0800 20 INFO: main: starting shard=0 2024-03-04T12:37:23.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.143+0000 7f9ecd0c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:23.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.144+0000 7f9ecd0c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:23.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.144+0000 7f9ecd0c0800 20 INFO: main: starting shard=1 2024-03-04T12:37:23.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.144+0000 7f9ecd0c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:23.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.144+0000 7f9ecd0c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:23.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.144+0000 7f9ecd0c0800 20 INFO: main: starting shard=2 2024-03-04T12:37:23.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.144+0000 7f9ecd0c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:23.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.145+0000 7f9ecd0c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:23.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.145+0000 7f9ecd0c0800 20 INFO: main: starting shard=3 2024-03-04T12:37:23.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.145+0000 7f9ecd0c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:23.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.145+0000 7f9ecd0c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:23.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.145+0000 7f9ecd0c0800 20 INFO: main: starting shard=4 2024-03-04T12:37:23.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.145+0000 7f9ecd0c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:23.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.146+0000 7f9ecd0c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:23.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.146+0000 7f9ecd0c0800 20 INFO: main: starting shard=5 2024-03-04T12:37:23.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.146+0000 7f9ecd0c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:23.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.146+0000 7f9ecd0c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:23.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.146+0000 7f9ecd0c0800 20 INFO: main: starting shard=6 2024-03-04T12:37:23.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.146+0000 7f9ecd0c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:23.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.147+0000 7f9ecd0c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:23.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.147+0000 7f9ecd0c0800 20 INFO: main: starting shard=7 2024-03-04T12:37:23.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.147+0000 7f9ecd0c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:23.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.147+0000 7f9ecd0c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:23.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.147+0000 7f9ecd0c0800 20 INFO: main: starting shard=8 2024-03-04T12:37:23.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.147+0000 7f9ecd0c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:23.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.148+0000 7f9ecd0c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:23.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.148+0000 7f9ecd0c0800 20 INFO: main: starting shard=9 2024-03-04T12:37:23.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.148+0000 7f9ecd0c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:23.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.148+0000 7f9ecd0c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:23.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.148+0000 7f9ecd0c0800 20 INFO: main: starting shard=10 2024-03-04T12:37:23.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.148+0000 7f9ecd0c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:23.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.149+0000 7f9ecd0c0800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:37:23.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.149+0000 7f9ecd0c0800 20 INFO: main: done 2024-03-04T12:37:23.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.149+0000 7f9d817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:23.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.152+0000 7f9ecd0c0800 20 remove_watcher() i=0 2024-03-04T12:37:23.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.152+0000 7f9ecd0c0800 2 removed watcher, disabling cache 2024-03-04T12:37:23.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.154+0000 7f9ecd0c0800 20 remove_watcher() i=1 2024-03-04T12:37:23.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.156+0000 7f9ecd0c0800 20 remove_watcher() i=2 2024-03-04T12:37:23.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.157+0000 7f9ecd0c0800 20 remove_watcher() i=3 2024-03-04T12:37:23.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.159+0000 7f9ecd0c0800 20 remove_watcher() i=4 2024-03-04T12:37:23.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.160+0000 7f9ecd0c0800 20 remove_watcher() i=5 2024-03-04T12:37:23.168 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.162+0000 7f9ecd0c0800 20 remove_watcher() i=6 2024-03-04T12:37:23.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:23.163+0000 7f9ecd0c0800 20 remove_watcher() i=7 2024-03-04T12:37:23.180 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:23.180 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:23.184 INFO:tasks.workunit.client.0.smithi090.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-04T12:37:23.573 INFO:tasks.workunit.client.0.smithi090.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-04T12:37:23.954 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: bucket check unlinked finds unlistable entries 2024-03-04T12:37:23.954 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:23.955 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-04T12:37:23.986 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:23.986 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:24.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.013+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.014+0000 7ff1c568c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.014+0000 7ff1c568c800 20 realm 2024-03-04T12:37:24.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.014+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.014+0000 7ff1c568c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.014+0000 7ff1c568c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:24.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.014+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.014+0000 7ff1c568c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.014+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.015+0000 7ff1c568c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:24.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.015+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.016+0000 7ff1c568c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:24.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.016+0000 7ff1c568c800 20 searching for the correct realm 2024-03-04T12:37:24.025 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.019+0000 7ff1c3989640 0 -- 172.21.15.90:0/2238620034 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x560303c566b0 msgr2=0x560303c58b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:24.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.022+0000 7ff1c3188640 0 -- 172.21.15.90:0/2238620034 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7ff1ac089790 msgr2=0x7ff1ac023620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:24.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.027+0000 7ff1c568c800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:24.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.027+0000 7ff1c568c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:24.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.027+0000 7ff1c568c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:24.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.027+0000 7ff1c568c800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:24.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.027+0000 7ff1c568c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:24.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.027+0000 7ff1c568c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:24.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.027+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.027+0000 7ff1c568c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.027+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:24.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:24.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 20 zone default found 2024-03-04T12:37:24.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 4 Realm: () 2024-03-04T12:37:24.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:24.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:24.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:24.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 20 zonegroup default 2024-03-04T12:37:24.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.028+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.029+0000 7ff1c568c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.029+0000 7ff1c568c800 20 started sync module instance, tier type = 2024-03-04T12:37:24.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.029+0000 7ff1c568c800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:24.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.045+0000 7ff1c568c800 20 add_watcher() i=0 2024-03-04T12:37:24.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.045+0000 7ff1c568c800 20 add_watcher() i=1 2024-03-04T12:37:24.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.045+0000 7ff1c568c800 20 add_watcher() i=2 2024-03-04T12:37:24.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.045+0000 7ff1c568c800 20 add_watcher() i=3 2024-03-04T12:37:24.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.045+0000 7ff1c568c800 20 add_watcher() i=4 2024-03-04T12:37:24.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.045+0000 7ff1c568c800 20 add_watcher() i=5 2024-03-04T12:37:24.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.045+0000 7ff1c568c800 20 add_watcher() i=6 2024-03-04T12:37:24.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.046+0000 7ff1c568c800 20 add_watcher() i=7 2024-03-04T12:37:24.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.046+0000 7ff1c568c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:24.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.048+0000 7ff079fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.048+0000 7ff1c568c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.048+0000 7ff1c568c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.048+0000 7ff1c568c800 5 note: GC not initialized 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.048+0000 7ff078fe1640 20 reqs_thread_entry: start 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.048+0000 7ff1c568c800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.048+0000 7ff1c568c800 20 Filter name: none 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.048+0000 7feff27fc640 20 reqs_thread_entry: start 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.048+0000 7ff1c568c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.048+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.049+0000 7ff1c568c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.049+0000 7ff1c568c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.049+0000 7ff1c568c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.049+0000 7ff1c568c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 : miss 2024-03-04T12:37:24.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.049+0000 7ff1c568c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.049+0000 7ff1c568c800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:24.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.049+0000 7ff1c568c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 info.flags=0x17 2024-03-04T12:37:24.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.049+0000 7ff1c568c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 to cache LRU end 2024-03-04T12:37:24.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.049+0000 7ff1c568c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:24.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.049+0000 7ff1c568c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:37:24.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.049+0000 7ff1c568c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 2024-03-04T12:37:24.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.049+0000 7ff1c568c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:24.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.050+0000 7ff1c568c800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-04T12:37:24.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.050+0000 7ff1c568c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:24.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.051+0000 7ff1c568c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:24.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.051+0000 7ff1c568c800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-04T12:37:24.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.051+0000 7ff1c568c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:24.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.052+0000 7ff1c568c800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-04T12:37:24.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.052+0000 7ff1c568c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:24.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.052+0000 7ff1c568c800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-04T12:37:24.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.052+0000 7ff1c568c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:24.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.053+0000 7ff1c568c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:24.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.053+0000 7ff1c568c800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-04T12:37:24.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.053+0000 7ff1c568c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:24.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.053+0000 7ff1c568c800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-04T12:37:24.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.053+0000 7ff1c568c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:24.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.054+0000 7ff1c568c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:24.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.054+0000 7ff1c568c800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-04T12:37:24.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.054+0000 7ff1c568c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:24.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.055+0000 7ff1c568c800 1 NOTICE: finished shard 1 (1 entries found) 2024-03-04T12:37:24.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.055+0000 7ff1c568c800 1 NOTICE: finished shard 5 (1 entries found) 2024-03-04T12:37:24.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.055+0000 7ff1c568c800 1 NOTICE: finished shard 8 (1 entries found) 2024-03-04T12:37:24.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.055+0000 7ff1c568c800 1 NOTICE: finished shard 10 (1 entries found) 2024-03-04T12:37:24.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.055+0000 7ff1c568c800 1 NOTICE: finished all shards (4 entries found) 2024-03-04T12:37:24.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.056+0000 7ff079fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:24.064 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.058+0000 7ff1c568c800 20 remove_watcher() i=0 2024-03-04T12:37:24.064 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.058+0000 7ff1c568c800 2 removed watcher, disabling cache 2024-03-04T12:37:24.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.060+0000 7ff1c568c800 20 remove_watcher() i=1 2024-03-04T12:37:24.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.061+0000 7ff1c568c800 20 remove_watcher() i=2 2024-03-04T12:37:24.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.063+0000 7ff1c568c800 20 remove_watcher() i=3 2024-03-04T12:37:24.069 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.064+0000 7ff1c568c800 20 remove_watcher() i=4 2024-03-04T12:37:24.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.065+0000 7ff1c568c800 20 remove_watcher() i=5 2024-03-04T12:37:24.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.066+0000 7ff1c568c800 20 remove_watcher() i=6 2024-03-04T12:37:24.073 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.067+0000 7ff1c568c800 20 remove_watcher() i=7 2024-03-04T12:37:24.082 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: unlinked entries are not listable 2024-03-04T12:37:24.083 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:24.085 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:24.085 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:24.091 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-03-04T12:37:24.091 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:24.093 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:24.093 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:24.137 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:24.137 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:24.180 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-03-04T12:37:24.180 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:24.181 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-04T12:37:24.215 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:24.215 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:24.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.242+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.243+0000 7f31e9644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.244+0000 7f31e9644800 20 realm 2024-03-04T12:37:24.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.244+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.244+0000 7f31e9644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.244+0000 7f31e9644800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:24.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.244+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.244+0000 7f31e9644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.244+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.245+0000 7f31e9644800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:24.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.245+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.245+0000 7f31e9644800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:24.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.245+0000 7f31e9644800 20 searching for the correct realm 2024-03-04T12:37:24.255 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.249+0000 7f31e7941640 0 -- 172.21.15.90:0/2985410085 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7f31d007e6f0 msgr2=0x7f31d00a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:24.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.456+0000 7f31e7140640 0 -- 172.21.15.90:0/2985410085 >> [v2:172.21.15.184:6824/1880219084,v1:172.21.15.184:6825/1880219084] conn(0x561c6d1b9a20 msgr2=0x561c6d1bbe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:24.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.458+0000 7f31e9644800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:24.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.458+0000 7f31e9644800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:24.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.458+0000 7f31e9644800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:24.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.458+0000 7f31e9644800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:24.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.458+0000 7f31e9644800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:24.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.458+0000 7f31e9644800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:24.465 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.458+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.465 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.458+0000 7f31e9644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.465 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.458+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.459+0000 7f31e9644800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:24.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.459+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.459+0000 7f31e9644800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:24.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.459+0000 7f31e9644800 20 zone default found 2024-03-04T12:37:24.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.459+0000 7f31e9644800 4 Realm: () 2024-03-04T12:37:24.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.459+0000 7f31e9644800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:24.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.459+0000 7f31e9644800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:24.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.459+0000 7f31e9644800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:24.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.459+0000 7f31e9644800 20 zonegroup default 2024-03-04T12:37:24.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.459+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.459+0000 7f31e9644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.459+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.460+0000 7f31e9644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.460+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.460+0000 7f31e9644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.460+0000 7f31e9644800 20 started sync module instance, tier type = 2024-03-04T12:37:24.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.460+0000 7f31e9644800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:24.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.475+0000 7f31e9644800 20 add_watcher() i=0 2024-03-04T12:37:24.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.475+0000 7f31e9644800 20 add_watcher() i=1 2024-03-04T12:37:24.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.475+0000 7f31e9644800 20 add_watcher() i=2 2024-03-04T12:37:24.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.475+0000 7f31e9644800 20 add_watcher() i=3 2024-03-04T12:37:24.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.475+0000 7f31e9644800 20 add_watcher() i=4 2024-03-04T12:37:24.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.475+0000 7f31e9644800 20 add_watcher() i=5 2024-03-04T12:37:24.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.475+0000 7f31e9644800 20 add_watcher() i=6 2024-03-04T12:37:24.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.476+0000 7f31e9644800 20 add_watcher() i=7 2024-03-04T12:37:24.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.476+0000 7f31e9644800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:24.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.478+0000 7f309dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:24.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.478+0000 7f31e9644800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:24.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.478+0000 7f31e9644800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:24.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.478+0000 7f31e9644800 5 note: GC not initialized 2024-03-04T12:37:24.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.478+0000 7f309cfe1640 20 reqs_thread_entry: start 2024-03-04T12:37:24.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.478+0000 7f31e9644800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:24.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.479+0000 7f31e9644800 20 Filter name: none 2024-03-04T12:37:24.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.479+0000 7f30167fc640 20 reqs_thread_entry: start 2024-03-04T12:37:24.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.479+0000 7f31e9644800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:37:24.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.479+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.479+0000 7f31e9644800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:24.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.479+0000 7f31e9644800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:37:24.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.479+0000 7f31e9644800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:37:24.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.479+0000 7f31e9644800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 : miss 2024-03-04T12:37:24.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.479+0000 7f31e9644800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.480+0000 7f31e9644800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:24.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.480+0000 7f31e9644800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 info.flags=0x17 2024-03-04T12:37:24.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.480+0000 7f31e9644800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 to cache LRU end 2024-03-04T12:37:24.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.480+0000 7f31e9644800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:24.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.480+0000 7f31e9644800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:37:24.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.480+0000 7f31e9644800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 2024-03-04T12:37:24.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.480+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:24.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.480+0000 7f31e9644800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-04T12:37:24.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.480+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:24.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.481+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:24.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.481+0000 7f31e9644800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-04T12:37:24.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.481+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:24.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.482+0000 7f31e9644800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-04T12:37:24.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.482+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:24.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.482+0000 7f31e9644800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-04T12:37:24.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.482+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:24.489 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.483+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:24.489 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.483+0000 7f31e9644800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-04T12:37:24.489 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.483+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:24.489 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.484+0000 7f31e9644800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-04T12:37:24.489 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.484+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:24.490 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.484+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:24.490 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.484+0000 7f31e9644800 1 NOTICE: finished shard 9 (0 entries removed) 2024-03-04T12:37:24.490 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.484+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:24.491 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.485+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:24.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.485+0000 7f31e9644800 20 get_obj_state: octx=0x561c6cf51a40 obj=check-bucket:e state=0x561c6d1f14d8 s->prefetch_data=0 2024-03-04T12:37:24.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.485+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:24.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 get_obj_state: octx=0x561c6cf51c20 obj=check-bucket:d state=0x561c6d1f5df8 s->prefetch_data=0 2024-03-04T12:37:24.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:24.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 get_obj_state: octx=0x561c6d1fa400 obj=check-bucket:c state=0x561c6d28e6c8 s->prefetch_data=0 2024-03-04T12:37:24.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:24.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 get_obj_state: octx=0x561c6d1f05e0 obj=check-bucket:f state=0x561c6d28f228 s->prefetch_data=0 2024-03-04T12:37:24.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 get_obj_state: setting s->obj_tag to p4i4tksjecrb2jwza73q48hirbyb00j0 2024-03-04T12:37:24.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 get_obj_state_impl: setting s->olh_tag to pwzoufq0q1l9u9isbcm6sncorht0to1b 2024-03-04T12:37:24.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pwzoufq0q1l9u9isbcm6sncorht0to1b 2024-03-04T12:37:24.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 get_obj_state: setting s->obj_tag to 3v9bd4hlwa9fb30alku7mmv61mohfgvo 2024-03-04T12:37:24.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 get_obj_state_impl: setting s->olh_tag to 4hcgxhng6c96zb8o0eokc0x6sh8pfmuq 2024-03-04T12:37:24.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4hcgxhng6c96zb8o0eokc0x6sh8pfmuq 2024-03-04T12:37:24.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 get_obj_state: setting s->obj_tag to 5gtusvx3cqs41qqgly3hrf2hbyzp4vty 2024-03-04T12:37:24.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 get_obj_state_impl: setting s->olh_tag to 8fvg1imilijf3kbglbahbg6gypkewyso 2024-03-04T12:37:24.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.486+0000 7f31e9644800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8fvg1imilijf3kbglbahbg6gypkewyso 2024-03-04T12:37:24.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.487+0000 7f31e9644800 20 get_obj_state: setting s->obj_tag to t2kgmpm65xxld3r7udcbivihi2j3r7hj 2024-03-04T12:37:24.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.487+0000 7f31e9644800 20 get_obj_state_impl: setting s->olh_tag to 0g1ahczt0mrc3y0fvujttjg93gjc2lpi 2024-03-04T12:37:24.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.487+0000 7f31e9644800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0g1ahczt0mrc3y0fvujttjg93gjc2lpi 2024-03-04T12:37:24.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.488+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:24.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.488+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:24.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.488+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:24.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.489+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:24.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.490+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:24.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.490+0000 7f31e9644800 20 olh_log_entry: epoch=3 op=3 key=d[EMb5ZSdQKnaHf67LKCh5R0YmNZJXsIA] 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.490+0000 7f31e9644800 20 get_obj_state: octx=0x561c6cf51c20 obj=check-bucket:_:EMb5ZSdQKnaHf67LKCh5R0YmNZJXsIA_d state=0x561c6d291da8 s->prefetch_data=0 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.490+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.490+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 10 manifest: total_size = 9 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16705934943534338560 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 get_obj_state: octx=0x561c6cf51c20 obj=check-bucket:_:EMb5ZSdQKnaHf67LKCh5R0YmNZJXsIA_d state=0x561c6d291da8 s->prefetch_data=0 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 prepare_atomic_modification: state is not atomic. state=0x561c6d291da8 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 olh_log_entry: epoch=2 op=3 key=e[FtKpYeBm4n.9DBT.FebxL3BRJLsLIEd] 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 get_obj_state: octx=0x561c6cf51a40 obj=check-bucket:_:FtKpYeBm4n.9DBT.FebxL3BRJLsLIEd_e state=0x561c6d2ad298 s->prefetch_data=0 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 olh_log_entry: epoch=3 op=3 key=c[BmW3n28ESI0YdFxSoEUSZodzwuLfrIa] 2024-03-04T12:37:24.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 get_obj_state: octx=0x561c6d1fa400 obj=check-bucket:_:BmW3n28ESI0YdFxSoEUSZodzwuLfrIa_c state=0x561c6d2b4308 s->prefetch_data=0 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 olh_log_entry: epoch=2 op=3 key=f[d4AQzF1ibmvBKJkl5Vc2NgEhedgjqEf] 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 get_obj_state: octx=0x561c6d1f05e0 obj=check-bucket:_:d4AQzF1ibmvBKJkl5Vc2NgEhedgjqEf_f state=0x561c6d2badc8 s->prefetch_data=0 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 10 manifest: total_size = 9 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8889077837589931744 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 get_obj_state: octx=0x561c6cf51a40 obj=check-bucket:_:FtKpYeBm4n.9DBT.FebxL3BRJLsLIEd_e state=0x561c6d2ad298 s->prefetch_data=0 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 prepare_atomic_modification: state is not atomic. state=0x561c6d2ad298 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 10 manifest: total_size = 9 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3633189583220620293 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 get_obj_state: octx=0x561c6d1fa400 obj=check-bucket:_:BmW3n28ESI0YdFxSoEUSZodzwuLfrIa_c state=0x561c6d2b4308 s->prefetch_data=0 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 prepare_atomic_modification: state is not atomic. state=0x561c6d2b4308 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 10 manifest: total_size = 22 2024-03-04T12:37:24.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13042634893532780049 2024-03-04T12:37:24.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 get_obj_state: octx=0x561c6d1f05e0 obj=check-bucket:_:d4AQzF1ibmvBKJkl5Vc2NgEhedgjqEf_f state=0x561c6d2badc8 s->prefetch_data=0 2024-03-04T12:37:24.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 prepare_atomic_modification: state is not atomic. state=0x561c6d2badc8 2024-03-04T12:37:24.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.491+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:24.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.494+0000 7f31e9644800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:37:24.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.494+0000 7f31e9644800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-03-04T12:37:24.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.494+0000 7f31e9644800 0 deleting objects inline since gc isn't initialized 2024-03-04T12:37:24.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.494+0000 7f31e9644800 5 delete_objs_inline: removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1__shadow:EMb5ZSdQKnaHf67LKCh5R0YmNZJXsIA_.FsFG2dlZBIvc1_pqBcCvwhWQrh6F_fK_0 2024-03-04T12:37:24.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.495+0000 7f31e9644800 5 delete_objs_inline: refcount put returned error -2 2024-03-04T12:37:24.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.495+0000 7f31e9644800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:37:24.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.495+0000 7f31e9644800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-03-04T12:37:24.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.495+0000 7f31e9644800 0 deleting objects inline since gc isn't initialized 2024-03-04T12:37:24.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.495+0000 7f31e9644800 5 delete_objs_inline: removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1__shadow:FtKpYeBm4n.9DBT.FebxL3BRJLsLIEd_.0-MS-ZUbYBq9InQJ5mVlkP-JM6ITGwk_0 2024-03-04T12:37:24.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.496+0000 7f30caffd640 20 handle_completion(): completion ok for obj=d[EMb5ZSdQKnaHf67LKCh5R0YmNZJXsIA] 2024-03-04T12:37:24.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.497+0000 7f30ca7fc640 20 handle_completion(): completion ok for obj=e[FtKpYeBm4n.9DBT.FebxL3BRJLsLIEd] 2024-03-04T12:37:24.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.497+0000 7f31e9644800 5 delete_objs_inline: refcount put returned error -2 2024-03-04T12:37:24.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.497+0000 7f31e9644800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:37:24.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.497+0000 7f31e9644800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-03-04T12:37:24.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.497+0000 7f31e9644800 0 deleting objects inline since gc isn't initialized 2024-03-04T12:37:24.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.497+0000 7f31e9644800 5 delete_objs_inline: removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1__shadow:BmW3n28ESI0YdFxSoEUSZodzwuLfrIa_.HIDAzlfYOBxfTb7nBwstVNak4G3YOCO_0 2024-03-04T12:37:24.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.499+0000 7f31e9644800 5 delete_objs_inline: refcount put returned error -2 2024-03-04T12:37:24.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.499+0000 7f31e9644800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:37:24.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.499+0000 7f31e9644800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-03-04T12:37:24.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.499+0000 7f31e9644800 0 deleting objects inline since gc isn't initialized 2024-03-04T12:37:24.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.499+0000 7f31e9644800 5 delete_objs_inline: removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1__shadow:d4AQzF1ibmvBKJkl5Vc2NgEhedgjqEf_.LBmJHu9SbVP-IEIhcf-b9WozCKrlA2S_0 2024-03-04T12:37:24.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.499+0000 7f30caffd640 20 handle_completion(): completion ok for obj=c[BmW3n28ESI0YdFxSoEUSZodzwuLfrIa] 2024-03-04T12:37:24.506 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.500+0000 7f30ca7fc640 20 handle_completion(): completion ok for obj=f[d4AQzF1ibmvBKJkl5Vc2NgEhedgjqEf] 2024-03-04T12:37:24.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.501+0000 7f31e9644800 5 delete_objs_inline: refcount put returned error -2 2024-03-04T12:37:24.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.501+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:24.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.501+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:24.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.501+0000 7f31e9644800 20 get_obj_state: octx=0x561c6cf51a40 obj=check-bucket:e state=0x561c6d1f14d8 s->prefetch_data=0 2024-03-04T12:37:24.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.501+0000 7f31e9644800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pwzoufq0q1l9u9isbcm6sncorht0to1b 2024-03-04T12:37:24.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.501+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:24.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.501+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:24.508 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.502+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:24.508 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.502+0000 7f31e9644800 1 NOTICE: finished shard 5 (1 entries removed) 2024-03-04T12:37:24.509 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.503+0000 7f31e9644800 20 get_obj_state: octx=0x561c6d1f05e0 obj=check-bucket:f state=0x561c6d28f228 s->prefetch_data=0 2024-03-04T12:37:24.509 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.503+0000 7f31e9644800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0g1ahczt0mrc3y0fvujttjg93gjc2lpi 2024-03-04T12:37:24.509 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.503+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:24.509 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.503+0000 7f31e9644800 1 NOTICE: finished shard 8 (1 entries removed) 2024-03-04T12:37:24.509 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.504+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:24.511 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.505+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:24.511 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.505+0000 7f31e9644800 1 NOTICE: finished shard 1 (1 entries removed) 2024-03-04T12:37:24.511 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.505+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:24.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.506+0000 7f31e9644800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:24.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.506+0000 7f31e9644800 1 NOTICE: finished shard 10 (1 entries removed) 2024-03-04T12:37:24.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.506+0000 7f31e9644800 1 NOTICE: finished all shards (4 entries removed) 2024-03-04T12:37:24.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.507+0000 7f309dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:24.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.510+0000 7f31e9644800 20 remove_watcher() i=0 2024-03-04T12:37:24.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.510+0000 7f31e9644800 2 removed watcher, disabling cache 2024-03-04T12:37:24.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.511+0000 7f31e9644800 20 remove_watcher() i=1 2024-03-04T12:37:24.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.512+0000 7f31e9644800 20 remove_watcher() i=2 2024-03-04T12:37:24.518 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.513+0000 7f31e9644800 20 remove_watcher() i=3 2024-03-04T12:37:24.520 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.514+0000 7f31e9644800 20 remove_watcher() i=4 2024-03-04T12:37:24.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.515+0000 7f31e9644800 20 remove_watcher() i=5 2024-03-04T12:37:24.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.516+0000 7f31e9644800 20 remove_watcher() i=6 2024-03-04T12:37:24.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.517+0000 7f31e9644800 20 remove_watcher() i=7 2024-03-04T12:37:24.534 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:24.534 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:24.537 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:24.537 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:24.539 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:24.539 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:24.542 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:24.542 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:24.543 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: bucket check unlinked does not affect normal entries 2024-03-04T12:37:24.543 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:24.544 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:24.544 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:24.589 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:24.590 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:24.592 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:24.592 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:24.595 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:24.595 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:24.598 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:24.598 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:24.599 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-03-04T12:37:24.599 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:24.601 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-04T12:37:24.632 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:24.632 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:24.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.659+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.660+0000 7fa1ea616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.660+0000 7fa1ea616800 20 realm 2024-03-04T12:37:24.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.660+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.660+0000 7fa1ea616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.660+0000 7fa1ea616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:24.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.660+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.660+0000 7fa1ea616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.660+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.661+0000 7fa1ea616800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:24.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.661+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.662+0000 7fa1ea616800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:24.668 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.662+0000 7fa1ea616800 20 searching for the correct realm 2024-03-04T12:37:24.670 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.664+0000 7fa1e5480640 0 -- 172.21.15.90:0/3642160103 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fa1dc03b040 msgr2=0x7fa1dc01f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:24.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:24.870+0000 7fa1e5c81640 0 -- 172.21.15.90:0/3642160103 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fa1dc01fc20 msgr2=0x7fa1dc05e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:25.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.076+0000 7fa1ea616800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:25.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.076+0000 7fa1ea616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:25.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.076+0000 7fa1ea616800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:25.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.076+0000 7fa1ea616800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:25.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.076+0000 7fa1ea616800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:25.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.076+0000 7fa1ea616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:25.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.076+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.077+0000 7fa1ea616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.077+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.077+0000 7fa1ea616800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.077+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.077+0000 7fa1ea616800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:25.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.077+0000 7fa1ea616800 20 zone default found 2024-03-04T12:37:25.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.077+0000 7fa1ea616800 4 Realm: () 2024-03-04T12:37:25.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.077+0000 7fa1ea616800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:25.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.077+0000 7fa1ea616800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:25.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.077+0000 7fa1ea616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:25.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.077+0000 7fa1ea616800 20 zonegroup default 2024-03-04T12:37:25.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.077+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.078+0000 7fa1ea616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.078+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.078+0000 7fa1ea616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.078+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.078+0000 7fa1ea616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.078+0000 7fa1ea616800 20 started sync module instance, tier type = 2024-03-04T12:37:25.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.078+0000 7fa1ea616800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:25.095 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.089+0000 7fa1ea616800 20 add_watcher() i=0 2024-03-04T12:37:25.095 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.089+0000 7fa1ea616800 20 add_watcher() i=1 2024-03-04T12:37:25.095 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.089+0000 7fa1ea616800 20 add_watcher() i=2 2024-03-04T12:37:25.095 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.089+0000 7fa1ea616800 20 add_watcher() i=3 2024-03-04T12:37:25.096 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.089+0000 7fa1ea616800 20 add_watcher() i=4 2024-03-04T12:37:25.096 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.089+0000 7fa1ea616800 20 add_watcher() i=5 2024-03-04T12:37:25.096 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.089+0000 7fa1ea616800 20 add_watcher() i=6 2024-03-04T12:37:25.096 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.090+0000 7fa1ea616800 20 add_watcher() i=7 2024-03-04T12:37:25.096 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.090+0000 7fa1ea616800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:25.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.092+0000 7fa0977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.092+0000 7fa1ea616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:25.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.092+0000 7fa1ea616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:25.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.092+0000 7fa1ea616800 5 note: GC not initialized 2024-03-04T12:37:25.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.092+0000 7fa0967fc640 20 reqs_thread_entry: start 2024-03-04T12:37:25.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.093+0000 7fa1ea616800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:25.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.093+0000 7fa1ea616800 20 Filter name: none 2024-03-04T12:37:25.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.093+0000 7fa007fff640 20 reqs_thread_entry: start 2024-03-04T12:37:25.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.093+0000 7fa1ea616800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:37:25.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.093+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.093+0000 7fa1ea616800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:25.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.093+0000 7fa1ea616800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:37:25.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.093+0000 7fa1ea616800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:37:25.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.093+0000 7fa1ea616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 : miss 2024-03-04T12:37:25.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.093+0000 7fa1ea616800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.094+0000 7fa1ea616800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:25.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.094+0000 7fa1ea616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 info.flags=0x17 2024-03-04T12:37:25.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.094+0000 7fa1ea616800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 to cache LRU end 2024-03-04T12:37:25.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.094+0000 7fa1ea616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:25.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.094+0000 7fa1ea616800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:37:25.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.094+0000 7fa1ea616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 2024-03-04T12:37:25.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.094+0000 7fa1ea616800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:25.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.094+0000 7fa1ea616800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-04T12:37:25.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.094+0000 7fa1ea616800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:25.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.095+0000 7fa1ea616800 1 NOTICE: finished shard 1 (0 entries found) 2024-03-04T12:37:25.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.095+0000 7fa1ea616800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:25.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.096+0000 7fa1ea616800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-04T12:37:25.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.096+0000 7fa1ea616800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:25.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.096+0000 7fa1ea616800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-04T12:37:25.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.096+0000 7fa1ea616800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:25.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.096+0000 7fa1ea616800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-04T12:37:25.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.096+0000 7fa1ea616800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:25.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.097+0000 7fa1ea616800 1 NOTICE: finished shard 5 (0 entries found) 2024-03-04T12:37:25.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.097+0000 7fa1ea616800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:25.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.097+0000 7fa1ea616800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-04T12:37:25.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.097+0000 7fa1ea616800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:25.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.098+0000 7fa1ea616800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-04T12:37:25.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.098+0000 7fa1ea616800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:25.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.098+0000 7fa1ea616800 1 NOTICE: finished shard 8 (0 entries found) 2024-03-04T12:37:25.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.098+0000 7fa1ea616800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:25.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.099+0000 7fa1ea616800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-04T12:37:25.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.099+0000 7fa1ea616800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:25.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.099+0000 7fa1ea616800 1 NOTICE: finished shard 10 (0 entries found) 2024-03-04T12:37:25.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.099+0000 7fa1ea616800 1 NOTICE: finished all shards (0 entries found) 2024-03-04T12:37:25.106 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.100+0000 7fa0977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.108 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.102+0000 7fa1ea616800 20 remove_watcher() i=0 2024-03-04T12:37:25.108 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.102+0000 7fa1ea616800 2 removed watcher, disabling cache 2024-03-04T12:37:25.109 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.103+0000 7fa1ea616800 20 remove_watcher() i=1 2024-03-04T12:37:25.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.105+0000 7fa1ea616800 20 remove_watcher() i=2 2024-03-04T12:37:25.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.106+0000 7fa1ea616800 20 remove_watcher() i=3 2024-03-04T12:37:25.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.107+0000 7fa1ea616800 20 remove_watcher() i=4 2024-03-04T12:37:25.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.108+0000 7fa1ea616800 20 remove_watcher() i=5 2024-03-04T12:37:25.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.109+0000 7fa1ea616800 20 remove_watcher() i=6 2024-03-04T12:37:25.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.110+0000 7fa1ea616800 20 remove_watcher() i=7 2024-03-04T12:37:25.129 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:25.129 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:25.145 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:25.145 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:25.168 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-04T12:37:25.198 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:25.198 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:25.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.224+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.226+0000 7f4163b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.226+0000 7f4163b2f800 20 realm 2024-03-04T12:37:25.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.226+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.226+0000 7f4163b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.226+0000 7f4163b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:25.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.226+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.226+0000 7f4163b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.226+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.227+0000 7f4163b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.227+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.228+0000 7f4163b2f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:25.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.228+0000 7f4163b2f800 20 searching for the correct realm 2024-03-04T12:37:25.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.230+0000 7f415f7f7640 0 -- 172.21.15.90:0/1210025709 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f4158018550 msgr2=0x7f415802a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:25.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.234+0000 7f415f7f7640 0 -- 172.21.15.90:0/1210025709 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f41480403f0 msgr2=0x7f4148040850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:25.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.440+0000 7f4163b2f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:25.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.440+0000 7f4163b2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:25.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.440+0000 7f4163b2f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:25.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.440+0000 7f4163b2f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:25.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.440+0000 7f4163b2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:25.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.440+0000 7f4163b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:25.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.440+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.440+0000 7f4163b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.440+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.441+0000 7f4163b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.441+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.441+0000 7f4163b2f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:25.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.441+0000 7f4163b2f800 20 zone default found 2024-03-04T12:37:25.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.441+0000 7f4163b2f800 4 Realm: () 2024-03-04T12:37:25.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.441+0000 7f4163b2f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:25.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.441+0000 7f4163b2f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:25.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.441+0000 7f4163b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:25.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.441+0000 7f4163b2f800 20 zonegroup default 2024-03-04T12:37:25.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.441+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.441+0000 7f4163b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.441+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.442+0000 7f4163b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.442+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.442+0000 7f4163b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.442+0000 7f4163b2f800 20 started sync module instance, tier type = 2024-03-04T12:37:25.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.442+0000 7f4163b2f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:25.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.457+0000 7f4163b2f800 20 add_watcher() i=0 2024-03-04T12:37:25.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.457+0000 7f4163b2f800 20 add_watcher() i=1 2024-03-04T12:37:25.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.457+0000 7f4163b2f800 20 add_watcher() i=2 2024-03-04T12:37:25.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.457+0000 7f4163b2f800 20 add_watcher() i=3 2024-03-04T12:37:25.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.457+0000 7f4163b2f800 20 add_watcher() i=4 2024-03-04T12:37:25.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.457+0000 7f4163b2f800 20 add_watcher() i=5 2024-03-04T12:37:25.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.457+0000 7f4163b2f800 20 add_watcher() i=6 2024-03-04T12:37:25.465 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.460+0000 7f4163b2f800 20 add_watcher() i=7 2024-03-04T12:37:25.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.460+0000 7f4163b2f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:25.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.463+0000 7f4015fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.463+0000 7f4163b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:25.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.463+0000 7f4163b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:25.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.463+0000 7f4163b2f800 5 note: GC not initialized 2024-03-04T12:37:25.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.463+0000 7f4014fe1640 20 reqs_thread_entry: start 2024-03-04T12:37:25.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.463+0000 7f4163b2f800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:25.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.463+0000 7f4163b2f800 20 Filter name: none 2024-03-04T12:37:25.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.464+0000 7f3f8e7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:25.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.464+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.464+0000 7f4163b2f800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:25.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.464+0000 7f4163b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.465+0000 7f4163b2f800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:25.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.465+0000 7f4163b2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:25.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.465+0000 7f4163b2f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:37:25.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.465+0000 7f4163b2f800 20 INFO: main: starting shard=0 2024-03-04T12:37:25.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.465+0000 7f4163b2f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:25.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.465+0000 7f4163b2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.465+0000 7f4163b2f800 20 INFO: main: starting shard=1 2024-03-04T12:37:25.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.465+0000 7f4163b2f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:25.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.466+0000 7f4163b2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.466+0000 7f4163b2f800 20 INFO: main: starting shard=2 2024-03-04T12:37:25.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.466+0000 7f4163b2f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:25.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.466+0000 7f4163b2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.466+0000 7f4163b2f800 20 INFO: main: starting shard=3 2024-03-04T12:37:25.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.466+0000 7f4163b2f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:25.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.467+0000 7f4163b2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.467+0000 7f4163b2f800 20 INFO: main: starting shard=4 2024-03-04T12:37:25.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.467+0000 7f4163b2f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:25.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.468+0000 7f4163b2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.468+0000 7f4163b2f800 20 INFO: main: starting shard=5 2024-03-04T12:37:25.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.468+0000 7f4163b2f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:25.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.468+0000 7f4163b2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.468+0000 7f4163b2f800 20 INFO: main: starting shard=6 2024-03-04T12:37:25.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.468+0000 7f4163b2f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:25.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.469+0000 7f4163b2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.469+0000 7f4163b2f800 20 INFO: main: starting shard=7 2024-03-04T12:37:25.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.469+0000 7f4163b2f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:25.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.469+0000 7f4163b2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.469+0000 7f4163b2f800 20 INFO: main: starting shard=8 2024-03-04T12:37:25.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.469+0000 7f4163b2f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:25.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.470+0000 7f4163b2f800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-03-04T12:37:25.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.470+0000 7f4163b2f800 20 INFO: main: starting shard=9 2024-03-04T12:37:25.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.470+0000 7f4163b2f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:25.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.470+0000 7f4163b2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.470+0000 7f4163b2f800 20 INFO: main: starting shard=10 2024-03-04T12:37:25.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.470+0000 7f4163b2f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:25.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.471+0000 7f4163b2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.471+0000 7f4163b2f800 20 INFO: main: done 2024-03-04T12:37:25.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.471+0000 7f4015fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.474+0000 7f4163b2f800 20 remove_watcher() i=0 2024-03-04T12:37:25.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.474+0000 7f4163b2f800 2 removed watcher, disabling cache 2024-03-04T12:37:25.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.475+0000 7f4163b2f800 20 remove_watcher() i=1 2024-03-04T12:37:25.484 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.478+0000 7f4163b2f800 20 remove_watcher() i=2 2024-03-04T12:37:25.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.479+0000 7f4163b2f800 20 remove_watcher() i=3 2024-03-04T12:37:25.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.481+0000 7f4163b2f800 20 remove_watcher() i=4 2024-03-04T12:37:25.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.482+0000 7f4163b2f800 20 remove_watcher() i=5 2024-03-04T12:37:25.489 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.483+0000 7f4163b2f800 20 remove_watcher() i=6 2024-03-04T12:37:25.490 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.484+0000 7f4163b2f800 20 remove_watcher() i=7 2024-03-04T12:37:25.501 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-04T12:37:25.531 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:25.531 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:25.564 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.558+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.559+0000 7fb04f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.559+0000 7fb04f14b800 20 realm 2024-03-04T12:37:25.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.559+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.559+0000 7fb04f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.559+0000 7fb04f14b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:25.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.559+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.559+0000 7fb04f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.559+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.560+0000 7fb04f14b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.560+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.561+0000 7fb04f14b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:25.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.561+0000 7fb04f14b800 20 searching for the correct realm 2024-03-04T12:37:25.570 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.564+0000 7fb04d448640 0 -- 172.21.15.90:0/136812687 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x5640ea585f50 msgr2=0x5640ea588410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:25.573 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.567+0000 7fb04cc47640 0 -- 172.21.15.90:0/136812687 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fb034042410 msgr2=0x7fb034042890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:25.579 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.572+0000 7fb04f14b800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:25.579 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.572+0000 7fb04f14b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:25.579 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.572+0000 7fb04f14b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.572+0000 7fb04f14b800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.572+0000 7fb04f14b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.572+0000 7fb04f14b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.572+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.572+0000 7fb04f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.572+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 20 zone default found 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 4 Realm: () 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:25.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:25.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:25.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 20 zonegroup default 2024-03-04T12:37:25.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.573+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.574+0000 7fb04f14b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.574+0000 7fb04f14b800 20 started sync module instance, tier type = 2024-03-04T12:37:25.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.574+0000 7fb04f14b800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:25.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.592+0000 7fb04f14b800 20 add_watcher() i=0 2024-03-04T12:37:25.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.592+0000 7fb04f14b800 20 add_watcher() i=1 2024-03-04T12:37:25.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.592+0000 7fb04f14b800 20 add_watcher() i=2 2024-03-04T12:37:25.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.592+0000 7fb04f14b800 20 add_watcher() i=3 2024-03-04T12:37:25.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.592+0000 7fb04f14b800 20 add_watcher() i=4 2024-03-04T12:37:25.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.592+0000 7fb04f14b800 20 add_watcher() i=5 2024-03-04T12:37:25.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.595+0000 7fb04f14b800 20 add_watcher() i=6 2024-03-04T12:37:25.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.595+0000 7fb04f14b800 20 add_watcher() i=7 2024-03-04T12:37:25.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.595+0000 7fb04f14b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:25.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.598+0000 7faf02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.598+0000 7fb04f14b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.598+0000 7fb04f14b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.598+0000 7fb04f14b800 5 note: GC not initialized 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.598+0000 7faf01fe3640 20 reqs_thread_entry: start 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.598+0000 7fb04f14b800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.598+0000 7fb04f14b800 20 Filter name: none 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.598+0000 7fae737fe640 20 reqs_thread_entry: start 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.599+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.599+0000 7fb04f14b800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.599+0000 7fb04f14b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.600+0000 7fb04f14b800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.600+0000 7fb04f14b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.600+0000 7fb04f14b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.600+0000 7fb04f14b800 20 INFO: main: starting shard=0 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.600+0000 7fb04f14b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.600+0000 7fb04f14b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.600+0000 7fb04f14b800 20 INFO: main: starting shard=1 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.600+0000 7fb04f14b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:25.607 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.601+0000 7fb04f14b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.607 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.601+0000 7fb04f14b800 20 INFO: main: starting shard=2 2024-03-04T12:37:25.607 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.601+0000 7fb04f14b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:25.607 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.601+0000 7fb04f14b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.601+0000 7fb04f14b800 20 INFO: main: starting shard=3 2024-03-04T12:37:25.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.601+0000 7fb04f14b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:25.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.602+0000 7fb04f14b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.602+0000 7fb04f14b800 20 INFO: main: starting shard=4 2024-03-04T12:37:25.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.602+0000 7fb04f14b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:25.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.602+0000 7fb04f14b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.602+0000 7fb04f14b800 20 INFO: main: starting shard=5 2024-03-04T12:37:25.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.602+0000 7fb04f14b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:25.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.603+0000 7fb04f14b800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-03-04T12:37:25.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.603+0000 7fb04f14b800 20 INFO: main: starting shard=6 2024-03-04T12:37:25.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.603+0000 7fb04f14b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:25.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.603+0000 7fb04f14b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.603+0000 7fb04f14b800 20 INFO: main: starting shard=7 2024-03-04T12:37:25.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.603+0000 7fb04f14b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:25.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.604+0000 7fb04f14b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.604+0000 7fb04f14b800 20 INFO: main: starting shard=8 2024-03-04T12:37:25.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.604+0000 7fb04f14b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:25.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.604+0000 7fb04f14b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.604+0000 7fb04f14b800 20 INFO: main: starting shard=9 2024-03-04T12:37:25.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.604+0000 7fb04f14b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:25.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.605+0000 7fb04f14b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.605+0000 7fb04f14b800 20 INFO: main: starting shard=10 2024-03-04T12:37:25.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.605+0000 7fb04f14b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:25.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.606+0000 7fb04f14b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.606+0000 7fb04f14b800 20 INFO: main: done 2024-03-04T12:37:25.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.606+0000 7faf02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.609+0000 7fb04f14b800 20 remove_watcher() i=0 2024-03-04T12:37:25.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.609+0000 7fb04f14b800 2 removed watcher, disabling cache 2024-03-04T12:37:25.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.610+0000 7fb04f14b800 20 remove_watcher() i=1 2024-03-04T12:37:25.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.613+0000 7fb04f14b800 20 remove_watcher() i=2 2024-03-04T12:37:25.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.614+0000 7fb04f14b800 20 remove_watcher() i=3 2024-03-04T12:37:25.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.615+0000 7fb04f14b800 20 remove_watcher() i=4 2024-03-04T12:37:25.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.616+0000 7fb04f14b800 20 remove_watcher() i=5 2024-03-04T12:37:25.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.617+0000 7fb04f14b800 20 remove_watcher() i=6 2024-03-04T12:37:25.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.618+0000 7fb04f14b800 20 remove_watcher() i=7 2024-03-04T12:37:25.634 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: bucket check olh finds leftover OLH entries 2024-03-04T12:37:25.634 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:25.635 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-03-04T12:37:25.665 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:25.665 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:25.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.692+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.693+0000 7f96d892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.693+0000 7f96d892c800 20 realm 2024-03-04T12:37:25.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.693+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.693+0000 7f96d892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.693+0000 7f96d892c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:25.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.693+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.693+0000 7f96d892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.693+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.694+0000 7f96d892c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.694+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.695+0000 7f96d892c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:25.701 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.695+0000 7f96d892c800 20 searching for the correct realm 2024-03-04T12:37:25.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.697+0000 7f96d3e60640 0 -- 172.21.15.90:0/1880610214 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f96c8027070 msgr2=0x7f96c801a190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:25.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:25.903+0000 7f96d4661640 0 -- 172.21.15.90:0/1880610214 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f96c806c0a0 msgr2=0x7f96c806c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:26.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.109+0000 7f96d892c800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:26.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.109+0000 7f96d892c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:26.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.109+0000 7f96d892c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:26.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.109+0000 7f96d892c800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:26.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.109+0000 7f96d892c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:26.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.109+0000 7f96d892c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:26.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.109+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.110+0000 7f96d892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.110+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.110+0000 7f96d892c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:26.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.110+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.110+0000 7f96d892c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.110+0000 7f96d892c800 20 zone default found 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.110+0000 7f96d892c800 4 Realm: () 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.110+0000 7f96d892c800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.110+0000 7f96d892c800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.110+0000 7f96d892c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.110+0000 7f96d892c800 20 zonegroup default 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.110+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.111+0000 7f96d892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.111+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.111+0000 7f96d892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.111+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.111+0000 7f96d892c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.111+0000 7f96d892c800 20 started sync module instance, tier type = 2024-03-04T12:37:26.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.111+0000 7f96d892c800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:26.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.134+0000 7f96d892c800 20 add_watcher() i=0 2024-03-04T12:37:26.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.134+0000 7f96d892c800 20 add_watcher() i=1 2024-03-04T12:37:26.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.134+0000 7f96d892c800 20 add_watcher() i=2 2024-03-04T12:37:26.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.134+0000 7f96d892c800 20 add_watcher() i=3 2024-03-04T12:37:26.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.134+0000 7f96d892c800 20 add_watcher() i=4 2024-03-04T12:37:26.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.134+0000 7f96d892c800 20 add_watcher() i=5 2024-03-04T12:37:26.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.134+0000 7f96d892c800 20 add_watcher() i=6 2024-03-04T12:37:26.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.137+0000 7f96d892c800 20 add_watcher() i=7 2024-03-04T12:37:26.143 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.137+0000 7f96d892c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:26.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.139+0000 7f958afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.139+0000 7f96d892c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.139+0000 7f96d892c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.139+0000 7f96d892c800 5 note: GC not initialized 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.139+0000 7f9589fdb640 20 reqs_thread_entry: start 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.139+0000 7f96d892c800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.139+0000 7f96d892c800 20 Filter name: none 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.139+0000 7f94fb7fe640 20 reqs_thread_entry: start 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.139+0000 7f96d892c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 : miss 2024-03-04T12:37:26.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:26.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 info.flags=0x17 2024-03-04T12:37:26.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 to cache LRU end 2024-03-04T12:37:26.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:26.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:37:26.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 2024-03-04T12:37:26.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.140+0000 7f96d892c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:26.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.141+0000 7f96d892c800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-04T12:37:26.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.141+0000 7f96d892c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:26.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.141+0000 7f96d892c800 1 NOTICE: finished shard 1 (0 entries found) 2024-03-04T12:37:26.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.141+0000 7f96d892c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:26.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.142+0000 7f96d892c800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-04T12:37:26.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.142+0000 7f96d892c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:26.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.142+0000 7f96d892c800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-04T12:37:26.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.142+0000 7f96d892c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:26.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.143+0000 7f96d892c800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-04T12:37:26.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.143+0000 7f96d892c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:26.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.143+0000 7f96d892c800 1 NOTICE: finished shard 5 (1 entries found) 2024-03-04T12:37:26.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.143+0000 7f96d892c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:26.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.144+0000 7f96d892c800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-04T12:37:26.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.144+0000 7f96d892c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:26.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.144+0000 7f96d892c800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-04T12:37:26.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.144+0000 7f96d892c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:26.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.145+0000 7f96d892c800 1 NOTICE: finished shard 8 (1 entries found) 2024-03-04T12:37:26.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.145+0000 7f96d892c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:26.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.145+0000 7f96d892c800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-04T12:37:26.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.145+0000 7f96d892c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:26.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.146+0000 7f96d892c800 1 NOTICE: finished shard 10 (0 entries found) 2024-03-04T12:37:26.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.146+0000 7f96d892c800 1 NOTICE: finished all shards (2 entries found) 2024-03-04T12:37:26.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.146+0000 7f958afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:26.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.149+0000 7f96d892c800 20 remove_watcher() i=0 2024-03-04T12:37:26.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.149+0000 7f96d892c800 2 removed watcher, disabling cache 2024-03-04T12:37:26.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.150+0000 7f96d892c800 20 remove_watcher() i=1 2024-03-04T12:37:26.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.151+0000 7f96d892c800 20 remove_watcher() i=2 2024-03-04T12:37:26.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.152+0000 7f96d892c800 20 remove_watcher() i=3 2024-03-04T12:37:26.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.153+0000 7f96d892c800 20 remove_watcher() i=4 2024-03-04T12:37:26.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.154+0000 7f96d892c800 20 remove_watcher() i=5 2024-03-04T12:37:26.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.157+0000 7f96d892c800 20 remove_watcher() i=6 2024-03-04T12:37:26.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.158+0000 7f96d892c800 20 remove_watcher() i=7 2024-03-04T12:37:26.173 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-03-04T12:37:26.173 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:26.175 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-04T12:37:26.206 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:26.206 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:26.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.233+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.234+0000 7f6c1752f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.234+0000 7f6c1752f800 20 realm 2024-03-04T12:37:26.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.234+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.234+0000 7f6c1752f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.234+0000 7f6c1752f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:26.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.234+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.235+0000 7f6c1752f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.235+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.235+0000 7f6c1752f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:26.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.235+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.236+0000 7f6c1752f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:26.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.236+0000 7f6c1752f800 20 searching for the correct realm 2024-03-04T12:37:26.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.239+0000 7f6c129f6640 0 -- 172.21.15.90:0/3642898970 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f6c080a5950 msgr2=0x7f6c080b48a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:26.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.242+0000 7f6c131f7640 0 -- 172.21.15.90:0/3642898970 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f6c080d0bb0 msgr2=0x7f6c080d20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:26.455 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.448+0000 7f6c1752f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:26.455 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.448+0000 7f6c1752f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.448+0000 7f6c1752f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.448+0000 7f6c1752f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.448+0000 7f6c1752f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.448+0000 7f6c1752f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.448+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 20 zone default found 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 4 Realm: () 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:26.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:26.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:26.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 20 zonegroup default 2024-03-04T12:37:26.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.449+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.450+0000 7f6c1752f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.450+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.450+0000 7f6c1752f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.450+0000 7f6c1752f800 20 started sync module instance, tier type = 2024-03-04T12:37:26.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.450+0000 7f6c1752f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:26.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.463+0000 7f6c1752f800 20 add_watcher() i=0 2024-03-04T12:37:26.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.463+0000 7f6c1752f800 20 add_watcher() i=1 2024-03-04T12:37:26.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.463+0000 7f6c1752f800 20 add_watcher() i=2 2024-03-04T12:37:26.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.463+0000 7f6c1752f800 20 add_watcher() i=3 2024-03-04T12:37:26.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.463+0000 7f6c1752f800 20 add_watcher() i=4 2024-03-04T12:37:26.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.463+0000 7f6c1752f800 20 add_watcher() i=5 2024-03-04T12:37:26.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.463+0000 7f6c1752f800 20 add_watcher() i=6 2024-03-04T12:37:26.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.464+0000 7f6c1752f800 20 add_watcher() i=7 2024-03-04T12:37:26.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.464+0000 7f6c1752f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:26.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.466+0000 7f6ac9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:26.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.466+0000 7f6c1752f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:26.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.466+0000 7f6c1752f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:26.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.466+0000 7f6c1752f800 5 note: GC not initialized 2024-03-04T12:37:26.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.466+0000 7f6ac8fe1640 20 reqs_thread_entry: start 2024-03-04T12:37:26.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.466+0000 7f6c1752f800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:26.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.466+0000 7f6c1752f800 20 Filter name: none 2024-03-04T12:37:26.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.467+0000 7f6a427fc640 20 reqs_thread_entry: start 2024-03-04T12:37:26.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.467+0000 7f6c1752f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:37:26.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.467+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.467+0000 7f6c1752f800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:26.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.467+0000 7f6c1752f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:37:26.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.467+0000 7f6c1752f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:37:26.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.467+0000 7f6c1752f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 : miss 2024-03-04T12:37:26.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.467+0000 7f6c1752f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.467+0000 7f6c1752f800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:26.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.468+0000 7f6c1752f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 info.flags=0x17 2024-03-04T12:37:26.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.468+0000 7f6c1752f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 to cache LRU end 2024-03-04T12:37:26.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.468+0000 7f6c1752f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:26.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.468+0000 7f6c1752f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:37:26.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.468+0000 7f6c1752f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 2024-03-04T12:37:26.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.468+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:26.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.468+0000 7f6c1752f800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-04T12:37:26.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.468+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:26.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.469+0000 7f6c1752f800 1 NOTICE: finished shard 1 (0 entries removed) 2024-03-04T12:37:26.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.469+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:26.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.469+0000 7f6c1752f800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-04T12:37:26.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.469+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:26.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.470+0000 7f6c1752f800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-04T12:37:26.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.470+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:26.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.470+0000 7f6c1752f800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-04T12:37:26.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.470+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:26.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.471+0000 7f6c1752f800 20 get_obj_state: octx=0x55ec5c69ba30 obj=check-bucket:d state=0x55ec5c93bc58 s->prefetch_data=0 2024-03-04T12:37:26.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.471+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:26.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.471+0000 7f6c1752f800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-04T12:37:26.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.471+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:26.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.472+0000 7f6c1752f800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-04T12:37:26.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.472+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:26.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.472+0000 7f6c1752f800 20 get_obj_state: octx=0x55ec5c69bc10 obj=check-bucket:c state=0x55ec5c93d218 s->prefetch_data=0 2024-03-04T12:37:26.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.472+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.473+0000 7f6c1752f800 1 NOTICE: finished shard 9 (0 entries removed) 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.473+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.473+0000 7f6c1752f800 1 NOTICE: finished shard 10 (0 entries removed) 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.473+0000 7f6c1752f800 20 get_obj_state: setting s->obj_tag to 3v9bd4hlwa9fb30alku7mmv61mohfgvo 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.473+0000 7f6c1752f800 20 get_obj_state_impl: setting s->olh_tag to 4hcgxhng6c96zb8o0eokc0x6sh8pfmuq 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.473+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.473+0000 7f6c1752f800 20 get_obj_state: setting s->obj_tag to 5gtusvx3cqs41qqgly3hrf2hbyzp4vty 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.473+0000 7f6c1752f800 20 get_obj_state_impl: setting s->olh_tag to 8fvg1imilijf3kbglbahbg6gypkewyso 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.473+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.473+0000 7f6c1752f800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.474+0000 7f6c1752f800 20 olh_log_entry: epoch=4 op=3 key=d[4B14IW0r-OzIT1xB1Cks6rHOjoyi-pM] 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.474+0000 7f6c1752f800 20 get_obj_state: octx=0x55ec5c97a6b0 obj=check-bucket:_:4B14IW0r-OzIT1xB1Cks6rHOjoyi-pM_d state=0x55ec5c93f6b8 s->prefetch_data=0 2024-03-04T12:37:26.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.474+0000 7f6c1752f800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-03-04T12:37:26.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.474+0000 7f6c1752f800 20 olh_log_entry: epoch=4 op=3 key=c[MsbFcSoNpix2UeQfy4wgHqTpi6BbPfP] 2024-03-04T12:37:26.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.474+0000 7f6c1752f800 20 get_obj_state: octx=0x55ec5c99a6b0 obj=check-bucket:_:MsbFcSoNpix2UeQfy4wgHqTpi6BbPfP_c state=0x55ec5c99d388 s->prefetch_data=0 2024-03-04T12:37:26.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.475+0000 7f6c1752f800 20 get_obj_state: octx=0x55ec5c97a6b0 obj=check-bucket:d state=0x55ec5c93e6a8 s->prefetch_data=0 2024-03-04T12:37:26.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.475+0000 7f6c1752f800 20 get_obj_state: octx=0x55ec5c99a6b0 obj=check-bucket:c state=0x55ec5c99aeb8 s->prefetch_data=0 2024-03-04T12:37:26.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.475+0000 7f6c1752f800 20 get_obj_state: setting s->obj_tag to 3v9bd4hlwa9fb30alku7mmv61mohfgvo 2024-03-04T12:37:26.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.475+0000 7f6c1752f800 20 get_obj_state_impl: setting s->olh_tag to 4hcgxhng6c96zb8o0eokc0x6sh8pfmuq 2024-03-04T12:37:26.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.475+0000 7f6c1752f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4hcgxhng6c96zb8o0eokc0x6sh8pfmuq 2024-03-04T12:37:26.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.475+0000 7f6c1752f800 20 get_obj_state: setting s->obj_tag to 5gtusvx3cqs41qqgly3hrf2hbyzp4vty 2024-03-04T12:37:26.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.475+0000 7f6c1752f800 20 get_obj_state_impl: setting s->olh_tag to 8fvg1imilijf3kbglbahbg6gypkewyso 2024-03-04T12:37:26.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.475+0000 7f6c1752f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8fvg1imilijf3kbglbahbg6gypkewyso 2024-03-04T12:37:26.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.479+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:26.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.479+0000 7f6c1752f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:26.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.480+0000 7f6c1752f800 1 NOTICE: finished shard 5 (1 entries removed) 2024-03-04T12:37:26.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.481+0000 7f6c1752f800 1 NOTICE: finished shard 8 (1 entries removed) 2024-03-04T12:37:26.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.481+0000 7f6c1752f800 1 NOTICE: finished all shards (2 entries removed) 2024-03-04T12:37:26.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.482+0000 7f6ac9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:26.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.487+0000 7f6c1752f800 20 remove_watcher() i=0 2024-03-04T12:37:26.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.487+0000 7f6c1752f800 2 removed watcher, disabling cache 2024-03-04T12:37:26.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.489+0000 7f6c1752f800 20 remove_watcher() i=1 2024-03-04T12:37:26.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.490+0000 7f6c1752f800 20 remove_watcher() i=2 2024-03-04T12:37:26.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.491+0000 7f6c1752f800 20 remove_watcher() i=3 2024-03-04T12:37:26.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.492+0000 7f6c1752f800 20 remove_watcher() i=4 2024-03-04T12:37:26.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.493+0000 7f6c1752f800 20 remove_watcher() i=5 2024-03-04T12:37:26.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.494+0000 7f6c1752f800 20 remove_watcher() i=6 2024-03-04T12:37:26.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.495+0000 7f6c1752f800 20 remove_watcher() i=7 2024-03-04T12:37:26.512 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-04T12:37:26.541 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:26.541 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:26.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.568+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.570+0000 7fed6e444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.570+0000 7fed6e444800 20 realm 2024-03-04T12:37:26.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.570+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.570+0000 7fed6e444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.570+0000 7fed6e444800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:26.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.570+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.570+0000 7fed6e444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.570+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.571+0000 7fed6e444800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:26.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.571+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.572+0000 7fed6e444800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:26.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.572+0000 7fed6e444800 20 searching for the correct realm 2024-03-04T12:37:26.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.575+0000 7fed6c741640 0 -- 172.21.15.90:0/4068146587 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x555e589ac530 msgr2=0x555e589ae9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:26.584 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.578+0000 7fed6bf40640 0 -- 172.21.15.90:0/4068146587 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fed540ad870 msgr2=0x7fed54097f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:26.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.785+0000 7fed6e444800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:26.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.785+0000 7fed6e444800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:26.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.785+0000 7fed6e444800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:26.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.785+0000 7fed6e444800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:26.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.785+0000 7fed6e444800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:26.792 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.785+0000 7fed6e444800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:26.792 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.785+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.792 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.785+0000 7fed6e444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.792 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.785+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.786+0000 7fed6e444800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:26.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.786+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.786+0000 7fed6e444800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.786+0000 7fed6e444800 20 zone default found 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.786+0000 7fed6e444800 4 Realm: () 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.786+0000 7fed6e444800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.786+0000 7fed6e444800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.786+0000 7fed6e444800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.786+0000 7fed6e444800 20 zonegroup default 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.786+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.786+0000 7fed6e444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.786+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.787+0000 7fed6e444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.787+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.787+0000 7fed6e444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.787+0000 7fed6e444800 20 started sync module instance, tier type = 2024-03-04T12:37:26.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.787+0000 7fed6e444800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:26.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.798+0000 7fed6e444800 20 add_watcher() i=0 2024-03-04T12:37:26.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.798+0000 7fed6e444800 20 add_watcher() i=1 2024-03-04T12:37:26.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.798+0000 7fed6e444800 20 add_watcher() i=2 2024-03-04T12:37:26.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.798+0000 7fed6e444800 20 add_watcher() i=3 2024-03-04T12:37:26.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.798+0000 7fed6e444800 20 add_watcher() i=4 2024-03-04T12:37:26.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.798+0000 7fed6e444800 20 add_watcher() i=5 2024-03-04T12:37:26.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.798+0000 7fed6e444800 20 add_watcher() i=6 2024-03-04T12:37:26.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.799+0000 7fed6e444800 20 add_watcher() i=7 2024-03-04T12:37:26.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.799+0000 7fed6e444800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:26.807 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.801+0000 7fec21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:26.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.801+0000 7fed6e444800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:26.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.801+0000 7fed6e444800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:26.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.801+0000 7fed6e444800 5 note: GC not initialized 2024-03-04T12:37:26.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.802+0000 7fec20fe1640 20 reqs_thread_entry: start 2024-03-04T12:37:26.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.802+0000 7fed6e444800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:26.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.802+0000 7fed6e444800 20 Filter name: none 2024-03-04T12:37:26.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.802+0000 7feb9a7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:26.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.802+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.809 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.802+0000 7fed6e444800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:26.809 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.802+0000 7fed6e444800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.809 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.803+0000 7fed6e444800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:26.809 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.803+0000 7fed6e444800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:26.809 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.803+0000 7fed6e444800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:37:26.809 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.803+0000 7fed6e444800 20 INFO: main: starting shard=0 2024-03-04T12:37:26.809 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.803+0000 7fed6e444800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:26.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.804+0000 7fed6e444800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:26.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.804+0000 7fed6e444800 20 INFO: main: starting shard=1 2024-03-04T12:37:26.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.804+0000 7fed6e444800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:26.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.804+0000 7fed6e444800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:26.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.804+0000 7fed6e444800 20 INFO: main: starting shard=2 2024-03-04T12:37:26.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.804+0000 7fed6e444800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:26.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.805+0000 7fed6e444800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:26.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.805+0000 7fed6e444800 20 INFO: main: starting shard=3 2024-03-04T12:37:26.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.805+0000 7fed6e444800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:26.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.805+0000 7fed6e444800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:26.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.805+0000 7fed6e444800 20 INFO: main: starting shard=4 2024-03-04T12:37:26.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.805+0000 7fed6e444800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:26.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.806+0000 7fed6e444800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:26.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.806+0000 7fed6e444800 20 INFO: main: starting shard=5 2024-03-04T12:37:26.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.806+0000 7fed6e444800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:26.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.806+0000 7fed6e444800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:26.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.806+0000 7fed6e444800 20 INFO: main: starting shard=6 2024-03-04T12:37:26.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.806+0000 7fed6e444800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:26.813 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.807+0000 7fed6e444800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:26.813 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.807+0000 7fed6e444800 20 INFO: main: starting shard=7 2024-03-04T12:37:26.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.807+0000 7fed6e444800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:26.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.807+0000 7fed6e444800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:26.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.807+0000 7fed6e444800 20 INFO: main: starting shard=8 2024-03-04T12:37:26.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.807+0000 7fed6e444800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:26.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.808+0000 7fed6e444800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:26.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.808+0000 7fed6e444800 20 INFO: main: starting shard=9 2024-03-04T12:37:26.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.808+0000 7fed6e444800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:26.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.809+0000 7fed6e444800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:26.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.809+0000 7fed6e444800 20 INFO: main: starting shard=10 2024-03-04T12:37:26.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.809+0000 7fed6e444800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:26.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.809+0000 7fed6e444800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:26.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.809+0000 7fed6e444800 20 INFO: main: done 2024-03-04T12:37:26.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.810+0000 7fec21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:26.818 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.812+0000 7fed6e444800 20 remove_watcher() i=0 2024-03-04T12:37:26.818 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.812+0000 7fed6e444800 2 removed watcher, disabling cache 2024-03-04T12:37:26.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.813+0000 7fed6e444800 20 remove_watcher() i=1 2024-03-04T12:37:26.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.815+0000 7fed6e444800 20 remove_watcher() i=2 2024-03-04T12:37:26.821 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.816+0000 7fed6e444800 20 remove_watcher() i=3 2024-03-04T12:37:26.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.817+0000 7fed6e444800 20 remove_watcher() i=4 2024-03-04T12:37:26.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.818+0000 7fed6e444800 20 remove_watcher() i=5 2024-03-04T12:37:26.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.819+0000 7fed6e444800 20 remove_watcher() i=6 2024-03-04T12:37:26.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.820+0000 7fed6e444800 20 remove_watcher() i=7 2024-03-04T12:37:26.836 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-04T12:37:26.866 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:26.866 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:26.899 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.893+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.895+0000 7f2af7011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.895+0000 7f2af7011800 20 realm 2024-03-04T12:37:26.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.895+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.895+0000 7f2af7011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.895+0000 7f2af7011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:26.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.895+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.902 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.895+0000 7f2af7011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:26.902 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.895+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.902 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.896+0000 7f2af7011800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:26.902 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.896+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:26.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.897+0000 7f2af7011800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:26.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.897+0000 7f2af7011800 20 searching for the correct realm 2024-03-04T12:37:26.904 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:26.898+0000 7f2af2749640 0 -- 172.21.15.90:0/1651592092 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f2aec027c20 msgr2=0x7f2aec00f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:27.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.104+0000 7f2aebfff640 0 -- 172.21.15.90:0/1651592092 >> [v2:172.21.15.90:6817/137526376,v1:172.21.15.90:6819/137526376] conn(0x55e4170b7eb0 msgr2=0x55e4170ba2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:27.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.111+0000 7f2af7011800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:27.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.111+0000 7f2af7011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:27.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.111+0000 7f2af7011800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:27.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.111+0000 7f2af7011800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:27.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.111+0000 7f2af7011800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:27.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.111+0000 7f2af7011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:27.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.111+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.111+0000 7f2af7011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:27.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.111+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 20 zone default found 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 4 Realm: () 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 20 zonegroup default 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.112+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.113+0000 7f2af7011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:27.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.113+0000 7f2af7011800 20 started sync module instance, tier type = 2024-03-04T12:37:27.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.113+0000 7f2af7011800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:27.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.126+0000 7f2af7011800 20 add_watcher() i=0 2024-03-04T12:37:27.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.126+0000 7f2af7011800 20 add_watcher() i=1 2024-03-04T12:37:27.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.126+0000 7f2af7011800 20 add_watcher() i=2 2024-03-04T12:37:27.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.126+0000 7f2af7011800 20 add_watcher() i=3 2024-03-04T12:37:27.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.126+0000 7f2af7011800 20 add_watcher() i=4 2024-03-04T12:37:27.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.126+0000 7f2af7011800 20 add_watcher() i=5 2024-03-04T12:37:27.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.126+0000 7f2af7011800 20 add_watcher() i=6 2024-03-04T12:37:27.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.127+0000 7f2af7011800 20 add_watcher() i=7 2024-03-04T12:37:27.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.127+0000 7f2af7011800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:27.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.129+0000 7f29a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:27.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.129+0000 7f2af7011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:27.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.129+0000 7f2af7011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:27.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.129+0000 7f2af7011800 5 note: GC not initialized 2024-03-04T12:37:27.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.129+0000 7f29237fe640 20 reqs_thread_entry: start 2024-03-04T12:37:27.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.130+0000 7f2af7011800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:27.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.130+0000 7f2af7011800 20 Filter name: none 2024-03-04T12:37:27.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.130+0000 7f29217fa640 20 reqs_thread_entry: start 2024-03-04T12:37:27.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.130+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.130+0000 7f2af7011800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:27.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.130+0000 7f2af7011800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.131+0000 7f2af7011800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:27.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.131+0000 7f2af7011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:27.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.131+0000 7f2af7011800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:37:27.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.131+0000 7f2af7011800 20 INFO: main: starting shard=0 2024-03-04T12:37:27.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.131+0000 7f2af7011800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:27.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.131+0000 7f2af7011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:27.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.131+0000 7f2af7011800 20 INFO: main: starting shard=1 2024-03-04T12:37:27.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.131+0000 7f2af7011800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:27.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.132+0000 7f2af7011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:27.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.132+0000 7f2af7011800 20 INFO: main: starting shard=2 2024-03-04T12:37:27.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.132+0000 7f2af7011800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:27.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.132+0000 7f2af7011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:27.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.132+0000 7f2af7011800 20 INFO: main: starting shard=3 2024-03-04T12:37:27.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.132+0000 7f2af7011800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:27.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.133+0000 7f2af7011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:27.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.133+0000 7f2af7011800 20 INFO: main: starting shard=4 2024-03-04T12:37:27.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.133+0000 7f2af7011800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:27.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.133+0000 7f2af7011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:27.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.133+0000 7f2af7011800 20 INFO: main: starting shard=5 2024-03-04T12:37:27.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.133+0000 7f2af7011800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:27.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.134+0000 7f2af7011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:27.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.134+0000 7f2af7011800 20 INFO: main: starting shard=6 2024-03-04T12:37:27.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.134+0000 7f2af7011800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:27.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.134+0000 7f2af7011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:27.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.134+0000 7f2af7011800 20 INFO: main: starting shard=7 2024-03-04T12:37:27.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.134+0000 7f2af7011800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:27.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.135+0000 7f2af7011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:27.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.135+0000 7f2af7011800 20 INFO: main: starting shard=8 2024-03-04T12:37:27.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.135+0000 7f2af7011800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:27.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.135+0000 7f2af7011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:27.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.135+0000 7f2af7011800 20 INFO: main: starting shard=9 2024-03-04T12:37:27.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.135+0000 7f2af7011800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:27.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.136+0000 7f2af7011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:27.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.136+0000 7f2af7011800 20 INFO: main: starting shard=10 2024-03-04T12:37:27.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.136+0000 7f2af7011800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:27.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.136+0000 7f2af7011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:27.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.136+0000 7f2af7011800 20 INFO: main: done 2024-03-04T12:37:27.143 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.137+0000 7f29a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:27.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.140+0000 7f2af7011800 20 remove_watcher() i=0 2024-03-04T12:37:27.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.140+0000 7f2af7011800 2 removed watcher, disabling cache 2024-03-04T12:37:27.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.141+0000 7f2af7011800 20 remove_watcher() i=1 2024-03-04T12:37:27.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.142+0000 7f2af7011800 20 remove_watcher() i=2 2024-03-04T12:37:27.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.144+0000 7f2af7011800 20 remove_watcher() i=3 2024-03-04T12:37:27.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.145+0000 7f2af7011800 20 remove_watcher() i=4 2024-03-04T12:37:27.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.146+0000 7f2af7011800 20 remove_watcher() i=5 2024-03-04T12:37:27.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.148+0000 7f2af7011800 20 remove_watcher() i=6 2024-03-04T12:37:27.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.149+0000 7f2af7011800 20 remove_watcher() i=7 2024-03-04T12:37:27.164 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-03-04T12:37:27.164 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:27.166 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-03-04T12:37:27.195 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:27.195 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:27.228 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.222+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.223+0000 7fa82852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:27.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.223+0000 7fa82852c800 20 realm 2024-03-04T12:37:27.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.223+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.224+0000 7fa82852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:27.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.224+0000 7fa82852c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:27.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.224+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.224+0000 7fa82852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:27.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.224+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.224+0000 7fa82852c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:27.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.224+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.225+0000 7fa82852c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:27.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.225+0000 7fa82852c800 20 searching for the correct realm 2024-03-04T12:37:27.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.229+0000 7fa824aed640 0 -- 172.21.15.90:0/740496112 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7fa80c05f630 msgr2=0x7fa80c055970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:27.441 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.435+0000 7fa8242ec640 0 -- 172.21.15.90:0/740496112 >> [v2:172.21.15.184:6824/1880219084,v1:172.21.15.184:6825/1880219084] conn(0x55a1d9465670 msgr2=0x55a1d9467aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:27.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.438+0000 7fa82852c800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:27.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.438+0000 7fa82852c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:27.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.438+0000 7fa82852c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:27.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.438+0000 7fa82852c800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:27.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.438+0000 7fa82852c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:27.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.438+0000 7fa82852c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:27.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.438+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.438+0000 7fa82852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:27.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.438+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.438+0000 7fa82852c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.438+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.439+0000 7fa82852c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.439+0000 7fa82852c800 20 zone default found 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.439+0000 7fa82852c800 4 Realm: () 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.439+0000 7fa82852c800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.439+0000 7fa82852c800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.439+0000 7fa82852c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.439+0000 7fa82852c800 20 zonegroup default 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.439+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.439+0000 7fa82852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.439+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.439+0000 7fa82852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:27.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.439+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.440+0000 7fa82852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:27.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.440+0000 7fa82852c800 20 started sync module instance, tier type = 2024-03-04T12:37:27.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.440+0000 7fa82852c800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:27.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.462+0000 7fa82852c800 20 add_watcher() i=0 2024-03-04T12:37:27.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.462+0000 7fa82852c800 20 add_watcher() i=1 2024-03-04T12:37:27.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.462+0000 7fa82852c800 20 add_watcher() i=2 2024-03-04T12:37:27.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.462+0000 7fa82852c800 20 add_watcher() i=3 2024-03-04T12:37:27.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.462+0000 7fa82852c800 20 add_watcher() i=4 2024-03-04T12:37:27.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.462+0000 7fa82852c800 20 add_watcher() i=5 2024-03-04T12:37:27.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.462+0000 7fa82852c800 20 add_watcher() i=6 2024-03-04T12:37:27.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.465+0000 7fa82852c800 20 add_watcher() i=7 2024-03-04T12:37:27.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.465+0000 7fa82852c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:27.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.467+0000 7fa6dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:27.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.467+0000 7fa82852c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:27.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.467+0000 7fa82852c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:27.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.467+0000 7fa82852c800 5 note: GC not initialized 2024-03-04T12:37:27.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.467+0000 7fa6d9fdb640 20 reqs_thread_entry: start 2024-03-04T12:37:27.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.467+0000 7fa82852c800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:27.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.467+0000 7fa82852c800 20 Filter name: none 2024-03-04T12:37:27.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.468+0000 7fa64b7fe640 20 reqs_thread_entry: start 2024-03-04T12:37:27.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.468+0000 7fa82852c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:37:27.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.468+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.468+0000 7fa82852c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:27.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.468+0000 7fa82852c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:37:27.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.468+0000 7fa82852c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:37:27.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.468+0000 7fa82852c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 : miss 2024-03-04T12:37:27.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.468+0000 7fa82852c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:27.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.469+0000 7fa82852c800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:27.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.469+0000 7fa82852c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 info.flags=0x17 2024-03-04T12:37:27.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.469+0000 7fa82852c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 to cache LRU end 2024-03-04T12:37:27.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.469+0000 7fa82852c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:27.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.469+0000 7fa82852c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:37:27.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.469+0000 7fa82852c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 2024-03-04T12:37:27.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.469+0000 7fa82852c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:27.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.469+0000 7fa82852c800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-04T12:37:27.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.469+0000 7fa82852c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:27.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.470+0000 7fa82852c800 1 NOTICE: finished shard 1 (0 entries found) 2024-03-04T12:37:27.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.470+0000 7fa82852c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:27.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.470+0000 7fa82852c800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-04T12:37:27.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.470+0000 7fa82852c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:27.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.470+0000 7fa82852c800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-04T12:37:27.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.470+0000 7fa82852c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:27.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.471+0000 7fa82852c800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-04T12:37:27.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.471+0000 7fa82852c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:27.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.471+0000 7fa82852c800 1 NOTICE: finished shard 5 (0 entries found) 2024-03-04T12:37:27.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.471+0000 7fa82852c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:27.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.472+0000 7fa82852c800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-04T12:37:27.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.472+0000 7fa82852c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:27.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.472+0000 7fa82852c800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-04T12:37:27.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.472+0000 7fa82852c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:27.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.473+0000 7fa82852c800 1 NOTICE: finished shard 8 (0 entries found) 2024-03-04T12:37:27.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.473+0000 7fa82852c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:27.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.473+0000 7fa82852c800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-04T12:37:27.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.473+0000 7fa82852c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:27.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.474+0000 7fa82852c800 1 NOTICE: finished shard 10 (0 entries found) 2024-03-04T12:37:27.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.474+0000 7fa82852c800 1 NOTICE: finished all shards (0 entries found) 2024-03-04T12:37:27.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.474+0000 7fa6dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:27.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.477+0000 7fa82852c800 20 remove_watcher() i=0 2024-03-04T12:37:27.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.477+0000 7fa82852c800 2 removed watcher, disabling cache 2024-03-04T12:37:27.484 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.478+0000 7fa82852c800 20 remove_watcher() i=1 2024-03-04T12:37:27.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.481+0000 7fa82852c800 20 remove_watcher() i=2 2024-03-04T12:37:27.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.482+0000 7fa82852c800 20 remove_watcher() i=3 2024-03-04T12:37:27.490 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.484+0000 7fa82852c800 20 remove_watcher() i=4 2024-03-04T12:37:27.491 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.485+0000 7fa82852c800 20 remove_watcher() i=5 2024-03-04T12:37:27.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.487+0000 7fa82852c800 20 remove_watcher() i=6 2024-03-04T12:37:27.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:27.488+0000 7fa82852c800 20 remove_watcher() i=7 2024-03-04T12:37:27.503 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-03-04T12:37:27.503 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:27.505 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.505 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.509 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.509 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.511 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.512 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.555 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-03-04T12:37:27.555 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:37:27.556 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.556 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.600 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.600 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.643 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.643 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.657 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.657 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.660 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.661 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.672 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.673 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.675 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.676 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.688 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.688 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.691 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.691 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.705 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.705 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.707 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.707 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.722 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.722 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.725 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.725 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.739 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:27.739 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:27.742 INFO:tasks.workunit.client.0.smithi090.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-04T12:37:28.121 INFO:tasks.workunit.client.0.smithi090.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-04T12:37:29.506 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:29.506 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:29.558 INFO:tasks.workunit.client.0.smithi090.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:37:29.560 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-04T12:37:29.592 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:29.592 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:29.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.622+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.624+0000 7f686012a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:29.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.624+0000 7f686012a800 20 realm 2024-03-04T12:37:29.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.624+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.624+0000 7f686012a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:29.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.624+0000 7f686012a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:29.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.624+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.624+0000 7f686012a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:29.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.624+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.625+0000 7f686012a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:29.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.625+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.625+0000 7f686012a800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:29.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.625+0000 7f686012a800 20 searching for the correct realm 2024-03-04T12:37:29.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.629+0000 7f685beec640 0 -- 172.21.15.90:0/1799694027 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f685406d040 msgr2=0x7f6854055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:29.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.633+0000 7f685beec640 0 -- 172.21.15.90:0/1799694027 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f685007f430 msgr2=0x7f685000d070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:29.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.840+0000 7f686012a800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:29.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.840+0000 7f686012a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:29.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.840+0000 7f686012a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:29.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.840+0000 7f686012a800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:29.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.840+0000 7f686012a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:29.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.840+0000 7f686012a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:29.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.840+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.840+0000 7f686012a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:29.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.840+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.841+0000 7f686012a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:29.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.841+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.841+0000 7f686012a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:29.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.841+0000 7f686012a800 20 zone default found 2024-03-04T12:37:29.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.841+0000 7f686012a800 4 Realm: () 2024-03-04T12:37:29.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.841+0000 7f686012a800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:29.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.841+0000 7f686012a800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:29.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.841+0000 7f686012a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:29.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.841+0000 7f686012a800 20 zonegroup default 2024-03-04T12:37:29.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.841+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.841+0000 7f686012a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:29.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.841+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.842+0000 7f686012a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:29.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.842+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.842+0000 7f686012a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:29.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.842+0000 7f686012a800 20 started sync module instance, tier type = 2024-03-04T12:37:29.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.842+0000 7f686012a800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:29.860 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.854+0000 7f686012a800 20 add_watcher() i=0 2024-03-04T12:37:29.860 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.854+0000 7f686012a800 20 add_watcher() i=1 2024-03-04T12:37:29.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.854+0000 7f686012a800 20 add_watcher() i=2 2024-03-04T12:37:29.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.854+0000 7f686012a800 20 add_watcher() i=3 2024-03-04T12:37:29.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.854+0000 7f686012a800 20 add_watcher() i=4 2024-03-04T12:37:29.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.854+0000 7f686012a800 20 add_watcher() i=5 2024-03-04T12:37:29.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.854+0000 7f686012a800 20 add_watcher() i=6 2024-03-04T12:37:29.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.855+0000 7f686012a800 20 add_watcher() i=7 2024-03-04T12:37:29.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.855+0000 7f686012a800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:29.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.857+0000 7f6711fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:29.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.857+0000 7f686012a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:29.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.857+0000 7f686012a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:29.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.857+0000 7f686012a800 5 note: GC not initialized 2024-03-04T12:37:29.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.857+0000 7f6710fe1640 20 reqs_thread_entry: start 2024-03-04T12:37:29.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.857+0000 7f686012a800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:29.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.857+0000 7f686012a800 20 Filter name: none 2024-03-04T12:37:29.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.858+0000 7f668a7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:29.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.858+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.858+0000 7f686012a800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:29.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.858+0000 7f686012a800 20 rados->read ofs=0 len=0 2024-03-04T12:37:29.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.859+0000 7f686012a800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:29.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.859+0000 7f686012a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:29.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.859+0000 7f686012a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:37:29.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.859+0000 7f686012a800 20 INFO: main: starting shard=0 2024-03-04T12:37:29.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.859+0000 7f686012a800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:29.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.859+0000 7f686012a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:29.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.859+0000 7f686012a800 20 INFO: main: starting shard=1 2024-03-04T12:37:29.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.859+0000 7f686012a800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:29.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.860+0000 7f686012a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:29.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.860+0000 7f686012a800 20 INFO: main: starting shard=2 2024-03-04T12:37:29.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.860+0000 7f686012a800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:29.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.861+0000 7f686012a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:29.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.861+0000 7f686012a800 20 INFO: main: starting shard=3 2024-03-04T12:37:29.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.861+0000 7f686012a800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:29.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.861+0000 7f686012a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:29.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.861+0000 7f686012a800 20 INFO: main: starting shard=4 2024-03-04T12:37:29.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.861+0000 7f686012a800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:29.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.862+0000 7f686012a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:29.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.862+0000 7f686012a800 20 INFO: main: starting shard=5 2024-03-04T12:37:29.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.862+0000 7f686012a800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:29.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.862+0000 7f686012a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:29.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.862+0000 7f686012a800 20 INFO: main: starting shard=6 2024-03-04T12:37:29.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.862+0000 7f686012a800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:29.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.863+0000 7f686012a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:29.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.863+0000 7f686012a800 20 INFO: main: starting shard=7 2024-03-04T12:37:29.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.863+0000 7f686012a800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:29.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.863+0000 7f686012a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:29.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.863+0000 7f686012a800 20 INFO: main: starting shard=8 2024-03-04T12:37:29.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.863+0000 7f686012a800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:29.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.864+0000 7f686012a800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-04T12:37:29.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.864+0000 7f686012a800 20 INFO: main: starting shard=9 2024-03-04T12:37:29.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.864+0000 7f686012a800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:29.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.865+0000 7f686012a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:29.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.865+0000 7f686012a800 20 INFO: main: starting shard=10 2024-03-04T12:37:29.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.865+0000 7f686012a800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:29.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.865+0000 7f686012a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:29.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.865+0000 7f686012a800 20 INFO: main: done 2024-03-04T12:37:29.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.866+0000 7f6711fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:29.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.868+0000 7f686012a800 20 remove_watcher() i=0 2024-03-04T12:37:29.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.868+0000 7f686012a800 2 removed watcher, disabling cache 2024-03-04T12:37:29.877 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.870+0000 7f686012a800 20 remove_watcher() i=1 2024-03-04T12:37:29.877 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.871+0000 7f686012a800 20 remove_watcher() i=2 2024-03-04T12:37:29.878 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.872+0000 7f686012a800 20 remove_watcher() i=3 2024-03-04T12:37:29.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.874+0000 7f686012a800 20 remove_watcher() i=4 2024-03-04T12:37:29.880 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.875+0000 7f686012a800 20 remove_watcher() i=5 2024-03-04T12:37:29.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.876+0000 7f686012a800 20 remove_watcher() i=6 2024-03-04T12:37:29.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:29.877+0000 7f686012a800 20 remove_watcher() i=7 2024-03-04T12:37:29.895 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:29.895 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:29.898 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:29.898 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:29.901 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:29.901 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:29.954 INFO:tasks.workunit.client.0.smithi090.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:37:29.955 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-04T12:37:29.984 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:29.984 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:30.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.010+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.018 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.012+0000 7fcf82814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.018 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.012+0000 7fcf82814800 20 realm 2024-03-04T12:37:30.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.012+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.012+0000 7fcf82814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.012+0000 7fcf82814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:30.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.012+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.012+0000 7fcf82814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.012+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.013+0000 7fcf82814800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:30.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.013+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.014+0000 7fcf82814800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:30.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.014+0000 7fcf82814800 20 searching for the correct realm 2024-03-04T12:37:30.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.017+0000 7fcf7df5e640 0 -- 172.21.15.90:0/3745839305 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7fcf7802b020 msgr2=0x7fcf7806f8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:30.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.020+0000 7fcf7df5e640 0 -- 172.21.15.90:0/3745839305 >> [v2:172.21.15.184:6824/1880219084,v1:172.21.15.184:6825/1880219084] conn(0x55a4230900c0 msgr2=0x55a4230924b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:30.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.025+0000 7fcf82814800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:30.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.025+0000 7fcf82814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:30.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.025+0000 7fcf82814800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:30.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.025+0000 7fcf82814800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:30.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.025+0000 7fcf82814800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:30.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.025+0000 7fcf82814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:30.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.025+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.025+0000 7fcf82814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.025+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.025+0000 7fcf82814800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:30.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.026+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.026+0000 7fcf82814800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.026+0000 7fcf82814800 20 zone default found 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.026+0000 7fcf82814800 4 Realm: () 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.026+0000 7fcf82814800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.026+0000 7fcf82814800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.026+0000 7fcf82814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.026+0000 7fcf82814800 20 zonegroup default 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.026+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.026+0000 7fcf82814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.026+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.027+0000 7fcf82814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.027+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.027+0000 7fcf82814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.027+0000 7fcf82814800 20 started sync module instance, tier type = 2024-03-04T12:37:30.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.027+0000 7fcf82814800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:30.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.037+0000 7fcf82814800 20 add_watcher() i=0 2024-03-04T12:37:30.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.037+0000 7fcf82814800 20 add_watcher() i=1 2024-03-04T12:37:30.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.037+0000 7fcf82814800 20 add_watcher() i=2 2024-03-04T12:37:30.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.037+0000 7fcf82814800 20 add_watcher() i=3 2024-03-04T12:37:30.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.037+0000 7fcf82814800 20 add_watcher() i=4 2024-03-04T12:37:30.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.037+0000 7fcf82814800 20 add_watcher() i=5 2024-03-04T12:37:30.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.037+0000 7fcf82814800 20 add_watcher() i=6 2024-03-04T12:37:30.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.037+0000 7fcf82814800 20 add_watcher() i=7 2024-03-04T12:37:30.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.037+0000 7fcf82814800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:30.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.039+0000 7fce2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:30.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.039+0000 7fcf82814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:30.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.039+0000 7fcf82814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:30.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.040+0000 7fcf82814800 5 note: GC not initialized 2024-03-04T12:37:30.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.040+0000 7fce2e7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:30.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.040+0000 7fcf82814800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:30.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.040+0000 7fcf82814800 20 Filter name: none 2024-03-04T12:37:30.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.040+0000 7fcd9ffff640 20 reqs_thread_entry: start 2024-03-04T12:37:30.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.040+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.040+0000 7fcf82814800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:30.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.040+0000 7fcf82814800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.041+0000 7fcf82814800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:30.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.041+0000 7fcf82814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:30.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.041+0000 7fcf82814800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:37:30.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.041+0000 7fcf82814800 20 INFO: main: starting shard=0 2024-03-04T12:37:30.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.041+0000 7fcf82814800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:30.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.042+0000 7fcf82814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.042+0000 7fcf82814800 20 INFO: main: starting shard=1 2024-03-04T12:37:30.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.042+0000 7fcf82814800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:30.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.042+0000 7fcf82814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.042+0000 7fcf82814800 20 INFO: main: starting shard=2 2024-03-04T12:37:30.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.042+0000 7fcf82814800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:30.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.042+0000 7fcf82814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.042+0000 7fcf82814800 20 INFO: main: starting shard=3 2024-03-04T12:37:30.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.042+0000 7fcf82814800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:30.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.043+0000 7fcf82814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.043+0000 7fcf82814800 20 INFO: main: starting shard=4 2024-03-04T12:37:30.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.043+0000 7fcf82814800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:30.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.044+0000 7fcf82814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.044+0000 7fcf82814800 20 INFO: main: starting shard=5 2024-03-04T12:37:30.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.044+0000 7fcf82814800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:30.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.044+0000 7fcf82814800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-04T12:37:30.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.044+0000 7fcf82814800 20 INFO: main: starting shard=6 2024-03-04T12:37:30.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.044+0000 7fcf82814800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:30.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.045+0000 7fcf82814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.045+0000 7fcf82814800 20 INFO: main: starting shard=7 2024-03-04T12:37:30.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.045+0000 7fcf82814800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:30.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.045+0000 7fcf82814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.045+0000 7fcf82814800 20 INFO: main: starting shard=8 2024-03-04T12:37:30.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.045+0000 7fcf82814800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:30.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.046+0000 7fcf82814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.046+0000 7fcf82814800 20 INFO: main: starting shard=9 2024-03-04T12:37:30.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.046+0000 7fcf82814800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:30.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.046+0000 7fcf82814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.046+0000 7fcf82814800 20 INFO: main: starting shard=10 2024-03-04T12:37:30.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.046+0000 7fcf82814800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:30.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.047+0000 7fcf82814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.047+0000 7fcf82814800 20 INFO: main: done 2024-03-04T12:37:30.054 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.048+0000 7fce2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:30.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.050+0000 7fcf82814800 20 remove_watcher() i=0 2024-03-04T12:37:30.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.050+0000 7fcf82814800 2 removed watcher, disabling cache 2024-03-04T12:37:30.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.051+0000 7fcf82814800 20 remove_watcher() i=1 2024-03-04T12:37:30.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.052+0000 7fcf82814800 20 remove_watcher() i=2 2024-03-04T12:37:30.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.053+0000 7fcf82814800 20 remove_watcher() i=3 2024-03-04T12:37:30.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.054+0000 7fcf82814800 20 remove_watcher() i=4 2024-03-04T12:37:30.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.055+0000 7fcf82814800 20 remove_watcher() i=5 2024-03-04T12:37:30.062 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.056+0000 7fcf82814800 20 remove_watcher() i=6 2024-03-04T12:37:30.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.057+0000 7fcf82814800 20 remove_watcher() i=7 2024-03-04T12:37:30.075 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:30.076 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:30.079 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:30.079 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:30.130 INFO:tasks.workunit.client.0.smithi090.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:37:30.131 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-03-04T12:37:30.160 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:30.160 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:30.192 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.186+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.194 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.188+0000 7f663a52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.194 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.188+0000 7f663a52f800 20 realm 2024-03-04T12:37:30.194 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.188+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.194 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.188+0000 7f663a52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.194 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.188+0000 7f663a52f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:30.194 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.188+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.194 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.188+0000 7f663a52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.195 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.188+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.195 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.189+0000 7f663a52f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:30.195 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.189+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.190+0000 7f663a52f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:30.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.190+0000 7f663a52f800 20 searching for the correct realm 2024-03-04T12:37:30.198 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.193+0000 7f66369f8640 0 -- 172.21.15.90:0/3945536449 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x562e93feb940 msgr2=0x562e93fede00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:30.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.196+0000 7f66361f7640 0 -- 172.21.15.90:0/3945536449 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f662c00f6f0 msgr2=0x7f662c02a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:30.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.200+0000 7f663a52f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:30.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.200+0000 7f663a52f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:30.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.200+0000 7f663a52f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:30.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.200+0000 7f663a52f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:30.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.200+0000 7f663a52f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:30.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.200+0000 7f663a52f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:30.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.200+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.200+0000 7f663a52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.200+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:30.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:30.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 20 zone default found 2024-03-04T12:37:30.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 4 Realm: () 2024-03-04T12:37:30.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:30.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:30.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:30.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 20 zonegroup default 2024-03-04T12:37:30.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.201+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.202+0000 7f663a52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.202+0000 7f663a52f800 20 started sync module instance, tier type = 2024-03-04T12:37:30.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.202+0000 7f663a52f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:30.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.221+0000 7f663a52f800 20 add_watcher() i=0 2024-03-04T12:37:30.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.221+0000 7f663a52f800 20 add_watcher() i=1 2024-03-04T12:37:30.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.221+0000 7f663a52f800 20 add_watcher() i=2 2024-03-04T12:37:30.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.221+0000 7f663a52f800 20 add_watcher() i=3 2024-03-04T12:37:30.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.221+0000 7f663a52f800 20 add_watcher() i=4 2024-03-04T12:37:30.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.221+0000 7f663a52f800 20 add_watcher() i=5 2024-03-04T12:37:30.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.221+0000 7f663a52f800 20 add_watcher() i=6 2024-03-04T12:37:30.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.223+0000 7f663a52f800 20 add_watcher() i=7 2024-03-04T12:37:30.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.223+0000 7f663a52f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:30.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.226+0000 7f64ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:30.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.227+0000 7f663a52f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:30.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.227+0000 7f663a52f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:30.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.227+0000 7f663a52f800 5 note: GC not initialized 2024-03-04T12:37:30.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.227+0000 7f64677fe640 20 reqs_thread_entry: start 2024-03-04T12:37:30.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.227+0000 7f663a52f800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:30.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.227+0000 7f663a52f800 20 Filter name: none 2024-03-04T12:37:30.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.227+0000 7f64657fa640 20 reqs_thread_entry: start 2024-03-04T12:37:30.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.227+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.228+0000 7f663a52f800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:30.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.228+0000 7f663a52f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.228+0000 7f663a52f800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:30.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.228+0000 7f663a52f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:30.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.228+0000 7f663a52f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:37:30.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.228+0000 7f663a52f800 20 INFO: main: starting shard=0 2024-03-04T12:37:30.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.228+0000 7f663a52f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:30.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.229+0000 7f663a52f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.229+0000 7f663a52f800 20 INFO: main: starting shard=1 2024-03-04T12:37:30.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.229+0000 7f663a52f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:30.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.229+0000 7f663a52f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:37:30.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.229+0000 7f663a52f800 20 INFO: main: starting shard=2 2024-03-04T12:37:30.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.229+0000 7f663a52f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:30.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.230+0000 7f663a52f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.230+0000 7f663a52f800 20 INFO: main: starting shard=3 2024-03-04T12:37:30.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.230+0000 7f663a52f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:30.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.230+0000 7f663a52f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.230+0000 7f663a52f800 20 INFO: main: starting shard=4 2024-03-04T12:37:30.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.230+0000 7f663a52f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:30.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.230+0000 7f663a52f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.230+0000 7f663a52f800 20 INFO: main: starting shard=5 2024-03-04T12:37:30.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.230+0000 7f663a52f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:30.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.231+0000 7f663a52f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.231+0000 7f663a52f800 20 INFO: main: starting shard=6 2024-03-04T12:37:30.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.231+0000 7f663a52f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:30.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.231+0000 7f663a52f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.231+0000 7f663a52f800 20 INFO: main: starting shard=7 2024-03-04T12:37:30.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.231+0000 7f663a52f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:30.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.232+0000 7f663a52f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.232+0000 7f663a52f800 20 INFO: main: starting shard=8 2024-03-04T12:37:30.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.232+0000 7f663a52f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:30.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.232+0000 7f663a52f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.232+0000 7f663a52f800 20 INFO: main: starting shard=9 2024-03-04T12:37:30.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.232+0000 7f663a52f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:30.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.233+0000 7f663a52f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.233+0000 7f663a52f800 20 INFO: main: starting shard=10 2024-03-04T12:37:30.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.233+0000 7f663a52f800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:30.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.233+0000 7f663a52f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.233+0000 7f663a52f800 20 INFO: main: done 2024-03-04T12:37:30.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.234+0000 7f64ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:30.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.236+0000 7f663a52f800 20 remove_watcher() i=0 2024-03-04T12:37:30.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.236+0000 7f663a52f800 2 removed watcher, disabling cache 2024-03-04T12:37:30.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.238+0000 7f663a52f800 20 remove_watcher() i=1 2024-03-04T12:37:30.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.239+0000 7f663a52f800 20 remove_watcher() i=2 2024-03-04T12:37:30.246 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.241+0000 7f663a52f800 20 remove_watcher() i=3 2024-03-04T12:37:30.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.242+0000 7f663a52f800 20 remove_watcher() i=4 2024-03-04T12:37:30.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.243+0000 7f663a52f800 20 remove_watcher() i=5 2024-03-04T12:37:30.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.245+0000 7f663a52f800 20 remove_watcher() i=6 2024-03-04T12:37:30.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.246+0000 7f663a52f800 20 remove_watcher() i=7 2024-03-04T12:37:30.263 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:30.263 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:30.266 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:30.266 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:30.318 INFO:tasks.workunit.client.0.smithi090.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:37:30.319 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-03-04T12:37:30.348 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:30.348 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:30.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.375+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.376+0000 7f93bb130800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.376+0000 7f93bb130800 20 realm 2024-03-04T12:37:30.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.376+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.376+0000 7f93bb130800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.376+0000 7f93bb130800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:30.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.376+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.377+0000 7f93bb130800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.377+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.377+0000 7f93bb130800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:30.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.377+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.378+0000 7f93bb130800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:30.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.378+0000 7f93bb130800 20 searching for the correct realm 2024-03-04T12:37:30.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.381+0000 7f93b6ef6640 0 -- 172.21.15.90:0/712552443 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f93b0066070 msgr2=0x7f93b007e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:30.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.384+0000 7f93b6ef6640 0 -- 172.21.15.90:0/712552443 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f93a005c8d0 msgr2=0x7f93a00513a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:30.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.590+0000 7f93bb130800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:30.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.590+0000 7f93bb130800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:30.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.590+0000 7f93bb130800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:30.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.590+0000 7f93bb130800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:30.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.590+0000 7f93bb130800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:30.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.590+0000 7f93bb130800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:30.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.590+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.590+0000 7f93bb130800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.590+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.590+0000 7f93bb130800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:30.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.590+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.591+0000 7f93bb130800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:30.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.591+0000 7f93bb130800 20 zone default found 2024-03-04T12:37:30.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.591+0000 7f93bb130800 4 Realm: () 2024-03-04T12:37:30.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.591+0000 7f93bb130800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:30.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.591+0000 7f93bb130800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:30.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.591+0000 7f93bb130800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:30.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.591+0000 7f93bb130800 20 zonegroup default 2024-03-04T12:37:30.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.591+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.591+0000 7f93bb130800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.591+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.591+0000 7f93bb130800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.591+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.592+0000 7f93bb130800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:30.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.592+0000 7f93bb130800 20 started sync module instance, tier type = 2024-03-04T12:37:30.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.592+0000 7f93bb130800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:30.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.610+0000 7f93bb130800 20 add_watcher() i=0 2024-03-04T12:37:30.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.610+0000 7f93bb130800 20 add_watcher() i=1 2024-03-04T12:37:30.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.610+0000 7f93bb130800 20 add_watcher() i=2 2024-03-04T12:37:30.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.610+0000 7f93bb130800 20 add_watcher() i=3 2024-03-04T12:37:30.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.610+0000 7f93bb130800 20 add_watcher() i=4 2024-03-04T12:37:30.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.610+0000 7f93bb130800 20 add_watcher() i=5 2024-03-04T12:37:30.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.610+0000 7f93bb130800 20 add_watcher() i=6 2024-03-04T12:37:30.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.611+0000 7f93bb130800 20 add_watcher() i=7 2024-03-04T12:37:30.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.611+0000 7f93bb130800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:30.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.613+0000 7f926d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:30.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.613+0000 7f93bb130800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:30.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.613+0000 7f93bb130800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:30.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.613+0000 7f93bb130800 5 note: GC not initialized 2024-03-04T12:37:30.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.613+0000 7f91e7fff640 20 reqs_thread_entry: start 2024-03-04T12:37:30.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.613+0000 7f93bb130800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:30.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.614+0000 7f93bb130800 20 Filter name: none 2024-03-04T12:37:30.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.614+0000 7f91e5ffb640 20 reqs_thread_entry: start 2024-03-04T12:37:30.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.614+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.614+0000 7f93bb130800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:30.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.614+0000 7f93bb130800 20 rados->read ofs=0 len=0 2024-03-04T12:37:30.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.615+0000 7f93bb130800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:30.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.615+0000 7f93bb130800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:30.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.615+0000 7f93bb130800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:37:30.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.615+0000 7f93bb130800 20 INFO: main: starting shard=0 2024-03-04T12:37:30.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.615+0000 7f93bb130800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:30.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.615+0000 7f93bb130800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.615+0000 7f93bb130800 20 INFO: main: starting shard=1 2024-03-04T12:37:30.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.615+0000 7f93bb130800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:30.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.616+0000 7f93bb130800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.616+0000 7f93bb130800 20 INFO: main: starting shard=2 2024-03-04T12:37:30.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.616+0000 7f93bb130800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:30.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.617+0000 7f93bb130800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.617+0000 7f93bb130800 20 INFO: main: starting shard=3 2024-03-04T12:37:30.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.617+0000 7f93bb130800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:30.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.617+0000 7f93bb130800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.617+0000 7f93bb130800 20 INFO: main: starting shard=4 2024-03-04T12:37:30.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.617+0000 7f93bb130800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:30.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.618+0000 7f93bb130800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.618+0000 7f93bb130800 20 INFO: main: starting shard=5 2024-03-04T12:37:30.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.618+0000 7f93bb130800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:30.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.618+0000 7f93bb130800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.618+0000 7f93bb130800 20 INFO: main: starting shard=6 2024-03-04T12:37:30.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.618+0000 7f93bb130800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:30.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.619+0000 7f93bb130800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.619+0000 7f93bb130800 20 INFO: main: starting shard=7 2024-03-04T12:37:30.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.619+0000 7f93bb130800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:30.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.619+0000 7f93bb130800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.619+0000 7f93bb130800 20 INFO: main: starting shard=8 2024-03-04T12:37:30.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.619+0000 7f93bb130800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:30.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.620+0000 7f93bb130800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.620+0000 7f93bb130800 20 INFO: main: starting shard=9 2024-03-04T12:37:30.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.620+0000 7f93bb130800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:30.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.620+0000 7f93bb130800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:30.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.620+0000 7f93bb130800 20 INFO: main: starting shard=10 2024-03-04T12:37:30.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.620+0000 7f93bb130800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:30.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.621+0000 7f93bb130800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:37:30.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.621+0000 7f93bb130800 20 INFO: main: done 2024-03-04T12:37:30.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.622+0000 7f926d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:30.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.624+0000 7f93bb130800 20 remove_watcher() i=0 2024-03-04T12:37:30.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.624+0000 7f93bb130800 2 removed watcher, disabling cache 2024-03-04T12:37:30.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.625+0000 7f93bb130800 20 remove_watcher() i=1 2024-03-04T12:37:30.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.626+0000 7f93bb130800 20 remove_watcher() i=2 2024-03-04T12:37:30.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.628+0000 7f93bb130800 20 remove_watcher() i=3 2024-03-04T12:37:30.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.629+0000 7f93bb130800 20 remove_watcher() i=4 2024-03-04T12:37:30.636 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.630+0000 7f93bb130800 20 remove_watcher() i=5 2024-03-04T12:37:30.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.633+0000 7f93bb130800 20 remove_watcher() i=6 2024-03-04T12:37:30.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:30.634+0000 7f93bb130800 20 remove_watcher() i=7 2024-03-04T12:37:30.651 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:30.651 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:30.655 INFO:tasks.workunit.client.0.smithi090.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-04T12:37:31.036 INFO:tasks.workunit.client.0.smithi090.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-04T12:37:31.422 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-03-04T12:37:31.450 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:31.451 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:31.484 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.478+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.479+0000 7f4770234800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:31.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.479+0000 7f4770234800 20 realm 2024-03-04T12:37:31.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.479+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.480+0000 7f4770234800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:31.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.480+0000 7f4770234800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:31.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.480+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.480+0000 7f4770234800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:31.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.480+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.481+0000 7f4770234800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:31.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.481+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.481+0000 7f4770234800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:31.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.481+0000 7f4770234800 20 searching for the correct realm 2024-03-04T12:37:31.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.483+0000 7f476b4d9640 0 -- 172.21.15.90:0/3433175454 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x55fa455d0610 msgr2=0x7f4764065950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:31.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.689+0000 7f4762cd8640 0 -- 172.21.15.90:0/3433175454 >> [v2:172.21.15.90:6817/137526376,v1:172.21.15.90:6819/137526376] conn(0x55fa4584bc50 msgr2=0x55fa4584e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:31.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.696+0000 7f4770234800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:31.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.696+0000 7f4770234800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:31.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.696+0000 7f4770234800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:31.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.696+0000 7f4770234800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:31.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.696+0000 7f4770234800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:31.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.696+0000 7f4770234800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:31.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.696+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.696+0000 7f4770234800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:31.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.696+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.697+0000 7f4770234800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:31.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.697+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.697+0000 7f4770234800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:31.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.697+0000 7f4770234800 20 zone default found 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.697+0000 7f4770234800 4 Realm: () 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.697+0000 7f4770234800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.697+0000 7f4770234800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.697+0000 7f4770234800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.697+0000 7f4770234800 20 zonegroup default 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.697+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.697+0000 7f4770234800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.697+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.698+0000 7f4770234800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.698+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.698+0000 7f4770234800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.698+0000 7f4770234800 20 started sync module instance, tier type = 2024-03-04T12:37:31.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.698+0000 7f4770234800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:31.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.709+0000 7f4770234800 20 add_watcher() i=0 2024-03-04T12:37:31.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.709+0000 7f4770234800 20 add_watcher() i=1 2024-03-04T12:37:31.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.709+0000 7f4770234800 20 add_watcher() i=2 2024-03-04T12:37:31.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.709+0000 7f4770234800 20 add_watcher() i=3 2024-03-04T12:37:31.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.709+0000 7f4770234800 20 add_watcher() i=4 2024-03-04T12:37:31.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.709+0000 7f4770234800 20 add_watcher() i=5 2024-03-04T12:37:31.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.709+0000 7f4770234800 20 add_watcher() i=6 2024-03-04T12:37:31.716 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.710+0000 7f4770234800 20 add_watcher() i=7 2024-03-04T12:37:31.716 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.710+0000 7f4770234800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:31.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.712+0000 7f4621fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:31.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.712+0000 7f4770234800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:31.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.712+0000 7f4770234800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:31.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.712+0000 7f4770234800 5 note: GC not initialized 2024-03-04T12:37:31.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.712+0000 7f4620fe1640 20 reqs_thread_entry: start 2024-03-04T12:37:31.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.712+0000 7f4770234800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:31.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.712+0000 7f4770234800 20 Filter name: none 2024-03-04T12:37:31.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.712+0000 7f459a7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:31.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.713+0000 7f4770234800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:37:31.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.713+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.713+0000 7f4770234800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:31.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.713+0000 7f4770234800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:37:31.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.713+0000 7f4770234800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:37:31.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.713+0000 7f4770234800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 : miss 2024-03-04T12:37:31.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.713+0000 7f4770234800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.714+0000 7f4770234800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:31.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.714+0000 7f4770234800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 info.flags=0x17 2024-03-04T12:37:31.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.714+0000 7f4770234800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 to cache LRU end 2024-03-04T12:37:31.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.714+0000 7f4770234800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:31.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.714+0000 7f4770234800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:37:31.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.714+0000 7f4770234800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 2024-03-04T12:37:31.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.714+0000 7f4770234800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:37:31.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.714+0000 7f4770234800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:37:31.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.715+0000 7f4770234800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:37:31.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.715+0000 7f4770234800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:37:31.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.715+0000 7f4770234800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:37:31.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.715+0000 7f4770234800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:37:31.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.719+0000 7f4621fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:31.727 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.722+0000 7f4770234800 20 remove_watcher() i=0 2024-03-04T12:37:31.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.722+0000 7f4770234800 2 removed watcher, disabling cache 2024-03-04T12:37:31.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.723+0000 7f4770234800 20 remove_watcher() i=1 2024-03-04T12:37:31.730 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.724+0000 7f4770234800 20 remove_watcher() i=2 2024-03-04T12:37:31.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.726+0000 7f4770234800 20 remove_watcher() i=3 2024-03-04T12:37:31.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.727+0000 7f4770234800 20 remove_watcher() i=4 2024-03-04T12:37:31.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.728+0000 7f4770234800 20 remove_watcher() i=5 2024-03-04T12:37:31.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.729+0000 7f4770234800 20 remove_watcher() i=6 2024-03-04T12:37:31.736 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.730+0000 7f4770234800 20 remove_watcher() i=7 2024-03-04T12:37:31.746 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-04T12:37:31.780 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:31.780 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:31.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.806+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.808+0000 7f956cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:31.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.808+0000 7f956cfa2800 20 realm 2024-03-04T12:37:31.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.808+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.808+0000 7f956cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:31.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.808+0000 7f956cfa2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:31.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.808+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:31.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.808+0000 7f956cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:31.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:31.808+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.010+0000 7f956cfa2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:32.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.010+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.017 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.011+0000 7f956cfa2800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:32.017 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.011+0000 7f956cfa2800 20 searching for the correct realm 2024-03-04T12:37:32.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.015+0000 7f956a2a4640 0 -- 172.21.15.90:0/556423422 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f956005b040 msgr2=0x7f956007f900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:32.024 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.018+0000 7f956a2a4640 0 -- 172.21.15.90:0/556423422 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f9434077290 msgr2=0x7f94340796c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:32.029 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.022+0000 7f956cfa2800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.022+0000 7f956cfa2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.022+0000 7f956cfa2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.022+0000 7f956cfa2800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.022+0000 7f956cfa2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.022+0000 7f956cfa2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.022+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.022+0000 7f956cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.022+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.023+0000 7f956cfa2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.023+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.023+0000 7f956cfa2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.023+0000 7f956cfa2800 20 zone default found 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.023+0000 7f956cfa2800 4 Realm: () 2024-03-04T12:37:32.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.023+0000 7f956cfa2800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:32.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.023+0000 7f956cfa2800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:32.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.023+0000 7f956cfa2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:32.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.023+0000 7f956cfa2800 20 zonegroup default 2024-03-04T12:37:32.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.023+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.023+0000 7f956cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:32.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.023+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.024+0000 7f956cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:32.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.024+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.024+0000 7f956cfa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:32.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.024+0000 7f956cfa2800 20 started sync module instance, tier type = 2024-03-04T12:37:32.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.024+0000 7f956cfa2800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:32.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.038+0000 7f956cfa2800 20 add_watcher() i=0 2024-03-04T12:37:32.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.038+0000 7f956cfa2800 20 add_watcher() i=1 2024-03-04T12:37:32.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.038+0000 7f956cfa2800 20 add_watcher() i=2 2024-03-04T12:37:32.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.038+0000 7f956cfa2800 20 add_watcher() i=3 2024-03-04T12:37:32.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.038+0000 7f956cfa2800 20 add_watcher() i=4 2024-03-04T12:37:32.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.038+0000 7f956cfa2800 20 add_watcher() i=5 2024-03-04T12:37:32.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.038+0000 7f956cfa2800 20 add_watcher() i=6 2024-03-04T12:37:32.045 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.039+0000 7f956cfa2800 20 add_watcher() i=7 2024-03-04T12:37:32.045 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.039+0000 7f956cfa2800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:32.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.041+0000 7f94217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:32.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.041+0000 7f956cfa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:32.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.041+0000 7f956cfa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:32.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.041+0000 7f956cfa2800 5 note: GC not initialized 2024-03-04T12:37:32.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.041+0000 7f939bfff640 20 reqs_thread_entry: start 2024-03-04T12:37:32.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.041+0000 7f956cfa2800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:32.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.041+0000 7f956cfa2800 20 Filter name: none 2024-03-04T12:37:32.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.041+0000 7f9399ffb640 20 reqs_thread_entry: start 2024-03-04T12:37:32.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.041+0000 7f956cfa2800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:37:32.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.041+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.042+0000 7f956cfa2800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:32.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.042+0000 7f956cfa2800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:37:32.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.042+0000 7f956cfa2800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:37:32.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.042+0000 7f956cfa2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 : miss 2024-03-04T12:37:32.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.042+0000 7f956cfa2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.043+0000 7f956cfa2800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:32.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.043+0000 7f956cfa2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 info.flags=0x17 2024-03-04T12:37:32.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.043+0000 7f956cfa2800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 to cache LRU end 2024-03-04T12:37:32.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.043+0000 7f956cfa2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:32.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.043+0000 7f956cfa2800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:37:32.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.043+0000 7f956cfa2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1 2024-03-04T12:37:32.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.043+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.0 2024-03-04T12:37:32.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.043+0000 7f956cfa2800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-04T12:37:32.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.043+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:32.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.044+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.2 2024-03-04T12:37:32.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.044+0000 7f956cfa2800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-04T12:37:32.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.044+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.3 2024-03-04T12:37:32.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.045+0000 7f956cfa2800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-04T12:37:32.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.045+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.4 2024-03-04T12:37:32.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.045+0000 7f956cfa2800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-04T12:37:32.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.045+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:32.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.046+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.6 2024-03-04T12:37:32.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.046+0000 7f956cfa2800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-04T12:37:32.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.046+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.7 2024-03-04T12:37:32.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.047+0000 7f956cfa2800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-04T12:37:32.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.047+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:32.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.047+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.9 2024-03-04T12:37:32.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.048+0000 7f956cfa2800 1 NOTICE: finished shard 9 (0 entries removed) 2024-03-04T12:37:32.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.048+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:32.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.048+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:32.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.049+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d40fa40 obj=check-bucket:e state=0x55c89d67ee48 s->prefetch_data=0 2024-03-04T12:37:32.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.049+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:32.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.049+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d40fc20 obj=check-bucket:d state=0x55c89d67fea8 s->prefetch_data=0 2024-03-04T12:37:32.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.049+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:32.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d6b4380 obj=check-bucket:c state=0x55c89d6ae7d8 s->prefetch_data=0 2024-03-04T12:37:32.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 get_obj_state: setting s->obj_tag to i923dbij6btkz1mo0nm49r8d391xvxk5 2024-03-04T12:37:32.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 get_obj_state_impl: setting s->olh_tag to 29g29wpqdm66i01c3q7kgvmdzf1twhu9 2024-03-04T12:37:32.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=29g29wpqdm66i01c3q7kgvmdzf1twhu9 2024-03-04T12:37:32.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:32.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d681100 obj=check-bucket:f state=0x55c89d74ff18 s->prefetch_data=0 2024-03-04T12:37:32.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 get_obj_state: setting s->obj_tag to 2ijxwmei5vwc546c38v500n2okuo39kb 2024-03-04T12:37:32.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 get_obj_state_impl: setting s->olh_tag to js8759t5hl26y4jdtdkoxnaneqnw8hk1 2024-03-04T12:37:32.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=js8759t5hl26y4jdtdkoxnaneqnw8hk1 2024-03-04T12:37:32.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 get_obj_state: setting s->obj_tag to omi23silu8y3siqt0ze2lw7v184webg7 2024-03-04T12:37:32.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 get_obj_state_impl: setting s->olh_tag to nt30ekepgyh2f2cs3w3b3d0isy8z1ri8 2024-03-04T12:37:32.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nt30ekepgyh2f2cs3w3b3d0isy8z1ri8 2024-03-04T12:37:32.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 get_obj_state: setting s->obj_tag to wx5q79he8lcy7ngsp5cvm6w1meeb3pmq 2024-03-04T12:37:32.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 get_obj_state_impl: setting s->olh_tag to x7qxreu0n8uwkn1u54wgrp7pu33c1kwz 2024-03-04T12:37:32.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.050+0000 7f956cfa2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x7qxreu0n8uwkn1u54wgrp7pu33c1kwz 2024-03-04T12:37:32.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.051+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:32.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.051+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:32.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.052+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:32.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.052+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:32.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.053+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:32.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.053+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:32.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.053+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:32.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.053+0000 7f956cfa2800 20 olh_log_entry: epoch=3 op=3 key=d[3SesanqkCEyANewxD3uBxWI-rp18D0Y] 2024-03-04T12:37:32.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.053+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d40fc20 obj=check-bucket:_:3SesanqkCEyANewxD3uBxWI-rp18D0Y_d state=0x55c89d761198 s->prefetch_data=0 2024-03-04T12:37:32.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:32.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-03-04T12:37:32.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 olh_log_entry: epoch=2 op=3 key=e[8zsAnY6WBWe8ZX037nn2hSAcdoHv9er] 2024-03-04T12:37:32.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d40fa40 obj=check-bucket:_:8zsAnY6WBWe8ZX037nn2hSAcdoHv9er_e state=0x55c89d768078 s->prefetch_data=0 2024-03-04T12:37:32.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 olh_log_entry: epoch=3 op=3 key=c[uZ0NjeykJL8hnG5MK5LiHT4O3Vnxh8a] 2024-03-04T12:37:32.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d6b4380 obj=check-bucket:_:uZ0NjeykJL8hnG5MK5LiHT4O3Vnxh8a_c state=0x55c89d74ef08 s->prefetch_data=0 2024-03-04T12:37:32.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-03-04T12:37:32.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 olh_log_entry: epoch=2 op=3 key=f[g397U3WB3esa1LI3dOKtv0Mw2MtwaTK] 2024-03-04T12:37:32.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d681100 obj=check-bucket:_:g397U3WB3esa1LI3dOKtv0Mw2MtwaTK_f state=0x55c89d774218 s->prefetch_data=0 2024-03-04T12:37:32.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 10 manifest: total_size = 22 2024-03-04T12:37:32.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15975156856042126076 2024-03-04T12:37:32.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d40fa40 obj=check-bucket:_:8zsAnY6WBWe8ZX037nn2hSAcdoHv9er_e state=0x55c89d768078 s->prefetch_data=0 2024-03-04T12:37:32.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 prepare_atomic_modification: state is not atomic. state=0x55c89d768078 2024-03-04T12:37:32.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:32.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 10 manifest: total_size = 22 2024-03-04T12:37:32.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6096008382590658050 2024-03-04T12:37:32.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d40fc20 obj=check-bucket:_:3SesanqkCEyANewxD3uBxWI-rp18D0Y_d state=0x55c89d761198 s->prefetch_data=0 2024-03-04T12:37:32.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 prepare_atomic_modification: state is not atomic. state=0x55c89d761198 2024-03-04T12:37:32.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:32.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 10 manifest: total_size = 22 2024-03-04T12:37:32.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15981859357428874583 2024-03-04T12:37:32.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d6b4380 obj=check-bucket:_:uZ0NjeykJL8hnG5MK5LiHT4O3Vnxh8a_c state=0x55c89d74ef08 s->prefetch_data=0 2024-03-04T12:37:32.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 prepare_atomic_modification: state is not atomic. state=0x55c89d74ef08 2024-03-04T12:37:32.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:32.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 10 manifest: total_size = 22 2024-03-04T12:37:32.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7815280271524183934 2024-03-04T12:37:32.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d681100 obj=check-bucket:_:g397U3WB3esa1LI3dOKtv0Mw2MtwaTK_f state=0x55c89d774218 s->prefetch_data=0 2024-03-04T12:37:32.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 prepare_atomic_modification: state is not atomic. state=0x55c89d774218 2024-03-04T12:37:32.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.054+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:32.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.057+0000 7f956cfa2800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:37:32.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.057+0000 7f956cfa2800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-03-04T12:37:32.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.057+0000 7f956cfa2800 0 deleting objects inline since gc isn't initialized 2024-03-04T12:37:32.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.057+0000 7f956cfa2800 5 delete_objs_inline: removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1__shadow:3SesanqkCEyANewxD3uBxWI-rp18D0Y_.0gBFiG5F-bqYM5psDSSH-JIctFdKWy2_0 2024-03-04T12:37:32.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.062+0000 7f956cfa2800 5 delete_objs_inline: refcount put returned error -2 2024-03-04T12:37:32.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.062+0000 7f956cfa2800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:37:32.069 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.062+0000 7f956cfa2800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-03-04T12:37:32.069 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.062+0000 7f956cfa2800 0 deleting objects inline since gc isn't initialized 2024-03-04T12:37:32.069 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.062+0000 7f956cfa2800 5 delete_objs_inline: removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1__shadow:8zsAnY6WBWe8ZX037nn2hSAcdoHv9er_.z6_LsCIaxXSiEbqCOrDz5HdIztpYumX_0 2024-03-04T12:37:32.069 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.062+0000 7f944e7fc640 20 handle_completion(): completion ok for obj=d[3SesanqkCEyANewxD3uBxWI-rp18D0Y] 2024-03-04T12:37:32.069 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.064+0000 7f944dffb640 20 handle_completion(): completion ok for obj=e[8zsAnY6WBWe8ZX037nn2hSAcdoHv9er] 2024-03-04T12:37:32.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.065+0000 7f956cfa2800 5 delete_objs_inline: refcount put returned error -2 2024-03-04T12:37:32.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.065+0000 7f956cfa2800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:37:32.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.065+0000 7f956cfa2800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-03-04T12:37:32.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.065+0000 7f956cfa2800 0 deleting objects inline since gc isn't initialized 2024-03-04T12:37:32.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.065+0000 7f956cfa2800 5 delete_objs_inline: removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1__shadow:uZ0NjeykJL8hnG5MK5LiHT4O3Vnxh8a_.bEbwFtaksvbaWImLos9-lROC36uyQtX_0 2024-03-04T12:37:32.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.071+0000 7f944e7fc640 20 handle_completion(): completion ok for obj=c[uZ0NjeykJL8hnG5MK5LiHT4O3Vnxh8a] 2024-03-04T12:37:32.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.071+0000 7f956cfa2800 5 delete_objs_inline: refcount put returned error -2 2024-03-04T12:37:32.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.071+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d40fa40 obj=check-bucket:e state=0x55c89d67ee48 s->prefetch_data=0 2024-03-04T12:37:32.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.071+0000 7f956cfa2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=29g29wpqdm66i01c3q7kgvmdzf1twhu9 2024-03-04T12:37:32.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.071+0000 7f956cfa2800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:37:32.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.071+0000 7f956cfa2800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-03-04T12:37:32.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.071+0000 7f956cfa2800 0 deleting objects inline since gc isn't initialized 2024-03-04T12:37:32.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.071+0000 7f956cfa2800 5 delete_objs_inline: removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1__shadow:g397U3WB3esa1LI3dOKtv0Mw2MtwaTK_.HakISYsauoTZ_7v0NmG5zcckPjIAzH4_0 2024-03-04T12:37:32.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.072+0000 7f956cfa2800 5 delete_objs_inline: refcount put returned error -2 2024-03-04T12:37:32.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.072+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:32.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.072+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:32.079 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.073+0000 7f944e7fc640 20 handle_completion(): completion ok for obj=f[g397U3WB3esa1LI3dOKtv0Mw2MtwaTK] 2024-03-04T12:37:32.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.074+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:32.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.074+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:32.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.074+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:32.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.075+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.1 2024-03-04T12:37:32.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.075+0000 7f956cfa2800 1 NOTICE: finished shard 1 (1 entries removed) 2024-03-04T12:37:32.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.077+0000 7f956cfa2800 20 get_obj_state: octx=0x55c89d681100 obj=check-bucket:f state=0x55c89d74ff18 s->prefetch_data=0 2024-03-04T12:37:32.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.077+0000 7f956cfa2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x7qxreu0n8uwkn1u54wgrp7pu33c1kwz 2024-03-04T12:37:32.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.077+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.5 2024-03-04T12:37:32.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.077+0000 7f956cfa2800 1 NOTICE: finished shard 5 (1 entries removed) 2024-03-04T12:37:32.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.077+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.8 2024-03-04T12:37:32.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.077+0000 7f956cfa2800 1 NOTICE: finished shard 8 (1 entries removed) 2024-03-04T12:37:32.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.079+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:32.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.080+0000 7f956cfa2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1.10 2024-03-04T12:37:32.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.080+0000 7f956cfa2800 1 NOTICE: finished shard 10 (1 entries removed) 2024-03-04T12:37:32.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.080+0000 7f956cfa2800 1 NOTICE: finished all shards (4 entries removed) 2024-03-04T12:37:32.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.081+0000 7f94217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:32.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.083+0000 7f956cfa2800 20 remove_watcher() i=0 2024-03-04T12:37:32.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.083+0000 7f956cfa2800 2 removed watcher, disabling cache 2024-03-04T12:37:32.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.085+0000 7f956cfa2800 20 remove_watcher() i=1 2024-03-04T12:37:32.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.086+0000 7f956cfa2800 20 remove_watcher() i=2 2024-03-04T12:37:32.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.087+0000 7f956cfa2800 20 remove_watcher() i=3 2024-03-04T12:37:32.094 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.088+0000 7f956cfa2800 20 remove_watcher() i=4 2024-03-04T12:37:32.094 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.089+0000 7f956cfa2800 20 remove_watcher() i=5 2024-03-04T12:37:32.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.092+0000 7f956cfa2800 20 remove_watcher() i=6 2024-03-04T12:37:32.098 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.093+0000 7f956cfa2800 20 remove_watcher() i=7 2024-03-04T12:37:32.110 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:32.110 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:32.115 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:32.115 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:32.164 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-03-04T12:37:32.192 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:32.192 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:32.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.218+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.220+0000 7f78a632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:32.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.220+0000 7f78a632f800 20 realm 2024-03-04T12:37:32.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.220+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.220+0000 7f78a632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:32.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.220+0000 7f78a632f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:32.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.220+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.220+0000 7f78a632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:32.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.220+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.221+0000 7f78a632f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:32.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.221+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.222+0000 7f78a632f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:32.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.222+0000 7f78a632f800 20 searching for the correct realm 2024-03-04T12:37:32.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.224+0000 7f78a1ff7640 0 -- 172.21.15.90:0/2516316061 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f789c03a970 msgr2=0x7f789c02d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:32.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.428+0000 7f78a1ff7640 0 -- 172.21.15.90:0/2516316061 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f7898069360 msgr2=0x7f78980618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:32.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.634+0000 7f78a632f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:37:32.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.634+0000 7f78a632f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:32.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.634+0000 7f78a632f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:32.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.634+0000 7f78a632f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:37:32.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.634+0000 7f78a632f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:32.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.634+0000 7f78a632f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:32.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.634+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.634+0000 7f78a632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:32.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.634+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.635+0000 7f78a632f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:32.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.635+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.635+0000 7f78a632f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:32.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.635+0000 7f78a632f800 20 zone default found 2024-03-04T12:37:32.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.635+0000 7f78a632f800 4 Realm: () 2024-03-04T12:37:32.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.635+0000 7f78a632f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:37:32.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.635+0000 7f78a632f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:37:32.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.635+0000 7f78a632f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:32.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.635+0000 7f78a632f800 20 zonegroup default 2024-03-04T12:37:32.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.635+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.635+0000 7f78a632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:32.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.635+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.636+0000 7f78a632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:32.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.636+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.636+0000 7f78a632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:32.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.636+0000 7f78a632f800 20 started sync module instance, tier type = 2024-03-04T12:37:32.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.636+0000 7f78a632f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:37:32.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.649+0000 7f78a632f800 20 add_watcher() i=0 2024-03-04T12:37:32.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.649+0000 7f78a632f800 20 add_watcher() i=1 2024-03-04T12:37:32.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.649+0000 7f78a632f800 20 add_watcher() i=2 2024-03-04T12:37:32.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.649+0000 7f78a632f800 20 add_watcher() i=3 2024-03-04T12:37:32.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.649+0000 7f78a632f800 20 add_watcher() i=4 2024-03-04T12:37:32.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.649+0000 7f78a632f800 20 add_watcher() i=5 2024-03-04T12:37:32.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.649+0000 7f78a632f800 20 add_watcher() i=6 2024-03-04T12:37:32.658 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.652+0000 7f78a632f800 20 add_watcher() i=7 2024-03-04T12:37:32.658 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.652+0000 7f78a632f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:32.659 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.654+0000 7f77537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:32.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.654+0000 7f78a632f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:32.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.654+0000 7f78a632f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:32.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.654+0000 7f78a632f800 5 note: GC not initialized 2024-03-04T12:37:32.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.654+0000 7f77527fc640 20 reqs_thread_entry: start 2024-03-04T12:37:32.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.654+0000 7f78a632f800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:32.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.655+0000 7f78a632f800 20 Filter name: none 2024-03-04T12:37:32.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.655+0000 7f76c3fff640 20 reqs_thread_entry: start 2024-03-04T12:37:32.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.655+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.655+0000 7f78a632f800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:32.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.655+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.656+0000 7f78a632f800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:32.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.656+0000 7f78a632f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:32.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.656+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.656+0000 7f78a632f800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:37:32.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.656+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.656+0000 7f78a632f800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:37:32.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.656+0000 7f78a632f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:32.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.657+0000 7f78a632f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:32.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.657+0000 7f78a632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:32.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.658+0000 7f77537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:32.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.661+0000 7f78a632f800 20 remove_watcher() i=0 2024-03-04T12:37:32.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.661+0000 7f78a632f800 2 removed watcher, disabling cache 2024-03-04T12:37:32.668 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.662+0000 7f78a632f800 20 remove_watcher() i=1 2024-03-04T12:37:32.669 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.663+0000 7f78a632f800 20 remove_watcher() i=2 2024-03-04T12:37:32.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.665+0000 7f78a632f800 20 remove_watcher() i=3 2024-03-04T12:37:32.672 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.666+0000 7f78a632f800 20 remove_watcher() i=4 2024-03-04T12:37:32.673 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.667+0000 7f78a632f800 20 remove_watcher() i=5 2024-03-04T12:37:32.675 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.669+0000 7f78a632f800 20 remove_watcher() i=6 2024-03-04T12:37:32.675 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:37:32.670+0000 7f78a632f800 20 remove_watcher() i=7 2024-03-04T12:37:32.686 INFO:tasks.workunit.client.0.smithi090.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-03-04T12:37:32.686 INFO:tasks.workunit.client.0.smithi090.stderr:Deleting bucket check-bucket 2024-03-04T12:37:32.687 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:32.687 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:32.691 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:32.691 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:37:32.719 INFO:tasks.workunit.client.0.smithi090.stderr:Completed bucket check tests 2024-03-04T12:37:32.720 INFO:tasks.workunit.client.0.smithi090.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-03-04T12:37:32.720 INFO:tasks.workunit.client.0.smithi090.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-03-04T12:37:32.720 INFO:tasks.workunit.client.0.smithi090.stdout:connected to https://localhost:443 2024-03-04T12:37:32.777 INFO:tasks.workunit.client.0.smithi090.stderr:+ deactivate 2024-03-04T12:37:32.777 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-03-04T12:37:32.777 INFO:tasks.workunit.client.0.smithi090.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:37:32.777 INFO:tasks.workunit.client.0.smithi090.stderr:+ export PATH 2024-03-04T12:37:32.778 INFO:tasks.workunit.client.0.smithi090.stderr:+ unset _OLD_VIRTUAL_PATH 2024-03-04T12:37:32.778 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' -n '' ']' 2024-03-04T12:37:32.778 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:37:32.778 INFO:tasks.workunit.client.0.smithi090.stderr:+ hash -r 2024-03-04T12:37:32.778 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' -n '' ']' 2024-03-04T12:37:32.778 INFO:tasks.workunit.client.0.smithi090.stderr:+ unset VIRTUAL_ENV 2024-03-04T12:37:32.778 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' '!' '' = nondestructive ']' 2024-03-04T12:37:32.778 INFO:tasks.workunit.client.0.smithi090.stderr:+ unset -f deactivate 2024-03-04T12:37:32.778 INFO:tasks.workunit.client.0.smithi090.stderr:+ echo OK. 2024-03-04T12:37:32.779 INFO:tasks.workunit.client.0.smithi090.stdout:OK. 2024-03-04T12:37:32.779 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:37:32.779 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:37:32.819 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-03-04T12:37:32.819 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-04T12:37:33.204 DEBUG:teuthology.parallel:result is None 2024-03-04T12:37:33.204 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:37:33.243 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:37:33.244 DEBUG:teuthology.orchestra.run.smithi090:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:37:33.323 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:37:33.324 INFO:teuthology.run_tasks:Running task workunit... 2024-03-04T12:37:33.334 INFO:tasks.workunit:Pulling workunits from ref 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:37:33.334 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-04T12:37:33.334 DEBUG:teuthology.orchestra.run.smithi090:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:37:33.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:37:33.392 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-04T12:37:33.392 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:37:33.459 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-04T12:37:33.459 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-04T12:37:33.526 INFO:tasks.workunit:timeout=3h 2024-03-04T12:37:33.526 INFO:tasks.workunit:cleanup=True 2024-03-04T12:37:33.527 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:37:33.594 INFO:tasks.workunit.client.0.smithi090.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-04T12:38:11.796 INFO:tasks.workunit.client.0.smithi090.stderr:Note: switching to '3aec390336fdfdc8f927818b718cfb0361bd47c8'. 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr:state without impacting any branches by switching back to a branch. 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr: git switch -c 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr:Or undo this operation with: 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:38:11.797 INFO:tasks.workunit.client.0.smithi090.stderr: git switch - 2024-03-04T12:38:11.798 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:38:11.798 INFO:tasks.workunit.client.0.smithi090.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-04T12:38:11.798 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:38:11.798 INFO:tasks.workunit.client.0.smithi090.stderr:HEAD is now at 3aec390336f qa/d4n: Start redis up before rgw 2024-03-04T12:38:11.801 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-04T12:38:11.868 INFO:tasks.workunit.client.0.smithi090.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-04T12:38:11.870 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:38:11.870 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-04T12:38:11.918 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-04T12:38:11.967 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-04T12:38:12.006 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:38:12.008 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:38:12.008 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-04T12:38:12.046 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:38:12.050 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:38:12.050 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-04T12:38:12.117 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-03-04T12:38:12.119 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-03-04T12:38:12.119 DEBUG:teuthology.orchestra.run.smithi090:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-03-04T12:38:12.220 INFO:tasks.workunit.client.0.smithi090.stdout:Running main() from gmock_main.cc 2024-03-04T12:38:12.221 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-04T12:38:12.221 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:38:12.221 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 11 tests from ClsLock 2024-03-04T12:38:12.221 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-03-04T12:38:14.006 INFO:tasks.workunit.client.0.smithi090.stdout:lock: mylock 2024-03-04T12:38:14.007 INFO:tasks.workunit.client.0.smithi090.stdout: lock_type: exclusive 2024-03-04T12:38:14.007 INFO:tasks.workunit.client.0.smithi090.stdout: tag: 2024-03-04T12:38:14.007 INFO:tasks.workunit.client.0.smithi090.stdout: lockers: 2024-03-04T12:38:14.007 INFO:tasks.workunit.client.0.smithi090.stdout: client.5187 expiration=2024-03-04T12:40:13.992883+0000 addr=v1:172.21.15.90:0/520425711 cookie= 2024-03-04T12:38:14.014 INFO:tasks.workunit.client.0.smithi090.stdout:lock: mylock 2024-03-04T12:38:14.014 INFO:tasks.workunit.client.0.smithi090.stdout: lock_type: shared 2024-03-04T12:38:14.014 INFO:tasks.workunit.client.0.smithi090.stdout: tag: 2024-03-04T12:38:14.014 INFO:tasks.workunit.client.0.smithi090.stdout: lockers: 2024-03-04T12:38:14.014 INFO:tasks.workunit.client.0.smithi090.stdout: client.5187 expiration=2024-03-04T12:40:14.006465+0000 addr=v1:172.21.15.90:0/520425711 cookie= 2024-03-04T12:38:14.014 INFO:tasks.workunit.client.0.smithi090.stdout: client.5193 expiration=0.000000 addr=v1:172.21.15.90:0/2617974610 cookie= 2024-03-04T12:38:14.015 INFO:tasks.workunit.client.0.smithi090.stdout:lock: mylock 2024-03-04T12:38:14.015 INFO:tasks.workunit.client.0.smithi090.stdout: lock_type: shared 2024-03-04T12:38:14.015 INFO:tasks.workunit.client.0.smithi090.stdout: tag: 2024-03-04T12:38:14.015 INFO:tasks.workunit.client.0.smithi090.stdout: lockers: 2024-03-04T12:38:14.016 INFO:tasks.workunit.client.0.smithi090.stdout: client.5193 expiration=0.000000 addr=v1:172.21.15.90:0/2617974610 cookie= 2024-03-04T12:38:14.983 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] ClsLock.TestMultiLocking (2763 ms) 2024-03-04T12:38:14.983 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] ClsLock.TestMeta 2024-03-04T12:38:17.021 INFO:tasks.workunit.client.0.smithi090.stdout:lock: mylock 2024-03-04T12:38:17.021 INFO:tasks.workunit.client.0.smithi090.stdout: lock_type: shared 2024-03-04T12:38:17.022 INFO:tasks.workunit.client.0.smithi090.stdout: tag: 2024-03-04T12:38:17.022 INFO:tasks.workunit.client.0.smithi090.stdout: lockers: 2024-03-04T12:38:17.022 INFO:tasks.workunit.client.0.smithi090.stdout: client.5027 expiration=0.000000 addr=v1:172.21.15.90:0/2069998086 cookie= 2024-03-04T12:38:17.024 INFO:tasks.workunit.client.0.smithi090.stdout:lock: mylock 2024-03-04T12:38:17.024 INFO:tasks.workunit.client.0.smithi090.stdout: lock_type: exclusive 2024-03-04T12:38:17.024 INFO:tasks.workunit.client.0.smithi090.stdout: tag: new_tag 2024-03-04T12:38:17.024 INFO:tasks.workunit.client.0.smithi090.stdout: lockers: 2024-03-04T12:38:17.024 INFO:tasks.workunit.client.0.smithi090.stdout: client.5199 expiration=0.000000 addr=v1:172.21.15.90:0/1972648089 cookie= 2024-03-04T12:38:17.990 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] ClsLock.TestMeta (3007 ms) 2024-03-04T12:38:17.990 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] ClsLock.TestCookie 2024-03-04T12:38:20.027 INFO:tasks.workunit.client.0.smithi090.stdout:lock: mylock 2024-03-04T12:38:20.027 INFO:tasks.workunit.client.0.smithi090.stdout: lock_type: exclusive 2024-03-04T12:38:20.027 INFO:tasks.workunit.client.0.smithi090.stdout: tag: 2024-03-04T12:38:20.027 INFO:tasks.workunit.client.0.smithi090.stdout: lockers: 2024-03-04T12:38:20.031 INFO:tasks.workunit.client.0.smithi090.stdout:lock: mylock 2024-03-04T12:38:20.032 INFO:tasks.workunit.client.0.smithi090.stdout: lock_type: shared 2024-03-04T12:38:20.032 INFO:tasks.workunit.client.0.smithi090.stdout: tag: 2024-03-04T12:38:20.032 INFO:tasks.workunit.client.0.smithi090.stdout: lockers: 2024-03-04T12:38:20.032 INFO:tasks.workunit.client.0.smithi090.stdout: client.5033 expiration=0.000000 addr=v1:172.21.15.90:0/435323595 cookie= 2024-03-04T12:38:20.032 INFO:tasks.workunit.client.0.smithi090.stdout: client.5033 expiration=0.000000 addr=v1:172.21.15.90:0/435323595 cookie=new cookie 2024-03-04T12:38:21.025 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] ClsLock.TestCookie (3035 ms) 2024-03-04T12:38:21.025 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-03-04T12:38:24.026 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] ClsLock.TestMultipleLocks (3001 ms) 2024-03-04T12:38:24.026 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] ClsLock.TestLockDuration 2024-03-04T12:38:32.063 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] ClsLock.TestLockDuration (8037 ms) 2024-03-04T12:38:32.063 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-03-04T12:38:35.090 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] ClsLock.TestAssertLocked (3027 ms) 2024-03-04T12:38:35.090 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] ClsLock.TestSetCookie 2024-03-04T12:38:38.110 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] ClsLock.TestSetCookie (3020 ms) 2024-03-04T12:38:38.110 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] ClsLock.TestRenew 2024-03-04T12:38:59.152 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] ClsLock.TestRenew (21041 ms) 2024-03-04T12:38:59.152 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-03-04T12:39:05.237 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6086 ms) 2024-03-04T12:39:05.237 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-03-04T12:39:13.281 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8044 ms) 2024-03-04T12:39:13.281 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-03-04T12:39:21.319 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8038 ms) 2024-03-04T12:39:21.319 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 11 tests from ClsLock (69099 ms total) 2024-03-04T12:39:21.320 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:39:21.320 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:39:21.320 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 11 tests from 1 test suite ran. (69099 ms total) 2024-03-04T12:39:21.320 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 11 tests. 2024-03-04T12:39:21.323 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:39:21.323 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:39:21.366 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-03-04T12:39:21.367 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-03-04T12:39:21.367 DEBUG:teuthology.orchestra.run.smithi090:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-03-04T12:39:21.450 INFO:tasks.workunit.client.0.smithi090.stdout:Running main() from gmock_main.cc 2024-03-04T12:39:21.450 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-04T12:39:21.450 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:39:21.450 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 4 tests from cls_log 2024-03-04T12:39:21.450 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-03-04T12:39:24.323 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_log.test_log_add_same_time (2872 ms) 2024-03-04T12:39:24.323 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-03-04T12:39:27.348 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_log.test_log_add_different_time (3026 ms) 2024-03-04T12:39:27.348 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_log.trim_by_time 2024-03-04T12:39:30.371 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_log.trim_by_time (3023 ms) 2024-03-04T12:39:30.371 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_log.trim_by_marker 2024-03-04T12:39:33.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_log.trim_by_marker (3021 ms) 2024-03-04T12:39:33.392 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 4 tests from cls_log (11942 ms total) 2024-03-04T12:39:33.392 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:39:33.392 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:39:33.393 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 4 tests from 1 test suite ran. (11942 ms total) 2024-03-04T12:39:33.393 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 4 tests. 2024-03-04T12:39:33.395 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:39:33.395 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:39:33.478 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-03-04T12:39:33.480 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-03-04T12:39:33.481 DEBUG:teuthology.orchestra.run.smithi090:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-03-04T12:39:33.562 INFO:tasks.workunit.client.0.smithi090.stdout:Running main() from gmock_main.cc 2024-03-04T12:39:33.562 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 10 tests from 1 test suite. 2024-03-04T12:39:33.562 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:39:33.562 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 10 tests from cls_refcount 2024-03-04T12:39:33.562 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_refcount.test_implicit 2024-03-04T12:39:36.406 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_refcount.test_implicit (2843 ms) 2024-03-04T12:39:36.406 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-03-04T12:39:39.432 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3027 ms) 2024-03-04T12:39:39.432 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_refcount.test_put_snap 2024-03-04T12:39:48.486 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_refcount.test_put_snap (9054 ms) 2024-03-04T12:39:48.487 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_refcount.test_explicit 2024-03-04T12:39:51.516 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_refcount.test_explicit (3029 ms) 2024-03-04T12:39:51.516 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_refcount.set 2024-03-04T12:39:54.535 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_refcount.set (3020 ms) 2024-03-04T12:39:54.535 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-03-04T12:40:01.552 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_refcount.test_implicit_ec (7017 ms) 2024-03-04T12:40:01.552 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-03-04T12:40:08.596 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7044 ms) 2024-03-04T12:40:08.597 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-03-04T12:40:21.669 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_refcount.test_put_snap_ec (13073 ms) 2024-03-04T12:40:21.670 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-03-04T12:40:28.679 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_refcount.test_explicit_ec (7010 ms) 2024-03-04T12:40:28.680 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_refcount.set_ec 2024-03-04T12:40:35.721 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_refcount.set_ec (7042 ms) 2024-03-04T12:40:35.722 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 10 tests from cls_refcount (62159 ms total) 2024-03-04T12:40:35.722 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:40:35.722 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:40:35.722 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 10 tests from 1 test suite ran. (62159 ms total) 2024-03-04T12:40:35.722 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 10 tests. 2024-03-04T12:40:35.724 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:40:35.724 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:40:35.819 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-03-04T12:40:35.821 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-03-04T12:40:35.821 DEBUG:teuthology.orchestra.run.smithi090:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-03-04T12:40:35.868 INFO:tasks.workunit.client.0.smithi090.stdout:Running main() from gmock_main.cc 2024-03-04T12:40:35.869 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 16 tests from 1 test suite. 2024-03-04T12:40:35.869 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:40:35.869 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 16 tests from cls_rgw 2024-03-04T12:40:37.731 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.index_basic 2024-03-04T12:40:37.772 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.index_basic (40 ms) 2024-03-04T12:40:37.772 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-03-04T12:40:37.807 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (35 ms) 2024-03-04T12:40:37.807 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.index_remove_object 2024-03-04T12:40:37.852 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.index_remove_object (45 ms) 2024-03-04T12:40:37.852 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.index_suggest 2024-03-04T12:40:39.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.index_suggest (1540 ms) 2024-03-04T12:40:39.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-03-04T12:40:39.399 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-03-04T12:40:39.399 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.index_list 2024-03-04T12:40:39.422 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.index_list (23 ms) 2024-03-04T12:40:39.422 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-03-04T12:40:58.839 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.index_list_delimited (19417 ms) 2024-03-04T12:40:58.839 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.bi_list 2024-03-04T12:40:58.912 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.bi_list (73 ms) 2024-03-04T12:40:58.912 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.gc_set 2024-03-04T12:40:58.922 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-03-04T12:40:58.922 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.gc_list 2024-03-04T12:40:58.932 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.gc_list (10 ms) 2024-03-04T12:40:58.932 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.gc_defer 2024-03-04T12:41:06.032 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.gc_defer (7100 ms) 2024-03-04T12:41:06.032 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.usage_basic 2024-03-04T12:41:06.108 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.usage_basic (76 ms) 2024-03-04T12:41:06.108 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-03-04T12:41:06.109 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-03-04T12:41:06.109 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.usage_clear 2024-03-04T12:41:06.206 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.usage_clear (97 ms) 2024-03-04T12:41:06.206 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-03-04T12:41:06.247 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.bi_log_trim (41 ms) 2024-03-04T12:41:06.247 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-03-04T12:41:06.259 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw.index_racing_removes (12 ms) 2024-03-04T12:41:07.040 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 16 tests from cls_rgw (28528 ms total) 2024-03-04T12:41:07.040 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:41:07.040 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:41:07.040 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 16 tests from 1 test suite ran. (31171 ms total) 2024-03-04T12:41:07.041 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 16 tests. 2024-03-04T12:41:07.044 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:41:07.044 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:41:07.088 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-03-04T12:41:07.089 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-03-04T12:41:07.090 DEBUG:teuthology.orchestra.run.smithi090:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-03-04T12:41:07.171 INFO:tasks.workunit.client.0.smithi090.stdout:Running main() from gmock_main.cc 2024-03-04T12:41:07.171 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-04T12:41:07.171 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:41:07.171 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 9 tests from cls_rgw_gc 2024-03-04T12:41:07.172 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw_gc.init 2024-03-04T12:41:09.056 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw_gc.init (1885 ms) 2024-03-04T12:41:09.056 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-03-04T12:41:09.077 INFO:tasks.workunit.client.0.smithi090.stderr:[ ] list info tag = chain-0 2024-03-04T12:41:09.077 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (21 ms) 2024-03-04T12:41:09.078 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-03-04T12:41:09.084 INFO:tasks.workunit.client.0.smithi090.stderr:[ ] next_marker is: = 0/4263 2024-03-04T12:41:09.084 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (8 ms) 2024-03-04T12:41:09.084 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-03-04T12:41:09.092 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (7 ms) 2024-03-04T12:41:09.092 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-03-04T12:41:09.279 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (187 ms) 2024-03-04T12:41:09.279 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-03-04T12:41:09.291 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (11 ms) 2024-03-04T12:41:09.291 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-03-04T12:41:09.298 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (9 ms) 2024-03-04T12:41:09.298 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-03-04T12:41:09.306 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (7 ms) 2024-03-04T12:41:09.306 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw_gc.finalize 2024-03-04T12:41:10.057 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw_gc.finalize (751 ms) 2024-03-04T12:41:10.057 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 9 tests from cls_rgw_gc (2886 ms total) 2024-03-04T12:41:10.057 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:41:10.057 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:41:10.057 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 9 tests from 1 test suite ran. (2886 ms total) 2024-03-04T12:41:10.058 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 9 tests. 2024-03-04T12:41:10.060 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:41:10.060 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:41:10.147 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-03-04T12:41:10.148 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-03-04T12:41:10.148 DEBUG:teuthology.orchestra.run.smithi090:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-03-04T12:41:10.200 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:41:10.200 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:41:10.200 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 1 test from 1 test suite. 2024-03-04T12:41:10.200 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:41:12.079 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 1 test from cls_rgw_stats 2024-03-04T12:41:12.080 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] cls_rgw_stats.simulate 2024-03-04T12:41:12.098 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.092+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~N5YT9H27F0Q9.0 size=1048576 2024-03-04T12:41:12.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.093+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~N5YT9H27F0Q9.1 size=1048576 2024-03-04T12:41:12.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.094+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~N5YT9H27F0Q9.2 size=349360 2024-03-04T12:41:12.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.094+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=N5YT9H27F0Q9 tag=AM39JEKG4T58 type=write size=3495088 2024-03-04T12:41:12.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.096+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=MIVBW724PE8Y type=del size=957832 2024-03-04T12:41:12.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.097+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=UAB6YN7PS0XC type=write size=866077 2024-03-04T12:41:12.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.099+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~YL62EJ2JVL82.0 size=92379 2024-03-04T12:41:12.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.099+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=YL62EJ2JVL82 tag=1CVI6QY8J3SA type=write size=1140955 2024-03-04T12:41:12.107 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.102+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~U2D8IXJ79EWZ.0 size=767965 2024-03-04T12:41:12.107 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.102+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=U2D8IXJ79EWZ tag=TFOB43LVSNZX type=write size=1816541 2024-03-04T12:41:12.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.104+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~HADC5MO1GGMM.0 size=1048576 2024-03-04T12:41:12.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.105+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~HADC5MO1GGMM.1 size=720516 2024-03-04T12:41:12.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.105+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=HADC5MO1GGMM tag=1SQLOBCHR1XU type=write size=2817668 2024-03-04T12:41:12.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.106+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=YEHAF2DVH315 type=write size=123048 2024-03-04T12:41:12.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.108+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=XZ17YC5I9ZW0 type=del size=190889 2024-03-04T12:41:12.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.110+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~61TQEZU03VII.0 size=199903 2024-03-04T12:41:12.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.110+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=61TQEZU03VII tag=S2WD87KBKAC3 type=write size=1248479 2024-03-04T12:41:12.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.113+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~MVCE5HPFE5W8.0 size=1048576 2024-03-04T12:41:12.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.114+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~MVCE5HPFE5W8.1 size=132938 2024-03-04T12:41:12.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.114+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=MVCE5HPFE5W8 tag=4B9T3P9MOAQN type=write size=2230090 2024-03-04T12:41:12.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.115+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=L7R04OA45HF7 type=del size=2459345 2024-03-04T12:41:12.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.118+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~PRI2B6F5D0ZQ.0 size=1048576 2024-03-04T12:41:12.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.119+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~PRI2B6F5D0ZQ.1 size=1048576 2024-03-04T12:41:12.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.120+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~PRI2B6F5D0ZQ.2 size=1036624 2024-03-04T12:41:12.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.120+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=PRI2B6F5D0ZQ tag=H7P4NKLA2QAY type=write size=4182352 2024-03-04T12:41:12.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.122+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~2IP1HI03E632.0 size=1048576 2024-03-04T12:41:12.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.123+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~2IP1HI03E632.1 size=276949 2024-03-04T12:41:12.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.123+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=2IP1HI03E632 tag=7M75JLUVLXC9 type=write size=2374101 2024-03-04T12:41:12.130 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.124+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=A0GIKJPNHRBX type=del size=3547859 2024-03-04T12:41:12.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.126+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~M615O9AQPK2X.0 size=1048576 2024-03-04T12:41:12.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.127+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~M615O9AQPK2X.1 size=1048576 2024-03-04T12:41:12.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.129+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~M615O9AQPK2X.2 size=844103 2024-03-04T12:41:12.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.129+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=M615O9AQPK2X tag=ILUJQI3431X5 type=write size=3989831 2024-03-04T12:41:12.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.130+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=OVYFOQ2SRET9 type=del size=3207527 2024-03-04T12:41:12.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.131+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~N5YT9H27F0Q9.0 size=1048576 2024-03-04T12:41:12.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.131+0000 7f093583d780 1 < canceled part key=_multipart_L4UQK3UJFXZC.2~N5YT9H27F0Q9.1 size=1048576 2024-03-04T12:41:12.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.132+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~N5YT9H27F0Q9.2 size=349360 2024-03-04T12:41:12.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.134+0000 7f093583d780 1 < canceled multipart upload key=L4UQK3UJFXZC upload=N5YT9H27F0Q9 tag=AM39JEKG4T58 type=write size=3495088 2024-03-04T12:41:12.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.135+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=0IMZE26OSCWW type=del size=1617820 2024-03-04T12:41:12.143 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.138+0000 7f093583d780 1 < suggested update operation key=U6F7IZ07CS9Q tag=MIVBW724PE8Y type=del size=957832 2024-03-04T12:41:12.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.139+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=7XC2Y8QFHRA9 type=del size=692805 2024-03-04T12:41:12.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.140+0000 7f093583d780 1 < completed write operation key=YJXFSO53QVPS tag=UAB6YN7PS0XC type=write size=866077 2024-03-04T12:41:12.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.141+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=7DRMQL50ZVCS type=del size=347297 2024-03-04T12:41:12.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.143+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~YL62EJ2JVL82.0 size=92379 2024-03-04T12:41:12.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.145+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=YL62EJ2JVL82 tag=1CVI6QY8J3SA type=write size=1140955 2024-03-04T12:41:12.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.146+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=H651AFCEDHUI type=del size=1919423 2024-03-04T12:41:12.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.147+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~U2D8IXJ79EWZ.0 size=767965 2024-03-04T12:41:12.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.149+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=U2D8IXJ79EWZ tag=TFOB43LVSNZX type=write size=1816541 2024-03-04T12:41:12.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.150+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=53YEPOTDNL33 type=del size=111096 2024-03-04T12:41:12.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.152+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~HADC5MO1GGMM.0 size=1048576 2024-03-04T12:41:12.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.153+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~HADC5MO1GGMM.1 size=720516 2024-03-04T12:41:12.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.155+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=HADC5MO1GGMM tag=1SQLOBCHR1XU type=write size=2817668 2024-03-04T12:41:12.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.156+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=142PN4ASU93G type=del size=3794256 2024-03-04T12:41:12.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.158+0000 7f093583d780 1 < suggested remove operation key=YJXFSO53QVPS tag=YEHAF2DVH315 type=write 2024-03-04T12:41:12.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.160+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=JU5Q7CPLEOAD type=del size=190639 2024-03-04T12:41:12.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.161+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=XZ17YC5I9ZW0 type=del 2024-03-04T12:41:12.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.163+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~7FEVRLMFM8VU.0 size=1048576 2024-03-04T12:41:12.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.164+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~7FEVRLMFM8VU.1 size=637348 2024-03-04T12:41:12.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.164+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=7FEVRLMFM8VU tag=UIOUHYJA4FLI type=write size=2734500 2024-03-04T12:41:12.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.165+0000 7f093583d780 1 < canceled part key=_multipart_NQF43I07F2HT.2~61TQEZU03VII.0 size=199903 2024-03-04T12:41:12.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.167+0000 7f093583d780 1 < canceled multipart upload key=NQF43I07F2HT upload=61TQEZU03VII tag=S2WD87KBKAC3 type=write size=1248479 2024-03-04T12:41:12.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.169+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~13FJLEZF8THG.0 size=894268 2024-03-04T12:41:12.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.169+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=13FJLEZF8THG tag=TQ05NYVXO59K type=write size=1942844 2024-03-04T12:41:12.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.171+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~MVCE5HPFE5W8.0 size=1048576 2024-03-04T12:41:12.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.172+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~MVCE5HPFE5W8.1 size=132938 2024-03-04T12:41:12.179 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.174+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=MVCE5HPFE5W8 tag=4B9T3P9MOAQN type=write size=2230090 2024-03-04T12:41:12.181 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.176+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~CEDJPNMHFN7T.0 size=1048576 2024-03-04T12:41:12.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.176+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~CEDJPNMHFN7T.1 size=1048576 2024-03-04T12:41:12.183 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.177+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~CEDJPNMHFN7T.2 size=1047010 2024-03-04T12:41:12.183 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.177+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=CEDJPNMHFN7T tag=YP48F5I28LMZ type=write size=4192738 2024-03-04T12:41:12.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.178+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=L7R04OA45HF7 type=del 2024-03-04T12:41:12.185 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.180+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=388NWOJJZ1MT type=write size=458780 2024-03-04T12:41:12.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.181+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~PRI2B6F5D0ZQ.0 size=1048576 2024-03-04T12:41:12.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.182+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~PRI2B6F5D0ZQ.1 size=1048576 2024-03-04T12:41:12.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.183+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~PRI2B6F5D0ZQ.2 size=1036624 2024-03-04T12:41:12.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.185+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=PRI2B6F5D0ZQ tag=H7P4NKLA2QAY type=write size=4182352 2024-03-04T12:41:12.192 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.187+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=YEEYMQBL7IJ0 type=write size=425280 2024-03-04T12:41:12.193 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.188+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~2IP1HI03E632.0 size=1048576 2024-03-04T12:41:12.195 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.189+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~2IP1HI03E632.1 size=276949 2024-03-04T12:41:12.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.191+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=2IP1HI03E632 tag=7M75JLUVLXC9 type=write size=2374101 2024-03-04T12:41:12.198 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.192+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=METHKKAC00YV type=del size=3676616 2024-03-04T12:41:12.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.193+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=A0GIKJPNHRBX type=del 2024-03-04T12:41:12.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.194+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=ZY139Y5VKIAH type=del size=1769306 2024-03-04T12:41:12.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.196+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~M615O9AQPK2X.0 size=1048576 2024-03-04T12:41:12.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.197+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~M615O9AQPK2X.1 size=1048576 2024-03-04T12:41:12.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.198+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~M615O9AQPK2X.2 size=844103 2024-03-04T12:41:12.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.200+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=M615O9AQPK2X tag=ILUJQI3431X5 type=write size=3989831 2024-03-04T12:41:12.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.201+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=7S8RK2837HYI type=write size=357050 2024-03-04T12:41:12.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.203+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=OVYFOQ2SRET9 type=del 2024-03-04T12:41:12.210 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.205+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~IR3T2YUKRP05.0 size=1048576 2024-03-04T12:41:12.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.206+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~IR3T2YUKRP05.1 size=1048576 2024-03-04T12:41:12.212 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.207+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~IR3T2YUKRP05.2 size=700900 2024-03-04T12:41:12.212 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.207+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=IR3T2YUKRP05 tag=H34MZDM6SWWP type=write size=3846628 2024-03-04T12:41:12.213 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.208+0000 7f093583d780 -1 < failed to complete operation key=YJXFSO53QVPS tag=0IMZE26OSCWW type=del size=1617820: (22) Invalid argument 2024-03-04T12:41:12.214 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.209+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=AZEO795OYKVY type=write size=330224 2024-03-04T12:41:12.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.210+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=7XC2Y8QFHRA9 type=del 2024-03-04T12:41:12.218 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.212+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~TYLAKDPFXZBB.0 size=1048576 2024-03-04T12:41:12.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.213+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~TYLAKDPFXZBB.1 size=897138 2024-03-04T12:41:12.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.213+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=TYLAKDPFXZBB tag=052QX4PP9H8F type=write size=2994290 2024-03-04T12:41:12.220 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.214+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=7DRMQL50ZVCS type=del 2024-03-04T12:41:12.222 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.216+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=GD5TPXREAWHF type=del size=3997493 2024-03-04T12:41:12.223 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.217+0000 7f093583d780 1 < canceled operation key=M0AOZ89IQNSK tag=H651AFCEDHUI type=del size=1919423 2024-03-04T12:41:12.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.218+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=AMMLZTYW1CUP type=del size=2290448 2024-03-04T12:41:12.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.221+0000 7f093583d780 1 < suggested update operation key=OFTWI7UFD5L5 tag=53YEPOTDNL33 type=del size=111096 2024-03-04T12:41:12.228 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.223+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~Z1BPZX2E4M1H.0 size=291756 2024-03-04T12:41:12.228 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.223+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=Z1BPZX2E4M1H tag=KFA97UC1WUJ9 type=write size=1340332 2024-03-04T12:41:12.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.224+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=142PN4ASU93G type=del 2024-03-04T12:41:12.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.226+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~ESV4ZZ6AT1LH.0 size=1048576 2024-03-04T12:41:12.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.227+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~ESV4ZZ6AT1LH.1 size=734002 2024-03-04T12:41:12.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.227+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=ESV4ZZ6AT1LH tag=SNN9ZAFPECTP type=write size=2831154 2024-03-04T12:41:12.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.228+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=JU5Q7CPLEOAD type=del 2024-03-04T12:41:12.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.230+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~G3M1JFGHPN08.0 size=1024149 2024-03-04T12:41:12.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.230+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=G3M1JFGHPN08 tag=ORB0I0FW8Q7T type=write size=2072725 2024-03-04T12:41:12.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.232+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~7FEVRLMFM8VU.0 size=1048576 2024-03-04T12:41:12.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.233+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~7FEVRLMFM8VU.1 size=637348 2024-03-04T12:41:12.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.235+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=7FEVRLMFM8VU tag=UIOUHYJA4FLI type=write size=2734500 2024-03-04T12:41:12.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.236+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=KH0V2YBGEQS3 type=write size=370544 2024-03-04T12:41:12.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.237+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~13FJLEZF8THG.0 size=894268 2024-03-04T12:41:12.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.239+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=13FJLEZF8THG tag=TQ05NYVXO59K type=write size=1942844 2024-03-04T12:41:12.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.240+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=6YUEM34GFZ47 type=del size=1383328 2024-03-04T12:41:12.246 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.241+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~CEDJPNMHFN7T.0 size=1048576 2024-03-04T12:41:12.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.242+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~CEDJPNMHFN7T.1 size=1048576 2024-03-04T12:41:12.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.243+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~CEDJPNMHFN7T.2 size=1047010 2024-03-04T12:41:12.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.245+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=CEDJPNMHFN7T tag=YP48F5I28LMZ type=write size=4192738 2024-03-04T12:41:12.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.246+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~3GH3DD4WY11R.0 size=1048576 2024-03-04T12:41:12.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.247+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~3GH3DD4WY11R.1 size=182367 2024-03-04T12:41:12.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.247+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=3GH3DD4WY11R tag=ZKSD8UKO2T0W type=write size=2279519 2024-03-04T12:41:12.254 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.248+0000 7f093583d780 1 < completed write operation key=OCOQJLUUNWRG tag=388NWOJJZ1MT type=write size=458780 2024-03-04T12:41:12.255 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.249+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=UUETNFU3WCGC type=del size=2472394 2024-03-04T12:41:12.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.251+0000 7f093583d780 1 < completed write operation key=96PTQ2KHPMMM tag=YEEYMQBL7IJ0 type=write size=425280 2024-03-04T12:41:12.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.253+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~8JGLG2AYSDUQ.0 size=1048576 2024-03-04T12:41:12.259 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.254+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~8JGLG2AYSDUQ.1 size=1006588 2024-03-04T12:41:12.259 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.254+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=8JGLG2AYSDUQ tag=35QSLC0HEA8M type=write size=3103740 2024-03-04T12:41:12.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.255+0000 7f093583d780 1 < completed delete operation key=AQI7H63EQSTN tag=METHKKAC00YV type=del 2024-03-04T12:41:12.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.257+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~KQ3I7EOJTS37.0 size=998398 2024-03-04T12:41:12.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.257+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=KQ3I7EOJTS37 tag=2XQIN6CGH51A type=write size=2046974 2024-03-04T12:41:12.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.258+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=ZY139Y5VKIAH type=del 2024-03-04T12:41:12.264 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.259+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=Q18409LQZ65R type=del size=2927312 2024-03-04T12:41:12.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.261+0000 7f093583d780 1 < suggested update operation key=M0AOZ89IQNSK tag=7S8RK2837HYI type=write size=357050 2024-03-04T12:41:12.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.263+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~EU04DFTYSWEQ.0 size=1048576 2024-03-04T12:41:12.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.264+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~EU04DFTYSWEQ.1 size=1048576 2024-03-04T12:41:12.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.265+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~EU04DFTYSWEQ.2 size=874552 2024-03-04T12:41:12.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.265+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=EU04DFTYSWEQ tag=QR8D0QCEBPDI type=write size=4020280 2024-03-04T12:41:12.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.266+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~IR3T2YUKRP05.0 size=1048576 2024-03-04T12:41:12.272 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.267+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~IR3T2YUKRP05.1 size=1048576 2024-03-04T12:41:12.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.268+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~IR3T2YUKRP05.2 size=700900 2024-03-04T12:41:12.275 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.270+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=IR3T2YUKRP05 tag=H34MZDM6SWWP type=write size=3846628 2024-03-04T12:41:12.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.271+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=LDJFH70HR442 type=del size=2210280 2024-03-04T12:41:12.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.272+0000 7f093583d780 1 < completed write operation key=PT63VLFQQN0E tag=AZEO795OYKVY type=write size=330224 2024-03-04T12:41:12.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.273+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=YYRXMSTB5IZ2 type=del size=155081 2024-03-04T12:41:12.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.274+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~TYLAKDPFXZBB.0 size=1048576 2024-03-04T12:41:12.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.275+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~TYLAKDPFXZBB.1 size=897138 2024-03-04T12:41:12.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.277+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=TYLAKDPFXZBB tag=052QX4PP9H8F type=write size=2994290 2024-03-04T12:41:12.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.279+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~YOGKJ1WPTVCJ.0 size=1048576 2024-03-04T12:41:12.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.280+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~YOGKJ1WPTVCJ.1 size=262556 2024-03-04T12:41:12.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.280+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=YOGKJ1WPTVCJ tag=HX63NFX2N902 type=write size=2359708 2024-03-04T12:41:12.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.283+0000 7f093583d780 1 < suggested update operation key=Y4D4Q7NV5VMO tag=GD5TPXREAWHF type=del size=3997493 2024-03-04T12:41:12.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.284+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=TKIXKIO8PKBH type=del size=1410031 2024-03-04T12:41:12.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.286+0000 7f093583d780 1 < suggested update operation key=NFM6LT89K5F4 tag=AMMLZTYW1CUP type=del size=2290448 2024-03-04T12:41:12.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.287+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=IO9FHD8J5YUT type=del size=2017001 2024-03-04T12:41:12.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.288+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~Z1BPZX2E4M1H.0 size=291756 2024-03-04T12:41:12.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.290+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=Z1BPZX2E4M1H tag=KFA97UC1WUJ9 type=write size=1340332 2024-03-04T12:41:12.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.291+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=1YPSWLLVE3T1 type=del size=1819200 2024-03-04T12:41:12.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.294+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~ESV4ZZ6AT1LH.0 size=1048576 2024-03-04T12:41:12.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.295+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~ESV4ZZ6AT1LH.1 size=734002 2024-03-04T12:41:12.302 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.297+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=ESV4ZZ6AT1LH tag=SNN9ZAFPECTP type=write size=2831154 2024-03-04T12:41:12.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.299+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~6LXI6HQS2ILJ.0 size=1048576 2024-03-04T12:41:12.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.300+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~6LXI6HQS2ILJ.1 size=1001215 2024-03-04T12:41:12.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.300+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=6LXI6HQS2ILJ tag=Z0S5Q7AGY0W5 type=write size=3098367 2024-03-04T12:41:12.306 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.301+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~G3M1JFGHPN08.0 size=1024149 2024-03-04T12:41:12.308 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.303+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=G3M1JFGHPN08 tag=ORB0I0FW8Q7T type=write size=2072725 2024-03-04T12:41:12.310 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.305+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~Y72GJOBH0XVE.0 size=1048576 2024-03-04T12:41:12.311 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.306+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~Y72GJOBH0XVE.1 size=1048576 2024-03-04T12:41:12.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.307+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~Y72GJOBH0XVE.2 size=898985 2024-03-04T12:41:12.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.307+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=Y72GJOBH0XVE tag=XEK9USB0IFCC type=write size=4044713 2024-03-04T12:41:12.313 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.308+0000 7f093583d780 1 < completed write operation key=2YD2M0JQNCC0 tag=KH0V2YBGEQS3 type=write size=370544 2024-03-04T12:41:12.314 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.309+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=QZ2IDVWN70QC type=del size=1049529 2024-03-04T12:41:12.316 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.310+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=6YUEM34GFZ47 type=del 2024-03-04T12:41:12.319 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.314+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~GHC55N10J232.0 size=1048576 2024-03-04T12:41:12.320 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.315+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~GHC55N10J232.1 size=1048576 2024-03-04T12:41:12.321 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.315+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~GHC55N10J232.2 size=839120 2024-03-04T12:41:12.321 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.316+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=GHC55N10J232 tag=TXFLG45PMKQA type=write size=3984848 2024-03-04T12:41:12.322 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.317+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~3GH3DD4WY11R.0 size=1048576 2024-03-04T12:41:12.323 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.318+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~3GH3DD4WY11R.1 size=182367 2024-03-04T12:41:12.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.319+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=3GH3DD4WY11R tag=ZKSD8UKO2T0W type=write size=2279519 2024-03-04T12:41:12.326 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.321+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=7E8IOGRWMFFI type=del size=2673243 2024-03-04T12:41:12.327 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.322+0000 7f093583d780 1 < canceled operation key=54FLC10FWKL6 tag=UUETNFU3WCGC type=del size=2472394 2024-03-04T12:41:12.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.324+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=YUJJVEVKY4QZ type=del size=2375183 2024-03-04T12:41:12.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.324+0000 7f093583d780 1 < canceled part key=_multipart_TMAI6MOG2C4N.2~8JGLG2AYSDUQ.0 size=1048576 2024-03-04T12:41:12.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.325+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~8JGLG2AYSDUQ.1 size=1006588 2024-03-04T12:41:12.332 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.327+0000 7f093583d780 1 < canceled multipart upload key=TMAI6MOG2C4N upload=8JGLG2AYSDUQ tag=35QSLC0HEA8M type=write size=3103740 2024-03-04T12:41:12.334 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.329+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~ELGFH2XLO57M.0 size=1048576 2024-03-04T12:41:12.335 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.330+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~ELGFH2XLO57M.1 size=1048576 2024-03-04T12:41:12.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.330+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~ELGFH2XLO57M.2 size=554586 2024-03-04T12:41:12.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.330+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=ELGFH2XLO57M tag=FA68HZELMWM0 type=write size=3700314 2024-03-04T12:41:12.337 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.332+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~KQ3I7EOJTS37.0 size=998398 2024-03-04T12:41:12.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.333+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=KQ3I7EOJTS37 tag=2XQIN6CGH51A type=write size=2046974 2024-03-04T12:41:12.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.334+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=OSYF9FL1PUTC type=del size=1702121 2024-03-04T12:41:12.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.337+0000 7f093583d780 1 < suggested remove operation key=UAEQORB3BDBH tag=Q18409LQZ65R type=del 2024-03-04T12:41:12.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.339+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~Z1EAHRLAX8TG.0 size=1048576 2024-03-04T12:41:12.345 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.339+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~Z1EAHRLAX8TG.1 size=1048576 2024-03-04T12:41:12.346 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.340+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~Z1EAHRLAX8TG.2 size=792613 2024-03-04T12:41:12.346 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.340+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=Z1EAHRLAX8TG tag=UU8GN4KLDZDY type=write size=3938341 2024-03-04T12:41:12.347 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.342+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~EU04DFTYSWEQ.0 size=1048576 2024-03-04T12:41:12.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.342+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~EU04DFTYSWEQ.1 size=1048576 2024-03-04T12:41:12.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.342+0000 7f093583d780 1 < canceled part key=_multipart_Y4D4Q7NV5VMO.2~EU04DFTYSWEQ.2 size=874552 2024-03-04T12:41:12.351 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.344+0000 7f093583d780 1 < canceled multipart upload key=Y4D4Q7NV5VMO upload=EU04DFTYSWEQ tag=QR8D0QCEBPDI type=write size=4020280 2024-03-04T12:41:12.351 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.345+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=BH7CYCY8K3KF type=del size=1369745 2024-03-04T12:41:12.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.347+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=LDJFH70HR442 type=del 2024-03-04T12:41:12.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.348+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=XE3RLCRGK52C type=del size=1538567 2024-03-04T12:41:12.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.350+0000 7f093583d780 1 < suggested update operation key=OCOQJLUUNWRG tag=YYRXMSTB5IZ2 type=del size=155081 2024-03-04T12:41:12.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.351+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=Z49LCK4ACVKD type=del size=1520385 2024-03-04T12:41:12.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.352+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~YOGKJ1WPTVCJ.0 size=1048576 2024-03-04T12:41:12.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.353+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~YOGKJ1WPTVCJ.1 size=262556 2024-03-04T12:41:12.360 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.355+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=YOGKJ1WPTVCJ tag=HX63NFX2N902 type=write size=2359708 2024-03-04T12:41:12.361 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.356+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=VGXVOZXRXEYT type=del size=84959 2024-03-04T12:41:12.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.357+0000 7f093583d780 -1 < failed to complete operation key=OCOQJLUUNWRG tag=TKIXKIO8PKBH type=del size=1410031: (22) Invalid argument 2024-03-04T12:41:12.364 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.359+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~C7NT2685YMH7.0 size=1048576 2024-03-04T12:41:12.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.360+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~C7NT2685YMH7.1 size=1030179 2024-03-04T12:41:12.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.360+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=C7NT2685YMH7 tag=3B9PB4JFBJVN type=write size=3127331 2024-03-04T12:41:12.366 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.361+0000 7f093583d780 1 < canceled operation key=96PTQ2KHPMMM tag=IO9FHD8J5YUT type=del size=2017001 2024-03-04T12:41:12.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.362+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=RY26V68MPOYR type=del size=3726970 2024-03-04T12:41:12.370 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.364+0000 7f093583d780 1 < suggested update operation key=U6F7IZ07CS9Q tag=1YPSWLLVE3T1 type=del size=1819200 2024-03-04T12:41:12.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.365+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=VVX91O58PZVY type=del size=1401174 2024-03-04T12:41:12.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.367+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~6LXI6HQS2ILJ.0 size=1048576 2024-03-04T12:41:12.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.367+0000 7f093583d780 1 < canceled part key=_multipart_I5NQBROT0WKE.2~6LXI6HQS2ILJ.1 size=1001215 2024-03-04T12:41:12.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.368+0000 7f093583d780 1 < canceled multipart upload key=I5NQBROT0WKE upload=6LXI6HQS2ILJ tag=Z0S5Q7AGY0W5 type=write size=3098367 2024-03-04T12:41:12.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.370+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=LJGRQAO67CEC type=del size=1848098 2024-03-04T12:41:12.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.370+0000 7f093583d780 1 < canceled part key=_multipart_M0AOZ89IQNSK.2~Y72GJOBH0XVE.0 size=1048576 2024-03-04T12:41:12.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.371+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~Y72GJOBH0XVE.1 size=1048576 2024-03-04T12:41:12.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.372+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~Y72GJOBH0XVE.2 size=898985 2024-03-04T12:41:12.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.374+0000 7f093583d780 1 < canceled multipart upload key=M0AOZ89IQNSK upload=Y72GJOBH0XVE tag=XEK9USB0IFCC type=write size=4044713 2024-03-04T12:41:12.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.375+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=F4LZAHP5WLLB type=del size=3433647 2024-03-04T12:41:12.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.376+0000 7f093583d780 1 < canceled operation key=96PTQ2KHPMMM tag=QZ2IDVWN70QC type=del size=1049529 2024-03-04T12:41:12.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.377+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=Y2ZIFKXK22M7 type=del size=3025591 2024-03-04T12:41:12.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.379+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~GHC55N10J232.0 size=1048576 2024-03-04T12:41:12.385 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.379+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~GHC55N10J232.1 size=1048576 2024-03-04T12:41:12.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.380+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~GHC55N10J232.2 size=839120 2024-03-04T12:41:12.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.382+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=GHC55N10J232 tag=TXFLG45PMKQA type=write size=3984848 2024-03-04T12:41:12.389 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.383+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=QU6HXQJW8XS5 type=del size=3721720 2024-03-04T12:41:12.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.386+0000 7f093583d780 1 < suggested update operation key=TMAI6MOG2C4N tag=7E8IOGRWMFFI type=del size=2673243 2024-03-04T12:41:12.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.387+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=FK89WC1VESJK type=del size=3826881 2024-03-04T12:41:12.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.388+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=YUJJVEVKY4QZ type=del 2024-03-04T12:41:12.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.390+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~UVUP21TAWJHN.0 size=1048576 2024-03-04T12:41:12.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.391+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~UVUP21TAWJHN.1 size=1048576 2024-03-04T12:41:12.397 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.392+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~UVUP21TAWJHN.2 size=289248 2024-03-04T12:41:12.397 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.392+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=UVUP21TAWJHN tag=WT2UTDWMFCC4 type=write size=3434976 2024-03-04T12:41:12.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.393+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~ELGFH2XLO57M.0 size=1048576 2024-03-04T12:41:12.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.394+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~ELGFH2XLO57M.1 size=1048576 2024-03-04T12:41:12.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.395+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~ELGFH2XLO57M.2 size=554586 2024-03-04T12:41:12.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.397+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=ELGFH2XLO57M tag=FA68HZELMWM0 type=write size=3700314 2024-03-04T12:41:12.404 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.399+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~1K2EG5T2QVXV.0 size=1048576 2024-03-04T12:41:12.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.400+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~1K2EG5T2QVXV.1 size=1048576 2024-03-04T12:41:12.406 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.401+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~1K2EG5T2QVXV.2 size=668060 2024-03-04T12:41:12.406 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.401+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=1K2EG5T2QVXV tag=6LRA1ED5ZMWL type=write size=3813788 2024-03-04T12:41:12.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.402+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=OSYF9FL1PUTC type=del 2024-03-04T12:41:12.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.403+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=USOGW19K30R2 type=del size=3680984 2024-03-04T12:41:12.410 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.405+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~Z1EAHRLAX8TG.0 size=1048576 2024-03-04T12:41:12.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.406+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~Z1EAHRLAX8TG.1 size=1048576 2024-03-04T12:41:12.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.407+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~Z1EAHRLAX8TG.2 size=792613 2024-03-04T12:41:12.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.409+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=Z1EAHRLAX8TG tag=UU8GN4KLDZDY type=write size=3938341 2024-03-04T12:41:12.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.410+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=2Z2HW8VOM4D4 type=del size=3918069 2024-03-04T12:41:12.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.411+0000 7f093583d780 -1 < failed to complete operation key=U6F7IZ07CS9Q tag=BH7CYCY8K3KF type=del size=1369745: (22) Invalid argument 2024-03-04T12:41:12.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.412+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=Y22L13X5EM7P type=del size=3534856 2024-03-04T12:41:12.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.413+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=XE3RLCRGK52C type=del 2024-03-04T12:41:12.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.415+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~PSTS3N46XUOX.0 size=636753 2024-03-04T12:41:12.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.415+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=PSTS3N46XUOX tag=CO0SGA2N3J1Q type=write size=1685329 2024-03-04T12:41:12.423 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.417+0000 7f093583d780 1 < canceled operation key=2XVNK3YEVHJ7 tag=Z49LCK4ACVKD type=del size=1520385 2024-03-04T12:41:12.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.419+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~F1QT7T92QVKD.0 size=1048576 2024-03-04T12:41:12.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.420+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~F1QT7T92QVKD.1 size=1048576 2024-03-04T12:41:12.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.421+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~F1QT7T92QVKD.2 size=1017450 2024-03-04T12:41:12.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.421+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=F1QT7T92QVKD tag=R6XG7QVWU3HH type=write size=4163178 2024-03-04T12:41:12.427 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.422+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=VGXVOZXRXEYT type=del 2024-03-04T12:41:12.429 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.423+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=P3Q8K9MTZOG1 type=del size=4118426 2024-03-04T12:41:12.430 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.424+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~C7NT2685YMH7.0 size=1048576 2024-03-04T12:41:12.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.425+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~C7NT2685YMH7.1 size=1030179 2024-03-04T12:41:12.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.427+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=C7NT2685YMH7 tag=3B9PB4JFBJVN type=write size=3127331 2024-03-04T12:41:12.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.430+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~HLSMPX7E11U2.0 size=1048576 2024-03-04T12:41:12.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.432+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~HLSMPX7E11U2.1 size=37341 2024-03-04T12:41:12.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.432+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=HLSMPX7E11U2 tag=89NJCUJNVP22 type=write size=2134493 2024-03-04T12:41:12.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.434+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=RY26V68MPOYR type=del 2024-03-04T12:41:12.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.435+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=SNLLOV74N6XT type=del size=4174834 2024-03-04T12:41:12.441 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.436+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=VVX91O58PZVY type=del 2024-03-04T12:41:12.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.438+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~D7SPNEJKO8U1.0 size=944191 2024-03-04T12:41:12.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.438+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=D7SPNEJKO8U1 tag=E5K4QWU9IC3Z type=write size=1992767 2024-03-04T12:41:12.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.439+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=LJGRQAO67CEC type=del 2024-03-04T12:41:12.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.441+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~U54L4JVB77Q1.0 size=1048576 2024-03-04T12:41:12.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.442+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~U54L4JVB77Q1.1 size=763093 2024-03-04T12:41:12.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.442+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=U54L4JVB77Q1 tag=PP4IT00L1625 type=write size=2860245 2024-03-04T12:41:12.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.444+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=F4LZAHP5WLLB type=del 2024-03-04T12:41:12.450 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.445+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=2T709MHUBFAA type=del size=1135865 2024-03-04T12:41:12.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.446+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=Y2ZIFKXK22M7 type=del 2024-03-04T12:41:12.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.447+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=24TZ7A94B9VG type=del size=2787450 2024-03-04T12:41:12.454 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.448+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=QU6HXQJW8XS5 type=del 2024-03-04T12:41:12.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.450+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~T0485IRMM3U7.0 size=375501 2024-03-04T12:41:12.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.450+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=T0485IRMM3U7 tag=Z0M596KAM26L type=write size=1424077 2024-03-04T12:41:12.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.452+0000 7f093583d780 1 < suggested remove operation key=3F8GI0JCUR6W tag=FK89WC1VESJK type=del 2024-03-04T12:41:12.459 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.453+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=42DG8133OTSO type=del size=297834 2024-03-04T12:41:12.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.455+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~UVUP21TAWJHN.0 size=1048576 2024-03-04T12:41:12.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.456+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~UVUP21TAWJHN.1 size=1048576 2024-03-04T12:41:12.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.456+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~UVUP21TAWJHN.2 size=289248 2024-03-04T12:41:12.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.459+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=UVUP21TAWJHN tag=WT2UTDWMFCC4 type=write size=3434976 2024-03-04T12:41:12.465 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.460+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=D2LSTIXB6Z3X type=del size=505476 2024-03-04T12:41:12.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.461+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~1K2EG5T2QVXV.0 size=1048576 2024-03-04T12:41:12.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.462+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~1K2EG5T2QVXV.1 size=1048576 2024-03-04T12:41:12.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.463+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~1K2EG5T2QVXV.2 size=668060 2024-03-04T12:41:12.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.465+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=1K2EG5T2QVXV tag=6LRA1ED5ZMWL type=write size=3813788 2024-03-04T12:41:12.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.467+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~8KF9SF79OZDJ.0 size=611203 2024-03-04T12:41:12.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.467+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=8KF9SF79OZDJ tag=M3MYLHYHAIH0 type=write size=1659779 2024-03-04T12:41:12.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.468+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=USOGW19K30R2 type=del 2024-03-04T12:41:12.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.470+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=P1WBD0N8Z1GN type=del size=3682739 2024-03-04T12:41:12.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.472+0000 7f093583d780 1 < suggested remove operation key=F269PJEZ05IO tag=2Z2HW8VOM4D4 type=del 2024-03-04T12:41:12.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.473+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=MIL2TLX60HHR type=del size=3438997 2024-03-04T12:41:12.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.474+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=Y22L13X5EM7P type=del 2024-03-04T12:41:12.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.476+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~YEA96OPUKAAT.0 size=1048576 2024-03-04T12:41:12.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.477+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~YEA96OPUKAAT.1 size=1048576 2024-03-04T12:41:12.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.477+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~YEA96OPUKAAT.2 size=391767 2024-03-04T12:41:12.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.477+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=YEA96OPUKAAT tag=ERW43TOJCS76 type=write size=3537495 2024-03-04T12:41:12.484 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.478+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~PSTS3N46XUOX.0 size=636753 2024-03-04T12:41:12.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.480+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=PSTS3N46XUOX tag=CO0SGA2N3J1Q type=write size=1685329 2024-03-04T12:41:12.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.481+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=48I6TITZ1XQP type=del size=1125956 2024-03-04T12:41:12.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.482+0000 7f093583d780 1 < canceled part key=_multipart_OCOQJLUUNWRG.2~F1QT7T92QVKD.0 size=1048576 2024-03-04T12:41:12.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.483+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~F1QT7T92QVKD.1 size=1048576 2024-03-04T12:41:12.489 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.484+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~F1QT7T92QVKD.2 size=1017450 2024-03-04T12:41:12.491 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.485+0000 7f093583d780 1 < canceled multipart upload key=OCOQJLUUNWRG upload=F1QT7T92QVKD tag=R6XG7QVWU3HH type=write size=4163178 2024-03-04T12:41:12.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.488+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~YSPDWNDULWBO.0 size=1048576 2024-03-04T12:41:12.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.488+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~YSPDWNDULWBO.1 size=1048576 2024-03-04T12:41:12.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.489+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~YSPDWNDULWBO.2 size=676689 2024-03-04T12:41:12.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.489+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=YSPDWNDULWBO tag=DRQFI7BTSH9P type=write size=3822417 2024-03-04T12:41:12.496 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.491+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=P3Q8K9MTZOG1 type=del 2024-03-04T12:41:12.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.492+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=YZEXDMUL32S5 type=del size=2149308 2024-03-04T12:41:12.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.493+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~HLSMPX7E11U2.0 size=1048576 2024-03-04T12:41:12.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.494+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~HLSMPX7E11U2.1 size=37341 2024-03-04T12:41:12.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.496+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=HLSMPX7E11U2 tag=89NJCUJNVP22 type=write size=2134493 2024-03-04T12:41:12.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.498+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~OFLKT496SGQK.0 size=1048576 2024-03-04T12:41:12.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.499+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~OFLKT496SGQK.1 size=1048576 2024-03-04T12:41:12.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.500+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~OFLKT496SGQK.2 size=151283 2024-03-04T12:41:12.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.500+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=OFLKT496SGQK tag=32IVVVK61694 type=write size=3297011 2024-03-04T12:41:12.506 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.501+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=SNLLOV74N6XT type=del 2024-03-04T12:41:12.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.502+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=36ZXGT21DP0Z type=del size=3797410 2024-03-04T12:41:12.509 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.503+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~D7SPNEJKO8U1.0 size=944191 2024-03-04T12:41:12.511 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.505+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=D7SPNEJKO8U1 tag=E5K4QWU9IC3Z type=write size=1992767 2024-03-04T12:41:12.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.506+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=5R5UNLW14J7C type=del size=272705 2024-03-04T12:41:12.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.508+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~U54L4JVB77Q1.0 size=1048576 2024-03-04T12:41:12.514 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.509+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~U54L4JVB77Q1.1 size=763093 2024-03-04T12:41:12.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.511+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=U54L4JVB77Q1 tag=PP4IT00L1625 type=write size=2860245 2024-03-04T12:41:12.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.512+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=617QO7MH6P0G type=del size=3722766 2024-03-04T12:41:12.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.513+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=2T709MHUBFAA type=del 2024-03-04T12:41:12.520 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.514+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=GH9MGFP7RXKQ type=write size=696081 2024-03-04T12:41:12.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.515+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=24TZ7A94B9VG type=del 2024-03-04T12:41:12.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.516+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=ZOFZB9IXLBZC type=del size=1573716 2024-03-04T12:41:12.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.517+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~T0485IRMM3U7.0 size=375501 2024-03-04T12:41:12.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.519+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=T0485IRMM3U7 tag=Z0M596KAM26L type=write size=1424077 2024-03-04T12:41:12.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.520+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=5IAW0M7YLWYW type=del size=2894602 2024-03-04T12:41:12.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.521+0000 7f093583d780 1 < completed delete operation key=NFM6LT89K5F4 tag=42DG8133OTSO type=del 2024-03-04T12:41:12.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.523+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~5XA4K4AYN017.0 size=701511 2024-03-04T12:41:12.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.523+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=5XA4K4AYN017 tag=3WU77GZIN1ZM type=write size=1750087 2024-03-04T12:41:12.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.524+0000 7f093583d780 1 < canceled operation key=NFM6LT89K5F4 tag=D2LSTIXB6Z3X type=del size=505476 2024-03-04T12:41:12.532 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.526+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~SG3BOLI6PRT2.0 size=197483 2024-03-04T12:41:12.532 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.526+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=SG3BOLI6PRT2 tag=KY9S7LWCBQWQ type=write size=1246059 2024-03-04T12:41:12.533 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.527+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~8KF9SF79OZDJ.0 size=611203 2024-03-04T12:41:12.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.530+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=8KF9SF79OZDJ tag=M3MYLHYHAIH0 type=write size=1659779 2024-03-04T12:41:12.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.531+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=66B3KADVHFO8 type=write size=638121 2024-03-04T12:41:12.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.532+0000 7f093583d780 1 < canceled operation key=O6OUISHWZ7FU tag=P1WBD0N8Z1GN type=del size=3682739 2024-03-04T12:41:12.539 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.533+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=2PO27AFSZ7HK type=del size=605359 2024-03-04T12:41:12.540 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.534+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=MIL2TLX60HHR type=del 2024-03-04T12:41:12.541 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.535+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=NQ6AZZBLR9Z8 type=write size=500864 2024-03-04T12:41:12.541 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.536+0000 7f093583d780 1 < canceled part key=_multipart_UAEQORB3BDBH.2~YEA96OPUKAAT.0 size=1048576 2024-03-04T12:41:12.543 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.537+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~YEA96OPUKAAT.1 size=1048576 2024-03-04T12:41:12.543 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.538+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~YEA96OPUKAAT.2 size=391767 2024-03-04T12:41:12.545 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.540+0000 7f093583d780 1 < canceled multipart upload key=UAEQORB3BDBH upload=YEA96OPUKAAT tag=ERW43TOJCS76 type=write size=3537495 2024-03-04T12:41:12.546 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.541+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=0WR4M15L9DH9 type=del size=1335019 2024-03-04T12:41:12.548 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.543+0000 7f093583d780 1 < suggested update operation key=2R5WA9Q9ZAUG tag=48I6TITZ1XQP type=del size=1125956 2024-03-04T12:41:12.550 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.545+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~EK7AU67267EK.0 size=1048576 2024-03-04T12:41:12.551 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.546+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~EK7AU67267EK.1 size=245490 2024-03-04T12:41:12.552 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.546+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=EK7AU67267EK tag=0J1O3GV61LYN type=write size=2342642 2024-03-04T12:41:12.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.547+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~YSPDWNDULWBO.0 size=1048576 2024-03-04T12:41:12.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.548+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~YSPDWNDULWBO.1 size=1048576 2024-03-04T12:41:12.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.549+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~YSPDWNDULWBO.2 size=676689 2024-03-04T12:41:12.556 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.550+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=YSPDWNDULWBO tag=DRQFI7BTSH9P type=write size=3822417 2024-03-04T12:41:12.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.552+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~M0EXQC4AEKBF.0 size=340839 2024-03-04T12:41:12.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.552+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=M0EXQC4AEKBF tag=GRLYHSV28T5R type=write size=1389415 2024-03-04T12:41:12.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.553+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=YZEXDMUL32S5 type=del 2024-03-04T12:41:12.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.554+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=G22UDXLBCYJE type=del size=832162 2024-03-04T12:41:12.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.555+0000 7f093583d780 1 < canceled part key=_multipart_PT63VLFQQN0E.2~OFLKT496SGQK.0 size=1048576 2024-03-04T12:41:12.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.556+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~OFLKT496SGQK.1 size=1048576 2024-03-04T12:41:12.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.557+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~OFLKT496SGQK.2 size=151283 2024-03-04T12:41:12.564 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.559+0000 7f093583d780 1 < canceled multipart upload key=PT63VLFQQN0E upload=OFLKT496SGQK tag=32IVVVK61694 type=write size=3297011 2024-03-04T12:41:12.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.560+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=ZYON48RYJGIV type=del size=498554 2024-03-04T12:41:12.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.561+0000 7f093583d780 1 < completed delete operation key=NFM6LT89K5F4 tag=36ZXGT21DP0Z type=del 2024-03-04T12:41:12.569 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.563+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~05T9X7SJ30VK.0 size=39664 2024-03-04T12:41:12.569 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.563+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=05T9X7SJ30VK tag=7K1BJBLT2WGN type=write size=1088240 2024-03-04T12:41:12.571 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.565+0000 7f093583d780 1 < suggested update operation key=3F8GI0JCUR6W tag=5R5UNLW14J7C type=del size=272705 2024-03-04T12:41:12.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.566+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=LDX88BKIXUE4 type=write size=563515 2024-03-04T12:41:12.573 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.567+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=617QO7MH6P0G type=del 2024-03-04T12:41:12.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.568+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=USUXF6QZ40WM type=del size=1531413 2024-03-04T12:41:12.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.570+0000 7f093583d780 1 < completed write operation key=96PTQ2KHPMMM tag=GH9MGFP7RXKQ type=write size=696081 2024-03-04T12:41:12.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.571+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=5S6Z4YTC9EDW type=del size=4010287 2024-03-04T12:41:12.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.573+0000 7f093583d780 1 < suggested remove operation key=HG0EM344TJZY tag=ZOFZB9IXLBZC type=del 2024-03-04T12:41:12.579 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.574+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=0W9ZW6FHZ90L type=del size=1145043 2024-03-04T12:41:12.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.575+0000 7f093583d780 -1 < failed to complete operation key=2R5WA9Q9ZAUG tag=5IAW0M7YLWYW type=del size=2894602: (22) Invalid argument 2024-03-04T12:41:12.582 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.576+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=UBVJCHWYIADM type=del size=3502184 2024-03-04T12:41:12.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.577+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~5XA4K4AYN017.0 size=701511 2024-03-04T12:41:12.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.579+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=5XA4K4AYN017 tag=3WU77GZIN1ZM type=write size=1750087 2024-03-04T12:41:12.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.580+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=8IWGSR7M1N8T type=del size=3169613 2024-03-04T12:41:12.587 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.581+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~SG3BOLI6PRT2.0 size=197483 2024-03-04T12:41:12.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.583+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=SG3BOLI6PRT2 tag=KY9S7LWCBQWQ type=write size=1246059 2024-03-04T12:41:12.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.585+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~GFPN5WHI7QTJ.0 size=1048576 2024-03-04T12:41:12.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.586+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~GFPN5WHI7QTJ.1 size=1048576 2024-03-04T12:41:12.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.587+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~GFPN5WHI7QTJ.2 size=167153 2024-03-04T12:41:12.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.587+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=GFPN5WHI7QTJ tag=RM1ZLZX0FYS6 type=write size=3312881 2024-03-04T12:41:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.590+0000 7f093583d780 1 < suggested update operation key=2R5WA9Q9ZAUG tag=66B3KADVHFO8 type=write size=638121 2024-03-04T12:41:12.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.591+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=1KKG5928UXC5 type=del size=2870819 2024-03-04T12:41:12.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.593+0000 7f093583d780 1 < suggested update operation key=I6DIP4VGHMNO tag=2PO27AFSZ7HK type=del size=605359 2024-03-04T12:41:12.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.594+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=5LMXPR4IHHI1 type=write size=389705 2024-03-04T12:41:12.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.595+0000 7f093583d780 1 < completed write operation key=I5NQBROT0WKE tag=NQ6AZZBLR9Z8 type=write size=500864 2024-03-04T12:41:12.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.597+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~K97N0OEELK8R.0 size=1048576 2024-03-04T12:41:12.604 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.598+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~K97N0OEELK8R.1 size=1048576 2024-03-04T12:41:12.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.599+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~K97N0OEELK8R.2 size=537096 2024-03-04T12:41:12.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.599+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=K97N0OEELK8R tag=Z6M38WGT5F2R type=write size=3682824 2024-03-04T12:41:12.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.601+0000 7f093583d780 1 < completed delete operation key=O6OUISHWZ7FU tag=0WR4M15L9DH9 type=del 2024-03-04T12:41:12.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.603+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~6BL3H2K50TII.0 size=1048576 2024-03-04T12:41:12.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.604+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~6BL3H2K50TII.1 size=1048576 2024-03-04T12:41:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.604+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~6BL3H2K50TII.2 size=144830 2024-03-04T12:41:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.604+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=6BL3H2K50TII tag=7EXU9SRU0MNF type=write size=3290558 2024-03-04T12:41:12.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.606+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~EK7AU67267EK.0 size=1048576 2024-03-04T12:41:12.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.607+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~EK7AU67267EK.1 size=245490 2024-03-04T12:41:12.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.609+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=EK7AU67267EK tag=0J1O3GV61LYN type=write size=2342642 2024-03-04T12:41:12.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.611+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~NT5E5CBM5IT1.0 size=1046190 2024-03-04T12:41:12.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.611+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=NT5E5CBM5IT1 tag=0FZZQ4WDOGUJ type=write size=2094766 2024-03-04T12:41:12.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.612+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~M0EXQC4AEKBF.0 size=340839 2024-03-04T12:41:12.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.614+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=M0EXQC4AEKBF tag=GRLYHSV28T5R type=write size=1389415 2024-03-04T12:41:12.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.615+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=E29DZRLY87RB type=del size=57065 2024-03-04T12:41:12.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.617+0000 7f093583d780 1 < suggested remove operation key=2ZOV2JEQHXGS tag=G22UDXLBCYJE type=del 2024-03-04T12:41:12.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.618+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=198C6LW2849S type=del size=1919145 2024-03-04T12:41:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.621+0000 7f093583d780 1 < suggested update operation key=3F8GI0JCUR6W tag=ZYON48RYJGIV type=del size=498554 2024-03-04T12:41:12.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.622+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=WVAY473SM8Y2 type=write size=419387 2024-03-04T12:41:12.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.623+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~05T9X7SJ30VK.0 size=39664 2024-03-04T12:41:12.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.625+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=05T9X7SJ30VK tag=7K1BJBLT2WGN type=write size=1088240 2024-03-04T12:41:12.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.626+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=G22GQNT4QAMG type=write size=353102 2024-03-04T12:41:12.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.628+0000 7f093583d780 1 < suggested update operation key=UAEQORB3BDBH tag=LDX88BKIXUE4 type=write size=563515 2024-03-04T12:41:12.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.629+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=Y91CXVC8QFEQ type=del size=2198733 2024-03-04T12:41:12.636 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.630+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=USUXF6QZ40WM type=del 2024-03-04T12:41:12.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.631+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=DLNC66HQ1I0Z type=del size=71957 2024-03-04T12:41:12.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.632+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=5S6Z4YTC9EDW type=del 2024-03-04T12:41:12.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.633+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=6JQ9TJ0J4X62 type=del size=967039 2024-03-04T12:41:12.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.635+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=0W9ZW6FHZ90L type=del 2024-03-04T12:41:12.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.636+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=FR5V9IKLGGTD type=del size=2240828 2024-03-04T12:41:12.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.637+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=UBVJCHWYIADM type=del 2024-03-04T12:41:12.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.639+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~UUCWTVDY7X9L.0 size=1048576 2024-03-04T12:41:12.645 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.640+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~UUCWTVDY7X9L.1 size=885820 2024-03-04T12:41:12.645 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.640+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=UUCWTVDY7X9L tag=IC7KM50ISC6O type=write size=2982972 2024-03-04T12:41:12.646 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.641+0000 7f093583d780 -1 < failed to complete operation key=2ZOV2JEQHXGS tag=8IWGSR7M1N8T type=del size=3169613: (22) Invalid argument 2024-03-04T12:41:12.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.644+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~E38EP7WVQRYT.0 size=1048576 2024-03-04T12:41:12.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.646+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~E38EP7WVQRYT.1 size=442473 2024-03-04T12:41:12.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.646+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=E38EP7WVQRYT tag=5J08Q1NDVOH4 type=write size=2539625 2024-03-04T12:41:12.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.647+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~GFPN5WHI7QTJ.0 size=1048576 2024-03-04T12:41:12.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.648+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~GFPN5WHI7QTJ.1 size=1048576 2024-03-04T12:41:12.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.649+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~GFPN5WHI7QTJ.2 size=167153 2024-03-04T12:41:12.657 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.651+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=GFPN5WHI7QTJ tag=RM1ZLZX0FYS6 type=write size=3312881 2024-03-04T12:41:12.659 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.653+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~2SEN2AD7S7PL.0 size=1048576 2024-03-04T12:41:12.659 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.654+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~2SEN2AD7S7PL.1 size=400466 2024-03-04T12:41:12.659 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.654+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=2SEN2AD7S7PL tag=8EF5VZYNI2JV type=write size=2497618 2024-03-04T12:41:12.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.655+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=1KKG5928UXC5 type=del 2024-03-04T12:41:12.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.656+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=M2Y0GXRXM5VQ type=del size=4094288 2024-03-04T12:41:12.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.658+0000 7f093583d780 1 < suggested update operation key=FT2XNJYYT30J tag=5LMXPR4IHHI1 type=write size=389705 2024-03-04T12:41:12.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.660+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~22K3H0MPS5R1.0 size=704872 2024-03-04T12:41:12.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.660+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=22K3H0MPS5R1 tag=S5MW4LB3RXRZ type=write size=1753448 2024-03-04T12:41:12.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.661+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~K97N0OEELK8R.0 size=1048576 2024-03-04T12:41:12.668 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.662+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~K97N0OEELK8R.1 size=1048576 2024-03-04T12:41:12.669 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.663+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~K97N0OEELK8R.2 size=537096 2024-03-04T12:41:12.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.665+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=K97N0OEELK8R tag=Z6M38WGT5F2R type=write size=3682824 2024-03-04T12:41:12.673 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.667+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~0OTAKI62SHHQ.0 size=1048576 2024-03-04T12:41:12.673 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.668+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~0OTAKI62SHHQ.1 size=1048576 2024-03-04T12:41:12.674 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.669+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~0OTAKI62SHHQ.2 size=61477 2024-03-04T12:41:12.674 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.669+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=0OTAKI62SHHQ tag=8C59X39NQSHY type=write size=3207205 2024-03-04T12:41:12.675 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.670+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~6BL3H2K50TII.0 size=1048576 2024-03-04T12:41:12.676 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.671+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~6BL3H2K50TII.1 size=1048576 2024-03-04T12:41:12.677 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.672+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~6BL3H2K50TII.2 size=144830 2024-03-04T12:41:12.679 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.674+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=6BL3H2K50TII tag=7EXU9SRU0MNF type=write size=3290558 2024-03-04T12:41:12.680 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.675+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=QX19MVI2ANPZ type=del size=349480 2024-03-04T12:41:12.681 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.676+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~NT5E5CBM5IT1.0 size=1046190 2024-03-04T12:41:12.683 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.678+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=NT5E5CBM5IT1 tag=0FZZQ4WDOGUJ type=write size=2094766 2024-03-04T12:41:12.685 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.680+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~FA07XBE1SQDR.0 size=376446 2024-03-04T12:41:12.685 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.680+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=FA07XBE1SQDR tag=S17OAC2NRT3T type=write size=1425022 2024-03-04T12:41:12.686 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.681+0000 7f093583d780 1 < canceled operation key=96PTQ2KHPMMM tag=E29DZRLY87RB type=del size=57065 2024-03-04T12:41:12.689 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.683+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~8CODEN13E4GV.0 size=1048576 2024-03-04T12:41:12.690 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.684+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~8CODEN13E4GV.1 size=1048576 2024-03-04T12:41:12.691 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.685+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~8CODEN13E4GV.2 size=591334 2024-03-04T12:41:12.691 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.685+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=8CODEN13E4GV tag=E70MJJC7QY9R type=write size=3737062 2024-03-04T12:41:12.692 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.686+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=198C6LW2849S type=del 2024-03-04T12:41:12.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.688+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=IU65ET7ELWQ4 type=del size=331785 2024-03-04T12:41:12.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.689+0000 7f093583d780 1 < completed write operation key=9E12MS7PETOK tag=WVAY473SM8Y2 type=write size=419387 2024-03-04T12:41:12.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.690+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=L78YCS3PCZ66 type=del size=3080962 2024-03-04T12:41:12.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.691+0000 7f093583d780 -1 < failed to complete operation key=FT2XNJYYT30J tag=G22GQNT4QAMG type=write size=353102: (22) Invalid argument 2024-03-04T12:41:12.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.693+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~95P3W4PVF484.0 size=237553 2024-03-04T12:41:12.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.693+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=95P3W4PVF484 tag=N2KQ8N4IJVJL type=write size=1286129 2024-03-04T12:41:12.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.694+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=Y91CXVC8QFEQ type=del 2024-03-04T12:41:12.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.696+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~THP1WGUB36G8.0 size=706274 2024-03-04T12:41:12.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.696+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=THP1WGUB36G8 tag=JUYGZBBWRHXB type=write size=1754850 2024-03-04T12:41:12.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.699+0000 7f093583d780 1 < suggested update operation key=OCOQJLUUNWRG tag=DLNC66HQ1I0Z type=del size=71957 2024-03-04T12:41:12.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.700+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=U04S86I3J4LU type=del size=3333303 2024-03-04T12:41:12.706 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.701+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=6JQ9TJ0J4X62 type=del 2024-03-04T12:41:12.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.703+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~EQC1O7GVV5PN.0 size=1048576 2024-03-04T12:41:12.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.704+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~EQC1O7GVV5PN.1 size=51277 2024-03-04T12:41:12.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.704+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=EQC1O7GVV5PN tag=354NMYGIPJJ4 type=write size=2148429 2024-03-04T12:41:12.712 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.706+0000 7f093583d780 1 < suggested update operation key=L4UQK3UJFXZC tag=FR5V9IKLGGTD type=del size=2240828 2024-03-04T12:41:12.713 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.707+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=448N56HQJI97 type=del size=719521 2024-03-04T12:41:12.714 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.708+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~UUCWTVDY7X9L.0 size=1048576 2024-03-04T12:41:12.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.709+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~UUCWTVDY7X9L.1 size=885820 2024-03-04T12:41:12.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.711+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=UUCWTVDY7X9L tag=IC7KM50ISC6O type=write size=2982972 2024-03-04T12:41:12.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.713+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~4BPLDHFGTT1K.0 size=1048576 2024-03-04T12:41:12.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.714+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~4BPLDHFGTT1K.1 size=18529 2024-03-04T12:41:12.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.714+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=4BPLDHFGTT1K tag=808PG8TRGYG0 type=write size=2115681 2024-03-04T12:41:12.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.716+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~E38EP7WVQRYT.0 size=1048576 2024-03-04T12:41:12.722 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.717+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~E38EP7WVQRYT.1 size=442473 2024-03-04T12:41:12.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.718+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=E38EP7WVQRYT tag=5J08Q1NDVOH4 type=write size=2539625 2024-03-04T12:41:12.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.720+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=G44X0YKD9Y08 type=del size=2455264 2024-03-04T12:41:12.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.721+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~2SEN2AD7S7PL.0 size=1048576 2024-03-04T12:41:12.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.724+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~2SEN2AD7S7PL.1 size=400466 2024-03-04T12:41:12.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.726+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=2SEN2AD7S7PL tag=8EF5VZYNI2JV type=write size=2497618 2024-03-04T12:41:12.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.727+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=9Z7LOQSWNLJ5 type=del size=1052308 2024-03-04T12:41:12.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.728+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=M2Y0GXRXM5VQ type=del 2024-03-04T12:41:12.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.730+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~2WDWWUPVYEIL.0 size=244138 2024-03-04T12:41:12.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.730+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=2WDWWUPVYEIL tag=TXJF9K1L5BCT type=write size=1292714 2024-03-04T12:41:12.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.731+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~22K3H0MPS5R1.0 size=704872 2024-03-04T12:41:12.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.733+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=22K3H0MPS5R1 tag=S5MW4LB3RXRZ type=write size=1753448 2024-03-04T12:41:12.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.734+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=NO707285VT8Y type=del size=3276951 2024-03-04T12:41:12.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.735+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~0OTAKI62SHHQ.0 size=1048576 2024-03-04T12:41:12.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.735+0000 7f093583d780 1 < canceled part key=_multipart_NFM6LT89K5F4.2~0OTAKI62SHHQ.1 size=1048576 2024-03-04T12:41:12.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.736+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~0OTAKI62SHHQ.2 size=61477 2024-03-04T12:41:12.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.738+0000 7f093583d780 1 < canceled multipart upload key=NFM6LT89K5F4 upload=0OTAKI62SHHQ tag=8C59X39NQSHY type=write size=3207205 2024-03-04T12:41:12.744 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.739+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=751CCQDSAX9L type=del size=3774097 2024-03-04T12:41:12.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.740+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=QX19MVI2ANPZ type=del 2024-03-04T12:41:12.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.742+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~B9RQ93CA1RNI.0 size=679357 2024-03-04T12:41:12.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.742+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=B9RQ93CA1RNI tag=9CSFRPWDC4BM type=write size=1727933 2024-03-04T12:41:12.748 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.743+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~FA07XBE1SQDR.0 size=376446 2024-03-04T12:41:12.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.745+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=FA07XBE1SQDR tag=S17OAC2NRT3T type=write size=1425022 2024-03-04T12:41:12.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.747+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~MOS82P5AR4BH.0 size=1048576 2024-03-04T12:41:12.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.748+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~MOS82P5AR4BH.1 size=888688 2024-03-04T12:41:12.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.748+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=MOS82P5AR4BH tag=UTIX6UIZXJC9 type=write size=2985840 2024-03-04T12:41:12.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.750+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~8CODEN13E4GV.0 size=1048576 2024-03-04T12:41:12.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.751+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~8CODEN13E4GV.1 size=1048576 2024-03-04T12:41:12.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.751+0000 7f093583d780 1 < canceled part key=_multipart_F269PJEZ05IO.2~8CODEN13E4GV.2 size=591334 2024-03-04T12:41:12.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.753+0000 7f093583d780 1 < canceled multipart upload key=F269PJEZ05IO upload=8CODEN13E4GV tag=E70MJJC7QY9R type=write size=3737062 2024-03-04T12:41:12.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.755+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~3LIBMUV57P7N.0 size=1048576 2024-03-04T12:41:12.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.756+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~3LIBMUV57P7N.1 size=1048576 2024-03-04T12:41:12.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.757+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~3LIBMUV57P7N.2 size=812688 2024-03-04T12:41:12.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.757+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=3LIBMUV57P7N tag=ZPRQCK559OB0 type=write size=3958416 2024-03-04T12:41:12.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.758+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=IU65ET7ELWQ4 type=del 2024-03-04T12:41:12.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.759+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=H165WJ3NBY5V type=write size=174700 2024-03-04T12:41:12.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.760+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=L78YCS3PCZ66 type=del 2024-03-04T12:41:12.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.761+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=FOZR03SQP403 type=del size=931242 2024-03-04T12:41:12.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.762+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~95P3W4PVF484.0 size=237553 2024-03-04T12:41:12.769 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.764+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=95P3W4PVF484 tag=N2KQ8N4IJVJL type=write size=1286129 2024-03-04T12:41:12.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.765+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=7C6NKI83S9DT type=del size=1684776 2024-03-04T12:41:12.772 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.766+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~THP1WGUB36G8.0 size=706274 2024-03-04T12:41:12.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.768+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=THP1WGUB36G8 tag=JUYGZBBWRHXB type=write size=1754850 2024-03-04T12:41:12.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.769+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=QFLW94WARRXV type=del size=3341387 2024-03-04T12:41:12.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.771+0000 7f093583d780 1 < suggested update operation key=U6F7IZ07CS9Q tag=U04S86I3J4LU type=del size=3333303 2024-03-04T12:41:12.779 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.773+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~OC39L42RGS6Z.0 size=1048576 2024-03-04T12:41:12.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.774+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~OC39L42RGS6Z.1 size=1048576 2024-03-04T12:41:12.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.775+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~OC39L42RGS6Z.2 size=880705 2024-03-04T12:41:12.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.775+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=OC39L42RGS6Z tag=ONGDX8BQQ0JS type=write size=4026433 2024-03-04T12:41:12.782 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.776+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~EQC1O7GVV5PN.0 size=1048576 2024-03-04T12:41:12.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.777+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~EQC1O7GVV5PN.1 size=51277 2024-03-04T12:41:12.785 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.779+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=EQC1O7GVV5PN tag=354NMYGIPJJ4 type=write size=2148429 2024-03-04T12:41:12.786 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.780+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=UFFJVVQBFF3R type=write size=378885 2024-03-04T12:41:12.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.782+0000 7f093583d780 1 < suggested remove operation key=2XVNK3YEVHJ7 tag=448N56HQJI97 type=del 2024-03-04T12:41:12.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.784+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~976U0BFG7YE6.0 size=355125 2024-03-04T12:41:12.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.784+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=976U0BFG7YE6 tag=GQI21HUSCOB9 type=write size=1403701 2024-03-04T12:41:12.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.786+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~4BPLDHFGTT1K.0 size=1048576 2024-03-04T12:41:12.792 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.787+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~4BPLDHFGTT1K.1 size=18529 2024-03-04T12:41:12.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.788+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=4BPLDHFGTT1K tag=808PG8TRGYG0 type=write size=2115681 2024-03-04T12:41:12.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.790+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=0PG9RYJ0OJ0C type=del size=3520296 2024-03-04T12:41:12.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.791+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=G44X0YKD9Y08 type=del 2024-03-04T12:41:12.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.793+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~TQ4QDOC1UHEJ.0 size=1048576 2024-03-04T12:41:12.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.794+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~TQ4QDOC1UHEJ.1 size=1048576 2024-03-04T12:41:12.800 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.795+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~TQ4QDOC1UHEJ.2 size=127440 2024-03-04T12:41:12.800 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.795+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=TQ4QDOC1UHEJ tag=GZIJ82OIUR2H type=write size=3273168 2024-03-04T12:41:12.801 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.795+0000 7f093583d780 -1 < no bi entry to suggest for operation key=2XVNK3YEVHJ7 tag=9Z7LOQSWNLJ5 type=del size=1052308: (2) No such file or directory 2024-03-04T12:41:12.802 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.796+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=AI2JP56D0FL1 type=write size=341268 2024-03-04T12:41:12.803 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.797+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~2WDWWUPVYEIL.0 size=244138 2024-03-04T12:41:12.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.799+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=2WDWWUPVYEIL tag=TXJF9K1L5BCT type=write size=1292714 2024-03-04T12:41:12.807 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.802+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~IM3SRQADZH22.0 size=1048576 2024-03-04T12:41:12.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.802+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~IM3SRQADZH22.1 size=218166 2024-03-04T12:41:12.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.802+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=IM3SRQADZH22 tag=1Z8F2OSQGG1Y type=write size=2315318 2024-03-04T12:41:12.809 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.804+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=NO707285VT8Y type=del 2024-03-04T12:41:12.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.805+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=B7OT6I4BRQUD type=del size=3453652 2024-03-04T12:41:12.813 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.807+0000 7f093583d780 1 < suggested update operation key=NQF43I07F2HT tag=751CCQDSAX9L type=del size=3774097 2024-03-04T12:41:12.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.808+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=306YH528BWA9 type=del size=3799434 2024-03-04T12:41:12.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.809+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~B9RQ93CA1RNI.0 size=679357 2024-03-04T12:41:12.817 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.811+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=B9RQ93CA1RNI tag=9CSFRPWDC4BM type=write size=1727933 2024-03-04T12:41:12.818 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.812+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=K3R84I01WXL9 type=del size=2534488 2024-03-04T12:41:12.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.814+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~MOS82P5AR4BH.0 size=1048576 2024-03-04T12:41:12.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.815+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~MOS82P5AR4BH.1 size=888688 2024-03-04T12:41:12.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.816+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=MOS82P5AR4BH tag=UTIX6UIZXJC9 type=write size=2985840 2024-03-04T12:41:12.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.818+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~4594I69CDTEK.0 size=1048576 2024-03-04T12:41:12.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.819+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~4594I69CDTEK.1 size=1048576 2024-03-04T12:41:12.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.820+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~4594I69CDTEK.2 size=56241 2024-03-04T12:41:12.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.820+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=4594I69CDTEK tag=G6T4SMA10TGV type=write size=3201969 2024-03-04T12:41:12.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.822+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~3LIBMUV57P7N.0 size=1048576 2024-03-04T12:41:12.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.823+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~3LIBMUV57P7N.1 size=1048576 2024-03-04T12:41:12.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.823+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~3LIBMUV57P7N.2 size=812688 2024-03-04T12:41:12.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.825+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=3LIBMUV57P7N tag=ZPRQCK559OB0 type=write size=3958416 2024-03-04T12:41:12.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.826+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=IXBTK95E8MVV type=del size=2459999 2024-03-04T12:41:12.834 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.829+0000 7f093583d780 1 < suggested remove operation key=PT63VLFQQN0E tag=H165WJ3NBY5V type=write 2024-03-04T12:41:12.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.830+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=5LV35OL7CJLK type=del size=1071317 2024-03-04T12:41:12.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.831+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=FOZR03SQP403 type=del 2024-03-04T12:41:12.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.833+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=ERA7O3XA6NKN type=del size=1406017 2024-03-04T12:41:12.839 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.834+0000 7f093583d780 -1 < failed to complete operation key=PT63VLFQQN0E tag=7C6NKI83S9DT type=del size=1684776: (22) Invalid argument 2024-03-04T12:41:12.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.835+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=FH9BR3P5XIL3 type=del size=2580604 2024-03-04T12:41:12.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.836+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=QFLW94WARRXV type=del 2024-03-04T12:41:12.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.838+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~1680X1XLXE9R.0 size=1048576 2024-03-04T12:41:12.845 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.839+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~1680X1XLXE9R.1 size=631116 2024-03-04T12:41:12.845 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.839+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=1680X1XLXE9R tag=J828W6YSDAMC type=write size=2728268 2024-03-04T12:41:12.845 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.839+0000 7f093583d780 1 < canceled part key=_multipart_GJ0FQ6EH9HJL.2~OC39L42RGS6Z.0 size=1048576 2024-03-04T12:41:12.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.840+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~OC39L42RGS6Z.1 size=1048576 2024-03-04T12:41:12.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.841+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~OC39L42RGS6Z.2 size=880705 2024-03-04T12:41:12.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.843+0000 7f093583d780 1 < canceled multipart upload key=GJ0FQ6EH9HJL upload=OC39L42RGS6Z tag=ONGDX8BQQ0JS type=write size=4026433 2024-03-04T12:41:12.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.845+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=G397VSG9WIVQ type=del size=216935 2024-03-04T12:41:12.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.846+0000 7f093583d780 1 < completed write operation key=L4UQK3UJFXZC tag=UFFJVVQBFF3R type=write size=378885 2024-03-04T12:41:12.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.847+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=3GCY730WP3FU type=write size=854640 2024-03-04T12:41:12.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.848+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~976U0BFG7YE6.0 size=355125 2024-03-04T12:41:12.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.850+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=976U0BFG7YE6 tag=GQI21HUSCOB9 type=write size=1403701 2024-03-04T12:41:12.857 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.852+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~6N0TPK82B9V7.0 size=782914 2024-03-04T12:41:12.857 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.852+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=6N0TPK82B9V7 tag=H25IXABRDHDW type=write size=1831490 2024-03-04T12:41:12.858 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.853+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=0PG9RYJ0OJ0C type=del 2024-03-04T12:41:12.859 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.854+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=LCAU4N62VV4L type=write size=61898 2024-03-04T12:41:12.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.856+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~TQ4QDOC1UHEJ.0 size=1048576 2024-03-04T12:41:12.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.857+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~TQ4QDOC1UHEJ.1 size=1048576 2024-03-04T12:41:12.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.858+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~TQ4QDOC1UHEJ.2 size=127440 2024-03-04T12:41:12.866 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.861+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=TQ4QDOC1UHEJ tag=GZIJ82OIUR2H type=write size=3273168 2024-03-04T12:41:12.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.862+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=Y8OGZJWNZ48C type=del size=743527 2024-03-04T12:41:12.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.863+0000 7f093583d780 1 < completed write operation key=TMAI6MOG2C4N tag=AI2JP56D0FL1 type=write size=341268 2024-03-04T12:41:12.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.865+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~CCV20XP51UJE.0 size=1048576 2024-03-04T12:41:12.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.866+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~CCV20XP51UJE.1 size=788145 2024-03-04T12:41:12.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.866+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=CCV20XP51UJE tag=F7ZPOT9LZP68 type=write size=2885297 2024-03-04T12:41:12.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.866+0000 7f093583d780 1 < canceled part key=_multipart_I5NQBROT0WKE.2~IM3SRQADZH22.0 size=1048576 2024-03-04T12:41:12.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.867+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~IM3SRQADZH22.1 size=218166 2024-03-04T12:41:12.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.869+0000 7f093583d780 1 < canceled multipart upload key=I5NQBROT0WKE upload=IM3SRQADZH22 tag=1Z8F2OSQGG1Y type=write size=2315318 2024-03-04T12:41:12.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.870+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=170G16T9T6ET type=del size=2340056 2024-03-04T12:41:12.877 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.871+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=B7OT6I4BRQUD type=del 2024-03-04T12:41:12.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.873+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~03A24D4SL4VJ.0 size=771822 2024-03-04T12:41:12.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.873+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=03A24D4SL4VJ tag=8UHZJ0EK656E type=write size=1820398 2024-03-04T12:41:12.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.875+0000 7f093583d780 1 < suggested remove operation key=HG0EM344TJZY tag=306YH528BWA9 type=del 2024-03-04T12:41:12.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.877+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~AV6U3EO58I9F.0 size=940682 2024-03-04T12:41:12.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.877+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=AV6U3EO58I9F tag=SEBLOND7YLJE type=write size=1989258 2024-03-04T12:41:12.884 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.879+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=K3R84I01WXL9 type=del 2024-03-04T12:41:12.886 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.881+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~NPEI65KYKBAJ.0 size=1048576 2024-03-04T12:41:12.887 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.881+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~NPEI65KYKBAJ.1 size=600269 2024-03-04T12:41:12.887 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.881+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=NPEI65KYKBAJ tag=70W4BB40XWXW type=write size=2697421 2024-03-04T12:41:12.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.883+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~4594I69CDTEK.0 size=1048576 2024-03-04T12:41:12.889 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.884+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~4594I69CDTEK.1 size=1048576 2024-03-04T12:41:12.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.884+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~4594I69CDTEK.2 size=56241 2024-03-04T12:41:12.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.886+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=4594I69CDTEK tag=G6T4SMA10TGV type=write size=3201969 2024-03-04T12:41:12.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.888+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=YPXEJ3Q4MXDA type=del size=1625255 2024-03-04T12:41:12.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.889+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=IXBTK95E8MVV type=del 2024-03-04T12:41:12.895 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.890+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=6S72AI6UPNXY type=write size=888313 2024-03-04T12:41:12.896 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.891+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=5LV35OL7CJLK type=del 2024-03-04T12:41:12.899 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.893+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~3Y0OUC8OZTKV.0 size=248192 2024-03-04T12:41:12.899 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.893+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=3Y0OUC8OZTKV tag=XYV2O8TIXH4I type=write size=1296768 2024-03-04T12:41:12.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.895+0000 7f093583d780 1 < suggested update operation key=2R5WA9Q9ZAUG tag=ERA7O3XA6NKN type=del size=1406017 2024-03-04T12:41:12.902 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.897+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=K7L4SUMKMF10 type=del size=4026625 2024-03-04T12:41:12.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.898+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=FH9BR3P5XIL3 type=del 2024-03-04T12:41:12.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.900+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~0OPF5VACO1U4.0 size=393760 2024-03-04T12:41:12.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.900+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=0OPF5VACO1U4 tag=48OUN4EHR11Q type=write size=1442336 2024-03-04T12:41:12.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.901+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~1680X1XLXE9R.0 size=1048576 2024-03-04T12:41:12.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.902+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~1680X1XLXE9R.1 size=631116 2024-03-04T12:41:12.909 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.904+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=1680X1XLXE9R tag=J828W6YSDAMC type=write size=2728268 2024-03-04T12:41:12.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.905+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=2CHV24RJXU3E type=del size=12164 2024-03-04T12:41:12.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.906+0000 7f093583d780 -1 < failed to complete operation key=HG0EM344TJZY tag=G397VSG9WIVQ type=del size=216935: (22) Invalid argument 2024-03-04T12:41:12.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.908+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~HFYRO7MW3R74.0 size=313638 2024-03-04T12:41:12.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.908+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=HFYRO7MW3R74 tag=QHFO28XVR7LW type=write size=1362214 2024-03-04T12:41:12.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.910+0000 7f093583d780 1 < completed write operation key=GMKM2QEP072H tag=3GCY730WP3FU type=write size=854640 2024-03-04T12:41:12.916 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.911+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=49YB8W7TZ2RS type=del size=3082802 2024-03-04T12:41:12.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.912+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~6N0TPK82B9V7.0 size=782914 2024-03-04T12:41:12.919 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.914+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=6N0TPK82B9V7 tag=H25IXABRDHDW type=write size=1831490 2024-03-04T12:41:12.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.915+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=K5640H3GRZB2 type=del size=1180015 2024-03-04T12:41:12.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.917+0000 7f093583d780 1 < suggested remove operation key=9E12MS7PETOK tag=LCAU4N62VV4L type=write 2024-03-04T12:41:12.924 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.918+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=1THB6DL58S3P type=del size=548041 2024-03-04T12:41:12.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.920+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=Y8OGZJWNZ48C type=del 2024-03-04T12:41:12.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.921+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=6DF92LM809D2 type=del size=1501639 2024-03-04T12:41:12.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.922+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~CCV20XP51UJE.0 size=1048576 2024-03-04T12:41:12.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.923+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~CCV20XP51UJE.1 size=788145 2024-03-04T12:41:12.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.925+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=CCV20XP51UJE tag=F7ZPOT9LZP68 type=write size=2885297 2024-03-04T12:41:12.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.926+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=QVPYHS5FOD85 type=write size=10483 2024-03-04T12:41:12.933 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.927+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=170G16T9T6ET type=del 2024-03-04T12:41:12.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.928+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=C84S87M553AR type=write size=581617 2024-03-04T12:41:12.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.929+0000 7f093583d780 1 < canceled part key=_multipart_NQF43I07F2HT.2~03A24D4SL4VJ.0 size=771822 2024-03-04T12:41:12.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.930+0000 7f093583d780 1 < canceled multipart upload key=NQF43I07F2HT upload=03A24D4SL4VJ tag=8UHZJ0EK656E type=write size=1820398 2024-03-04T12:41:12.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.932+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~LF0QY8JZTK7C.0 size=891227 2024-03-04T12:41:12.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.932+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=LF0QY8JZTK7C tag=TVNK4PWJB2DQ type=write size=1939803 2024-03-04T12:41:12.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.934+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~AV6U3EO58I9F.0 size=940682 2024-03-04T12:41:12.941 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.935+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=AV6U3EO58I9F tag=SEBLOND7YLJE type=write size=1989258 2024-03-04T12:41:12.942 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.936+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=K8SG9TRAPO4X type=del size=840083 2024-03-04T12:41:12.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.938+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~NPEI65KYKBAJ.0 size=1048576 2024-03-04T12:41:12.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.940+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~NPEI65KYKBAJ.1 size=600269 2024-03-04T12:41:12.948 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.942+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=NPEI65KYKBAJ tag=70W4BB40XWXW type=write size=2697421 2024-03-04T12:41:12.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.944+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~849E1P0TBNPU.0 size=296492 2024-03-04T12:41:12.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.944+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=849E1P0TBNPU tag=36USQH1QQRO9 type=write size=1345068 2024-03-04T12:41:12.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.946+0000 7f093583d780 1 < suggested remove operation key=UAEQORB3BDBH tag=YPXEJ3Q4MXDA type=del 2024-03-04T12:41:12.954 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.948+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~QYOZ8KV6VK0W.0 size=1048576 2024-03-04T12:41:12.955 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.949+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~QYOZ8KV6VK0W.1 size=150156 2024-03-04T12:41:12.955 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.949+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=QYOZ8KV6VK0W tag=9SR0KFE5TY37 type=write size=2247308 2024-03-04T12:41:12.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.951+0000 7f093583d780 1 < completed write operation key=GMKM2QEP072H tag=6S72AI6UPNXY type=write size=888313 2024-03-04T12:41:12.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.953+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~NDLOMVYGH936.0 size=1048576 2024-03-04T12:41:12.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.953+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~NDLOMVYGH936.1 size=920986 2024-03-04T12:41:12.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.953+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=NDLOMVYGH936 tag=QW69STC0S0QJ type=write size=3018138 2024-03-04T12:41:12.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.955+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~3Y0OUC8OZTKV.0 size=248192 2024-03-04T12:41:12.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.957+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=3Y0OUC8OZTKV tag=XYV2O8TIXH4I type=write size=1296768 2024-03-04T12:41:12.964 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.958+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=07HH70CB7BLL type=del size=1996091 2024-03-04T12:41:12.965 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.959+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=K7L4SUMKMF10 type=del 2024-03-04T12:41:12.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.960+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=3WEI0BBSHX1A type=del size=623221 2024-03-04T12:41:12.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.962+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~0OPF5VACO1U4.0 size=393760 2024-03-04T12:41:12.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.964+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=0OPF5VACO1U4 tag=48OUN4EHR11Q type=write size=1442336 2024-03-04T12:41:12.971 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.966+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=4A3SG5EYJOJQ type=del size=1368745 2024-03-04T12:41:12.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.967+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=2CHV24RJXU3E type=del 2024-03-04T12:41:12.973 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.968+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=9VW9MFO9S3CS type=del size=2334598 2024-03-04T12:41:12.974 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.969+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~HFYRO7MW3R74.0 size=313638 2024-03-04T12:41:12.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.971+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=HFYRO7MW3R74 tag=QHFO28XVR7LW type=write size=1362214 2024-03-04T12:41:12.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.972+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=D7QNFYW74R46 type=del size=4152396 2024-03-04T12:41:12.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.973+0000 7f093583d780 -1 < failed to complete operation key=UAEQORB3BDBH tag=49YB8W7TZ2RS type=del size=3082802: (22) Invalid argument 2024-03-04T12:41:12.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.975+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~RNW1KLPAJK77.0 size=1048576 2024-03-04T12:41:12.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.976+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~RNW1KLPAJK77.1 size=312664 2024-03-04T12:41:12.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.976+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=RNW1KLPAJK77 tag=5FO1RA60D0R2 type=write size=2409816 2024-03-04T12:41:12.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.977+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=K5640H3GRZB2 type=del 2024-03-04T12:41:12.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.978+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=H53F3NIVE0PM type=del size=2374960 2024-03-04T12:41:12.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.980+0000 7f093583d780 1 < suggested update operation key=GJ0FQ6EH9HJL tag=1THB6DL58S3P type=del size=548041 2024-03-04T12:41:12.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.981+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=W1W9KZFX323O type=del size=3906311 2024-03-04T12:41:12.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.982+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=6DF92LM809D2 type=del 2024-03-04T12:41:12.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.983+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=LMAVCP0EJVBP type=del size=3218425 2024-03-04T12:41:12.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.984+0000 7f093583d780 1 < completed write operation key=O6OUISHWZ7FU tag=QVPYHS5FOD85 type=write size=10483 2024-03-04T12:41:12.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.986+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~YP76EXOAU57I.0 size=1048576 2024-03-04T12:41:12.992 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.987+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~YP76EXOAU57I.1 size=171421 2024-03-04T12:41:12.992 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.987+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=YP76EXOAU57I tag=0KHMY94YZ8VE type=write size=2268573 2024-03-04T12:41:12.993 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.988+0000 7f093583d780 1 < completed write operation key=3F8GI0JCUR6W tag=C84S87M553AR type=write size=581617 2024-03-04T12:41:12.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.990+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~HFW7HF25Y14M.0 size=910168 2024-03-04T12:41:12.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.990+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=HFW7HF25Y14M tag=CO86116C2F31 type=write size=1958744 2024-03-04T12:41:12.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.991+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~LF0QY8JZTK7C.0 size=891227 2024-03-04T12:41:12.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.992+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=LF0QY8JZTK7C tag=TVNK4PWJB2DQ type=write size=1939803 2024-03-04T12:41:13.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.994+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~Z8SFVYV3IE9U.0 size=119026 2024-03-04T12:41:13.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.994+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=Z8SFVYV3IE9U tag=ZZQRWOZPD2DE type=write size=1167602 2024-03-04T12:41:13.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.995+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=K8SG9TRAPO4X type=del 2024-03-04T12:41:13.002 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.996+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=SXXN36SCFHGX type=del size=1755721 2024-03-04T12:41:13.003 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.997+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~849E1P0TBNPU.0 size=296492 2024-03-04T12:41:13.005 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:12.999+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=849E1P0TBNPU tag=36USQH1QQRO9 type=write size=1345068 2024-03-04T12:41:13.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.000+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=HDPIFOVP4V2F type=del size=965427 2024-03-04T12:41:13.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.001+0000 7f093583d780 1 < canceled part key=_multipart_2YD2M0JQNCC0.2~QYOZ8KV6VK0W.0 size=1048576 2024-03-04T12:41:13.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.001+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~QYOZ8KV6VK0W.1 size=150156 2024-03-04T12:41:13.009 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.003+0000 7f093583d780 1 < canceled multipart upload key=2YD2M0JQNCC0 upload=QYOZ8KV6VK0W tag=9SR0KFE5TY37 type=write size=2247308 2024-03-04T12:41:13.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.005+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=WEFPQPODRY2G type=write size=715363 2024-03-04T12:41:13.011 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.006+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~NDLOMVYGH936.0 size=1048576 2024-03-04T12:41:13.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.007+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~NDLOMVYGH936.1 size=920986 2024-03-04T12:41:13.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.009+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=NDLOMVYGH936 tag=QW69STC0S0QJ type=write size=3018138 2024-03-04T12:41:13.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.010+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=NK9UJ7E333KS type=del size=841992 2024-03-04T12:41:13.017 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.011+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=07HH70CB7BLL type=del 2024-03-04T12:41:13.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.013+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~BN172T4D4B5M.0 size=1048576 2024-03-04T12:41:13.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.015+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~BN172T4D4B5M.1 size=1048576 2024-03-04T12:41:13.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.016+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~BN172T4D4B5M.2 size=843495 2024-03-04T12:41:13.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.016+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=BN172T4D4B5M tag=JP4OBJ6HKIIR type=write size=3989223 2024-03-04T12:41:13.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.017+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=3WEI0BBSHX1A type=del 2024-03-04T12:41:13.024 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.018+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=NDSG18XO82YA type=del size=2614770 2024-03-04T12:41:13.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.020+0000 7f093583d780 1 < suggested update operation key=AQI7H63EQSTN tag=4A3SG5EYJOJQ type=del size=1368745 2024-03-04T12:41:13.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.023+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~D3INWVPD0ZTD.0 size=1048576 2024-03-04T12:41:13.029 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.024+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~D3INWVPD0ZTD.1 size=558194 2024-03-04T12:41:13.029 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.024+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=D3INWVPD0ZTD tag=P8S0JSSGB366 type=write size=2655346 2024-03-04T12:41:13.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.025+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=9VW9MFO9S3CS type=del 2024-03-04T12:41:13.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.028+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~EZ83H0K0WT3G.0 size=63694 2024-03-04T12:41:13.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.028+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=EZ83H0K0WT3G tag=GXPBAESYXPQK type=write size=1112270 2024-03-04T12:41:13.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.030+0000 7f093583d780 1 < suggested remove operation key=U6F7IZ07CS9Q tag=D7QNFYW74R46 type=del 2024-03-04T12:41:13.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.031+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=I6M1HHT1V4VV type=write size=562813 2024-03-04T12:41:13.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.032+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~RNW1KLPAJK77.0 size=1048576 2024-03-04T12:41:13.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.033+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~RNW1KLPAJK77.1 size=312664 2024-03-04T12:41:13.040 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.035+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=RNW1KLPAJK77 tag=5FO1RA60D0R2 type=write size=2409816 2024-03-04T12:41:13.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.037+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~03RNN73PRP7F.0 size=1048576 2024-03-04T12:41:13.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.038+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~03RNN73PRP7F.1 size=1048576 2024-03-04T12:41:13.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.039+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~03RNN73PRP7F.2 size=948499 2024-03-04T12:41:13.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.039+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=03RNN73PRP7F tag=W9QOB9ACW5O8 type=write size=4094227 2024-03-04T12:41:13.045 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.040+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=H53F3NIVE0PM type=del 2024-03-04T12:41:13.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.042+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~2QUI68TNGIBG.0 size=1048576 2024-03-04T12:41:13.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.043+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~2QUI68TNGIBG.1 size=1048576 2024-03-04T12:41:13.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.045+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~2QUI68TNGIBG.2 size=956337 2024-03-04T12:41:13.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.045+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=2QUI68TNGIBG tag=QDMSQC2VRY66 type=write size=4102065 2024-03-04T12:41:13.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.047+0000 7f093583d780 1 < suggested remove operation key=I5NQBROT0WKE tag=W1W9KZFX323O type=del 2024-03-04T12:41:13.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.049+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~UWIP06YCKM2Y.0 size=1048576 2024-03-04T12:41:13.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.050+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~UWIP06YCKM2Y.1 size=1048576 2024-03-04T12:41:13.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.051+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~UWIP06YCKM2Y.2 size=188556 2024-03-04T12:41:13.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.051+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=UWIP06YCKM2Y tag=KJ812UK82VT8 type=write size=3334284 2024-03-04T12:41:13.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.052+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=LMAVCP0EJVBP type=del 2024-03-04T12:41:13.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.053+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=YC0I9IJZLEIN type=write size=110278 2024-03-04T12:41:13.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.054+0000 7f093583d780 1 < canceled part key=_multipart_M0AOZ89IQNSK.2~YP76EXOAU57I.0 size=1048576 2024-03-04T12:41:13.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.055+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~YP76EXOAU57I.1 size=171421 2024-03-04T12:41:13.062 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.057+0000 7f093583d780 1 < canceled multipart upload key=M0AOZ89IQNSK upload=YP76EXOAU57I tag=0KHMY94YZ8VE type=write size=2268573 2024-03-04T12:41:13.064 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.059+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~OJVV4VG5R5TU.0 size=1048576 2024-03-04T12:41:13.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.059+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~OJVV4VG5R5TU.1 size=1048576 2024-03-04T12:41:13.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.060+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~OJVV4VG5R5TU.2 size=1035427 2024-03-04T12:41:13.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.060+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=OJVV4VG5R5TU tag=W0WFIN73QGI4 type=write size=4181155 2024-03-04T12:41:13.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.062+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~HFW7HF25Y14M.0 size=910168 2024-03-04T12:41:13.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.064+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=HFW7HF25Y14M tag=CO86116C2F31 type=write size=1958744 2024-03-04T12:41:13.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.065+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=Z2AE7KIKTIRI type=del size=1436460 2024-03-04T12:41:13.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.073+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~Z8SFVYV3IE9U.0 size=119026 2024-03-04T12:41:13.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.076+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=Z8SFVYV3IE9U tag=ZZQRWOZPD2DE type=write size=1167602 2024-03-04T12:41:13.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.078+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=MKBPE6VLKPSL type=del size=3442275 2024-03-04T12:41:13.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.079+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=SXXN36SCFHGX type=del 2024-03-04T12:41:13.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.081+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~0VC3W35X35YS.0 size=1048576 2024-03-04T12:41:13.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.084+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~0VC3W35X35YS.1 size=1048576 2024-03-04T12:41:13.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.085+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~0VC3W35X35YS.2 size=367597 2024-03-04T12:41:13.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.085+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=0VC3W35X35YS tag=T3AOLR4UL7N2 type=write size=3513325 2024-03-04T12:41:13.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.086+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=HDPIFOVP4V2F type=del 2024-03-04T12:41:13.093 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.087+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=XONRA7VQTF1P type=del size=3513073 2024-03-04T12:41:13.094 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.088+0000 7f093583d780 1 < completed write operation key=96PTQ2KHPMMM tag=WEFPQPODRY2G type=write size=715363 2024-03-04T12:41:13.096 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.090+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~5L37LRRFS8IG.0 size=558576 2024-03-04T12:41:13.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.090+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=5L37LRRFS8IG tag=CLX1BJB02K07 type=write size=1607152 2024-03-04T12:41:13.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.091+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=NK9UJ7E333KS type=del 2024-03-04T12:41:13.098 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.092+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=7TBW23C8TMCY type=write size=190388 2024-03-04T12:41:13.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.093+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~BN172T4D4B5M.0 size=1048576 2024-03-04T12:41:13.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.094+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~BN172T4D4B5M.1 size=1048576 2024-03-04T12:41:13.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.095+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~BN172T4D4B5M.2 size=843495 2024-03-04T12:41:13.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.097+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=BN172T4D4B5M tag=JP4OBJ6HKIIR type=write size=3989223 2024-03-04T12:41:13.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.098+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=4H0O069IQ1FA type=del size=1695658 2024-03-04T12:41:13.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.099+0000 7f093583d780 1 < completed delete operation key=NFM6LT89K5F4 tag=NDSG18XO82YA type=del 2024-03-04T12:41:13.106 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.100+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=8HHCWWBLAXV6 type=del size=1094686 2024-03-04T12:41:13.107 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.101+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~D3INWVPD0ZTD.0 size=1048576 2024-03-04T12:41:13.108 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.102+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~D3INWVPD0ZTD.1 size=558194 2024-03-04T12:41:13.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.104+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=D3INWVPD0ZTD tag=P8S0JSSGB366 type=write size=2655346 2024-03-04T12:41:13.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.105+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=9E741TAL2A3O type=del size=301452 2024-03-04T12:41:13.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.106+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~EZ83H0K0WT3G.0 size=63694 2024-03-04T12:41:13.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.108+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=EZ83H0K0WT3G tag=GXPBAESYXPQK type=write size=1112270 2024-03-04T12:41:13.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.109+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=3N6RTY14MH1U type=del size=2862645 2024-03-04T12:41:13.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.111+0000 7f093583d780 1 < completed write operation key=J6Y9V11BX06B tag=I6M1HHT1V4VV type=write size=562813 2024-03-04T12:41:13.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.112+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=LF0QGV1GJ3I5 type=write size=801979 2024-03-04T12:41:13.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.113+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~03RNN73PRP7F.0 size=1048576 2024-03-04T12:41:13.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.114+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~03RNN73PRP7F.1 size=1048576 2024-03-04T12:41:13.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.115+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~03RNN73PRP7F.2 size=948499 2024-03-04T12:41:13.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.117+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=03RNN73PRP7F tag=W9QOB9ACW5O8 type=write size=4094227 2024-03-04T12:41:13.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.119+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=UI6R1P1685DL type=del size=3754711 2024-03-04T12:41:13.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.120+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~2QUI68TNGIBG.0 size=1048576 2024-03-04T12:41:13.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.121+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~2QUI68TNGIBG.1 size=1048576 2024-03-04T12:41:13.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.122+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~2QUI68TNGIBG.2 size=956337 2024-03-04T12:41:13.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.124+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=2QUI68TNGIBG tag=QDMSQC2VRY66 type=write size=4102065 2024-03-04T12:41:13.131 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.125+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=HBF7WRR6QJF9 type=write size=485353 2024-03-04T12:41:13.131 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.125+0000 7f093583d780 1 < canceled part key=_multipart_O6OUISHWZ7FU.2~UWIP06YCKM2Y.0 size=1048576 2024-03-04T12:41:13.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.126+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~UWIP06YCKM2Y.1 size=1048576 2024-03-04T12:41:13.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.127+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~UWIP06YCKM2Y.2 size=188556 2024-03-04T12:41:13.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.129+0000 7f093583d780 1 < canceled multipart upload key=O6OUISHWZ7FU upload=UWIP06YCKM2Y tag=KJ812UK82VT8 type=write size=3334284 2024-03-04T12:41:13.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.131+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=6LF0U9CRAJE6 type=del size=2868937 2024-03-04T12:41:13.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.132+0000 7f093583d780 1 < completed write operation key=GMKM2QEP072H tag=YC0I9IJZLEIN type=write size=110278 2024-03-04T12:41:13.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.133+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=LBWDRSAWKWN8 type=del size=1693541 2024-03-04T12:41:13.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.134+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~OJVV4VG5R5TU.0 size=1048576 2024-03-04T12:41:13.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.135+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~OJVV4VG5R5TU.1 size=1048576 2024-03-04T12:41:13.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.136+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~OJVV4VG5R5TU.2 size=1035427 2024-03-04T12:41:13.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.138+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=OJVV4VG5R5TU tag=W0WFIN73QGI4 type=write size=4181155 2024-03-04T12:41:13.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.140+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~QRA54RVIP67V.0 size=1048576 2024-03-04T12:41:13.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.141+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~QRA54RVIP67V.1 size=916224 2024-03-04T12:41:13.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.141+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=QRA54RVIP67V tag=W66PPHI662YW type=write size=3013376 2024-03-04T12:41:13.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.142+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=Z2AE7KIKTIRI type=del 2024-03-04T12:41:13.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.143+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=GWNQ4IZOJH3Y type=del size=3743649 2024-03-04T12:41:13.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.144+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=MKBPE6VLKPSL type=del 2024-03-04T12:41:13.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.146+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=HYKP2PE1AC21 type=del size=2470805 2024-03-04T12:41:13.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.147+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~0VC3W35X35YS.0 size=1048576 2024-03-04T12:41:13.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.148+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~0VC3W35X35YS.1 size=1048576 2024-03-04T12:41:13.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.148+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~0VC3W35X35YS.2 size=367597 2024-03-04T12:41:13.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.150+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=0VC3W35X35YS tag=T3AOLR4UL7N2 type=write size=3513325 2024-03-04T12:41:13.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.152+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~C2KCXSOH3R76.0 size=683466 2024-03-04T12:41:13.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.152+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=C2KCXSOH3R76 tag=MZ5JJCU60G9X type=write size=1732042 2024-03-04T12:41:13.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.153+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=XONRA7VQTF1P type=del 2024-03-04T12:41:13.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.156+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~Y2GB7UWS8QFX.0 size=1048576 2024-03-04T12:41:13.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.157+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~Y2GB7UWS8QFX.1 size=375190 2024-03-04T12:41:13.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.157+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=Y2GB7UWS8QFX tag=VGU6GFGCA9BT type=write size=2472342 2024-03-04T12:41:13.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.158+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~5L37LRRFS8IG.0 size=558576 2024-03-04T12:41:13.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.160+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=5L37LRRFS8IG tag=CLX1BJB02K07 type=write size=1607152 2024-03-04T12:41:13.168 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.162+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~R2KPGIZLW032.0 size=1048576 2024-03-04T12:41:13.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.163+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~R2KPGIZLW032.1 size=1048576 2024-03-04T12:41:13.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.164+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~R2KPGIZLW032.2 size=545739 2024-03-04T12:41:13.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.164+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=R2KPGIZLW032 tag=NIRRD25QJUW3 type=write size=3691467 2024-03-04T12:41:13.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.166+0000 7f093583d780 1 < suggested update operation key=2ZOV2JEQHXGS tag=7TBW23C8TMCY type=write size=190388 2024-03-04T12:41:13.174 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.168+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~NTXR8149BPM5.0 size=279113 2024-03-04T12:41:13.174 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.168+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=NTXR8149BPM5 tag=W6B1L14361G5 type=write size=1327689 2024-03-04T12:41:13.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.170+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=4H0O069IQ1FA type=del 2024-03-04T12:41:13.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.171+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=QRBH7MZTSUW8 type=del size=1071467 2024-03-04T12:41:13.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.172+0000 7f093583d780 1 < canceled operation key=3F8GI0JCUR6W tag=8HHCWWBLAXV6 type=del size=1094686 2024-03-04T12:41:13.180 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.174+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~G2JM9L4EJ7HS.0 size=1048576 2024-03-04T12:41:13.181 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.175+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~G2JM9L4EJ7HS.1 size=1048576 2024-03-04T12:41:13.181 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.176+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~G2JM9L4EJ7HS.2 size=123028 2024-03-04T12:41:13.181 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.176+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=G2JM9L4EJ7HS tag=GG6W0T8H1Z9L type=write size=3268756 2024-03-04T12:41:13.183 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.177+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=9E741TAL2A3O type=del 2024-03-04T12:41:13.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.178+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=UQKR21LWU5H8 type=write size=998522 2024-03-04T12:41:13.185 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.179+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=3N6RTY14MH1U type=del 2024-03-04T12:41:13.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.181+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~2RMPNHUHYRXY.0 size=1048576 2024-03-04T12:41:13.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.182+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~2RMPNHUHYRXY.1 size=641681 2024-03-04T12:41:13.188 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.182+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=2RMPNHUHYRXY tag=4KFCYRDVDC18 type=write size=2738833 2024-03-04T12:41:13.188 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.183+0000 7f093583d780 1 < completed write operation key=YJXFSO53QVPS tag=LF0QGV1GJ3I5 type=write size=801979 2024-03-04T12:41:13.190 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.184+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=PBJ2LPHC5JWA type=write size=997970 2024-03-04T12:41:13.192 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.186+0000 7f093583d780 1 < suggested update operation key=UAEQORB3BDBH tag=UI6R1P1685DL type=del size=3754711 2024-03-04T12:41:13.195 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.189+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=EN2GJET2RFJN type=del size=3628717 2024-03-04T12:41:13.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.192+0000 7f093583d780 1 < suggested remove operation key=NQF43I07F2HT tag=HBF7WRR6QJF9 type=write 2024-03-04T12:41:13.198 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.193+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=ECEBNNCKO7DZ type=del size=5049 2024-03-04T12:41:13.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.195+0000 7f093583d780 1 < suggested update operation key=AQI7H63EQSTN tag=6LF0U9CRAJE6 type=del size=2868937 2024-03-04T12:41:13.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.197+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~DG0Z9PO3FV4O.0 size=603504 2024-03-04T12:41:13.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.197+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=DG0Z9PO3FV4O tag=M5B0EOMNM410 type=write size=1652080 2024-03-04T12:41:13.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.197+0000 7f093583d780 -1 < no bi entry to suggest for operation key=NQF43I07F2HT tag=LBWDRSAWKWN8 type=del size=1693541: (2) No such file or directory 2024-03-04T12:41:13.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.199+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=SZQHCOM8W1RH type=del size=3066932 2024-03-04T12:41:13.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.200+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~QRA54RVIP67V.0 size=1048576 2024-03-04T12:41:13.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.201+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~QRA54RVIP67V.1 size=916224 2024-03-04T12:41:13.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.203+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=QRA54RVIP67V tag=W66PPHI662YW type=write size=3013376 2024-03-04T12:41:13.210 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.205+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~62UERDVYW4DL.0 size=1048576 2024-03-04T12:41:13.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.206+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~62UERDVYW4DL.1 size=746928 2024-03-04T12:41:13.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.206+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=62UERDVYW4DL tag=S72KQBV1T0VT type=write size=2844080 2024-03-04T12:41:13.213 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.208+0000 7f093583d780 1 < suggested remove operation key=HG0EM344TJZY tag=GWNQ4IZOJH3Y type=del 2024-03-04T12:41:13.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.210+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~ZBN01HEIJNJK.0 size=1048576 2024-03-04T12:41:13.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.210+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~ZBN01HEIJNJK.1 size=1048576 2024-03-04T12:41:13.217 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.211+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~ZBN01HEIJNJK.2 size=641357 2024-03-04T12:41:13.217 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.211+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=ZBN01HEIJNJK tag=7178PX4NSK5Q type=write size=3787085 2024-03-04T12:41:13.218 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.212+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=HYKP2PE1AC21 type=del 2024-03-04T12:41:13.220 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.215+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~IO65FA156LER.0 size=742158 2024-03-04T12:41:13.220 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.215+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=IO65FA156LER tag=1ICMAEP2942U type=write size=1790734 2024-03-04T12:41:13.222 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.216+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~C2KCXSOH3R76.0 size=683466 2024-03-04T12:41:13.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.218+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=C2KCXSOH3R76 tag=MZ5JJCU60G9X type=write size=1732042 2024-03-04T12:41:13.225 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.219+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=WO3FLRMFI9K3 type=del size=812570 2024-03-04T12:41:13.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.221+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~Y2GB7UWS8QFX.0 size=1048576 2024-03-04T12:41:13.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.221+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~Y2GB7UWS8QFX.1 size=375190 2024-03-04T12:41:13.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.223+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=Y2GB7UWS8QFX tag=VGU6GFGCA9BT type=write size=2472342 2024-03-04T12:41:13.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.225+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=35B6YGS0TCPH type=del size=1157111 2024-03-04T12:41:13.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.226+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~R2KPGIZLW032.0 size=1048576 2024-03-04T12:41:13.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.227+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~R2KPGIZLW032.1 size=1048576 2024-03-04T12:41:13.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.227+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~R2KPGIZLW032.2 size=545739 2024-03-04T12:41:13.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.229+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=R2KPGIZLW032 tag=NIRRD25QJUW3 type=write size=3691467 2024-03-04T12:41:13.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.232+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~2JUW8C08HVY5.0 size=1048576 2024-03-04T12:41:13.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.233+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~2JUW8C08HVY5.1 size=1048576 2024-03-04T12:41:13.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.234+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~2JUW8C08HVY5.2 size=181038 2024-03-04T12:41:13.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.234+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=2JUW8C08HVY5 tag=25CRC9FPYP5V type=write size=3326766 2024-03-04T12:41:13.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.235+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~NTXR8149BPM5.0 size=279113 2024-03-04T12:41:13.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.237+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=NTXR8149BPM5 tag=W6B1L14361G5 type=write size=1327689 2024-03-04T12:41:13.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.239+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~AK11AAL8TA6W.0 size=1048576 2024-03-04T12:41:13.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.240+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~AK11AAL8TA6W.1 size=245016 2024-03-04T12:41:13.246 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.240+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=AK11AAL8TA6W tag=XVPF65SUEEYT type=write size=2342168 2024-03-04T12:41:13.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.241+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=QRBH7MZTSUW8 type=del 2024-03-04T12:41:13.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.244+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~U1O71VFHL5WY.0 size=723677 2024-03-04T12:41:13.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.244+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=U1O71VFHL5WY tag=6V86IYOP7EY8 type=write size=1772253 2024-03-04T12:41:13.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.245+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~G2JM9L4EJ7HS.0 size=1048576 2024-03-04T12:41:13.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.246+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~G2JM9L4EJ7HS.1 size=1048576 2024-03-04T12:41:13.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.247+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~G2JM9L4EJ7HS.2 size=123028 2024-03-04T12:41:13.254 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.249+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=G2JM9L4EJ7HS tag=GG6W0T8H1Z9L type=write size=3268756 2024-03-04T12:41:13.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.251+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~I30MASWK9RSB.0 size=1048576 2024-03-04T12:41:13.257 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.252+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~I30MASWK9RSB.1 size=848721 2024-03-04T12:41:13.257 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.252+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=I30MASWK9RSB tag=UECK7Q5O2GJD type=write size=2945873 2024-03-04T12:41:13.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.253+0000 7f093583d780 1 < completed write operation key=Q45PKXZVJ6YS tag=UQKR21LWU5H8 type=write size=998522 2024-03-04T12:41:13.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.255+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~36Y7N1GWZ38T.0 size=84935 2024-03-04T12:41:13.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.255+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=36Y7N1GWZ38T tag=DG918EOKFVX2 type=write size=1133511 2024-03-04T12:41:13.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.256+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~2RMPNHUHYRXY.0 size=1048576 2024-03-04T12:41:13.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.257+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~2RMPNHUHYRXY.1 size=641681 2024-03-04T12:41:13.264 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.259+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=2RMPNHUHYRXY tag=4KFCYRDVDC18 type=write size=2738833 2024-03-04T12:41:13.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.260+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=NP59089M9QUB type=del size=3044824 2024-03-04T12:41:13.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.261+0000 7f093583d780 1 < canceled operation key=2R5WA9Q9ZAUG tag=PBJ2LPHC5JWA type=write size=997970 2024-03-04T12:41:13.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.262+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=W4Q629REENZ2 type=del size=1413795 2024-03-04T12:41:13.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.264+0000 7f093583d780 1 < suggested update operation key=PT63VLFQQN0E tag=EN2GJET2RFJN type=del size=3628717 2024-03-04T12:41:13.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.265+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=JZC6N3509SY6 type=write size=603871 2024-03-04T12:41:13.272 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.266+0000 7f093583d780 1 < canceled operation key=J6Y9V11BX06B tag=ECEBNNCKO7DZ type=del size=5049 2024-03-04T12:41:13.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.270+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~K0WG16D35QCN.0 size=1048576 2024-03-04T12:41:13.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.271+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~K0WG16D35QCN.1 size=1048576 2024-03-04T12:41:13.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.272+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~K0WG16D35QCN.2 size=339451 2024-03-04T12:41:13.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.272+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=K0WG16D35QCN tag=AITTF35G9Y58 type=write size=3485179 2024-03-04T12:41:13.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.273+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~DG0Z9PO3FV4O.0 size=603504 2024-03-04T12:41:13.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.275+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=DG0Z9PO3FV4O tag=M5B0EOMNM410 type=write size=1652080 2024-03-04T12:41:13.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.276+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=9VJX80ZZ9QQQ type=del size=3432994 2024-03-04T12:41:13.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.278+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=SZQHCOM8W1RH type=del 2024-03-04T12:41:13.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.280+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~YKFU8U7308MZ.0 size=840189 2024-03-04T12:41:13.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.280+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=YKFU8U7308MZ tag=IWSLGLFP3FS4 type=write size=1888765 2024-03-04T12:41:13.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.281+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~62UERDVYW4DL.0 size=1048576 2024-03-04T12:41:13.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.282+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~62UERDVYW4DL.1 size=746928 2024-03-04T12:41:13.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.284+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=62UERDVYW4DL tag=S72KQBV1T0VT type=write size=2844080 2024-03-04T12:41:13.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.286+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~4MS5D19Y17PL.0 size=1048576 2024-03-04T12:41:13.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.289+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~4MS5D19Y17PL.1 size=1048576 2024-03-04T12:41:13.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.290+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~4MS5D19Y17PL.2 size=102859 2024-03-04T12:41:13.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.290+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=4MS5D19Y17PL tag=MZSDRCVDZK5K type=write size=3248587 2024-03-04T12:41:13.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.291+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~ZBN01HEIJNJK.0 size=1048576 2024-03-04T12:41:13.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.291+0000 7f093583d780 1 < canceled part key=_multipart_J6Y9V11BX06B.2~ZBN01HEIJNJK.1 size=1048576 2024-03-04T12:41:13.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.291+0000 7f093583d780 1 < canceled part key=_multipart_J6Y9V11BX06B.2~ZBN01HEIJNJK.2 size=641357 2024-03-04T12:41:13.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.293+0000 7f093583d780 1 < canceled multipart upload key=J6Y9V11BX06B upload=ZBN01HEIJNJK tag=7178PX4NSK5Q type=write size=3787085 2024-03-04T12:41:13.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.295+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~S606LSUAXTQS.0 size=679725 2024-03-04T12:41:13.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.295+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=S606LSUAXTQS tag=O1J6XG1KOBI9 type=write size=1728301 2024-03-04T12:41:13.302 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.296+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~IO65FA156LER.0 size=742158 2024-03-04T12:41:13.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.299+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=IO65FA156LER tag=1ICMAEP2942U type=write size=1790734 2024-03-04T12:41:13.306 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.300+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=L9NNPN0RV8U5 type=del size=489022 2024-03-04T12:41:13.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.301+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=WO3FLRMFI9K3 type=del 2024-03-04T12:41:13.308 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.303+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=LGI4DCXN8RSI type=del size=3793435 2024-03-04T12:41:13.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.304+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=35B6YGS0TCPH type=del 2024-03-04T12:41:13.310 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.305+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=DFEY5BNGR3YB type=write size=789386 2024-03-04T12:41:13.311 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.306+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~2JUW8C08HVY5.0 size=1048576 2024-03-04T12:41:13.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.307+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~2JUW8C08HVY5.1 size=1048576 2024-03-04T12:41:13.313 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.308+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~2JUW8C08HVY5.2 size=181038 2024-03-04T12:41:13.315 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.310+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=2JUW8C08HVY5 tag=25CRC9FPYP5V type=write size=3326766 2024-03-04T12:41:13.316 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.311+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=KS19K2A1K6Y3 type=del size=3543467 2024-03-04T12:41:13.318 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.312+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~AK11AAL8TA6W.0 size=1048576 2024-03-04T12:41:13.319 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.314+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~AK11AAL8TA6W.1 size=245016 2024-03-04T12:41:13.321 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.316+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=AK11AAL8TA6W tag=XVPF65SUEEYT type=write size=2342168 2024-03-04T12:41:13.323 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.318+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~63NE443T9W9J.0 size=1048576 2024-03-04T12:41:13.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.319+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~63NE443T9W9J.1 size=1008131 2024-03-04T12:41:13.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.319+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=63NE443T9W9J tag=TJ5B8T367Y4R type=write size=3105283 2024-03-04T12:41:13.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.320+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~U1O71VFHL5WY.0 size=723677 2024-03-04T12:41:13.327 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.322+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=U1O71VFHL5WY tag=6V86IYOP7EY8 type=write size=1772253 2024-03-04T12:41:13.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.323+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=G1T1L18WK6NQ type=del size=3362199 2024-03-04T12:41:13.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.324+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~I30MASWK9RSB.0 size=1048576 2024-03-04T12:41:13.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.325+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~I30MASWK9RSB.1 size=848721 2024-03-04T12:41:13.332 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.327+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=I30MASWK9RSB tag=UECK7Q5O2GJD type=write size=2945873 2024-03-04T12:41:13.333 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.328+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=ZN7PVHZFSR5W type=write size=133794 2024-03-04T12:41:13.334 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.328+0000 7f093583d780 1 < canceled part key=_multipart_I6DIP4VGHMNO.2~36Y7N1GWZ38T.0 size=84935 2024-03-04T12:41:13.335 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.330+0000 7f093583d780 1 < canceled multipart upload key=I6DIP4VGHMNO upload=36Y7N1GWZ38T tag=DG918EOKFVX2 type=write size=1133511 2024-03-04T12:41:13.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.331+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=QD1VJWJIL22N type=del size=1652765 2024-03-04T12:41:13.337 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.332+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=NP59089M9QUB type=del 2024-03-04T12:41:13.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.333+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=E1URP6D5LO90 type=del size=496579 2024-03-04T12:41:13.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.334+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=W4Q629REENZ2 type=del 2024-03-04T12:41:13.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.335+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=QYAQ5S3WEYL5 type=del size=330420 2024-03-04T12:41:13.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.336+0000 7f093583d780 1 < completed write operation key=2XVNK3YEVHJ7 tag=JZC6N3509SY6 type=write size=603871 2024-03-04T12:41:13.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.338+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~TT1KE2J0QFCS.0 size=263422 2024-03-04T12:41:13.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.338+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=TT1KE2J0QFCS tag=XMUB8JTCZWWA type=write size=1311998 2024-03-04T12:41:13.345 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.339+0000 7f093583d780 1 < canceled part key=_multipart_AQI7H63EQSTN.2~K0WG16D35QCN.0 size=1048576 2024-03-04T12:41:13.345 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.340+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~K0WG16D35QCN.1 size=1048576 2024-03-04T12:41:13.346 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.341+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~K0WG16D35QCN.2 size=339451 2024-03-04T12:41:13.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.342+0000 7f093583d780 1 < canceled multipart upload key=AQI7H63EQSTN upload=K0WG16D35QCN tag=AITTF35G9Y58 type=write size=3485179 2024-03-04T12:41:13.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.344+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=K0DQ1MQRWSNJ type=del size=906306 2024-03-04T12:41:13.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.345+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=9VJX80ZZ9QQQ type=del 2024-03-04T12:41:13.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.346+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=VST3KI3KY3ZG type=del size=1545019 2024-03-04T12:41:13.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.347+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~YKFU8U7308MZ.0 size=840189 2024-03-04T12:41:13.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.349+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=YKFU8U7308MZ tag=IWSLGLFP3FS4 type=write size=1888765 2024-03-04T12:41:13.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.350+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=GP8L1SCCS048 type=write size=426551 2024-03-04T12:41:13.357 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.351+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~4MS5D19Y17PL.0 size=1048576 2024-03-04T12:41:13.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.352+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~4MS5D19Y17PL.1 size=1048576 2024-03-04T12:41:13.359 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.353+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~4MS5D19Y17PL.2 size=102859 2024-03-04T12:41:13.360 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.355+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=4MS5D19Y17PL tag=MZSDRCVDZK5K type=write size=3248587 2024-03-04T12:41:13.361 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.356+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=FO1FHKJHY4UW type=del size=1878727 2024-03-04T12:41:13.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.357+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~S606LSUAXTQS.0 size=679725 2024-03-04T12:41:13.364 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.359+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=S606LSUAXTQS tag=O1J6XG1KOBI9 type=write size=1728301 2024-03-04T12:41:13.366 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.361+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~8SPUIEZSC5HB.0 size=1048576 2024-03-04T12:41:13.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.361+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~8SPUIEZSC5HB.1 size=958198 2024-03-04T12:41:13.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.361+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=8SPUIEZSC5HB tag=ISCMWZPKUFV7 type=write size=3055350 2024-03-04T12:41:13.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.364+0000 7f093583d780 1 < suggested update operation key=O6OUISHWZ7FU tag=L9NNPN0RV8U5 type=del size=489022 2024-03-04T12:41:13.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.365+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=DYPCA13009JL type=del size=781455 2024-03-04T12:41:13.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.367+0000 7f093583d780 1 < suggested remove operation key=O6OUISHWZ7FU tag=LGI4DCXN8RSI type=del 2024-03-04T12:41:13.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.369+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~Y184P54GXTVM.0 size=1048576 2024-03-04T12:41:13.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.369+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~Y184P54GXTVM.1 size=1048576 2024-03-04T12:41:13.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.370+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~Y184P54GXTVM.2 size=1026030 2024-03-04T12:41:13.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.370+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=Y184P54GXTVM tag=L5IP1DO0NMAP type=write size=4171758 2024-03-04T12:41:13.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.372+0000 7f093583d780 1 < canceled operation key=YJXFSO53QVPS tag=DFEY5BNGR3YB type=write size=789386 2024-03-04T12:41:13.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.374+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~9F7WB39YY557.0 size=1048576 2024-03-04T12:41:13.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.375+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~9F7WB39YY557.1 size=1048576 2024-03-04T12:41:13.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.376+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~9F7WB39YY557.2 size=809361 2024-03-04T12:41:13.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.376+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=9F7WB39YY557 tag=750BMXSRQ012 type=write size=3955089 2024-03-04T12:41:13.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.377+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=KS19K2A1K6Y3 type=del 2024-03-04T12:41:13.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.378+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=KGLTQCPTPZI2 type=del size=3778332 2024-03-04T12:41:13.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.379+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~63NE443T9W9J.0 size=1048576 2024-03-04T12:41:13.385 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.380+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~63NE443T9W9J.1 size=1008131 2024-03-04T12:41:13.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.382+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=63NE443T9W9J tag=TJ5B8T367Y4R type=write size=3105283 2024-03-04T12:41:13.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.384+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~970GIKOBD7PX.0 size=412330 2024-03-04T12:41:13.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.384+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=970GIKOBD7PX tag=9UP30392LTED type=write size=1460906 2024-03-04T12:41:13.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.385+0000 7f093583d780 -1 < failed to complete operation key=O6OUISHWZ7FU tag=G1T1L18WK6NQ type=del size=3362199: (22) Invalid argument 2024-03-04T12:41:13.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.387+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=6LKUAM1J8WVG type=write size=395391 2024-03-04T12:41:13.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.389+0000 7f093583d780 1 < suggested remove operation key=J6Y9V11BX06B tag=ZN7PVHZFSR5W type=write 2024-03-04T12:41:13.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.390+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=3M2OH1J1ML47 type=del size=1268447 2024-03-04T12:41:13.397 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.391+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=QD1VJWJIL22N type=del 2024-03-04T12:41:13.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.393+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~1BKL6P6F6ZQ0.0 size=1048576 2024-03-04T12:41:13.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.394+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~1BKL6P6F6ZQ0.1 size=1048576 2024-03-04T12:41:13.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.395+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~1BKL6P6F6ZQ0.2 size=79664 2024-03-04T12:41:13.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.395+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=1BKL6P6F6ZQ0 tag=2F23T4FTY1M9 type=write size=3225392 2024-03-04T12:41:13.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.397+0000 7f093583d780 1 < suggested remove operation key=UAEQORB3BDBH tag=E1URP6D5LO90 type=del 2024-03-04T12:41:13.404 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.398+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=34ZZ1FYKIJQS type=del size=2536491 2024-03-04T12:41:13.406 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.401+0000 7f093583d780 1 < suggested update operation key=Q45PKXZVJ6YS tag=QYAQ5S3WEYL5 type=del size=330420 2024-03-04T12:41:13.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.402+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=9I7DXVUTO03S type=del size=3948430 2024-03-04T12:41:13.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.403+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~TT1KE2J0QFCS.0 size=263422 2024-03-04T12:41:13.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.406+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=TT1KE2J0QFCS tag=XMUB8JTCZWWA type=write size=1311998 2024-03-04T12:41:13.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.407+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=ZMDTC3MXZL3I type=del size=935281 2024-03-04T12:41:13.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.408+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=K0DQ1MQRWSNJ type=del 2024-03-04T12:41:13.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.409+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=08ZI6GF7D33I type=del size=486897 2024-03-04T12:41:13.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.412+0000 7f093583d780 1 < suggested remove operation key=96PTQ2KHPMMM tag=VST3KI3KY3ZG type=del 2024-03-04T12:41:13.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.413+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=XYDH7E3KJ8L7 type=del size=3647480 2024-03-04T12:41:13.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.415+0000 7f093583d780 1 < suggested remove operation key=YJXFSO53QVPS tag=GP8L1SCCS048 type=write 2024-03-04T12:41:13.423 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.417+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~RG33SF6D1RKO.0 size=1048576 2024-03-04T12:41:13.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.418+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~RG33SF6D1RKO.1 size=1048576 2024-03-04T12:41:13.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.419+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~RG33SF6D1RKO.2 size=956284 2024-03-04T12:41:13.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.419+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=RG33SF6D1RKO tag=UC4PZLDF29VG type=write size=4102012 2024-03-04T12:41:13.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.420+0000 7f093583d780 1 < canceled operation key=L4UQK3UJFXZC tag=FO1FHKJHY4UW type=del size=1878727 2024-03-04T12:41:13.427 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.421+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=Z0ZA0CF78UC6 type=del size=3658532 2024-03-04T12:41:13.428 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.423+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~8SPUIEZSC5HB.0 size=1048576 2024-03-04T12:41:13.429 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.424+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~8SPUIEZSC5HB.1 size=958198 2024-03-04T12:41:13.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.426+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=8SPUIEZSC5HB tag=ISCMWZPKUFV7 type=write size=3055350 2024-03-04T12:41:13.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.428+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~4HIEKS43TB70.0 size=1048576 2024-03-04T12:41:13.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.429+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~4HIEKS43TB70.1 size=426614 2024-03-04T12:41:13.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.429+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=4HIEKS43TB70 tag=E359XP5Q5R9N type=write size=2523766 2024-03-04T12:41:13.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.431+0000 7f093583d780 1 < suggested remove operation key=PT63VLFQQN0E tag=DYPCA13009JL type=del 2024-03-04T12:41:13.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.432+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=MTYLIXJ4K4NY type=del size=1445930 2024-03-04T12:41:13.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.434+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~Y184P54GXTVM.0 size=1048576 2024-03-04T12:41:13.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.435+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~Y184P54GXTVM.1 size=1048576 2024-03-04T12:41:13.441 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.435+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~Y184P54GXTVM.2 size=1026030 2024-03-04T12:41:13.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.437+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=Y184P54GXTVM tag=L5IP1DO0NMAP type=write size=4171758 2024-03-04T12:41:13.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.439+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=E7U98YQ75CKE type=write size=217209 2024-03-04T12:41:13.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.440+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~9F7WB39YY557.0 size=1048576 2024-03-04T12:41:13.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.441+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~9F7WB39YY557.1 size=1048576 2024-03-04T12:41:13.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.442+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~9F7WB39YY557.2 size=809361 2024-03-04T12:41:13.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.444+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=9F7WB39YY557 tag=750BMXSRQ012 type=write size=3955089 2024-03-04T12:41:13.450 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.445+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=WZM2AAM1Z8SB type=write size=80159 2024-03-04T12:41:13.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.446+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=KGLTQCPTPZI2 type=del 2024-03-04T12:41:13.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.447+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=5Q52G7BWUGRP type=del size=3922913 2024-03-04T12:41:13.454 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.448+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~970GIKOBD7PX.0 size=412330 2024-03-04T12:41:13.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.450+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=970GIKOBD7PX tag=9UP30392LTED type=write size=1460906 2024-03-04T12:41:13.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.452+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~F31GT745WF19.0 size=1048576 2024-03-04T12:41:13.459 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.453+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~F31GT745WF19.1 size=1048576 2024-03-04T12:41:13.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.454+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~F31GT745WF19.2 size=428988 2024-03-04T12:41:13.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.454+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=F31GT745WF19 tag=DD6O8T4F7R5J type=write size=3574716 2024-03-04T12:41:13.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.455+0000 7f093583d780 -1 < no bi entry to suggest for operation key=YJXFSO53QVPS tag=6LKUAM1J8WVG type=write size=395391: (2) No such file or directory 2024-03-04T12:41:13.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.457+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~5HZNTZ10FUMS.0 size=1048576 2024-03-04T12:41:13.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.457+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~5HZNTZ10FUMS.1 size=1048576 2024-03-04T12:41:13.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.458+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~5HZNTZ10FUMS.2 size=247890 2024-03-04T12:41:13.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.458+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=5HZNTZ10FUMS tag=QFCZ83DAOJGZ type=write size=3393618 2024-03-04T12:41:13.465 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.459+0000 7f093583d780 1 < canceled operation key=FT2XNJYYT30J tag=3M2OH1J1ML47 type=del size=1268447 2024-03-04T12:41:13.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.461+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=KRR2T0EZ8LCW type=del size=2373178 2024-03-04T12:41:13.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.462+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~1BKL6P6F6ZQ0.0 size=1048576 2024-03-04T12:41:13.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.463+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~1BKL6P6F6ZQ0.1 size=1048576 2024-03-04T12:41:13.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.464+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~1BKL6P6F6ZQ0.2 size=79664 2024-03-04T12:41:13.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.466+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=1BKL6P6F6ZQ0 tag=2F23T4FTY1M9 type=write size=3225392 2024-03-04T12:41:13.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.468+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~ECOUS3ZGLX93.0 size=517234 2024-03-04T12:41:13.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.468+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=ECOUS3ZGLX93 tag=DU73XPDTDKF0 type=write size=1565810 2024-03-04T12:41:13.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.470+0000 7f093583d780 1 < suggested update operation key=M0AOZ89IQNSK tag=34ZZ1FYKIJQS type=del size=2536491 2024-03-04T12:41:13.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.472+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=IFX5PGZ13ID1 type=del size=2364497 2024-03-04T12:41:13.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.474+0000 7f093583d780 1 < suggested remove operation key=GJ0FQ6EH9HJL tag=9I7DXVUTO03S type=del 2024-03-04T12:41:13.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.475+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=QU1TN6NMAC9V type=del size=1920147 2024-03-04T12:41:13.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.478+0000 7f093583d780 1 < suggested update operation key=9VKN43CB955V tag=ZMDTC3MXZL3I type=del size=935281 2024-03-04T12:41:13.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.479+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~8FG0IGFWB7TR.0 size=1048576 2024-03-04T12:41:13.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.480+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~8FG0IGFWB7TR.1 size=667879 2024-03-04T12:41:13.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.480+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=8FG0IGFWB7TR tag=ITOPCJJ2K33T type=write size=2765031 2024-03-04T12:41:13.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.483+0000 7f093583d780 1 < suggested update operation key=54FLC10FWKL6 tag=08ZI6GF7D33I type=del size=486897 2024-03-04T12:41:13.489 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.484+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=X93OGLATBLM7 type=del size=1097753 2024-03-04T12:41:13.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.486+0000 7f093583d780 1 < suggested remove operation key=54FLC10FWKL6 tag=XYDH7E3KJ8L7 type=del 2024-03-04T12:41:13.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.488+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=H3RQMWMSQJ3W type=write size=49889 2024-03-04T12:41:13.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.490+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~RG33SF6D1RKO.0 size=1048576 2024-03-04T12:41:13.496 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.490+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~RG33SF6D1RKO.1 size=1048576 2024-03-04T12:41:13.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.491+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~RG33SF6D1RKO.2 size=956284 2024-03-04T12:41:13.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.493+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=RG33SF6D1RKO tag=UC4PZLDF29VG type=write size=4102012 2024-03-04T12:41:13.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.495+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~GT5GRE0ZARU6.0 size=1048576 2024-03-04T12:41:13.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.496+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~GT5GRE0ZARU6.1 size=1048576 2024-03-04T12:41:13.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.497+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~GT5GRE0ZARU6.2 size=906267 2024-03-04T12:41:13.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.497+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=GT5GRE0ZARU6 tag=LP536O24WF6Y type=write size=4051995 2024-03-04T12:41:13.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.498+0000 7f093583d780 1 < canceled operation key=2ZOV2JEQHXGS tag=Z0ZA0CF78UC6 type=del size=3658532 2024-03-04T12:41:13.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.500+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~H9V389G40EDZ.0 size=1048576 2024-03-04T12:41:13.506 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.501+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~H9V389G40EDZ.1 size=1048576 2024-03-04T12:41:13.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.502+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~H9V389G40EDZ.2 size=1024565 2024-03-04T12:41:13.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.502+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=H9V389G40EDZ tag=0IOEFTMS0RJ7 type=write size=4170293 2024-03-04T12:41:13.508 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.503+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~4HIEKS43TB70.0 size=1048576 2024-03-04T12:41:13.509 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.504+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~4HIEKS43TB70.1 size=426614 2024-03-04T12:41:13.511 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.505+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=4HIEKS43TB70 tag=E359XP5Q5R9N type=write size=2523766 2024-03-04T12:41:13.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.506+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=X9LZ4CIIBOZ7 type=del size=3460032 2024-03-04T12:41:13.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.508+0000 7f093583d780 -1 < failed to complete operation key=9VKN43CB955V tag=MTYLIXJ4K4NY type=del size=1445930: (22) Invalid argument 2024-03-04T12:41:13.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.510+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~AJB0FFSJXJOS.0 size=1048576 2024-03-04T12:41:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.510+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~AJB0FFSJXJOS.1 size=1048576 2024-03-04T12:41:13.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.512+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~AJB0FFSJXJOS.2 size=573412 2024-03-04T12:41:13.518 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.512+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=AJB0FFSJXJOS tag=7BGNRS9MAN8K type=write size=3719140 2024-03-04T12:41:13.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.513+0000 7f093583d780 1 < completed write operation key=J6Y9V11BX06B tag=E7U98YQ75CKE type=write size=217209 2024-03-04T12:41:13.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.515+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~J05Q8CEKTMIY.0 size=422292 2024-03-04T12:41:13.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.515+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=J05Q8CEKTMIY tag=LYY8MA03CKRM type=write size=1470868 2024-03-04T12:41:13.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.516+0000 7f093583d780 -1 < failed to complete operation key=M0AOZ89IQNSK tag=WZM2AAM1Z8SB type=write size=80159: (22) Invalid argument 2024-03-04T12:41:13.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.518+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~QALW2E77FX4Q.0 size=1048576 2024-03-04T12:41:13.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.519+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~QALW2E77FX4Q.1 size=672595 2024-03-04T12:41:13.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.519+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=QALW2E77FX4Q tag=Y8N6NKVVOVXH type=write size=2769747 2024-03-04T12:41:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.520+0000 7f093583d780 -1 < failed to complete operation key=M0AOZ89IQNSK tag=5Q52G7BWUGRP type=del size=3922913: (22) Invalid argument 2024-03-04T12:41:13.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.522+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~0O4Z3VMO231X.0 size=1048576 2024-03-04T12:41:13.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.523+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~0O4Z3VMO231X.1 size=1048576 2024-03-04T12:41:13.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.524+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~0O4Z3VMO231X.2 size=123102 2024-03-04T12:41:13.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.524+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=0O4Z3VMO231X tag=EF2ETQQQYR22 type=write size=3268830 2024-03-04T12:41:13.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.525+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~F31GT745WF19.0 size=1048576 2024-03-04T12:41:13.531 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.526+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~F31GT745WF19.1 size=1048576 2024-03-04T12:41:13.532 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.527+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~F31GT745WF19.2 size=428988 2024-03-04T12:41:13.534 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.529+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=F31GT745WF19 tag=DD6O8T4F7R5J type=write size=3574716 2024-03-04T12:41:13.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.530+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=O6LSUUWGFPDN type=del size=487837 2024-03-04T12:41:13.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.531+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~5HZNTZ10FUMS.0 size=1048576 2024-03-04T12:41:13.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.532+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~5HZNTZ10FUMS.1 size=1048576 2024-03-04T12:41:13.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.532+0000 7f093583d780 1 < canceled part key=_multipart_F269PJEZ05IO.2~5HZNTZ10FUMS.2 size=247890 2024-03-04T12:41:13.539 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.534+0000 7f093583d780 1 < canceled multipart upload key=F269PJEZ05IO upload=5HZNTZ10FUMS tag=QFCZ83DAOJGZ type=write size=3393618 2024-03-04T12:41:13.541 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.535+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=AEQJV2CRR6V5 type=del size=3309696 2024-03-04T12:41:13.542 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.536+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=KRR2T0EZ8LCW type=del 2024-03-04T12:41:13.543 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.537+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=UE8EK6DDRJOZ type=del size=728076 2024-03-04T12:41:13.544 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.539+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~ECOUS3ZGLX93.0 size=517234 2024-03-04T12:41:13.546 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.541+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=ECOUS3ZGLX93 tag=DU73XPDTDKF0 type=write size=1565810 2024-03-04T12:41:13.548 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.543+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~GU00878SPUV1.0 size=1048576 2024-03-04T12:41:13.549 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.543+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~GU00878SPUV1.1 size=1048576 2024-03-04T12:41:13.550 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.544+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~GU00878SPUV1.2 size=384117 2024-03-04T12:41:13.550 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.544+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=GU00878SPUV1 tag=JFPGBWOQBLQQ type=write size=3529845 2024-03-04T12:41:13.551 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.545+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=IFX5PGZ13ID1 type=del 2024-03-04T12:41:13.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.548+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~ZKQX2FFCHVPG.0 size=1048576 2024-03-04T12:41:13.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.548+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~ZKQX2FFCHVPG.1 size=524055 2024-03-04T12:41:13.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.548+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=ZKQX2FFCHVPG tag=78HRHBLABC11 type=write size=2621207 2024-03-04T12:41:13.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.550+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=QU1TN6NMAC9V type=del 2024-03-04T12:41:13.556 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.551+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=3QNRUQ1OS46F type=write size=852243 2024-03-04T12:41:13.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.552+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~8FG0IGFWB7TR.0 size=1048576 2024-03-04T12:41:13.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.553+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~8FG0IGFWB7TR.1 size=667879 2024-03-04T12:41:13.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.555+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=8FG0IGFWB7TR tag=ITOPCJJ2K33T type=write size=2765031 2024-03-04T12:41:13.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.557+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~A6QZ0XEW3CRL.0 size=134394 2024-03-04T12:41:13.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.557+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=A6QZ0XEW3CRL tag=3L5U4DMP7YTA type=write size=1182970 2024-03-04T12:41:13.564 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.558+0000 7f093583d780 1 < canceled operation key=O6OUISHWZ7FU tag=X93OGLATBLM7 type=del size=1097753 2024-03-04T12:41:13.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.559+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=JO76X7L9RW46 type=del size=2661588 2024-03-04T12:41:13.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.560+0000 7f093583d780 1 < completed write operation key=OCOQJLUUNWRG tag=H3RQMWMSQJ3W type=write size=49889 2024-03-04T12:41:13.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.563+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~6G3N0HVV7DHW.0 size=360229 2024-03-04T12:41:13.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.563+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=6G3N0HVV7DHW tag=ZBNW18A535RW type=write size=1408805 2024-03-04T12:41:13.569 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.564+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~GT5GRE0ZARU6.0 size=1048576 2024-03-04T12:41:13.571 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.565+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~GT5GRE0ZARU6.1 size=1048576 2024-03-04T12:41:13.571 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.566+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~GT5GRE0ZARU6.2 size=906267 2024-03-04T12:41:13.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.568+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=GT5GRE0ZARU6 tag=LP536O24WF6Y type=write size=4051995 2024-03-04T12:41:13.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.569+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=SMZYFRLNXTAC type=del size=126410 2024-03-04T12:41:13.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.571+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~H9V389G40EDZ.0 size=1048576 2024-03-04T12:41:13.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.572+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~H9V389G40EDZ.1 size=1048576 2024-03-04T12:41:13.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.573+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~H9V389G40EDZ.2 size=1024565 2024-03-04T12:41:13.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.574+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=H9V389G40EDZ tag=0IOEFTMS0RJ7 type=write size=4170293 2024-03-04T12:41:13.582 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.576+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~B51M3SLLR5GJ.0 size=1048576 2024-03-04T12:41:13.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.577+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~B51M3SLLR5GJ.1 size=1048576 2024-03-04T12:41:13.584 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.578+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~B51M3SLLR5GJ.2 size=1017615 2024-03-04T12:41:13.584 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.578+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=B51M3SLLR5GJ tag=1V8XOIN5L8KD type=write size=4163343 2024-03-04T12:41:13.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.579+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=X9LZ4CIIBOZ7 type=del 2024-03-04T12:41:13.587 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.581+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~5PIW2CNMF0ZU.0 size=1048576 2024-03-04T12:41:13.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.582+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~5PIW2CNMF0ZU.1 size=926101 2024-03-04T12:41:13.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.582+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=5PIW2CNMF0ZU tag=SGCSA1OTXW6B type=write size=3023253 2024-03-04T12:41:13.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.583+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~AJB0FFSJXJOS.0 size=1048576 2024-03-04T12:41:13.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.584+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~AJB0FFSJXJOS.1 size=1048576 2024-03-04T12:41:13.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.585+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~AJB0FFSJXJOS.2 size=573412 2024-03-04T12:41:13.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.587+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=AJB0FFSJXJOS tag=7BGNRS9MAN8K type=write size=3719140 2024-03-04T12:41:13.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.588+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=N9WP4OKX2VZ6 type=del size=1469999 2024-03-04T12:41:13.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.589+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~J05Q8CEKTMIY.0 size=422292 2024-03-04T12:41:13.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.591+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=J05Q8CEKTMIY tag=LYY8MA03CKRM type=write size=1470868 2024-03-04T12:41:13.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.593+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~W9Y3FHGKBBI2.0 size=90038 2024-03-04T12:41:13.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.593+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=W9Y3FHGKBBI2 tag=Q7P5DZ0Z66NF type=write size=1138614 2024-03-04T12:41:13.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.595+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~QALW2E77FX4Q.0 size=1048576 2024-03-04T12:41:13.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.595+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~QALW2E77FX4Q.1 size=672595 2024-03-04T12:41:13.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.597+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=QALW2E77FX4Q tag=Y8N6NKVVOVXH type=write size=2769747 2024-03-04T12:41:13.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.599+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~Q5UM6SIIBDGN.0 size=1048576 2024-03-04T12:41:13.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.600+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~Q5UM6SIIBDGN.1 size=1048576 2024-03-04T12:41:13.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.601+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~Q5UM6SIIBDGN.2 size=347573 2024-03-04T12:41:13.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.601+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=Q5UM6SIIBDGN tag=ZJXF046F1U0N type=write size=3493301 2024-03-04T12:41:13.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.602+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~0O4Z3VMO231X.0 size=1048576 2024-03-04T12:41:13.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.603+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~0O4Z3VMO231X.1 size=1048576 2024-03-04T12:41:13.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.604+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~0O4Z3VMO231X.2 size=123102 2024-03-04T12:41:13.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.606+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=0O4Z3VMO231X tag=EF2ETQQQYR22 type=write size=3268830 2024-03-04T12:41:13.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.607+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=CK9ZS34IMBOY type=del size=1869209 2024-03-04T12:41:13.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.608+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=O6LSUUWGFPDN type=del 2024-03-04T12:41:13.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.610+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=5NT3RZJ732VH type=del size=2862608 2024-03-04T12:41:13.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.611+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=AEQJV2CRR6V5 type=del 2024-03-04T12:41:13.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.613+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~U9OVJM01ED1C.0 size=1048576 2024-03-04T12:41:13.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.614+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~U9OVJM01ED1C.1 size=670858 2024-03-04T12:41:13.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.614+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=U9OVJM01ED1C tag=JJIADQJHGB0E type=write size=2768010 2024-03-04T12:41:13.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.616+0000 7f093583d780 1 < canceled operation key=2R5WA9Q9ZAUG tag=UE8EK6DDRJOZ type=del size=728076 2024-03-04T12:41:13.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.618+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~CVF3TJH9BR0U.0 size=1048576 2024-03-04T12:41:13.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.619+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~CVF3TJH9BR0U.1 size=194266 2024-03-04T12:41:13.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.619+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=CVF3TJH9BR0U tag=ARPHME781GN0 type=write size=2291418 2024-03-04T12:41:13.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.619+0000 7f093583d780 1 < canceled part key=_multipart_AQI7H63EQSTN.2~GU00878SPUV1.0 size=1048576 2024-03-04T12:41:13.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.620+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~GU00878SPUV1.1 size=1048576 2024-03-04T12:41:13.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.621+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~GU00878SPUV1.2 size=384117 2024-03-04T12:41:13.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.623+0000 7f093583d780 1 < canceled multipart upload key=AQI7H63EQSTN upload=GU00878SPUV1 tag=JFPGBWOQBLQQ type=write size=3529845 2024-03-04T12:41:13.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.624+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=WALQSSXD61TC type=del size=889763 2024-03-04T12:41:13.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.625+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~ZKQX2FFCHVPG.0 size=1048576 2024-03-04T12:41:13.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.626+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~ZKQX2FFCHVPG.1 size=524055 2024-03-04T12:41:13.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.628+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=ZKQX2FFCHVPG tag=78HRHBLABC11 type=write size=2621207 2024-03-04T12:41:13.636 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.630+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~ETTS4X3POYAM.0 size=303359 2024-03-04T12:41:13.636 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.630+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=ETTS4X3POYAM tag=2ZB22U69B5JL type=write size=1351935 2024-03-04T12:41:13.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.631+0000 7f093583d780 1 < completed write operation key=U6F7IZ07CS9Q tag=3QNRUQ1OS46F type=write size=852243 2024-03-04T12:41:13.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.633+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~HLRQXPZF4J0I.0 size=1048576 2024-03-04T12:41:13.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.634+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~HLRQXPZF4J0I.1 size=1048576 2024-03-04T12:41:13.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.635+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~HLRQXPZF4J0I.2 size=476603 2024-03-04T12:41:13.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.635+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=HLRQXPZF4J0I tag=8TREY2X2RV51 type=write size=3622331 2024-03-04T12:41:13.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.636+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~A6QZ0XEW3CRL.0 size=134394 2024-03-04T12:41:13.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.638+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=A6QZ0XEW3CRL tag=3L5U4DMP7YTA type=write size=1182970 2024-03-04T12:41:13.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.639+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=JLSFTAZO7V6B type=del size=72105 2024-03-04T12:41:13.646 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.640+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=JO76X7L9RW46 type=del 2024-03-04T12:41:13.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.641+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=WMDVEQJPU0FK type=del size=1226263 2024-03-04T12:41:13.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.643+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~6G3N0HVV7DHW.0 size=360229 2024-03-04T12:41:13.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.644+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=6G3N0HVV7DHW tag=ZBNW18A535RW type=write size=1408805 2024-03-04T12:41:13.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.646+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~OYC6ENZH6K5X.0 size=1048576 2024-03-04T12:41:13.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.647+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~OYC6ENZH6K5X.1 size=643173 2024-03-04T12:41:13.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.647+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=OYC6ENZH6K5X tag=QTICSSZPI58R type=write size=2740325 2024-03-04T12:41:13.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.648+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=SMZYFRLNXTAC type=del 2024-03-04T12:41:13.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.650+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=B3S6SEL45JKC type=del size=695691 2024-03-04T12:41:13.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.651+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~B51M3SLLR5GJ.0 size=1048576 2024-03-04T12:41:13.657 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.652+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~B51M3SLLR5GJ.1 size=1048576 2024-03-04T12:41:13.658 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.653+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~B51M3SLLR5GJ.2 size=1017615 2024-03-04T12:41:13.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.655+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=B51M3SLLR5GJ tag=1V8XOIN5L8KD type=write size=4163343 2024-03-04T12:41:13.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.656+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=70TV1JI61263 type=del size=140905 2024-03-04T12:41:13.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.657+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~5PIW2CNMF0ZU.0 size=1048576 2024-03-04T12:41:13.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.657+0000 7f093583d780 1 < canceled part key=_multipart_I5NQBROT0WKE.2~5PIW2CNMF0ZU.1 size=926101 2024-03-04T12:41:13.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.659+0000 7f093583d780 1 < canceled multipart upload key=I5NQBROT0WKE upload=5PIW2CNMF0ZU tag=SGCSA1OTXW6B type=write size=3023253 2024-03-04T12:41:13.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.661+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~U0A7K90DAMFZ.0 size=1048576 2024-03-04T12:41:13.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.662+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~U0A7K90DAMFZ.1 size=655181 2024-03-04T12:41:13.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.662+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=U0A7K90DAMFZ tag=LSRP577KIWD3 type=write size=2752333 2024-03-04T12:41:13.668 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.663+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=N9WP4OKX2VZ6 type=del 2024-03-04T12:41:13.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.665+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~2FQXN2WOTCGF.0 size=1048576 2024-03-04T12:41:13.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.666+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~2FQXN2WOTCGF.1 size=751092 2024-03-04T12:41:13.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.666+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=2FQXN2WOTCGF tag=7XB131ORNLMP type=write size=2848244 2024-03-04T12:41:13.673 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.667+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~W9Y3FHGKBBI2.0 size=90038 2024-03-04T12:41:13.674 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.669+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=W9Y3FHGKBBI2 tag=Q7P5DZ0Z66NF type=write size=1138614 2024-03-04T12:41:13.675 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.670+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=9H8F0E4ENH22 type=del size=530267 2024-03-04T12:41:13.677 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.671+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~Q5UM6SIIBDGN.0 size=1048576 2024-03-04T12:41:13.677 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.671+0000 7f093583d780 1 < canceled part key=_multipart_M0AOZ89IQNSK.2~Q5UM6SIIBDGN.1 size=1048576 2024-03-04T12:41:13.678 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.672+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~Q5UM6SIIBDGN.2 size=347573 2024-03-04T12:41:13.680 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.674+0000 7f093583d780 1 < canceled multipart upload key=M0AOZ89IQNSK upload=Q5UM6SIIBDGN tag=ZJXF046F1U0N type=write size=3493301 2024-03-04T12:41:13.681 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.675+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=ENVXCAX49P8Y type=write size=45569 2024-03-04T12:41:13.683 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.677+0000 7f093583d780 1 < suggested remove operation key=3F8GI0JCUR6W tag=CK9ZS34IMBOY type=del 2024-03-04T12:41:13.684 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.678+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=WL1HOQIZNKY3 type=del size=1957657 2024-03-04T12:41:13.686 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.681+0000 7f093583d780 1 < suggested remove operation key=F269PJEZ05IO tag=5NT3RZJ732VH type=del 2024-03-04T12:41:13.687 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.682+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=3CVQK8GDW965 type=write size=863963 2024-03-04T12:41:13.688 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.683+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~U9OVJM01ED1C.0 size=1048576 2024-03-04T12:41:13.689 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.684+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~U9OVJM01ED1C.1 size=670858 2024-03-04T12:41:13.691 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.686+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=U9OVJM01ED1C tag=JJIADQJHGB0E type=write size=2768010 2024-03-04T12:41:13.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.687+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=6NCVGEC597YY type=del size=2042561 2024-03-04T12:41:13.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.688+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~CVF3TJH9BR0U.0 size=1048576 2024-03-04T12:41:13.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.689+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~CVF3TJH9BR0U.1 size=194266 2024-03-04T12:41:13.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.691+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=CVF3TJH9BR0U tag=ARPHME781GN0 type=write size=2291418 2024-03-04T12:41:13.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.693+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~M6VT041ET42B.0 size=1048576 2024-03-04T12:41:13.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.694+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~M6VT041ET42B.1 size=1048576 2024-03-04T12:41:13.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.695+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~M6VT041ET42B.2 size=16414 2024-03-04T12:41:13.701 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.695+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=M6VT041ET42B tag=G4NEMNGC34ML type=write size=3162142 2024-03-04T12:41:13.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.697+0000 7f093583d780 1 < suggested remove operation key=AQI7H63EQSTN tag=WALQSSXD61TC type=del 2024-03-04T12:41:13.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.698+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=71LS879UYD3T type=del size=1827674 2024-03-04T12:41:13.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.699+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~ETTS4X3POYAM.0 size=303359 2024-03-04T12:41:13.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.701+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=ETTS4X3POYAM tag=2ZB22U69B5JL type=write size=1351935 2024-03-04T12:41:13.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.703+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~YLLJENGMFL3W.0 size=1048576 2024-03-04T12:41:13.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.704+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~YLLJENGMFL3W.1 size=1048576 2024-03-04T12:41:13.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.705+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~YLLJENGMFL3W.2 size=149416 2024-03-04T12:41:13.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.705+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=YLLJENGMFL3W tag=15KJMQPYXSKB type=write size=3295144 2024-03-04T12:41:13.712 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.706+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~HLRQXPZF4J0I.0 size=1048576 2024-03-04T12:41:13.713 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.707+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~HLRQXPZF4J0I.1 size=1048576 2024-03-04T12:41:13.713 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.708+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~HLRQXPZF4J0I.2 size=476603 2024-03-04T12:41:13.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.710+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=HLRQXPZF4J0I tag=8TREY2X2RV51 type=write size=3622331 2024-03-04T12:41:13.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.711+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=RSEHL2EBI5H5 type=del size=2286348 2024-03-04T12:41:13.718 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.712+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=JLSFTAZO7V6B type=del 2024-03-04T12:41:13.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.714+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~CM9RHXCZOS3E.0 size=1048576 2024-03-04T12:41:13.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.715+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~CM9RHXCZOS3E.1 size=1048576 2024-03-04T12:41:13.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.716+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~CM9RHXCZOS3E.2 size=952114 2024-03-04T12:41:13.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.716+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=CM9RHXCZOS3E tag=21LQJY3SEN1W type=write size=4097842 2024-03-04T12:41:13.722 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.717+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=WMDVEQJPU0FK type=del 2024-03-04T12:41:13.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.719+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=0UO2J4TQC6AS type=del size=4001787 2024-03-04T12:41:13.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.720+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~OYC6ENZH6K5X.0 size=1048576 2024-03-04T12:41:13.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.721+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~OYC6ENZH6K5X.1 size=643173 2024-03-04T12:41:13.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.723+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=OYC6ENZH6K5X tag=QTICSSZPI58R type=write size=2740325 2024-03-04T12:41:13.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.724+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=KI5EQEQHPDMD type=del size=1906412 2024-03-04T12:41:13.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.726+0000 7f093583d780 1 < suggested remove operation key=TMAI6MOG2C4N tag=B3S6SEL45JKC type=del 2024-03-04T12:41:13.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.728+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~C9I2OK4XFUD9.0 size=1048576 2024-03-04T12:41:13.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.729+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~C9I2OK4XFUD9.1 size=682488 2024-03-04T12:41:13.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.729+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=C9I2OK4XFUD9 tag=FXWI04BAR1YL type=write size=2779640 2024-03-04T12:41:13.736 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.731+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=70TV1JI61263 type=del 2024-03-04T12:41:13.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.733+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~EHE7EKNTCI1Y.0 size=1007940 2024-03-04T12:41:13.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.733+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=EHE7EKNTCI1Y tag=KPY8TV15CVFY type=write size=2056516 2024-03-04T12:41:13.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.734+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~U0A7K90DAMFZ.0 size=1048576 2024-03-04T12:41:13.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.734+0000 7f093583d780 1 < canceled part key=_multipart_OFTWI7UFD5L5.2~U0A7K90DAMFZ.1 size=655181 2024-03-04T12:41:13.742 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.736+0000 7f093583d780 1 < canceled multipart upload key=OFTWI7UFD5L5 upload=U0A7K90DAMFZ tag=LSRP577KIWD3 type=write size=2752333 2024-03-04T12:41:13.744 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.738+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~V9CBSJBKV5YX.0 size=1048576 2024-03-04T12:41:13.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.739+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~V9CBSJBKV5YX.1 size=320867 2024-03-04T12:41:13.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.739+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=V9CBSJBKV5YX tag=LO7Y12VW572Z type=write size=2418019 2024-03-04T12:41:13.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.740+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~2FQXN2WOTCGF.0 size=1048576 2024-03-04T12:41:13.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.741+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~2FQXN2WOTCGF.1 size=751092 2024-03-04T12:41:13.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.743+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=2FQXN2WOTCGF tag=7XB131ORNLMP type=write size=2848244 2024-03-04T12:41:13.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.744+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=2VP0U1XASO8M type=del size=570375 2024-03-04T12:41:13.751 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.745+0000 7f093583d780 -1 < failed to complete operation key=AQI7H63EQSTN tag=9H8F0E4ENH22 type=del size=530267: (22) Invalid argument 2024-03-04T12:41:13.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.747+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=Q10X8TJYJ81H type=del size=3426563 2024-03-04T12:41:13.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.748+0000 7f093583d780 1 < completed write operation key=M0AOZ89IQNSK tag=ENVXCAX49P8Y type=write size=45569 2024-03-04T12:41:13.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.750+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~OYAD4LK26K5A.0 size=761001 2024-03-04T12:41:13.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.750+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=OYAD4LK26K5A tag=BQPVKN2SMGXT type=write size=1809577 2024-03-04T12:41:13.757 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.751+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=WL1HOQIZNKY3 type=del 2024-03-04T12:41:13.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.752+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=1S4U4PQ8T0OJ type=write size=716893 2024-03-04T12:41:13.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.753+0000 7f093583d780 1 < canceled operation key=96PTQ2KHPMMM tag=3CVQK8GDW965 type=write size=863963 2024-03-04T12:41:13.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.755+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=J4Y9J04WQ5XD type=del size=2370592 2024-03-04T12:41:13.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.756+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=6NCVGEC597YY type=del 2024-03-04T12:41:13.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.758+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~YJTYE4CN6HH6.0 size=1048576 2024-03-04T12:41:13.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.759+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~YJTYE4CN6HH6.1 size=211782 2024-03-04T12:41:13.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.759+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=YJTYE4CN6HH6 tag=69SQACB72ZGV type=write size=2308934 2024-03-04T12:41:13.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.760+0000 7f093583d780 1 < canceled part key=_multipart_GMKM2QEP072H.2~M6VT041ET42B.0 size=1048576 2024-03-04T12:41:13.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.761+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~M6VT041ET42B.1 size=1048576 2024-03-04T12:41:13.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.761+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~M6VT041ET42B.2 size=16414 2024-03-04T12:41:13.769 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.764+0000 7f093583d780 1 < canceled multipart upload key=GMKM2QEP072H upload=M6VT041ET42B tag=G4NEMNGC34ML type=write size=3162142 2024-03-04T12:41:13.770 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.765+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=JP6D9ZV2WZ37 type=del size=2257661 2024-03-04T12:41:13.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.766+0000 7f093583d780 1 < canceled operation key=I5NQBROT0WKE tag=71LS879UYD3T type=del size=1827674 2024-03-04T12:41:13.772 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.767+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=2K70IYX12TDU type=del size=1800313 2024-03-04T12:41:13.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.768+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~YLLJENGMFL3W.0 size=1048576 2024-03-04T12:41:13.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.769+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~YLLJENGMFL3W.1 size=1048576 2024-03-04T12:41:13.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.770+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~YLLJENGMFL3W.2 size=149416 2024-03-04T12:41:13.779 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.772+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=YLLJENGMFL3W tag=15KJMQPYXSKB type=write size=3295144 2024-03-04T12:41:13.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.774+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~QUL7R3RY1984.0 size=1048576 2024-03-04T12:41:13.782 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.777+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~QUL7R3RY1984.1 size=734061 2024-03-04T12:41:13.782 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.777+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=QUL7R3RY1984 tag=248S70MAXXYX type=write size=2831213 2024-03-04T12:41:13.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.778+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=RSEHL2EBI5H5 type=del 2024-03-04T12:41:13.786 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.780+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~RLFSNRMR789A.0 size=1048576 2024-03-04T12:41:13.786 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.781+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~RLFSNRMR789A.1 size=1048576 2024-03-04T12:41:13.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.782+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~RLFSNRMR789A.2 size=383709 2024-03-04T12:41:13.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.782+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=RLFSNRMR789A tag=5N6W00Z7BY9F type=write size=3529437 2024-03-04T12:41:13.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.783+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~CM9RHXCZOS3E.0 size=1048576 2024-03-04T12:41:13.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.784+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~CM9RHXCZOS3E.1 size=1048576 2024-03-04T12:41:13.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.785+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~CM9RHXCZOS3E.2 size=952114 2024-03-04T12:41:13.792 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.787+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=CM9RHXCZOS3E tag=21LQJY3SEN1W type=write size=4097842 2024-03-04T12:41:13.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.788+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=II1W9BIGR19V type=write size=749532 2024-03-04T12:41:13.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.789+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=0UO2J4TQC6AS type=del 2024-03-04T12:41:13.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.790+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=OW3NX34LMJHQ type=write size=155519 2024-03-04T12:41:13.797 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.792+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=KI5EQEQHPDMD type=del 2024-03-04T12:41:13.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.794+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~0MOKSENY0YXB.0 size=495890 2024-03-04T12:41:13.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.794+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=0MOKSENY0YXB tag=879HUTHQ7I1V type=write size=1544466 2024-03-04T12:41:13.800 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.795+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~C9I2OK4XFUD9.0 size=1048576 2024-03-04T12:41:13.801 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.796+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~C9I2OK4XFUD9.1 size=682488 2024-03-04T12:41:13.803 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.798+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=C9I2OK4XFUD9 tag=FXWI04BAR1YL type=write size=2779640 2024-03-04T12:41:13.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.800+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~H91ME8BRGQDQ.0 size=1048576 2024-03-04T12:41:13.806 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.801+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~H91ME8BRGQDQ.1 size=898561 2024-03-04T12:41:13.806 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.801+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=H91ME8BRGQDQ tag=UMH9GU3Q946O type=write size=2995713 2024-03-04T12:41:13.807 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.802+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~EHE7EKNTCI1Y.0 size=1007940 2024-03-04T12:41:13.809 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.804+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=EHE7EKNTCI1Y tag=KPY8TV15CVFY type=write size=2056516 2024-03-04T12:41:13.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.806+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~OP4UYM5QJO7E.0 size=1017438 2024-03-04T12:41:13.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.806+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=OP4UYM5QJO7E tag=OJT4MS9J1PDY type=write size=2066014 2024-03-04T12:41:13.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.807+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~V9CBSJBKV5YX.0 size=1048576 2024-03-04T12:41:13.813 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.808+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~V9CBSJBKV5YX.1 size=320867 2024-03-04T12:41:13.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.810+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=V9CBSJBKV5YX tag=LO7Y12VW572Z type=write size=2418019 2024-03-04T12:41:13.816 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.811+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=VNVC4TQFFE09 type=del size=277580 2024-03-04T12:41:13.818 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.813+0000 7f093583d780 1 < suggested update operation key=L4UQK3UJFXZC tag=2VP0U1XASO8M type=del size=570375 2024-03-04T12:41:13.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.814+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=JW3HOUQOWDAN type=del size=4177936 2024-03-04T12:41:13.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.815+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=Q10X8TJYJ81H type=del 2024-03-04T12:41:13.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.816+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=4GW26C5AJSRZ type=del size=764227 2024-03-04T12:41:13.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.817+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~OYAD4LK26K5A.0 size=761001 2024-03-04T12:41:13.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.819+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=OYAD4LK26K5A tag=BQPVKN2SMGXT type=write size=1809577 2024-03-04T12:41:13.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.821+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~YNAJWTEO0484.0 size=937779 2024-03-04T12:41:13.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.821+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=YNAJWTEO0484 tag=UMBN9TEGR7R9 type=write size=1986355 2024-03-04T12:41:13.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.822+0000 7f093583d780 1 < completed write operation key=TMAI6MOG2C4N tag=1S4U4PQ8T0OJ type=write size=716893 2024-03-04T12:41:13.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.823+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=I8MM6SB7GHID type=write size=781203 2024-03-04T12:41:13.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.825+0000 7f093583d780 1 < suggested remove operation key=2XVNK3YEVHJ7 tag=J4Y9J04WQ5XD type=del 2024-03-04T12:41:13.834 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.828+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~9Q05YEO4W7NI.0 size=1048576 2024-03-04T12:41:13.835 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.829+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~9Q05YEO4W7NI.1 size=1019610 2024-03-04T12:41:13.835 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.829+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=9Q05YEO4W7NI tag=YNCG1IQQK2D7 type=write size=3116762 2024-03-04T12:41:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.830+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~YJTYE4CN6HH6.0 size=1048576 2024-03-04T12:41:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.830+0000 7f093583d780 1 < canceled part key=_multipart_Q45PKXZVJ6YS.2~YJTYE4CN6HH6.1 size=211782 2024-03-04T12:41:13.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.833+0000 7f093583d780 1 < canceled multipart upload key=Q45PKXZVJ6YS upload=YJTYE4CN6HH6 tag=69SQACB72ZGV type=write size=2308934 2024-03-04T12:41:13.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.834+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=AQGOIGUGXOHA type=del size=2359565 2024-03-04T12:41:13.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.835+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=JP6D9ZV2WZ37 type=del 2024-03-04T12:41:13.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.836+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=MLTJUA6TS76F type=write size=427177 2024-03-04T12:41:13.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.837+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=2K70IYX12TDU type=del 2024-03-04T12:41:13.845 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.839+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~4INAPCAQGE8N.0 size=1048576 2024-03-04T12:41:13.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.840+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~4INAPCAQGE8N.1 size=815943 2024-03-04T12:41:13.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.840+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=4INAPCAQGE8N tag=M3G2EHKQ4UB9 type=write size=2913095 2024-03-04T12:41:13.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.842+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~QUL7R3RY1984.0 size=1048576 2024-03-04T12:41:13.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.843+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~QUL7R3RY1984.1 size=734061 2024-03-04T12:41:13.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.844+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=QUL7R3RY1984 tag=248S70MAXXYX type=write size=2831213 2024-03-04T12:41:13.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.846+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=UBJ4MIDMKYC2 type=del size=2995185 2024-03-04T12:41:13.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.847+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~RLFSNRMR789A.0 size=1048576 2024-03-04T12:41:13.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.848+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~RLFSNRMR789A.1 size=1048576 2024-03-04T12:41:13.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.849+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~RLFSNRMR789A.2 size=383709 2024-03-04T12:41:13.858 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.852+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=RLFSNRMR789A tag=5N6W00Z7BY9F type=write size=3529437 2024-03-04T12:41:13.859 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.853+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=BBGZSW81SPUG type=del size=283375 2024-03-04T12:41:13.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.856+0000 7f093583d780 1 < suggested remove operation key=3F8GI0JCUR6W tag=II1W9BIGR19V type=write 2024-03-04T12:41:13.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.858+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~FL1AK5AKF1T2.0 size=1023094 2024-03-04T12:41:13.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.858+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=FL1AK5AKF1T2 tag=4VBNHDBL0F47 type=write size=2071670 2024-03-04T12:41:13.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.860+0000 7f093583d780 1 < suggested update operation key=J6Y9V11BX06B tag=OW3NX34LMJHQ type=write size=155519 2024-03-04T12:41:13.866 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.861+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=M6V6645ICH3G type=del size=1437730 2024-03-04T12:41:13.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.862+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~0MOKSENY0YXB.0 size=495890 2024-03-04T12:41:13.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.864+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=0MOKSENY0YXB tag=879HUTHQ7I1V type=write size=1544466 2024-03-04T12:41:13.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.865+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=0KHB7KPSZRJK type=del size=2858081 2024-03-04T12:41:13.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.866+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~H91ME8BRGQDQ.0 size=1048576 2024-03-04T12:41:13.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.867+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~H91ME8BRGQDQ.1 size=898561 2024-03-04T12:41:13.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.869+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=H91ME8BRGQDQ tag=UMH9GU3Q946O type=write size=2995713 2024-03-04T12:41:13.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.870+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=PHOH47KLWXDP type=del size=529897 2024-03-04T12:41:13.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.871+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~OP4UYM5QJO7E.0 size=1017438 2024-03-04T12:41:13.878 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.872+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=OP4UYM5QJO7E tag=OJT4MS9J1PDY type=write size=2066014 2024-03-04T12:41:13.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.874+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=MH481U2GNHFT type=del size=1571786 2024-03-04T12:41:13.880 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.875+0000 7f093583d780 1 < canceled operation key=I6DIP4VGHMNO tag=VNVC4TQFFE09 type=del size=277580 2024-03-04T12:41:13.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.876+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=UTNFI2U9IDG6 type=write size=431236 2024-03-04T12:41:13.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.877+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=JW3HOUQOWDAN type=del 2024-03-04T12:41:13.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.878+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=H4HEZYBYEDUX type=write size=789953 2024-03-04T12:41:13.885 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.880+0000 7f093583d780 1 < suggested remove operation key=2R5WA9Q9ZAUG tag=4GW26C5AJSRZ type=del 2024-03-04T12:41:13.887 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.882+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~FIWR7VUSQC70.0 size=730988 2024-03-04T12:41:13.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.882+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=FIWR7VUSQC70 tag=UB4X1GFQ3MKP type=write size=1779564 2024-03-04T12:41:13.889 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.883+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~YNAJWTEO0484.0 size=937779 2024-03-04T12:41:13.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.885+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=YNAJWTEO0484 tag=UMBN9TEGR7R9 type=write size=1986355 2024-03-04T12:41:13.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.886+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=EO80LHL3LGWK type=del size=1325602 2024-03-04T12:41:13.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.887+0000 7f093583d780 1 < completed write operation key=FT2XNJYYT30J tag=I8MM6SB7GHID type=write size=781203 2024-03-04T12:41:13.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.888+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=WFFH8XN6ZFEM type=del size=1875523 2024-03-04T12:41:13.895 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.889+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~9Q05YEO4W7NI.0 size=1048576 2024-03-04T12:41:13.896 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.890+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~9Q05YEO4W7NI.1 size=1019610 2024-03-04T12:41:13.897 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.892+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=9Q05YEO4W7NI tag=YNCG1IQQK2D7 type=write size=3116762 2024-03-04T12:41:13.899 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.893+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=H7JIN2W2ONFM type=del size=1285613 2024-03-04T12:41:13.900 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.894+0000 7f093583d780 1 < completed delete operation key=AQI7H63EQSTN tag=AQGOIGUGXOHA type=del 2024-03-04T12:41:13.902 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.896+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~XJXLETOWC1SP.0 size=606898 2024-03-04T12:41:13.902 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.896+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=XJXLETOWC1SP tag=SMOI0SI3E5YJ type=write size=1655474 2024-03-04T12:41:13.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.897+0000 7f093583d780 1 < completed write operation key=F269PJEZ05IO tag=MLTJUA6TS76F type=write size=427177 2024-03-04T12:41:13.904 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.898+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=SO632QVZG7H2 type=del size=1390410 2024-03-04T12:41:13.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.899+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~4INAPCAQGE8N.0 size=1048576 2024-03-04T12:41:13.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.900+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~4INAPCAQGE8N.1 size=815943 2024-03-04T12:41:13.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.902+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=4INAPCAQGE8N tag=M3G2EHKQ4UB9 type=write size=2913095 2024-03-04T12:41:13.909 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.903+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=P1WJTF7LLNG6 type=del size=2173987 2024-03-04T12:41:13.910 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.904+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=UBJ4MIDMKYC2 type=del 2024-03-04T12:41:13.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.905+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=3QJKQCYFAK8H type=del size=883337 2024-03-04T12:41:13.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.906+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=BBGZSW81SPUG type=del 2024-03-04T12:41:13.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.908+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=20S1E2CUUTTF type=del size=2280131 2024-03-04T12:41:13.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.909+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~FL1AK5AKF1T2.0 size=1023094 2024-03-04T12:41:13.916 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.910+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=FL1AK5AKF1T2 tag=4VBNHDBL0F47 type=write size=2071670 2024-03-04T12:41:13.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.911+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=4E1310ETNGJJ type=write size=16984 2024-03-04T12:41:13.918 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.912+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=M6V6645ICH3G type=del 2024-03-04T12:41:13.920 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.914+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~8S6VVW47WVVY.0 size=1048576 2024-03-04T12:41:13.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.915+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~8S6VVW47WVVY.1 size=1048576 2024-03-04T12:41:13.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.916+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~8S6VVW47WVVY.2 size=33048 2024-03-04T12:41:13.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.916+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=8S6VVW47WVVY tag=BQX1I20NXYMK type=write size=3178776 2024-03-04T12:41:13.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.917+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=0KHB7KPSZRJK type=del 2024-03-04T12:41:13.924 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.918+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=DT6ST2POXG5A type=write size=983342 2024-03-04T12:41:13.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.919+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=PHOH47KLWXDP type=del 2024-03-04T12:41:13.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.921+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=71URXW1PRARO type=del size=752903 2024-03-04T12:41:13.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.922+0000 7f093583d780 1 < canceled operation key=FT2XNJYYT30J tag=MH481U2GNHFT type=del size=1571786 2024-03-04T12:41:13.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.924+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~YIH396HP7YES.0 size=736909 2024-03-04T12:41:13.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.924+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=YIH396HP7YES tag=BTMDMFWYXGT1 type=write size=1785485 2024-03-04T12:41:13.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.925+0000 7f093583d780 1 < completed write operation key=NQF43I07F2HT tag=UTNFI2U9IDG6 type=write size=431236 2024-03-04T12:41:13.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.926+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=Y19LG52P6H0J type=del size=112322 2024-03-04T12:41:13.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.928+0000 7f093583d780 1 < suggested remove operation key=FT2XNJYYT30J tag=H4HEZYBYEDUX type=write 2024-03-04T12:41:13.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.929+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=2LUCI2AKDTJA type=del size=1781279 2024-03-04T12:41:13.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.930+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~FIWR7VUSQC70.0 size=730988 2024-03-04T12:41:13.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.933+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=FIWR7VUSQC70 tag=UB4X1GFQ3MKP type=write size=1779564 2024-03-04T12:41:13.941 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.935+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~I5J5RDAE2ITF.0 size=16762 2024-03-04T12:41:13.941 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.935+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=I5J5RDAE2ITF tag=XCQ9DY1W64TO type=write size=1065338 2024-03-04T12:41:13.942 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.936+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=EO80LHL3LGWK type=del 2024-03-04T12:41:13.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.938+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~HW2BO2B485I6.0 size=251643 2024-03-04T12:41:13.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.938+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=HW2BO2B485I6 tag=9PHR3A1VDJRQ type=write size=1300219 2024-03-04T12:41:13.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.940+0000 7f093583d780 1 < completed delete operation key=AQI7H63EQSTN tag=WFFH8XN6ZFEM type=del 2024-03-04T12:41:13.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.941+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=KQQMUS13JWBW type=del size=58045 2024-03-04T12:41:13.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.941+0000 7f093583d780 -1 < no bi entry to suggest for operation key=FT2XNJYYT30J tag=H7JIN2W2ONFM type=del size=1285613: (2) No such file or directory 2024-03-04T12:41:13.948 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.942+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=71A6P6MTQBQV type=del size=1291344 2024-03-04T12:41:13.949 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.944+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~XJXLETOWC1SP.0 size=606898 2024-03-04T12:41:13.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.946+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=XJXLETOWC1SP tag=SMOI0SI3E5YJ type=write size=1655474 2024-03-04T12:41:13.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.947+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=AM6KNV15SWU9 type=del size=619729 2024-03-04T12:41:13.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.948+0000 7f093583d780 1 < completed delete operation key=O6OUISHWZ7FU tag=SO632QVZG7H2 type=del 2024-03-04T12:41:13.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.950+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~91H8I2EIVYU8.0 size=1048576 2024-03-04T12:41:13.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.951+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~91H8I2EIVYU8.1 size=686647 2024-03-04T12:41:13.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.951+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=91H8I2EIVYU8 tag=OZ239CY2OY19 type=write size=2783799 2024-03-04T12:41:13.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.953+0000 7f093583d780 1 < suggested update operation key=2YD2M0JQNCC0 tag=P1WJTF7LLNG6 type=del size=2173987 2024-03-04T12:41:13.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.955+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=310YSSD2VINK type=del size=3781886 2024-03-04T12:41:13.961 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.956+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=3QJKQCYFAK8H type=del 2024-03-04T12:41:13.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.957+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=H734635P152B type=del size=1697302 2024-03-04T12:41:13.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.958+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=20S1E2CUUTTF type=del 2024-03-04T12:41:13.965 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.959+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=EXX5MQ3ODCJQ type=del size=513821 2024-03-04T12:41:13.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.960+0000 7f093583d780 1 < completed write operation key=96PTQ2KHPMMM tag=4E1310ETNGJJ type=write size=16984 2024-03-04T12:41:13.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.962+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=3R7LSXL4R33J type=del size=2396294 2024-03-04T12:41:13.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.963+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~8S6VVW47WVVY.0 size=1048576 2024-03-04T12:41:13.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.964+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~8S6VVW47WVVY.1 size=1048576 2024-03-04T12:41:13.970 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.965+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~8S6VVW47WVVY.2 size=33048 2024-03-04T12:41:13.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.967+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=8S6VVW47WVVY tag=BQX1I20NXYMK type=write size=3178776 2024-03-04T12:41:13.973 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.968+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=0DW36AR9Z6VU type=del size=364449 2024-03-04T12:41:13.974 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.969+0000 7f093583d780 1 < completed write operation key=HG0EM344TJZY tag=DT6ST2POXG5A type=write size=983342 2024-03-04T12:41:13.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.971+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~SYWDAE5MN3S0.0 size=1048576 2024-03-04T12:41:13.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.972+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~SYWDAE5MN3S0.1 size=1048576 2024-03-04T12:41:13.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.972+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~SYWDAE5MN3S0.2 size=251652 2024-03-04T12:41:13.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.972+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=SYWDAE5MN3S0 tag=VDZ36QCREG89 type=write size=3397380 2024-03-04T12:41:13.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.974+0000 7f093583d780 1 < canceled operation key=YJXFSO53QVPS tag=71URXW1PRARO type=del size=752903 2024-03-04T12:41:13.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.975+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=8730M9NPL1Z1 type=del size=1485555 2024-03-04T12:41:13.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.976+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~YIH396HP7YES.0 size=736909 2024-03-04T12:41:13.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.978+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=YIH396HP7YES tag=BTMDMFWYXGT1 type=write size=1785485 2024-03-04T12:41:13.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.979+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=L2H7ZZ9IRJG6 type=del size=2798009 2024-03-04T12:41:13.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.980+0000 7f093583d780 -1 < failed to complete operation key=FT2XNJYYT30J tag=Y19LG52P6H0J type=del size=112322: (22) Invalid argument 2024-03-04T12:41:13.987 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.982+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~1F0WYJN6N37Y.0 size=1048576 2024-03-04T12:41:13.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.983+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~1F0WYJN6N37Y.1 size=1048576 2024-03-04T12:41:13.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.984+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~1F0WYJN6N37Y.2 size=416371 2024-03-04T12:41:13.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.984+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=1F0WYJN6N37Y tag=JN1GFTVC76LK type=write size=3562099 2024-03-04T12:41:13.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.985+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=2LUCI2AKDTJA type=del 2024-03-04T12:41:13.993 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.987+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~N6OFLFEMK44O.0 size=1048576 2024-03-04T12:41:13.993 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.988+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~N6OFLFEMK44O.1 size=1048576 2024-03-04T12:41:13.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.989+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~N6OFLFEMK44O.2 size=392435 2024-03-04T12:41:13.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.989+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=N6OFLFEMK44O tag=26LPLO34H33D type=write size=3538163 2024-03-04T12:41:13.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.989+0000 7f093583d780 1 < canceled part key=_multipart_I6DIP4VGHMNO.2~I5J5RDAE2ITF.0 size=16762 2024-03-04T12:41:13.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.992+0000 7f093583d780 1 < canceled multipart upload key=I6DIP4VGHMNO upload=I5J5RDAE2ITF tag=XCQ9DY1W64TO type=write size=1065338 2024-03-04T12:41:13.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.994+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~OQGWDWG4AMB3.0 size=1048576 2024-03-04T12:41:14.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.994+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~OQGWDWG4AMB3.1 size=1048576 2024-03-04T12:41:14.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.995+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~OQGWDWG4AMB3.2 size=878787 2024-03-04T12:41:14.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.995+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=OQGWDWG4AMB3 tag=C2J3PECDUFLS type=write size=4024515 2024-03-04T12:41:14.002 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.996+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~HW2BO2B485I6.0 size=251643 2024-03-04T12:41:14.004 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:13.998+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=HW2BO2B485I6 tag=9PHR3A1VDJRQ type=write size=1300219 2024-03-04T12:41:14.005 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.000+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~ZI8PZ5DBSQM9.0 size=1048576 2024-03-04T12:41:14.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.001+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~ZI8PZ5DBSQM9.1 size=2389 2024-03-04T12:41:14.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.001+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=ZI8PZ5DBSQM9 tag=2WT7EOXPX7R6 type=write size=2099541 2024-03-04T12:41:14.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.002+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=KQQMUS13JWBW type=del 2024-03-04T12:41:14.008 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.003+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=CZH7GT77358K type=del size=2360538 2024-03-04T12:41:14.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.004+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=71A6P6MTQBQV type=del 2024-03-04T12:41:14.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.006+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~NMR7WMKSXTL8.0 size=1048576 2024-03-04T12:41:14.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.007+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~NMR7WMKSXTL8.1 size=1048576 2024-03-04T12:41:14.013 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.008+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~NMR7WMKSXTL8.2 size=1024810 2024-03-04T12:41:14.013 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.008+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=NMR7WMKSXTL8 tag=NXHP956XFUN4 type=write size=4170538 2024-03-04T12:41:14.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.010+0000 7f093583d780 1 < suggested update operation key=HG0EM344TJZY tag=AM6KNV15SWU9 type=del size=619729 2024-03-04T12:41:14.018 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.012+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~9HSBCKI8QJU4.0 size=1048576 2024-03-04T12:41:14.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.013+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~9HSBCKI8QJU4.1 size=835858 2024-03-04T12:41:14.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.013+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=9HSBCKI8QJU4 tag=3VWC3MU7RGBX type=write size=2933010 2024-03-04T12:41:14.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.014+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~91H8I2EIVYU8.0 size=1048576 2024-03-04T12:41:14.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.015+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~91H8I2EIVYU8.1 size=686647 2024-03-04T12:41:14.023 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.017+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=91H8I2EIVYU8 tag=OZ239CY2OY19 type=write size=2783799 2024-03-04T12:41:14.025 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.019+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~9QAIXDUOAGSR.0 size=1048576 2024-03-04T12:41:14.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.020+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~9QAIXDUOAGSR.1 size=1048576 2024-03-04T12:41:14.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.021+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~9QAIXDUOAGSR.2 size=314699 2024-03-04T12:41:14.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.021+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=9QAIXDUOAGSR tag=4Q7M9A8OXCB5 type=write size=3460427 2024-03-04T12:41:14.029 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.024+0000 7f093583d780 1 < suggested update operation key=F269PJEZ05IO tag=310YSSD2VINK type=del size=3781886 2024-03-04T12:41:14.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.026+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~GOHNF169EPAW.0 size=1048576 2024-03-04T12:41:14.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.027+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~GOHNF169EPAW.1 size=432131 2024-03-04T12:41:14.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.027+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=GOHNF169EPAW tag=3IKWYMYDEZYR type=write size=2529283 2024-03-04T12:41:14.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.029+0000 7f093583d780 1 < suggested remove operation key=OCOQJLUUNWRG tag=H734635P152B type=del 2024-03-04T12:41:14.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.030+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=OTAZTT5CX3EV type=del size=281109 2024-03-04T12:41:14.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.032+0000 7f093583d780 1 < suggested remove operation key=O6OUISHWZ7FU tag=EXX5MQ3ODCJQ type=del 2024-03-04T12:41:14.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.033+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=01WX66NX8EL8 type=write size=385400 2024-03-04T12:41:14.040 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.035+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=3R7LSXL4R33J type=del 2024-03-04T12:41:14.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.037+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~QF2O1BO55HQA.0 size=343884 2024-03-04T12:41:14.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.037+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=QF2O1BO55HQA tag=N88979XNWFM5 type=write size=1392460 2024-03-04T12:41:14.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.038+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=0DW36AR9Z6VU type=del 2024-03-04T12:41:14.045 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.040+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=9QFM0PPMMLNA type=del size=3212137 2024-03-04T12:41:14.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.041+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~SYWDAE5MN3S0.0 size=1048576 2024-03-04T12:41:14.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.042+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~SYWDAE5MN3S0.1 size=1048576 2024-03-04T12:41:14.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.044+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~SYWDAE5MN3S0.2 size=251652 2024-03-04T12:41:14.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.046+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=SYWDAE5MN3S0 tag=VDZ36QCREG89 type=write size=3397380 2024-03-04T12:41:14.054 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.048+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=A0N104UE67W2 type=del size=1988875 2024-03-04T12:41:14.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.049+0000 7f093583d780 -1 < failed to complete operation key=F269PJEZ05IO tag=8730M9NPL1Z1 type=del size=1485555: (22) Invalid argument 2024-03-04T12:41:14.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.050+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=79O04GG1AYJ6 type=del size=496300 2024-03-04T12:41:14.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.052+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=L2H7ZZ9IRJG6 type=del 2024-03-04T12:41:14.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.053+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=2LMKYVADH81D type=del size=2270763 2024-03-04T12:41:14.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.054+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~1F0WYJN6N37Y.0 size=1048576 2024-03-04T12:41:14.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.055+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~1F0WYJN6N37Y.1 size=1048576 2024-03-04T12:41:14.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.056+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~1F0WYJN6N37Y.2 size=416371 2024-03-04T12:41:14.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.058+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=1F0WYJN6N37Y tag=JN1GFTVC76LK type=write size=3562099 2024-03-04T12:41:14.064 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.059+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=N6ZE1CV2MFG3 type=del size=2048289 2024-03-04T12:41:14.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.060+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~N6OFLFEMK44O.0 size=1048576 2024-03-04T12:41:14.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.061+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~N6OFLFEMK44O.1 size=1048576 2024-03-04T12:41:14.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.062+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~N6OFLFEMK44O.2 size=392435 2024-03-04T12:41:14.069 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.064+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=N6OFLFEMK44O tag=26LPLO34H33D type=write size=3538163 2024-03-04T12:41:14.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.065+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=OZ566PZO2AD6 type=write size=747428 2024-03-04T12:41:14.073 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.068+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~OQGWDWG4AMB3.0 size=1048576 2024-03-04T12:41:14.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.071+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~OQGWDWG4AMB3.1 size=1048576 2024-03-04T12:41:14.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.071+0000 7f093583d780 1 < canceled part key=_multipart_I5NQBROT0WKE.2~OQGWDWG4AMB3.2 size=878787 2024-03-04T12:41:14.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.076+0000 7f093583d780 1 < canceled multipart upload key=I5NQBROT0WKE upload=OQGWDWG4AMB3 tag=C2J3PECDUFLS type=write size=4024515 2024-03-04T12:41:14.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.077+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=4HLZ6E5114W5 type=write size=269286 2024-03-04T12:41:14.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.078+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~ZI8PZ5DBSQM9.0 size=1048576 2024-03-04T12:41:14.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.079+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~ZI8PZ5DBSQM9.1 size=2389 2024-03-04T12:41:14.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.081+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=ZI8PZ5DBSQM9 tag=2WT7EOXPX7R6 type=write size=2099541 2024-03-04T12:41:14.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.082+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=0IBORHJCZLSF type=del size=1031130 2024-03-04T12:41:14.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.084+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=CZH7GT77358K type=del 2024-03-04T12:41:14.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.085+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=FK0ITG7YKDKN type=del size=1744032 2024-03-04T12:41:14.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.086+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~NMR7WMKSXTL8.0 size=1048576 2024-03-04T12:41:14.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.086+0000 7f093583d780 1 < canceled part key=_multipart_OCOQJLUUNWRG.2~NMR7WMKSXTL8.1 size=1048576 2024-03-04T12:41:14.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.087+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~NMR7WMKSXTL8.2 size=1024810 2024-03-04T12:41:14.094 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.088+0000 7f093583d780 1 < canceled multipart upload key=OCOQJLUUNWRG upload=NMR7WMKSXTL8 tag=NXHP956XFUN4 type=write size=4170538 2024-03-04T12:41:14.095 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.089+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=50AP83ZL7HMF type=del size=2277085 2024-03-04T12:41:14.096 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.091+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~9HSBCKI8QJU4.0 size=1048576 2024-03-04T12:41:14.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.091+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~9HSBCKI8QJU4.1 size=835858 2024-03-04T12:41:14.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.093+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=9HSBCKI8QJU4 tag=3VWC3MU7RGBX type=write size=2933010 2024-03-04T12:41:14.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.094+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=9MY2FC7OQ0BW type=write size=663788 2024-03-04T12:41:14.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.095+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~9QAIXDUOAGSR.0 size=1048576 2024-03-04T12:41:14.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.096+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~9QAIXDUOAGSR.1 size=1048576 2024-03-04T12:41:14.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.097+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~9QAIXDUOAGSR.2 size=314699 2024-03-04T12:41:14.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.099+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=9QAIXDUOAGSR tag=4Q7M9A8OXCB5 type=write size=3460427 2024-03-04T12:41:14.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.100+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=8CNEX5XM0I0M type=write size=263675 2024-03-04T12:41:14.106 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.101+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~GOHNF169EPAW.0 size=1048576 2024-03-04T12:41:14.107 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.102+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~GOHNF169EPAW.1 size=432131 2024-03-04T12:41:14.109 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.104+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=GOHNF169EPAW tag=3IKWYMYDEZYR type=write size=2529283 2024-03-04T12:41:14.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.105+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=25DA311AE0PB type=del size=567498 2024-03-04T12:41:14.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.106+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=OTAZTT5CX3EV type=del 2024-03-04T12:41:14.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.107+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=QVBO69AAO5U2 type=del size=1778596 2024-03-04T12:41:14.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.108+0000 7f093583d780 1 < canceled operation key=2XVNK3YEVHJ7 tag=01WX66NX8EL8 type=write size=385400 2024-03-04T12:41:14.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.110+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~W9VO40X9WARG.0 size=1048576 2024-03-04T12:41:14.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.111+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~W9VO40X9WARG.1 size=264194 2024-03-04T12:41:14.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.111+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=W9VO40X9WARG tag=QKMKWHLG9843 type=write size=2361346 2024-03-04T12:41:14.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.112+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~QF2O1BO55HQA.0 size=343884 2024-03-04T12:41:14.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.113+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=QF2O1BO55HQA tag=N88979XNWFM5 type=write size=1392460 2024-03-04T12:41:14.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.115+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~3OMCF8OXEQQH.0 size=344459 2024-03-04T12:41:14.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.115+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=3OMCF8OXEQQH tag=BSK80AXWPZ5O type=write size=1393035 2024-03-04T12:41:14.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.118+0000 7f093583d780 1 < suggested update operation key=M0AOZ89IQNSK tag=9QFM0PPMMLNA type=del size=3212137 2024-03-04T12:41:14.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.119+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=3WA9KTIDEARZ type=del size=2275424 2024-03-04T12:41:14.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.120+0000 7f093583d780 1 < canceled operation key=PT63VLFQQN0E tag=A0N104UE67W2 type=del size=1988875 2024-03-04T12:41:14.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.121+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=I02NM2MQKAD1 type=write size=751095 2024-03-04T12:41:14.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.122+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=79O04GG1AYJ6 type=del 2024-03-04T12:41:14.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.124+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=I86DZ8ZU8K48 type=del size=1881587 2024-03-04T12:41:14.130 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.125+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=2LMKYVADH81D type=del 2024-03-04T12:41:14.131 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.126+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=358F2L24RQ10 type=del size=410936 2024-03-04T12:41:14.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.127+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=N6ZE1CV2MFG3 type=del 2024-03-04T12:41:14.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.128+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=ZGBST1R6DEBH type=del size=1802678 2024-03-04T12:41:14.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.129+0000 7f093583d780 1 < completed write operation key=GMKM2QEP072H tag=OZ566PZO2AD6 type=write size=747428 2024-03-04T12:41:14.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.130+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=MMLNK0ZB3J4A type=del size=800078 2024-03-04T12:41:14.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.132+0000 7f093583d780 1 < completed write operation key=2ZOV2JEQHXGS tag=4HLZ6E5114W5 type=write size=269286 2024-03-04T12:41:14.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.134+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~9BL8M0ZG57W1.0 size=1048576 2024-03-04T12:41:14.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.134+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~9BL8M0ZG57W1.1 size=1048576 2024-03-04T12:41:14.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.135+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~9BL8M0ZG57W1.2 size=85083 2024-03-04T12:41:14.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.135+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=9BL8M0ZG57W1 tag=KOHQTMRTKK99 type=write size=3230811 2024-03-04T12:41:14.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.137+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=0IBORHJCZLSF type=del 2024-03-04T12:41:14.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.139+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~9M4W9OSYDXQD.0 size=1048576 2024-03-04T12:41:14.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.140+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~9M4W9OSYDXQD.1 size=814687 2024-03-04T12:41:14.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.140+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=9M4W9OSYDXQD tag=69IKP94T1N41 type=write size=2911839 2024-03-04T12:41:14.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.142+0000 7f093583d780 1 < suggested remove operation key=OCOQJLUUNWRG tag=FK0ITG7YKDKN type=del 2024-03-04T12:41:14.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.143+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=1QO9TI7WT8FO type=del size=1625514 2024-03-04T12:41:14.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.145+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=50AP83ZL7HMF type=del 2024-03-04T12:41:14.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.146+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=AMK08BH1WR90 type=del size=3410639 2024-03-04T12:41:14.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.147+0000 7f093583d780 1 < canceled operation key=FT2XNJYYT30J tag=9MY2FC7OQ0BW type=write size=663788 2024-03-04T12:41:14.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.149+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~X89ZVXJNYL5B.0 size=1048576 2024-03-04T12:41:14.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.150+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~X89ZVXJNYL5B.1 size=1048576 2024-03-04T12:41:14.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.151+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~X89ZVXJNYL5B.2 size=991245 2024-03-04T12:41:14.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.151+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=X89ZVXJNYL5B tag=W5ACS5Z1ICIK type=write size=4136973 2024-03-04T12:41:14.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.152+0000 7f093583d780 1 < completed write operation key=U6F7IZ07CS9Q tag=8CNEX5XM0I0M type=write size=263675 2024-03-04T12:41:14.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.154+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~32OM9J21XRQ2.0 size=1048576 2024-03-04T12:41:14.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.155+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~32OM9J21XRQ2.1 size=1048576 2024-03-04T12:41:14.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.157+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~32OM9J21XRQ2.2 size=981591 2024-03-04T12:41:14.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.157+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=32OM9J21XRQ2 tag=OAPTDSEJKOZN type=write size=4127319 2024-03-04T12:41:14.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.159+0000 7f093583d780 1 < suggested remove operation key=I6DIP4VGHMNO tag=25DA311AE0PB type=del 2024-03-04T12:41:14.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.160+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=LHUSUU7ZLAUG type=del size=1043373 2024-03-04T12:41:14.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.161+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=QVBO69AAO5U2 type=del 2024-03-04T12:41:14.168 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.163+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=6H92U5WWAT1L type=del size=2003679 2024-03-04T12:41:14.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.164+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~W9VO40X9WARG.0 size=1048576 2024-03-04T12:41:14.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.164+0000 7f093583d780 1 < canceled part key=_multipart_UAEQORB3BDBH.2~W9VO40X9WARG.1 size=264194 2024-03-04T12:41:14.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.166+0000 7f093583d780 1 < canceled multipart upload key=UAEQORB3BDBH upload=W9VO40X9WARG tag=QKMKWHLG9843 type=write size=2361346 2024-03-04T12:41:14.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.167+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=XS7T7H75616N type=write size=852729 2024-03-04T12:41:14.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.168+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~3OMCF8OXEQQH.0 size=344459 2024-03-04T12:41:14.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.170+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=3OMCF8OXEQQH tag=BSK80AXWPZ5O type=write size=1393035 2024-03-04T12:41:14.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.171+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=MHINHXUMZK7C type=del size=1716789 2024-03-04T12:41:14.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.172+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=3WA9KTIDEARZ type=del 2024-03-04T12:41:14.179 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.173+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=MVAWQI0Z8C73 type=del size=3161992 2024-03-04T12:41:14.180 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.174+0000 7f093583d780 1 < completed write operation key=2XVNK3YEVHJ7 tag=I02NM2MQKAD1 type=write size=751095 2024-03-04T12:41:14.181 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.175+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=H64QXKO8C23O type=del size=384246 2024-03-04T12:41:14.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.177+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=I86DZ8ZU8K48 type=del 2024-03-04T12:41:14.185 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.179+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~12FHCO2AHH8Y.0 size=1048576 2024-03-04T12:41:14.185 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.180+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~12FHCO2AHH8Y.1 size=190514 2024-03-04T12:41:14.185 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.180+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=12FHCO2AHH8Y tag=8M60ZF2QH8ME type=write size=2287666 2024-03-04T12:41:14.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.181+0000 7f093583d780 -1 < failed to complete operation key=I6DIP4VGHMNO tag=358F2L24RQ10 type=del size=410936: (22) Invalid argument 2024-03-04T12:41:14.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.183+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~CBJ7ZBT0MVY4.0 size=1048576 2024-03-04T12:41:14.190 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.184+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~CBJ7ZBT0MVY4.1 size=829284 2024-03-04T12:41:14.190 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.184+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=CBJ7ZBT0MVY4 tag=XO16PZXSRKP4 type=write size=2926436 2024-03-04T12:41:14.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.185+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=ZGBST1R6DEBH type=del 2024-03-04T12:41:14.192 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.186+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=RYEAVUPBD87R type=del size=3919961 2024-03-04T12:41:14.193 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.188+0000 7f093583d780 1 < canceled operation key=2YD2M0JQNCC0 tag=MMLNK0ZB3J4A type=del size=800078 2024-03-04T12:41:14.195 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.189+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=TMKS462EM6FB type=del size=1486712 2024-03-04T12:41:14.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.190+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~9BL8M0ZG57W1.0 size=1048576 2024-03-04T12:41:14.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.192+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~9BL8M0ZG57W1.1 size=1048576 2024-03-04T12:41:14.198 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.193+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~9BL8M0ZG57W1.2 size=85083 2024-03-04T12:41:14.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.195+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=9BL8M0ZG57W1 tag=KOHQTMRTKK99 type=write size=3230811 2024-03-04T12:41:14.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.196+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=JKUKB7ULKEG3 type=del size=3592917 2024-03-04T12:41:14.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.196+0000 7f093583d780 1 < canceled part key=_multipart_Q45PKXZVJ6YS.2~9M4W9OSYDXQD.0 size=1048576 2024-03-04T12:41:14.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.197+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~9M4W9OSYDXQD.1 size=814687 2024-03-04T12:41:14.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.199+0000 7f093583d780 1 < canceled multipart upload key=Q45PKXZVJ6YS upload=9M4W9OSYDXQD tag=69IKP94T1N41 type=write size=2911839 2024-03-04T12:41:14.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.201+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~WOMNNQ99YKGC.0 size=1048576 2024-03-04T12:41:14.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.202+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~WOMNNQ99YKGC.1 size=495478 2024-03-04T12:41:14.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.202+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=WOMNNQ99YKGC tag=VELBITOJJSNH type=write size=2592630 2024-03-04T12:41:14.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.204+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=1QO9TI7WT8FO type=del 2024-03-04T12:41:14.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.205+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~Z65FW2VWZAE0.0 size=1048576 2024-03-04T12:41:14.212 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.206+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~Z65FW2VWZAE0.1 size=694367 2024-03-04T12:41:14.212 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.206+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=Z65FW2VWZAE0 tag=9ACW7KV8P4YN type=write size=2791519 2024-03-04T12:41:14.213 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.207+0000 7f093583d780 1 < canceled operation key=2YD2M0JQNCC0 tag=AMK08BH1WR90 type=del size=3410639 2024-03-04T12:41:14.214 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.209+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=POBZM2Q7A4G4 type=del size=1678652 2024-03-04T12:41:14.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.210+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~X89ZVXJNYL5B.0 size=1048576 2024-03-04T12:41:14.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.211+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~X89ZVXJNYL5B.1 size=1048576 2024-03-04T12:41:14.217 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.212+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~X89ZVXJNYL5B.2 size=991245 2024-03-04T12:41:14.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.213+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=X89ZVXJNYL5B tag=W5ACS5Z1ICIK type=write size=4136973 2024-03-04T12:41:14.222 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.217+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~QNCMRPR3R3AZ.0 size=1048576 2024-03-04T12:41:14.223 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.218+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~QNCMRPR3R3AZ.1 size=1048576 2024-03-04T12:41:14.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.219+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~QNCMRPR3R3AZ.2 size=401912 2024-03-04T12:41:14.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.219+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=QNCMRPR3R3AZ tag=DF94DXZJ3R9E type=write size=3547640 2024-03-04T12:41:14.225 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.220+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~32OM9J21XRQ2.0 size=1048576 2024-03-04T12:41:14.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.221+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~32OM9J21XRQ2.1 size=1048576 2024-03-04T12:41:14.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.222+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~32OM9J21XRQ2.2 size=981591 2024-03-04T12:41:14.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.223+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=32OM9J21XRQ2 tag=OAPTDSEJKOZN type=write size=4127319 2024-03-04T12:41:14.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.225+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=C3OEBCJRGLZU type=del size=3667530 2024-03-04T12:41:14.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.226+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=LHUSUU7ZLAUG type=del 2024-03-04T12:41:14.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.228+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~3NM1C3OC9RI9.0 size=1048576 2024-03-04T12:41:14.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.229+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~3NM1C3OC9RI9.1 size=218302 2024-03-04T12:41:14.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.229+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=3NM1C3OC9RI9 tag=O4P2ZAKT8A1X type=write size=2315454 2024-03-04T12:41:14.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.231+0000 7f093583d780 1 < suggested update operation key=I6DIP4VGHMNO tag=6H92U5WWAT1L type=del size=2003679 2024-03-04T12:41:14.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.232+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=U7H0CRGZKYSB type=del size=150956 2024-03-04T12:41:14.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.233+0000 7f093583d780 1 < completed write operation key=9E12MS7PETOK tag=XS7T7H75616N type=write size=852729 2024-03-04T12:41:14.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.235+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~PIEWZ9OGGS4C.0 size=1048576 2024-03-04T12:41:14.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.236+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~PIEWZ9OGGS4C.1 size=1048576 2024-03-04T12:41:14.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.237+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~PIEWZ9OGGS4C.2 size=568933 2024-03-04T12:41:14.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.237+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=PIEWZ9OGGS4C tag=LHJPLXS35WMZ type=write size=3714661 2024-03-04T12:41:14.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.238+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=MHINHXUMZK7C type=del 2024-03-04T12:41:14.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.239+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=JD6ZRZTD0RJ7 type=del size=3456741 2024-03-04T12:41:14.246 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.240+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=MVAWQI0Z8C73 type=del 2024-03-04T12:41:14.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.242+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~92456IMEFHPE.0 size=1048576 2024-03-04T12:41:14.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.243+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~92456IMEFHPE.1 size=317489 2024-03-04T12:41:14.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.243+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=92456IMEFHPE tag=0BXYCPPIQYBR type=write size=2414641 2024-03-04T12:41:14.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.245+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=H64QXKO8C23O type=del 2024-03-04T12:41:14.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.246+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=Z80YJOC9GHVO type=del size=950997 2024-03-04T12:41:14.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.247+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~12FHCO2AHH8Y.0 size=1048576 2024-03-04T12:41:14.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.248+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~12FHCO2AHH8Y.1 size=190514 2024-03-04T12:41:14.255 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.250+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=12FHCO2AHH8Y tag=8M60ZF2QH8ME type=write size=2287666 2024-03-04T12:41:14.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.251+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=J45XNESTA3OM type=write size=493332 2024-03-04T12:41:14.257 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.252+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~CBJ7ZBT0MVY4.0 size=1048576 2024-03-04T12:41:14.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.253+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~CBJ7ZBT0MVY4.1 size=829284 2024-03-04T12:41:14.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.255+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=CBJ7ZBT0MVY4 tag=XO16PZXSRKP4 type=write size=2926436 2024-03-04T12:41:14.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.256+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=W47NYMOXO3QO type=del size=2907015 2024-03-04T12:41:14.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.257+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=RYEAVUPBD87R type=del 2024-03-04T12:41:14.264 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.259+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~V1X7ULVCAQ9P.0 size=1048576 2024-03-04T12:41:14.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.259+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~V1X7ULVCAQ9P.1 size=1048576 2024-03-04T12:41:14.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.261+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~V1X7ULVCAQ9P.2 size=648478 2024-03-04T12:41:14.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.261+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=V1X7ULVCAQ9P tag=NUR8SI7367GX type=write size=3794206 2024-03-04T12:41:14.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.262+0000 7f093583d780 1 < canceled operation key=HG0EM344TJZY tag=TMKS462EM6FB type=del size=1486712 2024-03-04T12:41:14.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.266+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~5HL1Y814GWIA.0 size=1048576 2024-03-04T12:41:14.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.268+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~5HL1Y814GWIA.1 size=1048576 2024-03-04T12:41:14.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.269+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~5HL1Y814GWIA.2 size=205900 2024-03-04T12:41:14.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.269+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=5HL1Y814GWIA tag=63S1IITQ3JMH type=write size=3351628 2024-03-04T12:41:14.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.270+0000 7f093583d780 1 < canceled operation key=NFM6LT89K5F4 tag=JKUKB7ULKEG3 type=del size=3592917 2024-03-04T12:41:14.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.271+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=L5YROG8MCEHW type=write size=921075 2024-03-04T12:41:14.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.273+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~WOMNNQ99YKGC.0 size=1048576 2024-03-04T12:41:14.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.273+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~WOMNNQ99YKGC.1 size=495478 2024-03-04T12:41:14.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.275+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=WOMNNQ99YKGC tag=VELBITOJJSNH type=write size=2592630 2024-03-04T12:41:14.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.277+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=Y4HD8AQJTF5W type=del size=1424129 2024-03-04T12:41:14.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.278+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~Z65FW2VWZAE0.0 size=1048576 2024-03-04T12:41:14.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.279+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~Z65FW2VWZAE0.1 size=694367 2024-03-04T12:41:14.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.281+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=Z65FW2VWZAE0 tag=9ACW7KV8P4YN type=write size=2791519 2024-03-04T12:41:14.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.283+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~OCNY8MKP521D.0 size=1048576 2024-03-04T12:41:14.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.284+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~OCNY8MKP521D.1 size=916135 2024-03-04T12:41:14.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.284+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=OCNY8MKP521D tag=ARZBYSXM2FH2 type=write size=3013287 2024-03-04T12:41:14.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.286+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=POBZM2Q7A4G4 type=del 2024-03-04T12:41:14.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.287+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=2H7GLCR8FRFU type=del size=1489764 2024-03-04T12:41:14.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.289+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~QNCMRPR3R3AZ.0 size=1048576 2024-03-04T12:41:14.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.290+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~QNCMRPR3R3AZ.1 size=1048576 2024-03-04T12:41:14.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.291+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~QNCMRPR3R3AZ.2 size=401912 2024-03-04T12:41:14.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.293+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=QNCMRPR3R3AZ tag=DF94DXZJ3R9E type=write size=3547640 2024-03-04T12:41:14.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.294+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=9H0SD6BV3FT4 type=del size=739226 2024-03-04T12:41:14.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.295+0000 7f093583d780 -1 < failed to complete operation key=I6DIP4VGHMNO tag=C3OEBCJRGLZU type=del size=3667530: (22) Invalid argument 2024-03-04T12:41:14.302 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.296+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=2BVDZT6E18X0 type=del size=686346 2024-03-04T12:41:14.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.298+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~3NM1C3OC9RI9.0 size=1048576 2024-03-04T12:41:14.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.299+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~3NM1C3OC9RI9.1 size=218302 2024-03-04T12:41:14.306 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.301+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=3NM1C3OC9RI9 tag=O4P2ZAKT8A1X type=write size=2315454 2024-03-04T12:41:14.308 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.303+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~K0CY9OKQZG5W.0 size=572024 2024-03-04T12:41:14.308 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.303+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=K0CY9OKQZG5W tag=II6OCK140BKC type=write size=1620600 2024-03-04T12:41:14.311 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.305+0000 7f093583d780 1 < suggested remove operation key=GMKM2QEP072H tag=U7H0CRGZKYSB type=del 2024-03-04T12:41:14.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.307+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=YKBD2F6G202P type=del size=3760991 2024-03-04T12:41:14.313 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.308+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~PIEWZ9OGGS4C.0 size=1048576 2024-03-04T12:41:14.314 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.309+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~PIEWZ9OGGS4C.1 size=1048576 2024-03-04T12:41:14.315 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.310+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~PIEWZ9OGGS4C.2 size=568933 2024-03-04T12:41:14.317 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.311+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=PIEWZ9OGGS4C tag=LHJPLXS35WMZ type=write size=3714661 2024-03-04T12:41:14.319 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.313+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~8GCUAXMYJRCZ.0 size=52008 2024-03-04T12:41:14.319 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.313+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=8GCUAXMYJRCZ tag=JWD8VLWBKSFT type=write size=1100584 2024-03-04T12:41:14.320 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.315+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=JD6ZRZTD0RJ7 type=del 2024-03-04T12:41:14.321 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.316+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=0XJDDI3PYG1V type=del size=3255429 2024-03-04T12:41:14.323 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.317+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~92456IMEFHPE.0 size=1048576 2024-03-04T12:41:14.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.318+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~92456IMEFHPE.1 size=317489 2024-03-04T12:41:14.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.320+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=92456IMEFHPE tag=0BXYCPPIQYBR type=write size=2414641 2024-03-04T12:41:14.327 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.322+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~F9B04413ULHL.0 size=121450 2024-03-04T12:41:14.328 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.322+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=F9B04413ULHL tag=1M5JC3UXMJ7N type=write size=1170026 2024-03-04T12:41:14.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.324+0000 7f093583d780 1 < suggested remove operation key=2ZOV2JEQHXGS tag=Z80YJOC9GHVO type=del 2024-03-04T12:41:14.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.325+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=K9SRCILL1OZV type=del size=3120599 2024-03-04T12:41:14.333 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.327+0000 7f093583d780 1 < suggested update operation key=I6DIP4VGHMNO tag=J45XNESTA3OM type=write size=493332 2024-03-04T12:41:14.334 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.329+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=YS2YBYLUHBA0 type=del size=681303 2024-03-04T12:41:14.335 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.330+0000 7f093583d780 -1 < failed to complete operation key=I6DIP4VGHMNO tag=W47NYMOXO3QO type=del size=2907015: (22) Invalid argument 2024-03-04T12:41:14.337 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.332+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~0WN31H9J23K4.0 size=1048576 2024-03-04T12:41:14.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.333+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~0WN31H9J23K4.1 size=1048576 2024-03-04T12:41:14.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.334+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~0WN31H9J23K4.2 size=646263 2024-03-04T12:41:14.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.334+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=0WN31H9J23K4 tag=ZPQBIWTT3EZJ type=write size=3791991 2024-03-04T12:41:14.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.335+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~V1X7ULVCAQ9P.0 size=1048576 2024-03-04T12:41:14.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.336+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~V1X7ULVCAQ9P.1 size=1048576 2024-03-04T12:41:14.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.337+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~V1X7ULVCAQ9P.2 size=648478 2024-03-04T12:41:14.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.339+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=V1X7ULVCAQ9P tag=NUR8SI7367GX type=write size=3794206 2024-03-04T12:41:14.345 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.340+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=Y50PU70Y0US0 type=del size=2965859 2024-03-04T12:41:14.346 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.341+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~5HL1Y814GWIA.0 size=1048576 2024-03-04T12:41:14.347 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.342+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~5HL1Y814GWIA.1 size=1048576 2024-03-04T12:41:14.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.343+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~5HL1Y814GWIA.2 size=205900 2024-03-04T12:41:14.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.344+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=5HL1Y814GWIA tag=63S1IITQ3JMH type=write size=3351628 2024-03-04T12:41:14.351 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.345+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=TAL5G05FW68J type=del size=1623352 2024-03-04T12:41:14.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.348+0000 7f093583d780 1 < suggested remove operation key=OFTWI7UFD5L5 tag=L5YROG8MCEHW type=write 2024-03-04T12:41:14.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.349+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=FPZVRL7MT67L type=write size=904322 2024-03-04T12:41:14.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.350+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=Y4HD8AQJTF5W type=del 2024-03-04T12:41:14.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.351+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=MHTVJBXTOSAF type=del size=1924760 2024-03-04T12:41:14.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.352+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~OCNY8MKP521D.0 size=1048576 2024-03-04T12:41:14.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.353+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~OCNY8MKP521D.1 size=916135 2024-03-04T12:41:14.360 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.355+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=OCNY8MKP521D tag=ARZBYSXM2FH2 type=write size=3013287 2024-03-04T12:41:14.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.357+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~Q4A1IJMCLSI4.0 size=172318 2024-03-04T12:41:14.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.357+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=Q4A1IJMCLSI4 tag=PS9H13XU1EP1 type=write size=1220894 2024-03-04T12:41:14.364 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.358+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=2H7GLCR8FRFU type=del 2024-03-04T12:41:14.364 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.359+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=AR5DB16YPOFH type=del size=1637652 2024-03-04T12:41:14.366 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.360+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=9H0SD6BV3FT4 type=del 2024-03-04T12:41:14.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.362+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~UI8V5HIQ3U07.0 size=1048576 2024-03-04T12:41:14.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.363+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~UI8V5HIQ3U07.1 size=1048576 2024-03-04T12:41:14.369 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.364+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~UI8V5HIQ3U07.2 size=991165 2024-03-04T12:41:14.370 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.364+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=UI8V5HIQ3U07 tag=1HGMB5YLSPU4 type=write size=4136893 2024-03-04T12:41:14.370 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.365+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=2BVDZT6E18X0 type=del 2024-03-04T12:41:14.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.366+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=PN4S776ZTF8W type=del size=3676007 2024-03-04T12:41:14.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.367+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~K0CY9OKQZG5W.0 size=572024 2024-03-04T12:41:14.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.369+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=K0CY9OKQZG5W tag=II6OCK140BKC type=write size=1620600 2024-03-04T12:41:14.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.373+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~KUKK1YN6KWP5.0 size=1048576 2024-03-04T12:41:14.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.374+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~KUKK1YN6KWP5.1 size=1048576 2024-03-04T12:41:14.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.375+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~KUKK1YN6KWP5.2 size=345534 2024-03-04T12:41:14.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.375+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=KUKK1YN6KWP5 tag=C584LJUPMI87 type=write size=3491262 2024-03-04T12:41:14.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.376+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=YKBD2F6G202P type=del 2024-03-04T12:41:14.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.377+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=Q0WA1QR2J58F type=del size=787333 2024-03-04T12:41:14.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.379+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~8GCUAXMYJRCZ.0 size=52008 2024-03-04T12:41:14.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.380+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=8GCUAXMYJRCZ tag=JWD8VLWBKSFT type=write size=1100584 2024-03-04T12:41:14.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.382+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~7B5VOC7K86ME.0 size=1048576 2024-03-04T12:41:14.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.383+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~7B5VOC7K86ME.1 size=1048576 2024-03-04T12:41:14.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.386+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~7B5VOC7K86ME.2 size=776981 2024-03-04T12:41:14.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.386+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=7B5VOC7K86ME tag=E6TGCM7193PF type=write size=3922709 2024-03-04T12:41:14.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.387+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=0XJDDI3PYG1V type=del 2024-03-04T12:41:14.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.388+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=1Y0XWF0O1SQA type=write size=236552 2024-03-04T12:41:14.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.388+0000 7f093583d780 1 < canceled part key=_multipart_9VKN43CB955V.2~F9B04413ULHL.0 size=121450 2024-03-04T12:41:14.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.390+0000 7f093583d780 1 < canceled multipart upload key=9VKN43CB955V upload=F9B04413ULHL tag=1M5JC3UXMJ7N type=write size=1170026 2024-03-04T12:41:14.397 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.392+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=2GU3S7PGMGQ2 type=del size=29079 2024-03-04T12:41:14.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.394+0000 7f093583d780 1 < suggested remove operation key=54FLC10FWKL6 tag=K9SRCILL1OZV type=del 2024-03-04T12:41:14.401 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.395+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=DMT8HMYLNBS6 type=del size=1713319 2024-03-04T12:41:14.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.396+0000 7f093583d780 1 < canceled operation key=OCOQJLUUNWRG tag=YS2YBYLUHBA0 type=del size=681303 2024-03-04T12:41:14.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.398+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=0S9AGII0VBRD type=del size=3222134 2024-03-04T12:41:14.404 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.399+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~0WN31H9J23K4.0 size=1048576 2024-03-04T12:41:14.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.400+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~0WN31H9J23K4.1 size=1048576 2024-03-04T12:41:14.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.400+0000 7f093583d780 1 < canceled part key=_multipart_J6Y9V11BX06B.2~0WN31H9J23K4.2 size=646263 2024-03-04T12:41:14.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.402+0000 7f093583d780 1 < canceled multipart upload key=J6Y9V11BX06B upload=0WN31H9J23K4 tag=ZPQBIWTT3EZJ type=write size=3791991 2024-03-04T12:41:14.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.403+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=ISRXVHF4S8WB type=del size=4129195 2024-03-04T12:41:14.410 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.404+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=Y50PU70Y0US0 type=del 2024-03-04T12:41:14.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.406+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~ULZNBN36VOXY.0 size=1048576 2024-03-04T12:41:14.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.407+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~ULZNBN36VOXY.1 size=757065 2024-03-04T12:41:14.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.407+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=ULZNBN36VOXY tag=MBKD4EJ96ZK6 type=write size=2854217 2024-03-04T12:41:14.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.408+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=TAL5G05FW68J type=del 2024-03-04T12:41:14.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.410+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=IHLEOODD080G type=del size=4134174 2024-03-04T12:41:14.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.411+0000 7f093583d780 1 < completed write operation key=L4UQK3UJFXZC tag=FPZVRL7MT67L type=write size=904322 2024-03-04T12:41:14.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.413+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~PMHOOYDNFG5F.0 size=1048576 2024-03-04T12:41:14.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.414+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~PMHOOYDNFG5F.1 size=1048576 2024-03-04T12:41:14.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.415+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~PMHOOYDNFG5F.2 size=482508 2024-03-04T12:41:14.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.415+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=PMHOOYDNFG5F tag=27FE2O7JVRZH type=write size=3628236 2024-03-04T12:41:14.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.416+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=MHTVJBXTOSAF type=del 2024-03-04T12:41:14.423 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.417+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=2TCRUSJ2QY67 type=write size=165036 2024-03-04T12:41:14.423 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.417+0000 7f093583d780 1 < canceled part key=_multipart_OCOQJLUUNWRG.2~Q4A1IJMCLSI4.0 size=172318 2024-03-04T12:41:14.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.419+0000 7f093583d780 1 < canceled multipart upload key=OCOQJLUUNWRG upload=Q4A1IJMCLSI4 tag=PS9H13XU1EP1 type=write size=1220894 2024-03-04T12:41:14.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.421+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=J9FV6AXF3QRU type=write size=335232 2024-03-04T12:41:14.427 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.422+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=AR5DB16YPOFH type=del 2024-03-04T12:41:14.430 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.424+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~LO0VM5FUFWWA.0 size=1048576 2024-03-04T12:41:14.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.425+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~LO0VM5FUFWWA.1 size=437131 2024-03-04T12:41:14.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.425+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=LO0VM5FUFWWA tag=KJGG9IP4WZ8J type=write size=2534283 2024-03-04T12:41:14.432 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.426+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~UI8V5HIQ3U07.0 size=1048576 2024-03-04T12:41:14.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.427+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~UI8V5HIQ3U07.1 size=1048576 2024-03-04T12:41:14.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.428+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~UI8V5HIQ3U07.2 size=991165 2024-03-04T12:41:14.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.430+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=UI8V5HIQ3U07 tag=1HGMB5YLSPU4 type=write size=4136893 2024-03-04T12:41:14.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.432+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~MZ1KLZR77QK7.0 size=1048576 2024-03-04T12:41:14.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.433+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~MZ1KLZR77QK7.1 size=1048576 2024-03-04T12:41:14.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.434+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~MZ1KLZR77QK7.2 size=258595 2024-03-04T12:41:14.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.434+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=MZ1KLZR77QK7 tag=O0OGQ3CHLBIS type=write size=3404323 2024-03-04T12:41:14.441 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.435+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=PN4S776ZTF8W type=del 2024-03-04T12:41:14.442 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.437+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~TZ3YFBKNTOYJ.0 size=18786 2024-03-04T12:41:14.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.437+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=TZ3YFBKNTOYJ tag=5QLLN02C1WIZ type=write size=1067362 2024-03-04T12:41:14.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.438+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~KUKK1YN6KWP5.0 size=1048576 2024-03-04T12:41:14.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.439+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~KUKK1YN6KWP5.1 size=1048576 2024-03-04T12:41:14.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.440+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~KUKK1YN6KWP5.2 size=345534 2024-03-04T12:41:14.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.442+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=KUKK1YN6KWP5 tag=C584LJUPMI87 type=write size=3491262 2024-03-04T12:41:14.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.443+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=3D5GCJXHG4H3 type=del size=3459396 2024-03-04T12:41:14.450 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.444+0000 7f093583d780 1 < canceled operation key=GMKM2QEP072H tag=Q0WA1QR2J58F type=del size=787333 2024-03-04T12:41:14.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.446+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~175AR5UE1XAQ.0 size=1048576 2024-03-04T12:41:14.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.447+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~175AR5UE1XAQ.1 size=700876 2024-03-04T12:41:14.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.447+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=175AR5UE1XAQ tag=18UPOCEJZKEY type=write size=2798028 2024-03-04T12:41:14.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.447+0000 7f093583d780 1 < canceled part key=_multipart_2XVNK3YEVHJ7.2~7B5VOC7K86ME.0 size=1048576 2024-03-04T12:41:14.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.447+0000 7f093583d780 1 < canceled part key=_multipart_2XVNK3YEVHJ7.2~7B5VOC7K86ME.1 size=1048576 2024-03-04T12:41:14.454 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.448+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~7B5VOC7K86ME.2 size=776981 2024-03-04T12:41:14.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.450+0000 7f093583d780 1 < canceled multipart upload key=2XVNK3YEVHJ7 upload=7B5VOC7K86ME tag=E6TGCM7193PF type=write size=3922709 2024-03-04T12:41:14.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.452+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~JOEUHD1RJ6SY.0 size=1048576 2024-03-04T12:41:14.459 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.453+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~JOEUHD1RJ6SY.1 size=915471 2024-03-04T12:41:14.459 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.453+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=JOEUHD1RJ6SY tag=ENCA6AAN3MR1 type=write size=3012623 2024-03-04T12:41:14.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.454+0000 7f093583d780 1 < completed write operation key=FT2XNJYYT30J tag=1Y0XWF0O1SQA type=write size=236552 2024-03-04T12:41:14.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.456+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=5IUEZJR9PKIL type=write size=803780 2024-03-04T12:41:14.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.457+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=2GU3S7PGMGQ2 type=del 2024-03-04T12:41:14.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.459+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~68P80YGCS8UA.0 size=1048576 2024-03-04T12:41:14.465 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.460+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~68P80YGCS8UA.1 size=1048576 2024-03-04T12:41:14.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.461+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~68P80YGCS8UA.2 size=35941 2024-03-04T12:41:14.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.461+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=68P80YGCS8UA tag=RFIOTOQTOE8K type=write size=3181669 2024-03-04T12:41:14.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.462+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=DMT8HMYLNBS6 type=del 2024-03-04T12:41:14.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.463+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=RG23G6O9A01U type=write size=446149 2024-03-04T12:41:14.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.465+0000 7f093583d780 1 < suggested remove operation key=3F8GI0JCUR6W tag=0S9AGII0VBRD type=del 2024-03-04T12:41:14.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.467+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~2DNLS7N6FDB2.0 size=432504 2024-03-04T12:41:14.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.467+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=2DNLS7N6FDB2 tag=3YW9MC4AF61A type=write size=1481080 2024-03-04T12:41:14.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.469+0000 7f093583d780 1 < suggested remove operation key=I6DIP4VGHMNO tag=ISRXVHF4S8WB type=del 2024-03-04T12:41:14.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.470+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=0NVDDR5NT1OT type=del size=1785223 2024-03-04T12:41:14.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.471+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~ULZNBN36VOXY.0 size=1048576 2024-03-04T12:41:14.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.472+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~ULZNBN36VOXY.1 size=757065 2024-03-04T12:41:14.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.474+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=ULZNBN36VOXY tag=MBKD4EJ96ZK6 type=write size=2854217 2024-03-04T12:41:14.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.475+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=3YP1U3PWR8DZ type=del size=2820316 2024-03-04T12:41:14.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.477+0000 7f093583d780 1 < suggested remove operation key=PT63VLFQQN0E tag=IHLEOODD080G type=del 2024-03-04T12:41:14.484 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.478+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=AK1E7NARA267 type=write size=135347 2024-03-04T12:41:14.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.480+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~PMHOOYDNFG5F.0 size=1048576 2024-03-04T12:41:14.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.481+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~PMHOOYDNFG5F.1 size=1048576 2024-03-04T12:41:14.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.482+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~PMHOOYDNFG5F.2 size=482508 2024-03-04T12:41:14.489 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.484+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=PMHOOYDNFG5F tag=27FE2O7JVRZH type=write size=3628236 2024-03-04T12:41:14.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.486+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~PS9WA1MKB1QW.0 size=1048576 2024-03-04T12:41:14.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.487+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~PS9WA1MKB1QW.1 size=1048576 2024-03-04T12:41:14.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.488+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~PS9WA1MKB1QW.2 size=710835 2024-03-04T12:41:14.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.488+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=PS9WA1MKB1QW tag=IAJMYRWEPCVC type=write size=3856563 2024-03-04T12:41:14.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.490+0000 7f093583d780 -1 < failed to complete operation key=PT63VLFQQN0E tag=2TCRUSJ2QY67 type=write size=165036: (22) Invalid argument 2024-03-04T12:41:14.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.492+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~WR94BBQKE9V0.0 size=1048576 2024-03-04T12:41:14.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.492+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~WR94BBQKE9V0.1 size=594796 2024-03-04T12:41:14.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.492+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=WR94BBQKE9V0 tag=9854EUL8DD11 type=write size=2691948 2024-03-04T12:41:14.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.494+0000 7f093583d780 1 < completed write operation key=2R5WA9Q9ZAUG tag=J9FV6AXF3QRU type=write size=335232 2024-03-04T12:41:14.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.496+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~YM3XJXNDLOE5.0 size=1048576 2024-03-04T12:41:14.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.497+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~YM3XJXNDLOE5.1 size=1048576 2024-03-04T12:41:14.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.498+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~YM3XJXNDLOE5.2 size=587165 2024-03-04T12:41:14.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.498+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=YM3XJXNDLOE5 tag=AYWNQ89POP1G type=write size=3732893 2024-03-04T12:41:14.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.499+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~LO0VM5FUFWWA.0 size=1048576 2024-03-04T12:41:14.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.500+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~LO0VM5FUFWWA.1 size=437131 2024-03-04T12:41:14.508 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.502+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=LO0VM5FUFWWA tag=KJGG9IP4WZ8J type=write size=2534283 2024-03-04T12:41:14.510 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.504+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~P4LZSXPG56LI.0 size=625766 2024-03-04T12:41:14.510 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.504+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=P4LZSXPG56LI tag=3VJPTMBJG5Y9 type=write size=1674342 2024-03-04T12:41:14.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.505+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~MZ1KLZR77QK7.0 size=1048576 2024-03-04T12:41:14.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.506+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~MZ1KLZR77QK7.1 size=1048576 2024-03-04T12:41:14.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.507+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~MZ1KLZR77QK7.2 size=258595 2024-03-04T12:41:14.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.509+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=MZ1KLZR77QK7 tag=O0OGQ3CHLBIS type=write size=3404323 2024-03-04T12:41:14.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.510+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=4ETZYWOVGS35 type=del size=1049248 2024-03-04T12:41:14.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.512+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~TZ3YFBKNTOYJ.0 size=18786 2024-03-04T12:41:14.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.514+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=TZ3YFBKNTOYJ tag=5QLLN02C1WIZ type=write size=1067362 2024-03-04T12:41:14.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.516+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~T5HC1KN6G1ZC.0 size=626431 2024-03-04T12:41:14.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.516+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=T5HC1KN6G1ZC tag=6AUV90JV6WKI type=write size=1675007 2024-03-04T12:41:14.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.517+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=3D5GCJXHG4H3 type=del 2024-03-04T12:41:14.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.519+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~X8ZEG4HNMZCW.0 size=1048576 2024-03-04T12:41:14.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.520+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~X8ZEG4HNMZCW.1 size=323881 2024-03-04T12:41:14.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.520+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=X8ZEG4HNMZCW tag=C04W1NB1EXJ5 type=write size=2421033 2024-03-04T12:41:14.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.521+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~175AR5UE1XAQ.0 size=1048576 2024-03-04T12:41:14.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.522+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~175AR5UE1XAQ.1 size=700876 2024-03-04T12:41:14.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.524+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=175AR5UE1XAQ tag=18UPOCEJZKEY type=write size=2798028 2024-03-04T12:41:14.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.525+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=3U0MRTLT7KKX type=write size=338883 2024-03-04T12:41:14.532 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.526+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~JOEUHD1RJ6SY.0 size=1048576 2024-03-04T12:41:14.532 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.527+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~JOEUHD1RJ6SY.1 size=915471 2024-03-04T12:41:14.534 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.529+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=JOEUHD1RJ6SY tag=ENCA6AAN3MR1 type=write size=3012623 2024-03-04T12:41:14.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.530+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=39O093PG3K55 type=write size=219421 2024-03-04T12:41:14.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.531+0000 7f093583d780 1 < completed write operation key=NFM6LT89K5F4 tag=5IUEZJR9PKIL type=write size=803780 2024-03-04T12:41:14.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.532+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=RBUUNOFZNS6H type=del size=667746 2024-03-04T12:41:14.539 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.534+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~68P80YGCS8UA.0 size=1048576 2024-03-04T12:41:14.540 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.535+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~68P80YGCS8UA.1 size=1048576 2024-03-04T12:41:14.540 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.535+0000 7f093583d780 1 < canceled part key=_multipart_I5NQBROT0WKE.2~68P80YGCS8UA.2 size=35941 2024-03-04T12:41:14.542 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.536+0000 7f093583d780 1 < canceled multipart upload key=I5NQBROT0WKE upload=68P80YGCS8UA tag=RFIOTOQTOE8K type=write size=3181669 2024-03-04T12:41:14.543 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.538+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=B2Z1SOVGF6H2 type=del size=3100974 2024-03-04T12:41:14.545 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.539+0000 7f093583d780 1 < completed write operation key=GJ0FQ6EH9HJL tag=RG23G6O9A01U type=write size=446149 2024-03-04T12:41:14.546 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.540+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=Q36IU8WY08F4 type=write size=788707 2024-03-04T12:41:14.547 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.541+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~2DNLS7N6FDB2.0 size=432504 2024-03-04T12:41:14.549 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.543+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=2DNLS7N6FDB2 tag=3YW9MC4AF61A type=write size=1481080 2024-03-04T12:41:14.550 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.544+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=THGH7QTZWPCD type=del size=3557178 2024-03-04T12:41:14.552 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.547+0000 7f093583d780 1 < suggested update operation key=TMAI6MOG2C4N tag=0NVDDR5NT1OT type=del size=1785223 2024-03-04T12:41:14.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.548+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=ZTDOAU81YDXG type=del size=2884751 2024-03-04T12:41:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.549+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=3YP1U3PWR8DZ type=del 2024-03-04T12:41:14.556 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.551+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~WQCASU4ACXGR.0 size=1048576 2024-03-04T12:41:14.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.552+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~WQCASU4ACXGR.1 size=895986 2024-03-04T12:41:14.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.552+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=WQCASU4ACXGR tag=AS33K9XHCOCZ type=write size=2993138 2024-03-04T12:41:14.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.553+0000 7f093583d780 1 < completed write operation key=NQF43I07F2HT tag=AK1E7NARA267 type=write size=135347 2024-03-04T12:41:14.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.554+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=EJD1BUMU0O7F type=write size=318547 2024-03-04T12:41:14.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.555+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~PS9WA1MKB1QW.0 size=1048576 2024-03-04T12:41:14.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.556+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~PS9WA1MKB1QW.1 size=1048576 2024-03-04T12:41:14.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.557+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~PS9WA1MKB1QW.2 size=710835 2024-03-04T12:41:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.559+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=PS9WA1MKB1QW tag=IAJMYRWEPCVC type=write size=3856563 2024-03-04T12:41:14.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.561+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=3A1EBVJNYG24 type=del size=400310 2024-03-04T12:41:14.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.562+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~WR94BBQKE9V0.0 size=1048576 2024-03-04T12:41:14.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.563+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~WR94BBQKE9V0.1 size=594796 2024-03-04T12:41:14.570 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.565+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=WR94BBQKE9V0 tag=9854EUL8DD11 type=write size=2691948 2024-03-04T12:41:14.571 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.566+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=QVXRDXEK8KAW type=del size=1467354 2024-03-04T12:41:14.573 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.567+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~YM3XJXNDLOE5.0 size=1048576 2024-03-04T12:41:14.573 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.568+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~YM3XJXNDLOE5.1 size=1048576 2024-03-04T12:41:14.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.569+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~YM3XJXNDLOE5.2 size=587165 2024-03-04T12:41:14.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.571+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=YM3XJXNDLOE5 tag=AYWNQ89POP1G type=write size=3732893 2024-03-04T12:41:14.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.572+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=X4LKBGNUYK9E type=del size=1011399 2024-03-04T12:41:14.579 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.573+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~P4LZSXPG56LI.0 size=625766 2024-03-04T12:41:14.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.576+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=P4LZSXPG56LI tag=3VJPTMBJG5Y9 type=write size=1674342 2024-03-04T12:41:14.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.578+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~19YT60O55L56.0 size=1048576 2024-03-04T12:41:14.584 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.578+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~19YT60O55L56.1 size=1048576 2024-03-04T12:41:14.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.579+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~19YT60O55L56.2 size=490736 2024-03-04T12:41:14.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.579+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=19YT60O55L56 tag=GKBDW69YFMNC type=write size=3636464 2024-03-04T12:41:14.587 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.581+0000 7f093583d780 1 < suggested remove operation key=2R5WA9Q9ZAUG tag=4ETZYWOVGS35 type=del 2024-03-04T12:41:14.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.583+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~QI1T1FSIMOMI.0 size=1048576 2024-03-04T12:41:14.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.584+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~QI1T1FSIMOMI.1 size=1048576 2024-03-04T12:41:14.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.586+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~QI1T1FSIMOMI.2 size=804822 2024-03-04T12:41:14.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.586+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=QI1T1FSIMOMI tag=VVNVXEHYR9BA type=write size=3950550 2024-03-04T12:41:14.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.588+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~T5HC1KN6G1ZC.0 size=626431 2024-03-04T12:41:14.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.591+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=T5HC1KN6G1ZC tag=6AUV90JV6WKI type=write size=1675007 2024-03-04T12:41:14.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.592+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=TDCICRHQZLWX type=del size=1201702 2024-03-04T12:41:14.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.594+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~X8ZEG4HNMZCW.0 size=1048576 2024-03-04T12:41:14.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.594+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~X8ZEG4HNMZCW.1 size=323881 2024-03-04T12:41:14.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.596+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=X8ZEG4HNMZCW tag=C04W1NB1EXJ5 type=write size=2421033 2024-03-04T12:41:14.604 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.598+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~Q5KGTYHUEE4F.0 size=1048576 2024-03-04T12:41:14.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.599+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~Q5KGTYHUEE4F.1 size=939761 2024-03-04T12:41:14.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.599+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=Q5KGTYHUEE4F tag=SRPMOS3NZPS5 type=write size=3036913 2024-03-04T12:41:14.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.601+0000 7f093583d780 1 < completed write operation key=NFM6LT89K5F4 tag=3U0MRTLT7KKX type=write size=338883 2024-03-04T12:41:14.607 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.602+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=V733JJAT7D9B type=write size=21490 2024-03-04T12:41:14.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.603+0000 7f093583d780 1 < completed write operation key=GMKM2QEP072H tag=39O093PG3K55 type=write size=219421 2024-03-04T12:41:14.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.605+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~EOJ3O9HPLYMI.0 size=1048576 2024-03-04T12:41:14.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.606+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~EOJ3O9HPLYMI.1 size=1048576 2024-03-04T12:41:14.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.606+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~EOJ3O9HPLYMI.2 size=840180 2024-03-04T12:41:14.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.606+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=EOJ3O9HPLYMI tag=5Y651JNOLKHB type=write size=3985908 2024-03-04T12:41:14.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.607+0000 7f093583d780 1 < completed delete operation key=O6OUISHWZ7FU tag=RBUUNOFZNS6H type=del 2024-03-04T12:41:14.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.609+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~VFAR4VJDDFJC.0 size=1048576 2024-03-04T12:41:14.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.610+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~VFAR4VJDDFJC.1 size=1048576 2024-03-04T12:41:14.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.611+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~VFAR4VJDDFJC.2 size=35138 2024-03-04T12:41:14.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.611+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=VFAR4VJDDFJC tag=VHQO48MGXJKN type=write size=3180866 2024-03-04T12:41:14.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.615+0000 7f093583d780 1 < suggested update operation key=2XVNK3YEVHJ7 tag=B2Z1SOVGF6H2 type=del size=3100974 2024-03-04T12:41:14.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.616+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=YFHK64OCROA1 type=write size=804065 2024-03-04T12:41:14.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.617+0000 7f093583d780 -1 < failed to complete operation key=2R5WA9Q9ZAUG tag=Q36IU8WY08F4 type=write size=788707: (22) Invalid argument 2024-03-04T12:41:14.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.618+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=JZI7TYPL2FFO type=del size=1544102 2024-03-04T12:41:14.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.620+0000 7f093583d780 1 < suggested remove operation key=I5NQBROT0WKE tag=THGH7QTZWPCD type=del 2024-03-04T12:41:14.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.621+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=0A9L2YPMYH7U type=write size=361365 2024-03-04T12:41:14.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.623+0000 7f093583d780 1 < suggested update operation key=YJXFSO53QVPS tag=ZTDOAU81YDXG type=del size=2884751 2024-03-04T12:41:14.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.625+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~4ZAHLPEPN3DT.0 size=1048576 2024-03-04T12:41:14.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.626+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~4ZAHLPEPN3DT.1 size=135660 2024-03-04T12:41:14.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.626+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=4ZAHLPEPN3DT tag=S69EF1Z3GPH1 type=write size=2232812 2024-03-04T12:41:14.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.627+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~WQCASU4ACXGR.0 size=1048576 2024-03-04T12:41:14.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.628+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~WQCASU4ACXGR.1 size=895986 2024-03-04T12:41:14.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.630+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=WQCASU4ACXGR tag=AS33K9XHCOCZ type=write size=2993138 2024-03-04T12:41:14.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.632+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~NKY1E3GB6HTT.0 size=1048576 2024-03-04T12:41:14.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.633+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~NKY1E3GB6HTT.1 size=296377 2024-03-04T12:41:14.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.633+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=NKY1E3GB6HTT tag=K4UFIA01Q6ZS type=write size=2393529 2024-03-04T12:41:14.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.634+0000 7f093583d780 1 < completed write operation key=O6OUISHWZ7FU tag=EJD1BUMU0O7F type=write size=318547 2024-03-04T12:41:14.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.636+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~8Q129RIRLFQ8.0 size=1048576 2024-03-04T12:41:14.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.637+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~8Q129RIRLFQ8.1 size=1048576 2024-03-04T12:41:14.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.637+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~8Q129RIRLFQ8.2 size=934836 2024-03-04T12:41:14.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.637+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=8Q129RIRLFQ8 tag=1TEMW261QHIS type=write size=4080564 2024-03-04T12:41:14.645 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.640+0000 7f093583d780 1 < suggested remove operation key=Y4D4Q7NV5VMO tag=3A1EBVJNYG24 type=del 2024-03-04T12:41:14.646 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.641+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=1EDPOUUMH39P type=write size=46979 2024-03-04T12:41:14.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.642+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=QVXRDXEK8KAW type=del 2024-03-04T12:41:14.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.643+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=L4BC1PDOTFP5 type=del size=3567094 2024-03-04T12:41:14.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.644+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=X4LKBGNUYK9E type=del 2024-03-04T12:41:14.651 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.645+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=PDKAEX4UW35N type=del size=1463881 2024-03-04T12:41:14.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.646+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~19YT60O55L56.0 size=1048576 2024-03-04T12:41:14.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.647+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~19YT60O55L56.1 size=1048576 2024-03-04T12:41:14.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.648+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~19YT60O55L56.2 size=490736 2024-03-04T12:41:14.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.650+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=19YT60O55L56 tag=GKBDW69YFMNC type=write size=3636464 2024-03-04T12:41:14.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.651+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=UPXR1KW3I39V type=write size=57099 2024-03-04T12:41:14.658 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.652+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~QI1T1FSIMOMI.0 size=1048576 2024-03-04T12:41:14.659 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.653+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~QI1T1FSIMOMI.1 size=1048576 2024-03-04T12:41:14.659 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.654+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~QI1T1FSIMOMI.2 size=804822 2024-03-04T12:41:14.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.656+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=QI1T1FSIMOMI tag=VVNVXEHYR9BA type=write size=3950550 2024-03-04T12:41:14.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.658+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~7HY5CMN3QL61.0 size=1048576 2024-03-04T12:41:14.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.659+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~7HY5CMN3QL61.1 size=767958 2024-03-04T12:41:14.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.659+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=7HY5CMN3QL61 tag=1P3BK2JR9504 type=write size=2865110 2024-03-04T12:41:14.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.660+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=TDCICRHQZLWX type=del 2024-03-04T12:41:14.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.662+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~HAKHTHYPMA2E.0 size=1048576 2024-03-04T12:41:14.668 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.663+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~HAKHTHYPMA2E.1 size=629879 2024-03-04T12:41:14.668 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.663+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=HAKHTHYPMA2E tag=GTHTOHOXU1CL type=write size=2727031 2024-03-04T12:41:14.669 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.664+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~Q5KGTYHUEE4F.0 size=1048576 2024-03-04T12:41:14.670 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.665+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~Q5KGTYHUEE4F.1 size=939761 2024-03-04T12:41:14.672 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.667+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=Q5KGTYHUEE4F tag=SRPMOS3NZPS5 type=write size=3036913 2024-03-04T12:41:14.674 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.669+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~WEVQHEW5FOG5.0 size=1048576 2024-03-04T12:41:14.675 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.670+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~WEVQHEW5FOG5.1 size=695773 2024-03-04T12:41:14.675 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.670+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=WEVQHEW5FOG5 tag=XV8S0D77KHTX type=write size=2792925 2024-03-04T12:41:14.676 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.671+0000 7f093583d780 1 < completed write operation key=3F8GI0JCUR6W tag=V733JJAT7D9B type=write size=21490 2024-03-04T12:41:14.678 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.672+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=SGXSAJC4QPWZ type=del size=1806489 2024-03-04T12:41:14.679 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.673+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~EOJ3O9HPLYMI.0 size=1048576 2024-03-04T12:41:14.680 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.674+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~EOJ3O9HPLYMI.1 size=1048576 2024-03-04T12:41:14.681 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.675+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~EOJ3O9HPLYMI.2 size=840180 2024-03-04T12:41:14.683 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.677+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=EOJ3O9HPLYMI tag=5Y651JNOLKHB type=write size=3985908 2024-03-04T12:41:14.684 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.678+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=63RYAGBUSZBH type=del size=3172777 2024-03-04T12:41:14.685 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.679+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~VFAR4VJDDFJC.0 size=1048576 2024-03-04T12:41:14.686 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.680+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~VFAR4VJDDFJC.1 size=1048576 2024-03-04T12:41:14.687 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.681+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~VFAR4VJDDFJC.2 size=35138 2024-03-04T12:41:14.688 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.683+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=VFAR4VJDDFJC tag=VHQO48MGXJKN type=write size=3180866 2024-03-04T12:41:14.689 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.684+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=IAM59F896QYZ type=del size=2977304 2024-03-04T12:41:14.691 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.685+0000 7f093583d780 1 < canceled operation key=2ZOV2JEQHXGS tag=YFHK64OCROA1 type=write size=804065 2024-03-04T12:41:14.692 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.686+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=MGAPW4ZQH59I type=del size=34176 2024-03-04T12:41:14.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.687+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=JZI7TYPL2FFO type=del 2024-03-04T12:41:14.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.688+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=BOOFU8XVJE2D type=del size=2874043 2024-03-04T12:41:14.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.690+0000 7f093583d780 1 < canceled operation key=2XVNK3YEVHJ7 tag=0A9L2YPMYH7U type=write size=361365 2024-03-04T12:41:14.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.692+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=0DO7EPN3TT4S type=del size=901661 2024-03-04T12:41:14.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.693+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~4ZAHLPEPN3DT.0 size=1048576 2024-03-04T12:41:14.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.694+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~4ZAHLPEPN3DT.1 size=135660 2024-03-04T12:41:14.701 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.696+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=4ZAHLPEPN3DT tag=S69EF1Z3GPH1 type=write size=2232812 2024-03-04T12:41:14.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.698+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~MKD6GAV3MK2T.0 size=1048576 2024-03-04T12:41:14.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.698+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~MKD6GAV3MK2T.1 size=1048576 2024-03-04T12:41:14.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.699+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~MKD6GAV3MK2T.2 size=934981 2024-03-04T12:41:14.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.699+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=MKD6GAV3MK2T tag=VSO3SU3HVYE4 type=write size=4080709 2024-03-04T12:41:14.706 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.701+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~NKY1E3GB6HTT.0 size=1048576 2024-03-04T12:41:14.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.702+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~NKY1E3GB6HTT.1 size=296377 2024-03-04T12:41:14.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.704+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=NKY1E3GB6HTT tag=K4UFIA01Q6ZS type=write size=2393529 2024-03-04T12:41:14.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.705+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=244ZAH2VRSJ1 type=del size=3319618 2024-03-04T12:41:14.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.705+0000 7f093583d780 1 < canceled part key=_multipart_96PTQ2KHPMMM.2~8Q129RIRLFQ8.0 size=1048576 2024-03-04T12:41:14.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.706+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~8Q129RIRLFQ8.1 size=1048576 2024-03-04T12:41:14.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.706+0000 7f093583d780 1 < canceled part key=_multipart_96PTQ2KHPMMM.2~8Q129RIRLFQ8.2 size=934836 2024-03-04T12:41:14.713 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.708+0000 7f093583d780 1 < canceled multipart upload key=96PTQ2KHPMMM upload=8Q129RIRLFQ8 tag=1TEMW261QHIS type=write size=4080564 2024-03-04T12:41:14.714 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.709+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=9V6YFM5UJZIB type=write size=454629 2024-03-04T12:41:14.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.711+0000 7f093583d780 1 < suggested update operation key=L4UQK3UJFXZC tag=1EDPOUUMH39P type=write size=46979 2024-03-04T12:41:14.718 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.713+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~PB6RMMD6S3FR.0 size=1048576 2024-03-04T12:41:14.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.714+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~PB6RMMD6S3FR.1 size=429447 2024-03-04T12:41:14.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.714+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=PB6RMMD6S3FR tag=VJKM6YB7CN84 type=write size=2526599 2024-03-04T12:41:14.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.715+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=L4BC1PDOTFP5 type=del 2024-03-04T12:41:14.722 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.717+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~GP0X8MB1G5KX.0 size=832346 2024-03-04T12:41:14.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.717+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=GP0X8MB1G5KX tag=VXF22MJZ1UGF type=write size=1880922 2024-03-04T12:41:14.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.718+0000 7f093583d780 -1 < failed to complete operation key=L4UQK3UJFXZC tag=PDKAEX4UW35N type=del size=1463881: (22) Invalid argument 2024-03-04T12:41:14.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.719+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=KZ05XP32FVY3 type=del size=3064750 2024-03-04T12:41:14.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.720+0000 7f093583d780 1 < completed write operation key=M0AOZ89IQNSK tag=UPXR1KW3I39V type=write size=57099 2024-03-04T12:41:14.727 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.722+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=98TLBO3V884F type=del size=3613660 2024-03-04T12:41:14.727 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.722+0000 7f093583d780 1 < canceled part key=_multipart_NQF43I07F2HT.2~7HY5CMN3QL61.0 size=1048576 2024-03-04T12:41:14.727 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.722+0000 7f093583d780 1 < canceled part key=_multipart_NQF43I07F2HT.2~7HY5CMN3QL61.1 size=767958 2024-03-04T12:41:14.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.724+0000 7f093583d780 1 < canceled multipart upload key=NQF43I07F2HT upload=7HY5CMN3QL61 tag=1P3BK2JR9504 type=write size=2865110 2024-03-04T12:41:14.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.726+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~9768LAJ5CL71.0 size=1048576 2024-03-04T12:41:14.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.727+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~9768LAJ5CL71.1 size=359378 2024-03-04T12:41:14.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.727+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=9768LAJ5CL71 tag=M92SA43RRRME type=write size=2456530 2024-03-04T12:41:14.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.728+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~HAKHTHYPMA2E.0 size=1048576 2024-03-04T12:41:14.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.729+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~HAKHTHYPMA2E.1 size=629879 2024-03-04T12:41:14.736 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.730+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=HAKHTHYPMA2E tag=GTHTOHOXU1CL type=write size=2727031 2024-03-04T12:41:14.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.731+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=WYIJY2FUXYNW type=write size=372634 2024-03-04T12:41:14.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.733+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~WEVQHEW5FOG5.0 size=1048576 2024-03-04T12:41:14.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.734+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~WEVQHEW5FOG5.1 size=695773 2024-03-04T12:41:14.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.735+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=WEVQHEW5FOG5 tag=XV8S0D77KHTX type=write size=2792925 2024-03-04T12:41:14.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.737+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~ZFKSF1BWG1VO.0 size=348429 2024-03-04T12:41:14.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.737+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=ZFKSF1BWG1VO tag=0AYK3YRGX9UJ type=write size=1397005 2024-03-04T12:41:14.744 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.739+0000 7f093583d780 1 < canceled operation key=YJXFSO53QVPS tag=SGXSAJC4QPWZ type=del size=1806489 2024-03-04T12:41:14.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.741+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~AA7U0I4KNJKH.0 size=644811 2024-03-04T12:41:14.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.741+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=AA7U0I4KNJKH tag=AH0NN3PU26EY type=write size=1693387 2024-03-04T12:41:14.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.742+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=63RYAGBUSZBH type=del 2024-03-04T12:41:14.748 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.743+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=6SYPG0H974SN type=del size=759305 2024-03-04T12:41:14.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.744+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=IAM59F896QYZ type=del 2024-03-04T12:41:14.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.745+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=NZ2XOE1MX5UA type=del size=3508185 2024-03-04T12:41:14.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.747+0000 7f093583d780 1 < suggested update operation key=L4UQK3UJFXZC tag=MGAPW4ZQH59I type=del size=34176 2024-03-04T12:41:14.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.749+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~K3Q72PJ8F3I8.0 size=1048576 2024-03-04T12:41:14.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.750+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~K3Q72PJ8F3I8.1 size=1048576 2024-03-04T12:41:14.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.751+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~K3Q72PJ8F3I8.2 size=238686 2024-03-04T12:41:14.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.751+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=K3Q72PJ8F3I8 tag=J9F01Z5C8HYJ type=write size=3384414 2024-03-04T12:41:14.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.753+0000 7f093583d780 1 < suggested remove operation key=J6Y9V11BX06B tag=BOOFU8XVJE2D type=del 2024-03-04T12:41:14.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.754+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=VVIQJFDY68QU type=write size=990531 2024-03-04T12:41:14.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.755+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=0DO7EPN3TT4S type=del 2024-03-04T12:41:14.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.757+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~L9A6KIUQTNSB.0 size=389830 2024-03-04T12:41:14.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.757+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=L9A6KIUQTNSB tag=M6UE22PGNSF2 type=write size=1438406 2024-03-04T12:41:14.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.759+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~MKD6GAV3MK2T.0 size=1048576 2024-03-04T12:41:14.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.760+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~MKD6GAV3MK2T.1 size=1048576 2024-03-04T12:41:14.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.760+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~MKD6GAV3MK2T.2 size=934981 2024-03-04T12:41:14.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.762+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=MKD6GAV3MK2T tag=VSO3SU3HVYE4 type=write size=4080709 2024-03-04T12:41:14.769 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.763+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=YTJS71AVX4UK type=del size=360770 2024-03-04T12:41:14.770 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.765+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=244ZAH2VRSJ1 type=del 2024-03-04T12:41:14.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.766+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=KEXENRZM8BYN type=del size=2958255 2024-03-04T12:41:14.772 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.767+0000 7f093583d780 1 < completed write operation key=PT63VLFQQN0E tag=9V6YFM5UJZIB type=write size=454629 2024-03-04T12:41:14.773 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.768+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=7LAHMTQ5I2JR type=del size=2816002 2024-03-04T12:41:14.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.769+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~PB6RMMD6S3FR.0 size=1048576 2024-03-04T12:41:14.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.770+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~PB6RMMD6S3FR.1 size=429447 2024-03-04T12:41:14.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.772+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=PB6RMMD6S3FR tag=VJKM6YB7CN84 type=write size=2526599 2024-03-04T12:41:14.778 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.773+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=S9TE3FBFT091 type=del size=155083 2024-03-04T12:41:14.779 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.774+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~GP0X8MB1G5KX.0 size=832346 2024-03-04T12:41:14.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.776+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=GP0X8MB1G5KX tag=VXF22MJZ1UGF type=write size=1880922 2024-03-04T12:41:14.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.778+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~RAWDDS9GMNZZ.0 size=993834 2024-03-04T12:41:14.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.778+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=RAWDDS9GMNZZ tag=ZLIMMNFAD271 type=write size=2042410 2024-03-04T12:41:14.785 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.780+0000 7f093583d780 1 < suggested update operation key=9VKN43CB955V tag=KZ05XP32FVY3 type=del size=3064750 2024-03-04T12:41:14.787 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.782+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~LBP42201Q4WC.0 size=1048576 2024-03-04T12:41:14.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.783+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~LBP42201Q4WC.1 size=1048576 2024-03-04T12:41:14.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.784+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~LBP42201Q4WC.2 size=110328 2024-03-04T12:41:14.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.784+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=LBP42201Q4WC tag=YQ33IJTUDD62 type=write size=3256056 2024-03-04T12:41:14.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.785+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=98TLBO3V884F type=del 2024-03-04T12:41:14.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.786+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=0UHX69Z8KJXU type=write size=649979 2024-03-04T12:41:14.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.787+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~9768LAJ5CL71.0 size=1048576 2024-03-04T12:41:14.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.788+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~9768LAJ5CL71.1 size=359378 2024-03-04T12:41:14.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.790+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=9768LAJ5CL71 tag=M92SA43RRRME type=write size=2456530 2024-03-04T12:41:14.797 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.791+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=KUYPML7U98Z1 type=del size=982860 2024-03-04T12:41:14.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.792+0000 7f093583d780 1 < completed write operation key=TMAI6MOG2C4N tag=WYIJY2FUXYNW type=write size=372634 2024-03-04T12:41:14.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.793+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=RXW581N0Z5CZ type=del size=2077445 2024-03-04T12:41:14.801 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.795+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~ZFKSF1BWG1VO.0 size=348429 2024-03-04T12:41:14.803 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.797+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=ZFKSF1BWG1VO tag=0AYK3YRGX9UJ type=write size=1397005 2024-03-04T12:41:14.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.798+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=ZDGIKRVPRM9Y type=del size=1438587 2024-03-04T12:41:14.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.800+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~AA7U0I4KNJKH.0 size=644811 2024-03-04T12:41:14.807 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.802+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=AA7U0I4KNJKH tag=AH0NN3PU26EY type=write size=1693387 2024-03-04T12:41:14.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.803+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=BSUAIVLC7XPG type=del size=1682362 2024-03-04T12:41:14.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.805+0000 7f093583d780 1 < suggested remove operation key=2ZOV2JEQHXGS tag=6SYPG0H974SN type=del 2024-03-04T12:41:14.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.807+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=5BC9HMQ4H8MH type=del size=2302864 2024-03-04T12:41:14.813 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.808+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=NZ2XOE1MX5UA type=del 2024-03-04T12:41:14.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.809+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=Q92KJXGT7E8X type=del size=3244338 2024-03-04T12:41:14.816 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.811+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~K3Q72PJ8F3I8.0 size=1048576 2024-03-04T12:41:14.816 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.811+0000 7f093583d780 1 < canceled part key=_multipart_UAEQORB3BDBH.2~K3Q72PJ8F3I8.1 size=1048576 2024-03-04T12:41:14.817 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.812+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~K3Q72PJ8F3I8.2 size=238686 2024-03-04T12:41:14.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.814+0000 7f093583d780 1 < canceled multipart upload key=UAEQORB3BDBH upload=K3Q72PJ8F3I8 tag=J9F01Z5C8HYJ type=write size=3384414 2024-03-04T12:41:14.821 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.816+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~0UMPOEN8WC2F.0 size=1048576 2024-03-04T12:41:14.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.817+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~0UMPOEN8WC2F.1 size=148968 2024-03-04T12:41:14.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.817+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=0UMPOEN8WC2F tag=YV11OPACK7CA type=write size=2246120 2024-03-04T12:41:14.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.818+0000 7f093583d780 1 < completed write operation key=NFM6LT89K5F4 tag=VVIQJFDY68QU type=write size=990531 2024-03-04T12:41:14.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.820+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~GCDHGARIDYBO.0 size=1048576 2024-03-04T12:41:14.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.820+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~GCDHGARIDYBO.1 size=486167 2024-03-04T12:41:14.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.820+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=GCDHGARIDYBO tag=SBBDN18C1EYD type=write size=2583319 2024-03-04T12:41:14.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.822+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~L9A6KIUQTNSB.0 size=389830 2024-03-04T12:41:14.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.823+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=L9A6KIUQTNSB tag=M6UE22PGNSF2 type=write size=1438406 2024-03-04T12:41:14.830 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.824+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=PFMB3VO9ZSI0 type=del size=2590734 2024-03-04T12:41:14.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.826+0000 7f093583d780 1 < canceled operation key=OFTWI7UFD5L5 tag=YTJS71AVX4UK type=del size=360770 2024-03-04T12:41:14.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.827+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=H9B0Y0T453F7 type=write size=174099 2024-03-04T12:41:14.834 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.829+0000 7f093583d780 1 < suggested remove operation key=NQF43I07F2HT tag=KEXENRZM8BYN type=del 2024-03-04T12:41:14.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.831+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~ZYKJ18490XEZ.0 size=1048576 2024-03-04T12:41:14.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.832+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~ZYKJ18490XEZ.1 size=1048576 2024-03-04T12:41:14.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.832+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~ZYKJ18490XEZ.2 size=229556 2024-03-04T12:41:14.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.832+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=ZYKJ18490XEZ tag=OVAJ0IJ6L7ET type=write size=3375284 2024-03-04T12:41:14.839 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.834+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=7LAHMTQ5I2JR type=del 2024-03-04T12:41:14.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.835+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=2NN7I7F5U9I3 type=del size=3917155 2024-03-04T12:41:14.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.836+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=S9TE3FBFT091 type=del 2024-03-04T12:41:14.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.837+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=ASV2R8RW77JK type=write size=808733 2024-03-04T12:41:14.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.838+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~RAWDDS9GMNZZ.0 size=993834 2024-03-04T12:41:14.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.840+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=RAWDDS9GMNZZ tag=ZLIMMNFAD271 type=write size=2042410 2024-03-04T12:41:14.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.842+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~H62GY7HXIZF2.0 size=1048576 2024-03-04T12:41:14.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.843+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~H62GY7HXIZF2.1 size=813088 2024-03-04T12:41:14.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.843+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=H62GY7HXIZF2 tag=B0XQ14DI32BA type=write size=2910240 2024-03-04T12:41:14.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.844+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~LBP42201Q4WC.0 size=1048576 2024-03-04T12:41:14.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.845+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~LBP42201Q4WC.1 size=1048576 2024-03-04T12:41:14.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.846+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~LBP42201Q4WC.2 size=110328 2024-03-04T12:41:14.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.848+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=LBP42201Q4WC tag=YQ33IJTUDD62 type=write size=3256056 2024-03-04T12:41:14.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.849+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=S4WONN02ZN5T type=write size=388849 2024-03-04T12:41:14.857 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.851+0000 7f093583d780 1 < suggested update operation key=2XVNK3YEVHJ7 tag=0UHX69Z8KJXU type=write size=649979 2024-03-04T12:41:14.858 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.852+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=Y5VLNVTW4JVR type=del size=100537 2024-03-04T12:41:14.859 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.854+0000 7f093583d780 1 < canceled operation key=GMKM2QEP072H tag=KUYPML7U98Z1 type=del size=982860 2024-03-04T12:41:14.860 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.855+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=QC3L97Q4TQ6S type=del size=3497683 2024-03-04T12:41:14.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.857+0000 7f093583d780 1 < suggested update operation key=I5NQBROT0WKE tag=RXW581N0Z5CZ type=del size=2077445 2024-03-04T12:41:14.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.858+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=OEK2FJZU240B type=del size=2088149 2024-03-04T12:41:14.864 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.859+0000 7f093583d780 1 < canceled operation key=2YD2M0JQNCC0 tag=ZDGIKRVPRM9Y type=del size=1438587 2024-03-04T12:41:14.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.860+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=0N5IO1KQ4XZO type=del size=4139639 2024-03-04T12:41:14.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.861+0000 7f093583d780 -1 < failed to complete operation key=NQF43I07F2HT tag=BSUAIVLC7XPG type=del size=1682362: (22) Invalid argument 2024-03-04T12:41:14.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.863+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~FRKU51X85VLL.0 size=1048576 2024-03-04T12:41:14.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.864+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~FRKU51X85VLL.1 size=1048576 2024-03-04T12:41:14.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.865+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~FRKU51X85VLL.2 size=660481 2024-03-04T12:41:14.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.865+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=FRKU51X85VLL tag=SSH5SFDAMQA2 type=write size=3806209 2024-03-04T12:41:14.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.866+0000 7f093583d780 1 < canceled operation key=2ZOV2JEQHXGS tag=5BC9HMQ4H8MH type=del size=2302864 2024-03-04T12:41:14.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.868+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~27TPHJN5BBJD.0 size=527425 2024-03-04T12:41:14.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.868+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=27TPHJN5BBJD tag=O80538NV8H1W type=write size=1576001 2024-03-04T12:41:14.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.869+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=Q92KJXGT7E8X type=del 2024-03-04T12:41:14.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.870+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=I67PVHH66XAM type=del size=1031069 2024-03-04T12:41:14.877 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.872+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~0UMPOEN8WC2F.0 size=1048576 2024-03-04T12:41:14.878 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.872+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~0UMPOEN8WC2F.1 size=148968 2024-03-04T12:41:14.880 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.874+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=0UMPOEN8WC2F tag=YV11OPACK7CA type=write size=2246120 2024-03-04T12:41:14.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.875+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=R92KLH446RAG type=del size=1609014 2024-03-04T12:41:14.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.877+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~GCDHGARIDYBO.0 size=1048576 2024-03-04T12:41:14.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.878+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~GCDHGARIDYBO.1 size=486167 2024-03-04T12:41:14.885 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.879+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=GCDHGARIDYBO tag=SBBDN18C1EYD type=write size=2583319 2024-03-04T12:41:14.887 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.881+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~J77H8H0I48SY.0 size=653894 2024-03-04T12:41:14.887 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.881+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=J77H8H0I48SY tag=N601O2B5GIZC type=write size=1702470 2024-03-04T12:41:14.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.882+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=PFMB3VO9ZSI0 type=del 2024-03-04T12:41:14.889 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.884+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=VU6S9PI2JX6W type=del size=4138437 2024-03-04T12:41:14.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.885+0000 7f093583d780 1 < completed write operation key=J6Y9V11BX06B tag=H9B0Y0T453F7 type=write size=174099 2024-03-04T12:41:14.891 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.886+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=EJ394WKVG9P8 type=del size=2504325 2024-03-04T12:41:14.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.887+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~ZYKJ18490XEZ.0 size=1048576 2024-03-04T12:41:14.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.888+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~ZYKJ18490XEZ.1 size=1048576 2024-03-04T12:41:14.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.888+0000 7f093583d780 1 < canceled part key=_multipart_NFM6LT89K5F4.2~ZYKJ18490XEZ.2 size=229556 2024-03-04T12:41:14.895 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.890+0000 7f093583d780 1 < canceled multipart upload key=NFM6LT89K5F4 upload=ZYKJ18490XEZ tag=OVAJ0IJ6L7ET type=write size=3375284 2024-03-04T12:41:14.898 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.892+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~MNCGDENF7V44.0 size=177105 2024-03-04T12:41:14.898 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.892+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=MNCGDENF7V44 tag=NJRDYRUNDA28 type=write size=1225681 2024-03-04T12:41:14.899 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.894+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=2NN7I7F5U9I3 type=del 2024-03-04T12:41:14.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.896+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~HIXJG71PRCIF.0 size=801795 2024-03-04T12:41:14.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.896+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=HIXJG71PRCIF tag=Q84IRYFKRZ35 type=write size=1850371 2024-03-04T12:41:14.904 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.898+0000 7f093583d780 1 < suggested update operation key=HG0EM344TJZY tag=ASV2R8RW77JK type=write size=808733 2024-03-04T12:41:14.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.899+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=1OFH8CUS3YJ8 type=write size=346984 2024-03-04T12:41:14.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.901+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~H62GY7HXIZF2.0 size=1048576 2024-03-04T12:41:14.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.903+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~H62GY7HXIZF2.1 size=813088 2024-03-04T12:41:14.910 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.905+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=H62GY7HXIZF2 tag=B0XQ14DI32BA type=write size=2910240 2024-03-04T12:41:14.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.906+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=5S5EUR8YF6V5 type=write size=60923 2024-03-04T12:41:14.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.907+0000 7f093583d780 1 < completed write operation key=96PTQ2KHPMMM tag=S4WONN02ZN5T type=write size=388849 2024-03-04T12:41:14.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.909+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=GYNA8YO0BXNL type=del size=40953 2024-03-04T12:41:14.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.910+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=Y5VLNVTW4JVR type=del 2024-03-04T12:41:14.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.911+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=71XXWQTFDE9H type=del size=638911 2024-03-04T12:41:14.919 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.913+0000 7f093583d780 1 < suggested update operation key=J6Y9V11BX06B tag=QC3L97Q4TQ6S type=del size=3497683 2024-03-04T12:41:14.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.916+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~VJSBNT30DW0M.0 size=464752 2024-03-04T12:41:14.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.916+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=VJSBNT30DW0M tag=XI4SNDHHECLW type=write size=1513328 2024-03-04T12:41:14.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.918+0000 7f093583d780 1 < suggested remove operation key=U6F7IZ07CS9Q tag=OEK2FJZU240B type=del 2024-03-04T12:41:14.924 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.919+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=8NVOL90VNSKF type=del size=3350115 2024-03-04T12:41:14.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.920+0000 7f093583d780 1 < canceled operation key=9VKN43CB955V tag=0N5IO1KQ4XZO type=del size=4139639 2024-03-04T12:41:14.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.921+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=13NUE4F1YUO0 type=del size=3686776 2024-03-04T12:41:14.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.922+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~FRKU51X85VLL.0 size=1048576 2024-03-04T12:41:14.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.923+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~FRKU51X85VLL.1 size=1048576 2024-03-04T12:41:14.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.923+0000 7f093583d780 1 < canceled part key=_multipart_Q45PKXZVJ6YS.2~FRKU51X85VLL.2 size=660481 2024-03-04T12:41:14.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.925+0000 7f093583d780 1 < canceled multipart upload key=Q45PKXZVJ6YS upload=FRKU51X85VLL tag=SSH5SFDAMQA2 type=write size=3806209 2024-03-04T12:41:14.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.926+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=ZPYUJ22YZ301 type=del size=418834 2024-03-04T12:41:14.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.927+0000 7f093583d780 1 < canceled part key=_multipart_9VKN43CB955V.2~27TPHJN5BBJD.0 size=527425 2024-03-04T12:41:14.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.929+0000 7f093583d780 1 < canceled multipart upload key=9VKN43CB955V upload=27TPHJN5BBJD tag=O80538NV8H1W type=write size=1576001 2024-03-04T12:41:14.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.930+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=J2OPEHJRMGGF type=write size=502187 2024-03-04T12:41:14.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.931+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=I67PVHH66XAM type=del 2024-03-04T12:41:14.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.932+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=XG7HGPK9A5WI type=del size=2885365 2024-03-04T12:41:14.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.933+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=R92KLH446RAG type=del 2024-03-04T12:41:14.941 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.935+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~ZCQ2ZH0JSMOP.0 size=1048576 2024-03-04T12:41:14.942 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.936+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~ZCQ2ZH0JSMOP.1 size=347895 2024-03-04T12:41:14.942 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.936+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=ZCQ2ZH0JSMOP tag=Z4OK89NJBBIV type=write size=2445047 2024-03-04T12:41:14.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.937+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~J77H8H0I48SY.0 size=653894 2024-03-04T12:41:14.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.939+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=J77H8H0I48SY tag=N601O2B5GIZC type=write size=1702470 2024-03-04T12:41:14.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.940+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=Z1VB0GIJP4SK type=del size=898538 2024-03-04T12:41:14.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.942+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=VU6S9PI2JX6W type=del 2024-03-04T12:41:14.948 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.943+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=LMNC1HVINQ73 type=del size=4171560 2024-03-04T12:41:14.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.945+0000 7f093583d780 1 < suggested remove operation key=GJ0FQ6EH9HJL tag=EJ394WKVG9P8 type=del 2024-03-04T12:41:14.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.946+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=R8F63EBA2K4B type=write size=727987 2024-03-04T12:41:14.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.947+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~MNCGDENF7V44.0 size=177105 2024-03-04T12:41:14.955 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.949+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=MNCGDENF7V44 tag=NJRDYRUNDA28 type=write size=1225681 2024-03-04T12:41:14.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.950+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=VVGPK0OMSI0Y type=del size=2606171 2024-03-04T12:41:14.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.952+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~HIXJG71PRCIF.0 size=801795 2024-03-04T12:41:14.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.953+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=HIXJG71PRCIF tag=Q84IRYFKRZ35 type=write size=1850371 2024-03-04T12:41:14.961 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.955+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=RVEPM2IM92AW type=del size=80694 2024-03-04T12:41:14.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.956+0000 7f093583d780 1 < completed write operation key=PT63VLFQQN0E tag=1OFH8CUS3YJ8 type=write size=346984 2024-03-04T12:41:14.964 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.958+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~YLL8SQV8TEJA.0 size=911918 2024-03-04T12:41:14.964 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.958+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=YLL8SQV8TEJA tag=BSGWUFE1ILI3 type=write size=1960494 2024-03-04T12:41:14.965 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.960+0000 7f093583d780 1 < completed write operation key=2YD2M0JQNCC0 tag=5S5EUR8YF6V5 type=write size=60923 2024-03-04T12:41:14.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.961+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=ZSC46GMFIO1K type=del size=2277175 2024-03-04T12:41:14.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.962+0000 7f093583d780 1 < canceled operation key=I6DIP4VGHMNO tag=GYNA8YO0BXNL type=del size=40953 2024-03-04T12:41:14.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.963+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=QD6E6OYUMTOZ type=del size=2186087 2024-03-04T12:41:14.970 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.964+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=71XXWQTFDE9H type=del 2024-03-04T12:41:14.971 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.965+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=FTFNYJ8KFH20 type=del size=1448564 2024-03-04T12:41:14.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.966+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~VJSBNT30DW0M.0 size=464752 2024-03-04T12:41:14.973 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.968+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=VJSBNT30DW0M tag=XI4SNDHHECLW type=write size=1513328 2024-03-04T12:41:14.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.969+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=CE2SROKYIM4G type=del size=503499 2024-03-04T12:41:14.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.970+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=8NVOL90VNSKF type=del 2024-03-04T12:41:14.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.971+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=8222W9FF8X7S type=del size=2551644 2024-03-04T12:41:14.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.972+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=13NUE4F1YUO0 type=del 2024-03-04T12:41:14.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.974+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=VDNK5NCAG4SW type=del size=1589441 2024-03-04T12:41:14.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.975+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=ZPYUJ22YZ301 type=del 2024-03-04T12:41:14.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.977+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~1ATJ3AI9Z6B3.0 size=106681 2024-03-04T12:41:14.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.977+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=1ATJ3AI9Z6B3 tag=2QGKIS89KFU2 type=write size=1155257 2024-03-04T12:41:14.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.979+0000 7f093583d780 1 < suggested update operation key=I5NQBROT0WKE tag=J2OPEHJRMGGF type=write size=502187 2024-03-04T12:41:14.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.980+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=LQO7FTI6QY21 type=write size=987360 2024-03-04T12:41:14.987 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.981+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=XG7HGPK9A5WI type=del 2024-03-04T12:41:14.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.982+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=H2D3XR11HVM2 type=del size=2553778 2024-03-04T12:41:14.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.984+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~ZCQ2ZH0JSMOP.0 size=1048576 2024-03-04T12:41:14.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.985+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~ZCQ2ZH0JSMOP.1 size=347895 2024-03-04T12:41:14.992 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.987+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=ZCQ2ZH0JSMOP tag=Z4OK89NJBBIV type=write size=2445047 2024-03-04T12:41:14.993 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.988+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=YDCBWYSAEA0N type=del size=1927914 2024-03-04T12:41:14.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.990+0000 7f093583d780 1 < suggested remove operation key=3F8GI0JCUR6W tag=Z1VB0GIJP4SK type=del 2024-03-04T12:41:14.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.992+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~NCB9QL6VU4C1.0 size=1048576 2024-03-04T12:41:14.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.993+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~NCB9QL6VU4C1.1 size=1048576 2024-03-04T12:41:14.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.994+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~NCB9QL6VU4C1.2 size=811845 2024-03-04T12:41:15.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.994+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=NCB9QL6VU4C1 tag=YT5VV882IP7M type=write size=3957573 2024-03-04T12:41:15.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.995+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=LMNC1HVINQ73 type=del 2024-03-04T12:41:15.003 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.997+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~W5RS7QBOMPTL.0 size=1048576 2024-03-04T12:41:15.004 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.998+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~W5RS7QBOMPTL.1 size=745627 2024-03-04T12:41:15.004 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.998+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=W5RS7QBOMPTL tag=BKZHYN0G3FSH type=write size=2842779 2024-03-04T12:41:15.005 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:14.999+0000 7f093583d780 1 < canceled operation key=UAEQORB3BDBH tag=R8F63EBA2K4B type=write size=727987 2024-03-04T12:41:15.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.000+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=50LT9CPH3GB2 type=del size=1041492 2024-03-04T12:41:15.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.001+0000 7f093583d780 -1 < no bi entry to suggest for operation key=3F8GI0JCUR6W tag=VVGPK0OMSI0Y type=del size=2606171: (2) No such file or directory 2024-03-04T12:41:15.009 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.003+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~TSDCW3IY7JY2.0 size=656875 2024-03-04T12:41:15.009 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.003+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=TSDCW3IY7JY2 tag=Z5PVU4AHT71G type=write size=1705451 2024-03-04T12:41:15.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.004+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=RVEPM2IM92AW type=del 2024-03-04T12:41:15.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.006+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~XPAYOIVV0BQ6.0 size=604041 2024-03-04T12:41:15.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.006+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=XPAYOIVV0BQ6 tag=9UQ31EPNDAE4 type=write size=1652617 2024-03-04T12:41:15.013 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.007+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~YLL8SQV8TEJA.0 size=911918 2024-03-04T12:41:15.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.009+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=YLL8SQV8TEJA tag=BSGWUFE1ILI3 type=write size=1960494 2024-03-04T12:41:15.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.010+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=HF4NA2SRDGMJ type=del size=3930593 2024-03-04T12:41:15.017 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.012+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=ZSC46GMFIO1K type=del 2024-03-04T12:41:15.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.014+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=2GNP43HCFJRH type=del size=2373259 2024-03-04T12:41:15.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.015+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=QD6E6OYUMTOZ type=del 2024-03-04T12:41:15.023 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.017+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~DKUJHM7I4VUS.0 size=981025 2024-03-04T12:41:15.023 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.017+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=DKUJHM7I4VUS tag=GK5B50H6RHDO type=write size=2029601 2024-03-04T12:41:15.024 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.018+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=FTFNYJ8KFH20 type=del 2024-03-04T12:41:15.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.021+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~MSWKV1M7I2BY.0 size=971754 2024-03-04T12:41:15.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.021+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=MSWKV1M7I2BY tag=YZDYWGW3EI93 type=write size=2020330 2024-03-04T12:41:15.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.022+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=CE2SROKYIM4G type=del 2024-03-04T12:41:15.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.024+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~288D0YOEPYEF.0 size=1048576 2024-03-04T12:41:15.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.025+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~288D0YOEPYEF.1 size=898036 2024-03-04T12:41:15.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.025+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=288D0YOEPYEF tag=LVLR5I420J2C type=write size=2995188 2024-03-04T12:41:15.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.026+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=8222W9FF8X7S type=del 2024-03-04T12:41:15.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.028+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~5X0Y38Q0LLGJ.0 size=1048576 2024-03-04T12:41:15.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.029+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~5X0Y38Q0LLGJ.1 size=1048576 2024-03-04T12:41:15.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.030+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~5X0Y38Q0LLGJ.2 size=551813 2024-03-04T12:41:15.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.030+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=5X0Y38Q0LLGJ tag=QDJCESA3QPFQ type=write size=3697541 2024-03-04T12:41:15.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.031+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=VDNK5NCAG4SW type=del 2024-03-04T12:41:15.040 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.034+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~SASDE8RCA2CP.0 size=1048576 2024-03-04T12:41:15.040 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.035+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~SASDE8RCA2CP.1 size=440870 2024-03-04T12:41:15.041 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.035+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=SASDE8RCA2CP tag=YMK2OXINDHBY type=write size=2538022 2024-03-04T12:41:15.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.036+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~1ATJ3AI9Z6B3.0 size=106681 2024-03-04T12:41:15.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.038+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=1ATJ3AI9Z6B3 tag=2QGKIS89KFU2 type=write size=1155257 2024-03-04T12:41:15.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.039+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=SYW3OH4A2LRA type=del size=1823649 2024-03-04T12:41:15.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.041+0000 7f093583d780 1 < suggested remove operation key=Q45PKXZVJ6YS tag=LQO7FTI6QY21 type=write 2024-03-04T12:41:15.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.043+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~QE4MO24Y9IT3.0 size=1048576 2024-03-04T12:41:15.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.044+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~QE4MO24Y9IT3.1 size=1048576 2024-03-04T12:41:15.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.045+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~QE4MO24Y9IT3.2 size=822210 2024-03-04T12:41:15.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.045+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=QE4MO24Y9IT3 tag=HRG06NWXDS8X type=write size=3967938 2024-03-04T12:41:15.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.046+0000 7f093583d780 1 < completed delete operation key=O6OUISHWZ7FU tag=H2D3XR11HVM2 type=del 2024-03-04T12:41:15.054 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.048+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~M3IF8CNIJSO5.0 size=257275 2024-03-04T12:41:15.054 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.048+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=M3IF8CNIJSO5 tag=UMQTHOWAIYR1 type=write size=1305851 2024-03-04T12:41:15.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.049+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=YDCBWYSAEA0N type=del 2024-03-04T12:41:15.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.051+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=3JB94Z4E2D1V type=del size=4088087 2024-03-04T12:41:15.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.052+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~NCB9QL6VU4C1.0 size=1048576 2024-03-04T12:41:15.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.053+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~NCB9QL6VU4C1.1 size=1048576 2024-03-04T12:41:15.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.054+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~NCB9QL6VU4C1.2 size=811845 2024-03-04T12:41:15.062 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.056+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=NCB9QL6VU4C1 tag=YT5VV882IP7M type=write size=3957573 2024-03-04T12:41:15.064 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.058+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~MPA2JK0C178H.0 size=401998 2024-03-04T12:41:15.064 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.058+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=MPA2JK0C178H tag=37EK0JWOX7QE type=write size=1450574 2024-03-04T12:41:15.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.060+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~W5RS7QBOMPTL.0 size=1048576 2024-03-04T12:41:15.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.060+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~W5RS7QBOMPTL.1 size=745627 2024-03-04T12:41:15.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.062+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=W5RS7QBOMPTL tag=BKZHYN0G3FSH type=write size=2842779 2024-03-04T12:41:15.069 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.064+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=FVBIVLA0WMC6 type=del size=2078456 2024-03-04T12:41:15.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.065+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=50LT9CPH3GB2 type=del 2024-03-04T12:41:15.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.067+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~T4QTETGDOOI2.0 size=1048576 2024-03-04T12:41:15.073 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.068+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~T4QTETGDOOI2.1 size=401545 2024-03-04T12:41:15.073 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.068+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=T4QTETGDOOI2 tag=B6LYCVV20PY7 type=write size=2498697 2024-03-04T12:41:15.074 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.069+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~TSDCW3IY7JY2.0 size=656875 2024-03-04T12:41:15.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.071+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=TSDCW3IY7JY2 tag=Z5PVU4AHT71G type=write size=1705451 2024-03-04T12:41:15.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.072+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=O3KLQPUI2MYU type=del size=4179219 2024-03-04T12:41:15.079 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.073+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~XPAYOIVV0BQ6.0 size=604041 2024-03-04T12:41:15.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.075+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=XPAYOIVV0BQ6 tag=9UQ31EPNDAE4 type=write size=1652617 2024-03-04T12:41:15.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.076+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=D1BD4E68BY6O type=del size=2966722 2024-03-04T12:41:15.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.077+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=HF4NA2SRDGMJ type=del 2024-03-04T12:41:15.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.078+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=KIFIBWN3H9YM type=del size=3789335 2024-03-04T12:41:15.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.079+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=2GNP43HCFJRH type=del 2024-03-04T12:41:15.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.081+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=ICL62T23Z2G7 type=del size=2410364 2024-03-04T12:41:15.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.082+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~DKUJHM7I4VUS.0 size=981025 2024-03-04T12:41:15.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.083+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=DKUJHM7I4VUS tag=GK5B50H6RHDO type=write size=2029601 2024-03-04T12:41:15.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.085+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=DG7ECN3YVMDO type=write size=766404 2024-03-04T12:41:15.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.085+0000 7f093583d780 1 < canceled part key=_multipart_2YD2M0JQNCC0.2~MSWKV1M7I2BY.0 size=971754 2024-03-04T12:41:15.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.086+0000 7f093583d780 1 < canceled multipart upload key=2YD2M0JQNCC0 upload=MSWKV1M7I2BY tag=YZDYWGW3EI93 type=write size=2020330 2024-03-04T12:41:15.093 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.088+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=0F4W0GVMA5JT type=del size=1736299 2024-03-04T12:41:15.094 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.089+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~288D0YOEPYEF.0 size=1048576 2024-03-04T12:41:15.095 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.090+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~288D0YOEPYEF.1 size=898036 2024-03-04T12:41:15.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.091+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=288D0YOEPYEF tag=LVLR5I420J2C type=write size=2995188 2024-03-04T12:41:15.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.093+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~FTZQ30CG7PS6.0 size=1048576 2024-03-04T12:41:15.106 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.101+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~FTZQ30CG7PS6.1 size=347247 2024-03-04T12:41:15.106 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.101+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=FTZQ30CG7PS6 tag=JCZFRQQKYI19 type=write size=2444399 2024-03-04T12:41:15.107 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.102+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~5X0Y38Q0LLGJ.0 size=1048576 2024-03-04T12:41:15.109 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.103+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~5X0Y38Q0LLGJ.1 size=1048576 2024-03-04T12:41:15.109 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.104+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~5X0Y38Q0LLGJ.2 size=551813 2024-03-04T12:41:15.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.106+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=5X0Y38Q0LLGJ tag=QDJCESA3QPFQ type=write size=3697541 2024-03-04T12:41:15.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.108+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~YGFEG8EGZZ26.0 size=191156 2024-03-04T12:41:15.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.108+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=YGFEG8EGZZ26 tag=FGW9KII9Z5MU type=write size=1239732 2024-03-04T12:41:15.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.108+0000 7f093583d780 1 < canceled part key=_multipart_F269PJEZ05IO.2~SASDE8RCA2CP.0 size=1048576 2024-03-04T12:41:15.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.109+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~SASDE8RCA2CP.1 size=440870 2024-03-04T12:41:15.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.111+0000 7f093583d780 1 < canceled multipart upload key=F269PJEZ05IO upload=SASDE8RCA2CP tag=YMK2OXINDHBY type=write size=2538022 2024-03-04T12:41:15.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.112+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=1DD8VU2MSJ1K type=del size=3002311 2024-03-04T12:41:15.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.113+0000 7f093583d780 1 < canceled operation key=2ZOV2JEQHXGS tag=SYW3OH4A2LRA type=del size=1823649 2024-03-04T12:41:15.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.115+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~DNWW7XRZOU7V.0 size=993942 2024-03-04T12:41:15.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.115+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=DNWW7XRZOU7V tag=BZB3TEMTKKHL type=write size=2042518 2024-03-04T12:41:15.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.117+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~QE4MO24Y9IT3.0 size=1048576 2024-03-04T12:41:15.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.118+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~QE4MO24Y9IT3.1 size=1048576 2024-03-04T12:41:15.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.119+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~QE4MO24Y9IT3.2 size=822210 2024-03-04T12:41:15.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.121+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=QE4MO24Y9IT3 tag=HRG06NWXDS8X type=write size=3967938 2024-03-04T12:41:15.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.122+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=ZR1NSK1E1S03 type=del size=2522382 2024-03-04T12:41:15.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.123+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~M3IF8CNIJSO5.0 size=257275 2024-03-04T12:41:15.131 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.125+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=M3IF8CNIJSO5 tag=UMQTHOWAIYR1 type=write size=1305851 2024-03-04T12:41:15.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.127+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=HDQQFD54ND4N type=del size=352504 2024-03-04T12:41:15.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.128+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=3JB94Z4E2D1V type=del 2024-03-04T12:41:15.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.129+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=5SWHNBABQO9W type=del size=2363302 2024-03-04T12:41:15.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.130+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~MPA2JK0C178H.0 size=401998 2024-03-04T12:41:15.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.132+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=MPA2JK0C178H tag=37EK0JWOX7QE type=write size=1450574 2024-03-04T12:41:15.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.134+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~T1KHI63C7OWO.0 size=1048576 2024-03-04T12:41:15.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.135+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~T1KHI63C7OWO.1 size=1048576 2024-03-04T12:41:15.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.136+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~T1KHI63C7OWO.2 size=974994 2024-03-04T12:41:15.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.136+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=T1KHI63C7OWO tag=YRR6IZUDB9K5 type=write size=4120722 2024-03-04T12:41:15.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.137+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=FVBIVLA0WMC6 type=del 2024-03-04T12:41:15.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.139+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~QO2N4GGWZJXR.0 size=1048576 2024-03-04T12:41:15.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.140+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~QO2N4GGWZJXR.1 size=1048576 2024-03-04T12:41:15.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.140+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~QO2N4GGWZJXR.2 size=359863 2024-03-04T12:41:15.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.140+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=QO2N4GGWZJXR tag=0R7U08DBJ5CC type=write size=3505591 2024-03-04T12:41:15.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.142+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~T4QTETGDOOI2.0 size=1048576 2024-03-04T12:41:15.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.142+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~T4QTETGDOOI2.1 size=401545 2024-03-04T12:41:15.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.144+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=T4QTETGDOOI2 tag=B6LYCVV20PY7 type=write size=2498697 2024-03-04T12:41:15.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.146+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~CXLN85NW7620.0 size=1048576 2024-03-04T12:41:15.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.147+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~CXLN85NW7620.1 size=1048576 2024-03-04T12:41:15.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.148+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~CXLN85NW7620.2 size=912611 2024-03-04T12:41:15.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.148+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=CXLN85NW7620 tag=REOFAR2B6GVB type=write size=4058339 2024-03-04T12:41:15.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.149+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=O3KLQPUI2MYU type=del 2024-03-04T12:41:15.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.150+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=UUKM39Z2ELN8 type=del size=2452753 2024-03-04T12:41:15.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.152+0000 7f093583d780 1 < suggested remove operation key=NQF43I07F2HT tag=D1BD4E68BY6O type=del 2024-03-04T12:41:15.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.153+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=MAFXROF7F2TI type=del size=1535444 2024-03-04T12:41:15.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.154+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=KIFIBWN3H9YM type=del 2024-03-04T12:41:15.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.155+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=UQS9V3AMQCNK type=del size=3790207 2024-03-04T12:41:15.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.157+0000 7f093583d780 1 < canceled operation key=2XVNK3YEVHJ7 tag=ICL62T23Z2G7 type=del size=2410364 2024-03-04T12:41:15.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.158+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=41WFV1NC9H30 type=del size=3088305 2024-03-04T12:41:15.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.159+0000 7f093583d780 1 < completed write operation key=I6DIP4VGHMNO tag=DG7ECN3YVMDO type=write size=766404 2024-03-04T12:41:15.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.160+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=U9C32GMQU35L type=write size=68853 2024-03-04T12:41:15.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.161+0000 7f093583d780 1 < completed delete operation key=AQI7H63EQSTN tag=0F4W0GVMA5JT type=del 2024-03-04T12:41:15.168 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.162+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=I7JWAQD2DXO3 type=del size=851613 2024-03-04T12:41:15.168 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.163+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~FTZQ30CG7PS6.0 size=1048576 2024-03-04T12:41:15.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.164+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~FTZQ30CG7PS6.1 size=347247 2024-03-04T12:41:15.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.166+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=FTZQ30CG7PS6 tag=JCZFRQQKYI19 type=write size=2444399 2024-03-04T12:41:15.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.168+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~GPV2FSUOKU2G.0 size=1048576 2024-03-04T12:41:15.174 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.169+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~GPV2FSUOKU2G.1 size=149271 2024-03-04T12:41:15.174 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.169+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=GPV2FSUOKU2G tag=YCH9Q1DC5DB1 type=write size=2246423 2024-03-04T12:41:15.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.169+0000 7f093583d780 1 < canceled part key=_multipart_GJ0FQ6EH9HJL.2~YGFEG8EGZZ26.0 size=191156 2024-03-04T12:41:15.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.171+0000 7f093583d780 1 < canceled multipart upload key=GJ0FQ6EH9HJL upload=YGFEG8EGZZ26 tag=FGW9KII9Z5MU type=write size=1239732 2024-03-04T12:41:15.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.173+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~0I7ZQZNVG1HH.0 size=1048576 2024-03-04T12:41:15.179 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.174+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~0I7ZQZNVG1HH.1 size=1048576 2024-03-04T12:41:15.180 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.175+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~0I7ZQZNVG1HH.2 size=993721 2024-03-04T12:41:15.180 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.175+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=0I7ZQZNVG1HH tag=RAKNK4MBBHFC type=write size=4139449 2024-03-04T12:41:15.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.176+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=1DD8VU2MSJ1K type=del 2024-03-04T12:41:15.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.179+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~V8G9V3FYDUQG.0 size=1048576 2024-03-04T12:41:15.185 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.179+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~V8G9V3FYDUQG.1 size=1048576 2024-03-04T12:41:15.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.180+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~V8G9V3FYDUQG.2 size=492435 2024-03-04T12:41:15.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.180+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=V8G9V3FYDUQG tag=L6G3P8QJURCS type=write size=3638163 2024-03-04T12:41:15.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.181+0000 7f093583d780 1 < canceled part key=_multipart_TMAI6MOG2C4N.2~DNWW7XRZOU7V.0 size=993942 2024-03-04T12:41:15.188 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.182+0000 7f093583d780 1 < canceled multipart upload key=TMAI6MOG2C4N upload=DNWW7XRZOU7V tag=BZB3TEMTKKHL type=write size=2042518 2024-03-04T12:41:15.190 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.185+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~BTZESE390DW6.0 size=530465 2024-03-04T12:41:15.190 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.185+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=BTZESE390DW6 tag=G1EHUVDDS1GU type=write size=1579041 2024-03-04T12:41:15.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.186+0000 7f093583d780 1 < canceled operation key=54FLC10FWKL6 tag=ZR1NSK1E1S03 type=del size=2522382 2024-03-04T12:41:15.193 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.188+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~3TRJIFZ9NK7C.0 size=24048 2024-03-04T12:41:15.193 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.188+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=3TRJIFZ9NK7C tag=7N41BG600NID type=write size=1072624 2024-03-04T12:41:15.195 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.189+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=HDQQFD54ND4N type=del 2024-03-04T12:41:15.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.191+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~3KYEHA07JYIC.0 size=1048576 2024-03-04T12:41:15.198 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.192+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~3KYEHA07JYIC.1 size=1048576 2024-03-04T12:41:15.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.193+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~3KYEHA07JYIC.2 size=198183 2024-03-04T12:41:15.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.193+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=3KYEHA07JYIC tag=8ZCODPNMB55R type=write size=3343911 2024-03-04T12:41:15.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.195+0000 7f093583d780 1 < suggested remove operation key=OFTWI7UFD5L5 tag=5SWHNBABQO9W type=del 2024-03-04T12:41:15.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.196+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=WYOFTYUX230P type=del size=3455409 2024-03-04T12:41:15.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.198+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~T1KHI63C7OWO.0 size=1048576 2024-03-04T12:41:15.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.198+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~T1KHI63C7OWO.1 size=1048576 2024-03-04T12:41:15.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.199+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~T1KHI63C7OWO.2 size=974994 2024-03-04T12:41:15.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.201+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=T1KHI63C7OWO tag=YRR6IZUDB9K5 type=write size=4120722 2024-03-04T12:41:15.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.202+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=OFYMRYPSSVAZ type=del size=3497327 2024-03-04T12:41:15.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.203+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~QO2N4GGWZJXR.0 size=1048576 2024-03-04T12:41:15.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.204+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~QO2N4GGWZJXR.1 size=1048576 2024-03-04T12:41:15.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.204+0000 7f093583d780 1 < canceled part key=_multipart_TMAI6MOG2C4N.2~QO2N4GGWZJXR.2 size=359863 2024-03-04T12:41:15.212 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.206+0000 7f093583d780 1 < canceled multipart upload key=TMAI6MOG2C4N upload=QO2N4GGWZJXR tag=0R7U08DBJ5CC type=write size=3505591 2024-03-04T12:41:15.213 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.207+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=PVGPWD5BULTV type=del size=201549 2024-03-04T12:41:15.213 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.207+0000 7f093583d780 1 < canceled part key=_multipart_NQF43I07F2HT.2~CXLN85NW7620.0 size=1048576 2024-03-04T12:41:15.214 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.208+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~CXLN85NW7620.1 size=1048576 2024-03-04T12:41:15.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.209+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~CXLN85NW7620.2 size=912611 2024-03-04T12:41:15.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.211+0000 7f093583d780 1 < canceled multipart upload key=NQF43I07F2HT upload=CXLN85NW7620 tag=REOFAR2B6GVB type=write size=4058339 2024-03-04T12:41:15.218 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.213+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~DIL2I79R7ZG3.0 size=623232 2024-03-04T12:41:15.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.213+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=DIL2I79R7ZG3 tag=S434QOJFSLWA type=write size=1671808 2024-03-04T12:41:15.220 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.214+0000 7f093583d780 1 < canceled operation key=2ZOV2JEQHXGS tag=UUKM39Z2ELN8 type=del size=2452753 2024-03-04T12:41:15.222 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.216+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~ZJFO8H786LP5.0 size=445962 2024-03-04T12:41:15.222 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.216+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=ZJFO8H786LP5 tag=KFN1CNBLPA7L type=write size=1494538 2024-03-04T12:41:15.223 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.218+0000 7f093583d780 1 < canceled operation key=NQF43I07F2HT tag=MAFXROF7F2TI type=del size=1535444 2024-03-04T12:41:15.225 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.220+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~VL2QMOBQSPXC.0 size=1048576 2024-03-04T12:41:15.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.221+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~VL2QMOBQSPXC.1 size=1048576 2024-03-04T12:41:15.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.222+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~VL2QMOBQSPXC.2 size=610934 2024-03-04T12:41:15.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.222+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=VL2QMOBQSPXC tag=BGL6A8JYXS5O type=write size=3756662 2024-03-04T12:41:15.228 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.223+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=UQS9V3AMQCNK type=del 2024-03-04T12:41:15.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.224+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=AL2MP8VNZWMZ type=del size=672836 2024-03-04T12:41:15.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.225+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=41WFV1NC9H30 type=del 2024-03-04T12:41:15.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.227+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~WFSCIS1OV1LH.0 size=1048576 2024-03-04T12:41:15.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.228+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~WFSCIS1OV1LH.1 size=467851 2024-03-04T12:41:15.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.228+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=WFSCIS1OV1LH tag=DD34GSOEAYWD type=write size=2565003 2024-03-04T12:41:15.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.232+0000 7f093583d780 1 < suggested update operation key=OFTWI7UFD5L5 tag=U9C32GMQU35L type=write size=68853 2024-03-04T12:41:15.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.233+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=9WLR5MF5JG5S type=del size=631129 2024-03-04T12:41:15.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.234+0000 7f093583d780 1 < canceled operation key=OCOQJLUUNWRG tag=I7JWAQD2DXO3 type=del size=851613 2024-03-04T12:41:15.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.236+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~FPIN86KLGDGT.0 size=1048576 2024-03-04T12:41:15.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.237+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~FPIN86KLGDGT.1 size=1048576 2024-03-04T12:41:15.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.238+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~FPIN86KLGDGT.2 size=288803 2024-03-04T12:41:15.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.238+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=FPIN86KLGDGT tag=FJ6PRPHWOX63 type=write size=3434531 2024-03-04T12:41:15.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.239+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~GPV2FSUOKU2G.0 size=1048576 2024-03-04T12:41:15.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.240+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~GPV2FSUOKU2G.1 size=149271 2024-03-04T12:41:15.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.242+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=GPV2FSUOKU2G tag=YCH9Q1DC5DB1 type=write size=2246423 2024-03-04T12:41:15.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.243+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=9YXCEZC3JGJ0 type=del size=1992200 2024-03-04T12:41:15.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.244+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~0I7ZQZNVG1HH.0 size=1048576 2024-03-04T12:41:15.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.245+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~0I7ZQZNVG1HH.1 size=1048576 2024-03-04T12:41:15.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.245+0000 7f093583d780 1 < canceled part key=_multipart_I5NQBROT0WKE.2~0I7ZQZNVG1HH.2 size=993721 2024-03-04T12:41:15.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.247+0000 7f093583d780 1 < canceled multipart upload key=I5NQBROT0WKE upload=0I7ZQZNVG1HH tag=RAKNK4MBBHFC type=write size=4139449 2024-03-04T12:41:15.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.248+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=DZDVT83JGAE2 type=del size=2569249 2024-03-04T12:41:15.255 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.249+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~V8G9V3FYDUQG.0 size=1048576 2024-03-04T12:41:15.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.250+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~V8G9V3FYDUQG.1 size=1048576 2024-03-04T12:41:15.257 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.251+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~V8G9V3FYDUQG.2 size=492435 2024-03-04T12:41:15.259 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.253+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=V8G9V3FYDUQG tag=L6G3P8QJURCS type=write size=3638163 2024-03-04T12:41:15.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.255+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=ARLDAD7BT32A type=del size=273549 2024-03-04T12:41:15.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.256+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~BTZESE390DW6.0 size=530465 2024-03-04T12:41:15.264 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.258+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=BTZESE390DW6 tag=G1EHUVDDS1GU type=write size=1579041 2024-03-04T12:41:15.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.260+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~CBAU11UEKRQC.0 size=1048576 2024-03-04T12:41:15.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.261+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~CBAU11UEKRQC.1 size=685045 2024-03-04T12:41:15.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.261+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=CBAU11UEKRQC tag=SEL0HVSOO1MV type=write size=2782197 2024-03-04T12:41:15.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.262+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~3TRJIFZ9NK7C.0 size=24048 2024-03-04T12:41:15.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.264+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=3TRJIFZ9NK7C tag=7N41BG600NID type=write size=1072624 2024-03-04T12:41:15.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.265+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=MYQULH0XOS3S type=del size=3412789 2024-03-04T12:41:15.272 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.267+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~3KYEHA07JYIC.0 size=1048576 2024-03-04T12:41:15.272 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.267+0000 7f093583d780 1 < canceled part key=_multipart_TMAI6MOG2C4N.2~3KYEHA07JYIC.1 size=1048576 2024-03-04T12:41:15.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.268+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~3KYEHA07JYIC.2 size=198183 2024-03-04T12:41:15.275 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.270+0000 7f093583d780 1 < canceled multipart upload key=TMAI6MOG2C4N upload=3KYEHA07JYIC tag=8ZCODPNMB55R type=write size=3343911 2024-03-04T12:41:15.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.271+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=U0A1FJOD70YP type=write size=864500 2024-03-04T12:41:15.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.272+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=WYOFTYUX230P type=del 2024-03-04T12:41:15.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.273+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=G7GODBDMPAR4 type=del size=399625 2024-03-04T12:41:15.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.276+0000 7f093583d780 1 < suggested remove operation key=2XVNK3YEVHJ7 tag=OFYMRYPSSVAZ type=del 2024-03-04T12:41:15.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.278+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~NWSADW77QSB2.0 size=1048576 2024-03-04T12:41:15.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.279+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~NWSADW77QSB2.1 size=927216 2024-03-04T12:41:15.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.279+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=NWSADW77QSB2 tag=8Y2H8ALZ07CE type=write size=3024368 2024-03-04T12:41:15.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.281+0000 7f093583d780 1 < suggested remove operation key=OFTWI7UFD5L5 tag=PVGPWD5BULTV type=del 2024-03-04T12:41:15.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.282+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=N4Y94QO0OE1X type=del size=740291 2024-03-04T12:41:15.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.283+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~DIL2I79R7ZG3.0 size=623232 2024-03-04T12:41:15.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.285+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=DIL2I79R7ZG3 tag=S434QOJFSLWA type=write size=1671808 2024-03-04T12:41:15.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.286+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=CYN2Q6WC927R type=del size=1681756 2024-03-04T12:41:15.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.287+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~ZJFO8H786LP5.0 size=445962 2024-03-04T12:41:15.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.289+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=ZJFO8H786LP5 tag=KFN1CNBLPA7L type=write size=1494538 2024-03-04T12:41:15.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.291+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~7OC77FYRA975.0 size=1048576 2024-03-04T12:41:15.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.292+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~7OC77FYRA975.1 size=277417 2024-03-04T12:41:15.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.292+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=7OC77FYRA975 tag=WC0L8BXNR4PZ type=write size=2374569 2024-03-04T12:41:15.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.293+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~VL2QMOBQSPXC.0 size=1048576 2024-03-04T12:41:15.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.294+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~VL2QMOBQSPXC.1 size=1048576 2024-03-04T12:41:15.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.295+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~VL2QMOBQSPXC.2 size=610934 2024-03-04T12:41:15.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.297+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=VL2QMOBQSPXC tag=BGL6A8JYXS5O type=write size=3756662 2024-03-04T12:41:15.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.298+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=U7Z95NKGFJQM type=write size=472513 2024-03-04T12:41:15.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.299+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=AL2MP8VNZWMZ type=del 2024-03-04T12:41:15.306 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.300+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=3JLZJ1D5QMYV type=del size=2518854 2024-03-04T12:41:15.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.301+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~WFSCIS1OV1LH.0 size=1048576 2024-03-04T12:41:15.308 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.302+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~WFSCIS1OV1LH.1 size=467851 2024-03-04T12:41:15.310 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.304+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=WFSCIS1OV1LH tag=DD34GSOEAYWD type=write size=2565003 2024-03-04T12:41:15.311 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.305+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=B4GPBOP0WY8Y type=del size=2326013 2024-03-04T12:41:15.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.306+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=9WLR5MF5JG5S type=del 2024-03-04T12:41:15.313 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.308+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~037ZBRT1BXAU.0 size=1048576 2024-03-04T12:41:15.314 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.309+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~037ZBRT1BXAU.1 size=1048576 2024-03-04T12:41:15.315 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.310+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~037ZBRT1BXAU.2 size=972910 2024-03-04T12:41:15.315 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.310+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=037ZBRT1BXAU tag=24ZKMIMN72M2 type=write size=4118638 2024-03-04T12:41:15.316 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.311+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~FPIN86KLGDGT.0 size=1048576 2024-03-04T12:41:15.316 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.311+0000 7f093583d780 1 < canceled part key=_multipart_GMKM2QEP072H.2~FPIN86KLGDGT.1 size=1048576 2024-03-04T12:41:15.317 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.312+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~FPIN86KLGDGT.2 size=288803 2024-03-04T12:41:15.319 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.313+0000 7f093583d780 1 < canceled multipart upload key=GMKM2QEP072H upload=FPIN86KLGDGT tag=FJ6PRPHWOX63 type=write size=3434531 2024-03-04T12:41:15.320 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.315+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=WFRSAN8LHT74 type=write size=18866 2024-03-04T12:41:15.321 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.316+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=9YXCEZC3JGJ0 type=del 2024-03-04T12:41:15.323 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.318+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~V9THONPUUKGB.0 size=195176 2024-03-04T12:41:15.323 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.318+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=V9THONPUUKGB tag=Z4DKTMJU2VDC type=write size=1243752 2024-03-04T12:41:15.326 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.320+0000 7f093583d780 1 < suggested update operation key=NFM6LT89K5F4 tag=DZDVT83JGAE2 type=del size=2569249 2024-03-04T12:41:15.328 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.323+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~W7HU4967N095.0 size=1048576 2024-03-04T12:41:15.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.324+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~W7HU4967N095.1 size=491143 2024-03-04T12:41:15.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.324+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=W7HU4967N095 tag=JBAQ1T6RMMQT type=write size=2588295 2024-03-04T12:41:15.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.325+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=ARLDAD7BT32A type=del 2024-03-04T12:41:15.332 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.326+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=8GK7DK3D65BM type=del size=1982940 2024-03-04T12:41:15.333 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.327+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~CBAU11UEKRQC.0 size=1048576 2024-03-04T12:41:15.334 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.328+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~CBAU11UEKRQC.1 size=685045 2024-03-04T12:41:15.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.330+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=CBAU11UEKRQC tag=SEL0HVSOO1MV type=write size=2782197 2024-03-04T12:41:15.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.332+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=XMKEYPRIBSXC type=write size=730668 2024-03-04T12:41:15.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.334+0000 7f093583d780 1 < suggested update operation key=3F8GI0JCUR6W tag=MYQULH0XOS3S type=del size=3412789 2024-03-04T12:41:15.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.335+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=N8XZNV0LDB03 type=del size=1805682 2024-03-04T12:41:15.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.337+0000 7f093583d780 1 < completed write operation key=GMKM2QEP072H tag=U0A1FJOD70YP type=write size=864500 2024-03-04T12:41:15.347 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.341+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~VS07K1Q6WHU0.0 size=502606 2024-03-04T12:41:15.347 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.341+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=VS07K1Q6WHU0 tag=OFCWPV211WA7 type=write size=1551182 2024-03-04T12:41:15.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.342+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=G7GODBDMPAR4 type=del 2024-03-04T12:41:15.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.344+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=E6CT8YAQN1PB type=del size=3091959 2024-03-04T12:41:15.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.345+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~NWSADW77QSB2.0 size=1048576 2024-03-04T12:41:15.351 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.346+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~NWSADW77QSB2.1 size=927216 2024-03-04T12:41:15.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.347+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=NWSADW77QSB2 tag=8Y2H8ALZ07CE type=write size=3024368 2024-03-04T12:41:15.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.349+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~W7F3IILZLVFL.0 size=77394 2024-03-04T12:41:15.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.349+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=W7F3IILZLVFL tag=TXUJCYNF5R8L type=write size=1125970 2024-03-04T12:41:15.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.350+0000 7f093583d780 1 < canceled operation key=Y4D4Q7NV5VMO tag=N4Y94QO0OE1X type=del size=740291 2024-03-04T12:41:15.357 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.351+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=8OF8FHMXC9VT type=del size=1487314 2024-03-04T12:41:15.359 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.354+0000 7f093583d780 1 < suggested update operation key=NQF43I07F2HT tag=CYN2Q6WC927R type=del size=1681756 2024-03-04T12:41:15.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.356+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~30ZDNU6CKVM3.0 size=1048576 2024-03-04T12:41:15.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.357+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~30ZDNU6CKVM3.1 size=173419 2024-03-04T12:41:15.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.357+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=30ZDNU6CKVM3 tag=OP03SPYSE7KH type=write size=2270571 2024-03-04T12:41:15.364 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.358+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~7OC77FYRA975.0 size=1048576 2024-03-04T12:41:15.364 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.358+0000 7f093583d780 1 < canceled part key=_multipart_UAEQORB3BDBH.2~7OC77FYRA975.1 size=277417 2024-03-04T12:41:15.366 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.360+0000 7f093583d780 1 < canceled multipart upload key=UAEQORB3BDBH upload=7OC77FYRA975 tag=WC0L8BXNR4PZ type=write size=2374569 2024-03-04T12:41:15.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.361+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=TLTG0QA9JIBX type=write size=766744 2024-03-04T12:41:15.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.363+0000 7f093583d780 1 < completed write operation key=HG0EM344TJZY tag=U7Z95NKGFJQM type=write size=472513 2024-03-04T12:41:15.370 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.364+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=8SHVMB11HVD3 type=del size=2848324 2024-03-04T12:41:15.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.366+0000 7f093583d780 1 < suggested remove operation key=2XVNK3YEVHJ7 tag=3JLZJ1D5QMYV type=del 2024-03-04T12:41:15.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.369+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~V3KAJQ125BQM.0 size=1048576 2024-03-04T12:41:15.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.369+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~V3KAJQ125BQM.1 size=484526 2024-03-04T12:41:15.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.369+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=V3KAJQ125BQM tag=RQPR6I8YZABB type=write size=2581678 2024-03-04T12:41:15.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.370+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=B4GPBOP0WY8Y type=del 2024-03-04T12:41:15.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.372+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~O8ZPA4U0II1H.0 size=367092 2024-03-04T12:41:15.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.372+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=O8ZPA4U0II1H tag=D07UWA55H9B1 type=write size=1415668 2024-03-04T12:41:15.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.374+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~037ZBRT1BXAU.0 size=1048576 2024-03-04T12:41:15.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.374+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~037ZBRT1BXAU.1 size=1048576 2024-03-04T12:41:15.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.375+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~037ZBRT1BXAU.2 size=972910 2024-03-04T12:41:15.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.377+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=037ZBRT1BXAU tag=24ZKMIMN72M2 type=write size=4118638 2024-03-04T12:41:15.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.378+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=9BM1QD0M10D5 type=del size=2808486 2024-03-04T12:41:15.385 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.379+0000 7f093583d780 -1 < failed to complete operation key=2XVNK3YEVHJ7 tag=WFRSAN8LHT74 type=write size=18866: (22) Invalid argument 2024-03-04T12:41:15.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.380+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=0DWWDQBZ0G94 type=del size=3221540 2024-03-04T12:41:15.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.382+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~V9THONPUUKGB.0 size=195176 2024-03-04T12:41:15.389 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.384+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=V9THONPUUKGB tag=Z4DKTMJU2VDC type=write size=1243752 2024-03-04T12:41:15.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.385+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=8GULU4P4XTPI type=write size=253434 2024-03-04T12:41:15.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.386+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~W7HU4967N095.0 size=1048576 2024-03-04T12:41:15.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.387+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~W7HU4967N095.1 size=491143 2024-03-04T12:41:15.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.389+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=W7HU4967N095 tag=JBAQ1T6RMMQT type=write size=2588295 2024-03-04T12:41:15.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.390+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=A9HG918RJ3WN type=del size=809187 2024-03-04T12:41:15.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.392+0000 7f093583d780 1 < suggested update operation key=OCOQJLUUNWRG tag=8GK7DK3D65BM type=del size=1982940 2024-03-04T12:41:15.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.394+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=RKVMJB6LPG6Y type=del size=1125733 2024-03-04T12:41:15.401 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.396+0000 7f093583d780 1 < suggested update operation key=M0AOZ89IQNSK tag=XMKEYPRIBSXC type=write size=730668 2024-03-04T12:41:15.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.397+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=1G8FRVQGGWS5 type=write size=266569 2024-03-04T12:41:15.404 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.398+0000 7f093583d780 1 < canceled operation key=L4UQK3UJFXZC tag=N8XZNV0LDB03 type=del size=1805682 2024-03-04T12:41:15.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.399+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=S33LL6CPNTYG type=del size=2761617 2024-03-04T12:41:15.406 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.401+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~VS07K1Q6WHU0.0 size=502606 2024-03-04T12:41:15.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.402+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=VS07K1Q6WHU0 tag=OFCWPV211WA7 type=write size=1551182 2024-03-04T12:41:15.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.403+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=92XU5NXJ84B5 type=write size=1015022 2024-03-04T12:41:15.410 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.405+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=E6CT8YAQN1PB type=del 2024-03-04T12:41:15.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.406+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=FDZXVINABH9H type=del size=3848787 2024-03-04T12:41:15.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.407+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~W7F3IILZLVFL.0 size=77394 2024-03-04T12:41:15.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.409+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=W7F3IILZLVFL tag=TXUJCYNF5R8L type=write size=1125970 2024-03-04T12:41:15.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.411+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~15TT0SN2O6R1.0 size=1048576 2024-03-04T12:41:15.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.412+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~15TT0SN2O6R1.1 size=1048576 2024-03-04T12:41:15.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.413+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~15TT0SN2O6R1.2 size=306283 2024-03-04T12:41:15.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.413+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=15TT0SN2O6R1 tag=L17K30Q43700 type=write size=3452011 2024-03-04T12:41:15.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.414+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=8OF8FHMXC9VT type=del 2024-03-04T12:41:15.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.415+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=U6ZNYAXEVM2J type=del size=2630263 2024-03-04T12:41:15.422 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.416+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~30ZDNU6CKVM3.0 size=1048576 2024-03-04T12:41:15.423 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.417+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~30ZDNU6CKVM3.1 size=173419 2024-03-04T12:41:15.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.419+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=30ZDNU6CKVM3 tag=OP03SPYSE7KH type=write size=2270571 2024-03-04T12:41:15.427 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.421+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~C715LEUYN8FG.0 size=1048576 2024-03-04T12:41:15.428 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.422+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~C715LEUYN8FG.1 size=848533 2024-03-04T12:41:15.428 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.422+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=C715LEUYN8FG tag=KJDC3QH03903 type=write size=2945685 2024-03-04T12:41:15.430 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.423+0000 7f093583d780 1 < completed write operation key=AQI7H63EQSTN tag=TLTG0QA9JIBX type=write size=766744 2024-03-04T12:41:15.430 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.424+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=OP48EUE7FP2D type=del size=1985977 2024-03-04T12:41:15.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.426+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=8SHVMB11HVD3 type=del 2024-03-04T12:41:15.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.427+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=2998DOFT0U3B type=del size=3013606 2024-03-04T12:41:15.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.430+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~V3KAJQ125BQM.0 size=1048576 2024-03-04T12:41:15.436 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.431+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~V3KAJQ125BQM.1 size=484526 2024-03-04T12:41:15.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.433+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=V3KAJQ125BQM tag=RQPR6I8YZABB type=write size=2581678 2024-03-04T12:41:15.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.434+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=3MCEFMW46CVX type=del size=799921 2024-03-04T12:41:15.441 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.435+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~O8ZPA4U0II1H.0 size=367092 2024-03-04T12:41:15.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.438+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=O8ZPA4U0II1H tag=D07UWA55H9B1 type=write size=1415668 2024-03-04T12:41:15.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.439+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=9UJEMQ01K43Z type=del size=655810 2024-03-04T12:41:15.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.440+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=9BM1QD0M10D5 type=del 2024-03-04T12:41:15.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.442+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=P45HVJ0EL8NM type=del size=3582096 2024-03-04T12:41:15.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.443+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=0DWWDQBZ0G94 type=del 2024-03-04T12:41:15.450 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.445+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~RLHVPVMZHP8K.0 size=1048576 2024-03-04T12:41:15.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.446+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~RLHVPVMZHP8K.1 size=1048576 2024-03-04T12:41:15.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.447+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~RLHVPVMZHP8K.2 size=504167 2024-03-04T12:41:15.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.447+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=RLHVPVMZHP8K tag=WUBMCYOBV9SX type=write size=3649895 2024-03-04T12:41:15.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.448+0000 7f093583d780 1 < completed write operation key=Q45PKXZVJ6YS tag=8GULU4P4XTPI type=write size=253434 2024-03-04T12:41:15.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.450+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=4X5NPRUEJABU type=del size=2619711 2024-03-04T12:41:15.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.452+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=A9HG918RJ3WN type=del 2024-03-04T12:41:15.459 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.453+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=KC22ALQZGJ1S type=del size=3523958 2024-03-04T12:41:15.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.456+0000 7f093583d780 1 < suggested remove operation key=OFTWI7UFD5L5 tag=RKVMJB6LPG6Y type=del 2024-03-04T12:41:15.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.458+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~FFEOVVWQ153N.0 size=418768 2024-03-04T12:41:15.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.458+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=FFEOVVWQ153N tag=ZU3SDAHT75K6 type=write size=1467344 2024-03-04T12:41:15.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.459+0000 7f093583d780 1 < completed write operation key=2R5WA9Q9ZAUG tag=1G8FRVQGGWS5 type=write size=266569 2024-03-04T12:41:15.465 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.460+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=RDEXEQXE3WKZ type=del size=3499718 2024-03-04T12:41:15.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.461+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=S33LL6CPNTYG type=del 2024-03-04T12:41:15.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.462+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=J1VI2PH2THEG type=write size=226015 2024-03-04T12:41:15.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.464+0000 7f093583d780 1 < completed write operation key=F269PJEZ05IO tag=92XU5NXJ84B5 type=write size=1015022 2024-03-04T12:41:15.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.465+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=1L37CCREX42Y type=del size=3898528 2024-03-04T12:41:15.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.467+0000 7f093583d780 1 < suggested remove operation key=Y4D4Q7NV5VMO tag=FDZXVINABH9H type=del 2024-03-04T12:41:15.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.468+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=08A5TJAWNHKA type=del size=4023258 2024-03-04T12:41:15.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.470+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~15TT0SN2O6R1.0 size=1048576 2024-03-04T12:41:15.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.471+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~15TT0SN2O6R1.1 size=1048576 2024-03-04T12:41:15.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.472+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~15TT0SN2O6R1.2 size=306283 2024-03-04T12:41:15.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.474+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=15TT0SN2O6R1 tag=L17K30Q43700 type=write size=3452011 2024-03-04T12:41:15.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.475+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=W9HUW03A4XCC type=del size=3867010 2024-03-04T12:41:15.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.477+0000 7f093583d780 1 < suggested remove operation key=O6OUISHWZ7FU tag=U6ZNYAXEVM2J type=del 2024-03-04T12:41:15.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.479+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~TBIYLXX30YVP.0 size=787317 2024-03-04T12:41:15.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.479+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=TBIYLXX30YVP tag=K5GYO0HJ14CK type=write size=1835893 2024-03-04T12:41:15.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.480+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~C715LEUYN8FG.0 size=1048576 2024-03-04T12:41:15.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.481+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~C715LEUYN8FG.1 size=848533 2024-03-04T12:41:15.489 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.483+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=C715LEUYN8FG tag=KJDC3QH03903 type=write size=2945685 2024-03-04T12:41:15.490 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.484+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=ZVHKJVSVG71A type=del size=1731232 2024-03-04T12:41:15.491 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.485+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=OP48EUE7FP2D type=del 2024-03-04T12:41:15.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.487+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=L71SBH7R841I type=del size=3496394 2024-03-04T12:41:15.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.488+0000 7f093583d780 1 < canceled operation key=2XVNK3YEVHJ7 tag=2998DOFT0U3B type=del size=3013606 2024-03-04T12:41:15.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.489+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=CIRIMYLWZS7Z type=del size=2149409 2024-03-04T12:41:15.496 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.490+0000 7f093583d780 1 < canceled operation key=I5NQBROT0WKE tag=3MCEFMW46CVX type=del size=799921 2024-03-04T12:41:15.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.492+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~ECMSRDVA0Y65.0 size=1048576 2024-03-04T12:41:15.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.493+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~ECMSRDVA0Y65.1 size=1048576 2024-03-04T12:41:15.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.494+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~ECMSRDVA0Y65.2 size=265626 2024-03-04T12:41:15.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.494+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=ECMSRDVA0Y65 tag=HKAHDQVYNE9V type=write size=3411354 2024-03-04T12:41:15.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.495+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=9UJEMQ01K43Z type=del 2024-03-04T12:41:15.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.496+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=XX0M1H3KA411 type=del size=2741327 2024-03-04T12:41:15.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.497+0000 7f093583d780 -1 < failed to complete operation key=Y4D4Q7NV5VMO tag=P45HVJ0EL8NM type=del size=3582096: (22) Invalid argument 2024-03-04T12:41:15.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.498+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=VGOAUJ7DCDZ6 type=write size=901974 2024-03-04T12:41:15.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.500+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~RLHVPVMZHP8K.0 size=1048576 2024-03-04T12:41:15.506 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.501+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~RLHVPVMZHP8K.1 size=1048576 2024-03-04T12:41:15.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.501+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~RLHVPVMZHP8K.2 size=504167 2024-03-04T12:41:15.509 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.503+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=RLHVPVMZHP8K tag=WUBMCYOBV9SX type=write size=3649895 2024-03-04T12:41:15.511 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.505+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~2ZYP50582TJT.0 size=1048576 2024-03-04T12:41:15.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.506+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~2ZYP50582TJT.1 size=218635 2024-03-04T12:41:15.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.506+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=2ZYP50582TJT tag=9RS3LC2P4UAZ type=write size=2315787 2024-03-04T12:41:15.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.508+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=4X5NPRUEJABU type=del 2024-03-04T12:41:15.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.509+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~ODS8ZZJWDEWM.0 size=1048576 2024-03-04T12:41:15.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.510+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~ODS8ZZJWDEWM.1 size=1048576 2024-03-04T12:41:15.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.511+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~ODS8ZZJWDEWM.2 size=147516 2024-03-04T12:41:15.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.511+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=ODS8ZZJWDEWM tag=FD8120O5O3GZ type=write size=3293244 2024-03-04T12:41:15.518 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.513+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=KC22ALQZGJ1S type=del 2024-03-04T12:41:15.520 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.515+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~B3Z342DKG6L6.0 size=1048576 2024-03-04T12:41:15.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.515+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~B3Z342DKG6L6.1 size=1048576 2024-03-04T12:41:15.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.516+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~B3Z342DKG6L6.2 size=780822 2024-03-04T12:41:15.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.516+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=B3Z342DKG6L6 tag=4V5PQW192SOQ type=write size=3926550 2024-03-04T12:41:15.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.517+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~FFEOVVWQ153N.0 size=418768 2024-03-04T12:41:15.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.519+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=FFEOVVWQ153N tag=ZU3SDAHT75K6 type=write size=1467344 2024-03-04T12:41:15.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.520+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=LGYD169Y4ZNC type=write size=383758 2024-03-04T12:41:15.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.522+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=RDEXEQXE3WKZ type=del 2024-03-04T12:41:15.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.523+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=VDPAHGF44S14 type=del size=1222186 2024-03-04T12:41:15.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.524+0000 7f093583d780 1 < completed write operation key=HG0EM344TJZY tag=J1VI2PH2THEG type=write size=226015 2024-03-04T12:41:15.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.525+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=AN86HTOM2D4S type=del size=810985 2024-03-04T12:41:15.532 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.526+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=1L37CCREX42Y type=del 2024-03-04T12:41:15.533 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.527+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=IDP6SYKJJ2J4 type=del size=3160195 2024-03-04T12:41:15.534 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.528+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=08A5TJAWNHKA type=del 2024-03-04T12:41:15.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.530+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~FMEO2VAEYY7C.0 size=1048576 2024-03-04T12:41:15.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.531+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~FMEO2VAEYY7C.1 size=1048576 2024-03-04T12:41:15.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.532+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~FMEO2VAEYY7C.2 size=547030 2024-03-04T12:41:15.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.532+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=FMEO2VAEYY7C tag=8KTGWB7TLZ8U type=write size=3692758 2024-03-04T12:41:15.539 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.533+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=W9HUW03A4XCC type=del 2024-03-04T12:41:15.541 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.535+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~6KTVHBMTW6AM.0 size=1048576 2024-03-04T12:41:15.542 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.536+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~6KTVHBMTW6AM.1 size=1048576 2024-03-04T12:41:15.543 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.537+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~6KTVHBMTW6AM.2 size=313627 2024-03-04T12:41:15.543 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.537+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=6KTVHBMTW6AM tag=BT9XIVWV8S5Q type=write size=3459355 2024-03-04T12:41:15.544 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.538+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~TBIYLXX30YVP.0 size=787317 2024-03-04T12:41:15.546 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.540+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=TBIYLXX30YVP tag=K5GYO0HJ14CK type=write size=1835893 2024-03-04T12:41:15.547 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.542+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=CRABYTO19L7D type=del size=3757816 2024-03-04T12:41:15.548 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.543+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=ZVHKJVSVG71A type=del 2024-03-04T12:41:15.550 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.545+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~QZBMYQTMS188.0 size=1048576 2024-03-04T12:41:15.551 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.546+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~QZBMYQTMS188.1 size=804468 2024-03-04T12:41:15.551 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.546+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=QZBMYQTMS188 tag=CZ3BW8S30IQR type=write size=2901620 2024-03-04T12:41:15.552 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.547+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=L71SBH7R841I type=del 2024-03-04T12:41:15.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.548+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=NDOYUJBQ7LT2 type=del size=3701378 2024-03-04T12:41:15.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.550+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=CIRIMYLWZS7Z type=del 2024-03-04T12:41:15.556 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.551+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=5DN3IGT8X9UO type=del size=2875492 2024-03-04T12:41:15.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.552+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~ECMSRDVA0Y65.0 size=1048576 2024-03-04T12:41:15.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.553+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~ECMSRDVA0Y65.1 size=1048576 2024-03-04T12:41:15.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.554+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~ECMSRDVA0Y65.2 size=265626 2024-03-04T12:41:15.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.556+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=ECMSRDVA0Y65 tag=HKAHDQVYNE9V type=write size=3411354 2024-03-04T12:41:15.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.558+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=A65EK9PYTAGL type=write size=853554 2024-03-04T12:41:15.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.560+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=XX0M1H3KA411 type=del 2024-03-04T12:41:15.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.561+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=UGAJ2SKXV6C8 type=del size=4188274 2024-03-04T12:41:15.569 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.564+0000 7f093583d780 1 < canceled operation key=M0AOZ89IQNSK tag=VGOAUJ7DCDZ6 type=write size=901974 2024-03-04T12:41:15.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.566+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~V0DT016XA0E7.0 size=1048576 2024-03-04T12:41:15.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.567+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~V0DT016XA0E7.1 size=908576 2024-03-04T12:41:15.573 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.567+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=V0DT016XA0E7 tag=VOEMD63HFYPO type=write size=3005728 2024-03-04T12:41:15.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.568+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~2ZYP50582TJT.0 size=1048576 2024-03-04T12:41:15.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.569+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~2ZYP50582TJT.1 size=218635 2024-03-04T12:41:15.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.571+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=2ZYP50582TJT tag=9RS3LC2P4UAZ type=write size=2315787 2024-03-04T12:41:15.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.572+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=5HUM8LFZEX33 type=del size=2897323 2024-03-04T12:41:15.579 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.574+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~ODS8ZZJWDEWM.0 size=1048576 2024-03-04T12:41:15.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.575+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~ODS8ZZJWDEWM.1 size=1048576 2024-03-04T12:41:15.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.575+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~ODS8ZZJWDEWM.2 size=147516 2024-03-04T12:41:15.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.577+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=ODS8ZZJWDEWM tag=FD8120O5O3GZ type=write size=3293244 2024-03-04T12:41:15.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.579+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~GXTOMXLI85HT.0 size=1048576 2024-03-04T12:41:15.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.580+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~GXTOMXLI85HT.1 size=1048576 2024-03-04T12:41:15.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.581+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~GXTOMXLI85HT.2 size=20502 2024-03-04T12:41:15.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.581+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=GXTOMXLI85HT tag=QCZOUIE25LOT type=write size=3166230 2024-03-04T12:41:15.587 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.582+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~B3Z342DKG6L6.0 size=1048576 2024-03-04T12:41:15.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.583+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~B3Z342DKG6L6.1 size=1048576 2024-03-04T12:41:15.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.584+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~B3Z342DKG6L6.2 size=780822 2024-03-04T12:41:15.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.586+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=B3Z342DKG6L6 tag=4V5PQW192SOQ type=write size=3926550 2024-03-04T12:41:15.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.587+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=QDQSPG5A3UX6 type=write size=820371 2024-03-04T12:41:15.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.588+0000 7f093583d780 1 < completed write operation key=GJ0FQ6EH9HJL tag=LGYD169Y4ZNC type=write size=383758 2024-03-04T12:41:15.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.589+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=I8RP59TNQFU5 type=del size=2959916 2024-03-04T12:41:15.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.591+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=VDPAHGF44S14 type=del 2024-03-04T12:41:15.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.592+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=YNMN1VNNUQVM type=del size=3629160 2024-03-04T12:41:15.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.593+0000 7f093583d780 1 < canceled operation key=96PTQ2KHPMMM tag=AN86HTOM2D4S type=del size=810985 2024-03-04T12:41:15.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.594+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=TP14COP86LBK type=write size=816640 2024-03-04T12:41:15.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.596+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=IDP6SYKJJ2J4 type=del 2024-03-04T12:41:15.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.598+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~EXZN71AN5XGN.0 size=344336 2024-03-04T12:41:15.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.598+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=EXZN71AN5XGN tag=E2VCO957NAXK type=write size=1392912 2024-03-04T12:41:15.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.599+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~FMEO2VAEYY7C.0 size=1048576 2024-03-04T12:41:15.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.600+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~FMEO2VAEYY7C.1 size=1048576 2024-03-04T12:41:15.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.601+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~FMEO2VAEYY7C.2 size=547030 2024-03-04T12:41:15.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.602+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=FMEO2VAEYY7C tag=8KTGWB7TLZ8U type=write size=3692758 2024-03-04T12:41:15.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.604+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=VCTFHUO6Q4HM type=del size=566443 2024-03-04T12:41:15.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.605+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~6KTVHBMTW6AM.0 size=1048576 2024-03-04T12:41:15.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.606+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~6KTVHBMTW6AM.1 size=1048576 2024-03-04T12:41:15.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.607+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~6KTVHBMTW6AM.2 size=313627 2024-03-04T12:41:15.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.609+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=6KTVHBMTW6AM tag=BT9XIVWV8S5Q type=write size=3459355 2024-03-04T12:41:15.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.610+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=RJLLPZ9G73L5 type=del size=804213 2024-03-04T12:41:15.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.612+0000 7f093583d780 1 < suggested remove operation key=2XVNK3YEVHJ7 tag=CRABYTO19L7D type=del 2024-03-04T12:41:15.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.613+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=N42G5QIHDZZ0 type=write size=161450 2024-03-04T12:41:15.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.615+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~QZBMYQTMS188.0 size=1048576 2024-03-04T12:41:15.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.615+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~QZBMYQTMS188.1 size=804468 2024-03-04T12:41:15.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.617+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=QZBMYQTMS188 tag=CZ3BW8S30IQR type=write size=2901620 2024-03-04T12:41:15.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.619+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=DW94UJYG3U82 type=del size=2185200 2024-03-04T12:41:15.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.621+0000 7f093583d780 1 < suggested remove operation key=54FLC10FWKL6 tag=NDOYUJBQ7LT2 type=del 2024-03-04T12:41:15.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.622+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=TH2XRZV7EIH3 type=del size=1261792 2024-03-04T12:41:15.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.624+0000 7f093583d780 1 < suggested remove operation key=HG0EM344TJZY tag=5DN3IGT8X9UO type=del 2024-03-04T12:41:15.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.626+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~9QV6II2DZSED.0 size=1048576 2024-03-04T12:41:15.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.627+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~9QV6II2DZSED.1 size=1048576 2024-03-04T12:41:15.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.628+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~9QV6II2DZSED.2 size=202291 2024-03-04T12:41:15.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.628+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=9QV6II2DZSED tag=57J8CAMQEM62 type=write size=3348019 2024-03-04T12:41:15.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.629+0000 7f093583d780 1 < completed write operation key=GJ0FQ6EH9HJL tag=A65EK9PYTAGL type=write size=853554 2024-03-04T12:41:15.636 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.630+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=HOBBUODTJ4U3 type=del size=3409409 2024-03-04T12:41:15.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.632+0000 7f093583d780 1 < suggested update operation key=NFM6LT89K5F4 tag=UGAJ2SKXV6C8 type=del size=4188274 2024-03-04T12:41:15.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.634+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=397MRZ72SVS0 type=del size=2239454 2024-03-04T12:41:15.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.635+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~V0DT016XA0E7.0 size=1048576 2024-03-04T12:41:15.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.636+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~V0DT016XA0E7.1 size=908576 2024-03-04T12:41:15.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.638+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=V0DT016XA0E7 tag=VOEMD63HFYPO type=write size=3005728 2024-03-04T12:41:15.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.639+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=4ZFLK03XDLGR type=del size=1802751 2024-03-04T12:41:15.645 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.640+0000 7f093583d780 -1 < failed to complete operation key=54FLC10FWKL6 tag=5HUM8LFZEX33 type=del size=2897323: (22) Invalid argument 2024-03-04T12:41:15.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.641+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=OJ01ZJN4WFF7 type=write size=810980 2024-03-04T12:41:15.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.642+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~GXTOMXLI85HT.0 size=1048576 2024-03-04T12:41:15.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.643+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~GXTOMXLI85HT.1 size=1048576 2024-03-04T12:41:15.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.644+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~GXTOMXLI85HT.2 size=20502 2024-03-04T12:41:15.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.646+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=GXTOMXLI85HT tag=QCZOUIE25LOT type=write size=3166230 2024-03-04T12:41:15.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.648+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~61MD7X5EB5E5.0 size=996163 2024-03-04T12:41:15.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.648+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=61MD7X5EB5E5 tag=E44XLH4PIWD1 type=write size=2044739 2024-03-04T12:41:15.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.649+0000 7f093583d780 1 < completed write operation key=OCOQJLUUNWRG tag=QDQSPG5A3UX6 type=write size=820371 2024-03-04T12:41:15.657 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.652+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~E2C1F9E0HZGX.0 size=1048576 2024-03-04T12:41:15.658 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.652+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~E2C1F9E0HZGX.1 size=1048576 2024-03-04T12:41:15.659 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.653+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~E2C1F9E0HZGX.2 size=758030 2024-03-04T12:41:15.659 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.653+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=E2C1F9E0HZGX tag=1UQ6LNH4VAPD type=write size=3903758 2024-03-04T12:41:15.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.656+0000 7f093583d780 1 < suggested update operation key=YJXFSO53QVPS tag=I8RP59TNQFU5 type=del size=2959916 2024-03-04T12:41:15.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.658+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~O4XWXBBW5BCU.0 size=1048576 2024-03-04T12:41:15.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.659+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~O4XWXBBW5BCU.1 size=421732 2024-03-04T12:41:15.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.659+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=O4XWXBBW5BCU tag=QIH9D63FEAIF type=write size=2518884 2024-03-04T12:41:15.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.660+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=YNMN1VNNUQVM type=del 2024-03-04T12:41:15.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.662+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=ZM8ADGJQCDV1 type=del size=1276997 2024-03-04T12:41:15.670 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.663+0000 7f093583d780 1 < canceled operation key=PT63VLFQQN0E tag=TP14COP86LBK type=write size=816640 2024-03-04T12:41:15.670 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.664+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=7354ZBBAXB1O type=del size=1891277 2024-03-04T12:41:15.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.666+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~EXZN71AN5XGN.0 size=344336 2024-03-04T12:41:15.673 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.668+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=EXZN71AN5XGN tag=E2VCO957NAXK type=write size=1392912 2024-03-04T12:41:15.676 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.670+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=RI5AEO2AOAZ9 type=write size=252720 2024-03-04T12:41:15.677 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.671+0000 7f093583d780 -1 < failed to complete operation key=YJXFSO53QVPS tag=VCTFHUO6Q4HM type=del size=566443: (22) Invalid argument 2024-03-04T12:41:15.679 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.673+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~IE3NMITYR5O6.0 size=1048576 2024-03-04T12:41:15.680 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.674+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~IE3NMITYR5O6.1 size=8212 2024-03-04T12:41:15.680 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.674+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=IE3NMITYR5O6 tag=KV2HSN4ZRVGA type=write size=2105364 2024-03-04T12:41:15.681 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.676+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=RJLLPZ9G73L5 type=del 2024-03-04T12:41:15.682 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.677+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=ZYKBZNZ1J43V type=del size=1479130 2024-03-04T12:41:15.684 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.678+0000 7f093583d780 1 < completed write operation key=I5NQBROT0WKE tag=N42G5QIHDZZ0 type=write size=161450 2024-03-04T12:41:15.685 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.679+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=43C3R5G0YE89 type=del size=3970345 2024-03-04T12:41:15.686 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.680+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=DW94UJYG3U82 type=del 2024-03-04T12:41:15.688 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.682+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~ZCH8BDZMX2P7.0 size=671533 2024-03-04T12:41:15.688 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.682+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=ZCH8BDZMX2P7 tag=MJ21NZ882GXR type=write size=1720109 2024-03-04T12:41:15.690 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.684+0000 7f093583d780 1 < suggested update operation key=96PTQ2KHPMMM tag=TH2XRZV7EIH3 type=del size=1261792 2024-03-04T12:41:15.692 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.685+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=W1A1WVW6LP5X type=del size=2791026 2024-03-04T12:41:15.692 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.686+0000 7f093583d780 1 < canceled part key=_multipart_2YD2M0JQNCC0.2~9QV6II2DZSED.0 size=1048576 2024-03-04T12:41:15.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.687+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~9QV6II2DZSED.1 size=1048576 2024-03-04T12:41:15.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.687+0000 7f093583d780 1 < canceled part key=_multipart_2YD2M0JQNCC0.2~9QV6II2DZSED.2 size=202291 2024-03-04T12:41:15.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.689+0000 7f093583d780 1 < canceled multipart upload key=2YD2M0JQNCC0 upload=9QV6II2DZSED tag=57J8CAMQEM62 type=write size=3348019 2024-03-04T12:41:15.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.690+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=JXAVSC9G8CO4 type=write size=775733 2024-03-04T12:41:15.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.691+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=HOBBUODTJ4U3 type=del 2024-03-04T12:41:15.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.693+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~GZ5HCOOMQB6R.0 size=1048576 2024-03-04T12:41:15.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.694+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~GZ5HCOOMQB6R.1 size=1048576 2024-03-04T12:41:15.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.695+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~GZ5HCOOMQB6R.2 size=480809 2024-03-04T12:41:15.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.695+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=GZ5HCOOMQB6R tag=OI6QZPTFH3F0 type=write size=3626537 2024-03-04T12:41:15.701 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.696+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=397MRZ72SVS0 type=del 2024-03-04T12:41:15.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.697+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=NF571HMUO6E5 type=del size=990526 2024-03-04T12:41:15.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.698+0000 7f093583d780 -1 < failed to complete operation key=96PTQ2KHPMMM tag=4ZFLK03XDLGR type=del size=1802751: (22) Invalid argument 2024-03-04T12:41:15.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.699+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=QJVHMHYMZ6FR type=del size=2755378 2024-03-04T12:41:15.706 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.700+0000 7f093583d780 1 < completed write operation key=FT2XNJYYT30J tag=OJ01ZJN4WFF7 type=write size=810980 2024-03-04T12:41:15.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.702+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~OT3XF4RMOY6Y.0 size=1048576 2024-03-04T12:41:15.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.703+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~OT3XF4RMOY6Y.1 size=1048576 2024-03-04T12:41:15.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.704+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~OT3XF4RMOY6Y.2 size=252831 2024-03-04T12:41:15.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.704+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=OT3XF4RMOY6Y tag=L33P1IDN9AQP type=write size=3398559 2024-03-04T12:41:15.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.705+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~61MD7X5EB5E5.0 size=996163 2024-03-04T12:41:15.712 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.707+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=61MD7X5EB5E5 tag=E44XLH4PIWD1 type=write size=2044739 2024-03-04T12:41:15.714 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.708+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=HH5MAY958LXK type=write size=303620 2024-03-04T12:41:15.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.709+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~E2C1F9E0HZGX.0 size=1048576 2024-03-04T12:41:15.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.709+0000 7f093583d780 1 < canceled part key=_multipart_2YD2M0JQNCC0.2~E2C1F9E0HZGX.1 size=1048576 2024-03-04T12:41:15.716 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.710+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~E2C1F9E0HZGX.2 size=758030 2024-03-04T12:41:15.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.712+0000 7f093583d780 1 < canceled multipart upload key=2YD2M0JQNCC0 upload=E2C1F9E0HZGX tag=1UQ6LNH4VAPD type=write size=3903758 2024-03-04T12:41:15.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.714+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~ZTCG6SAN4DU9.0 size=1048576 2024-03-04T12:41:15.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.715+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~ZTCG6SAN4DU9.1 size=1048576 2024-03-04T12:41:15.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.716+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~ZTCG6SAN4DU9.2 size=731929 2024-03-04T12:41:15.722 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.716+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=ZTCG6SAN4DU9 tag=IJS02KY7NHFC type=write size=3877657 2024-03-04T12:41:15.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.717+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~O4XWXBBW5BCU.0 size=1048576 2024-03-04T12:41:15.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.718+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~O4XWXBBW5BCU.1 size=421732 2024-03-04T12:41:15.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.720+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=O4XWXBBW5BCU tag=QIH9D63FEAIF type=write size=2518884 2024-03-04T12:41:15.727 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.721+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=2QRUECML9XAU type=write size=747569 2024-03-04T12:41:15.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.722+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=ZM8ADGJQCDV1 type=del 2024-03-04T12:41:15.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.723+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=E462A91XLCI8 type=del size=2879481 2024-03-04T12:41:15.730 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.724+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=7354ZBBAXB1O type=del 2024-03-04T12:41:15.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.726+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=ZOGWO0B3PD6W type=write size=497754 2024-03-04T12:41:15.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.727+0000 7f093583d780 1 < completed write operation key=I5NQBROT0WKE tag=RI5AEO2AOAZ9 type=write size=252720 2024-03-04T12:41:15.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.729+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~X1M2V44YFY90.0 size=1048576 2024-03-04T12:41:15.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.730+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~X1M2V44YFY90.1 size=942695 2024-03-04T12:41:15.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.730+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=X1M2V44YFY90 tag=B00VL7MOEJ30 type=write size=3039847 2024-03-04T12:41:15.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.731+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~IE3NMITYR5O6.0 size=1048576 2024-03-04T12:41:15.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.732+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~IE3NMITYR5O6.1 size=8212 2024-03-04T12:41:15.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.734+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=IE3NMITYR5O6 tag=KV2HSN4ZRVGA type=write size=2105364 2024-03-04T12:41:15.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.735+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=VRDIPBG2PEUZ type=write size=639326 2024-03-04T12:41:15.742 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.736+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=ZYKBZNZ1J43V type=del 2024-03-04T12:41:15.744 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.738+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~D1YN55R5SDCG.0 size=61308 2024-03-04T12:41:15.744 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.738+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=D1YN55R5SDCG tag=BZWZB6GWFM9U type=write size=1109884 2024-03-04T12:41:15.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.740+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=43C3R5G0YE89 type=del 2024-03-04T12:41:15.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.741+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=JJ1GHHDDAI36 type=write size=187759 2024-03-04T12:41:15.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.742+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~ZCH8BDZMX2P7.0 size=671533 2024-03-04T12:41:15.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.744+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=ZCH8BDZMX2P7 tag=MJ21NZ882GXR type=write size=1720109 2024-03-04T12:41:15.751 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.746+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~39JBO0IN9HRF.0 size=1048576 2024-03-04T12:41:15.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.747+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~39JBO0IN9HRF.1 size=1048576 2024-03-04T12:41:15.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.747+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~39JBO0IN9HRF.2 size=250266 2024-03-04T12:41:15.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.747+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=39JBO0IN9HRF tag=KJEP1TV7OE1F type=write size=3395994 2024-03-04T12:41:15.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.749+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=W1A1WVW6LP5X type=del 2024-03-04T12:41:15.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.750+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=6POADNNBNLTY type=del size=693969 2024-03-04T12:41:15.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.751+0000 7f093583d780 1 < completed write operation key=TMAI6MOG2C4N tag=JXAVSC9G8CO4 type=write size=775733 2024-03-04T12:41:15.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.753+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~HQHL20N6LGZU.0 size=1048576 2024-03-04T12:41:15.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.754+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~HQHL20N6LGZU.1 size=751203 2024-03-04T12:41:15.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.754+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=HQHL20N6LGZU tag=UYI79L03H0SJ type=write size=2848355 2024-03-04T12:41:15.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.755+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~GZ5HCOOMQB6R.0 size=1048576 2024-03-04T12:41:15.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.756+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~GZ5HCOOMQB6R.1 size=1048576 2024-03-04T12:41:15.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.757+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~GZ5HCOOMQB6R.2 size=480809 2024-03-04T12:41:15.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.760+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=GZ5HCOOMQB6R tag=OI6QZPTFH3F0 type=write size=3626537 2024-03-04T12:41:15.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.761+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=LN3R9Z7X03Q2 type=del size=211537 2024-03-04T12:41:15.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.762+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=NF571HMUO6E5 type=del 2024-03-04T12:41:15.770 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.764+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~VOQQU6A0L1GF.0 size=101109 2024-03-04T12:41:15.770 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.764+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=VOQQU6A0L1GF tag=3T6YVKOKXSHD type=write size=1149685 2024-03-04T12:41:15.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.765+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=QJVHMHYMZ6FR type=del 2024-03-04T12:41:15.772 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.767+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=QHO6BEWMEO8R type=del size=345443 2024-03-04T12:41:15.773 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.768+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~OT3XF4RMOY6Y.0 size=1048576 2024-03-04T12:41:15.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.769+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~OT3XF4RMOY6Y.1 size=1048576 2024-03-04T12:41:15.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.770+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~OT3XF4RMOY6Y.2 size=252831 2024-03-04T12:41:15.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.772+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=OT3XF4RMOY6Y tag=L33P1IDN9AQP type=write size=3398559 2024-03-04T12:41:15.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.774+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=9VS1JY1AN4EC type=del size=3107735 2024-03-04T12:41:15.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.775+0000 7f093583d780 1 < completed write operation key=NFM6LT89K5F4 tag=HH5MAY958LXK type=write size=303620 2024-03-04T12:41:15.782 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.777+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=PXUCJE0PUD1N type=del size=3201549 2024-03-04T12:41:15.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.779+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~ZTCG6SAN4DU9.0 size=1048576 2024-03-04T12:41:15.787 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.781+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~ZTCG6SAN4DU9.1 size=1048576 2024-03-04T12:41:15.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.782+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~ZTCG6SAN4DU9.2 size=731929 2024-03-04T12:41:15.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.784+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=ZTCG6SAN4DU9 tag=IJS02KY7NHFC type=write size=3877657 2024-03-04T12:41:15.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.785+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=MBNTACZ0W3ZE type=del size=4101386 2024-03-04T12:41:15.792 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.787+0000 7f093583d780 1 < completed write operation key=UAEQORB3BDBH tag=2QRUECML9XAU type=write size=747569 2024-03-04T12:41:15.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.788+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=VHEYSXNUFOM0 type=del size=2917767 2024-03-04T12:41:15.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.789+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=E462A91XLCI8 type=del 2024-03-04T12:41:15.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.790+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=DODW97A0Z2DT type=write size=471179 2024-03-04T12:41:15.797 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.792+0000 7f093583d780 1 < completed write operation key=NQF43I07F2HT tag=ZOGWO0B3PD6W type=write size=497754 2024-03-04T12:41:15.800 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.794+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~QT9P5XWESVBT.0 size=881916 2024-03-04T12:41:15.800 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.794+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=QT9P5XWESVBT tag=JWP3M7ZEZGIM type=write size=1930492 2024-03-04T12:41:15.801 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.795+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~X1M2V44YFY90.0 size=1048576 2024-03-04T12:41:15.802 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.796+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~X1M2V44YFY90.1 size=942695 2024-03-04T12:41:15.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.798+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=X1M2V44YFY90 tag=B00VL7MOEJ30 type=write size=3039847 2024-03-04T12:41:15.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.799+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=O61B6N2OPARG type=del size=3003159 2024-03-04T12:41:15.806 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.801+0000 7f093583d780 1 < completed write operation key=Q45PKXZVJ6YS tag=VRDIPBG2PEUZ type=write size=639326 2024-03-04T12:41:15.807 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.802+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=31KNWTN67QG6 type=del size=2949178 2024-03-04T12:41:15.809 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.803+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~D1YN55R5SDCG.0 size=61308 2024-03-04T12:41:15.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.805+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=D1YN55R5SDCG tag=BZWZB6GWFM9U type=write size=1109884 2024-03-04T12:41:15.813 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.808+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~7IOYF8W9GBL1.0 size=259217 2024-03-04T12:41:15.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.808+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=7IOYF8W9GBL1 tag=ZG217UQZ7JXT type=write size=1307793 2024-03-04T12:41:15.816 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.810+0000 7f093583d780 1 < suggested remove operation key=I6DIP4VGHMNO tag=JJ1GHHDDAI36 type=write 2024-03-04T12:41:15.818 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.812+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~CJ992H5B5122.0 size=611588 2024-03-04T12:41:15.818 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.812+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=CJ992H5B5122 tag=HP1ZZUQ7D8TA type=write size=1660164 2024-03-04T12:41:15.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.814+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~39JBO0IN9HRF.0 size=1048576 2024-03-04T12:41:15.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.814+0000 7f093583d780 1 < canceled part key=_multipart_9VKN43CB955V.2~39JBO0IN9HRF.1 size=1048576 2024-03-04T12:41:15.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.815+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~39JBO0IN9HRF.2 size=250266 2024-03-04T12:41:15.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.816+0000 7f093583d780 1 < canceled multipart upload key=9VKN43CB955V upload=39JBO0IN9HRF tag=KJEP1TV7OE1F type=write size=3395994 2024-03-04T12:41:15.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.818+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=7NO22CN5YXLV type=del size=3924845 2024-03-04T12:41:15.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.819+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=6POADNNBNLTY type=del 2024-03-04T12:41:15.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.821+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~QZFLY2F1CZPX.0 size=1028345 2024-03-04T12:41:15.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.821+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=QZFLY2F1CZPX tag=BLVL9LAGHG2G type=write size=2076921 2024-03-04T12:41:15.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.822+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~HQHL20N6LGZU.0 size=1048576 2024-03-04T12:41:15.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.823+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~HQHL20N6LGZU.1 size=751203 2024-03-04T12:41:15.830 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.824+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=HQHL20N6LGZU tag=UYI79L03H0SJ type=write size=2848355 2024-03-04T12:41:15.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.826+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=FIXWR4F2JXTX type=del size=348165 2024-03-04T12:41:15.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.827+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=LN3R9Z7X03Q2 type=del 2024-03-04T12:41:15.834 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.829+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~PASKJHJN4OFO.0 size=1048576 2024-03-04T12:41:15.835 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.830+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~PASKJHJN4OFO.1 size=526784 2024-03-04T12:41:15.835 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.830+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=PASKJHJN4OFO tag=E12C8Z8OM9TL type=write size=2623936 2024-03-04T12:41:15.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.831+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~VOQQU6A0L1GF.0 size=101109 2024-03-04T12:41:15.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.833+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=VOQQU6A0L1GF tag=3T6YVKOKXSHD type=write size=1149685 2024-03-04T12:41:15.839 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.834+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=0J15OX50JQC9 type=del size=4012636 2024-03-04T12:41:15.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.835+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=QHO6BEWMEO8R type=del 2024-03-04T12:41:15.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.837+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~Z13567XT6I3V.0 size=1048576 2024-03-04T12:41:15.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.838+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~Z13567XT6I3V.1 size=1048576 2024-03-04T12:41:15.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.839+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~Z13567XT6I3V.2 size=342365 2024-03-04T12:41:15.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.839+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=Z13567XT6I3V tag=V1VM0ZYQVI09 type=write size=3488093 2024-03-04T12:41:15.845 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.840+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=9VS1JY1AN4EC type=del 2024-03-04T12:41:15.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.841+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=44JO2ATNE3KU type=del size=2931075 2024-03-04T12:41:15.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.843+0000 7f093583d780 1 < suggested update operation key=YJXFSO53QVPS tag=PXUCJE0PUD1N type=del size=3201549 2024-03-04T12:41:15.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.844+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=4KMK4VU2QG9I type=del size=1846187 2024-03-04T12:41:15.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.846+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=MBNTACZ0W3ZE type=del 2024-03-04T12:41:15.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.847+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=COFG5Z77T9NO type=write size=831896 2024-03-04T12:41:15.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.850+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=VHEYSXNUFOM0 type=del 2024-03-04T12:41:15.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.851+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=Q1K8TOQ0HLBX type=del size=1140257 2024-03-04T12:41:15.859 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.853+0000 7f093583d780 1 < suggested remove operation key=OCOQJLUUNWRG tag=DODW97A0Z2DT type=write 2024-03-04T12:41:15.860 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.855+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=PZIDLXHHKGQP type=del size=1753270 2024-03-04T12:41:15.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.856+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~QT9P5XWESVBT.0 size=881916 2024-03-04T12:41:15.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.858+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=QT9P5XWESVBT tag=JWP3M7ZEZGIM type=write size=1930492 2024-03-04T12:41:15.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.860+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~LJ0ENBR9UV3V.0 size=1048576 2024-03-04T12:41:15.866 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.861+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~LJ0ENBR9UV3V.1 size=618686 2024-03-04T12:41:15.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.861+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=LJ0ENBR9UV3V tag=5ZMP2JKQSY42 type=write size=2715838 2024-03-04T12:41:15.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.862+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=O61B6N2OPARG type=del 2024-03-04T12:41:15.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.863+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=VQF6L86SN1CB type=del size=4067244 2024-03-04T12:41:15.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.865+0000 7f093583d780 1 < canceled operation key=2R5WA9Q9ZAUG tag=31KNWTN67QG6 type=del size=2949178 2024-03-04T12:41:15.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.867+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~PM32ISR3CJY7.0 size=1048576 2024-03-04T12:41:15.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.868+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~PM32ISR3CJY7.1 size=123593 2024-03-04T12:41:15.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.868+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=PM32ISR3CJY7 tag=3GTF5FJGFQZK type=write size=2220745 2024-03-04T12:41:15.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.869+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~7IOYF8W9GBL1.0 size=259217 2024-03-04T12:41:15.878 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.873+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=7IOYF8W9GBL1 tag=ZG217UQZ7JXT type=write size=1307793 2024-03-04T12:41:15.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.875+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~ATMROZ8MODWP.0 size=129653 2024-03-04T12:41:15.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.875+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=ATMROZ8MODWP tag=D4IIZM4GI1SL type=write size=1178229 2024-03-04T12:41:15.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.875+0000 7f093583d780 1 < canceled part key=_multipart_TMAI6MOG2C4N.2~CJ992H5B5122.0 size=611588 2024-03-04T12:41:15.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.877+0000 7f093583d780 1 < canceled multipart upload key=TMAI6MOG2C4N upload=CJ992H5B5122 tag=HP1ZZUQ7D8TA type=write size=1660164 2024-03-04T12:41:15.884 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.879+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=2FK2SBJ1P042 type=del size=1472333 2024-03-04T12:41:15.887 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.881+0000 7f093583d780 1 < suggested remove operation key=9E12MS7PETOK tag=7NO22CN5YXLV type=del 2024-03-04T12:41:15.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.882+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=CT2OR4QDW67P type=del size=2928227 2024-03-04T12:41:15.889 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.883+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~QZFLY2F1CZPX.0 size=1028345 2024-03-04T12:41:15.891 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.885+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=QZFLY2F1CZPX tag=BLVL9LAGHG2G type=write size=2076921 2024-03-04T12:41:15.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.887+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=F2WDEGEK3F1L type=del size=2180111 2024-03-04T12:41:15.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.888+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=FIXWR4F2JXTX type=del 2024-03-04T12:41:15.895 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.889+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=3WPN139ID2MH type=del size=193930 2024-03-04T12:41:15.896 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.891+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~PASKJHJN4OFO.0 size=1048576 2024-03-04T12:41:15.897 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.892+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~PASKJHJN4OFO.1 size=526784 2024-03-04T12:41:15.899 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.894+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=PASKJHJN4OFO tag=E12C8Z8OM9TL type=write size=2623936 2024-03-04T12:41:15.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.896+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=59WPKP90UJB7 type=del size=3764480 2024-03-04T12:41:15.902 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.896+0000 7f093583d780 -1 < no bi entry to suggest for operation key=OCOQJLUUNWRG tag=0J15OX50JQC9 type=del size=4012636: (2) No such file or directory 2024-03-04T12:41:15.904 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.898+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~IR6QFMAMNE33.0 size=1048576 2024-03-04T12:41:15.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.899+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~IR6QFMAMNE33.1 size=1048576 2024-03-04T12:41:15.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.900+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~IR6QFMAMNE33.2 size=998329 2024-03-04T12:41:15.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.900+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=IR6QFMAMNE33 tag=G9HOXTI1CGC5 type=write size=4144057 2024-03-04T12:41:15.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.901+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~Z13567XT6I3V.0 size=1048576 2024-03-04T12:41:15.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.902+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~Z13567XT6I3V.1 size=1048576 2024-03-04T12:41:15.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.903+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~Z13567XT6I3V.2 size=342365 2024-03-04T12:41:15.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.905+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=Z13567XT6I3V tag=V1VM0ZYQVI09 type=write size=3488093 2024-03-04T12:41:15.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.906+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=991IVDJQ7E2Y type=del size=633769 2024-03-04T12:41:15.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.907+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=44JO2ATNE3KU type=del 2024-03-04T12:41:15.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.908+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=19YYLV4X9XFL type=del size=2036021 2024-03-04T12:41:15.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.909+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=4KMK4VU2QG9I type=del 2024-03-04T12:41:15.916 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.911+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=6UN97G20VMUZ type=del size=3816666 2024-03-04T12:41:15.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.912+0000 7f093583d780 -1 < failed to complete operation key=OCOQJLUUNWRG tag=COFG5Z77T9NO type=write size=831896: (22) Invalid argument 2024-03-04T12:41:15.918 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.913+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=YUPBX8JYHZOV type=del size=572909 2024-03-04T12:41:15.920 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.915+0000 7f093583d780 1 < suggested remove operation key=96PTQ2KHPMMM tag=Q1K8TOQ0HLBX type=del 2024-03-04T12:41:15.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.916+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=YGVJNJN10F04 type=del size=2211018 2024-03-04T12:41:15.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.917+0000 7f093583d780 1 < completed delete operation key=AQI7H63EQSTN tag=PZIDLXHHKGQP type=del 2024-03-04T12:41:15.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.918+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=G03BYGXACYUN type=del size=3260700 2024-03-04T12:41:15.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.919+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~LJ0ENBR9UV3V.0 size=1048576 2024-03-04T12:41:15.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.920+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~LJ0ENBR9UV3V.1 size=618686 2024-03-04T12:41:15.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.922+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=LJ0ENBR9UV3V tag=5ZMP2JKQSY42 type=write size=2715838 2024-03-04T12:41:15.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.923+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=15LKS2POIZB6 type=del size=3676517 2024-03-04T12:41:15.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.924+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=VQF6L86SN1CB type=del 2024-03-04T12:41:15.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.926+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~OW1CRK9IIBU5.0 size=1048576 2024-03-04T12:41:15.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.927+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~OW1CRK9IIBU5.1 size=695190 2024-03-04T12:41:15.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.927+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=OW1CRK9IIBU5 tag=4TDLPOVZUJ9W type=write size=2792342 2024-03-04T12:41:15.933 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.928+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~PM32ISR3CJY7.0 size=1048576 2024-03-04T12:41:15.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.929+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~PM32ISR3CJY7.1 size=123593 2024-03-04T12:41:15.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.931+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=PM32ISR3CJY7 tag=3GTF5FJGFQZK type=write size=2220745 2024-03-04T12:41:15.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.932+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=S4LFMO7KBD3R type=del size=431277 2024-03-04T12:41:15.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.933+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~ATMROZ8MODWP.0 size=129653 2024-03-04T12:41:15.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.935+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=ATMROZ8MODWP tag=D4IIZM4GI1SL type=write size=1178229 2024-03-04T12:41:15.942 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.937+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~J13W7UF95FMO.0 size=1048576 2024-03-04T12:41:15.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.938+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~J13W7UF95FMO.1 size=832911 2024-03-04T12:41:15.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.938+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=J13W7UF95FMO tag=SO3AHR50BKGT type=write size=2930063 2024-03-04T12:41:15.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.940+0000 7f093583d780 1 < suggested update operation key=AQI7H63EQSTN tag=2FK2SBJ1P042 type=del size=1472333 2024-03-04T12:41:15.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.942+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~ZZZL3ULPMMV6.0 size=1048576 2024-03-04T12:41:15.948 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.943+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~ZZZL3ULPMMV6.1 size=416834 2024-03-04T12:41:15.948 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.943+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=ZZZL3ULPMMV6 tag=JHN5WRCBRZAC type=write size=2513986 2024-03-04T12:41:15.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.945+0000 7f093583d780 1 < suggested update operation key=2R5WA9Q9ZAUG tag=CT2OR4QDW67P type=del size=2928227 2024-03-04T12:41:15.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.946+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=SIP438E2VM17 type=del size=1555491 2024-03-04T12:41:15.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.947+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=F2WDEGEK3F1L type=del 2024-03-04T12:41:15.955 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.949+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~QJT9JLTZOH9H.0 size=1048576 2024-03-04T12:41:15.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.950+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~QJT9JLTZOH9H.1 size=34822 2024-03-04T12:41:15.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.950+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=QJT9JLTZOH9H tag=F794Q4N1VP9Z type=write size=2131974 2024-03-04T12:41:15.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.951+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=3WPN139ID2MH type=del 2024-03-04T12:41:15.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.953+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=GY9ZSMUVDLGN type=del size=3109362 2024-03-04T12:41:15.961 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.955+0000 7f093583d780 1 < suggested update operation key=OFTWI7UFD5L5 tag=59WPKP90UJB7 type=del size=3764480 2024-03-04T12:41:15.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.957+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=EIAK8U79IHEA type=del size=2333205 2024-03-04T12:41:15.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.958+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~IR6QFMAMNE33.0 size=1048576 2024-03-04T12:41:15.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.958+0000 7f093583d780 1 < canceled part key=_multipart_Y4D4Q7NV5VMO.2~IR6QFMAMNE33.1 size=1048576 2024-03-04T12:41:15.964 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.959+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~IR6QFMAMNE33.2 size=998329 2024-03-04T12:41:15.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.961+0000 7f093583d780 1 < canceled multipart upload key=Y4D4Q7NV5VMO upload=IR6QFMAMNE33 tag=G9HOXTI1CGC5 type=write size=4144057 2024-03-04T12:41:15.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.963+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~N15YZJDG3PVQ.0 size=654035 2024-03-04T12:41:15.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.963+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=N15YZJDG3PVQ tag=BD0X52GOBV07 type=write size=1702611 2024-03-04T12:41:15.971 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.966+0000 7f093583d780 1 < suggested remove operation key=OCOQJLUUNWRG tag=991IVDJQ7E2Y type=del 2024-03-04T12:41:15.973 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.968+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~8N6LB0D5AKWQ.0 size=18176 2024-03-04T12:41:15.973 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.968+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=8N6LB0D5AKWQ tag=2MFXXZTASFRC type=write size=1066752 2024-03-04T12:41:15.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.970+0000 7f093583d780 1 < suggested remove operation key=3F8GI0JCUR6W tag=19YYLV4X9XFL type=del 2024-03-04T12:41:15.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.971+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=UI3O6CIXK22C type=del size=472385 2024-03-04T12:41:15.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.973+0000 7f093583d780 1 < suggested update operation key=UAEQORB3BDBH tag=6UN97G20VMUZ type=del size=3816666 2024-03-04T12:41:15.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.974+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=D2Q5M75CTOCB type=del size=1739924 2024-03-04T12:41:15.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.976+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=YUPBX8JYHZOV type=del 2024-03-04T12:41:15.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.978+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~EEM0TLR8RAOP.0 size=1048576 2024-03-04T12:41:15.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.978+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~EEM0TLR8RAOP.1 size=412864 2024-03-04T12:41:15.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.978+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=EEM0TLR8RAOP tag=2KW67553YTCB type=write size=2510016 2024-03-04T12:41:15.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.981+0000 7f093583d780 1 < suggested remove operation key=UAEQORB3BDBH tag=YGVJNJN10F04 type=del 2024-03-04T12:41:15.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.983+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~NLVRKF3R2SKG.0 size=959177 2024-03-04T12:41:15.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.983+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=NLVRKF3R2SKG tag=6B1LGXE7FV45 type=write size=2007753 2024-03-04T12:41:15.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.984+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=G03BYGXACYUN type=del 2024-03-04T12:41:15.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.985+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=QCTK346N7OJB type=write size=190524 2024-03-04T12:41:15.992 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.986+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=15LKS2POIZB6 type=del 2024-03-04T12:41:15.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.988+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~0IHY3QWTSO9R.0 size=659656 2024-03-04T12:41:15.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.988+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=0IHY3QWTSO9R tag=2WP0MOSQYIDE type=write size=1708232 2024-03-04T12:41:15.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.989+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~OW1CRK9IIBU5.0 size=1048576 2024-03-04T12:41:15.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.990+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~OW1CRK9IIBU5.1 size=695190 2024-03-04T12:41:15.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.992+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=OW1CRK9IIBU5 tag=4TDLPOVZUJ9W type=write size=2792342 2024-03-04T12:41:15.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.993+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=FFMZJCWPRT02 type=del size=2844982 2024-03-04T12:41:16.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.994+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=S4LFMO7KBD3R type=del 2024-03-04T12:41:16.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.996+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=48YAFSV1SLAU type=del size=2821513 2024-03-04T12:41:16.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.996+0000 7f093583d780 1 < canceled part key=_multipart_GMKM2QEP072H.2~J13W7UF95FMO.0 size=1048576 2024-03-04T12:41:16.003 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.997+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~J13W7UF95FMO.1 size=832911 2024-03-04T12:41:16.004 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:15.999+0000 7f093583d780 1 < canceled multipart upload key=GMKM2QEP072H upload=J13W7UF95FMO tag=SO3AHR50BKGT type=write size=2930063 2024-03-04T12:41:16.005 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.000+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=90ML5LUS0ZJ8 type=del size=2789080 2024-03-04T12:41:16.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.001+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~ZZZL3ULPMMV6.0 size=1048576 2024-03-04T12:41:16.009 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.003+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~ZZZL3ULPMMV6.1 size=416834 2024-03-04T12:41:16.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.007+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=ZZZL3ULPMMV6 tag=JHN5WRCBRZAC type=write size=2513986 2024-03-04T12:41:16.013 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.008+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=GEKYSWRIL2ZX type=del size=939060 2024-03-04T12:41:16.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.009+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=SIP438E2VM17 type=del 2024-03-04T12:41:16.017 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.011+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~OK6844V7DQI7.0 size=1048576 2024-03-04T12:41:16.017 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.012+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~OK6844V7DQI7.1 size=1048576 2024-03-04T12:41:16.018 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.013+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~OK6844V7DQI7.2 size=528155 2024-03-04T12:41:16.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.013+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=OK6844V7DQI7 tag=RH5C341MW96T type=write size=3673883 2024-03-04T12:41:16.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.014+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~QJT9JLTZOH9H.0 size=1048576 2024-03-04T12:41:16.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.015+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~QJT9JLTZOH9H.1 size=34822 2024-03-04T12:41:16.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.017+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=QJT9JLTZOH9H tag=F794Q4N1VP9Z type=write size=2131974 2024-03-04T12:41:16.023 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.018+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=ZVJ4EK5Q91DD type=write size=444649 2024-03-04T12:41:16.025 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.020+0000 7f093583d780 1 < suggested remove operation key=L4UQK3UJFXZC tag=GY9ZSMUVDLGN type=del 2024-03-04T12:41:16.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.022+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~MGEIOJCU1D7Y.0 size=360243 2024-03-04T12:41:16.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.022+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=MGEIOJCU1D7Y tag=IEP9FUNR4B3H type=write size=1408819 2024-03-04T12:41:16.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.022+0000 7f093583d780 -1 < no bi entry to suggest for operation key=UAEQORB3BDBH tag=EIAK8U79IHEA type=del size=2333205: (2) No such file or directory 2024-03-04T12:41:16.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.024+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=RGK18LBW0DNV type=del size=3732489 2024-03-04T12:41:16.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.025+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~N15YZJDG3PVQ.0 size=654035 2024-03-04T12:41:16.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.026+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=N15YZJDG3PVQ tag=BD0X52GOBV07 type=write size=1702611 2024-03-04T12:41:16.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.028+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=ZP1FUBZGQB9S type=del size=3094385 2024-03-04T12:41:16.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.029+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~8N6LB0D5AKWQ.0 size=18176 2024-03-04T12:41:16.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.030+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=8N6LB0D5AKWQ tag=2MFXXZTASFRC type=write size=1066752 2024-03-04T12:41:16.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.032+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~WRU73WBG0SDQ.0 size=1048576 2024-03-04T12:41:16.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.033+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~WRU73WBG0SDQ.1 size=1048576 2024-03-04T12:41:16.040 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.034+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~WRU73WBG0SDQ.2 size=66321 2024-03-04T12:41:16.040 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.034+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=WRU73WBG0SDQ tag=QXWOY845PAKD type=write size=3212049 2024-03-04T12:41:16.041 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.035+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=UI3O6CIXK22C type=del 2024-03-04T12:41:16.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.036+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=CXNH9F2IW730 type=del size=1087941 2024-03-04T12:41:16.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.038+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=D2Q5M75CTOCB type=del 2024-03-04T12:41:16.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.039+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=BR0ERMHJPLGU type=del size=3956591 2024-03-04T12:41:16.045 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.040+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~EEM0TLR8RAOP.0 size=1048576 2024-03-04T12:41:16.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.041+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~EEM0TLR8RAOP.1 size=412864 2024-03-04T12:41:16.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.043+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=EEM0TLR8RAOP tag=2KW67553YTCB type=write size=2510016 2024-03-04T12:41:16.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.044+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=XYKMNXSOXEN4 type=del size=2667217 2024-03-04T12:41:16.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.045+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~NLVRKF3R2SKG.0 size=959177 2024-03-04T12:41:16.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.047+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=NLVRKF3R2SKG tag=6B1LGXE7FV45 type=write size=2007753 2024-03-04T12:41:16.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.048+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=8M5T0UO7CN79 type=del size=1214721 2024-03-04T12:41:16.054 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.049+0000 7f093583d780 1 < completed write operation key=I5NQBROT0WKE tag=QCTK346N7OJB type=write size=190524 2024-03-04T12:41:16.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.050+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=4FIE63VB8UXB type=del size=1516225 2024-03-04T12:41:16.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.051+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~0IHY3QWTSO9R.0 size=659656 2024-03-04T12:41:16.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.053+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=0IHY3QWTSO9R tag=2WP0MOSQYIDE type=write size=1708232 2024-03-04T12:41:16.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.055+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~BRQTKTIM62K5.0 size=469502 2024-03-04T12:41:16.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.055+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=BRQTKTIM62K5 tag=W8IWN0LK14LP type=write size=1518078 2024-03-04T12:41:16.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.057+0000 7f093583d780 1 < suggested remove operation key=2XVNK3YEVHJ7 tag=FFMZJCWPRT02 type=del 2024-03-04T12:41:16.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.060+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~6E8CUQW6TQYD.0 size=1048576 2024-03-04T12:41:16.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.060+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~6E8CUQW6TQYD.1 size=807172 2024-03-04T12:41:16.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.060+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=6E8CUQW6TQYD tag=H8WN0PNMDWKP type=write size=2904324 2024-03-04T12:41:16.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.063+0000 7f093583d780 1 < suggested update operation key=NFM6LT89K5F4 tag=48YAFSV1SLAU type=del size=2821513 2024-03-04T12:41:16.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.064+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=0VL7B86OCVJW type=write size=5853 2024-03-04T12:41:16.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.065+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=90ML5LUS0ZJ8 type=del 2024-03-04T12:41:16.073 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.067+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~JT074QPIT0Y9.0 size=1048576 2024-03-04T12:41:16.074 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.068+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~JT074QPIT0Y9.1 size=818724 2024-03-04T12:41:16.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.068+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=JT074QPIT0Y9 tag=XHZ2M5JKVRQJ type=write size=2915876 2024-03-04T12:41:16.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.069+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=GEKYSWRIL2ZX type=del 2024-03-04T12:41:16.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.075+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~UIIWNNNL0UQU.0 size=1007181 2024-03-04T12:41:16.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.075+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=UIIWNNNL0UQU tag=PYFMKX2ULM0A type=write size=2055757 2024-03-04T12:41:16.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.078+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~OK6844V7DQI7.0 size=1048576 2024-03-04T12:41:16.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.079+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~OK6844V7DQI7.1 size=1048576 2024-03-04T12:41:16.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.080+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~OK6844V7DQI7.2 size=528155 2024-03-04T12:41:16.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.082+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=OK6844V7DQI7 tag=RH5C341MW96T type=write size=3673883 2024-03-04T12:41:16.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.084+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=H08J9VVMS3J7 type=write size=792832 2024-03-04T12:41:16.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.085+0000 7f093583d780 1 < completed write operation key=F269PJEZ05IO tag=ZVJ4EK5Q91DD type=write size=444649 2024-03-04T12:41:16.093 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.087+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~D2UORUVRF4ZQ.0 size=1048576 2024-03-04T12:41:16.094 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.088+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~D2UORUVRF4ZQ.1 size=1048576 2024-03-04T12:41:16.095 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.089+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~D2UORUVRF4ZQ.2 size=329474 2024-03-04T12:41:16.095 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.089+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=D2UORUVRF4ZQ tag=9HKV9BTPWI0T type=write size=3475202 2024-03-04T12:41:16.096 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.090+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~MGEIOJCU1D7Y.0 size=360243 2024-03-04T12:41:16.098 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.092+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=MGEIOJCU1D7Y tag=IEP9FUNR4B3H type=write size=1408819 2024-03-04T12:41:16.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.094+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=TPBRCIN0221F type=del size=3315563 2024-03-04T12:41:16.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.095+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=RGK18LBW0DNV type=del 2024-03-04T12:41:16.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.097+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~R2KSBQRP68DJ.0 size=676173 2024-03-04T12:41:16.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.097+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=R2KSBQRP68DJ tag=I0S37OMRHIFS type=write size=1724749 2024-03-04T12:41:16.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.098+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=ZP1FUBZGQB9S type=del 2024-03-04T12:41:16.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.100+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=RN2R81WY1804 type=del size=375599 2024-03-04T12:41:16.106 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.101+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~WRU73WBG0SDQ.0 size=1048576 2024-03-04T12:41:16.108 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.102+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~WRU73WBG0SDQ.1 size=1048576 2024-03-04T12:41:16.109 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.103+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~WRU73WBG0SDQ.2 size=66321 2024-03-04T12:41:16.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.105+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=WRU73WBG0SDQ tag=QXWOY845PAKD type=write size=3212049 2024-03-04T12:41:16.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.106+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=6OL3CNHCKP8L type=del size=806341 2024-03-04T12:41:16.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.108+0000 7f093583d780 1 < completed delete operation key=O6OUISHWZ7FU tag=CXNH9F2IW730 type=del 2024-03-04T12:41:16.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.109+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=PNGIJ8G3NR95 type=del size=3305037 2024-03-04T12:41:16.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.110+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=BR0ERMHJPLGU type=del 2024-03-04T12:41:16.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.112+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~UHIXHC9I9MOX.0 size=1048576 2024-03-04T12:41:16.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.113+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~UHIXHC9I9MOX.1 size=992877 2024-03-04T12:41:16.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.113+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=UHIXHC9I9MOX tag=33DIXG428VM7 type=write size=3090029 2024-03-04T12:41:16.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.114+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=XYKMNXSOXEN4 type=del 2024-03-04T12:41:16.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.116+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=2VZXVRL5THPN type=del size=2877469 2024-03-04T12:41:16.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.117+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=8M5T0UO7CN79 type=del 2024-03-04T12:41:16.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.120+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~VA273DK7D2C1.0 size=1048576 2024-03-04T12:41:16.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.120+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~VA273DK7D2C1.1 size=1048576 2024-03-04T12:41:16.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.121+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~VA273DK7D2C1.2 size=176055 2024-03-04T12:41:16.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.121+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=VA273DK7D2C1 tag=X45SIYCLO3HJ type=write size=3321783 2024-03-04T12:41:16.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.122+0000 7f093583d780 -1 < failed to complete operation key=NFM6LT89K5F4 tag=4FIE63VB8UXB type=del size=1516225: (22) Invalid argument 2024-03-04T12:41:16.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.123+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=1TXQFZMCXDRE type=write size=366262 2024-03-04T12:41:16.130 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.125+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~BRQTKTIM62K5.0 size=469502 2024-03-04T12:41:16.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.126+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=BRQTKTIM62K5 tag=W8IWN0LK14LP type=write size=1518078 2024-03-04T12:41:16.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.128+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~WCGJH1CX21Q3.0 size=1048576 2024-03-04T12:41:16.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.129+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~WCGJH1CX21Q3.1 size=610269 2024-03-04T12:41:16.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.129+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=WCGJH1CX21Q3 tag=MKHAK2IQZGSF type=write size=2707421 2024-03-04T12:41:16.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.130+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~6E8CUQW6TQYD.0 size=1048576 2024-03-04T12:41:16.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.131+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~6E8CUQW6TQYD.1 size=807172 2024-03-04T12:41:16.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.133+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=6E8CUQW6TQYD tag=H8WN0PNMDWKP type=write size=2904324 2024-03-04T12:41:16.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.135+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~RVZRMOILWJJD.0 size=1048576 2024-03-04T12:41:16.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.136+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~RVZRMOILWJJD.1 size=1048576 2024-03-04T12:41:16.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.137+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~RVZRMOILWJJD.2 size=236681 2024-03-04T12:41:16.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.137+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=RVZRMOILWJJD tag=Z80XXZFN3OQT type=write size=3382409 2024-03-04T12:41:16.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.139+0000 7f093583d780 1 < suggested update operation key=2ZOV2JEQHXGS tag=0VL7B86OCVJW type=write size=5853 2024-03-04T12:41:16.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.141+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~CO2GM54M3YUC.0 size=979550 2024-03-04T12:41:16.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.141+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=CO2GM54M3YUC tag=FKECIUMS58UL type=write size=2028126 2024-03-04T12:41:16.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.141+0000 7f093583d780 1 < canceled part key=_multipart_Y4D4Q7NV5VMO.2~JT074QPIT0Y9.0 size=1048576 2024-03-04T12:41:16.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.142+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~JT074QPIT0Y9.1 size=818724 2024-03-04T12:41:16.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.144+0000 7f093583d780 1 < canceled multipart upload key=Y4D4Q7NV5VMO upload=JT074QPIT0Y9 tag=XHZ2M5JKVRQJ type=write size=2915876 2024-03-04T12:41:16.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.145+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=I2DUPNWPR9YL type=del size=1576035 2024-03-04T12:41:16.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.146+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~UIIWNNNL0UQU.0 size=1007181 2024-03-04T12:41:16.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.148+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=UIIWNNNL0UQU tag=PYFMKX2ULM0A type=write size=2055757 2024-03-04T12:41:16.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.149+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=CJGIPBDP4OY5 type=del size=1128704 2024-03-04T12:41:16.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.150+0000 7f093583d780 1 < completed write operation key=TMAI6MOG2C4N tag=H08J9VVMS3J7 type=write size=792832 2024-03-04T12:41:16.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.152+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~9APLNA076B44.0 size=1048576 2024-03-04T12:41:16.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.153+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~9APLNA076B44.1 size=1048576 2024-03-04T12:41:16.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.154+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~9APLNA076B44.2 size=940076 2024-03-04T12:41:16.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.154+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=9APLNA076B44 tag=KMLCIFVF0SPT type=write size=4085804 2024-03-04T12:41:16.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.155+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~D2UORUVRF4ZQ.0 size=1048576 2024-03-04T12:41:16.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.156+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~D2UORUVRF4ZQ.1 size=1048576 2024-03-04T12:41:16.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.156+0000 7f093583d780 1 < canceled part key=_multipart_U6F7IZ07CS9Q.2~D2UORUVRF4ZQ.2 size=329474 2024-03-04T12:41:16.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.158+0000 7f093583d780 1 < canceled multipart upload key=U6F7IZ07CS9Q upload=D2UORUVRF4ZQ tag=9HKV9BTPWI0T type=write size=3475202 2024-03-04T12:41:16.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.160+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~9TN3WEDQAIYU.0 size=1048576 2024-03-04T12:41:16.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.161+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~9TN3WEDQAIYU.1 size=450983 2024-03-04T12:41:16.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.161+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=9TN3WEDQAIYU tag=6325VF3OPY3F type=write size=2548135 2024-03-04T12:41:16.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.162+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=TPBRCIN0221F type=del 2024-03-04T12:41:16.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.163+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=84OZLCW0KQ2S type=del size=783639 2024-03-04T12:41:16.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.164+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~R2KSBQRP68DJ.0 size=676173 2024-03-04T12:41:16.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.166+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=R2KSBQRP68DJ tag=I0S37OMRHIFS type=write size=1724749 2024-03-04T12:41:16.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.168+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=MIYBK6VSL2DH type=del size=3463514 2024-03-04T12:41:16.174 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.169+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=RN2R81WY1804 type=del 2024-03-04T12:41:16.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.170+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=GOKA8X4A0VUI type=write size=839235 2024-03-04T12:41:16.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.171+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=6OL3CNHCKP8L type=del 2024-03-04T12:41:16.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.172+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=KOHTDRO0CHA4 type=del size=1908989 2024-03-04T12:41:16.179 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.173+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=PNGIJ8G3NR95 type=del 2024-03-04T12:41:16.181 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.176+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~DBFMG0JY5RN7.0 size=78759 2024-03-04T12:41:16.181 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.176+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=DBFMG0JY5RN7 tag=ADTURY0TU4Y7 type=write size=1127335 2024-03-04T12:41:16.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.177+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~UHIXHC9I9MOX.0 size=1048576 2024-03-04T12:41:16.183 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.178+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~UHIXHC9I9MOX.1 size=992877 2024-03-04T12:41:16.185 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.180+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=UHIXHC9I9MOX tag=33DIXG428VM7 type=write size=3090029 2024-03-04T12:41:16.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.182+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~63UNRA0DG6B7.0 size=1048576 2024-03-04T12:41:16.188 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.183+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~63UNRA0DG6B7.1 size=1048576 2024-03-04T12:41:16.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.184+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~63UNRA0DG6B7.2 size=772871 2024-03-04T12:41:16.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.184+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=63UNRA0DG6B7 tag=B1CU9CTFM8JW type=write size=3918599 2024-03-04T12:41:16.190 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.185+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=2VZXVRL5THPN type=del 2024-03-04T12:41:16.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.186+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=7G2TSV1F2QZ9 type=del size=3588433 2024-03-04T12:41:16.193 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.187+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~VA273DK7D2C1.0 size=1048576 2024-03-04T12:41:16.194 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.188+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~VA273DK7D2C1.1 size=1048576 2024-03-04T12:41:16.194 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.189+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~VA273DK7D2C1.2 size=176055 2024-03-04T12:41:16.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.191+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=VA273DK7D2C1 tag=X45SIYCLO3HJ type=write size=3321783 2024-03-04T12:41:16.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.194+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=FURD78XG0DJN type=del size=3583002 2024-03-04T12:41:16.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.195+0000 7f093583d780 1 < completed write operation key=9E12MS7PETOK tag=1TXQFZMCXDRE type=write size=366262 2024-03-04T12:41:16.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.196+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=B3MCCS6L69Z0 type=del size=2400167 2024-03-04T12:41:16.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.198+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~WCGJH1CX21Q3.0 size=1048576 2024-03-04T12:41:16.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.199+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~WCGJH1CX21Q3.1 size=610269 2024-03-04T12:41:16.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.201+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=WCGJH1CX21Q3 tag=MKHAK2IQZGSF type=write size=2707421 2024-03-04T12:41:16.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.202+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=TBHT7A9JUOCO type=write size=735723 2024-03-04T12:41:16.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.203+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~RVZRMOILWJJD.0 size=1048576 2024-03-04T12:41:16.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.204+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~RVZRMOILWJJD.1 size=1048576 2024-03-04T12:41:16.210 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.204+0000 7f093583d780 1 < canceled part key=_multipart_I5NQBROT0WKE.2~RVZRMOILWJJD.2 size=236681 2024-03-04T12:41:16.212 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.207+0000 7f093583d780 1 < canceled multipart upload key=I5NQBROT0WKE upload=RVZRMOILWJJD tag=Z80XXZFN3OQT type=write size=3382409 2024-03-04T12:41:16.213 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.208+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=98I2M11WFSUK type=del size=1249843 2024-03-04T12:41:16.214 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.209+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~CO2GM54M3YUC.0 size=979550 2024-03-04T12:41:16.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.211+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=CO2GM54M3YUC tag=FKECIUMS58UL type=write size=2028126 2024-03-04T12:41:16.218 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.213+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~IIY68U944LNX.0 size=1048576 2024-03-04T12:41:16.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.214+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~IIY68U944LNX.1 size=1048576 2024-03-04T12:41:16.220 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.215+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~IIY68U944LNX.2 size=972331 2024-03-04T12:41:16.220 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.215+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=IIY68U944LNX tag=C1A8R2Q7NF7A type=write size=4118059 2024-03-04T12:41:16.222 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.217+0000 7f093583d780 1 < suggested remove operation key=2YD2M0JQNCC0 tag=I2DUPNWPR9YL type=del 2024-03-04T12:41:16.223 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.218+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=JN6ZKO90O7NF type=del size=810357 2024-03-04T12:41:16.225 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.219+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=CJGIPBDP4OY5 type=del 2024-03-04T12:41:16.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.220+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=TFYRB2NDWKPY type=del size=2813198 2024-03-04T12:41:16.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.222+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~9APLNA076B44.0 size=1048576 2024-03-04T12:41:16.228 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.223+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~9APLNA076B44.1 size=1048576 2024-03-04T12:41:16.228 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.223+0000 7f093583d780 1 < canceled part key=_multipart_GJ0FQ6EH9HJL.2~9APLNA076B44.2 size=940076 2024-03-04T12:41:16.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.226+0000 7f093583d780 1 < canceled multipart upload key=GJ0FQ6EH9HJL upload=9APLNA076B44 tag=KMLCIFVF0SPT type=write size=4085804 2024-03-04T12:41:16.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.228+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~SBMY3KC6JNFQ.0 size=1048576 2024-03-04T12:41:16.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.229+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~SBMY3KC6JNFQ.1 size=1048576 2024-03-04T12:41:16.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.230+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~SBMY3KC6JNFQ.2 size=801681 2024-03-04T12:41:16.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.230+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=SBMY3KC6JNFQ tag=IAOS3G3MZZ59 type=write size=3947409 2024-03-04T12:41:16.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.231+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~9TN3WEDQAIYU.0 size=1048576 2024-03-04T12:41:16.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.232+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~9TN3WEDQAIYU.1 size=450983 2024-03-04T12:41:16.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.234+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=9TN3WEDQAIYU tag=6325VF3OPY3F type=write size=2548135 2024-03-04T12:41:16.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.235+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=53T4YF7Q9ASL type=del size=3720930 2024-03-04T12:41:16.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.236+0000 7f093583d780 1 < canceled operation key=AQI7H63EQSTN tag=84OZLCW0KQ2S type=del size=783639 2024-03-04T12:41:16.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.237+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=PY0N82LUVJYZ type=write size=606036 2024-03-04T12:41:16.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.238+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=MIYBK6VSL2DH type=del 2024-03-04T12:41:16.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.240+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=4JSMG7S38R1M type=del size=2767205 2024-03-04T12:41:16.246 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.241+0000 7f093583d780 1 < completed write operation key=F269PJEZ05IO tag=GOKA8X4A0VUI type=write size=839235 2024-03-04T12:41:16.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.242+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=39AXFUDCLQOX type=del size=67085 2024-03-04T12:41:16.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.244+0000 7f093583d780 1 < suggested remove operation key=O6OUISHWZ7FU tag=KOHTDRO0CHA4 type=del 2024-03-04T12:41:16.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.245+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=79AYTJD86R0O type=del size=429367 2024-03-04T12:41:16.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.246+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~DBFMG0JY5RN7.0 size=78759 2024-03-04T12:41:16.254 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.248+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=DBFMG0JY5RN7 tag=ADTURY0TU4Y7 type=write size=1127335 2024-03-04T12:41:16.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.250+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~D84IP8WRNY0C.0 size=1048576 2024-03-04T12:41:16.257 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.251+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~D84IP8WRNY0C.1 size=290525 2024-03-04T12:41:16.257 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.251+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=D84IP8WRNY0C tag=1LWGH4C0GNSL type=write size=2387677 2024-03-04T12:41:16.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.252+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~63UNRA0DG6B7.0 size=1048576 2024-03-04T12:41:16.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.252+0000 7f093583d780 1 < canceled part key=_multipart_Q45PKXZVJ6YS.2~63UNRA0DG6B7.1 size=1048576 2024-03-04T12:41:16.259 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.253+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~63UNRA0DG6B7.2 size=772871 2024-03-04T12:41:16.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.255+0000 7f093583d780 1 < canceled multipart upload key=Q45PKXZVJ6YS upload=63UNRA0DG6B7 tag=B1CU9CTFM8JW type=write size=3918599 2024-03-04T12:41:16.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.257+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~2XL3GKO95PO4.0 size=1048576 2024-03-04T12:41:16.264 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.258+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~2XL3GKO95PO4.1 size=680933 2024-03-04T12:41:16.264 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.258+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=2XL3GKO95PO4 tag=0O2EX58FG3KL type=write size=2778085 2024-03-04T12:41:16.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.260+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=7G2TSV1F2QZ9 type=del 2024-03-04T12:41:16.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.262+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~IFM3KMRGB20B.0 size=1048576 2024-03-04T12:41:16.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.263+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~IFM3KMRGB20B.1 size=1048576 2024-03-04T12:41:16.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.264+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~IFM3KMRGB20B.2 size=61886 2024-03-04T12:41:16.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.264+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=IFM3KMRGB20B tag=0F82ASGEJNDT type=write size=3207614 2024-03-04T12:41:16.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.266+0000 7f093583d780 1 < suggested update operation key=2XVNK3YEVHJ7 tag=FURD78XG0DJN type=del size=3583002 2024-03-04T12:41:16.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.268+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~U4NSPLJWWTM3.0 size=1048576 2024-03-04T12:41:16.275 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.269+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~U4NSPLJWWTM3.1 size=619526 2024-03-04T12:41:16.275 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.269+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=U4NSPLJWWTM3 tag=8H3DCQPCYUY3 type=write size=2716678 2024-03-04T12:41:16.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.270+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=B3MCCS6L69Z0 type=del 2024-03-04T12:41:16.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.272+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~I5WI9GJYQOPD.0 size=135297 2024-03-04T12:41:16.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.272+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=I5WI9GJYQOPD tag=YTC3N05MBXG2 type=write size=1183873 2024-03-04T12:41:16.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.273+0000 7f093583d780 1 < completed write operation key=OCOQJLUUNWRG tag=TBHT7A9JUOCO type=write size=735723 2024-03-04T12:41:16.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.275+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=WBSZRJHT4M4A type=del size=1166580 2024-03-04T12:41:16.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.276+0000 7f093583d780 -1 < failed to complete operation key=2XVNK3YEVHJ7 tag=98I2M11WFSUK type=del size=1249843: (22) Invalid argument 2024-03-04T12:41:16.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.277+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=HAV7LM515P3G type=del size=2063249 2024-03-04T12:41:16.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.278+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~IIY68U944LNX.0 size=1048576 2024-03-04T12:41:16.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.279+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~IIY68U944LNX.1 size=1048576 2024-03-04T12:41:16.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.280+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~IIY68U944LNX.2 size=972331 2024-03-04T12:41:16.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.282+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=IIY68U944LNX tag=C1A8R2Q7NF7A type=write size=4118059 2024-03-04T12:41:16.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.284+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~W5HNSJ8MEM2I.0 size=1048576 2024-03-04T12:41:16.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.285+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~W5HNSJ8MEM2I.1 size=835443 2024-03-04T12:41:16.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.285+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=W5HNSJ8MEM2I tag=TZVJRWABD4BF type=write size=2932595 2024-03-04T12:41:16.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.288+0000 7f093583d780 1 < suggested remove operation key=TMAI6MOG2C4N tag=JN6ZKO90O7NF type=del 2024-03-04T12:41:16.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.289+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=00X3W9770CSC type=del size=3651644 2024-03-04T12:41:16.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.290+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=TFYRB2NDWKPY type=del 2024-03-04T12:41:16.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.292+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~PLMQCRR0N39K.0 size=270009 2024-03-04T12:41:16.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.292+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=PLMQCRR0N39K tag=VL8HUEHZMSVG type=write size=1318585 2024-03-04T12:41:16.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.293+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~SBMY3KC6JNFQ.0 size=1048576 2024-03-04T12:41:16.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.294+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~SBMY3KC6JNFQ.1 size=1048576 2024-03-04T12:41:16.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.295+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~SBMY3KC6JNFQ.2 size=801681 2024-03-04T12:41:16.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.297+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=SBMY3KC6JNFQ tag=IAOS3G3MZZ59 type=write size=3947409 2024-03-04T12:41:16.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.299+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=SEAX1AT5AD82 type=del size=3202838 2024-03-04T12:41:16.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.300+0000 7f093583d780 1 < canceled operation key=Y4D4Q7NV5VMO tag=53T4YF7Q9ASL type=del size=3720930 2024-03-04T12:41:16.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.302+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~AJSF3QKDBJ8I.0 size=1048576 2024-03-04T12:41:16.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.304+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~AJSF3QKDBJ8I.1 size=896853 2024-03-04T12:41:16.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.304+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=AJSF3QKDBJ8I tag=9OVKXMOVTL4B type=write size=2994005 2024-03-04T12:41:16.310 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.305+0000 7f093583d780 1 < completed write operation key=J6Y9V11BX06B tag=PY0N82LUVJYZ type=write size=606036 2024-03-04T12:41:16.311 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.306+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=E00RUJDJXP64 type=del size=4083146 2024-03-04T12:41:16.313 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.307+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=4JSMG7S38R1M type=del 2024-03-04T12:41:16.314 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.308+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=2BO585WU8ZQ8 type=write size=1022630 2024-03-04T12:41:16.315 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.309+0000 7f093583d780 -1 < failed to complete operation key=2XVNK3YEVHJ7 tag=39AXFUDCLQOX type=del size=67085: (22) Invalid argument 2024-03-04T12:41:16.317 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.312+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~J3DNJJ16J3MM.0 size=1048576 2024-03-04T12:41:16.318 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.312+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~J3DNJJ16J3MM.1 size=1048576 2024-03-04T12:41:16.319 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.313+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~J3DNJJ16J3MM.2 size=565292 2024-03-04T12:41:16.319 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.313+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=J3DNJJ16J3MM tag=V8G8XLPTA0NR type=write size=3711020 2024-03-04T12:41:16.320 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.315+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=79AYTJD86R0O type=del 2024-03-04T12:41:16.321 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.316+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=TPGGASUCGY13 type=del size=811686 2024-03-04T12:41:16.322 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.317+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~D84IP8WRNY0C.0 size=1048576 2024-03-04T12:41:16.323 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.318+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~D84IP8WRNY0C.1 size=290525 2024-03-04T12:41:16.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.320+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=D84IP8WRNY0C tag=1LWGH4C0GNSL type=write size=2387677 2024-03-04T12:41:16.326 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.321+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=L8HJ1ZFPYW18 type=del size=3401106 2024-03-04T12:41:16.328 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.322+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~2XL3GKO95PO4.0 size=1048576 2024-03-04T12:41:16.328 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.323+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~2XL3GKO95PO4.1 size=680933 2024-03-04T12:41:16.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.325+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=2XL3GKO95PO4 tag=0O2EX58FG3KL type=write size=2778085 2024-03-04T12:41:16.332 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.326+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=TKMP7FJ4LAWO type=del size=906034 2024-03-04T12:41:16.333 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.327+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~IFM3KMRGB20B.0 size=1048576 2024-03-04T12:41:16.333 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.327+0000 7f093583d780 1 < canceled part key=_multipart_GMKM2QEP072H.2~IFM3KMRGB20B.1 size=1048576 2024-03-04T12:41:16.334 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.328+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~IFM3KMRGB20B.2 size=61886 2024-03-04T12:41:16.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.330+0000 7f093583d780 1 < canceled multipart upload key=GMKM2QEP072H upload=IFM3KMRGB20B tag=0F82ASGEJNDT type=write size=3207614 2024-03-04T12:41:16.337 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.331+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=30D8KUSP08D6 type=del size=1698858 2024-03-04T12:41:16.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.332+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~U4NSPLJWWTM3.0 size=1048576 2024-03-04T12:41:16.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.335+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~U4NSPLJWWTM3.1 size=619526 2024-03-04T12:41:16.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.337+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=U4NSPLJWWTM3 tag=8H3DCQPCYUY3 type=write size=2716678 2024-03-04T12:41:16.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.338+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=7BWYME0ZUPKR type=del size=2394202 2024-03-04T12:41:16.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.338+0000 7f093583d780 1 < canceled part key=_multipart_3F8GI0JCUR6W.2~I5WI9GJYQOPD.0 size=135297 2024-03-04T12:41:16.345 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.340+0000 7f093583d780 1 < canceled multipart upload key=3F8GI0JCUR6W upload=I5WI9GJYQOPD tag=YTC3N05MBXG2 type=write size=1183873 2024-03-04T12:41:16.347 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.341+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=3G0OFLPJCPO8 type=del size=4036508 2024-03-04T12:41:16.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.343+0000 7f093583d780 1 < suggested update operation key=U6F7IZ07CS9Q tag=WBSZRJHT4M4A type=del size=1166580 2024-03-04T12:41:16.351 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.346+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~LL9DZHB4LSX1.0 size=936442 2024-03-04T12:41:16.351 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.346+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=LL9DZHB4LSX1 tag=WFV09UEESFNH type=write size=1985018 2024-03-04T12:41:16.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.347+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=HAV7LM515P3G type=del 2024-03-04T12:41:16.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.348+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=2JYVQPZC2MF4 type=del size=2218660 2024-03-04T12:41:16.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.349+0000 7f093583d780 1 < canceled part key=_multipart_I5NQBROT0WKE.2~W5HNSJ8MEM2I.0 size=1048576 2024-03-04T12:41:16.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.349+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~W5HNSJ8MEM2I.1 size=835443 2024-03-04T12:41:16.357 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.351+0000 7f093583d780 1 < canceled multipart upload key=I5NQBROT0WKE upload=W5HNSJ8MEM2I tag=TZVJRWABD4BF type=write size=2932595 2024-03-04T12:41:16.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.353+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=ZXU3CT4ZFQAD type=del size=2702009 2024-03-04T12:41:16.359 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.354+0000 7f093583d780 1 < canceled operation key=NQF43I07F2HT tag=00X3W9770CSC type=del size=3651644 2024-03-04T12:41:16.360 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.355+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=0UXUSC1B7K1R type=write size=466319 2024-03-04T12:41:16.361 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.356+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~PLMQCRR0N39K.0 size=270009 2024-03-04T12:41:16.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.358+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=PLMQCRR0N39K tag=VL8HUEHZMSVG type=write size=1318585 2024-03-04T12:41:16.364 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.359+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=41HWWIONWXEN type=del size=1700976 2024-03-04T12:41:16.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.360+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=SEAX1AT5AD82 type=del 2024-03-04T12:41:16.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.363+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~7G453KOFK31Z.0 size=917536 2024-03-04T12:41:16.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.363+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=7G453KOFK31Z tag=5G6DMB6O63M0 type=write size=1966112 2024-03-04T12:41:16.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.363+0000 7f093583d780 1 < canceled part key=_multipart_FT2XNJYYT30J.2~AJSF3QKDBJ8I.0 size=1048576 2024-03-04T12:41:16.369 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.364+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~AJSF3QKDBJ8I.1 size=896853 2024-03-04T12:41:16.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.366+0000 7f093583d780 1 < canceled multipart upload key=FT2XNJYYT30J upload=AJSF3QKDBJ8I tag=9OVKXMOVTL4B type=write size=2994005 2024-03-04T12:41:16.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.367+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=UYI6TJ0Q15L5 type=del size=1429343 2024-03-04T12:41:16.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.368+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=E00RUJDJXP64 type=del 2024-03-04T12:41:16.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.370+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~8IW77LZ37F91.0 size=1048576 2024-03-04T12:41:16.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.371+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~8IW77LZ37F91.1 size=956129 2024-03-04T12:41:16.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.371+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=8IW77LZ37F91 tag=D0MNT9A1PNEE type=write size=3053281 2024-03-04T12:41:16.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.372+0000 7f093583d780 1 < completed write operation key=OFTWI7UFD5L5 tag=2BO585WU8ZQ8 type=write size=1022630 2024-03-04T12:41:16.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.374+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~Q7XGAC3ORSEY.0 size=1048576 2024-03-04T12:41:16.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.375+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~Q7XGAC3ORSEY.1 size=123384 2024-03-04T12:41:16.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.375+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=Q7XGAC3ORSEY tag=4XDYPRN1HYQQ type=write size=2220536 2024-03-04T12:41:16.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.377+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~J3DNJJ16J3MM.0 size=1048576 2024-03-04T12:41:16.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.378+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~J3DNJJ16J3MM.1 size=1048576 2024-03-04T12:41:16.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.379+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~J3DNJJ16J3MM.2 size=565292 2024-03-04T12:41:16.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.381+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=J3DNJJ16J3MM tag=V8G8XLPTA0NR type=write size=3711020 2024-03-04T12:41:16.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.383+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~8MMB34PY4JQ7.0 size=1048576 2024-03-04T12:41:16.389 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.384+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~8MMB34PY4JQ7.1 size=1048576 2024-03-04T12:41:16.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.384+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~8MMB34PY4JQ7.2 size=133338 2024-03-04T12:41:16.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.384+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=8MMB34PY4JQ7 tag=4TO63KCD49PZ type=write size=3279066 2024-03-04T12:41:16.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.386+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=TPGGASUCGY13 type=del 2024-03-04T12:41:16.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.388+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~2RH9TO3HBX4V.0 size=1048576 2024-03-04T12:41:16.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.389+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~2RH9TO3HBX4V.1 size=19765 2024-03-04T12:41:16.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.389+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=2RH9TO3HBX4V tag=9QYACHIFUNPQ type=write size=2116917 2024-03-04T12:41:16.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.391+0000 7f093583d780 1 < suggested update operation key=9E12MS7PETOK tag=L8HJ1ZFPYW18 type=del size=3401106 2024-03-04T12:41:16.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.392+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=UAKUS5GU811I type=del size=1925005 2024-03-04T12:41:16.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.393+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=TKMP7FJ4LAWO type=del 2024-03-04T12:41:16.401 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.395+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~74KWZIDZS8PF.0 size=94696 2024-03-04T12:41:16.401 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.395+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=74KWZIDZS8PF tag=5KG5Z7WXOX7J type=write size=1143272 2024-03-04T12:41:16.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.398+0000 7f093583d780 1 < suggested remove operation key=GMKM2QEP072H tag=30D8KUSP08D6 type=del 2024-03-04T12:41:16.404 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.399+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=1MNOLWXYTK3D type=write size=247964 2024-03-04T12:41:16.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.400+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=7BWYME0ZUPKR type=del 2024-03-04T12:41:16.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.402+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~JMXCM4LQL584.0 size=1048576 2024-03-04T12:41:16.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.403+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~JMXCM4LQL584.1 size=1048576 2024-03-04T12:41:16.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.404+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~JMXCM4LQL584.2 size=404839 2024-03-04T12:41:16.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.404+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=JMXCM4LQL584 tag=VP9861G5RQDH type=write size=3550567 2024-03-04T12:41:16.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.405+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=3G0OFLPJCPO8 type=del 2024-03-04T12:41:16.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.406+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=118BQEW9ULMV type=del size=3347300 2024-03-04T12:41:16.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.408+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~LL9DZHB4LSX1.0 size=936442 2024-03-04T12:41:16.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.412+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=LL9DZHB4LSX1 tag=WFV09UEESFNH type=write size=1985018 2024-03-04T12:41:16.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.414+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~669AHHDX3Q5Z.0 size=1048576 2024-03-04T12:41:16.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.415+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~669AHHDX3Q5Z.1 size=1048576 2024-03-04T12:41:16.422 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.416+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~669AHHDX3Q5Z.2 size=713059 2024-03-04T12:41:16.422 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.416+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=669AHHDX3Q5Z tag=D9OW5I1QMBRO type=write size=3858787 2024-03-04T12:41:16.423 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.417+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=2JYVQPZC2MF4 type=del 2024-03-04T12:41:16.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.420+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~3OCWN7QLMHN6.0 size=1048576 2024-03-04T12:41:16.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.421+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~3OCWN7QLMHN6.1 size=1048576 2024-03-04T12:41:16.427 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.422+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~3OCWN7QLMHN6.2 size=722467 2024-03-04T12:41:16.427 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.422+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=3OCWN7QLMHN6 tag=VLKST43RZP04 type=write size=3868195 2024-03-04T12:41:16.429 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.423+0000 7f093583d780 -1 < failed to complete operation key=GMKM2QEP072H tag=ZXU3CT4ZFQAD type=del size=2702009: (22) Invalid argument 2024-03-04T12:41:16.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.425+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~E09VKE2XIXBV.0 size=1048576 2024-03-04T12:41:16.432 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.426+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~E09VKE2XIXBV.1 size=1048576 2024-03-04T12:41:16.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.427+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~E09VKE2XIXBV.2 size=970878 2024-03-04T12:41:16.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.427+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=E09VKE2XIXBV tag=T57KTLH042YC type=write size=4116606 2024-03-04T12:41:16.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.428+0000 7f093583d780 1 < completed write operation key=M0AOZ89IQNSK tag=0UXUSC1B7K1R type=write size=466319 2024-03-04T12:41:16.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.430+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=RPK7TY5OCK37 type=del size=1251534 2024-03-04T12:41:16.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.432+0000 7f093583d780 1 < suggested remove operation key=9VKN43CB955V tag=41HWWIONWXEN type=del 2024-03-04T12:41:16.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.433+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=P61JGT1T09ZI type=del size=2596540 2024-03-04T12:41:16.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.434+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~7G453KOFK31Z.0 size=917536 2024-03-04T12:41:16.441 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.436+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=7G453KOFK31Z tag=5G6DMB6O63M0 type=write size=1966112 2024-03-04T12:41:16.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.438+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~PKAS29EKEG4P.0 size=551190 2024-03-04T12:41:16.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.438+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=PKAS29EKEG4P tag=AK6ROIWO9MEG type=write size=1599766 2024-03-04T12:41:16.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.439+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=UYI6TJ0Q15L5 type=del 2024-03-04T12:41:16.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.440+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=FL8604771VVW type=del size=3172670 2024-03-04T12:41:16.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.441+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~8IW77LZ37F91.0 size=1048576 2024-03-04T12:41:16.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.442+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~8IW77LZ37F91.1 size=956129 2024-03-04T12:41:16.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.444+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=8IW77LZ37F91 tag=D0MNT9A1PNEE type=write size=3053281 2024-03-04T12:41:16.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.446+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=P1RF8BOO3IV5 type=write size=1030519 2024-03-04T12:41:16.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.447+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~Q7XGAC3ORSEY.0 size=1048576 2024-03-04T12:41:16.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.448+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~Q7XGAC3ORSEY.1 size=123384 2024-03-04T12:41:16.455 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.450+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=Q7XGAC3ORSEY tag=4XDYPRN1HYQQ type=write size=2220536 2024-03-04T12:41:16.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.451+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~MJXI8PLNX8NS.0 size=1048576 2024-03-04T12:41:16.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.452+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~MJXI8PLNX8NS.1 size=1048576 2024-03-04T12:41:16.459 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.453+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~MJXI8PLNX8NS.2 size=12433 2024-03-04T12:41:16.459 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.453+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=MJXI8PLNX8NS tag=1QKJ3QLTNK23 type=write size=3158161 2024-03-04T12:41:16.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.454+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~8MMB34PY4JQ7.0 size=1048576 2024-03-04T12:41:16.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.455+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~8MMB34PY4JQ7.1 size=1048576 2024-03-04T12:41:16.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.456+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~8MMB34PY4JQ7.2 size=133338 2024-03-04T12:41:16.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.458+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=8MMB34PY4JQ7 tag=4TO63KCD49PZ type=write size=3279066 2024-03-04T12:41:16.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.459+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=QPDSP2A1MVY3 type=del size=3135754 2024-03-04T12:41:16.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.460+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~2RH9TO3HBX4V.0 size=1048576 2024-03-04T12:41:16.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.461+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~2RH9TO3HBX4V.1 size=19765 2024-03-04T12:41:16.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.463+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=2RH9TO3HBX4V tag=9QYACHIFUNPQ type=write size=2116917 2024-03-04T12:41:16.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.464+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=CXUKRODFEN0O type=del size=2426838 2024-03-04T12:41:16.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.465+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=UAKUS5GU811I type=del 2024-03-04T12:41:16.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.467+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=F64GG64LKIBJ type=del size=1741811 2024-03-04T12:41:16.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.468+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~74KWZIDZS8PF.0 size=94696 2024-03-04T12:41:16.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.470+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=74KWZIDZS8PF tag=5KG5Z7WXOX7J type=write size=1143272 2024-03-04T12:41:16.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.472+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~LCFZW7T110M0.0 size=602457 2024-03-04T12:41:16.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.472+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=LCFZW7T110M0 tag=HEAAEHHPJDUO type=write size=1651033 2024-03-04T12:41:16.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.474+0000 7f093583d780 1 < completed write operation key=F269PJEZ05IO tag=1MNOLWXYTK3D type=write size=247964 2024-03-04T12:41:16.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.475+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=YRCLXVFMF50L type=del size=2940038 2024-03-04T12:41:16.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.475+0000 7f093583d780 1 < canceled part key=_multipart_AQI7H63EQSTN.2~JMXCM4LQL584.0 size=1048576 2024-03-04T12:41:16.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.476+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~JMXCM4LQL584.1 size=1048576 2024-03-04T12:41:16.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.476+0000 7f093583d780 1 < canceled part key=_multipart_AQI7H63EQSTN.2~JMXCM4LQL584.2 size=404839 2024-03-04T12:41:16.484 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.478+0000 7f093583d780 1 < canceled multipart upload key=AQI7H63EQSTN upload=JMXCM4LQL584 tag=VP9861G5RQDH type=write size=3550567 2024-03-04T12:41:16.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.481+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~GPGAXALZTDUO.0 size=1048576 2024-03-04T12:41:16.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.482+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~GPGAXALZTDUO.1 size=597988 2024-03-04T12:41:16.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.482+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=GPGAXALZTDUO tag=FSNZDGYGY8JL type=write size=2695140 2024-03-04T12:41:16.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.483+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=118BQEW9ULMV type=del 2024-03-04T12:41:16.490 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.484+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=EZ6Q9P649I09 type=del size=1953772 2024-03-04T12:41:16.491 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.485+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~669AHHDX3Q5Z.0 size=1048576 2024-03-04T12:41:16.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.486+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~669AHHDX3Q5Z.1 size=1048576 2024-03-04T12:41:16.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.487+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~669AHHDX3Q5Z.2 size=713059 2024-03-04T12:41:16.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.490+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=669AHHDX3Q5Z tag=D9OW5I1QMBRO type=write size=3858787 2024-03-04T12:41:16.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.492+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~JFA1GD840JR4.0 size=786839 2024-03-04T12:41:16.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.492+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=JFA1GD840JR4 tag=ZGDG1HSRLS0T type=write size=1835415 2024-03-04T12:41:16.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.493+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~3OCWN7QLMHN6.0 size=1048576 2024-03-04T12:41:16.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.494+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~3OCWN7QLMHN6.1 size=1048576 2024-03-04T12:41:16.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.495+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~3OCWN7QLMHN6.2 size=722467 2024-03-04T12:41:16.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.497+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=3OCWN7QLMHN6 tag=VLKST43RZP04 type=write size=3868195 2024-03-04T12:41:16.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.499+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=U0B81BY4IHVC type=del size=3588453 2024-03-04T12:41:16.506 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.500+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~E09VKE2XIXBV.0 size=1048576 2024-03-04T12:41:16.508 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.503+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~E09VKE2XIXBV.1 size=1048576 2024-03-04T12:41:16.509 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.504+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~E09VKE2XIXBV.2 size=970878 2024-03-04T12:41:16.511 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.506+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=E09VKE2XIXBV tag=T57KTLH042YC type=write size=4116606 2024-03-04T12:41:16.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.508+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~CR2M9I841UO2.0 size=683 2024-03-04T12:41:16.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.508+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=CR2M9I841UO2 tag=0QCTRUFGSVJ6 type=write size=1049259 2024-03-04T12:41:16.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.510+0000 7f093583d780 1 < suggested remove operation key=OCOQJLUUNWRG tag=RPK7TY5OCK37 type=del 2024-03-04T12:41:16.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.511+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=QQZN9OL71OZH type=del size=1088496 2024-03-04T12:41:16.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.513+0000 7f093583d780 1 < suggested update operation key=PT63VLFQQN0E tag=P61JGT1T09ZI type=del size=2596540 2024-03-04T12:41:16.520 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.514+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=MHSRVA9OCV6O type=del size=3595629 2024-03-04T12:41:16.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.515+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~PKAS29EKEG4P.0 size=551190 2024-03-04T12:41:16.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.517+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=PKAS29EKEG4P tag=AK6ROIWO9MEG type=write size=1599766 2024-03-04T12:41:16.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.518+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=1TW71Q5TH6H0 type=del size=436721 2024-03-04T12:41:16.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.519+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=FL8604771VVW type=del 2024-03-04T12:41:16.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.523+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~5MS412TZIJPF.0 size=1048576 2024-03-04T12:41:16.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.524+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~5MS412TZIJPF.1 size=2769 2024-03-04T12:41:16.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.524+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=5MS412TZIJPF tag=36TTJ0UGNZOQ type=write size=2099921 2024-03-04T12:41:16.532 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.527+0000 7f093583d780 1 < suggested update operation key=I5NQBROT0WKE tag=P1RF8BOO3IV5 type=write size=1030519 2024-03-04T12:41:16.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.529+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~QAW07NQRQM0K.0 size=1048576 2024-03-04T12:41:16.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.530+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~QAW07NQRQM0K.1 size=605373 2024-03-04T12:41:16.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.530+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=QAW07NQRQM0K tag=2C56M80CE4QC type=write size=2702525 2024-03-04T12:41:16.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.531+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~MJXI8PLNX8NS.0 size=1048576 2024-03-04T12:41:16.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.532+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~MJXI8PLNX8NS.1 size=1048576 2024-03-04T12:41:16.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.532+0000 7f093583d780 1 < canceled part key=_multipart_HG0EM344TJZY.2~MJXI8PLNX8NS.2 size=12433 2024-03-04T12:41:16.539 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.533+0000 7f093583d780 1 < canceled multipart upload key=HG0EM344TJZY upload=MJXI8PLNX8NS tag=1QKJ3QLTNK23 type=write size=3158161 2024-03-04T12:41:16.540 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.535+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=5UAGJJEPS2JE type=del size=447203 2024-03-04T12:41:16.541 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.536+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=QPDSP2A1MVY3 type=del 2024-03-04T12:41:16.542 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.537+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=CH3Q31UQIBY9 type=write size=248711 2024-03-04T12:41:16.543 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.538+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=CXUKRODFEN0O type=del 2024-03-04T12:41:16.545 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.539+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=PDCK504WZJ2O type=del size=2558327 2024-03-04T12:41:16.546 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.540+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=F64GG64LKIBJ type=del 2024-03-04T12:41:16.548 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.542+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~IKHE6QZOX2UF.0 size=336977 2024-03-04T12:41:16.548 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.542+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=IKHE6QZOX2UF tag=T2M4A56D6WYJ type=write size=1385553 2024-03-04T12:41:16.549 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.543+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~LCFZW7T110M0.0 size=602457 2024-03-04T12:41:16.551 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.545+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=LCFZW7T110M0 tag=HEAAEHHPJDUO type=write size=1651033 2024-03-04T12:41:16.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.547+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~V1C4B7QTEACE.0 size=1048576 2024-03-04T12:41:16.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.548+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~V1C4B7QTEACE.1 size=1048576 2024-03-04T12:41:16.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.549+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~V1C4B7QTEACE.2 size=124565 2024-03-04T12:41:16.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.549+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=V1C4B7QTEACE tag=84XJHTZBCEIE type=write size=3270293 2024-03-04T12:41:16.556 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.550+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=YRCLXVFMF50L type=del 2024-03-04T12:41:16.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.551+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=T2XSXTQHBIVF type=write size=408906 2024-03-04T12:41:16.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.552+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~GPGAXALZTDUO.0 size=1048576 2024-03-04T12:41:16.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.553+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~GPGAXALZTDUO.1 size=597988 2024-03-04T12:41:16.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.556+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=GPGAXALZTDUO tag=FSNZDGYGY8JL type=write size=2695140 2024-03-04T12:41:16.564 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.559+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~C4J0FLAPBPY9.0 size=1048576 2024-03-04T12:41:16.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.560+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~C4J0FLAPBPY9.1 size=1048576 2024-03-04T12:41:16.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.560+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~C4J0FLAPBPY9.2 size=654729 2024-03-04T12:41:16.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.560+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=C4J0FLAPBPY9 tag=WGV0TR6Y69RJ type=write size=3800457 2024-03-04T12:41:16.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.562+0000 7f093583d780 1 < canceled operation key=FT2XNJYYT30J tag=EZ6Q9P649I09 type=del size=1953772 2024-03-04T12:41:16.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.563+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=FUDHO2U3IOA7 type=del size=2165020 2024-03-04T12:41:16.569 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.564+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~JFA1GD840JR4.0 size=786839 2024-03-04T12:41:16.571 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.566+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=JFA1GD840JR4 tag=ZGDG1HSRLS0T type=write size=1835415 2024-03-04T12:41:16.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.568+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~HE5ZTPM094YV.0 size=1048576 2024-03-04T12:41:16.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.569+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~HE5ZTPM094YV.1 size=1048576 2024-03-04T12:41:16.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.570+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~HE5ZTPM094YV.2 size=507983 2024-03-04T12:41:16.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.570+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=HE5ZTPM094YV tag=VUFSEW15Q2LS type=write size=3653711 2024-03-04T12:41:16.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.572+0000 7f093583d780 1 < suggested update operation key=UAEQORB3BDBH tag=U0B81BY4IHVC type=del size=3588453 2024-03-04T12:41:16.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.575+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~V21GZ4TXTVF2.0 size=297324 2024-03-04T12:41:16.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.575+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=V21GZ4TXTVF2 tag=0LTZ8CGEB9T3 type=write size=1345900 2024-03-04T12:41:16.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.576+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~CR2M9I841UO2.0 size=683 2024-03-04T12:41:16.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.578+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=CR2M9I841UO2 tag=0QCTRUFGSVJ6 type=write size=1049259 2024-03-04T12:41:16.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.579+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=2K84QNVMBRTT type=del size=4132796 2024-03-04T12:41:16.587 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.581+0000 7f093583d780 1 < suggested update operation key=2ZOV2JEQHXGS tag=QQZN9OL71OZH type=del size=1088496 2024-03-04T12:41:16.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.583+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=7318B3LJMM9Y type=del size=2643907 2024-03-04T12:41:16.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.584+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=MHSRVA9OCV6O type=del 2024-03-04T12:41:16.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.585+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=SQ89GXMEBOU9 type=del size=4023738 2024-03-04T12:41:16.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.586+0000 7f093583d780 1 < canceled operation key=TMAI6MOG2C4N tag=1TW71Q5TH6H0 type=del size=436721 2024-03-04T12:41:16.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.589+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~RDO6JPFRC79J.0 size=940263 2024-03-04T12:41:16.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.589+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=RDO6JPFRC79J tag=6ODVYFVHFRH7 type=write size=1988839 2024-03-04T12:41:16.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.590+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~5MS412TZIJPF.0 size=1048576 2024-03-04T12:41:16.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.590+0000 7f093583d780 1 < canceled part key=_multipart_NFM6LT89K5F4.2~5MS412TZIJPF.1 size=2769 2024-03-04T12:41:16.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.592+0000 7f093583d780 1 < canceled multipart upload key=NFM6LT89K5F4 upload=5MS412TZIJPF tag=36TTJ0UGNZOQ type=write size=2099921 2024-03-04T12:41:16.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.594+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~8BF73YJ1Z63C.0 size=1048576 2024-03-04T12:41:16.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.595+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~8BF73YJ1Z63C.1 size=1048576 2024-03-04T12:41:16.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.596+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~8BF73YJ1Z63C.2 size=200131 2024-03-04T12:41:16.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.596+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=8BF73YJ1Z63C tag=V7IC54QKP7BK type=write size=3345859 2024-03-04T12:41:16.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.597+0000 7f093583d780 1 < canceled part key=_multipart_TMAI6MOG2C4N.2~QAW07NQRQM0K.0 size=1048576 2024-03-04T12:41:16.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.597+0000 7f093583d780 1 < canceled part key=_multipart_TMAI6MOG2C4N.2~QAW07NQRQM0K.1 size=605373 2024-03-04T12:41:16.604 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.599+0000 7f093583d780 1 < canceled multipart upload key=TMAI6MOG2C4N upload=QAW07NQRQM0K tag=2C56M80CE4QC type=write size=2702525 2024-03-04T12:41:16.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.601+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~OFVWS12JM1Z4.0 size=1048576 2024-03-04T12:41:16.607 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.602+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~OFVWS12JM1Z4.1 size=34948 2024-03-04T12:41:16.607 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.602+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=OFVWS12JM1Z4 tag=6U653UOMCD9A type=write size=2132100 2024-03-04T12:41:16.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.603+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=5UAGJJEPS2JE type=del 2024-03-04T12:41:16.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.604+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=O9UT1SL58PCK type=del size=3872573 2024-03-04T12:41:16.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.605+0000 7f093583d780 1 < completed write operation key=AQI7H63EQSTN tag=CH3Q31UQIBY9 type=write size=248711 2024-03-04T12:41:16.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.607+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~D018KG3TU2VD.0 size=28287 2024-03-04T12:41:16.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.607+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=D018KG3TU2VD tag=MAJTJIJFDKMJ type=write size=1076863 2024-03-04T12:41:16.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.608+0000 7f093583d780 1 < completed delete operation key=O6OUISHWZ7FU tag=PDCK504WZJ2O type=del 2024-03-04T12:41:16.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.609+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=PD1KU60WK81B type=write size=145666 2024-03-04T12:41:16.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.610+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~IKHE6QZOX2UF.0 size=336977 2024-03-04T12:41:16.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.612+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=IKHE6QZOX2UF tag=T2M4A56D6WYJ type=write size=1385553 2024-03-04T12:41:16.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.614+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~LRKSV294UPZL.0 size=1048576 2024-03-04T12:41:16.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.615+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~LRKSV294UPZL.1 size=1048576 2024-03-04T12:41:16.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.616+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~LRKSV294UPZL.2 size=418985 2024-03-04T12:41:16.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.616+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=LRKSV294UPZL tag=UV10WCRUYU3M type=write size=3564713 2024-03-04T12:41:16.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.617+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~V1C4B7QTEACE.0 size=1048576 2024-03-04T12:41:16.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.618+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~V1C4B7QTEACE.1 size=1048576 2024-03-04T12:41:16.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.619+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~V1C4B7QTEACE.2 size=124565 2024-03-04T12:41:16.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.620+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=V1C4B7QTEACE tag=84XJHTZBCEIE type=write size=3270293 2024-03-04T12:41:16.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.623+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~JSFICHFRBT2R.0 size=1048576 2024-03-04T12:41:16.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.623+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~JSFICHFRBT2R.1 size=1048576 2024-03-04T12:41:16.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.624+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~JSFICHFRBT2R.2 size=349570 2024-03-04T12:41:16.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.624+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=JSFICHFRBT2R tag=6331I1BMHAO8 type=write size=3495298 2024-03-04T12:41:16.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.626+0000 7f093583d780 1 < completed write operation key=L4UQK3UJFXZC tag=T2XSXTQHBIVF type=write size=408906 2024-03-04T12:41:16.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.627+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=9M752QV930E8 type=write size=666525 2024-03-04T12:41:16.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.628+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~C4J0FLAPBPY9.0 size=1048576 2024-03-04T12:41:16.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.629+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~C4J0FLAPBPY9.1 size=1048576 2024-03-04T12:41:16.636 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.630+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~C4J0FLAPBPY9.2 size=654729 2024-03-04T12:41:16.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.632+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=C4J0FLAPBPY9 tag=WGV0TR6Y69RJ type=write size=3800457 2024-03-04T12:41:16.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.634+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~3O1PDSJ30PWC.0 size=1048576 2024-03-04T12:41:16.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.635+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~3O1PDSJ30PWC.1 size=1048576 2024-03-04T12:41:16.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.636+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~3O1PDSJ30PWC.2 size=911779 2024-03-04T12:41:16.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.636+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=3O1PDSJ30PWC tag=RW6KIBJTZ1PN type=write size=4057507 2024-03-04T12:41:16.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.637+0000 7f093583d780 1 < canceled operation key=PT63VLFQQN0E tag=FUDHO2U3IOA7 type=del size=2165020 2024-03-04T12:41:16.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.638+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=UHIDV52N4MG0 type=write size=942834 2024-03-04T12:41:16.645 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.639+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~HE5ZTPM094YV.0 size=1048576 2024-03-04T12:41:16.646 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.640+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~HE5ZTPM094YV.1 size=1048576 2024-03-04T12:41:16.646 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.641+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~HE5ZTPM094YV.2 size=507983 2024-03-04T12:41:16.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.643+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=HE5ZTPM094YV tag=VUFSEW15Q2LS type=write size=3653711 2024-03-04T12:41:16.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.644+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=P16VI3574AN2 type=del size=19491 2024-03-04T12:41:16.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.645+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~V21GZ4TXTVF2.0 size=297324 2024-03-04T12:41:16.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.647+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=V21GZ4TXTVF2 tag=0LTZ8CGEB9T3 type=write size=1345900 2024-03-04T12:41:16.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.649+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~W15WS74QQULV.0 size=420773 2024-03-04T12:41:16.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.649+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=W15WS74QQULV tag=ODDRKBYANZED type=write size=1469349 2024-03-04T12:41:16.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.650+0000 7f093583d780 1 < completed delete operation key=NFM6LT89K5F4 tag=2K84QNVMBRTT type=del 2024-03-04T12:41:16.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.651+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=QS21IQKHJQQ5 type=del size=2516203 2024-03-04T12:41:16.658 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.652+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=7318B3LJMM9Y type=del 2024-03-04T12:41:16.659 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.653+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=6XDSYJPV746K type=del size=4134743 2024-03-04T12:41:16.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.655+0000 7f093583d780 1 < completed delete operation key=AQI7H63EQSTN tag=SQ89GXMEBOU9 type=del 2024-03-04T12:41:16.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.656+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=4LRDUZKU3I2Q type=del size=1004455 2024-03-04T12:41:16.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.656+0000 7f093583d780 1 < canceled part key=_multipart_HG0EM344TJZY.2~RDO6JPFRC79J.0 size=940263 2024-03-04T12:41:16.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.658+0000 7f093583d780 1 < canceled multipart upload key=HG0EM344TJZY upload=RDO6JPFRC79J tag=6ODVYFVHFRH7 type=write size=1988839 2024-03-04T12:41:16.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.659+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=KO4O786MHFG5 type=del size=1078640 2024-03-04T12:41:16.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.660+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~8BF73YJ1Z63C.0 size=1048576 2024-03-04T12:41:16.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.661+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~8BF73YJ1Z63C.1 size=1048576 2024-03-04T12:41:16.669 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.663+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~8BF73YJ1Z63C.2 size=200131 2024-03-04T12:41:16.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.665+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=8BF73YJ1Z63C tag=V7IC54QKP7BK type=write size=3345859 2024-03-04T12:41:16.673 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.668+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~4S0E28WWR0HA.0 size=836564 2024-03-04T12:41:16.673 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.668+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=4S0E28WWR0HA tag=ZNEMDZYNKW4I type=write size=1885140 2024-03-04T12:41:16.674 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.669+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~OFVWS12JM1Z4.0 size=1048576 2024-03-04T12:41:16.676 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.670+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~OFVWS12JM1Z4.1 size=34948 2024-03-04T12:41:16.678 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.672+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=OFVWS12JM1Z4 tag=6U653UOMCD9A type=write size=2132100 2024-03-04T12:41:16.680 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.675+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~SLGX1SCK133J.0 size=408958 2024-03-04T12:41:16.680 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.675+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=SLGX1SCK133J tag=1PI4RXYCDLHF type=write size=1457534 2024-03-04T12:41:16.681 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.676+0000 7f093583d780 1 < canceled operation key=GJ0FQ6EH9HJL tag=O9UT1SL58PCK type=del size=3872573 2024-03-04T12:41:16.683 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.677+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=X1B1F7GKV1NY type=del size=1705561 2024-03-04T12:41:16.683 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.677+0000 7f093583d780 1 < canceled part key=_multipart_U6F7IZ07CS9Q.2~D018KG3TU2VD.0 size=28287 2024-03-04T12:41:16.685 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.679+0000 7f093583d780 1 < canceled multipart upload key=U6F7IZ07CS9Q upload=D018KG3TU2VD tag=MAJTJIJFDKMJ type=write size=1076863 2024-03-04T12:41:16.686 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.681+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=A17TRM3QIZ7M type=write size=1027700 2024-03-04T12:41:16.688 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.682+0000 7f093583d780 1 < canceled operation key=2XVNK3YEVHJ7 tag=PD1KU60WK81B type=write size=145666 2024-03-04T12:41:16.690 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.685+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~EI09CH6T4QWG.0 size=1048576 2024-03-04T12:41:16.691 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.686+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~EI09CH6T4QWG.1 size=1020298 2024-03-04T12:41:16.691 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.686+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=EI09CH6T4QWG tag=MF2TSQKOPS4I type=write size=3117450 2024-03-04T12:41:16.692 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.687+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~LRKSV294UPZL.0 size=1048576 2024-03-04T12:41:16.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.688+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~LRKSV294UPZL.1 size=1048576 2024-03-04T12:41:16.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.689+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~LRKSV294UPZL.2 size=418985 2024-03-04T12:41:16.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.691+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=LRKSV294UPZL tag=UV10WCRUYU3M type=write size=3564713 2024-03-04T12:41:16.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.692+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=2AOXOXSDB2JM type=del size=2698179 2024-03-04T12:41:16.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.693+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~JSFICHFRBT2R.0 size=1048576 2024-03-04T12:41:16.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.694+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~JSFICHFRBT2R.1 size=1048576 2024-03-04T12:41:16.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.694+0000 7f093583d780 1 < canceled part key=_multipart_2ZOV2JEQHXGS.2~JSFICHFRBT2R.2 size=349570 2024-03-04T12:41:16.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.697+0000 7f093583d780 1 < canceled multipart upload key=2ZOV2JEQHXGS upload=JSFICHFRBT2R tag=6331I1BMHAO8 type=write size=3495298 2024-03-04T12:41:16.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.699+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~5CO15E3WJOT1.0 size=609218 2024-03-04T12:41:16.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.699+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=5CO15E3WJOT1 tag=J38SUHIQ4T28 type=write size=1657794 2024-03-04T12:41:16.706 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.700+0000 7f093583d780 1 < completed write operation key=96PTQ2KHPMMM tag=9M752QV930E8 type=write size=666525 2024-03-04T12:41:16.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.702+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=E0NC1A55OIUT type=write size=731057 2024-03-04T12:41:16.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.703+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~3O1PDSJ30PWC.0 size=1048576 2024-03-04T12:41:16.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.704+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~3O1PDSJ30PWC.1 size=1048576 2024-03-04T12:41:16.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.704+0000 7f093583d780 1 < canceled part key=_multipart_2XVNK3YEVHJ7.2~3O1PDSJ30PWC.2 size=911779 2024-03-04T12:41:16.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.706+0000 7f093583d780 1 < canceled multipart upload key=2XVNK3YEVHJ7 upload=3O1PDSJ30PWC tag=RW6KIBJTZ1PN type=write size=4057507 2024-03-04T12:41:16.714 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.708+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~QBP1FF5BR0Y0.0 size=1048576 2024-03-04T12:41:16.714 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.709+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~QBP1FF5BR0Y0.1 size=910785 2024-03-04T12:41:16.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.709+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=QBP1FF5BR0Y0 tag=WQCFNH3VM1XU type=write size=3007937 2024-03-04T12:41:16.716 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.710+0000 7f093583d780 1 < completed write operation key=YJXFSO53QVPS tag=UHIDV52N4MG0 type=write size=942834 2024-03-04T12:41:16.718 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.712+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~WKEI7ZSUWYCF.0 size=624377 2024-03-04T12:41:16.718 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.712+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=WKEI7ZSUWYCF tag=YJOR362WE9SK type=write size=1672953 2024-03-04T12:41:16.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.713+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=P16VI3574AN2 type=del 2024-03-04T12:41:16.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.715+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~PL39RWTJ99DI.0 size=1048576 2024-03-04T12:41:16.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.718+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~PL39RWTJ99DI.1 size=934071 2024-03-04T12:41:16.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.718+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=PL39RWTJ99DI tag=J0KTAXK1YVCM type=write size=3031223 2024-03-04T12:41:16.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.719+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~W15WS74QQULV.0 size=420773 2024-03-04T12:41:16.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.721+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=W15WS74QQULV tag=ODDRKBYANZED type=write size=1469349 2024-03-04T12:41:16.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.723+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~CKQLDSJ58009.0 size=1048576 2024-03-04T12:41:16.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.723+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~CKQLDSJ58009.1 size=29530 2024-03-04T12:41:16.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.723+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=CKQLDSJ58009 tag=TG5972V9VYP5 type=write size=2126682 2024-03-04T12:41:16.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.726+0000 7f093583d780 1 < suggested update operation key=2XVNK3YEVHJ7 tag=QS21IQKHJQQ5 type=del size=2516203 2024-03-04T12:41:16.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.727+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=78PB6WB30RMT type=del size=630819 2024-03-04T12:41:16.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.728+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=6XDSYJPV746K type=del 2024-03-04T12:41:16.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.729+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=DRVG10MZ0P94 type=del size=998517 2024-03-04T12:41:16.736 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.730+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=4LRDUZKU3I2Q type=del 2024-03-04T12:41:16.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.732+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~73FOQ75GITC6.0 size=1048576 2024-03-04T12:41:16.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.733+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~73FOQ75GITC6.1 size=1048576 2024-03-04T12:41:16.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.734+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~73FOQ75GITC6.2 size=91103 2024-03-04T12:41:16.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.734+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=73FOQ75GITC6 tag=ARHJGMYL8H9O type=write size=3236831 2024-03-04T12:41:16.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.735+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=KO4O786MHFG5 type=del 2024-03-04T12:41:16.742 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.737+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~CC5HPEGH0XTZ.0 size=1048576 2024-03-04T12:41:16.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.738+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~CC5HPEGH0XTZ.1 size=286116 2024-03-04T12:41:16.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.738+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=CC5HPEGH0XTZ tag=GSN9YOK34ZSW type=write size=2383268 2024-03-04T12:41:16.744 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.739+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~4S0E28WWR0HA.0 size=836564 2024-03-04T12:41:16.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.741+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=4S0E28WWR0HA tag=ZNEMDZYNKW4I type=write size=1885140 2024-03-04T12:41:16.748 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.743+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~SNNAGMHD9IU4.0 size=1048576 2024-03-04T12:41:16.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.744+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~SNNAGMHD9IU4.1 size=1048576 2024-03-04T12:41:16.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.745+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~SNNAGMHD9IU4.2 size=597288 2024-03-04T12:41:16.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.745+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=SNNAGMHD9IU4 tag=M0SRQ5WJWRJ2 type=write size=3743016 2024-03-04T12:41:16.751 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.746+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~SLGX1SCK133J.0 size=408958 2024-03-04T12:41:16.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.748+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=SLGX1SCK133J tag=1PI4RXYCDLHF type=write size=1457534 2024-03-04T12:41:16.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.749+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=0O3HA8SEPL03 type=del size=3219078 2024-03-04T12:41:16.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.750+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=X1B1F7GKV1NY type=del 2024-03-04T12:41:16.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.751+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=YCDINH2TO7QI type=del size=816740 2024-03-04T12:41:16.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.752+0000 7f093583d780 1 < completed write operation key=2R5WA9Q9ZAUG tag=A17TRM3QIZ7M type=write size=1027700 2024-03-04T12:41:16.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.753+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=I9U1Z22AV58H type=write size=599438 2024-03-04T12:41:16.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.754+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~EI09CH6T4QWG.0 size=1048576 2024-03-04T12:41:16.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.755+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~EI09CH6T4QWG.1 size=1020298 2024-03-04T12:41:16.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.757+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=EI09CH6T4QWG tag=MF2TSQKOPS4I type=write size=3117450 2024-03-04T12:41:16.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.758+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=31PPIWE86GTI type=del size=3624507 2024-03-04T12:41:16.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.759+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=2AOXOXSDB2JM type=del 2024-03-04T12:41:16.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.760+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=VQN5GYVGNY3B type=write size=581046 2024-03-04T12:41:16.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.761+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~5CO15E3WJOT1.0 size=609218 2024-03-04T12:41:16.769 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.763+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=5CO15E3WJOT1 tag=J38SUHIQ4T28 type=write size=1657794 2024-03-04T12:41:16.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.765+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~CBDSQ4R99O2E.0 size=217502 2024-03-04T12:41:16.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.765+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=CBDSQ4R99O2E tag=DCP7FSVUX1MO type=write size=1266078 2024-03-04T12:41:16.773 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.767+0000 7f093583d780 1 < completed write operation key=PT63VLFQQN0E tag=E0NC1A55OIUT type=write size=731057 2024-03-04T12:41:16.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.769+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~N7PEDQKU9I4U.0 size=183885 2024-03-04T12:41:16.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.769+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=N7PEDQKU9I4U tag=10CLAW8H5ZK1 type=write size=1232461 2024-03-04T12:41:16.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.770+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~QBP1FF5BR0Y0.0 size=1048576 2024-03-04T12:41:16.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.771+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~QBP1FF5BR0Y0.1 size=910785 2024-03-04T12:41:16.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.774+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=QBP1FF5BR0Y0 tag=WQCFNH3VM1XU type=write size=3007937 2024-03-04T12:41:16.782 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.776+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=XUUSKNGG1TGR type=del size=2458731 2024-03-04T12:41:16.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.777+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~WKEI7ZSUWYCF.0 size=624377 2024-03-04T12:41:16.785 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.779+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=WKEI7ZSUWYCF tag=YJOR362WE9SK type=write size=1672953 2024-03-04T12:41:16.786 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.780+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=7SLXMEQH715F type=del size=756400 2024-03-04T12:41:16.786 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.781+0000 7f093583d780 1 < canceled part key=_multipart_OCOQJLUUNWRG.2~PL39RWTJ99DI.0 size=1048576 2024-03-04T12:41:16.787 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.781+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~PL39RWTJ99DI.1 size=934071 2024-03-04T12:41:16.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.783+0000 7f093583d780 1 < canceled multipart upload key=OCOQJLUUNWRG upload=PL39RWTJ99DI tag=J0KTAXK1YVCM type=write size=3031223 2024-03-04T12:41:16.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.784+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=JD5FFIZO3ODU type=del size=3065843 2024-03-04T12:41:16.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.786+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~CKQLDSJ58009.0 size=1048576 2024-03-04T12:41:16.792 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.786+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~CKQLDSJ58009.1 size=29530 2024-03-04T12:41:16.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.788+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=CKQLDSJ58009 tag=TG5972V9VYP5 type=write size=2126682 2024-03-04T12:41:16.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.790+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=22BQCU1SOHE4 type=del size=3638033 2024-03-04T12:41:16.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.791+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=78PB6WB30RMT type=del 2024-03-04T12:41:16.797 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.792+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=TZXSMLAPSADC type=del size=2522126 2024-03-04T12:41:16.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.793+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=DRVG10MZ0P94 type=del 2024-03-04T12:41:16.800 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.794+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=VPXZ923AXNKA type=del size=594318 2024-03-04T12:41:16.801 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.795+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~73FOQ75GITC6.0 size=1048576 2024-03-04T12:41:16.802 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.796+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~73FOQ75GITC6.1 size=1048576 2024-03-04T12:41:16.803 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.797+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~73FOQ75GITC6.2 size=91103 2024-03-04T12:41:16.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.799+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=73FOQ75GITC6 tag=ARHJGMYL8H9O type=write size=3236831 2024-03-04T12:41:16.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.800+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=JOTI6N7SMV2Q type=write size=450673 2024-03-04T12:41:16.807 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.801+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~CC5HPEGH0XTZ.0 size=1048576 2024-03-04T12:41:16.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.802+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~CC5HPEGH0XTZ.1 size=286116 2024-03-04T12:41:16.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.804+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=CC5HPEGH0XTZ tag=GSN9YOK34ZSW type=write size=2383268 2024-03-04T12:41:16.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.805+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=88TTQAD59TIP type=del size=2362264 2024-03-04T12:41:16.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.806+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~SNNAGMHD9IU4.0 size=1048576 2024-03-04T12:41:16.813 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.807+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~SNNAGMHD9IU4.1 size=1048576 2024-03-04T12:41:16.813 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.808+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~SNNAGMHD9IU4.2 size=597288 2024-03-04T12:41:16.816 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.810+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=SNNAGMHD9IU4 tag=M0SRQ5WJWRJ2 type=write size=3743016 2024-03-04T12:41:16.817 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.811+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=W27W4KD7QCA1 type=del size=897232 2024-03-04T12:41:16.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.814+0000 7f093583d780 1 < suggested remove operation key=UAEQORB3BDBH tag=0O3HA8SEPL03 type=del 2024-03-04T12:41:16.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.815+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=ME14SXZXA9IH type=write size=755482 2024-03-04T12:41:16.821 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.816+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=YCDINH2TO7QI type=del 2024-03-04T12:41:16.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.818+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~QRVEZFWNW15G.0 size=1048576 2024-03-04T12:41:16.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.819+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~QRVEZFWNW15G.1 size=734298 2024-03-04T12:41:16.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.819+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=QRVEZFWNW15G tag=H69EJAMN7ARR type=write size=2831450 2024-03-04T12:41:16.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.820+0000 7f093583d780 1 < completed write operation key=F269PJEZ05IO tag=I9U1Z22AV58H type=write size=599438 2024-03-04T12:41:16.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.821+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=04Y7KKFR2Y2O type=del size=765442 2024-03-04T12:41:16.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.824+0000 7f093583d780 1 < suggested remove operation key=PT63VLFQQN0E tag=31PPIWE86GTI type=del 2024-03-04T12:41:16.830 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.825+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=M886J499XMO7 type=del size=2503605 2024-03-04T12:41:16.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.826+0000 7f093583d780 1 < completed write operation key=YJXFSO53QVPS tag=VQN5GYVGNY3B type=write size=581046 2024-03-04T12:41:16.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.827+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=V3USQ3WVUYOX type=del size=3350097 2024-03-04T12:41:16.834 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.828+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~CBDSQ4R99O2E.0 size=217502 2024-03-04T12:41:16.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.831+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=CBDSQ4R99O2E tag=DCP7FSVUX1MO type=write size=1266078 2024-03-04T12:41:16.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.833+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~J1M57BFNN20G.0 size=1048576 2024-03-04T12:41:16.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.834+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~J1M57BFNN20G.1 size=1048576 2024-03-04T12:41:16.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.835+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~J1M57BFNN20G.2 size=211793 2024-03-04T12:41:16.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.835+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=J1M57BFNN20G tag=OY2JZDVMIQW3 type=write size=3357521 2024-03-04T12:41:16.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.836+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~N7PEDQKU9I4U.0 size=183885 2024-03-04T12:41:16.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.838+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=N7PEDQKU9I4U tag=10CLAW8H5ZK1 type=write size=1232461 2024-03-04T12:41:16.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.840+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~RWZMBXQH81EG.0 size=1048576 2024-03-04T12:41:16.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.840+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~RWZMBXQH81EG.1 size=462452 2024-03-04T12:41:16.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.840+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=RWZMBXQH81EG tag=BYB6V48SCE07 type=write size=2559604 2024-03-04T12:41:16.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.842+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=XUUSKNGG1TGR type=del 2024-03-04T12:41:16.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.844+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~6RRTAXXUH4CM.0 size=1048576 2024-03-04T12:41:16.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.845+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~6RRTAXXUH4CM.1 size=83540 2024-03-04T12:41:16.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.845+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=6RRTAXXUH4CM tag=KAIVEN1WC9ER type=write size=2180692 2024-03-04T12:41:16.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.847+0000 7f093583d780 1 < suggested update operation key=UAEQORB3BDBH tag=7SLXMEQH715F type=del size=756400 2024-03-04T12:41:16.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.848+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=ARV8T3BEGMQG type=del size=2965660 2024-03-04T12:41:16.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.849+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=JD5FFIZO3ODU type=del 2024-03-04T12:41:16.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.850+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=S4WZJQBVVMGR type=del size=196892 2024-03-04T12:41:16.857 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.851+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=22BQCU1SOHE4 type=del 2024-03-04T12:41:16.858 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.852+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=URNW4GORPFSX type=write size=772661 2024-03-04T12:41:16.859 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.854+0000 7f093583d780 1 < canceled operation key=YJXFSO53QVPS tag=TZXSMLAPSADC type=del size=2522126 2024-03-04T12:41:16.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.856+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~2X44VS6H2QUP.0 size=51650 2024-03-04T12:41:16.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.856+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=2X44VS6H2QUP tag=1S0C68KCQGMU type=write size=1100226 2024-03-04T12:41:16.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.858+0000 7f093583d780 1 < suggested update operation key=2XVNK3YEVHJ7 tag=VPXZ923AXNKA type=del size=594318 2024-03-04T12:41:16.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.860+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~6FL5RXZA3LD1.0 size=799490 2024-03-04T12:41:16.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.860+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=6FL5RXZA3LD1 tag=PN6O4WZ4EA4W type=write size=1848066 2024-03-04T12:41:16.866 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.861+0000 7f093583d780 1 < completed write operation key=O6OUISHWZ7FU tag=JOTI6N7SMV2Q type=write size=450673 2024-03-04T12:41:16.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.863+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~TTCNKCRH09PH.0 size=603125 2024-03-04T12:41:16.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.863+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=TTCNKCRH09PH tag=AN11IH085MOD type=write size=1651701 2024-03-04T12:41:16.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.864+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=88TTQAD59TIP type=del 2024-03-04T12:41:16.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.865+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=6ZECAHOAM6IL type=del size=144146 2024-03-04T12:41:16.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.866+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=W27W4KD7QCA1 type=del 2024-03-04T12:41:16.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.867+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=T1MK1N24CMAH type=del size=1379757 2024-03-04T12:41:16.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.868+0000 7f093583d780 1 < canceled operation key=GMKM2QEP072H tag=ME14SXZXA9IH type=write size=755482 2024-03-04T12:41:16.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.869+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=5UHIZR3JK86U type=write size=1038378 2024-03-04T12:41:16.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.870+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~QRVEZFWNW15G.0 size=1048576 2024-03-04T12:41:16.877 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.871+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~QRVEZFWNW15G.1 size=734298 2024-03-04T12:41:16.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.873+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=QRVEZFWNW15G tag=H69EJAMN7ARR type=write size=2831450 2024-03-04T12:41:16.880 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.874+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=ES43LTPD7TPT type=del size=3100951 2024-03-04T12:41:16.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.875+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=04Y7KKFR2Y2O type=del 2024-03-04T12:41:16.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.876+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=OK5MWS9VK18V type=del size=1494747 2024-03-04T12:41:16.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.878+0000 7f093583d780 -1 < failed to complete operation key=UAEQORB3BDBH tag=M886J499XMO7 type=del size=2503605: (22) Invalid argument 2024-03-04T12:41:16.885 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.879+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=J29M80D4QH2B type=del size=1255818 2024-03-04T12:41:16.887 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.881+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=V3USQ3WVUYOX type=del 2024-03-04T12:41:16.889 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.883+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~DEOJEU08U448.0 size=1048576 2024-03-04T12:41:16.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.884+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~DEOJEU08U448.1 size=1048576 2024-03-04T12:41:16.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.885+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~DEOJEU08U448.2 size=325540 2024-03-04T12:41:16.891 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.885+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=DEOJEU08U448 tag=1PXUENGIXOUO type=write size=3471268 2024-03-04T12:41:16.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.886+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~J1M57BFNN20G.0 size=1048576 2024-03-04T12:41:16.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.887+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~J1M57BFNN20G.1 size=1048576 2024-03-04T12:41:16.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.888+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~J1M57BFNN20G.2 size=211793 2024-03-04T12:41:16.895 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.890+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=J1M57BFNN20G tag=OY2JZDVMIQW3 type=write size=3357521 2024-03-04T12:41:16.897 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.892+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~FHA9B97LH2FE.0 size=1048576 2024-03-04T12:41:16.898 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.893+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~FHA9B97LH2FE.1 size=1048576 2024-03-04T12:41:16.899 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.894+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~FHA9B97LH2FE.2 size=733865 2024-03-04T12:41:16.899 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.894+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=FHA9B97LH2FE tag=N4L09CHB4OK0 type=write size=3879593 2024-03-04T12:41:16.900 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.895+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~RWZMBXQH81EG.0 size=1048576 2024-03-04T12:41:16.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.896+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~RWZMBXQH81EG.1 size=462452 2024-03-04T12:41:16.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.898+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=RWZMBXQH81EG tag=BYB6V48SCE07 type=write size=2559604 2024-03-04T12:41:16.904 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.899+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=3A10S072ZVI0 type=del size=1565819 2024-03-04T12:41:16.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.900+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~6RRTAXXUH4CM.0 size=1048576 2024-03-04T12:41:16.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.901+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~6RRTAXXUH4CM.1 size=83540 2024-03-04T12:41:16.909 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.903+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=6RRTAXXUH4CM tag=KAIVEN1WC9ER type=write size=2180692 2024-03-04T12:41:16.910 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.905+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=XWH1TA9C1Y2H type=del size=1551633 2024-03-04T12:41:16.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.906+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=ARV8T3BEGMQG type=del 2024-03-04T12:41:16.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.908+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~4M8WE1A4V248.0 size=1048576 2024-03-04T12:41:16.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.909+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~4M8WE1A4V248.1 size=1048576 2024-03-04T12:41:16.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.910+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~4M8WE1A4V248.2 size=223426 2024-03-04T12:41:16.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.910+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=4M8WE1A4V248 tag=83Y0Q0W7RX5X type=write size=3369154 2024-03-04T12:41:16.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.912+0000 7f093583d780 1 < suggested update operation key=AQI7H63EQSTN tag=S4WZJQBVVMGR type=del size=196892 2024-03-04T12:41:16.919 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.914+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~1950S5G450EQ.0 size=1048576 2024-03-04T12:41:16.920 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.915+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~1950S5G450EQ.1 size=187224 2024-03-04T12:41:16.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.915+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=1950S5G450EQ tag=AZJZROX50IW3 type=write size=2284376 2024-03-04T12:41:16.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.916+0000 7f093583d780 1 < completed write operation key=U6F7IZ07CS9Q tag=URNW4GORPFSX type=write size=772661 2024-03-04T12:41:16.924 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.919+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~AGLRTN78S1Q4.0 size=1048576 2024-03-04T12:41:16.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.921+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~AGLRTN78S1Q4.1 size=1048576 2024-03-04T12:41:16.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.922+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~AGLRTN78S1Q4.2 size=539361 2024-03-04T12:41:16.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.922+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=AGLRTN78S1Q4 tag=7J4R3WFX7AH1 type=write size=3685089 2024-03-04T12:41:16.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.923+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~2X44VS6H2QUP.0 size=51650 2024-03-04T12:41:16.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.925+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=2X44VS6H2QUP tag=1S0C68KCQGMU type=write size=1100226 2024-03-04T12:41:16.933 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.927+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~IZQVXTF4ZKZR.0 size=1048576 2024-03-04T12:41:16.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.928+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~IZQVXTF4ZKZR.1 size=1048576 2024-03-04T12:41:16.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.929+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~IZQVXTF4ZKZR.2 size=279186 2024-03-04T12:41:16.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.929+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=IZQVXTF4ZKZR tag=PYQNMEWC0R7I type=write size=3424914 2024-03-04T12:41:16.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.930+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~6FL5RXZA3LD1.0 size=799490 2024-03-04T12:41:16.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.932+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=6FL5RXZA3LD1 tag=PN6O4WZ4EA4W type=write size=1848066 2024-03-04T12:41:16.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.934+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~NQ8AXWOMZ9VU.0 size=1048576 2024-03-04T12:41:16.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.935+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~NQ8AXWOMZ9VU.1 size=128149 2024-03-04T12:41:16.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.935+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=NQ8AXWOMZ9VU tag=V919PEQ27Y9S type=write size=2225301 2024-03-04T12:41:16.941 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.936+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~TTCNKCRH09PH.0 size=603125 2024-03-04T12:41:16.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.939+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=TTCNKCRH09PH tag=AN11IH085MOD type=write size=1651701 2024-03-04T12:41:16.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.940+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=YZZ5PGLERVEM type=del size=2736220 2024-03-04T12:41:16.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.941+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=6ZECAHOAM6IL type=del 2024-03-04T12:41:16.948 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.943+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=SDYA90DC1M8K type=del size=1809875 2024-03-04T12:41:16.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.945+0000 7f093583d780 1 < suggested update operation key=PT63VLFQQN0E tag=T1MK1N24CMAH type=del size=1379757 2024-03-04T12:41:16.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.947+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~6GHY8233KWGW.0 size=1048576 2024-03-04T12:41:16.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.947+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~6GHY8233KWGW.1 size=867549 2024-03-04T12:41:16.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.947+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=6GHY8233KWGW tag=4LO9TMQIKH66 type=write size=2964701 2024-03-04T12:41:16.954 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.949+0000 7f093583d780 1 < completed write operation key=2ZOV2JEQHXGS tag=5UHIZR3JK86U type=write size=1038378 2024-03-04T12:41:16.955 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.950+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=IWPWM8M0YNR9 type=del size=792133 2024-03-04T12:41:16.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.951+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=ES43LTPD7TPT type=del 2024-03-04T12:41:16.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.952+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=Q8K0PEAQJW07 type=del size=3316877 2024-03-04T12:41:16.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.953+0000 7f093583d780 1 < canceled operation key=UAEQORB3BDBH tag=OK5MWS9VK18V type=del size=1494747 2024-03-04T12:41:16.961 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.955+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~1ZH1H1NQE09D.0 size=1048576 2024-03-04T12:41:16.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.956+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~1ZH1H1NQE09D.1 size=256379 2024-03-04T12:41:16.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.956+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=1ZH1H1NQE09D tag=Q4MT9DWA90JR type=write size=2353531 2024-03-04T12:41:16.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.957+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=J29M80D4QH2B type=del 2024-03-04T12:41:16.964 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.958+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=XIA439ZEWIF4 type=write size=1035465 2024-03-04T12:41:16.965 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.960+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~DEOJEU08U448.0 size=1048576 2024-03-04T12:41:16.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.960+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~DEOJEU08U448.1 size=1048576 2024-03-04T12:41:16.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.961+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~DEOJEU08U448.2 size=325540 2024-03-04T12:41:16.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.963+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=DEOJEU08U448 tag=1PXUENGIXOUO type=write size=3471268 2024-03-04T12:41:16.970 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.964+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=6QF8SFMHBTBK type=del size=469508 2024-03-04T12:41:16.971 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.966+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~FHA9B97LH2FE.0 size=1048576 2024-03-04T12:41:16.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.966+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~FHA9B97LH2FE.1 size=1048576 2024-03-04T12:41:16.973 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.967+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~FHA9B97LH2FE.2 size=733865 2024-03-04T12:41:16.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.969+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=FHA9B97LH2FE tag=N4L09CHB4OK0 type=write size=3879593 2024-03-04T12:41:16.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.971+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~IIOLICQNWFQ3.0 size=1048576 2024-03-04T12:41:16.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.972+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~IIOLICQNWFQ3.1 size=1048576 2024-03-04T12:41:16.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.973+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~IIOLICQNWFQ3.2 size=199363 2024-03-04T12:41:16.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.973+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=IIOLICQNWFQ3 tag=NVEGQET25RZA type=write size=3345091 2024-03-04T12:41:16.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.974+0000 7f093583d780 1 < completed delete operation key=O6OUISHWZ7FU tag=3A10S072ZVI0 type=del 2024-03-04T12:41:16.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.976+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=O9KNZJXTYAOS type=write size=102162 2024-03-04T12:41:16.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.977+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=XWH1TA9C1Y2H type=del 2024-03-04T12:41:16.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.978+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=7UC01OWH456W type=del size=3726060 2024-03-04T12:41:16.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.979+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~4M8WE1A4V248.0 size=1048576 2024-03-04T12:41:16.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.979+0000 7f093583d780 1 < canceled part key=_multipart_Q45PKXZVJ6YS.2~4M8WE1A4V248.1 size=1048576 2024-03-04T12:41:16.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.980+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~4M8WE1A4V248.2 size=223426 2024-03-04T12:41:16.987 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.982+0000 7f093583d780 1 < canceled multipart upload key=Q45PKXZVJ6YS upload=4M8WE1A4V248 tag=83Y0Q0W7RX5X type=write size=3369154 2024-03-04T12:41:16.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.984+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~ZXOBSMSYUB9G.0 size=1048576 2024-03-04T12:41:16.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.985+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~ZXOBSMSYUB9G.1 size=718416 2024-03-04T12:41:16.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.985+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=ZXOBSMSYUB9G tag=47RQ8OMGY41C type=write size=2815568 2024-03-04T12:41:16.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.986+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~1950S5G450EQ.0 size=1048576 2024-03-04T12:41:16.993 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.988+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~1950S5G450EQ.1 size=187224 2024-03-04T12:41:16.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.990+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=1950S5G450EQ tag=AZJZROX50IW3 type=write size=2284376 2024-03-04T12:41:16.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.992+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~HGDCVQIO07W5.0 size=742879 2024-03-04T12:41:16.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.992+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=HGDCVQIO07W5 tag=K6I9J4RHFB4Y type=write size=1791455 2024-03-04T12:41:16.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.993+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~AGLRTN78S1Q4.0 size=1048576 2024-03-04T12:41:16.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.994+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~AGLRTN78S1Q4.1 size=1048576 2024-03-04T12:41:17.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.995+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~AGLRTN78S1Q4.2 size=539361 2024-03-04T12:41:17.002 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.996+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=AGLRTN78S1Q4 tag=7J4R3WFX7AH1 type=write size=3685089 2024-03-04T12:41:17.003 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.998+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=T8DNW56Y6846 type=del size=728349 2024-03-04T12:41:17.004 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:16.999+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~IZQVXTF4ZKZR.0 size=1048576 2024-03-04T12:41:17.005 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.000+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~IZQVXTF4ZKZR.1 size=1048576 2024-03-04T12:41:17.005 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.000+0000 7f093583d780 1 < canceled part key=_multipart_2ZOV2JEQHXGS.2~IZQVXTF4ZKZR.2 size=279186 2024-03-04T12:41:17.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.002+0000 7f093583d780 1 < canceled multipart upload key=2ZOV2JEQHXGS upload=IZQVXTF4ZKZR tag=PYQNMEWC0R7I type=write size=3424914 2024-03-04T12:41:17.008 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.003+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=T09LZBOBHC0F type=del size=2173268 2024-03-04T12:41:17.009 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.004+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~NQ8AXWOMZ9VU.0 size=1048576 2024-03-04T12:41:17.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.005+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~NQ8AXWOMZ9VU.1 size=128149 2024-03-04T12:41:17.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.007+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=NQ8AXWOMZ9VU tag=V919PEQ27Y9S type=write size=2225301 2024-03-04T12:41:17.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.009+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~Y5SN87UNC9RM.0 size=520103 2024-03-04T12:41:17.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.009+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=Y5SN87UNC9RM tag=7Y4BN35Q62W1 type=write size=1568679 2024-03-04T12:41:17.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.010+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=YZZ5PGLERVEM type=del 2024-03-04T12:41:17.017 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.012+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=ZXT76VK58HQI type=del size=1969990 2024-03-04T12:41:17.018 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.013+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=SDYA90DC1M8K type=del 2024-03-04T12:41:17.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.014+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=38DBPHOTQZSF type=del size=2298973 2024-03-04T12:41:17.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.015+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~6GHY8233KWGW.0 size=1048576 2024-03-04T12:41:17.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.016+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~6GHY8233KWGW.1 size=867549 2024-03-04T12:41:17.024 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.018+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=6GHY8233KWGW tag=4LO9TMQIKH66 type=write size=2964701 2024-03-04T12:41:17.025 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.019+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=XUYMS3G5V2OW type=del size=3548049 2024-03-04T12:41:17.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.020+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=IWPWM8M0YNR9 type=del 2024-03-04T12:41:17.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.022+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=H3151L3FQI1Z type=del size=416285 2024-03-04T12:41:17.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.023+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=Q8K0PEAQJW07 type=del 2024-03-04T12:41:17.029 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.024+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=4C9E7W9Q4ZSK type=del size=2592329 2024-03-04T12:41:17.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.025+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~1ZH1H1NQE09D.0 size=1048576 2024-03-04T12:41:17.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.026+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~1ZH1H1NQE09D.1 size=256379 2024-03-04T12:41:17.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.028+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=1ZH1H1NQE09D tag=Q4MT9DWA90JR type=write size=2353531 2024-03-04T12:41:17.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.030+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~BD43PM5WLUAO.0 size=1048576 2024-03-04T12:41:17.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.031+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~BD43PM5WLUAO.1 size=1048576 2024-03-04T12:41:17.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.032+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~BD43PM5WLUAO.2 size=569391 2024-03-04T12:41:17.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.032+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=BD43PM5WLUAO tag=95M9DT2UI661 type=write size=3715119 2024-03-04T12:41:17.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.033+0000 7f093583d780 1 < completed write operation key=U6F7IZ07CS9Q tag=XIA439ZEWIF4 type=write size=1035465 2024-03-04T12:41:17.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.034+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=YHQ66SHMZHO5 type=del size=1006614 2024-03-04T12:41:17.041 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.035+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=6QF8SFMHBTBK type=del 2024-03-04T12:41:17.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.037+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~8X7WT8M4H36F.0 size=249562 2024-03-04T12:41:17.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.037+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=8X7WT8M4H36F tag=7E6CBE5K670C type=write size=1298138 2024-03-04T12:41:17.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.038+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~IIOLICQNWFQ3.0 size=1048576 2024-03-04T12:41:17.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.039+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~IIOLICQNWFQ3.1 size=1048576 2024-03-04T12:41:17.045 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.039+0000 7f093583d780 1 < canceled part key=_multipart_2XVNK3YEVHJ7.2~IIOLICQNWFQ3.2 size=199363 2024-03-04T12:41:17.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.041+0000 7f093583d780 1 < canceled multipart upload key=2XVNK3YEVHJ7 upload=IIOLICQNWFQ3 tag=NVEGQET25RZA type=write size=3345091 2024-03-04T12:41:17.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.042+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=E91YAH4E3KQ0 type=del size=2890471 2024-03-04T12:41:17.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.043+0000 7f093583d780 1 < completed write operation key=54FLC10FWKL6 tag=O9KNZJXTYAOS type=write size=102162 2024-03-04T12:41:17.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.044+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=PZCKJI5RPOA1 type=del size=932015 2024-03-04T12:41:17.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.045+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=7UC01OWH456W type=del 2024-03-04T12:41:17.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.047+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~5BOZ3H78ER1P.0 size=1048576 2024-03-04T12:41:17.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.048+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~5BOZ3H78ER1P.1 size=1048576 2024-03-04T12:41:17.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.049+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~5BOZ3H78ER1P.2 size=210038 2024-03-04T12:41:17.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.049+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=5BOZ3H78ER1P tag=P21923LWDSN4 type=write size=3355766 2024-03-04T12:41:17.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.050+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~ZXOBSMSYUB9G.0 size=1048576 2024-03-04T12:41:17.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.051+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~ZXOBSMSYUB9G.1 size=718416 2024-03-04T12:41:17.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.053+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=ZXOBSMSYUB9G tag=47RQ8OMGY41C type=write size=2815568 2024-03-04T12:41:17.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.055+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~RRTDJ0LIR7JW.0 size=373748 2024-03-04T12:41:17.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.055+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=RRTDJ0LIR7JW tag=0K4A9NVGQB6F type=write size=1422324 2024-03-04T12:41:17.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.056+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~HGDCVQIO07W5.0 size=742879 2024-03-04T12:41:17.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.058+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=HGDCVQIO07W5 tag=K6I9J4RHFB4Y type=write size=1791455 2024-03-04T12:41:17.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.060+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~AXV9K3DOPPEF.0 size=1048576 2024-03-04T12:41:17.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.061+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~AXV9K3DOPPEF.1 size=1048576 2024-03-04T12:41:17.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.061+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~AXV9K3DOPPEF.2 size=762692 2024-03-04T12:41:17.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.061+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=AXV9K3DOPPEF tag=M81KWUWISXBB type=write size=3908420 2024-03-04T12:41:17.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.063+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=T8DNW56Y6846 type=del 2024-03-04T12:41:17.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.065+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~1JCW030VICXW.0 size=1048576 2024-03-04T12:41:17.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.066+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~1JCW030VICXW.1 size=863730 2024-03-04T12:41:17.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.066+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=1JCW030VICXW tag=J0XUS6XAGE7I type=write size=2960882 2024-03-04T12:41:17.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.067+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=T09LZBOBHC0F type=del 2024-03-04T12:41:17.073 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.068+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=416ESAYRKUFP type=del size=274645 2024-03-04T12:41:17.074 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.069+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~Y5SN87UNC9RM.0 size=520103 2024-03-04T12:41:17.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.071+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=Y5SN87UNC9RM tag=7Y4BN35Q62W1 type=write size=1568679 2024-03-04T12:41:17.079 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.073+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~H6337VZ40VGV.0 size=1048576 2024-03-04T12:41:17.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.076+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~H6337VZ40VGV.1 size=1048576 2024-03-04T12:41:17.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.079+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~H6337VZ40VGV.2 size=893721 2024-03-04T12:41:17.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.079+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=H6337VZ40VGV tag=RTPL99ELF9O4 type=write size=4039449 2024-03-04T12:41:17.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.080+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=ZXT76VK58HQI type=del 2024-03-04T12:41:17.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.081+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=U1JWB0XHB1IV type=write size=428998 2024-03-04T12:41:17.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.082+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=38DBPHOTQZSF type=del 2024-03-04T12:41:17.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.084+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~N01A1ZL8S6IK.0 size=1048576 2024-03-04T12:41:17.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.085+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~N01A1ZL8S6IK.1 size=1048576 2024-03-04T12:41:17.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.086+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~N01A1ZL8S6IK.2 size=25127 2024-03-04T12:41:17.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.086+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=N01A1ZL8S6IK tag=HX06ND1JX2MQ type=write size=3170855 2024-03-04T12:41:17.094 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.089+0000 7f093583d780 1 < suggested update operation key=PT63VLFQQN0E tag=XUYMS3G5V2OW type=del size=3548049 2024-03-04T12:41:17.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.091+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=G6VY3R7MMG26 type=del size=1374054 2024-03-04T12:41:17.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.093+0000 7f093583d780 1 < suggested remove operation key=TMAI6MOG2C4N tag=H3151L3FQI1Z type=del 2024-03-04T12:41:17.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.095+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=TMJ33XV8V9BC type=write size=958082 2024-03-04T12:41:17.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.096+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=4C9E7W9Q4ZSK type=del 2024-03-04T12:41:17.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.099+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~U5E4S6BGSIAE.0 size=1048576 2024-03-04T12:41:17.107 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.101+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~U5E4S6BGSIAE.1 size=266352 2024-03-04T12:41:17.107 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.101+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=U5E4S6BGSIAE tag=4H3DNUZXX0GR type=write size=2363504 2024-03-04T12:41:17.108 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.103+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~BD43PM5WLUAO.0 size=1048576 2024-03-04T12:41:17.109 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.104+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~BD43PM5WLUAO.1 size=1048576 2024-03-04T12:41:17.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.105+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~BD43PM5WLUAO.2 size=569391 2024-03-04T12:41:17.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.106+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=BD43PM5WLUAO tag=95M9DT2UI661 type=write size=3715119 2024-03-04T12:41:17.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.108+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~G3HEK3CAF5VJ.0 size=801376 2024-03-04T12:41:17.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.108+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=G3HEK3CAF5VJ tag=KMZZ3YG2Q6FJ type=write size=1849952 2024-03-04T12:41:17.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.110+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=YHQ66SHMZHO5 type=del 2024-03-04T12:41:17.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.112+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~QFQLW8W5CAMD.0 size=1048576 2024-03-04T12:41:17.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.112+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~QFQLW8W5CAMD.1 size=1048576 2024-03-04T12:41:17.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.113+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~QFQLW8W5CAMD.2 size=1016776 2024-03-04T12:41:17.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.113+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=QFQLW8W5CAMD tag=4DD6RW0G1HGW type=write size=4162504 2024-03-04T12:41:17.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.114+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~8X7WT8M4H36F.0 size=249562 2024-03-04T12:41:17.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.116+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=8X7WT8M4H36F tag=7E6CBE5K670C type=write size=1298138 2024-03-04T12:41:17.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.118+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~WJMUVR44P756.0 size=445624 2024-03-04T12:41:17.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.118+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=WJMUVR44P756 tag=7IZJL5T9L423 type=write size=1494200 2024-03-04T12:41:17.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.119+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=E91YAH4E3KQ0 type=del 2024-03-04T12:41:17.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.121+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~U7B075KRQF2I.0 size=1048576 2024-03-04T12:41:17.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.122+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~U7B075KRQF2I.1 size=872904 2024-03-04T12:41:17.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.122+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=U7B075KRQF2I tag=1IKYR7SQDAZF type=write size=2970056 2024-03-04T12:41:17.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.123+0000 7f093583d780 1 < canceled operation key=2R5WA9Q9ZAUG tag=PZCKJI5RPOA1 type=del size=932015 2024-03-04T12:41:17.131 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.125+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~5J9H9I1TW5KT.0 size=1048576 2024-03-04T12:41:17.131 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.126+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~5J9H9I1TW5KT.1 size=700273 2024-03-04T12:41:17.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.126+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=5J9H9I1TW5KT tag=07BSLPHVJC30 type=write size=2797425 2024-03-04T12:41:17.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.127+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~5BOZ3H78ER1P.0 size=1048576 2024-03-04T12:41:17.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.128+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~5BOZ3H78ER1P.1 size=1048576 2024-03-04T12:41:17.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.129+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~5BOZ3H78ER1P.2 size=210038 2024-03-04T12:41:17.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.131+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=5BOZ3H78ER1P tag=P21923LWDSN4 type=write size=3355766 2024-03-04T12:41:17.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.132+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~1AV6GQV02SG9.0 size=1048576 2024-03-04T12:41:17.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.133+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~1AV6GQV02SG9.1 size=1048576 2024-03-04T12:41:17.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.134+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~1AV6GQV02SG9.2 size=643239 2024-03-04T12:41:17.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.134+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=1AV6GQV02SG9 tag=MW9A0V2KUNY4 type=write size=3788967 2024-03-04T12:41:17.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.135+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~RRTDJ0LIR7JW.0 size=373748 2024-03-04T12:41:17.143 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.137+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=RRTDJ0LIR7JW tag=0K4A9NVGQB6F type=write size=1422324 2024-03-04T12:41:17.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.138+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=ZCWKAL7XDU5F type=write size=736622 2024-03-04T12:41:17.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.140+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~AXV9K3DOPPEF.0 size=1048576 2024-03-04T12:41:17.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.141+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~AXV9K3DOPPEF.1 size=1048576 2024-03-04T12:41:17.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.142+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~AXV9K3DOPPEF.2 size=762692 2024-03-04T12:41:17.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.144+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=AXV9K3DOPPEF tag=M81KWUWISXBB type=write size=3908420 2024-03-04T12:41:17.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.146+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~5QNLP21OZ05E.0 size=1048576 2024-03-04T12:41:17.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.147+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~5QNLP21OZ05E.1 size=694736 2024-03-04T12:41:17.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.147+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=5QNLP21OZ05E tag=38S06F5KLQFF type=write size=2791888 2024-03-04T12:41:17.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.148+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~1JCW030VICXW.0 size=1048576 2024-03-04T12:41:17.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.149+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~1JCW030VICXW.1 size=863730 2024-03-04T12:41:17.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.151+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=1JCW030VICXW tag=J0XUS6XAGE7I type=write size=2960882 2024-03-04T12:41:17.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.152+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=VO6RH2LJBFSN type=del size=3280757 2024-03-04T12:41:17.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.154+0000 7f093583d780 1 < completed delete operation key=O6OUISHWZ7FU tag=416ESAYRKUFP type=del 2024-03-04T12:41:17.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.156+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~8AR3N92CCTPM.0 size=589462 2024-03-04T12:41:17.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.156+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=8AR3N92CCTPM tag=FTJHL00AUJ3M type=write size=1638038 2024-03-04T12:41:17.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.157+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~H6337VZ40VGV.0 size=1048576 2024-03-04T12:41:17.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.158+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~H6337VZ40VGV.1 size=1048576 2024-03-04T12:41:17.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.159+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~H6337VZ40VGV.2 size=893721 2024-03-04T12:41:17.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.161+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=H6337VZ40VGV tag=RTPL99ELF9O4 type=write size=4039449 2024-03-04T12:41:17.168 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.162+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=LAO0K8HK4NBC type=del size=2179542 2024-03-04T12:41:17.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.163+0000 7f093583d780 1 < completed write operation key=NFM6LT89K5F4 tag=U1JWB0XHB1IV type=write size=428998 2024-03-04T12:41:17.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.165+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=V3BVY4A6SFPS type=del size=2250428 2024-03-04T12:41:17.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.165+0000 7f093583d780 1 < canceled part key=_multipart_TMAI6MOG2C4N.2~N01A1ZL8S6IK.0 size=1048576 2024-03-04T12:41:17.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.166+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~N01A1ZL8S6IK.1 size=1048576 2024-03-04T12:41:17.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.167+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~N01A1ZL8S6IK.2 size=25127 2024-03-04T12:41:17.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.169+0000 7f093583d780 1 < canceled multipart upload key=TMAI6MOG2C4N upload=N01A1ZL8S6IK tag=HX06ND1JX2MQ type=write size=3170855 2024-03-04T12:41:17.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.170+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=W0CCH9T67JXJ type=write size=398791 2024-03-04T12:41:17.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.172+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=G6VY3R7MMG26 type=del 2024-03-04T12:41:17.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.173+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=7AKNB8IAQ7K7 type=del size=170483 2024-03-04T12:41:17.180 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.174+0000 7f093583d780 1 < completed write operation key=HG0EM344TJZY tag=TMJ33XV8V9BC type=write size=958082 2024-03-04T12:41:17.181 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.175+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=S1LKZFMTLRJ0 type=write size=157893 2024-03-04T12:41:17.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.176+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~U5E4S6BGSIAE.0 size=1048576 2024-03-04T12:41:17.183 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.177+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~U5E4S6BGSIAE.1 size=266352 2024-03-04T12:41:17.185 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.179+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=U5E4S6BGSIAE tag=4H3DNUZXX0GR type=write size=2363504 2024-03-04T12:41:17.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.180+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=2D5U7PO24UK4 type=del size=3347072 2024-03-04T12:41:17.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.182+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~G3HEK3CAF5VJ.0 size=801376 2024-03-04T12:41:17.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.183+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=G3HEK3CAF5VJ tag=KMZZ3YG2Q6FJ type=write size=1849952 2024-03-04T12:41:17.190 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.185+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=ZW0BCEDS20T2 type=del size=2229491 2024-03-04T12:41:17.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.186+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~QFQLW8W5CAMD.0 size=1048576 2024-03-04T12:41:17.192 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.187+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~QFQLW8W5CAMD.1 size=1048576 2024-03-04T12:41:17.192 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.187+0000 7f093583d780 1 < canceled part key=_multipart_Y4D4Q7NV5VMO.2~QFQLW8W5CAMD.2 size=1016776 2024-03-04T12:41:17.194 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.189+0000 7f093583d780 1 < canceled multipart upload key=Y4D4Q7NV5VMO upload=QFQLW8W5CAMD tag=4DD6RW0G1HGW type=write size=4162504 2024-03-04T12:41:17.195 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.190+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=0TWVX1P6C2IP type=del size=2786189 2024-03-04T12:41:17.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.191+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~WJMUVR44P756.0 size=445624 2024-03-04T12:41:17.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.193+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=WJMUVR44P756 tag=7IZJL5T9L423 type=write size=1494200 2024-03-04T12:41:17.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.195+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=GFTD37MSL0O0 type=write size=531022 2024-03-04T12:41:17.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.196+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~U7B075KRQF2I.0 size=1048576 2024-03-04T12:41:17.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.197+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~U7B075KRQF2I.1 size=872904 2024-03-04T12:41:17.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.199+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=U7B075KRQF2I tag=1IKYR7SQDAZF type=write size=2970056 2024-03-04T12:41:17.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.200+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=6Q8L2RMD6D59 type=del size=2008363 2024-03-04T12:41:17.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.202+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~5J9H9I1TW5KT.0 size=1048576 2024-03-04T12:41:17.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.203+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~5J9H9I1TW5KT.1 size=700273 2024-03-04T12:41:17.212 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.206+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=5J9H9I1TW5KT tag=07BSLPHVJC30 type=write size=2797425 2024-03-04T12:41:17.214 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.209+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~O05C9V28JDGK.0 size=1048576 2024-03-04T12:41:17.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.210+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~O05C9V28JDGK.1 size=343924 2024-03-04T12:41:17.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.210+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=O05C9V28JDGK tag=FVBDAPJ424MV type=write size=2441076 2024-03-04T12:41:17.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.211+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~1AV6GQV02SG9.0 size=1048576 2024-03-04T12:41:17.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.211+0000 7f093583d780 1 < canceled part key=_multipart_Y4D4Q7NV5VMO.2~1AV6GQV02SG9.1 size=1048576 2024-03-04T12:41:17.217 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.212+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~1AV6GQV02SG9.2 size=643239 2024-03-04T12:41:17.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.214+0000 7f093583d780 1 < canceled multipart upload key=Y4D4Q7NV5VMO upload=1AV6GQV02SG9 tag=MW9A0V2KUNY4 type=write size=3788967 2024-03-04T12:41:17.222 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.216+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~QQOJ29QJIJ41.0 size=1048576 2024-03-04T12:41:17.223 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.217+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~QQOJ29QJIJ41.1 size=421011 2024-03-04T12:41:17.223 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.217+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=QQOJ29QJIJ41 tag=AMR743O3EAD2 type=write size=2518163 2024-03-04T12:41:17.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.218+0000 7f093583d780 1 < completed write operation key=9E12MS7PETOK tag=ZCWKAL7XDU5F type=write size=736622 2024-03-04T12:41:17.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.219+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=F4F75NQ2ODF3 type=write size=508254 2024-03-04T12:41:17.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.220+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~5QNLP21OZ05E.0 size=1048576 2024-03-04T12:41:17.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.221+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~5QNLP21OZ05E.1 size=694736 2024-03-04T12:41:17.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.223+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=5QNLP21OZ05E tag=38S06F5KLQFF type=write size=2791888 2024-03-04T12:41:17.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.225+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~AJSTVT12QA9G.0 size=235180 2024-03-04T12:41:17.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.225+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=AJSTVT12QA9G tag=CV2T4MZC7ID5 type=write size=1283756 2024-03-04T12:41:17.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.226+0000 7f093583d780 1 < canceled operation key=2ZOV2JEQHXGS tag=VO6RH2LJBFSN type=del size=3280757 2024-03-04T12:41:17.233 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.227+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=NKBY4K55KTX5 type=del size=3463532 2024-03-04T12:41:17.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.228+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~8AR3N92CCTPM.0 size=589462 2024-03-04T12:41:17.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.232+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=8AR3N92CCTPM tag=FTJHL00AUJ3M type=write size=1638038 2024-03-04T12:41:17.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.233+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=FBDAQRRHKPPM type=del size=1446237 2024-03-04T12:41:17.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.234+0000 7f093583d780 1 < completed delete operation key=NFM6LT89K5F4 tag=LAO0K8HK4NBC type=del 2024-03-04T12:41:17.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.235+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=M2PRVXMT0C2N type=del size=2651890 2024-03-04T12:41:17.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.237+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=V3BVY4A6SFPS type=del 2024-03-04T12:41:17.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.238+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=Y7Z8NNJM6QJP type=del size=2574808 2024-03-04T12:41:17.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.239+0000 7f093583d780 1 < completed write operation key=UAEQORB3BDBH tag=W0CCH9T67JXJ type=write size=398791 2024-03-04T12:41:17.246 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.240+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=Y2WIPRGIDZGL type=del size=1311396 2024-03-04T12:41:17.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.241+0000 7f093583d780 1 < completed delete operation key=O6OUISHWZ7FU tag=7AKNB8IAQ7K7 type=del 2024-03-04T12:41:17.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.243+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~YHUTTGXC4GZ2.0 size=1048576 2024-03-04T12:41:17.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.244+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~YHUTTGXC4GZ2.1 size=536905 2024-03-04T12:41:17.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.244+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=YHUTTGXC4GZ2 tag=2Z4DA0Y7X8M6 type=write size=2634057 2024-03-04T12:41:17.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.245+0000 7f093583d780 1 < completed write operation key=NQF43I07F2HT tag=S1LKZFMTLRJ0 type=write size=157893 2024-03-04T12:41:17.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.246+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=KIC7TWTV09GR type=del size=189259 2024-03-04T12:41:17.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.248+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=2D5U7PO24UK4 type=del 2024-03-04T12:41:17.254 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.249+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=WG1GV6GIFBON type=del size=3973599 2024-03-04T12:41:17.255 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.250+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=ZW0BCEDS20T2 type=del 2024-03-04T12:41:17.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.252+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~ZZA50KUU4YKV.0 size=1048576 2024-03-04T12:41:17.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.253+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~ZZA50KUU4YKV.1 size=83126 2024-03-04T12:41:17.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.253+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=ZZA50KUU4YKV tag=B1QPO02BJHH2 type=write size=2180278 2024-03-04T12:41:17.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.254+0000 7f093583d780 1 < completed delete operation key=O6OUISHWZ7FU tag=0TWVX1P6C2IP type=del 2024-03-04T12:41:17.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.256+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~BK92FD5J0TTV.0 size=1048576 2024-03-04T12:41:17.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.257+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~BK92FD5J0TTV.1 size=1048576 2024-03-04T12:41:17.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.258+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~BK92FD5J0TTV.2 size=738544 2024-03-04T12:41:17.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.258+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=BK92FD5J0TTV tag=ON9DZA21M9KW type=write size=3884272 2024-03-04T12:41:17.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.260+0000 7f093583d780 1 < suggested remove operation key=O6OUISHWZ7FU tag=GFTD37MSL0O0 type=write 2024-03-04T12:41:17.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.261+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=PLZWSHPEY2EJ type=write size=258071 2024-03-04T12:41:17.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.262+0000 7f093583d780 1 < canceled operation key=F269PJEZ05IO tag=6Q8L2RMD6D59 type=del size=2008363 2024-03-04T12:41:17.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.264+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~NK3K8W8DQ9EQ.0 size=1048576 2024-03-04T12:41:17.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.265+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~NK3K8W8DQ9EQ.1 size=1048576 2024-03-04T12:41:17.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.266+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~NK3K8W8DQ9EQ.2 size=525969 2024-03-04T12:41:17.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.266+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=NK3K8W8DQ9EQ tag=2R9F88DH9XEA type=write size=3671697 2024-03-04T12:41:17.272 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.267+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~O05C9V28JDGK.0 size=1048576 2024-03-04T12:41:17.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.268+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~O05C9V28JDGK.1 size=343924 2024-03-04T12:41:17.275 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.270+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=O05C9V28JDGK tag=FVBDAPJ424MV type=write size=2441076 2024-03-04T12:41:17.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.271+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=9VGDPKCE6STQ type=del size=2553483 2024-03-04T12:41:17.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.272+0000 7f093583d780 1 < canceled part key=_multipart_GMKM2QEP072H.2~QQOJ29QJIJ41.0 size=1048576 2024-03-04T12:41:17.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.272+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~QQOJ29QJIJ41.1 size=421011 2024-03-04T12:41:17.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.274+0000 7f093583d780 1 < canceled multipart upload key=GMKM2QEP072H upload=QQOJ29QJIJ41 tag=AMR743O3EAD2 type=write size=2518163 2024-03-04T12:41:17.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.275+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=9K8UC7VI3ZR6 type=write size=863640 2024-03-04T12:41:17.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.277+0000 7f093583d780 1 < completed write operation key=I5NQBROT0WKE tag=F4F75NQ2ODF3 type=write size=508254 2024-03-04T12:41:17.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.279+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~FO2S34KAQR2J.0 size=1048576 2024-03-04T12:41:17.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.280+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~FO2S34KAQR2J.1 size=657016 2024-03-04T12:41:17.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.280+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=FO2S34KAQR2J tag=081UOCLAN2XR type=write size=2754168 2024-03-04T12:41:17.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.281+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~AJSTVT12QA9G.0 size=235180 2024-03-04T12:41:17.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.283+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=AJSTVT12QA9G tag=CV2T4MZC7ID5 type=write size=1283756 2024-03-04T12:41:17.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.284+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=2BHXPXV8UTUY type=write size=298030 2024-03-04T12:41:17.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.285+0000 7f093583d780 -1 < failed to complete operation key=O6OUISHWZ7FU tag=NKBY4K55KTX5 type=del size=3463532: (22) Invalid argument 2024-03-04T12:41:17.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.287+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=8A4KS44RFFME type=del size=1167090 2024-03-04T12:41:17.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.288+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=FBDAQRRHKPPM type=del 2024-03-04T12:41:17.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.289+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=5JCCZ3XFYK4J type=del size=3419621 2024-03-04T12:41:17.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.291+0000 7f093583d780 1 < canceled operation key=OCOQJLUUNWRG tag=M2PRVXMT0C2N type=del size=2651890 2024-03-04T12:41:17.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.292+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=ME9PXX96HLR1 type=del size=3092450 2024-03-04T12:41:17.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.294+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=Y7Z8NNJM6QJP type=del 2024-03-04T12:41:17.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.295+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=8IZF3VJOG1LY type=del size=1244716 2024-03-04T12:41:17.302 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.296+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=Y2WIPRGIDZGL type=del 2024-03-04T12:41:17.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.297+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=RHA3JC3JHDGU type=del size=298548 2024-03-04T12:41:17.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.299+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~YHUTTGXC4GZ2.0 size=1048576 2024-03-04T12:41:17.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.300+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~YHUTTGXC4GZ2.1 size=536905 2024-03-04T12:41:17.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.302+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=YHUTTGXC4GZ2 tag=2Z4DA0Y7X8M6 type=write size=2634057 2024-03-04T12:41:17.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.304+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~263QQ2H7OMZ2.0 size=1048576 2024-03-04T12:41:17.310 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.305+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~263QQ2H7OMZ2.1 size=916944 2024-03-04T12:41:17.310 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.305+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=263QQ2H7OMZ2 tag=YQHXYMXOU4JI type=write size=3014096 2024-03-04T12:41:17.313 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.307+0000 7f093583d780 1 < suggested update operation key=3F8GI0JCUR6W tag=KIC7TWTV09GR type=del size=189259 2024-03-04T12:41:17.315 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.309+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~4VHHNCTGFC2D.0 size=1048576 2024-03-04T12:41:17.316 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.310+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~4VHHNCTGFC2D.1 size=344229 2024-03-04T12:41:17.316 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.310+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=4VHHNCTGFC2D tag=ZD7AQZL2XWDW type=write size=2441381 2024-03-04T12:41:17.317 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.312+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=WG1GV6GIFBON type=del 2024-03-04T12:41:17.319 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.314+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~S47W0U5QU0ND.0 size=1048576 2024-03-04T12:41:17.320 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.315+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~S47W0U5QU0ND.1 size=1017211 2024-03-04T12:41:17.320 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.315+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=S47W0U5QU0ND tag=CR068EUQJKGW type=write size=3114363 2024-03-04T12:41:17.321 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.316+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~ZZA50KUU4YKV.0 size=1048576 2024-03-04T12:41:17.323 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.318+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~ZZA50KUU4YKV.1 size=83126 2024-03-04T12:41:17.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.320+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=ZZA50KUU4YKV tag=B1QPO02BJHH2 type=write size=2180278 2024-03-04T12:41:17.326 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.321+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=71H8WZ0WEFEE type=del size=1545514 2024-03-04T12:41:17.327 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.322+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~BK92FD5J0TTV.0 size=1048576 2024-03-04T12:41:17.328 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.323+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~BK92FD5J0TTV.1 size=1048576 2024-03-04T12:41:17.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.324+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~BK92FD5J0TTV.2 size=738544 2024-03-04T12:41:17.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.326+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=BK92FD5J0TTV tag=ON9DZA21M9KW type=write size=3884272 2024-03-04T12:41:17.333 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.328+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~QX46N20GO1FK.0 size=1048576 2024-03-04T12:41:17.334 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.329+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~QX46N20GO1FK.1 size=156492 2024-03-04T12:41:17.334 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.329+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=QX46N20GO1FK tag=C2O4D0XHEGQV type=write size=2253644 2024-03-04T12:41:17.335 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.330+0000 7f093583d780 1 < completed write operation key=M0AOZ89IQNSK tag=PLZWSHPEY2EJ type=write size=258071 2024-03-04T12:41:17.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.331+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=R9GP7KA0Y9NW type=del size=2414067 2024-03-04T12:41:17.337 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.332+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~NK3K8W8DQ9EQ.0 size=1048576 2024-03-04T12:41:17.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.333+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~NK3K8W8DQ9EQ.1 size=1048576 2024-03-04T12:41:17.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.333+0000 7f093583d780 1 < canceled part key=_multipart_2XVNK3YEVHJ7.2~NK3K8W8DQ9EQ.2 size=525969 2024-03-04T12:41:17.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.335+0000 7f093583d780 1 < canceled multipart upload key=2XVNK3YEVHJ7 upload=NK3K8W8DQ9EQ tag=2R9F88DH9XEA type=write size=3671697 2024-03-04T12:41:17.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.336+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=U5S5YRSK7TWY type=del size=3716025 2024-03-04T12:41:17.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.337+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=9VGDPKCE6STQ type=del 2024-03-04T12:41:17.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.338+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=2SQSCWLI2FQR type=write size=615671 2024-03-04T12:41:17.346 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.340+0000 7f093583d780 1 < suggested remove operation key=2ZOV2JEQHXGS tag=9K8UC7VI3ZR6 type=write 2024-03-04T12:41:17.347 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.341+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=ZZBYWBHHC7P2 type=write size=81099 2024-03-04T12:41:17.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.342+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~FO2S34KAQR2J.0 size=1048576 2024-03-04T12:41:17.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.343+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~FO2S34KAQR2J.1 size=657016 2024-03-04T12:41:17.351 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.345+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=FO2S34KAQR2J tag=081UOCLAN2XR type=write size=2754168 2024-03-04T12:41:17.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.347+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=SMJSD4G3BXPD type=del size=1094436 2024-03-04T12:41:17.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.348+0000 7f093583d780 1 < completed write operation key=M0AOZ89IQNSK tag=2BHXPXV8UTUY type=write size=298030 2024-03-04T12:41:17.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.349+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=D53K3G18VNT5 type=del size=2341929 2024-03-04T12:41:17.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.350+0000 7f093583d780 1 < canceled operation key=GJ0FQ6EH9HJL tag=8A4KS44RFFME type=del size=1167090 2024-03-04T12:41:17.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.352+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~H13V2H45ZHXN.0 size=1048576 2024-03-04T12:41:17.359 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.354+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~H13V2H45ZHXN.1 size=334168 2024-03-04T12:41:17.359 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.354+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=H13V2H45ZHXN tag=JO5ED8Y1TUXH type=write size=2431320 2024-03-04T12:41:17.360 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.355+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=5JCCZ3XFYK4J type=del 2024-03-04T12:41:17.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.357+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~K50MTCMCE67X.0 size=1048576 2024-03-04T12:41:17.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.358+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~K50MTCMCE67X.1 size=203188 2024-03-04T12:41:17.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.358+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=K50MTCMCE67X tag=QW7THA4A8RF1 type=write size=2300340 2024-03-04T12:41:17.364 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.359+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=ME9PXX96HLR1 type=del 2024-03-04T12:41:17.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.360+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=U1GB5UQ3W4A4 type=del size=687442 2024-03-04T12:41:17.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.362+0000 7f093583d780 1 < suggested remove operation key=PT63VLFQQN0E tag=8IZF3VJOG1LY type=del 2024-03-04T12:41:17.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.363+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=PBXCP3NPY1D1 type=write size=152531 2024-03-04T12:41:17.369 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.364+0000 7f093583d780 1 < canceled operation key=9VKN43CB955V tag=RHA3JC3JHDGU type=del size=298548 2024-03-04T12:41:17.370 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.365+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=SY7OHHWLDBIQ type=del size=3475820 2024-03-04T12:41:17.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.366+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~263QQ2H7OMZ2.0 size=1048576 2024-03-04T12:41:17.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.367+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~263QQ2H7OMZ2.1 size=916944 2024-03-04T12:41:17.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.369+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=263QQ2H7OMZ2 tag=YQHXYMXOU4JI type=write size=3014096 2024-03-04T12:41:17.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.370+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=51MTMJSFMWVM type=del size=851525 2024-03-04T12:41:17.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.372+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~4VHHNCTGFC2D.0 size=1048576 2024-03-04T12:41:17.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.372+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~4VHHNCTGFC2D.1 size=344229 2024-03-04T12:41:17.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.375+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=4VHHNCTGFC2D tag=ZD7AQZL2XWDW type=write size=2441381 2024-03-04T12:41:17.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.376+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=M56QY3CX7MW2 type=del size=3296385 2024-03-04T12:41:17.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.377+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~S47W0U5QU0ND.0 size=1048576 2024-03-04T12:41:17.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.378+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~S47W0U5QU0ND.1 size=1017211 2024-03-04T12:41:17.385 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.380+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=S47W0U5QU0ND tag=CR068EUQJKGW type=write size=3114363 2024-03-04T12:41:17.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.381+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=HWQ6MKXZHILS type=write size=408495 2024-03-04T12:41:17.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.382+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=71H8WZ0WEFEE type=del 2024-03-04T12:41:17.389 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.384+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~F0ILAOCR2MP9.0 size=1048576 2024-03-04T12:41:17.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.384+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~F0ILAOCR2MP9.1 size=1048576 2024-03-04T12:41:17.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.385+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~F0ILAOCR2MP9.2 size=356180 2024-03-04T12:41:17.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.385+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=F0ILAOCR2MP9 tag=KXQR8SP4ZRTV type=write size=3501908 2024-03-04T12:41:17.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.386+0000 7f093583d780 1 < canceled part key=_multipart_HG0EM344TJZY.2~QX46N20GO1FK.0 size=1048576 2024-03-04T12:41:17.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.386+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~QX46N20GO1FK.1 size=156492 2024-03-04T12:41:17.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.388+0000 7f093583d780 1 < canceled multipart upload key=HG0EM344TJZY upload=QX46N20GO1FK tag=C2O4D0XHEGQV type=write size=2253644 2024-03-04T12:41:17.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.389+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=GQ4ITJ467JYW type=del size=3710509 2024-03-04T12:41:17.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.390+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=R9GP7KA0Y9NW type=del 2024-03-04T12:41:17.397 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.392+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=4X2CSFR1T26G type=del size=396201 2024-03-04T12:41:17.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.393+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=U5S5YRSK7TWY type=del 2024-03-04T12:41:17.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.394+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=3OFMNXWM9X49 type=write size=430215 2024-03-04T12:41:17.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.395+0000 7f093583d780 1 < completed write operation key=I5NQBROT0WKE tag=2SQSCWLI2FQR type=write size=615671 2024-03-04T12:41:17.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.396+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=PIDEBY1OM7HB type=write size=100548 2024-03-04T12:41:17.404 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.399+0000 7f093583d780 1 < suggested update operation key=NFM6LT89K5F4 tag=ZZBYWBHHC7P2 type=write size=81099 2024-03-04T12:41:17.406 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.401+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~VNWUR7FAPXKR.0 size=1048576 2024-03-04T12:41:17.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.402+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~VNWUR7FAPXKR.1 size=662118 2024-03-04T12:41:17.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.402+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=VNWUR7FAPXKR tag=5QZCE472J6TP type=write size=2759270 2024-03-04T12:41:17.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.403+0000 7f093583d780 1 < canceled operation key=F269PJEZ05IO tag=SMJSD4G3BXPD type=del size=1094436 2024-03-04T12:41:17.410 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.405+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~CDOMPN7PQETJ.0 size=920902 2024-03-04T12:41:17.410 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.405+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=CDOMPN7PQETJ tag=GX4AZFKPRXLL type=write size=1969478 2024-03-04T12:41:17.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.406+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=D53K3G18VNT5 type=del 2024-03-04T12:41:17.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.408+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~DSSGKTAMUN30.0 size=1048576 2024-03-04T12:41:17.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.409+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~DSSGKTAMUN30.1 size=1016761 2024-03-04T12:41:17.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.409+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=DSSGKTAMUN30 tag=V8ASHALXLWSP type=write size=3113913 2024-03-04T12:41:17.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.410+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~H13V2H45ZHXN.0 size=1048576 2024-03-04T12:41:17.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.411+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~H13V2H45ZHXN.1 size=334168 2024-03-04T12:41:17.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.413+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=H13V2H45ZHXN tag=JO5ED8Y1TUXH type=write size=2431320 2024-03-04T12:41:17.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.414+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=HQV4WLWQV656 type=del size=2658195 2024-03-04T12:41:17.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.415+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~K50MTCMCE67X.0 size=1048576 2024-03-04T12:41:17.422 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.416+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~K50MTCMCE67X.1 size=203188 2024-03-04T12:41:17.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.418+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=K50MTCMCE67X tag=QW7THA4A8RF1 type=write size=2300340 2024-03-04T12:41:17.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.419+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=R1DRA3W0APX0 type=write size=1010119 2024-03-04T12:41:17.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.421+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=U1GB5UQ3W4A4 type=del 2024-03-04T12:41:17.427 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.422+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=NOK9C42XIG2V type=del size=1057885 2024-03-04T12:41:17.430 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.424+0000 7f093583d780 1 < completed write operation key=PT63VLFQQN0E tag=PBXCP3NPY1D1 type=write size=152531 2024-03-04T12:41:17.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.426+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~N4GIBY70JJN9.0 size=991221 2024-03-04T12:41:17.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.426+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=N4GIBY70JJN9 tag=S78S30YTW05D type=write size=2039797 2024-03-04T12:41:17.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.427+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=SY7OHHWLDBIQ type=del 2024-03-04T12:41:17.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.429+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~9R1L92ITXU3S.0 size=1001940 2024-03-04T12:41:17.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.429+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=9R1L92ITXU3S tag=YBQUHJBC17CB type=write size=2050516 2024-03-04T12:41:17.436 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.430+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=51MTMJSFMWVM type=del 2024-03-04T12:41:17.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.431+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=TEH7O12R27B1 type=del size=1288312 2024-03-04T12:41:17.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.433+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=M56QY3CX7MW2 type=del 2024-03-04T12:41:17.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.435+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~5C39O019MT7X.0 size=659207 2024-03-04T12:41:17.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.435+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=5C39O019MT7X tag=MC87QH7FBXX9 type=write size=1707783 2024-03-04T12:41:17.441 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.436+0000 7f093583d780 1 < completed write operation key=3F8GI0JCUR6W tag=HWQ6MKXZHILS type=write size=408495 2024-03-04T12:41:17.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.438+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~797YXV2KGV96.0 size=1048576 2024-03-04T12:41:17.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.439+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~797YXV2KGV96.1 size=1048576 2024-03-04T12:41:17.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.440+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~797YXV2KGV96.2 size=25165 2024-03-04T12:41:17.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.440+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=797YXV2KGV96 tag=FMWMFYWVHY1G type=write size=3170893 2024-03-04T12:41:17.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.441+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~F0ILAOCR2MP9.0 size=1048576 2024-03-04T12:41:17.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.442+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~F0ILAOCR2MP9.1 size=1048576 2024-03-04T12:41:17.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.443+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~F0ILAOCR2MP9.2 size=356180 2024-03-04T12:41:17.450 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.444+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=F0ILAOCR2MP9 tag=KXQR8SP4ZRTV type=write size=3501908 2024-03-04T12:41:17.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.447+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~HUK908815210.0 size=1048576 2024-03-04T12:41:17.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.448+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~HUK908815210.1 size=579608 2024-03-04T12:41:17.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.448+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=HUK908815210 tag=ZU885JAIJ3CE type=write size=2676760 2024-03-04T12:41:17.454 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.449+0000 7f093583d780 1 < canceled operation key=Y4D4Q7NV5VMO tag=GQ4ITJ467JYW type=del size=3710509 2024-03-04T12:41:17.455 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.450+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=ZCLKO5G96D6I type=del size=78094 2024-03-04T12:41:17.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.451+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=4X2CSFR1T26G type=del 2024-03-04T12:41:17.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.453+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~HIX2F1Z6WUFY.0 size=1048576 2024-03-04T12:41:17.459 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.454+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~HIX2F1Z6WUFY.1 size=1048576 2024-03-04T12:41:17.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.455+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~HIX2F1Z6WUFY.2 size=605827 2024-03-04T12:41:17.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.455+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=HIX2F1Z6WUFY tag=NLINKFEF3UQ2 type=write size=3751555 2024-03-04T12:41:17.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.457+0000 7f093583d780 1 < completed write operation key=3F8GI0JCUR6W tag=3OFMNXWM9X49 type=write size=430215 2024-03-04T12:41:17.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.458+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=9F33FUB4E9XE type=del size=34718 2024-03-04T12:41:17.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.459+0000 7f093583d780 1 < completed write operation key=U6F7IZ07CS9Q tag=PIDEBY1OM7HB type=write size=100548 2024-03-04T12:41:17.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.460+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=K1TZNX415EIT type=del size=1250283 2024-03-04T12:41:17.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.461+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~VNWUR7FAPXKR.0 size=1048576 2024-03-04T12:41:17.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.462+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~VNWUR7FAPXKR.1 size=662118 2024-03-04T12:41:17.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.464+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=VNWUR7FAPXKR tag=5QZCE472J6TP type=write size=2759270 2024-03-04T12:41:17.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.466+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~6MWQ8BV7QSY8.0 size=1048576 2024-03-04T12:41:17.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.467+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~6MWQ8BV7QSY8.1 size=1545 2024-03-04T12:41:17.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.467+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=6MWQ8BV7QSY8 tag=V6GRI42D17L8 type=write size=2098697 2024-03-04T12:41:17.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.469+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~CDOMPN7PQETJ.0 size=920902 2024-03-04T12:41:17.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.471+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=CDOMPN7PQETJ tag=GX4AZFKPRXLL type=write size=1969478 2024-03-04T12:41:17.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.473+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~01FHYLTY05QJ.0 size=1048576 2024-03-04T12:41:17.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.474+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~01FHYLTY05QJ.1 size=808338 2024-03-04T12:41:17.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.474+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=01FHYLTY05QJ tag=IMKECRLFL7AX type=write size=2905490 2024-03-04T12:41:17.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.475+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~DSSGKTAMUN30.0 size=1048576 2024-03-04T12:41:17.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.476+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~DSSGKTAMUN30.1 size=1016761 2024-03-04T12:41:17.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.477+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=DSSGKTAMUN30 tag=V8ASHALXLWSP type=write size=3113913 2024-03-04T12:41:17.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.479+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~E0C62BBA978X.0 size=1048576 2024-03-04T12:41:17.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.480+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~E0C62BBA978X.1 size=1048576 2024-03-04T12:41:17.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.481+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~E0C62BBA978X.2 size=460026 2024-03-04T12:41:17.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.481+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=E0C62BBA978X tag=1DCHW1PT6IBJ type=write size=3605754 2024-03-04T12:41:17.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.482+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=HQV4WLWQV656 type=del 2024-03-04T12:41:17.489 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.483+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=WB3TBM8PJFMR type=write size=280010 2024-03-04T12:41:17.490 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.484+0000 7f093583d780 1 < completed write operation key=HG0EM344TJZY tag=R1DRA3W0APX0 type=write size=1010119 2024-03-04T12:41:17.491 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.485+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=LCWHPZLTQQ4U type=write size=528673 2024-03-04T12:41:17.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.486+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=NOK9C42XIG2V type=del 2024-03-04T12:41:17.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.488+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=1OFTV2113C6R type=del size=3043023 2024-03-04T12:41:17.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.489+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~N4GIBY70JJN9.0 size=991221 2024-03-04T12:41:17.496 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.490+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=N4GIBY70JJN9 tag=S78S30YTW05D type=write size=2039797 2024-03-04T12:41:17.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.492+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=R1SVPI54W33T type=del size=2164150 2024-03-04T12:41:17.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.492+0000 7f093583d780 1 < canceled part key=_multipart_OFTWI7UFD5L5.2~9R1L92ITXU3S.0 size=1001940 2024-03-04T12:41:17.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.494+0000 7f093583d780 1 < canceled multipart upload key=OFTWI7UFD5L5 upload=9R1L92ITXU3S tag=YBQUHJBC17CB type=write size=2050516 2024-03-04T12:41:17.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.495+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=CVP7DBQQQ40P type=del size=2997383 2024-03-04T12:41:17.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.496+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=TEH7O12R27B1 type=del 2024-03-04T12:41:17.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.498+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~N9LEZ4HGPILE.0 size=1048576 2024-03-04T12:41:17.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.499+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~N9LEZ4HGPILE.1 size=698888 2024-03-04T12:41:17.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.499+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=N9LEZ4HGPILE tag=JCPQA5EZL36U type=write size=2796040 2024-03-04T12:41:17.506 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.500+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~5C39O019MT7X.0 size=659207 2024-03-04T12:41:17.508 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.502+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=5C39O019MT7X tag=MC87QH7FBXX9 type=write size=1707783 2024-03-04T12:41:17.509 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.503+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=JKKLEGJB9192 type=del size=420574 2024-03-04T12:41:17.510 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.505+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~797YXV2KGV96.0 size=1048576 2024-03-04T12:41:17.510 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.505+0000 7f093583d780 1 < canceled part key=_multipart_3F8GI0JCUR6W.2~797YXV2KGV96.1 size=1048576 2024-03-04T12:41:17.511 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.505+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~797YXV2KGV96.2 size=25165 2024-03-04T12:41:17.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.508+0000 7f093583d780 1 < canceled multipart upload key=3F8GI0JCUR6W upload=797YXV2KGV96 tag=FMWMFYWVHY1G type=write size=3170893 2024-03-04T12:41:17.514 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.509+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=Z1TPG1HQ1J8H type=del size=3982962 2024-03-04T12:41:17.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.510+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~HUK908815210.0 size=1048576 2024-03-04T12:41:17.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.511+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~HUK908815210.1 size=579608 2024-03-04T12:41:17.518 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.513+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=HUK908815210 tag=ZU885JAIJ3CE type=write size=2676760 2024-03-04T12:41:17.520 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.514+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=W92OSYRKFA9P type=del size=2340823 2024-03-04T12:41:17.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.515+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=ZCLKO5G96D6I type=del 2024-03-04T12:41:17.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.516+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=NO3SYM9JGD0B type=del size=2106160 2024-03-04T12:41:17.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.518+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~HIX2F1Z6WUFY.0 size=1048576 2024-03-04T12:41:17.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.518+0000 7f093583d780 1 < canceled part key=_multipart_2ZOV2JEQHXGS.2~HIX2F1Z6WUFY.1 size=1048576 2024-03-04T12:41:17.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.518+0000 7f093583d780 1 < canceled part key=_multipart_2ZOV2JEQHXGS.2~HIX2F1Z6WUFY.2 size=605827 2024-03-04T12:41:17.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.519+0000 7f093583d780 1 < canceled multipart upload key=2ZOV2JEQHXGS upload=HIX2F1Z6WUFY tag=NLINKFEF3UQ2 type=write size=3751555 2024-03-04T12:41:17.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.521+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~K2HKIF2GV9U1.0 size=1048576 2024-03-04T12:41:17.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.522+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~K2HKIF2GV9U1.1 size=494292 2024-03-04T12:41:17.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.522+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=K2HKIF2GV9U1 tag=97M96DX1I3E2 type=write size=2591444 2024-03-04T12:41:17.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.523+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=9F33FUB4E9XE type=del 2024-03-04T12:41:17.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.525+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=EATCCMTCZ60Q type=del size=1361731 2024-03-04T12:41:17.531 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.526+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=K1TZNX415EIT type=del 2024-03-04T12:41:17.532 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.527+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=VKSBDXF47USH type=write size=920088 2024-03-04T12:41:17.533 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.528+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~6MWQ8BV7QSY8.0 size=1048576 2024-03-04T12:41:17.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.530+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~6MWQ8BV7QSY8.1 size=1545 2024-03-04T12:41:17.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.532+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=6MWQ8BV7QSY8 tag=V6GRI42D17L8 type=write size=2098697 2024-03-04T12:41:17.541 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.535+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~7CZOWADTXCIU.0 size=519784 2024-03-04T12:41:17.541 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.535+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=7CZOWADTXCIU tag=9B82YOJAC38O type=write size=1568360 2024-03-04T12:41:17.542 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.537+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~01FHYLTY05QJ.0 size=1048576 2024-03-04T12:41:17.543 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.538+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~01FHYLTY05QJ.1 size=808338 2024-03-04T12:41:17.547 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.542+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=01FHYLTY05QJ tag=IMKECRLFL7AX type=write size=2905490 2024-03-04T12:41:17.549 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.544+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~UIMRMQFAC95C.0 size=1048576 2024-03-04T12:41:17.550 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.544+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~UIMRMQFAC95C.1 size=1048576 2024-03-04T12:41:17.551 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.545+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~UIMRMQFAC95C.2 size=850736 2024-03-04T12:41:17.551 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.545+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=UIMRMQFAC95C tag=G3FE4N97WJYJ type=write size=3996464 2024-03-04T12:41:17.552 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.546+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~E0C62BBA978X.0 size=1048576 2024-03-04T12:41:17.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.547+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~E0C62BBA978X.1 size=1048576 2024-03-04T12:41:17.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.548+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~E0C62BBA978X.2 size=460026 2024-03-04T12:41:17.556 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.550+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=E0C62BBA978X tag=1DCHW1PT6IBJ type=write size=3605754 2024-03-04T12:41:17.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.553+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~56J8C9BV2GJE.0 size=1048576 2024-03-04T12:41:17.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.553+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~56J8C9BV2GJE.1 size=646501 2024-03-04T12:41:17.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.553+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=56J8C9BV2GJE tag=13SZYZTA6W09 type=write size=2743653 2024-03-04T12:41:17.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.555+0000 7f093583d780 1 < completed write operation key=2YD2M0JQNCC0 tag=WB3TBM8PJFMR type=write size=280010 2024-03-04T12:41:17.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.557+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~SA32TGRV70TL.0 size=1048576 2024-03-04T12:41:17.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.558+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~SA32TGRV70TL.1 size=182049 2024-03-04T12:41:17.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.558+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=SA32TGRV70TL tag=14BDDRCE9CWL type=write size=2279201 2024-03-04T12:41:17.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.560+0000 7f093583d780 1 < suggested update operation key=AQI7H63EQSTN tag=LCWHPZLTQQ4U type=write size=528673 2024-03-04T12:41:17.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.562+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~MDECB3CO0VT2.0 size=1048576 2024-03-04T12:41:17.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.562+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~MDECB3CO0VT2.1 size=185299 2024-03-04T12:41:17.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.562+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=MDECB3CO0VT2 tag=GP3RL3R0YVK1 type=write size=2282451 2024-03-04T12:41:17.570 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.565+0000 7f093583d780 1 < suggested update operation key=O6OUISHWZ7FU tag=1OFTV2113C6R type=del size=3043023 2024-03-04T12:41:17.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.567+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~6YJFOHR8W378.0 size=242432 2024-03-04T12:41:17.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.567+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=6YJFOHR8W378 tag=4OFQ3NYFDRQ8 type=write size=1291008 2024-03-04T12:41:17.573 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.568+0000 7f093583d780 1 < canceled operation key=Y4D4Q7NV5VMO tag=R1SVPI54W33T type=del size=2164150 2024-03-04T12:41:17.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.570+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~JIO8EUKA5ZF5.0 size=508012 2024-03-04T12:41:17.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.570+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=JIO8EUKA5ZF5 tag=3EUXC9NU6X6I type=write size=1556588 2024-03-04T12:41:17.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.572+0000 7f093583d780 1 < suggested remove operation key=U6F7IZ07CS9Q tag=CVP7DBQQQ40P type=del 2024-03-04T12:41:17.579 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.574+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~Y2RNSBDUNNL4.0 size=1048576 2024-03-04T12:41:17.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.575+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~Y2RNSBDUNNL4.1 size=792625 2024-03-04T12:41:17.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.575+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=Y2RNSBDUNNL4 tag=62XS2PB2FLZ0 type=write size=2889777 2024-03-04T12:41:17.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.575+0000 7f093583d780 1 < canceled part key=_multipart_9E12MS7PETOK.2~N9LEZ4HGPILE.0 size=1048576 2024-03-04T12:41:17.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.576+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~N9LEZ4HGPILE.1 size=698888 2024-03-04T12:41:17.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.577+0000 7f093583d780 1 < canceled multipart upload key=9E12MS7PETOK upload=N9LEZ4HGPILE tag=JCPQA5EZL36U type=write size=2796040 2024-03-04T12:41:17.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.579+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~73Y1UQDCN5WP.0 size=716079 2024-03-04T12:41:17.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.579+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=73Y1UQDCN5WP tag=ZS0JM30CB00K type=write size=1764655 2024-03-04T12:41:17.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.581+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=JKKLEGJB9192 type=del 2024-03-04T12:41:17.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.583+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~CPI2XDDC2PCA.0 size=1048576 2024-03-04T12:41:17.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.583+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~CPI2XDDC2PCA.1 size=1048576 2024-03-04T12:41:17.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.584+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~CPI2XDDC2PCA.2 size=741997 2024-03-04T12:41:17.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.584+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=CPI2XDDC2PCA tag=HDAQD8EI1ZJN type=write size=3887725 2024-03-04T12:41:17.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.585+0000 7f093583d780 1 < canceled operation key=F269PJEZ05IO tag=Z1TPG1HQ1J8H type=del size=3982962 2024-03-04T12:41:17.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.586+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=AX1MD0HDT5WI type=del size=1843829 2024-03-04T12:41:17.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.588+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=W92OSYRKFA9P type=del 2024-03-04T12:41:17.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.590+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~IK92BS8W65HT.0 size=1048576 2024-03-04T12:41:17.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.590+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~IK92BS8W65HT.1 size=333721 2024-03-04T12:41:17.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.590+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=IK92BS8W65HT tag=NXIJTVL5P8IY type=write size=2430873 2024-03-04T12:41:17.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.592+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=NO3SYM9JGD0B type=del 2024-03-04T12:41:17.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.594+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~GTAJXX0TQVF3.0 size=1048576 2024-03-04T12:41:17.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.594+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~GTAJXX0TQVF3.1 size=153076 2024-03-04T12:41:17.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.594+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=GTAJXX0TQVF3 tag=BG2493X3Y6Y9 type=write size=2250228 2024-03-04T12:41:17.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.596+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~K2HKIF2GV9U1.0 size=1048576 2024-03-04T12:41:17.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.597+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~K2HKIF2GV9U1.1 size=494292 2024-03-04T12:41:17.604 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.598+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=K2HKIF2GV9U1 tag=97M96DX1I3E2 type=write size=2591444 2024-03-04T12:41:17.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.600+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~QCE0N189BHUW.0 size=1048576 2024-03-04T12:41:17.607 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.601+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~QCE0N189BHUW.1 size=1041909 2024-03-04T12:41:17.607 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.601+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=QCE0N189BHUW tag=JBV087PRHWTZ type=write size=3139061 2024-03-04T12:41:17.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.603+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=EATCCMTCZ60Q type=del 2024-03-04T12:41:17.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.605+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~1G5XPIT0ASZI.0 size=1048576 2024-03-04T12:41:17.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.605+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~1G5XPIT0ASZI.1 size=731216 2024-03-04T12:41:17.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.605+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=1G5XPIT0ASZI tag=IQ6WHV1C9UY4 type=write size=2828368 2024-03-04T12:41:17.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.607+0000 7f093583d780 1 < completed write operation key=2R5WA9Q9ZAUG tag=VKSBDXF47USH type=write size=920088 2024-03-04T12:41:17.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.608+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=F9X0QUJR2YN5 type=del size=2117254 2024-03-04T12:41:17.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.609+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~7CZOWADTXCIU.0 size=519784 2024-03-04T12:41:17.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.611+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=7CZOWADTXCIU tag=9B82YOJAC38O type=write size=1568360 2024-03-04T12:41:17.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.613+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~ZVSAWIUXR1CI.0 size=390834 2024-03-04T12:41:17.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.613+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=ZVSAWIUXR1CI tag=2YIWRBUQ5MXW type=write size=1439410 2024-03-04T12:41:17.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.614+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~UIMRMQFAC95C.0 size=1048576 2024-03-04T12:41:17.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.614+0000 7f093583d780 1 < canceled part key=_multipart_96PTQ2KHPMMM.2~UIMRMQFAC95C.1 size=1048576 2024-03-04T12:41:17.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.615+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~UIMRMQFAC95C.2 size=850736 2024-03-04T12:41:17.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.617+0000 7f093583d780 1 < canceled multipart upload key=96PTQ2KHPMMM upload=UIMRMQFAC95C tag=G3FE4N97WJYJ type=write size=3996464 2024-03-04T12:41:17.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.618+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=86C3P9HVIFNS type=write size=17598 2024-03-04T12:41:17.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.620+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~56J8C9BV2GJE.0 size=1048576 2024-03-04T12:41:17.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.621+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~56J8C9BV2GJE.1 size=646501 2024-03-04T12:41:17.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.622+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=56J8C9BV2GJE tag=13SZYZTA6W09 type=write size=2743653 2024-03-04T12:41:17.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.623+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=F64ORX326RUX type=write size=658340 2024-03-04T12:41:17.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.625+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~SA32TGRV70TL.0 size=1048576 2024-03-04T12:41:17.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.625+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~SA32TGRV70TL.1 size=182049 2024-03-04T12:41:17.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.627+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=SA32TGRV70TL tag=14BDDRCE9CWL type=write size=2279201 2024-03-04T12:41:17.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.628+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=KU1WIC9B66UN type=del size=1156102 2024-03-04T12:41:17.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.630+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~MDECB3CO0VT2.0 size=1048576 2024-03-04T12:41:17.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.630+0000 7f093583d780 1 < canceled part key=_multipart_2R5WA9Q9ZAUG.2~MDECB3CO0VT2.1 size=185299 2024-03-04T12:41:17.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.632+0000 7f093583d780 1 < canceled multipart upload key=2R5WA9Q9ZAUG upload=MDECB3CO0VT2 tag=GP3RL3R0YVK1 type=write size=2282451 2024-03-04T12:41:17.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.634+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~3KUCDNMTPRSZ.0 size=1048576 2024-03-04T12:41:17.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.636+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~3KUCDNMTPRSZ.1 size=405139 2024-03-04T12:41:17.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.636+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=3KUCDNMTPRSZ tag=GVQEWDARUEJ9 type=write size=2502291 2024-03-04T12:41:17.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.637+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~6YJFOHR8W378.0 size=242432 2024-03-04T12:41:17.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.639+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=6YJFOHR8W378 tag=4OFQ3NYFDRQ8 type=write size=1291008 2024-03-04T12:41:17.646 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.641+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~3B34RA4N67Y4.0 size=592252 2024-03-04T12:41:17.646 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.641+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=3B34RA4N67Y4 tag=DGLC8GBBR2Z8 type=write size=1640828 2024-03-04T12:41:17.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.642+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~JIO8EUKA5ZF5.0 size=508012 2024-03-04T12:41:17.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.644+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=JIO8EUKA5ZF5 tag=3EUXC9NU6X6I type=write size=1556588 2024-03-04T12:41:17.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.648+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~OAE6W99SK3K5.0 size=1048576 2024-03-04T12:41:17.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.648+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~OAE6W99SK3K5.1 size=236621 2024-03-04T12:41:17.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.648+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=OAE6W99SK3K5 tag=UP7RSZ3W1H0L type=write size=2333773 2024-03-04T12:41:17.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.650+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~Y2RNSBDUNNL4.0 size=1048576 2024-03-04T12:41:17.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.650+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~Y2RNSBDUNNL4.1 size=792625 2024-03-04T12:41:17.658 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.652+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=Y2RNSBDUNNL4 tag=62XS2PB2FLZ0 type=write size=2889777 2024-03-04T12:41:17.659 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.653+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=ILO1C2KYK9GU type=del size=100313 2024-03-04T12:41:17.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.655+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~73Y1UQDCN5WP.0 size=716079 2024-03-04T12:41:17.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.657+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=73Y1UQDCN5WP tag=ZS0JM30CB00K type=write size=1764655 2024-03-04T12:41:17.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.658+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=EBPBC1EDIMA0 type=write size=227962 2024-03-04T12:41:17.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.659+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~CPI2XDDC2PCA.0 size=1048576 2024-03-04T12:41:17.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.660+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~CPI2XDDC2PCA.1 size=1048576 2024-03-04T12:41:17.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.660+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~CPI2XDDC2PCA.2 size=741997 2024-03-04T12:41:17.668 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.662+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=CPI2XDDC2PCA tag=HDAQD8EI1ZJN type=write size=3887725 2024-03-04T12:41:17.670 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.664+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~2MAY7NOCR0J1.0 size=1048576 2024-03-04T12:41:17.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.665+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~2MAY7NOCR0J1.1 size=327386 2024-03-04T12:41:17.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.665+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=2MAY7NOCR0J1 tag=ANNS539S0CEO type=write size=2424538 2024-03-04T12:41:17.672 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.666+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=AX1MD0HDT5WI type=del 2024-03-04T12:41:17.674 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.668+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~K2NFYALFZLVZ.0 size=1048576 2024-03-04T12:41:17.675 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.669+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~K2NFYALFZLVZ.1 size=1048576 2024-03-04T12:41:17.675 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.670+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~K2NFYALFZLVZ.2 size=65942 2024-03-04T12:41:17.676 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.670+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=K2NFYALFZLVZ tag=86LSE60QVUBA type=write size=3211670 2024-03-04T12:41:17.677 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.671+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~IK92BS8W65HT.0 size=1048576 2024-03-04T12:41:17.677 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.672+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~IK92BS8W65HT.1 size=333721 2024-03-04T12:41:17.679 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.674+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=IK92BS8W65HT tag=NXIJTVL5P8IY type=write size=2430873 2024-03-04T12:41:17.680 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.675+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=2Q1VDUN651ER type=del size=806587 2024-03-04T12:41:17.682 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.676+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~GTAJXX0TQVF3.0 size=1048576 2024-03-04T12:41:17.682 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.677+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~GTAJXX0TQVF3.1 size=153076 2024-03-04T12:41:17.684 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.679+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=GTAJXX0TQVF3 tag=BG2493X3Y6Y9 type=write size=2250228 2024-03-04T12:41:17.685 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.680+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=KP5KJ84ON3WR type=del size=536952 2024-03-04T12:41:17.687 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.681+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~QCE0N189BHUW.0 size=1048576 2024-03-04T12:41:17.687 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.682+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~QCE0N189BHUW.1 size=1041909 2024-03-04T12:41:17.690 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.684+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=QCE0N189BHUW tag=JBV087PRHWTZ type=write size=3139061 2024-03-04T12:41:17.691 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.685+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=XL1CZWZNBFQQ type=write size=539749 2024-03-04T12:41:17.692 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.686+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~1G5XPIT0ASZI.0 size=1048576 2024-03-04T12:41:17.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.687+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~1G5XPIT0ASZI.1 size=731216 2024-03-04T12:41:17.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.689+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=1G5XPIT0ASZI tag=IQ6WHV1C9UY4 type=write size=2828368 2024-03-04T12:41:17.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.691+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~NML6UZXNTGAS.0 size=92978 2024-03-04T12:41:17.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.691+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=NML6UZXNTGAS tag=OU5CMUX5NHX2 type=write size=1141554 2024-03-04T12:41:17.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.693+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=F9X0QUJR2YN5 type=del 2024-03-04T12:41:17.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.694+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=UBGL3N8FU3QZ type=del size=2034598 2024-03-04T12:41:17.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.695+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~ZVSAWIUXR1CI.0 size=390834 2024-03-04T12:41:17.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.697+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=ZVSAWIUXR1CI tag=2YIWRBUQ5MXW type=write size=1439410 2024-03-04T12:41:17.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.698+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=GGE3JXX6L067 type=del size=2296771 2024-03-04T12:41:17.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.699+0000 7f093583d780 1 < completed write operation key=AQI7H63EQSTN tag=86C3P9HVIFNS type=write size=17598 2024-03-04T12:41:17.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.701+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~GZ4P3LQW4Y34.0 size=1048576 2024-03-04T12:41:17.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.702+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~GZ4P3LQW4Y34.1 size=935845 2024-03-04T12:41:17.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.702+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=GZ4P3LQW4Y34 tag=G60019K18KWJ type=write size=3032997 2024-03-04T12:41:17.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.704+0000 7f093583d780 1 < completed write operation key=2ZOV2JEQHXGS tag=F64ORX326RUX type=write size=658340 2024-03-04T12:41:17.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.706+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~65ZTCIO9ZYYD.0 size=1048576 2024-03-04T12:41:17.712 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.707+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~65ZTCIO9ZYYD.1 size=876466 2024-03-04T12:41:17.712 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.707+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=65ZTCIO9ZYYD tag=4YDNA0C33QD3 type=write size=2973618 2024-03-04T12:41:17.713 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.708+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=KU1WIC9B66UN type=del 2024-03-04T12:41:17.714 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.709+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=NYK2JYFWY0WA type=del size=1347567 2024-03-04T12:41:17.716 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.710+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~3KUCDNMTPRSZ.0 size=1048576 2024-03-04T12:41:17.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.711+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~3KUCDNMTPRSZ.1 size=405139 2024-03-04T12:41:17.718 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.713+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=3KUCDNMTPRSZ tag=GVQEWDARUEJ9 type=write size=2502291 2024-03-04T12:41:17.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.714+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=Z9KB6NCI2CLU type=del size=261690 2024-03-04T12:41:17.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.716+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~3B34RA4N67Y4.0 size=592252 2024-03-04T12:41:17.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.718+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=3B34RA4N67Y4 tag=DGLC8GBBR2Z8 type=write size=1640828 2024-03-04T12:41:17.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.719+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=CRHZ6AJH6X1I type=del size=2678202 2024-03-04T12:41:17.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.720+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~OAE6W99SK3K5.0 size=1048576 2024-03-04T12:41:17.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.721+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~OAE6W99SK3K5.1 size=236621 2024-03-04T12:41:17.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.723+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=OAE6W99SK3K5 tag=UP7RSZ3W1H0L type=write size=2333773 2024-03-04T12:41:17.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.724+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=QW15OWMN6CGL type=del size=1860846 2024-03-04T12:41:17.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.725+0000 7f093583d780 1 < canceled operation key=AQI7H63EQSTN tag=ILO1C2KYK9GU type=del size=100313 2024-03-04T12:41:17.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.726+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=I1RBIZ2LGIA8 type=write size=653847 2024-03-04T12:41:17.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.728+0000 7f093583d780 1 < completed write operation key=TMAI6MOG2C4N tag=EBPBC1EDIMA0 type=write size=227962 2024-03-04T12:41:17.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.729+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=L1PQRQUL46OX type=del size=4182931 2024-03-04T12:41:17.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.730+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~2MAY7NOCR0J1.0 size=1048576 2024-03-04T12:41:17.736 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.731+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~2MAY7NOCR0J1.1 size=327386 2024-03-04T12:41:17.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.733+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=2MAY7NOCR0J1 tag=ANNS539S0CEO type=write size=2424538 2024-03-04T12:41:17.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.734+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=HWEA0S7WXH37 type=del size=2735936 2024-03-04T12:41:17.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.735+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~K2NFYALFZLVZ.0 size=1048576 2024-03-04T12:41:17.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.736+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~K2NFYALFZLVZ.1 size=1048576 2024-03-04T12:41:17.742 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.737+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~K2NFYALFZLVZ.2 size=65942 2024-03-04T12:41:17.744 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.739+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=K2NFYALFZLVZ tag=86LSE60QVUBA type=write size=3211670 2024-03-04T12:41:17.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.740+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=MTXBYH1JHF0K type=del size=2231712 2024-03-04T12:41:17.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.745+0000 7f093583d780 1 < suggested remove operation key=PT63VLFQQN0E tag=2Q1VDUN651ER type=del 2024-03-04T12:41:17.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.746+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=2PPK99V6EPHI type=del size=2478293 2024-03-04T12:41:17.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.749+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=KP5KJ84ON3WR type=del 2024-03-04T12:41:17.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.750+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=SMGIUIIHRTW4 type=del size=1435874 2024-03-04T12:41:17.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.751+0000 7f093583d780 1 < completed write operation key=I5NQBROT0WKE tag=XL1CZWZNBFQQ type=write size=539749 2024-03-04T12:41:17.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.752+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=1HMHWZC1TBR5 type=del size=1110534 2024-03-04T12:41:17.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.753+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~NML6UZXNTGAS.0 size=92978 2024-03-04T12:41:17.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.756+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=NML6UZXNTGAS tag=OU5CMUX5NHX2 type=write size=1141554 2024-03-04T12:41:17.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.757+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=UP2OL0XHROLN type=del size=4712 2024-03-04T12:41:17.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.758+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=UBGL3N8FU3QZ type=del 2024-03-04T12:41:17.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.760+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~Y2G4HMA2FIWO.0 size=709600 2024-03-04T12:41:17.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.760+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=Y2G4HMA2FIWO tag=0HUYT8COZ2UH type=write size=1758176 2024-03-04T12:41:17.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.761+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=GGE3JXX6L067 type=del 2024-03-04T12:41:17.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.763+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=V48S8HGA2ETV type=del size=602724 2024-03-04T12:41:17.769 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.764+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~GZ4P3LQW4Y34.0 size=1048576 2024-03-04T12:41:17.770 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.765+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~GZ4P3LQW4Y34.1 size=935845 2024-03-04T12:41:17.772 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.767+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=GZ4P3LQW4Y34 tag=G60019K18KWJ type=write size=3032997 2024-03-04T12:41:17.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.769+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~EEXCXCWGBTUN.0 size=1048576 2024-03-04T12:41:17.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.770+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~EEXCXCWGBTUN.1 size=1048576 2024-03-04T12:41:17.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.770+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~EEXCXCWGBTUN.2 size=106427 2024-03-04T12:41:17.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.770+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=EEXCXCWGBTUN tag=8KVO6BU3M617 type=write size=3252155 2024-03-04T12:41:17.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.772+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~65ZTCIO9ZYYD.0 size=1048576 2024-03-04T12:41:17.778 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.772+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~65ZTCIO9ZYYD.1 size=876466 2024-03-04T12:41:17.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.774+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=65ZTCIO9ZYYD tag=4YDNA0C33QD3 type=write size=2973618 2024-03-04T12:41:17.782 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.776+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~1LNJ31YDIW1N.0 size=1048576 2024-03-04T12:41:17.782 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.777+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~1LNJ31YDIW1N.1 size=1048576 2024-03-04T12:41:17.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.778+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~1LNJ31YDIW1N.2 size=244454 2024-03-04T12:41:17.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.778+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=1LNJ31YDIW1N tag=WY9OWJJ9MJN2 type=write size=3390182 2024-03-04T12:41:17.786 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.780+0000 7f093583d780 1 < suggested remove operation key=O6OUISHWZ7FU tag=NYK2JYFWY0WA type=del 2024-03-04T12:41:17.787 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.781+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=MGWC5K0VE7IE type=write size=325725 2024-03-04T12:41:17.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.782+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=Z9KB6NCI2CLU type=del 2024-03-04T12:41:17.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.783+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=HCUTEQY7MU67 type=write size=55144 2024-03-04T12:41:17.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.785+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=CRHZ6AJH6X1I type=del 2024-03-04T12:41:17.792 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.787+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~OWC41NH36QD1.0 size=1048576 2024-03-04T12:41:17.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.788+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~OWC41NH36QD1.1 size=1048576 2024-03-04T12:41:17.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.789+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~OWC41NH36QD1.2 size=727342 2024-03-04T12:41:17.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.789+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=OWC41NH36QD1 tag=GWHQKNDB9UDR type=write size=3873070 2024-03-04T12:41:17.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.790+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=QW15OWMN6CGL type=del 2024-03-04T12:41:17.797 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.792+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~EFLM5XH0NM5X.0 size=747156 2024-03-04T12:41:17.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.792+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=EFLM5XH0NM5X tag=7KZQYY0YJ7MY type=write size=1795732 2024-03-04T12:41:17.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.793+0000 7f093583d780 1 < completed write operation key=9VKN43CB955V tag=I1RBIZ2LGIA8 type=write size=653847 2024-03-04T12:41:17.801 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.795+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~QUKHN0VBP5H5.0 size=1048576 2024-03-04T12:41:17.802 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.796+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~QUKHN0VBP5H5.1 size=1048576 2024-03-04T12:41:17.802 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.797+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~QUKHN0VBP5H5.2 size=415922 2024-03-04T12:41:17.803 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.797+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=QUKHN0VBP5H5 tag=1C1R2W0M2U70 type=write size=3561650 2024-03-04T12:41:17.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.798+0000 7f093583d780 -1 < failed to complete operation key=O6OUISHWZ7FU tag=L1PQRQUL46OX type=del size=4182931: (22) Invalid argument 2024-03-04T12:41:17.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.799+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=8QK1MH50PWV8 type=del size=3590317 2024-03-04T12:41:17.806 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.801+0000 7f093583d780 -1 < failed to complete operation key=O6OUISHWZ7FU tag=HWEA0S7WXH37 type=del size=2735936: (22) Invalid argument 2024-03-04T12:41:17.807 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.802+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=QRAYOL7AEG1F type=del size=1096530 2024-03-04T12:41:17.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.803+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=MTXBYH1JHF0K type=del 2024-03-04T12:41:17.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.805+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~AUE36AZJ73FL.0 size=891860 2024-03-04T12:41:17.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.805+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=AUE36AZJ73FL tag=M8N18UPKVI6G type=write size=1940436 2024-03-04T12:41:17.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.806+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=2PPK99V6EPHI type=del 2024-03-04T12:41:17.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.808+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~JA6P1RFNMZEP.0 size=371481 2024-03-04T12:41:17.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.808+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=JA6P1RFNMZEP tag=IMYLDTH190US type=write size=1420057 2024-03-04T12:41:17.817 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.811+0000 7f093583d780 1 < suggested update operation key=M0AOZ89IQNSK tag=SMGIUIIHRTW4 type=del size=1435874 2024-03-04T12:41:17.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.813+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~KEAMP9JXK82T.0 size=1048576 2024-03-04T12:41:17.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.814+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~KEAMP9JXK82T.1 size=1048576 2024-03-04T12:41:17.821 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.815+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~KEAMP9JXK82T.2 size=556572 2024-03-04T12:41:17.821 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.815+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=KEAMP9JXK82T tag=KCX0EHDXWDTD type=write size=3702300 2024-03-04T12:41:17.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.817+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=1HMHWZC1TBR5 type=del 2024-03-04T12:41:17.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.819+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~F3A3P3YHYS4W.0 size=1048576 2024-03-04T12:41:17.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.820+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~F3A3P3YHYS4W.1 size=499394 2024-03-04T12:41:17.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.820+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=F3A3P3YHYS4W tag=1GY1I4OAEXNV type=write size=2596546 2024-03-04T12:41:17.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.823+0000 7f093583d780 1 < suggested remove operation key=I5NQBROT0WKE tag=UP2OL0XHROLN type=del 2024-03-04T12:41:17.830 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.824+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=PZRUUTWQYT61 type=write size=158914 2024-03-04T12:41:17.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.826+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~Y2G4HMA2FIWO.0 size=709600 2024-03-04T12:41:17.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.828+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=Y2G4HMA2FIWO tag=0HUYT8COZ2UH type=write size=1758176 2024-03-04T12:41:17.835 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.829+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=D9PYEVK9U34K type=del size=4012445 2024-03-04T12:41:17.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.830+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=V48S8HGA2ETV type=del 2024-03-04T12:41:17.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.831+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=9RV4M5LSLJLB type=del size=3158320 2024-03-04T12:41:17.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.833+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~EEXCXCWGBTUN.0 size=1048576 2024-03-04T12:41:17.839 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.834+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~EEXCXCWGBTUN.1 size=1048576 2024-03-04T12:41:17.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.835+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~EEXCXCWGBTUN.2 size=106427 2024-03-04T12:41:17.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:17.837+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=EEXCXCWGBTUN tag=8KVO6BU3M617 type=write size=3252155 2024-03-04T12:41:18.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.041+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~83HE9H61CK70.0 size=1048576 2024-03-04T12:41:18.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.041+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~83HE9H61CK70.1 size=1048576 2024-03-04T12:41:18.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.043+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~83HE9H61CK70.2 size=248058 2024-03-04T12:41:18.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.043+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=83HE9H61CK70 tag=OB09ZGMT8MHI type=write size=3393786 2024-03-04T12:41:18.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.044+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~1LNJ31YDIW1N.0 size=1048576 2024-03-04T12:41:18.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.044+0000 7f093583d780 1 < canceled part key=_multipart_2R5WA9Q9ZAUG.2~1LNJ31YDIW1N.1 size=1048576 2024-03-04T12:41:18.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.045+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~1LNJ31YDIW1N.2 size=244454 2024-03-04T12:41:18.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.047+0000 7f093583d780 1 < canceled multipart upload key=2R5WA9Q9ZAUG upload=1LNJ31YDIW1N tag=WY9OWJJ9MJN2 type=write size=3390182 2024-03-04T12:41:18.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.048+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=PPUSJVWV667P type=del size=1695561 2024-03-04T12:41:18.054 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.049+0000 7f093583d780 1 < canceled operation key=2R5WA9Q9ZAUG tag=MGWC5K0VE7IE type=write size=325725 2024-03-04T12:41:18.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.050+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=9MFG5T42GCO8 type=del size=1999737 2024-03-04T12:41:18.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.051+0000 7f093583d780 1 < completed write operation key=O6OUISHWZ7FU tag=HCUTEQY7MU67 type=write size=55144 2024-03-04T12:41:18.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.053+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=SIGZV1E4EFD4 type=del size=2808125 2024-03-04T12:41:18.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.054+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~OWC41NH36QD1.0 size=1048576 2024-03-04T12:41:18.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.055+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~OWC41NH36QD1.1 size=1048576 2024-03-04T12:41:18.062 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.056+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~OWC41NH36QD1.2 size=727342 2024-03-04T12:41:18.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.059+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=OWC41NH36QD1 tag=GWHQKNDB9UDR type=write size=3873070 2024-03-04T12:41:18.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.062+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~NM694LB7D7ZT.0 size=563935 2024-03-04T12:41:18.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.062+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=NM694LB7D7ZT tag=HT16UZ3A4VKE type=write size=1612511 2024-03-04T12:41:18.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.063+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~EFLM5XH0NM5X.0 size=747156 2024-03-04T12:41:18.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.065+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=EFLM5XH0NM5X tag=7KZQYY0YJ7MY type=write size=1795732 2024-03-04T12:41:18.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.066+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=AUKFGXIDCXH6 type=del size=3173901 2024-03-04T12:41:18.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.067+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~QUKHN0VBP5H5.0 size=1048576 2024-03-04T12:41:18.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.068+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~QUKHN0VBP5H5.1 size=1048576 2024-03-04T12:41:18.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.069+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~QUKHN0VBP5H5.2 size=415922 2024-03-04T12:41:18.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.071+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=QUKHN0VBP5H5 tag=1C1R2W0M2U70 type=write size=3561650 2024-03-04T12:41:18.079 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.073+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~CYUJ5ZUSP3W4.0 size=224799 2024-03-04T12:41:18.079 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.073+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=CYUJ5ZUSP3W4 tag=P0DDHKELT87G type=write size=1273375 2024-03-04T12:41:18.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.075+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=8QK1MH50PWV8 type=del 2024-03-04T12:41:18.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.077+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~MGPS0FZ1YH2O.0 size=955797 2024-03-04T12:41:18.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.077+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=MGPS0FZ1YH2O tag=15LVIUBK5IID type=write size=2004373 2024-03-04T12:41:18.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.080+0000 7f093583d780 1 < canceled operation key=OFTWI7UFD5L5 tag=QRAYOL7AEG1F type=del size=1096530 2024-03-04T12:41:18.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.082+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~J9JQB6DE3AVO.0 size=1048576 2024-03-04T12:41:18.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.083+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~J9JQB6DE3AVO.1 size=1048576 2024-03-04T12:41:18.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.084+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~J9JQB6DE3AVO.2 size=944653 2024-03-04T12:41:18.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.084+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=J9JQB6DE3AVO tag=KXGXLQ7IHCRF type=write size=4090381 2024-03-04T12:41:18.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.085+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~AUE36AZJ73FL.0 size=891860 2024-03-04T12:41:18.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.087+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=AUE36AZJ73FL tag=M8N18UPKVI6G type=write size=1940436 2024-03-04T12:41:18.094 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.088+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=AN5H0IQYG2FF type=write size=286228 2024-03-04T12:41:18.095 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.090+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~JA6P1RFNMZEP.0 size=371481 2024-03-04T12:41:18.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.092+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=JA6P1RFNMZEP tag=IMYLDTH190US type=write size=1420057 2024-03-04T12:41:18.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.094+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~CK2HBGL6ETTC.0 size=1048576 2024-03-04T12:41:18.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.095+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~CK2HBGL6ETTC.1 size=886223 2024-03-04T12:41:18.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.095+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=CK2HBGL6ETTC tag=BA8FBG2U5OA8 type=write size=2983375 2024-03-04T12:41:18.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.096+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~KEAMP9JXK82T.0 size=1048576 2024-03-04T12:41:18.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.097+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~KEAMP9JXK82T.1 size=1048576 2024-03-04T12:41:18.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.098+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~KEAMP9JXK82T.2 size=556572 2024-03-04T12:41:18.106 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.100+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=KEAMP9JXK82T tag=KCX0EHDXWDTD type=write size=3702300 2024-03-04T12:41:18.107 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.101+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=V35A00JAU5GP type=del size=629096 2024-03-04T12:41:18.108 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.103+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~F3A3P3YHYS4W.0 size=1048576 2024-03-04T12:41:18.109 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.104+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~F3A3P3YHYS4W.1 size=499394 2024-03-04T12:41:18.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.106+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=F3A3P3YHYS4W tag=1GY1I4OAEXNV type=write size=2596546 2024-03-04T12:41:18.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.107+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=T0GW31U6SDJ2 type=write size=90222 2024-03-04T12:41:18.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.108+0000 7f093583d780 1 < completed write operation key=2R5WA9Q9ZAUG tag=PZRUUTWQYT61 type=write size=158914 2024-03-04T12:41:18.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.110+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=Z2TVUIZ7BCWE type=del size=3927787 2024-03-04T12:41:18.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.112+0000 7f093583d780 1 < suggested remove operation key=NQF43I07F2HT tag=D9PYEVK9U34K type=del 2024-03-04T12:41:18.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.113+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=PPP7TO8ME4CN type=write size=432903 2024-03-04T12:41:18.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.116+0000 7f093583d780 1 < suggested remove operation key=2R5WA9Q9ZAUG tag=9RV4M5LSLJLB type=del 2024-03-04T12:41:18.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.117+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=9HI4YBVB94NM type=del size=801307 2024-03-04T12:41:18.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.118+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~83HE9H61CK70.0 size=1048576 2024-03-04T12:41:18.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.118+0000 7f093583d780 1 < canceled part key=_multipart_9E12MS7PETOK.2~83HE9H61CK70.1 size=1048576 2024-03-04T12:41:18.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.119+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~83HE9H61CK70.2 size=248058 2024-03-04T12:41:18.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.121+0000 7f093583d780 1 < canceled multipart upload key=9E12MS7PETOK upload=83HE9H61CK70 tag=OB09ZGMT8MHI type=write size=3393786 2024-03-04T12:41:18.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.122+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=8P1THCLRRSP5 type=write size=624640 2024-03-04T12:41:18.130 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.125+0000 7f093583d780 1 < suggested update operation key=2YD2M0JQNCC0 tag=PPUSJVWV667P type=del size=1695561 2024-03-04T12:41:18.131 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.126+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=IST27KXNMH1F type=write size=450434 2024-03-04T12:41:18.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.127+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=9MFG5T42GCO8 type=del 2024-03-04T12:41:18.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.128+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=Y1VOLIUHH2EW type=del size=1159301 2024-03-04T12:41:18.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.130+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=SIGZV1E4EFD4 type=del 2024-03-04T12:41:18.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.131+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=IDL4SHLCBAON type=del size=4115358 2024-03-04T12:41:18.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.132+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~NM694LB7D7ZT.0 size=563935 2024-03-04T12:41:18.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.134+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=NM694LB7D7ZT tag=HT16UZ3A4VKE type=write size=1612511 2024-03-04T12:41:18.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.136+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~87BX4D36K4AR.0 size=1048576 2024-03-04T12:41:18.143 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.137+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~87BX4D36K4AR.1 size=444850 2024-03-04T12:41:18.143 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.137+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=87BX4D36K4AR tag=HA2AG963MT66 type=write size=2542002 2024-03-04T12:41:18.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.139+0000 7f093583d780 1 < suggested update operation key=FT2XNJYYT30J tag=AUKFGXIDCXH6 type=del size=3173901 2024-03-04T12:41:18.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.140+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=5R40R2DLM14F type=del size=1855538 2024-03-04T12:41:18.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.142+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~CYUJ5ZUSP3W4.0 size=224799 2024-03-04T12:41:18.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.143+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=CYUJ5ZUSP3W4 tag=P0DDHKELT87G type=write size=1273375 2024-03-04T12:41:18.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.146+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~SX6TQ5VEGMHY.0 size=326506 2024-03-04T12:41:18.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.146+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=SX6TQ5VEGMHY tag=LBIBLH4JHKDC type=write size=1375082 2024-03-04T12:41:18.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.147+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~MGPS0FZ1YH2O.0 size=955797 2024-03-04T12:41:18.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.149+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=MGPS0FZ1YH2O tag=15LVIUBK5IID type=write size=2004373 2024-03-04T12:41:18.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.151+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=WSK5J000Z715 type=del size=2459537 2024-03-04T12:41:18.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.152+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~J9JQB6DE3AVO.0 size=1048576 2024-03-04T12:41:18.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.153+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~J9JQB6DE3AVO.1 size=1048576 2024-03-04T12:41:18.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.154+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~J9JQB6DE3AVO.2 size=944653 2024-03-04T12:41:18.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.156+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=J9JQB6DE3AVO tag=KXGXLQ7IHCRF type=write size=4090381 2024-03-04T12:41:18.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.157+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=WZU0NFNFNEAN type=write size=523946 2024-03-04T12:41:18.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.158+0000 7f093583d780 -1 < failed to complete operation key=FT2XNJYYT30J tag=AN5H0IQYG2FF type=write size=286228: (22) Invalid argument 2024-03-04T12:41:18.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.159+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=2FQ64E6U8K4U type=del size=3979281 2024-03-04T12:41:18.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.160+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~CK2HBGL6ETTC.0 size=1048576 2024-03-04T12:41:18.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.161+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~CK2HBGL6ETTC.1 size=886223 2024-03-04T12:41:18.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.163+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=CK2HBGL6ETTC tag=BA8FBG2U5OA8 type=write size=2983375 2024-03-04T12:41:18.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.164+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=O0KJAREHP5XT type=write size=927896 2024-03-04T12:41:18.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.165+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=V35A00JAU5GP type=del 2024-03-04T12:41:18.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.166+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=R3SVOEUJUG11 type=write size=538869 2024-03-04T12:41:18.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.168+0000 7f093583d780 1 < canceled operation key=GMKM2QEP072H tag=T0GW31U6SDJ2 type=write size=90222 2024-03-04T12:41:18.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.169+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=RPPSCSV34DLF type=del size=2821520 2024-03-04T12:41:18.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.170+0000 7f093583d780 1 < canceled operation key=I5NQBROT0WKE tag=Z2TVUIZ7BCWE type=del size=3927787 2024-03-04T12:41:18.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.173+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=JPTKZI3AJDIH type=del size=1449021 2024-03-04T12:41:18.179 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.174+0000 7f093583d780 1 < canceled operation key=NQF43I07F2HT tag=PPP7TO8ME4CN type=write size=432903 2024-03-04T12:41:18.181 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.176+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~ASUAJU9BEL44.0 size=1048576 2024-03-04T12:41:18.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.177+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~ASUAJU9BEL44.1 size=746179 2024-03-04T12:41:18.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.177+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=ASUAJU9BEL44 tag=MU3K08M2T5ZW type=write size=2843331 2024-03-04T12:41:18.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.179+0000 7f093583d780 1 < suggested remove operation key=J6Y9V11BX06B tag=9HI4YBVB94NM type=del 2024-03-04T12:41:18.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.180+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=0FZ6C21CI6SF type=write size=57715 2024-03-04T12:41:18.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.181+0000 7f093583d780 1 < completed write operation key=GMKM2QEP072H tag=8P1THCLRRSP5 type=write size=624640 2024-03-04T12:41:18.188 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.183+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=0DQ391A62PLD type=del size=222032 2024-03-04T12:41:18.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.184+0000 7f093583d780 1 < completed write operation key=HG0EM344TJZY tag=IST27KXNMH1F type=write size=450434 2024-03-04T12:41:18.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.186+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~EN7ZSYJEK12Y.0 size=1048576 2024-03-04T12:41:18.192 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.187+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~EN7ZSYJEK12Y.1 size=205784 2024-03-04T12:41:18.192 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.187+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=EN7ZSYJEK12Y tag=UBGKWJDC3MUI type=write size=2302936 2024-03-04T12:41:18.193 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.188+0000 7f093583d780 1 < canceled operation key=I6DIP4VGHMNO tag=Y1VOLIUHH2EW type=del size=1159301 2024-03-04T12:41:18.195 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.190+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~F4TGTIDGIXHI.0 size=1048576 2024-03-04T12:41:18.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.191+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~F4TGTIDGIXHI.1 size=81531 2024-03-04T12:41:18.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.191+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=F4TGTIDGIXHI tag=LWBERDWA52MD type=write size=2178683 2024-03-04T12:41:18.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.193+0000 7f093583d780 1 < suggested update operation key=FT2XNJYYT30J tag=IDL4SHLCBAON type=del size=4115358 2024-03-04T12:41:18.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.195+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~BAFKVFBSJKC1.0 size=1048576 2024-03-04T12:41:18.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.196+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~BAFKVFBSJKC1.1 size=490373 2024-03-04T12:41:18.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.196+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=BAFKVFBSJKC1 tag=MMNS8HUAW261 type=write size=2587525 2024-03-04T12:41:18.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.197+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~87BX4D36K4AR.0 size=1048576 2024-03-04T12:41:18.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.198+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~87BX4D36K4AR.1 size=444850 2024-03-04T12:41:18.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.200+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=87BX4D36K4AR tag=HA2AG963MT66 type=write size=2542002 2024-03-04T12:41:18.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.201+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=LQZ5VQ43HQXD type=del size=625101 2024-03-04T12:41:18.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.202+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=5R40R2DLM14F type=del 2024-03-04T12:41:18.210 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.205+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~F52F43RX3EHM.0 size=960049 2024-03-04T12:41:18.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.205+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=F52F43RX3EHM tag=L0RF4Q5L9FTL type=write size=2008625 2024-03-04T12:41:18.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.205+0000 7f093583d780 1 < canceled part key=_multipart_3F8GI0JCUR6W.2~SX6TQ5VEGMHY.0 size=326506 2024-03-04T12:41:18.212 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.207+0000 7f093583d780 1 < canceled multipart upload key=3F8GI0JCUR6W upload=SX6TQ5VEGMHY tag=LBIBLH4JHKDC type=write size=1375082 2024-03-04T12:41:18.213 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.208+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=70FIWMHQ2FYL type=del size=1244034 2024-03-04T12:41:18.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.210+0000 7f093583d780 1 < suggested remove operation key=OFTWI7UFD5L5 tag=WSK5J000Z715 type=del 2024-03-04T12:41:18.218 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.212+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~QOB1EY43127A.0 size=1048576 2024-03-04T12:41:18.218 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.213+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~QOB1EY43127A.1 size=413864 2024-03-04T12:41:18.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.213+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=QOB1EY43127A tag=IPLFD236HPYM type=write size=2511016 2024-03-04T12:41:18.221 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.215+0000 7f093583d780 1 < suggested remove operation key=2YD2M0JQNCC0 tag=WZU0NFNFNEAN type=write 2024-03-04T12:41:18.222 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.216+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=AN831B6ABKFT type=del size=2513912 2024-03-04T12:41:18.223 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.217+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=2FQ64E6U8K4U type=del 2024-03-04T12:41:18.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.220+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~O7FC0PWLVAJQ.0 size=68843 2024-03-04T12:41:18.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.220+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=O7FC0PWLVAJQ tag=A3DK7UB22YZ6 type=write size=1117419 2024-03-04T12:41:18.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.221+0000 7f093583d780 1 < completed write operation key=TMAI6MOG2C4N tag=O0KJAREHP5XT type=write size=927896 2024-03-04T12:41:18.228 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.223+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=TFYCCZIK7P3M type=del size=1866787 2024-03-04T12:41:18.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.224+0000 7f093583d780 1 < completed write operation key=M0AOZ89IQNSK tag=R3SVOEUJUG11 type=write size=538869 2024-03-04T12:41:18.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.225+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=55JPPPIDNBNG type=del size=3694587 2024-03-04T12:41:18.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.227+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=RPPSCSV34DLF type=del 2024-03-04T12:41:18.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.229+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~QU98KJU7KRIH.0 size=1048576 2024-03-04T12:41:18.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.230+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~QU98KJU7KRIH.1 size=1048576 2024-03-04T12:41:18.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.231+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~QU98KJU7KRIH.2 size=91072 2024-03-04T12:41:18.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.231+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=QU98KJU7KRIH tag=0FMJMXDE5072 type=write size=3236800 2024-03-04T12:41:18.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.232+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=JPTKZI3AJDIH type=del 2024-03-04T12:41:18.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.234+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~LV3BU889FFVR.0 size=1048576 2024-03-04T12:41:18.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.235+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~LV3BU889FFVR.1 size=1048576 2024-03-04T12:41:18.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.236+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~LV3BU889FFVR.2 size=581692 2024-03-04T12:41:18.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.236+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=LV3BU889FFVR tag=83HRG3HXBYPD type=write size=3727420 2024-03-04T12:41:18.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.237+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~ASUAJU9BEL44.0 size=1048576 2024-03-04T12:41:18.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.238+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~ASUAJU9BEL44.1 size=746179 2024-03-04T12:41:18.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.240+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=ASUAJU9BEL44 tag=MU3K08M2T5ZW type=write size=2843331 2024-03-04T12:41:18.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.242+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~4GGOE1JER8SO.0 size=1048576 2024-03-04T12:41:18.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.243+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~4GGOE1JER8SO.1 size=1048576 2024-03-04T12:41:18.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.244+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~4GGOE1JER8SO.2 size=270482 2024-03-04T12:41:18.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.244+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=4GGOE1JER8SO tag=V6O6GBV13H4F type=write size=3416210 2024-03-04T12:41:18.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.245+0000 7f093583d780 1 < completed write operation key=2ZOV2JEQHXGS tag=0FZ6C21CI6SF type=write size=57715 2024-03-04T12:41:18.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.247+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~G8VMDJV3R05T.0 size=49379 2024-03-04T12:41:18.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.247+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=G8VMDJV3R05T tag=S0S00U2YIEGM type=write size=1097955 2024-03-04T12:41:18.254 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.248+0000 7f093583d780 -1 < failed to complete operation key=2YD2M0JQNCC0 tag=0DQ391A62PLD type=del size=222032: (22) Invalid argument 2024-03-04T12:41:18.255 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.249+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=1ZZ6I5RX8KVP type=del size=3502108 2024-03-04T12:41:18.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.250+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~EN7ZSYJEK12Y.0 size=1048576 2024-03-04T12:41:18.257 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.251+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~EN7ZSYJEK12Y.1 size=205784 2024-03-04T12:41:18.259 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.253+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=EN7ZSYJEK12Y tag=UBGKWJDC3MUI type=write size=2302936 2024-03-04T12:41:18.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.255+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~U2ZG1R6M0HSD.0 size=1048576 2024-03-04T12:41:18.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.256+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~U2ZG1R6M0HSD.1 size=699276 2024-03-04T12:41:18.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.256+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=U2ZG1R6M0HSD tag=PH6TMBNMSGCH type=write size=2796428 2024-03-04T12:41:18.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.257+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~F4TGTIDGIXHI.0 size=1048576 2024-03-04T12:41:18.264 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.258+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~F4TGTIDGIXHI.1 size=81531 2024-03-04T12:41:18.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.260+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=F4TGTIDGIXHI tag=LWBERDWA52MD type=write size=2178683 2024-03-04T12:41:18.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.261+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=YQ791R49KMJ0 type=write size=610578 2024-03-04T12:41:18.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.262+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~BAFKVFBSJKC1.0 size=1048576 2024-03-04T12:41:18.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.262+0000 7f093583d780 1 < canceled part key=_multipart_AQI7H63EQSTN.2~BAFKVFBSJKC1.1 size=490373 2024-03-04T12:41:18.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.264+0000 7f093583d780 1 < canceled multipart upload key=AQI7H63EQSTN upload=BAFKVFBSJKC1 tag=MMNS8HUAW261 type=write size=2587525 2024-03-04T12:41:18.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.266+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~4XVR23F6JLUS.0 size=1048576 2024-03-04T12:41:18.272 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.267+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~4XVR23F6JLUS.1 size=1048576 2024-03-04T12:41:18.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.268+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~4XVR23F6JLUS.2 size=86943 2024-03-04T12:41:18.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.268+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=4XVR23F6JLUS tag=BBMTTVDR13Q1 type=write size=3232671 2024-03-04T12:41:18.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.269+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=LQZ5VQ43HQXD type=del 2024-03-04T12:41:18.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.271+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~51AU3Q9S0FCL.0 size=1048576 2024-03-04T12:41:18.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.272+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~51AU3Q9S0FCL.1 size=320607 2024-03-04T12:41:18.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.272+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=51AU3Q9S0FCL tag=EII2V4TEGIQI type=write size=2417759 2024-03-04T12:41:18.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.273+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~F52F43RX3EHM.0 size=960049 2024-03-04T12:41:18.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.275+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=F52F43RX3EHM tag=L0RF4Q5L9FTL type=write size=2008625 2024-03-04T12:41:18.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.276+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=M0ZJ5AZ4B3ST type=del size=4010909 2024-03-04T12:41:18.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.277+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=70FIWMHQ2FYL type=del 2024-03-04T12:41:18.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.279+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=4PSIOZVQ91L2 type=del size=4041402 2024-03-04T12:41:18.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.280+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~QOB1EY43127A.0 size=1048576 2024-03-04T12:41:18.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.283+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~QOB1EY43127A.1 size=413864 2024-03-04T12:41:18.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.285+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=QOB1EY43127A tag=IPLFD236HPYM type=write size=2511016 2024-03-04T12:41:18.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.287+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~8MU790309I5J.0 size=1048576 2024-03-04T12:41:18.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.288+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~8MU790309I5J.1 size=737596 2024-03-04T12:41:18.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.288+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=8MU790309I5J tag=BERWK5L22Y8D type=write size=2834748 2024-03-04T12:41:18.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.289+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=AN831B6ABKFT type=del 2024-03-04T12:41:18.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.290+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=XVF2RW017L0W type=del size=197474 2024-03-04T12:41:18.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.291+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~O7FC0PWLVAJQ.0 size=68843 2024-03-04T12:41:18.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.293+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=O7FC0PWLVAJQ tag=A3DK7UB22YZ6 type=write size=1117419 2024-03-04T12:41:18.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.294+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=2CK0D0FT7269 type=del size=558034 2024-03-04T12:41:18.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.295+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=TFYCCZIK7P3M type=del 2024-03-04T12:41:18.302 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.296+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=22TWT3I8HD8Y type=write size=510467 2024-03-04T12:41:18.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.297+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=55JPPPIDNBNG type=del 2024-03-04T12:41:18.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.299+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~N738HED9FSW1.0 size=1048576 2024-03-04T12:41:18.306 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.300+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~N738HED9FSW1.1 size=1048576 2024-03-04T12:41:18.306 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.301+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~N738HED9FSW1.2 size=1013870 2024-03-04T12:41:18.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.301+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=N738HED9FSW1 tag=1EEKANCMSOMY type=write size=4159598 2024-03-04T12:41:18.308 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.302+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~QU98KJU7KRIH.0 size=1048576 2024-03-04T12:41:18.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.303+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~QU98KJU7KRIH.1 size=1048576 2024-03-04T12:41:18.310 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.305+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~QU98KJU7KRIH.2 size=91072 2024-03-04T12:41:18.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.307+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=QU98KJU7KRIH tag=0FMJMXDE5072 type=write size=3236800 2024-03-04T12:41:18.314 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.309+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~T8ERVTYLCJ90.0 size=1048576 2024-03-04T12:41:18.315 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.310+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~T8ERVTYLCJ90.1 size=344812 2024-03-04T12:41:18.315 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.310+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=T8ERVTYLCJ90 tag=IXM6RGALP31V type=write size=2441964 2024-03-04T12:41:18.315 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.310+0000 7f093583d780 1 < canceled part key=_multipart_9E12MS7PETOK.2~LV3BU889FFVR.0 size=1048576 2024-03-04T12:41:18.316 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.311+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~LV3BU889FFVR.1 size=1048576 2024-03-04T12:41:18.317 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.312+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~LV3BU889FFVR.2 size=581692 2024-03-04T12:41:18.319 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.314+0000 7f093583d780 1 < canceled multipart upload key=9E12MS7PETOK upload=LV3BU889FFVR tag=83HRG3HXBYPD type=write size=3727420 2024-03-04T12:41:18.321 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.316+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~HE866MXCIA1P.0 size=719396 2024-03-04T12:41:18.321 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.316+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=HE866MXCIA1P tag=U4HEUPZ79T47 type=write size=1767972 2024-03-04T12:41:18.323 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.317+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~4GGOE1JER8SO.0 size=1048576 2024-03-04T12:41:18.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.318+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~4GGOE1JER8SO.1 size=1048576 2024-03-04T12:41:18.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.319+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~4GGOE1JER8SO.2 size=270482 2024-03-04T12:41:18.326 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.321+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=4GGOE1JER8SO tag=V6O6GBV13H4F type=write size=3416210 2024-03-04T12:41:18.328 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.322+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=1YRNR8HEA7HO type=del size=3770544 2024-03-04T12:41:18.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.323+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~G8VMDJV3R05T.0 size=49379 2024-03-04T12:41:18.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.325+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=G8VMDJV3R05T tag=S0S00U2YIEGM type=write size=1097955 2024-03-04T12:41:18.332 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.327+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=M1OILS2Q8EG4 type=del size=2869027 2024-03-04T12:41:18.333 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.328+0000 7f093583d780 1 < canceled operation key=YJXFSO53QVPS tag=1ZZ6I5RX8KVP type=del size=3502108 2024-03-04T12:41:18.335 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.329+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=V7F0SHI1VVVF type=del size=1330745 2024-03-04T12:41:18.335 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.329+0000 7f093583d780 1 < canceled part key=_multipart_9VKN43CB955V.2~U2ZG1R6M0HSD.0 size=1048576 2024-03-04T12:41:18.335 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.329+0000 7f093583d780 1 < canceled part key=_multipart_9VKN43CB955V.2~U2ZG1R6M0HSD.1 size=699276 2024-03-04T12:41:18.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.331+0000 7f093583d780 1 < canceled multipart upload key=9VKN43CB955V upload=U2ZG1R6M0HSD tag=PH6TMBNMSGCH type=write size=2796428 2024-03-04T12:41:18.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.332+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=QCK32DMOTYHQ type=del size=983935 2024-03-04T12:41:18.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.333+0000 7f093583d780 1 < canceled operation key=NFM6LT89K5F4 tag=YQ791R49KMJ0 type=write size=610578 2024-03-04T12:41:18.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.334+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=D6K3AKTN3XI0 type=write size=616872 2024-03-04T12:41:18.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.335+0000 7f093583d780 1 < canceled part key=_multipart_GJ0FQ6EH9HJL.2~4XVR23F6JLUS.0 size=1048576 2024-03-04T12:41:18.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.335+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~4XVR23F6JLUS.1 size=1048576 2024-03-04T12:41:18.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.336+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~4XVR23F6JLUS.2 size=86943 2024-03-04T12:41:18.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.338+0000 7f093583d780 1 < canceled multipart upload key=GJ0FQ6EH9HJL upload=4XVR23F6JLUS tag=BBMTTVDR13Q1 type=write size=3232671 2024-03-04T12:41:18.345 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.339+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=4O1Q0M5DA7GY type=del size=3150842 2024-03-04T12:41:18.345 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.340+0000 7f093583d780 1 < canceled part key=_multipart_PT63VLFQQN0E.2~51AU3Q9S0FCL.0 size=1048576 2024-03-04T12:41:18.346 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.340+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~51AU3Q9S0FCL.1 size=320607 2024-03-04T12:41:18.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.342+0000 7f093583d780 1 < canceled multipart upload key=PT63VLFQQN0E upload=51AU3Q9S0FCL tag=EII2V4TEGIQI type=write size=2417759 2024-03-04T12:41:18.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.344+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~9XK56EC2TD0S.0 size=1048576 2024-03-04T12:41:18.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.345+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~9XK56EC2TD0S.1 size=1048576 2024-03-04T12:41:18.351 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.346+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~9XK56EC2TD0S.2 size=306122 2024-03-04T12:41:18.351 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.346+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=9XK56EC2TD0S tag=WX5UP0GCX3IS type=write size=3451850 2024-03-04T12:41:18.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.347+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=M0ZJ5AZ4B3ST type=del 2024-03-04T12:41:18.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.348+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=QXXAK0JGN6AX type=del size=2330805 2024-03-04T12:41:18.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.349+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=4PSIOZVQ91L2 type=del 2024-03-04T12:41:18.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.350+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=3W66FF15W3I0 type=del size=1180796 2024-03-04T12:41:18.357 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.351+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~8MU790309I5J.0 size=1048576 2024-03-04T12:41:18.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.352+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~8MU790309I5J.1 size=737596 2024-03-04T12:41:18.360 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.354+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=8MU790309I5J tag=BERWK5L22Y8D type=write size=2834748 2024-03-04T12:41:18.361 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.355+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=OK5NCZZHML3H type=del size=1464346 2024-03-04T12:41:18.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.357+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=XVF2RW017L0W type=del 2024-03-04T12:41:18.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.358+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=4Y392EZEFPDR type=del size=3393042 2024-03-04T12:41:18.364 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.359+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=2CK0D0FT7269 type=del 2024-03-04T12:41:18.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.360+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=V544GPXDR2O7 type=write size=589493 2024-03-04T12:41:18.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.361+0000 7f093583d780 1 < completed write operation key=OCOQJLUUNWRG tag=22TWT3I8HD8Y type=write size=510467 2024-03-04T12:41:18.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.362+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=33H181JWF2H0 type=del size=2375688 2024-03-04T12:41:18.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.363+0000 7f093583d780 1 < canceled part key=_multipart_M0AOZ89IQNSK.2~N738HED9FSW1.0 size=1048576 2024-03-04T12:41:18.369 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.364+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~N738HED9FSW1.1 size=1048576 2024-03-04T12:41:18.370 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.365+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~N738HED9FSW1.2 size=1013870 2024-03-04T12:41:18.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.367+0000 7f093583d780 1 < canceled multipart upload key=M0AOZ89IQNSK upload=N738HED9FSW1 tag=1EEKANCMSOMY type=write size=4159598 2024-03-04T12:41:18.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.368+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=0L13V3BY6HA1 type=del size=79906 2024-03-04T12:41:18.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.369+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~T8ERVTYLCJ90.0 size=1048576 2024-03-04T12:41:18.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.370+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~T8ERVTYLCJ90.1 size=344812 2024-03-04T12:41:18.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.373+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=T8ERVTYLCJ90 tag=IXM6RGALP31V type=write size=2441964 2024-03-04T12:41:18.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.375+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~OE1EQJS1PYY3.0 size=111632 2024-03-04T12:41:18.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.375+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=OE1EQJS1PYY3 tag=GDA7Q3Q5C12T type=write size=1160208 2024-03-04T12:41:18.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.376+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~HE866MXCIA1P.0 size=719396 2024-03-04T12:41:18.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.378+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=HE866MXCIA1P tag=U4HEUPZ79T47 type=write size=1767972 2024-03-04T12:41:18.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.379+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=6DBCS7RZ1A9N type=del size=728235 2024-03-04T12:41:18.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.380+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=1YRNR8HEA7HO type=del 2024-03-04T12:41:18.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.382+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~X0VC202UI101.0 size=144396 2024-03-04T12:41:18.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.382+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=X0VC202UI101 tag=TNO92K35RPHI type=write size=1192972 2024-03-04T12:41:18.389 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.384+0000 7f093583d780 1 < canceled operation key=9VKN43CB955V tag=M1OILS2Q8EG4 type=del size=2869027 2024-03-04T12:41:18.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.386+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~DXOQ47H8SDGB.0 size=1002275 2024-03-04T12:41:18.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.386+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=DXOQ47H8SDGB tag=055HZ85CEH2O type=write size=2050851 2024-03-04T12:41:18.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.388+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=V7F0SHI1VVVF type=del 2024-03-04T12:41:18.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.389+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=XF46M9KQTE8F type=del size=311642 2024-03-04T12:41:18.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.390+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=QCK32DMOTYHQ type=del 2024-03-04T12:41:18.397 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.392+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=8G70JZ15QABL type=del size=3918302 2024-03-04T12:41:18.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.393+0000 7f093583d780 1 < completed write operation key=OFTWI7UFD5L5 tag=D6K3AKTN3XI0 type=write size=616872 2024-03-04T12:41:18.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.395+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~AD1BT05P1QQI.0 size=1048576 2024-03-04T12:41:18.401 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.396+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~AD1BT05P1QQI.1 size=1048576 2024-03-04T12:41:18.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.397+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~AD1BT05P1QQI.2 size=128274 2024-03-04T12:41:18.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.397+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=AD1BT05P1QQI tag=GRTXMYAC7PW0 type=write size=3274002 2024-03-04T12:41:18.404 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.398+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=4O1Q0M5DA7GY type=del 2024-03-04T12:41:18.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.399+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=20GJK7AKMVQN type=write size=350875 2024-03-04T12:41:18.406 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.400+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~9XK56EC2TD0S.0 size=1048576 2024-03-04T12:41:18.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.401+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~9XK56EC2TD0S.1 size=1048576 2024-03-04T12:41:18.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.402+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~9XK56EC2TD0S.2 size=306122 2024-03-04T12:41:18.410 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.405+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=9XK56EC2TD0S tag=WX5UP0GCX3IS type=write size=3451850 2024-03-04T12:41:18.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.406+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=TPOXH5GQGQF7 type=write size=774145 2024-03-04T12:41:18.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.407+0000 7f093583d780 1 < canceled operation key=2YD2M0JQNCC0 tag=QXXAK0JGN6AX type=del size=2330805 2024-03-04T12:41:18.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.408+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=OZOEUTXZ8FH5 type=del size=3329625 2024-03-04T12:41:18.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.409+0000 7f093583d780 1 < canceled operation key=2ZOV2JEQHXGS tag=3W66FF15W3I0 type=del size=1180796 2024-03-04T12:41:18.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.410+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=79MAOHMAPJCQ type=del size=4022181 2024-03-04T12:41:18.417 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.411+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=OK5NCZZHML3H type=del 2024-03-04T12:41:18.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.412+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=N5BD1XOXGV74 type=del size=4071001 2024-03-04T12:41:18.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.414+0000 7f093583d780 1 < canceled operation key=HG0EM344TJZY tag=4Y392EZEFPDR type=del size=3393042 2024-03-04T12:41:18.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.415+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=Y9D2J14JJQLS type=write size=718682 2024-03-04T12:41:18.422 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.417+0000 7f093583d780 1 < suggested remove operation key=54FLC10FWKL6 tag=V544GPXDR2O7 type=write 2024-03-04T12:41:18.423 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.418+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=8QG8OBNSI3F2 type=write size=11857 2024-03-04T12:41:18.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.419+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=33H181JWF2H0 type=del 2024-03-04T12:41:18.427 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.422+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=H8Z8Z5XWC89J type=del size=3973229 2024-03-04T12:41:18.428 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.423+0000 7f093583d780 1 < canceled operation key=I6DIP4VGHMNO tag=0L13V3BY6HA1 type=del size=79906 2024-03-04T12:41:18.429 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.424+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=AHL8KG46P12K type=del size=1185910 2024-03-04T12:41:18.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.425+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~OE1EQJS1PYY3.0 size=111632 2024-03-04T12:41:18.432 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.427+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=OE1EQJS1PYY3 tag=GDA7Q3Q5C12T type=write size=1160208 2024-03-04T12:41:18.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.428+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=CE17Z0WED1EO type=del size=1948634 2024-03-04T12:41:18.436 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.430+0000 7f093583d780 1 < suggested update operation key=I5NQBROT0WKE tag=6DBCS7RZ1A9N type=del size=728235 2024-03-04T12:41:18.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.432+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=R1YXYTUML3PT type=del size=2420940 2024-03-04T12:41:18.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.432+0000 7f093583d780 1 < canceled part key=_multipart_J6Y9V11BX06B.2~X0VC202UI101.0 size=144396 2024-03-04T12:41:18.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.434+0000 7f093583d780 1 < canceled multipart upload key=J6Y9V11BX06B upload=X0VC202UI101 tag=TNO92K35RPHI type=write size=1192972 2024-03-04T12:41:18.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.435+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=5CUL84PQP01M type=del size=1989503 2024-03-04T12:41:18.441 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.436+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~DXOQ47H8SDGB.0 size=1002275 2024-03-04T12:41:18.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.438+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=DXOQ47H8SDGB tag=055HZ85CEH2O type=write size=2050851 2024-03-04T12:41:18.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.439+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=SUI1MFIKJ1AY type=del size=180157 2024-03-04T12:41:18.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.440+0000 7f093583d780 1 < completed delete operation key=AQI7H63EQSTN tag=XF46M9KQTE8F type=del 2024-03-04T12:41:18.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.443+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=01KQO2R55HC1 type=write size=700757 2024-03-04T12:41:18.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.444+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=8G70JZ15QABL type=del 2024-03-04T12:41:18.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.445+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=RGLAU4R6XO1V type=write size=567938 2024-03-04T12:41:18.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.446+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~AD1BT05P1QQI.0 size=1048576 2024-03-04T12:41:18.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.447+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~AD1BT05P1QQI.1 size=1048576 2024-03-04T12:41:18.454 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.448+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~AD1BT05P1QQI.2 size=128274 2024-03-04T12:41:18.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.450+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=AD1BT05P1QQI tag=GRTXMYAC7PW0 type=write size=3274002 2024-03-04T12:41:18.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.451+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=L2J50D6KX8K3 type=del size=3312289 2024-03-04T12:41:18.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.452+0000 7f093583d780 1 < completed write operation key=F269PJEZ05IO tag=20GJK7AKMVQN type=write size=350875 2024-03-04T12:41:18.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.454+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~YC7C8AQO8N9I.0 size=1048576 2024-03-04T12:41:18.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.455+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~YC7C8AQO8N9I.1 size=126608 2024-03-04T12:41:18.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.455+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=YC7C8AQO8N9I tag=11KNRHA8ABYT type=write size=2223760 2024-03-04T12:41:18.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.456+0000 7f093583d780 1 < completed write operation key=9E12MS7PETOK tag=TPOXH5GQGQF7 type=write size=774145 2024-03-04T12:41:18.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.458+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=FX8Q0RBKFCHW type=del size=2798878 2024-03-04T12:41:18.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.459+0000 7f093583d780 -1 < failed to complete operation key=I5NQBROT0WKE tag=OZOEUTXZ8FH5 type=del size=3329625: (22) Invalid argument 2024-03-04T12:41:18.465 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.460+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=LW0ICG5AYL2X type=del size=169782 2024-03-04T12:41:18.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.461+0000 7f093583d780 1 < canceled operation key=AQI7H63EQSTN tag=79MAOHMAPJCQ type=del size=4022181 2024-03-04T12:41:18.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.462+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=FJZKU9DC7HEN type=write size=393335 2024-03-04T12:41:18.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.463+0000 7f093583d780 1 < canceled operation key=AQI7H63EQSTN tag=N5BD1XOXGV74 type=del size=4071001 2024-03-04T12:41:18.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.464+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=M63ZUEI036VX type=del size=3882328 2024-03-04T12:41:18.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.466+0000 7f093583d780 1 < completed write operation key=Y4D4Q7NV5VMO tag=Y9D2J14JJQLS type=write size=718682 2024-03-04T12:41:18.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.467+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=XAOXBCVN5UVD type=del size=2492315 2024-03-04T12:41:18.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.468+0000 7f093583d780 1 < completed write operation key=OCOQJLUUNWRG tag=8QG8OBNSI3F2 type=write size=11857 2024-03-04T12:41:18.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.469+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=X1VSXQSQEEO9 type=del size=3085135 2024-03-04T12:41:18.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.471+0000 7f093583d780 1 < suggested remove operation key=Y4D4Q7NV5VMO tag=H8Z8Z5XWC89J type=del 2024-03-04T12:41:18.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.472+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=8R10NZ1R01OZ type=del size=1190119 2024-03-04T12:41:18.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.473+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=AHL8KG46P12K type=del 2024-03-04T12:41:18.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.475+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=25ZP97TRHXAV type=del size=1430648 2024-03-04T12:41:18.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.476+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=CE17Z0WED1EO type=del 2024-03-04T12:41:18.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.478+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~EUZF98JS9U1Y.0 size=575293 2024-03-04T12:41:18.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.478+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=EUZF98JS9U1Y tag=APHVTD3YE9UB type=write size=1623869 2024-03-04T12:41:18.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.480+0000 7f093583d780 1 < suggested remove operation key=FT2XNJYYT30J tag=R1YXYTUML3PT type=del 2024-03-04T12:41:18.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.481+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=UB3PIR288XLQ type=del size=2499566 2024-03-04T12:41:18.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.482+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=5CUL84PQP01M type=del 2024-03-04T12:41:18.490 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.484+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~1J33E3L2T2OT.0 size=1048576 2024-03-04T12:41:18.491 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.485+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~1J33E3L2T2OT.1 size=1048576 2024-03-04T12:41:18.491 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.486+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~1J33E3L2T2OT.2 size=269645 2024-03-04T12:41:18.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.486+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=1J33E3L2T2OT tag=TR3FYIQG0HYO type=write size=3415373 2024-03-04T12:41:18.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.487+0000 7f093583d780 1 < canceled operation key=GJ0FQ6EH9HJL tag=SUI1MFIKJ1AY type=del size=180157 2024-03-04T12:41:18.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.489+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~8Y8RUCZI7CUF.0 size=1048576 2024-03-04T12:41:18.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.490+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~8Y8RUCZI7CUF.1 size=1048576 2024-03-04T12:41:18.496 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.491+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~8Y8RUCZI7CUF.2 size=166049 2024-03-04T12:41:18.496 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.491+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=8Y8RUCZI7CUF tag=IDUL74D2M04J type=write size=3311777 2024-03-04T12:41:18.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.492+0000 7f093583d780 1 < completed write operation key=UAEQORB3BDBH tag=01KQO2R55HC1 type=write size=700757 2024-03-04T12:41:18.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.493+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=LA4CKV7XHV55 type=del size=2339677 2024-03-04T12:41:18.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.494+0000 7f093583d780 1 < canceled operation key=TMAI6MOG2C4N tag=RGLAU4R6XO1V type=write size=567938 2024-03-04T12:41:18.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.495+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=R683HX9EB8J0 type=del size=1799900 2024-03-04T12:41:18.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.498+0000 7f093583d780 1 < suggested remove operation key=L4UQK3UJFXZC tag=L2J50D6KX8K3 type=del 2024-03-04T12:41:18.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.499+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=5SL5V7C9T0LW type=del size=3464189 2024-03-04T12:41:18.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.501+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~YC7C8AQO8N9I.0 size=1048576 2024-03-04T12:41:18.508 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.502+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~YC7C8AQO8N9I.1 size=126608 2024-03-04T12:41:18.509 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.504+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=YC7C8AQO8N9I tag=11KNRHA8ABYT type=write size=2223760 2024-03-04T12:41:18.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.506+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~83453X7D5CDZ.0 size=1048576 2024-03-04T12:41:18.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.507+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~83453X7D5CDZ.1 size=7847 2024-03-04T12:41:18.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.507+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=83453X7D5CDZ tag=3B992EORHOYY type=write size=2104999 2024-03-04T12:41:18.514 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.508+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=FX8Q0RBKFCHW type=del 2024-03-04T12:41:18.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.510+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=BBZ5SMT1VSBV type=del size=4033444 2024-03-04T12:41:18.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.511+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=LW0ICG5AYL2X type=del 2024-03-04T12:41:18.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.512+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=Q6WO32CCP9UJ type=del size=1129541 2024-03-04T12:41:18.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.513+0000 7f093583d780 -1 < failed to complete operation key=FT2XNJYYT30J tag=FJZKU9DC7HEN type=write size=393335: (22) Invalid argument 2024-03-04T12:41:18.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.515+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~9TT2Y10WKWJ1.0 size=1048576 2024-03-04T12:41:18.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.516+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~9TT2Y10WKWJ1.1 size=977232 2024-03-04T12:41:18.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.516+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=9TT2Y10WKWJ1 tag=XL38UWRS6AN9 type=write size=3074384 2024-03-04T12:41:18.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.517+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=M63ZUEI036VX type=del 2024-03-04T12:41:18.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.519+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~4KXR8NJ1E7JK.0 size=1048576 2024-03-04T12:41:18.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.520+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~4KXR8NJ1E7JK.1 size=1048576 2024-03-04T12:41:18.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.521+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~4KXR8NJ1E7JK.2 size=364590 2024-03-04T12:41:18.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.521+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=4KXR8NJ1E7JK tag=BLJQGUHSUQ3W type=write size=3510318 2024-03-04T12:41:18.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.522+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=XAOXBCVN5UVD type=del 2024-03-04T12:41:18.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.524+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=2WHWVUZWAYV2 type=write size=842860 2024-03-04T12:41:18.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.525+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=X1VSXQSQEEO9 type=del 2024-03-04T12:41:18.531 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.526+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=57KFC5SCXPVP type=del size=2358732 2024-03-04T12:41:18.534 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.528+0000 7f093583d780 1 < suggested remove operation key=2YD2M0JQNCC0 tag=8R10NZ1R01OZ type=del 2024-03-04T12:41:18.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.529+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=5J3XDMH9B04H type=write size=932738 2024-03-04T12:41:18.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.532+0000 7f093583d780 1 < suggested remove operation key=OFTWI7UFD5L5 tag=25ZP97TRHXAV type=del 2024-03-04T12:41:18.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.533+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=T61J9A9WVL0H type=del size=2270755 2024-03-04T12:41:18.540 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.534+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~EUZF98JS9U1Y.0 size=575293 2024-03-04T12:41:18.541 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.536+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=EUZF98JS9U1Y tag=APHVTD3YE9UB type=write size=1623869 2024-03-04T12:41:18.544 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.538+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~X5NOI6VBT4QK.0 size=1048576 2024-03-04T12:41:18.544 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.539+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~X5NOI6VBT4QK.1 size=1048576 2024-03-04T12:41:18.545 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.540+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~X5NOI6VBT4QK.2 size=945121 2024-03-04T12:41:18.546 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.540+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=X5NOI6VBT4QK tag=L4DZ4KPXWB3V type=write size=4090849 2024-03-04T12:41:18.547 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.541+0000 7f093583d780 1 < completed delete operation key=NFM6LT89K5F4 tag=UB3PIR288XLQ type=del 2024-03-04T12:41:18.548 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.542+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=1QIPNSQFEFCO type=del size=2866382 2024-03-04T12:41:18.549 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.543+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~1J33E3L2T2OT.0 size=1048576 2024-03-04T12:41:18.550 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.544+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~1J33E3L2T2OT.1 size=1048576 2024-03-04T12:41:18.550 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.544+0000 7f093583d780 1 < canceled part key=_multipart_Q45PKXZVJ6YS.2~1J33E3L2T2OT.2 size=269645 2024-03-04T12:41:18.552 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.546+0000 7f093583d780 1 < canceled multipart upload key=Q45PKXZVJ6YS upload=1J33E3L2T2OT tag=TR3FYIQG0HYO type=write size=3415373 2024-03-04T12:41:18.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.548+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~CL1HQ3J1PKUB.0 size=95165 2024-03-04T12:41:18.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.548+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=CL1HQ3J1PKUB tag=3XRY9A1UTXMG type=write size=1143741 2024-03-04T12:41:18.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.549+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~8Y8RUCZI7CUF.0 size=1048576 2024-03-04T12:41:18.556 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.550+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~8Y8RUCZI7CUF.1 size=1048576 2024-03-04T12:41:18.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.551+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~8Y8RUCZI7CUF.2 size=166049 2024-03-04T12:41:18.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.553+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=8Y8RUCZI7CUF tag=IDUL74D2M04J type=write size=3311777 2024-03-04T12:41:18.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.555+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~X82QS3ZZML1L.0 size=1048576 2024-03-04T12:41:18.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.556+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~X82QS3ZZML1L.1 size=1048576 2024-03-04T12:41:18.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.557+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~X82QS3ZZML1L.2 size=115193 2024-03-04T12:41:18.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.557+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=X82QS3ZZML1L tag=I70UXQEE0IJF type=write size=3260921 2024-03-04T12:41:18.564 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.559+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=LA4CKV7XHV55 type=del 2024-03-04T12:41:18.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.560+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=5WWYSG057OZK type=del size=2584761 2024-03-04T12:41:18.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.562+0000 7f093583d780 1 < suggested update operation key=OFTWI7UFD5L5 tag=R683HX9EB8J0 type=del size=1799900 2024-03-04T12:41:18.569 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.564+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~ZJXM42DMV2PS.0 size=1048576 2024-03-04T12:41:18.570 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.565+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~ZJXM42DMV2PS.1 size=541094 2024-03-04T12:41:18.570 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.565+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=ZJXM42DMV2PS tag=TNLJ9XMH4IJR type=write size=2638246 2024-03-04T12:41:18.571 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.566+0000 7f093583d780 1 < canceled operation key=9VKN43CB955V tag=5SL5V7C9T0LW type=del size=3464189 2024-03-04T12:41:18.573 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.567+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=2LQZFQAGP3F3 type=del size=2715731 2024-03-04T12:41:18.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.568+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~83453X7D5CDZ.0 size=1048576 2024-03-04T12:41:18.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.568+0000 7f093583d780 1 < canceled part key=_multipart_I5NQBROT0WKE.2~83453X7D5CDZ.1 size=7847 2024-03-04T12:41:18.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.570+0000 7f093583d780 1 < canceled multipart upload key=I5NQBROT0WKE upload=83453X7D5CDZ tag=3B992EORHOYY type=write size=2104999 2024-03-04T12:41:18.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.571+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=SK3WSQZVC2OV type=write size=866546 2024-03-04T12:41:18.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.573+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=BBZ5SMT1VSBV type=del 2024-03-04T12:41:18.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.575+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~AD2XQGPAYHRY.0 size=896968 2024-03-04T12:41:18.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.575+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=AD2XQGPAYHRY tag=WSDWGXVNI67R type=write size=1945544 2024-03-04T12:41:18.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.576+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=Q6WO32CCP9UJ type=del 2024-03-04T12:41:18.582 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.577+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=WJ4X6OCLVUTG type=del size=859703 2024-03-04T12:41:18.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.578+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~9TT2Y10WKWJ1.0 size=1048576 2024-03-04T12:41:18.584 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.579+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~9TT2Y10WKWJ1.1 size=977232 2024-03-04T12:41:18.587 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.582+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=9TT2Y10WKWJ1 tag=XL38UWRS6AN9 type=write size=3074384 2024-03-04T12:41:18.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.584+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~6VU4XHG7PL3E.0 size=1048576 2024-03-04T12:41:18.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.584+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~6VU4XHG7PL3E.1 size=816475 2024-03-04T12:41:18.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.584+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=6VU4XHG7PL3E tag=VRYGE9JLJRUD type=write size=2913627 2024-03-04T12:41:18.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.586+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~4KXR8NJ1E7JK.0 size=1048576 2024-03-04T12:41:18.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.587+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~4KXR8NJ1E7JK.1 size=1048576 2024-03-04T12:41:18.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.587+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~4KXR8NJ1E7JK.2 size=364590 2024-03-04T12:41:18.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.589+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=4KXR8NJ1E7JK tag=BLJQGUHSUQ3W type=write size=3510318 2024-03-04T12:41:18.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.591+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~FC0L3YS56W5M.0 size=1048576 2024-03-04T12:41:18.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.592+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~FC0L3YS56W5M.1 size=1048576 2024-03-04T12:41:18.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.594+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~FC0L3YS56W5M.2 size=32657 2024-03-04T12:41:18.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.594+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=FC0L3YS56W5M tag=UOXK57Q9QV5K type=write size=3178385 2024-03-04T12:41:18.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.596+0000 7f093583d780 1 < suggested remove operation key=OCOQJLUUNWRG tag=2WHWVUZWAYV2 type=write 2024-03-04T12:41:18.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.597+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=50SX605C0TPO type=write size=79544 2024-03-04T12:41:18.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.601+0000 7f093583d780 1 < suggested update operation key=UAEQORB3BDBH tag=57KFC5SCXPVP type=del size=2358732 2024-03-04T12:41:18.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.603+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~ATP3HZXQXVBI.0 size=1048576 2024-03-04T12:41:18.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.604+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~ATP3HZXQXVBI.1 size=1048576 2024-03-04T12:41:18.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.605+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~ATP3HZXQXVBI.2 size=148931 2024-03-04T12:41:18.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.605+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=ATP3HZXQXVBI tag=07DETSGNCMN2 type=write size=3294659 2024-03-04T12:41:18.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.607+0000 7f093583d780 1 < suggested remove operation key=Y4D4Q7NV5VMO tag=5J3XDMH9B04H type=write 2024-03-04T12:41:18.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.608+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=DBM2ZMWW8HGE type=del size=3142457 2024-03-04T12:41:18.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.610+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=T61J9A9WVL0H type=del 2024-03-04T12:41:18.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.613+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~R5UHVOU1X3TX.0 size=1048576 2024-03-04T12:41:18.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.613+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~R5UHVOU1X3TX.1 size=81100 2024-03-04T12:41:18.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.613+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=R5UHVOU1X3TX tag=PKTO061TWF8W type=write size=2178252 2024-03-04T12:41:18.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.615+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~X5NOI6VBT4QK.0 size=1048576 2024-03-04T12:41:18.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.616+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~X5NOI6VBT4QK.1 size=1048576 2024-03-04T12:41:18.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.616+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~X5NOI6VBT4QK.2 size=945121 2024-03-04T12:41:18.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.618+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=X5NOI6VBT4QK tag=L4DZ4KPXWB3V type=write size=4090849 2024-03-04T12:41:18.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.620+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=EJCYIJQWVMQN type=del size=343691 2024-03-04T12:41:18.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.621+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=1QIPNSQFEFCO type=del 2024-03-04T12:41:18.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.623+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~8K8VMOL9Q478.0 size=1048576 2024-03-04T12:41:18.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.624+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~8K8VMOL9Q478.1 size=1048576 2024-03-04T12:41:18.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.625+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~8K8VMOL9Q478.2 size=710464 2024-03-04T12:41:18.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.625+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=8K8VMOL9Q478 tag=M204CAMJ1N6T type=write size=3856192 2024-03-04T12:41:18.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.626+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~CL1HQ3J1PKUB.0 size=95165 2024-03-04T12:41:18.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.628+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=CL1HQ3J1PKUB tag=3XRY9A1UTXMG type=write size=1143741 2024-03-04T12:41:18.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.630+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=WB41L6MH7UY6 type=write size=834866 2024-03-04T12:41:18.636 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.631+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~X82QS3ZZML1L.0 size=1048576 2024-03-04T12:41:18.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.632+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~X82QS3ZZML1L.1 size=1048576 2024-03-04T12:41:18.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.633+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~X82QS3ZZML1L.2 size=115193 2024-03-04T12:41:18.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.635+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=X82QS3ZZML1L tag=I70UXQEE0IJF type=write size=3260921 2024-03-04T12:41:18.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.636+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=H24HL2K6DDL5 type=del size=2046513 2024-03-04T12:41:18.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.637+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=5WWYSG057OZK type=del 2024-03-04T12:41:18.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.639+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=MN44DNLLDPJG type=del size=4119506 2024-03-04T12:41:18.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.639+0000 7f093583d780 1 < canceled part key=_multipart_2XVNK3YEVHJ7.2~ZJXM42DMV2PS.0 size=1048576 2024-03-04T12:41:18.645 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.640+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~ZJXM42DMV2PS.1 size=541094 2024-03-04T12:41:18.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.642+0000 7f093583d780 1 < canceled multipart upload key=2XVNK3YEVHJ7 upload=ZJXM42DMV2PS tag=TNLJ9XMH4IJR type=write size=2638246 2024-03-04T12:41:18.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.644+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~9LRIE2W08WJO.0 size=1048576 2024-03-04T12:41:18.651 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.645+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~9LRIE2W08WJO.1 size=18723 2024-03-04T12:41:18.651 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.645+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=9LRIE2W08WJO tag=6JCMEIJVTE3K type=write size=2115875 2024-03-04T12:41:18.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.647+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=2LQZFQAGP3F3 type=del 2024-03-04T12:41:18.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.648+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=3SVJ7ZYFFZO1 type=del size=4170447 2024-03-04T12:41:18.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.649+0000 7f093583d780 1 < completed write operation key=YJXFSO53QVPS tag=SK3WSQZVC2OV type=write size=866546 2024-03-04T12:41:18.657 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.651+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~OZ8S51KI93VZ.0 size=188007 2024-03-04T12:41:18.657 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.651+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=OZ8S51KI93VZ tag=LDKET2NXH6LL type=write size=1236583 2024-03-04T12:41:18.658 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.653+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~AD2XQGPAYHRY.0 size=896968 2024-03-04T12:41:18.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.655+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=AD2XQGPAYHRY tag=WSDWGXVNI67R type=write size=1945544 2024-03-04T12:41:18.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.657+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~1DB6BSFRHUS1.0 size=1048576 2024-03-04T12:41:18.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.660+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~1DB6BSFRHUS1.1 size=599913 2024-03-04T12:41:18.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.660+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=1DB6BSFRHUS1 tag=WAP88B51MFCK type=write size=2697065 2024-03-04T12:41:18.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.661+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=WJ4X6OCLVUTG type=del 2024-03-04T12:41:18.668 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.662+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=0R2CCKR55FD2 type=del size=4126152 2024-03-04T12:41:18.669 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.663+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~6VU4XHG7PL3E.0 size=1048576 2024-03-04T12:41:18.670 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.664+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~6VU4XHG7PL3E.1 size=816475 2024-03-04T12:41:18.672 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.666+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=6VU4XHG7PL3E tag=VRYGE9JLJRUD type=write size=2913627 2024-03-04T12:41:18.673 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.667+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=90U0DCSJ87NP type=del size=1934885 2024-03-04T12:41:18.675 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.669+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~FC0L3YS56W5M.0 size=1048576 2024-03-04T12:41:18.676 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.670+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~FC0L3YS56W5M.1 size=1048576 2024-03-04T12:41:18.676 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.671+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~FC0L3YS56W5M.2 size=32657 2024-03-04T12:41:18.679 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.673+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=FC0L3YS56W5M tag=UOXK57Q9QV5K type=write size=3178385 2024-03-04T12:41:18.680 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.674+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=JAQ3COL0YJ0P type=del size=395544 2024-03-04T12:41:18.681 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.675+0000 7f093583d780 1 < completed write operation key=HG0EM344TJZY tag=50SX605C0TPO type=write size=79544 2024-03-04T12:41:18.683 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.677+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~0E0S009VZJR7.0 size=390583 2024-03-04T12:41:18.683 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.677+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=0E0S009VZJR7 tag=MYGFZHIVNZW8 type=write size=1439159 2024-03-04T12:41:18.684 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.678+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~ATP3HZXQXVBI.0 size=1048576 2024-03-04T12:41:18.685 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.679+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~ATP3HZXQXVBI.1 size=1048576 2024-03-04T12:41:18.685 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.679+0000 7f093583d780 1 < canceled part key=_multipart_FT2XNJYYT30J.2~ATP3HZXQXVBI.2 size=148931 2024-03-04T12:41:18.687 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.681+0000 7f093583d780 1 < canceled multipart upload key=FT2XNJYYT30J upload=ATP3HZXQXVBI tag=07DETSGNCMN2 type=write size=3294659 2024-03-04T12:41:18.688 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.683+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=0CHP3XZRTWK0 type=del size=2412458 2024-03-04T12:41:18.692 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.684+0000 7f093583d780 1 < canceled operation key=9E12MS7PETOK tag=DBM2ZMWW8HGE type=del size=3142457 2024-03-04T12:41:18.692 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.686+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~GRP2CU0PBYD5.0 size=1048576 2024-03-04T12:41:18.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.687+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~GRP2CU0PBYD5.1 size=508871 2024-03-04T12:41:18.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.687+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=GRP2CU0PBYD5 tag=70LAAVFIJ2TK type=write size=2606023 2024-03-04T12:41:18.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.688+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~R5UHVOU1X3TX.0 size=1048576 2024-03-04T12:41:18.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.689+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~R5UHVOU1X3TX.1 size=81100 2024-03-04T12:41:18.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.691+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=R5UHVOU1X3TX tag=PKTO061TWF8W type=write size=2178252 2024-03-04T12:41:18.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.692+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=C0KPNPDFWLMS type=del size=1215594 2024-03-04T12:41:18.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.693+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=EJCYIJQWVMQN type=del 2024-03-04T12:41:18.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.694+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=5QXGKPIZ6LZZ type=del size=462327 2024-03-04T12:41:18.701 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.695+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~8K8VMOL9Q478.0 size=1048576 2024-03-04T12:41:18.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.696+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~8K8VMOL9Q478.1 size=1048576 2024-03-04T12:41:18.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.697+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~8K8VMOL9Q478.2 size=710464 2024-03-04T12:41:18.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.699+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=8K8VMOL9Q478 tag=M204CAMJ1N6T type=write size=3856192 2024-03-04T12:41:18.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.701+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~78U31VBHXDY5.0 size=1048576 2024-03-04T12:41:18.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.702+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~78U31VBHXDY5.1 size=277646 2024-03-04T12:41:18.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.702+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=78U31VBHXDY5 tag=YHHOKF2ITJ9G type=write size=2374798 2024-03-04T12:41:18.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.703+0000 7f093583d780 1 < completed write operation key=I5NQBROT0WKE tag=WB41L6MH7UY6 type=write size=834866 2024-03-04T12:41:18.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.704+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=S31JK6WU5RDM type=del size=1671512 2024-03-04T12:41:18.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.705+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=H24HL2K6DDL5 type=del 2024-03-04T12:41:18.712 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.706+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=R4GF9CBJFF0S type=del size=337042 2024-03-04T12:41:18.713 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.708+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=MN44DNLLDPJG type=del 2024-03-04T12:41:18.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.710+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~IUQRRC5WTLET.0 size=1048576 2024-03-04T12:41:18.716 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.711+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~IUQRRC5WTLET.1 size=1048576 2024-03-04T12:41:18.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.712+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~IUQRRC5WTLET.2 size=221037 2024-03-04T12:41:18.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.712+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=IUQRRC5WTLET tag=810QLJH8A06T type=write size=3366765 2024-03-04T12:41:18.718 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.713+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~9LRIE2W08WJO.0 size=1048576 2024-03-04T12:41:18.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.714+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~9LRIE2W08WJO.1 size=18723 2024-03-04T12:41:18.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.716+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=9LRIE2W08WJO tag=6JCMEIJVTE3K type=write size=2115875 2024-03-04T12:41:18.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.718+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=HJ5JE02T28OG type=del size=3867556 2024-03-04T12:41:18.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.719+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=3SVJ7ZYFFZO1 type=del 2024-03-04T12:41:18.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.720+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=2P1K00JBPDNQ type=del size=2576610 2024-03-04T12:41:18.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.722+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~OZ8S51KI93VZ.0 size=188007 2024-03-04T12:41:18.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.724+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=OZ8S51KI93VZ tag=LDKET2NXH6LL type=write size=1236583 2024-03-04T12:41:18.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.726+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~G01SVD9C1GW1.0 size=846607 2024-03-04T12:41:18.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.726+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=G01SVD9C1GW1 tag=D008VIPH5D6T type=write size=1895183 2024-03-04T12:41:18.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.727+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~1DB6BSFRHUS1.0 size=1048576 2024-03-04T12:41:18.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.728+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~1DB6BSFRHUS1.1 size=599913 2024-03-04T12:41:18.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.730+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=1DB6BSFRHUS1 tag=WAP88B51MFCK type=write size=2697065 2024-03-04T12:41:18.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.732+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~JZV7D089IQ0O.0 size=408792 2024-03-04T12:41:18.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.732+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=JZV7D089IQ0O tag=26889DG3D477 type=write size=1457368 2024-03-04T12:41:18.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.733+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=0R2CCKR55FD2 type=del 2024-03-04T12:41:18.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.735+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~ZGWRRSE5MJ5S.0 size=1017253 2024-03-04T12:41:18.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.735+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=ZGWRRSE5MJ5S tag=2BFXJW91JS4Y type=write size=2065829 2024-03-04T12:41:18.742 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.736+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=90U0DCSJ87NP type=del 2024-03-04T12:41:18.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.737+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=P9NSADBWWK2L type=del size=2001294 2024-03-04T12:41:18.744 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.738+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=JAQ3COL0YJ0P type=del 2024-03-04T12:41:18.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.740+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~J1FKC2Y7XLGU.0 size=176836 2024-03-04T12:41:18.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.740+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=J1FKC2Y7XLGU tag=ASE3JQ4ZTSFM type=write size=1225412 2024-03-04T12:41:18.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.741+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~0E0S009VZJR7.0 size=390583 2024-03-04T12:41:18.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.743+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=0E0S009VZJR7 tag=MYGFZHIVNZW8 type=write size=1439159 2024-03-04T12:41:18.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.744+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=CKE0E5OPN2KB type=del size=517722 2024-03-04T12:41:18.751 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.746+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=0CHP3XZRTWK0 type=del 2024-03-04T12:41:18.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.747+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=0B7AFCJ3G1JW type=del size=468700 2024-03-04T12:41:18.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.748+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~GRP2CU0PBYD5.0 size=1048576 2024-03-04T12:41:18.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.749+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~GRP2CU0PBYD5.1 size=508871 2024-03-04T12:41:18.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.751+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=GRP2CU0PBYD5 tag=70LAAVFIJ2TK type=write size=2606023 2024-03-04T12:41:18.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.753+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~BQVKJRWHH7UV.0 size=1048576 2024-03-04T12:41:18.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.754+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~BQVKJRWHH7UV.1 size=891210 2024-03-04T12:41:18.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.754+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=BQVKJRWHH7UV tag=0H130PYDHWZ0 type=write size=2988362 2024-03-04T12:41:18.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.756+0000 7f093583d780 1 < suggested remove operation key=GJ0FQ6EH9HJL tag=C0KPNPDFWLMS type=del 2024-03-04T12:41:18.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.757+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=910Z2SHE1V6R type=write size=190317 2024-03-04T12:41:18.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.759+0000 7f093583d780 1 < suggested update operation key=HG0EM344TJZY tag=5QXGKPIZ6LZZ type=del size=462327 2024-03-04T12:41:18.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.761+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=AC5I35GHT4YZ type=del size=114210 2024-03-04T12:41:18.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.762+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~78U31VBHXDY5.0 size=1048576 2024-03-04T12:41:18.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.763+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~78U31VBHXDY5.1 size=277646 2024-03-04T12:41:18.770 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.765+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=78U31VBHXDY5 tag=YHHOKF2ITJ9G type=write size=2374798 2024-03-04T12:41:18.772 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.767+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~5CXYQYD3G8QF.0 size=1048576 2024-03-04T12:41:18.773 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.768+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~5CXYQYD3G8QF.1 size=1048576 2024-03-04T12:41:18.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.769+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~5CXYQYD3G8QF.2 size=923929 2024-03-04T12:41:18.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.769+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=5CXYQYD3G8QF tag=M44L7CKPK6HN type=write size=4069657 2024-03-04T12:41:18.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.770+0000 7f093583d780 1 < completed delete operation key=AQI7H63EQSTN tag=S31JK6WU5RDM type=del 2024-03-04T12:41:18.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.771+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=M6LQP0W278NB type=del size=2552386 2024-03-04T12:41:18.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.772+0000 7f093583d780 -1 < failed to complete operation key=HG0EM344TJZY tag=R4GF9CBJFF0S type=del size=337042: (22) Invalid argument 2024-03-04T12:41:18.778 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.773+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=W8RZSV8X11U8 type=del size=1882220 2024-03-04T12:41:18.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.774+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~IUQRRC5WTLET.0 size=1048576 2024-03-04T12:41:18.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.775+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~IUQRRC5WTLET.1 size=1048576 2024-03-04T12:41:18.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.776+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~IUQRRC5WTLET.2 size=221037 2024-03-04T12:41:18.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.778+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=IUQRRC5WTLET tag=810QLJH8A06T type=write size=3366765 2024-03-04T12:41:18.785 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.780+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~ZLJ5W3HW42JY.0 size=1048576 2024-03-04T12:41:18.786 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.781+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~ZLJ5W3HW42JY.1 size=603719 2024-03-04T12:41:18.786 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.781+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=ZLJ5W3HW42JY tag=08VW39B07KE8 type=write size=2700871 2024-03-04T12:41:18.787 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.782+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=HJ5JE02T28OG type=del 2024-03-04T12:41:18.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.783+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=EXVOZL7RA3XF type=del size=3191092 2024-03-04T12:41:18.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.785+0000 7f093583d780 1 < canceled operation key=9VKN43CB955V tag=2P1K00JBPDNQ type=del size=2576610 2024-03-04T12:41:18.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.786+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=0Z2Y12UAVLM6 type=del size=1945054 2024-03-04T12:41:18.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.787+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~G01SVD9C1GW1.0 size=846607 2024-03-04T12:41:18.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.789+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=G01SVD9C1GW1 tag=D008VIPH5D6T type=write size=1895183 2024-03-04T12:41:18.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.790+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=PZ9TAUE9B51Q type=del size=3988877 2024-03-04T12:41:18.797 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.791+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~JZV7D089IQ0O.0 size=408792 2024-03-04T12:41:18.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.793+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=JZV7D089IQ0O tag=26889DG3D477 type=write size=1457368 2024-03-04T12:41:18.800 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.795+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=KYUH0GOJLR6M type=del size=3033559 2024-03-04T12:41:18.800 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.795+0000 7f093583d780 1 < canceled part key=_multipart_M0AOZ89IQNSK.2~ZGWRRSE5MJ5S.0 size=1017253 2024-03-04T12:41:18.802 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.797+0000 7f093583d780 1 < canceled multipart upload key=M0AOZ89IQNSK upload=ZGWRRSE5MJ5S tag=2BFXJW91JS4Y type=write size=2065829 2024-03-04T12:41:18.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.798+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=V8OMK75N6EOU type=write size=648262 2024-03-04T12:41:18.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.800+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=P9NSADBWWK2L type=del 2024-03-04T12:41:18.806 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.801+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=B2TJ2ASA3GXE type=del size=4013984 2024-03-04T12:41:18.806 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.801+0000 7f093583d780 1 < canceled part key=_multipart_FT2XNJYYT30J.2~J1FKC2Y7XLGU.0 size=176836 2024-03-04T12:41:18.809 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.803+0000 7f093583d780 1 < canceled multipart upload key=FT2XNJYYT30J upload=J1FKC2Y7XLGU tag=ASE3JQ4ZTSFM type=write size=1225412 2024-03-04T12:41:18.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.804+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=SWD2M5T8KUK9 type=del size=3335562 2024-03-04T12:41:18.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.806+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=CKE0E5OPN2KB type=del 2024-03-04T12:41:18.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.807+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=4S7VUFL1LUNI type=del size=1536606 2024-03-04T12:41:18.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.808+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=0B7AFCJ3G1JW type=del 2024-03-04T12:41:18.816 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.810+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~77WOC561VN73.0 size=1048576 2024-03-04T12:41:18.816 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.811+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~77WOC561VN73.1 size=918735 2024-03-04T12:41:18.817 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.811+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=77WOC561VN73 tag=X3QU2901LAVS type=write size=3015887 2024-03-04T12:41:18.818 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.812+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~BQVKJRWHH7UV.0 size=1048576 2024-03-04T12:41:18.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.813+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~BQVKJRWHH7UV.1 size=891210 2024-03-04T12:41:18.821 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.815+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=BQVKJRWHH7UV tag=0H130PYDHWZ0 type=write size=2988362 2024-03-04T12:41:18.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.817+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=89QL8R7QZ89L type=del size=954925 2024-03-04T12:41:18.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.818+0000 7f093583d780 1 < canceled operation key=3F8GI0JCUR6W tag=910Z2SHE1V6R type=write size=190317 2024-03-04T12:41:18.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.819+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=93P6HMDU55JB type=write size=401014 2024-03-04T12:41:18.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.820+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=AC5I35GHT4YZ type=del 2024-03-04T12:41:18.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.822+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~EVJQOZJTGTTF.0 size=1048576 2024-03-04T12:41:18.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.823+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~EVJQOZJTGTTF.1 size=917512 2024-03-04T12:41:18.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.823+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=EVJQOZJTGTTF tag=7YPL3U9RNGTF type=write size=3014664 2024-03-04T12:41:18.830 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.825+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~5CXYQYD3G8QF.0 size=1048576 2024-03-04T12:41:18.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.825+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~5CXYQYD3G8QF.1 size=1048576 2024-03-04T12:41:18.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.826+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~5CXYQYD3G8QF.2 size=923929 2024-03-04T12:41:18.834 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.828+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=5CXYQYD3G8QF tag=M44L7CKPK6HN type=write size=4069657 2024-03-04T12:41:18.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.830+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=HAKLFUOOD7NZ type=del size=1499596 2024-03-04T12:41:18.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.833+0000 7f093583d780 1 < suggested remove operation key=FT2XNJYYT30J tag=M6LQP0W278NB type=del 2024-03-04T12:41:18.839 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.834+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=T1X5TRIEY9AV type=del size=3737814 2024-03-04T12:41:18.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.835+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=W8RZSV8X11U8 type=del 2024-03-04T12:41:18.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.836+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=JYTI50678ZUX type=del size=2121367 2024-03-04T12:41:18.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.837+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~ZLJ5W3HW42JY.0 size=1048576 2024-03-04T12:41:18.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.838+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~ZLJ5W3HW42JY.1 size=603719 2024-03-04T12:41:18.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.840+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=ZLJ5W3HW42JY tag=08VW39B07KE8 type=write size=2700871 2024-03-04T12:41:18.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.842+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~RMWZHI8W65LH.0 size=1048576 2024-03-04T12:41:18.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.843+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~RMWZHI8W65LH.1 size=1048576 2024-03-04T12:41:18.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.844+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~RMWZHI8W65LH.2 size=57721 2024-03-04T12:41:18.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.844+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=RMWZHI8W65LH tag=NYB94TE3GCRU type=write size=3203449 2024-03-04T12:41:18.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.845+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=EXVOZL7RA3XF type=del 2024-03-04T12:41:18.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.846+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=XUFP5ZUNMNYT type=del size=2552110 2024-03-04T12:41:18.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.847+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=0Z2Y12UAVLM6 type=del 2024-03-04T12:41:18.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.849+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=YOL8XEFIWZZ5 type=write size=426719 2024-03-04T12:41:18.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.850+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=PZ9TAUE9B51Q type=del 2024-03-04T12:41:18.857 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.852+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~X3DOU3RYJTH0.0 size=1034823 2024-03-04T12:41:18.857 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.852+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=X3DOU3RYJTH0 tag=RRPCS417006K type=write size=2083399 2024-03-04T12:41:18.858 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.853+0000 7f093583d780 1 < canceled operation key=2YD2M0JQNCC0 tag=KYUH0GOJLR6M type=del size=3033559 2024-03-04T12:41:18.860 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.855+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~DV1KLX4RA82N.0 size=1048576 2024-03-04T12:41:18.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.856+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~DV1KLX4RA82N.1 size=1048576 2024-03-04T12:41:18.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.857+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~DV1KLX4RA82N.2 size=145372 2024-03-04T12:41:18.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.857+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=DV1KLX4RA82N tag=WHK64L6JRWW1 type=write size=3291100 2024-03-04T12:41:18.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.858+0000 7f093583d780 1 < canceled operation key=I6DIP4VGHMNO tag=V8OMK75N6EOU type=write size=648262 2024-03-04T12:41:18.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.859+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=4S4PVXE8KJ1P type=write size=381430 2024-03-04T12:41:18.866 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.860+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=B2TJ2ASA3GXE type=del 2024-03-04T12:41:18.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.862+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=9AC6DT9US2AE type=del size=3490527 2024-03-04T12:41:18.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.863+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=SWD2M5T8KUK9 type=del 2024-03-04T12:41:18.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.864+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=YR6XOGMKRQFI type=write size=897117 2024-03-04T12:41:18.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.865+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=4S7VUFL1LUNI type=del 2024-03-04T12:41:18.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.867+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=7A6Z7OQE59U2 type=del size=925721 2024-03-04T12:41:18.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.868+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~77WOC561VN73.0 size=1048576 2024-03-04T12:41:18.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.869+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~77WOC561VN73.1 size=918735 2024-03-04T12:41:18.877 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.872+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=77WOC561VN73 tag=X3QU2901LAVS type=write size=3015887 2024-03-04T12:41:18.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.874+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~72BHIGMQM15K.0 size=1048576 2024-03-04T12:41:18.880 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.875+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~72BHIGMQM15K.1 size=1048576 2024-03-04T12:41:18.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.875+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~72BHIGMQM15K.2 size=448253 2024-03-04T12:41:18.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.875+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=72BHIGMQM15K tag=5IR0O41W2GIY type=write size=3593981 2024-03-04T12:41:18.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.877+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=89QL8R7QZ89L type=del 2024-03-04T12:41:18.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.878+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=8EQPUN4WK7TO type=write size=255173 2024-03-04T12:41:18.885 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.879+0000 7f093583d780 1 < completed write operation key=3F8GI0JCUR6W tag=93P6HMDU55JB type=write size=401014 2024-03-04T12:41:18.886 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.880+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=C2YGP6709B8O type=del size=3626402 2024-03-04T12:41:18.887 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.882+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~EVJQOZJTGTTF.0 size=1048576 2024-03-04T12:41:18.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.882+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~EVJQOZJTGTTF.1 size=917512 2024-03-04T12:41:18.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.884+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=EVJQOZJTGTTF tag=7YPL3U9RNGTF type=write size=3014664 2024-03-04T12:41:18.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.886+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~NCG3HCHESS0X.0 size=412849 2024-03-04T12:41:18.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.886+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=NCG3HCHESS0X tag=3A1RRSU9RZHJ type=write size=1461425 2024-03-04T12:41:18.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.888+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=HAKLFUOOD7NZ type=del 2024-03-04T12:41:18.896 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.890+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=URJIYLTNIGWA type=del size=2987054 2024-03-04T12:41:18.900 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.891+0000 7f093583d780 1 < canceled operation key=O6OUISHWZ7FU tag=T1X5TRIEY9AV type=del size=3737814 2024-03-04T12:41:18.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.893+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~NBE9C6P6IW1B.0 size=1048576 2024-03-04T12:41:18.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.894+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~NBE9C6P6IW1B.1 size=419723 2024-03-04T12:41:18.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.894+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=NBE9C6P6IW1B tag=ZIBMQXH6Y3T4 type=write size=2516875 2024-03-04T12:41:18.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.895+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=JYTI50678ZUX type=del 2024-03-04T12:41:18.902 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.897+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=XM8L1WGI216I type=write size=485446 2024-03-04T12:41:18.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.898+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~RMWZHI8W65LH.0 size=1048576 2024-03-04T12:41:18.904 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.899+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~RMWZHI8W65LH.1 size=1048576 2024-03-04T12:41:18.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.900+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~RMWZHI8W65LH.2 size=57721 2024-03-04T12:41:18.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.902+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=RMWZHI8W65LH tag=NYB94TE3GCRU type=write size=3203449 2024-03-04T12:41:18.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.903+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=HX4HIF4NJJ2B type=del size=3679868 2024-03-04T12:41:18.909 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.904+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=XUFP5ZUNMNYT type=del 2024-03-04T12:41:18.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.906+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~12AZ2E00NPX7.0 size=1031476 2024-03-04T12:41:18.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.906+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=12AZ2E00NPX7 tag=96FERB05VOHP type=write size=2080052 2024-03-04T12:41:18.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.907+0000 7f093583d780 1 < completed write operation key=NFM6LT89K5F4 tag=YOL8XEFIWZZ5 type=write size=426719 2024-03-04T12:41:18.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.908+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=BV9RIGE3CLJ8 type=del size=959025 2024-03-04T12:41:18.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.909+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~X3DOU3RYJTH0.0 size=1034823 2024-03-04T12:41:18.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.911+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=X3DOU3RYJTH0 tag=RRPCS417006K type=write size=2083399 2024-03-04T12:41:18.919 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.913+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~SMZG5DPBJ7B2.0 size=1048576 2024-03-04T12:41:18.920 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.914+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~SMZG5DPBJ7B2.1 size=244383 2024-03-04T12:41:18.920 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.914+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=SMZG5DPBJ7B2 tag=7ASSYMCM8N90 type=write size=2341535 2024-03-04T12:41:18.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.915+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~DV1KLX4RA82N.0 size=1048576 2024-03-04T12:41:18.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.916+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~DV1KLX4RA82N.1 size=1048576 2024-03-04T12:41:18.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.916+0000 7f093583d780 1 < canceled part key=_multipart_96PTQ2KHPMMM.2~DV1KLX4RA82N.2 size=145372 2024-03-04T12:41:18.924 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.918+0000 7f093583d780 1 < canceled multipart upload key=96PTQ2KHPMMM upload=DV1KLX4RA82N tag=WHK64L6JRWW1 type=write size=3291100 2024-03-04T12:41:18.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.920+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=70TUPIBL363G type=del size=3069685 2024-03-04T12:41:18.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.921+0000 7f093583d780 1 < completed write operation key=FT2XNJYYT30J tag=4S4PVXE8KJ1P type=write size=381430 2024-03-04T12:41:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.923+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~TR0GQX2DP00L.0 size=1048576 2024-03-04T12:41:18.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.924+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~TR0GQX2DP00L.1 size=1048576 2024-03-04T12:41:18.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.925+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~TR0GQX2DP00L.2 size=534318 2024-03-04T12:41:18.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.925+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=TR0GQX2DP00L tag=E6ES2ZKVAE2A type=write size=3680046 2024-03-04T12:41:18.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.926+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=9AC6DT9US2AE type=del 2024-03-04T12:41:18.933 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.927+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=2U7GUVCRYK9Y type=del size=80294 2024-03-04T12:41:18.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.930+0000 7f093583d780 1 < suggested update operation key=M0AOZ89IQNSK tag=YR6XOGMKRQFI type=write size=897117 2024-03-04T12:41:18.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.931+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=1F3JM85DZZT5 type=del size=989891 2024-03-04T12:41:18.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.932+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=7A6Z7OQE59U2 type=del 2024-03-04T12:41:18.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.933+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=ZAT106I5YHEZ type=del size=1346607 2024-03-04T12:41:18.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.934+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~72BHIGMQM15K.0 size=1048576 2024-03-04T12:41:18.941 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.935+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~72BHIGMQM15K.1 size=1048576 2024-03-04T12:41:18.942 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.936+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~72BHIGMQM15K.2 size=448253 2024-03-04T12:41:18.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.938+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=72BHIGMQM15K tag=5IR0O41W2GIY type=write size=3593981 2024-03-04T12:41:18.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.942+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~RW5JJW8DTZL9.0 size=1048576 2024-03-04T12:41:18.948 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.943+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~RW5JJW8DTZL9.1 size=1048576 2024-03-04T12:41:18.949 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.944+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~RW5JJW8DTZL9.2 size=1017043 2024-03-04T12:41:18.949 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.944+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=RW5JJW8DTZL9 tag=I2REG0DDBNMZ type=write size=4162771 2024-03-04T12:41:18.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.945+0000 7f093583d780 1 < canceled operation key=GMKM2QEP072H tag=8EQPUN4WK7TO type=write size=255173 2024-03-04T12:41:18.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.947+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~48BB3TZXP0P0.0 size=254382 2024-03-04T12:41:18.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.947+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=48BB3TZXP0P0 tag=JVJGL28LPCKT type=write size=1302958 2024-03-04T12:41:18.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.948+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=C2YGP6709B8O type=del 2024-03-04T12:41:18.955 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.949+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=CL85BGB25AKU type=del size=296923 2024-03-04T12:41:18.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.951+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~NCG3HCHESS0X.0 size=412849 2024-03-04T12:41:18.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.953+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=NCG3HCHESS0X tag=3A1RRSU9RZHJ type=write size=1461425 2024-03-04T12:41:18.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.954+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=P8AF0N0G64Q6 type=del size=3366684 2024-03-04T12:41:18.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.956+0000 7f093583d780 1 < suggested remove operation key=I5NQBROT0WKE tag=URJIYLTNIGWA type=del 2024-03-04T12:41:18.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.957+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=4MGNYWPEI1GP type=del size=1654168 2024-03-04T12:41:18.964 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.958+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~NBE9C6P6IW1B.0 size=1048576 2024-03-04T12:41:18.965 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.959+0000 7f093583d780 1 < completed part key=_multipart_L4UQK3UJFXZC.2~NBE9C6P6IW1B.1 size=419723 2024-03-04T12:41:18.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.961+0000 7f093583d780 1 < completed multipart upload key=L4UQK3UJFXZC upload=NBE9C6P6IW1B tag=ZIBMQXH6Y3T4 type=write size=2516875 2024-03-04T12:41:18.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.963+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~JAFY2NIWUVWH.0 size=90416 2024-03-04T12:41:18.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.963+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=JAFY2NIWUVWH tag=OJ1EUSPZ8A3M type=write size=1138992 2024-03-04T12:41:18.971 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.965+0000 7f093583d780 1 < suggested update operation key=YJXFSO53QVPS tag=XM8L1WGI216I type=write size=485446 2024-03-04T12:41:18.973 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.967+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~MMV3NDPA7B6A.0 size=663080 2024-03-04T12:41:18.973 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.967+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=MMV3NDPA7B6A tag=OB7EWQRGQEBO type=write size=1711656 2024-03-04T12:41:18.974 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.969+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=HX4HIF4NJJ2B type=del 2024-03-04T12:41:18.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.970+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=1ZECOQV3ELNV type=write size=20406 2024-03-04T12:41:18.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.971+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~12AZ2E00NPX7.0 size=1031476 2024-03-04T12:41:18.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.973+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=12AZ2E00NPX7 tag=96FERB05VOHP type=write size=2080052 2024-03-04T12:41:18.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.974+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=0XARG2MK4I14 type=del size=1109329 2024-03-04T12:41:18.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.975+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=BV9RIGE3CLJ8 type=del 2024-03-04T12:41:18.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.976+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=XO91R23ND70N type=del size=1112075 2024-03-04T12:41:18.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.977+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~SMZG5DPBJ7B2.0 size=1048576 2024-03-04T12:41:18.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.978+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~SMZG5DPBJ7B2.1 size=244383 2024-03-04T12:41:18.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.980+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=SMZG5DPBJ7B2 tag=7ASSYMCM8N90 type=write size=2341535 2024-03-04T12:41:18.987 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.981+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=EZ21D2V4EWRG type=del size=4031719 2024-03-04T12:41:18.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.982+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=70TUPIBL363G type=del 2024-03-04T12:41:18.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.984+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~14PNLJNLZGG6.0 size=490231 2024-03-04T12:41:18.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.984+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=14PNLJNLZGG6 tag=AK4RK1RZ1EK3 type=write size=1538807 2024-03-04T12:41:18.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.985+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~TR0GQX2DP00L.0 size=1048576 2024-03-04T12:41:18.992 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.986+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~TR0GQX2DP00L.1 size=1048576 2024-03-04T12:41:18.992 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.986+0000 7f093583d780 1 < canceled part key=_multipart_Q45PKXZVJ6YS.2~TR0GQX2DP00L.2 size=534318 2024-03-04T12:41:18.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.988+0000 7f093583d780 1 < canceled multipart upload key=Q45PKXZVJ6YS upload=TR0GQX2DP00L tag=E6ES2ZKVAE2A type=write size=3680046 2024-03-04T12:41:18.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.991+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~SQ53O8B5DYL1.0 size=1048576 2024-03-04T12:41:18.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.991+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~SQ53O8B5DYL1.1 size=1048576 2024-03-04T12:41:18.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.992+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~SQ53O8B5DYL1.2 size=546996 2024-03-04T12:41:18.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.992+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=SQ53O8B5DYL1 tag=MD9F6I0OPVG2 type=write size=3692724 2024-03-04T12:41:19.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.995+0000 7f093583d780 1 < suggested remove operation key=J6Y9V11BX06B tag=2U7GUVCRYK9Y type=del 2024-03-04T12:41:19.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.996+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=XPBKOC3XFMEK type=del size=1627916 2024-03-04T12:41:19.003 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.997+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=1F3JM85DZZT5 type=del 2024-03-04T12:41:19.003 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:18.998+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=JAP3OTJR89PB type=del size=3633698 2024-03-04T12:41:19.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.000+0000 7f093583d780 1 < suggested update operation key=2ZOV2JEQHXGS tag=ZAT106I5YHEZ type=del size=1346607 2024-03-04T12:41:19.008 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.002+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~OIHB13IM93E9.0 size=1048576 2024-03-04T12:41:19.008 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.003+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~OIHB13IM93E9.1 size=373428 2024-03-04T12:41:19.009 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.003+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=OIHB13IM93E9 tag=UTTXKWHWD8TS type=write size=2470580 2024-03-04T12:41:19.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.004+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~RW5JJW8DTZL9.0 size=1048576 2024-03-04T12:41:19.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.005+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~RW5JJW8DTZL9.1 size=1048576 2024-03-04T12:41:19.011 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.006+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~RW5JJW8DTZL9.2 size=1017043 2024-03-04T12:41:19.013 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.008+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=RW5JJW8DTZL9 tag=I2REG0DDBNMZ type=write size=4162771 2024-03-04T12:41:19.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.010+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~CHQF60B8S7LJ.0 size=686128 2024-03-04T12:41:19.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.010+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=CHQF60B8S7LJ tag=WII6322TMGLR type=write size=1734704 2024-03-04T12:41:19.017 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.011+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~48BB3TZXP0P0.0 size=254382 2024-03-04T12:41:19.018 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.013+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=48BB3TZXP0P0 tag=JVJGL28LPCKT type=write size=1302958 2024-03-04T12:41:19.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.015+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~IBLB0XY212DV.0 size=1048576 2024-03-04T12:41:19.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.016+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~IBLB0XY212DV.1 size=438024 2024-03-04T12:41:19.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.016+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=IBLB0XY212DV tag=QLAAP8VSGAW2 type=write size=2535176 2024-03-04T12:41:19.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.017+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=CL85BGB25AKU type=del 2024-03-04T12:41:19.023 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.018+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=R1UEM10LGCE1 type=write size=785070 2024-03-04T12:41:19.025 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.019+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=P8AF0N0G64Q6 type=del 2024-03-04T12:41:19.025 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.020+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=1UNKXBHEF8U6 type=del size=3464384 2024-03-04T12:41:19.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.021+0000 7f093583d780 1 < canceled operation key=54FLC10FWKL6 tag=4MGNYWPEI1GP type=del size=1654168 2024-03-04T12:41:19.029 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.023+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~IRX9ZQHJGPVP.0 size=1048576 2024-03-04T12:41:19.029 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.024+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~IRX9ZQHJGPVP.1 size=159373 2024-03-04T12:41:19.029 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.024+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=IRX9ZQHJGPVP tag=0DEL70A5LM7S type=write size=2256525 2024-03-04T12:41:19.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.025+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~JAFY2NIWUVWH.0 size=90416 2024-03-04T12:41:19.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.027+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=JAFY2NIWUVWH tag=OJ1EUSPZ8A3M type=write size=1138992 2024-03-04T12:41:19.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.029+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~6K38DOF01ICY.0 size=78703 2024-03-04T12:41:19.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.029+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=6K38DOF01ICY tag=9A7T6886KM3D type=write size=1127279 2024-03-04T12:41:19.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.030+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~MMV3NDPA7B6A.0 size=663080 2024-03-04T12:41:19.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.032+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=MMV3NDPA7B6A tag=OB7EWQRGQEBO type=write size=1711656 2024-03-04T12:41:19.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.033+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=ZEGY1MQHF8CC type=del size=371017 2024-03-04T12:41:19.040 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.034+0000 7f093583d780 1 < completed write operation key=Y4D4Q7NV5VMO tag=1ZECOQV3ELNV type=write size=20406 2024-03-04T12:41:19.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.037+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~YWI14SIC9PAN.0 size=1048576 2024-03-04T12:41:19.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.038+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~YWI14SIC9PAN.1 size=1048576 2024-03-04T12:41:19.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.039+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~YWI14SIC9PAN.2 size=162595 2024-03-04T12:41:19.045 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.039+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=YWI14SIC9PAN tag=G92ZJ4LWMR5P type=write size=3308323 2024-03-04T12:41:19.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.041+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=0XARG2MK4I14 type=del 2024-03-04T12:41:19.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.042+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=Y82GZ2HA3PRG type=write size=372456 2024-03-04T12:41:19.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.043+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=XO91R23ND70N type=del 2024-03-04T12:41:19.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.046+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~0TGUEY4NT7CR.0 size=1048576 2024-03-04T12:41:19.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.047+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~0TGUEY4NT7CR.1 size=2078 2024-03-04T12:41:19.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.047+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=0TGUEY4NT7CR tag=BP2BLL3NR1X4 type=write size=2099230 2024-03-04T12:41:19.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.050+0000 7f093583d780 -1 < failed to complete operation key=2ZOV2JEQHXGS tag=EZ21D2V4EWRG type=del size=4031719: (22) Invalid argument 2024-03-04T12:41:19.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.054+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~I2IMKKTL7AUG.0 size=1048576 2024-03-04T12:41:19.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.055+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~I2IMKKTL7AUG.1 size=1048576 2024-03-04T12:41:19.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.056+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~I2IMKKTL7AUG.2 size=120559 2024-03-04T12:41:19.062 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.056+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=I2IMKKTL7AUG tag=RWOV0FOW7JO7 type=write size=3266287 2024-03-04T12:41:19.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.057+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~14PNLJNLZGG6.0 size=490231 2024-03-04T12:41:19.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.059+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=14PNLJNLZGG6 tag=AK4RK1RZ1EK3 type=write size=1538807 2024-03-04T12:41:19.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.060+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=F2JIQAMN3OAU type=del size=1223170 2024-03-04T12:41:19.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.062+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~SQ53O8B5DYL1.0 size=1048576 2024-03-04T12:41:19.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.063+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~SQ53O8B5DYL1.1 size=1048576 2024-03-04T12:41:19.069 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.064+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~SQ53O8B5DYL1.2 size=546996 2024-03-04T12:41:19.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.066+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=SQ53O8B5DYL1 tag=MD9F6I0OPVG2 type=write size=3692724 2024-03-04T12:41:19.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.067+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=NH6CM3RK9NX9 type=del size=2664385 2024-03-04T12:41:19.073 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.068+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=XPBKOC3XFMEK type=del 2024-03-04T12:41:19.074 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.069+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=CBKC8R8U8L4U type=del size=1105148 2024-03-04T12:41:19.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.070+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=JAP3OTJR89PB type=del 2024-03-04T12:41:19.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.071+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=ND6ZJCUH7HZV type=del size=1273019 2024-03-04T12:41:19.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.072+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~OIHB13IM93E9.0 size=1048576 2024-03-04T12:41:19.079 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.073+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~OIHB13IM93E9.1 size=373428 2024-03-04T12:41:19.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.075+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=OIHB13IM93E9 tag=UTTXKWHWD8TS type=write size=2470580 2024-03-04T12:41:19.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.076+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=CKALO2U57FVN type=del size=2775969 2024-03-04T12:41:19.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.077+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~CHQF60B8S7LJ.0 size=686128 2024-03-04T12:41:19.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.079+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=CHQF60B8S7LJ tag=WII6322TMGLR type=write size=1734704 2024-03-04T12:41:19.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.081+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=BES1HVCV7W1Y type=write size=188329 2024-03-04T12:41:19.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.082+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~IBLB0XY212DV.0 size=1048576 2024-03-04T12:41:19.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.083+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~IBLB0XY212DV.1 size=438024 2024-03-04T12:41:19.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.084+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=IBLB0XY212DV tag=QLAAP8VSGAW2 type=write size=2535176 2024-03-04T12:41:19.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.085+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=11SHUBMLGASN type=del size=4076379 2024-03-04T12:41:19.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.087+0000 7f093583d780 1 < completed write operation key=2ZOV2JEQHXGS tag=R1UEM10LGCE1 type=write size=785070 2024-03-04T12:41:19.093 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.088+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=XR9E72N0HJN8 type=del size=1888160 2024-03-04T12:41:19.096 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.090+0000 7f093583d780 1 < suggested remove operation key=M0AOZ89IQNSK tag=1UNKXBHEF8U6 type=del 2024-03-04T12:41:19.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.091+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=WP9AMMRRGWPW type=del size=42980 2024-03-04T12:41:19.098 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.092+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~IRX9ZQHJGPVP.0 size=1048576 2024-03-04T12:41:19.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.093+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~IRX9ZQHJGPVP.1 size=159373 2024-03-04T12:41:19.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.095+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=IRX9ZQHJGPVP tag=0DEL70A5LM7S type=write size=2256525 2024-03-04T12:41:19.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.097+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=YLS9D6LLS4R1 type=write size=618063 2024-03-04T12:41:19.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.098+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~6K38DOF01ICY.0 size=78703 2024-03-04T12:41:19.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.100+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=6K38DOF01ICY tag=9A7T6886KM3D type=write size=1127279 2024-03-04T12:41:19.107 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.101+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=SYH8C3UJ6H6F type=del size=3471468 2024-03-04T12:41:19.107 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.102+0000 7f093583d780 1 < completed delete operation key=NFM6LT89K5F4 tag=ZEGY1MQHF8CC type=del 2024-03-04T12:41:19.109 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.103+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=TG067Y3VSZGB type=del size=372642 2024-03-04T12:41:19.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.104+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~YWI14SIC9PAN.0 size=1048576 2024-03-04T12:41:19.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.107+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~YWI14SIC9PAN.1 size=1048576 2024-03-04T12:41:19.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.108+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~YWI14SIC9PAN.2 size=162595 2024-03-04T12:41:19.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.110+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=YWI14SIC9PAN tag=G92ZJ4LWMR5P type=write size=3308323 2024-03-04T12:41:19.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.111+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=3FNKH2ZDWLLJ type=del size=3860230 2024-03-04T12:41:19.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.113+0000 7f093583d780 1 < suggested update operation key=M0AOZ89IQNSK tag=Y82GZ2HA3PRG type=write size=372456 2024-03-04T12:41:19.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.114+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=13GLUEM67BWS type=del size=4119211 2024-03-04T12:41:19.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.115+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~0TGUEY4NT7CR.0 size=1048576 2024-03-04T12:41:19.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.115+0000 7f093583d780 1 < canceled part key=_multipart_O6OUISHWZ7FU.2~0TGUEY4NT7CR.1 size=2078 2024-03-04T12:41:19.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.117+0000 7f093583d780 1 < canceled multipart upload key=O6OUISHWZ7FU upload=0TGUEY4NT7CR tag=BP2BLL3NR1X4 type=write size=2099230 2024-03-04T12:41:19.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.118+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=VZBSPJVUXQLZ type=write size=92704 2024-03-04T12:41:19.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.120+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~I2IMKKTL7AUG.0 size=1048576 2024-03-04T12:41:19.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.120+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~I2IMKKTL7AUG.1 size=1048576 2024-03-04T12:41:19.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.121+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~I2IMKKTL7AUG.2 size=120559 2024-03-04T12:41:19.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.123+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=I2IMKKTL7AUG tag=RWOV0FOW7JO7 type=write size=3266287 2024-03-04T12:41:19.131 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.125+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~OE5ZIIUGIG3D.0 size=1048576 2024-03-04T12:41:19.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.126+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~OE5ZIIUGIG3D.1 size=266454 2024-03-04T12:41:19.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.126+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=OE5ZIIUGIG3D tag=06JFUKTCXKXE type=write size=2363606 2024-03-04T12:41:19.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.128+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=F2JIQAMN3OAU type=del 2024-03-04T12:41:19.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.129+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=LEQHZ5HQ458H type=del size=4106740 2024-03-04T12:41:19.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.130+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=NH6CM3RK9NX9 type=del 2024-03-04T12:41:19.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.132+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~M8E0MVIL7Z56.0 size=1018417 2024-03-04T12:41:19.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.132+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=M8E0MVIL7Z56 tag=Z0G3I2OJ02KJ type=write size=2066993 2024-03-04T12:41:19.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.133+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=CBKC8R8U8L4U type=del 2024-03-04T12:41:19.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.135+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~SMUQIBF0SNJS.0 size=1048576 2024-03-04T12:41:19.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.136+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~SMUQIBF0SNJS.1 size=315990 2024-03-04T12:41:19.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.136+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=SMUQIBF0SNJS tag=6QJ8RYYNIPHF type=write size=2413142 2024-03-04T12:41:19.143 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.137+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=ND6ZJCUH7HZV type=del 2024-03-04T12:41:19.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.138+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=VOCIDVFRQDC7 type=del size=3093790 2024-03-04T12:41:19.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.139+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=CKALO2U57FVN type=del 2024-03-04T12:41:19.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.140+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=X1MEVVAEWITO type=del size=3777730 2024-03-04T12:41:19.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.144+0000 7f093583d780 1 < suggested update operation key=2R5WA9Q9ZAUG tag=BES1HVCV7W1Y type=write size=188329 2024-03-04T12:41:19.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.145+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=DS9630U0SQFC type=del size=1413719 2024-03-04T12:41:19.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.146+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=11SHUBMLGASN type=del 2024-03-04T12:41:19.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.149+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~KDF0ROOOQJAB.0 size=1048576 2024-03-04T12:41:19.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.150+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~KDF0ROOOQJAB.1 size=1048576 2024-03-04T12:41:19.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.151+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~KDF0ROOOQJAB.2 size=547653 2024-03-04T12:41:19.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.151+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=KDF0ROOOQJAB tag=PUJ8TSTPQXE8 type=write size=3693381 2024-03-04T12:41:19.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.152+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=XR9E72N0HJN8 type=del 2024-03-04T12:41:19.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.153+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=E3WUT0XFMC90 type=write size=169674 2024-03-04T12:41:19.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.155+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=WP9AMMRRGWPW type=del 2024-03-04T12:41:19.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.156+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=X8G6L2T5EDHR type=del size=23284 2024-03-04T12:41:19.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.158+0000 7f093583d780 1 < suggested update operation key=3F8GI0JCUR6W tag=YLS9D6LLS4R1 type=write size=618063 2024-03-04T12:41:19.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.159+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=5X2S14XWS3MQ type=del size=3342263 2024-03-04T12:41:19.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.160+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=SYH8C3UJ6H6F type=del 2024-03-04T12:41:19.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.164+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~YULOKHN86E7M.0 size=1048576 2024-03-04T12:41:19.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.165+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~YULOKHN86E7M.1 size=1048576 2024-03-04T12:41:19.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.166+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~YULOKHN86E7M.2 size=417670 2024-03-04T12:41:19.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.166+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=YULOKHN86E7M tag=RTO2D9EGNM4N type=write size=3563398 2024-03-04T12:41:19.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.167+0000 7f093583d780 1 < canceled operation key=I5NQBROT0WKE tag=TG067Y3VSZGB type=del size=372642 2024-03-04T12:41:19.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.168+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=1V7YZ1N1FQNX type=del size=1937715 2024-03-04T12:41:19.174 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.169+0000 7f093583d780 -1 < failed to complete operation key=M0AOZ89IQNSK tag=3FNKH2ZDWLLJ type=del size=3860230: (22) Invalid argument 2024-03-04T12:41:19.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.170+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=W6SQK16J3XD6 type=del size=2079683 2024-03-04T12:41:19.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.172+0000 7f093583d780 1 < suggested remove operation key=I6DIP4VGHMNO tag=13GLUEM67BWS type=del 2024-03-04T12:41:19.179 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.173+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=3FK35JOXZKDU type=del size=3264128 2024-03-04T12:41:19.181 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.175+0000 7f093583d780 1 < suggested update operation key=NFM6LT89K5F4 tag=VZBSPJVUXQLZ type=write size=92704 2024-03-04T12:41:19.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.177+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=6MYAT1MHRUFR type=del size=314473 2024-03-04T12:41:19.183 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.178+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~OE5ZIIUGIG3D.0 size=1048576 2024-03-04T12:41:19.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.179+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~OE5ZIIUGIG3D.1 size=266454 2024-03-04T12:41:19.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.181+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=OE5ZIIUGIG3D tag=06JFUKTCXKXE type=write size=2363606 2024-03-04T12:41:19.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.182+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=N01D7QQ3UT14 type=del size=2672504 2024-03-04T12:41:19.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.183+0000 7f093583d780 1 < canceled operation key=2XVNK3YEVHJ7 tag=LEQHZ5HQ458H type=del size=4106740 2024-03-04T12:41:19.190 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.184+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=890EMJU4JMUZ type=del size=4001512 2024-03-04T12:41:19.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.185+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~M8E0MVIL7Z56.0 size=1018417 2024-03-04T12:41:19.193 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.187+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=M8E0MVIL7Z56 tag=Z0G3I2OJ02KJ type=write size=2066993 2024-03-04T12:41:19.195 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.189+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~1FV9QXWME1K8.0 size=1048576 2024-03-04T12:41:19.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.190+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~1FV9QXWME1K8.1 size=174334 2024-03-04T12:41:19.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.190+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=1FV9QXWME1K8 tag=RHLRWIYFZIZJ type=write size=2271486 2024-03-04T12:41:19.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.191+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~SMUQIBF0SNJS.0 size=1048576 2024-03-04T12:41:19.198 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.192+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~SMUQIBF0SNJS.1 size=315990 2024-03-04T12:41:19.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.194+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=SMUQIBF0SNJS tag=6QJ8RYYNIPHF type=write size=2413142 2024-03-04T12:41:19.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.195+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=IT6BE9QGMDKQ type=del size=2022348 2024-03-04T12:41:19.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.196+0000 7f093583d780 -1 < failed to complete operation key=NFM6LT89K5F4 tag=VOCIDVFRQDC7 type=del size=3093790: (22) Invalid argument 2024-03-04T12:41:19.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.198+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~S11SB1IJ0YPY.0 size=659714 2024-03-04T12:41:19.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.198+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=S11SB1IJ0YPY tag=BV30NWCYN7U0 type=write size=1708290 2024-03-04T12:41:19.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.199+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=X1MEVVAEWITO type=del 2024-03-04T12:41:19.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.200+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=0SRVB0QNYG1G type=del size=2006956 2024-03-04T12:41:19.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.202+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=DS9630U0SQFC type=del 2024-03-04T12:41:19.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.203+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=GOX6402OCAL0 type=del size=2323506 2024-03-04T12:41:19.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.204+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~KDF0ROOOQJAB.0 size=1048576 2024-03-04T12:41:19.210 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.205+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~KDF0ROOOQJAB.1 size=1048576 2024-03-04T12:41:19.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.206+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~KDF0ROOOQJAB.2 size=547653 2024-03-04T12:41:19.213 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.207+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=KDF0ROOOQJAB tag=PUJ8TSTPQXE8 type=write size=3693381 2024-03-04T12:41:19.214 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.208+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=XXJ7F5CK03HF type=del size=1455976 2024-03-04T12:41:19.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.210+0000 7f093583d780 1 < completed write operation key=2R5WA9Q9ZAUG tag=E3WUT0XFMC90 type=write size=169674 2024-03-04T12:41:19.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.211+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=XRN9P3MG7DJF type=del size=3655983 2024-03-04T12:41:19.218 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.213+0000 7f093583d780 1 < suggested remove operation key=2ZOV2JEQHXGS tag=X8G6L2T5EDHR type=del 2024-03-04T12:41:19.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.214+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=BHU3RYRSO862 type=del size=1974747 2024-03-04T12:41:19.221 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.215+0000 7f093583d780 -1 < failed to complete operation key=I6DIP4VGHMNO tag=5X2S14XWS3MQ type=del size=3342263: (22) Invalid argument 2024-03-04T12:41:19.222 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.216+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=1SO8J4DJBH6V type=del size=1526735 2024-03-04T12:41:19.223 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.217+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~YULOKHN86E7M.0 size=1048576 2024-03-04T12:41:19.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.218+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~YULOKHN86E7M.1 size=1048576 2024-03-04T12:41:19.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.218+0000 7f093583d780 1 < canceled part key=_multipart_9VKN43CB955V.2~YULOKHN86E7M.2 size=417670 2024-03-04T12:41:19.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.220+0000 7f093583d780 1 < canceled multipart upload key=9VKN43CB955V upload=YULOKHN86E7M tag=RTO2D9EGNM4N type=write size=3563398 2024-03-04T12:41:19.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.222+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=5KTF77OZ7W6A type=write size=516618 2024-03-04T12:41:19.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.223+0000 7f093583d780 1 < canceled operation key=9E12MS7PETOK tag=1V7YZ1N1FQNX type=del size=1937715 2024-03-04T12:41:19.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.224+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=TQH4EJDPS4OX type=del size=1775078 2024-03-04T12:41:19.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.225+0000 7f093583d780 -1 < failed to complete operation key=I6DIP4VGHMNO tag=W6SQK16J3XD6 type=del size=2079683: (22) Invalid argument 2024-03-04T12:41:19.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.226+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=APLJCI619877 type=write size=38577 2024-03-04T12:41:19.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.229+0000 7f093583d780 1 < suggested remove operation key=OFTWI7UFD5L5 tag=3FK35JOXZKDU type=del 2024-03-04T12:41:19.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.230+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=96HKP3LN8834 type=del size=2008420 2024-03-04T12:41:19.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.232+0000 7f093583d780 1 < suggested remove operation key=F269PJEZ05IO tag=6MYAT1MHRUFR type=del 2024-03-04T12:41:19.239 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.233+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=XSVFYZN4IWJY type=del size=392777 2024-03-04T12:41:19.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.234+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=N01D7QQ3UT14 type=del 2024-03-04T12:41:19.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.236+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~8CMDMO5TWGCT.0 size=772227 2024-03-04T12:41:19.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.236+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=8CMDMO5TWGCT tag=YFPKDPWR052E type=write size=1820803 2024-03-04T12:41:19.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.237+0000 7f093583d780 1 < completed delete operation key=NFM6LT89K5F4 tag=890EMJU4JMUZ type=del 2024-03-04T12:41:19.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.239+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=RTAAGBA81P6U type=del size=2897407 2024-03-04T12:41:19.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.240+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~1FV9QXWME1K8.0 size=1048576 2024-03-04T12:41:19.246 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.241+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~1FV9QXWME1K8.1 size=174334 2024-03-04T12:41:19.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.243+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=1FV9QXWME1K8 tag=RHLRWIYFZIZJ type=write size=2271486 2024-03-04T12:41:19.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.244+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=Q73B8AFDIMEK type=del size=1269369 2024-03-04T12:41:19.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.245+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=IT6BE9QGMDKQ type=del 2024-03-04T12:41:19.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.246+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=DQMB832USLTE type=del size=1875783 2024-03-04T12:41:19.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.247+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~S11SB1IJ0YPY.0 size=659714 2024-03-04T12:41:19.255 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.249+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=S11SB1IJ0YPY tag=BV30NWCYN7U0 type=write size=1708290 2024-03-04T12:41:19.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.250+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=YN1MXHEEC8TZ type=write size=612876 2024-03-04T12:41:19.257 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.252+0000 7f093583d780 1 < canceled operation key=96PTQ2KHPMMM tag=0SRVB0QNYG1G type=del size=2006956 2024-03-04T12:41:19.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.253+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=4BXRT320NMB5 type=del size=498297 2024-03-04T12:41:19.259 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.254+0000 7f093583d780 1 < completed delete operation key=NFM6LT89K5F4 tag=GOX6402OCAL0 type=del 2024-03-04T12:41:19.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.255+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=440Q3C7KOL7A type=del size=2968000 2024-03-04T12:41:19.264 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.258+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=XXJ7F5CK03HF type=del 2024-03-04T12:41:19.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.260+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~EHV37758RVDT.0 size=509730 2024-03-04T12:41:19.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.260+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=EHV37758RVDT tag=ZMV1D5G1UKO1 type=write size=1558306 2024-03-04T12:41:19.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.261+0000 7f093583d780 1 < canceled operation key=NFM6LT89K5F4 tag=XRN9P3MG7DJF type=del size=3655983 2024-03-04T12:41:19.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.263+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=V6EZAIQH9E80 type=del size=1957998 2024-03-04T12:41:19.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.264+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=BHU3RYRSO862 type=del 2024-03-04T12:41:19.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.265+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=W5TIYFE63C62 type=write size=531721 2024-03-04T12:41:19.272 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.266+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=1SO8J4DJBH6V type=del 2024-03-04T12:41:19.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.267+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=CS1EY4A75MRD type=del size=2414514 2024-03-04T12:41:19.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.269+0000 7f093583d780 1 < completed write operation key=J6Y9V11BX06B tag=5KTF77OZ7W6A type=write size=516618 2024-03-04T12:41:19.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.271+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~FXVPT1AMGQY5.0 size=1048576 2024-03-04T12:41:19.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.272+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~FXVPT1AMGQY5.1 size=166090 2024-03-04T12:41:19.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.272+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=FXVPT1AMGQY5 tag=BLQPW3PH02PZ type=write size=2263242 2024-03-04T12:41:19.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.273+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=TQH4EJDPS4OX type=del 2024-03-04T12:41:19.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.276+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=MT4BE46A7ESA type=del size=3485805 2024-03-04T12:41:19.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.278+0000 7f093583d780 1 < completed write operation key=GJ0FQ6EH9HJL tag=APLJCI619877 type=write size=38577 2024-03-04T12:41:19.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.280+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~RD1ET83N2BEA.0 size=1048576 2024-03-04T12:41:19.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.281+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~RD1ET83N2BEA.1 size=1048576 2024-03-04T12:41:19.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.282+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~RD1ET83N2BEA.2 size=117131 2024-03-04T12:41:19.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.282+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=RD1ET83N2BEA tag=LIDREHPR2XU8 type=write size=3262859 2024-03-04T12:41:19.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.283+0000 7f093583d780 1 < canceled operation key=AQI7H63EQSTN tag=96HKP3LN8834 type=del size=2008420 2024-03-04T12:41:19.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.284+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=BGM6WGTFRFPR type=del size=2170868 2024-03-04T12:41:19.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.285+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=XSVFYZN4IWJY type=del 2024-03-04T12:41:19.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.287+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~OXP5TBOGSQ3K.0 size=1048576 2024-03-04T12:41:19.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.288+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~OXP5TBOGSQ3K.1 size=14818 2024-03-04T12:41:19.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.288+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=OXP5TBOGSQ3K tag=O03JNQ7TXCTU type=write size=2111970 2024-03-04T12:41:19.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.289+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~8CMDMO5TWGCT.0 size=772227 2024-03-04T12:41:19.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.293+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=8CMDMO5TWGCT tag=YFPKDPWR052E type=write size=1820803 2024-03-04T12:41:19.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.294+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=ZCACZF838BGL type=del size=571727 2024-03-04T12:41:19.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.295+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=RTAAGBA81P6U type=del 2024-03-04T12:41:19.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.297+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~7D0WRNBPG8M9.0 size=1048576 2024-03-04T12:41:19.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.298+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~7D0WRNBPG8M9.1 size=415402 2024-03-04T12:41:19.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.298+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=7D0WRNBPG8M9 tag=YOPPXWVPZA9I type=write size=2512554 2024-03-04T12:41:19.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.300+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=Q73B8AFDIMEK type=del 2024-03-04T12:41:19.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.301+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=GVQM64L93VA4 type=del size=1139240 2024-03-04T12:41:19.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.303+0000 7f093583d780 1 < suggested update operation key=9E12MS7PETOK tag=DQMB832USLTE type=del size=1875783 2024-03-04T12:41:19.310 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.305+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=UQZYCRV2KRTA type=del size=1530846 2024-03-04T12:41:19.313 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.307+0000 7f093583d780 1 < suggested remove operation key=Y4D4Q7NV5VMO tag=YN1MXHEEC8TZ type=write 2024-03-04T12:41:19.314 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.308+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=WIIV8289OJC3 type=del size=3647712 2024-03-04T12:41:19.316 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.311+0000 7f093583d780 1 < suggested remove operation key=J6Y9V11BX06B tag=4BXRT320NMB5 type=del 2024-03-04T12:41:19.318 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.313+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~QOZU24CDE6YW.0 size=921144 2024-03-04T12:41:19.318 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.313+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=QOZU24CDE6YW tag=F33VI34L4RLC type=write size=1969720 2024-03-04T12:41:19.319 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.314+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=440Q3C7KOL7A type=del 2024-03-04T12:41:19.322 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.316+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~4ABM8ADKAJOU.0 size=227448 2024-03-04T12:41:19.322 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.316+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=4ABM8ADKAJOU tag=U4O2HLHK44B8 type=write size=1276024 2024-03-04T12:41:19.323 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.317+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~EHV37758RVDT.0 size=509730 2024-03-04T12:41:19.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.319+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=EHV37758RVDT tag=ZMV1D5G1UKO1 type=write size=1558306 2024-03-04T12:41:19.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.320+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=FHYYD3BWLT63 type=del size=1745297 2024-03-04T12:41:19.327 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.321+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=V6EZAIQH9E80 type=del 2024-03-04T12:41:19.328 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.322+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=8YHD1XEZO8D5 type=del size=3286755 2024-03-04T12:41:19.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.323+0000 7f093583d780 1 < completed write operation key=2XVNK3YEVHJ7 tag=W5TIYFE63C62 type=write size=531721 2024-03-04T12:41:19.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.324+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=2YHV2HKA80TU type=del size=822503 2024-03-04T12:41:19.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.326+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=CS1EY4A75MRD type=del 2024-03-04T12:41:19.332 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.327+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=UCU3JVBHVYR9 type=del size=2084331 2024-03-04T12:41:19.334 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.328+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~FXVPT1AMGQY5.0 size=1048576 2024-03-04T12:41:19.334 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.329+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~FXVPT1AMGQY5.1 size=166090 2024-03-04T12:41:19.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.330+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=FXVPT1AMGQY5 tag=BLQPW3PH02PZ type=write size=2263242 2024-03-04T12:41:19.337 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.332+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=HN5AM02OY9J1 type=del size=129037 2024-03-04T12:41:19.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.333+0000 7f093583d780 1 < canceled operation key=I5NQBROT0WKE tag=MT4BE46A7ESA type=del size=3485805 2024-03-04T12:41:19.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.334+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=JXW94UJ3TV5S type=del size=1636018 2024-03-04T12:41:19.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.335+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~RD1ET83N2BEA.0 size=1048576 2024-03-04T12:41:19.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.335+0000 7f093583d780 1 < canceled part key=_multipart_GMKM2QEP072H.2~RD1ET83N2BEA.1 size=1048576 2024-03-04T12:41:19.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.336+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~RD1ET83N2BEA.2 size=117131 2024-03-04T12:41:19.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.338+0000 7f093583d780 1 < canceled multipart upload key=GMKM2QEP072H upload=RD1ET83N2BEA tag=LIDREHPR2XU8 type=write size=3262859 2024-03-04T12:41:19.345 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.339+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=DV7ADIXH3FYE type=del size=2031058 2024-03-04T12:41:19.346 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.340+0000 7f093583d780 1 < completed delete operation key=NFM6LT89K5F4 tag=BGM6WGTFRFPR type=del 2024-03-04T12:41:19.347 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.341+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=OE8MOSMHENDW type=del size=2529351 2024-03-04T12:41:19.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.342+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~OXP5TBOGSQ3K.0 size=1048576 2024-03-04T12:41:19.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.343+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~OXP5TBOGSQ3K.1 size=14818 2024-03-04T12:41:19.351 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.345+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=OXP5TBOGSQ3K tag=O03JNQ7TXCTU type=write size=2111970 2024-03-04T12:41:19.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.346+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=6N3RPBRZ5DW3 type=del size=1574 2024-03-04T12:41:19.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.348+0000 7f093583d780 1 < suggested remove operation key=54FLC10FWKL6 tag=ZCACZF838BGL type=del 2024-03-04T12:41:19.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.351+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~5R6PUM243FY8.0 size=656300 2024-03-04T12:41:19.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.351+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=5R6PUM243FY8 tag=FIQOZ2EXBOFT type=write size=1704876 2024-03-04T12:41:19.357 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.352+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~7D0WRNBPG8M9.0 size=1048576 2024-03-04T12:41:19.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.353+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~7D0WRNBPG8M9.1 size=415402 2024-03-04T12:41:19.360 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.355+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=7D0WRNBPG8M9 tag=YOPPXWVPZA9I type=write size=2512554 2024-03-04T12:41:19.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.356+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=Y8B9CMNKYU9H type=del size=4022304 2024-03-04T12:41:19.364 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.358+0000 7f093583d780 1 < suggested remove operation key=UAEQORB3BDBH tag=GVQM64L93VA4 type=del 2024-03-04T12:41:19.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.360+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=6V50PQGBPHWL type=del size=2347819 2024-03-04T12:41:19.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.361+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=UQZYCRV2KRTA type=del 2024-03-04T12:41:19.369 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.364+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~3LCE9T53WDAI.0 size=1048576 2024-03-04T12:41:19.370 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.364+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~3LCE9T53WDAI.1 size=1048576 2024-03-04T12:41:19.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.366+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~3LCE9T53WDAI.2 size=654747 2024-03-04T12:41:19.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.366+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=3LCE9T53WDAI tag=DAYVNSM1A64V type=write size=3800475 2024-03-04T12:41:19.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.368+0000 7f093583d780 1 < suggested update operation key=L4UQK3UJFXZC tag=WIIV8289OJC3 type=del size=3647712 2024-03-04T12:41:19.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.369+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=MKVCH63Z72QG type=write size=596780 2024-03-04T12:41:19.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.370+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~QOZU24CDE6YW.0 size=921144 2024-03-04T12:41:19.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.372+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=QOZU24CDE6YW tag=F33VI34L4RLC type=write size=1969720 2024-03-04T12:41:19.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.374+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=WV0BANLFLIJ0 type=del size=762023 2024-03-04T12:41:19.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.375+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~4ABM8ADKAJOU.0 size=227448 2024-03-04T12:41:19.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.377+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=4ABM8ADKAJOU tag=U4O2HLHK44B8 type=write size=1276024 2024-03-04T12:41:19.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.378+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=OKV4SLXRW41W type=del size=3138610 2024-03-04T12:41:19.385 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.380+0000 7f093583d780 1 < suggested update operation key=FT2XNJYYT30J tag=FHYYD3BWLT63 type=del size=1745297 2024-03-04T12:41:19.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.382+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~K7JLRQK3CE3L.0 size=1048576 2024-03-04T12:41:19.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.383+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~K7JLRQK3CE3L.1 size=12582 2024-03-04T12:41:19.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.383+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=K7JLRQK3CE3L tag=3ESYT27SOO6I type=write size=2109734 2024-03-04T12:41:19.389 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.384+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=8YHD1XEZO8D5 type=del 2024-03-04T12:41:19.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.385+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=VLP8JG9Q6VQJ type=write size=853080 2024-03-04T12:41:19.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.386+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=2YHV2HKA80TU type=del 2024-03-04T12:41:19.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.389+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~T7IDTOUTHJOH.0 size=1048576 2024-03-04T12:41:19.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.390+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~T7IDTOUTHJOH.1 size=1048576 2024-03-04T12:41:19.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.391+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~T7IDTOUTHJOH.2 size=872155 2024-03-04T12:41:19.397 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.391+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=T7IDTOUTHJOH tag=X6Z7K4U8O6R5 type=write size=4017883 2024-03-04T12:41:19.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.392+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=UCU3JVBHVYR9 type=del 2024-03-04T12:41:19.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.394+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~QB33AGOUV0FZ.0 size=1048576 2024-03-04T12:41:19.401 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.395+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~QB33AGOUV0FZ.1 size=811128 2024-03-04T12:41:19.401 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.395+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=QB33AGOUV0FZ tag=4SU3NE1PQ12H type=write size=2908280 2024-03-04T12:41:19.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.396+0000 7f093583d780 1 < canceled operation key=3F8GI0JCUR6W tag=HN5AM02OY9J1 type=del size=129037 2024-03-04T12:41:19.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.397+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=TYK47CEMYP3B type=del size=735923 2024-03-04T12:41:19.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.399+0000 7f093583d780 1 < suggested update operation key=9VKN43CB955V tag=JXW94UJ3TV5S type=del size=1636018 2024-03-04T12:41:19.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.401+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~ZIDRXTSJ2U6L.0 size=519881 2024-03-04T12:41:19.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.401+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=ZIDRXTSJ2U6L tag=PVBOK3GVVLLU type=write size=1568457 2024-03-04T12:41:19.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.402+0000 7f093583d780 -1 < failed to complete operation key=UAEQORB3BDBH tag=DV7ADIXH3FYE type=del size=2031058: (22) Invalid argument 2024-03-04T12:41:19.410 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.405+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~YC39UMEGINXK.0 size=1048576 2024-03-04T12:41:19.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.405+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~YC39UMEGINXK.1 size=314038 2024-03-04T12:41:19.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.405+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=YC39UMEGINXK tag=J7K7M9P38T3C type=write size=2411190 2024-03-04T12:41:19.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.407+0000 7f093583d780 1 < canceled operation key=9E12MS7PETOK tag=OE8MOSMHENDW type=del size=2529351 2024-03-04T12:41:19.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.408+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=BRRT4A2WCHEC type=write size=715100 2024-03-04T12:41:19.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.409+0000 7f093583d780 1 < completed delete operation key=AQI7H63EQSTN tag=6N3RPBRZ5DW3 type=del 2024-03-04T12:41:19.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.410+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=14WGMZVFW66B type=del size=3651320 2024-03-04T12:41:19.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.411+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~5R6PUM243FY8.0 size=656300 2024-03-04T12:41:19.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.413+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=5R6PUM243FY8 tag=FIQOZ2EXBOFT type=write size=1704876 2024-03-04T12:41:19.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.414+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=2E220N37BIWR type=del size=102751 2024-03-04T12:41:19.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.415+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=Y8B9CMNKYU9H type=del 2024-03-04T12:41:19.422 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.417+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~Y181POR9L24B.0 size=1048576 2024-03-04T12:41:19.423 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.418+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~Y181POR9L24B.1 size=356859 2024-03-04T12:41:19.423 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.418+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=Y181POR9L24B tag=8WUCT2FCNZKV type=write size=2454011 2024-03-04T12:41:19.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.420+0000 7f093583d780 1 < suggested remove operation key=9VKN43CB955V tag=6V50PQGBPHWL type=del 2024-03-04T12:41:19.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.421+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=NALS8UW84XSU type=del size=3130001 2024-03-04T12:41:19.427 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.422+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~3LCE9T53WDAI.0 size=1048576 2024-03-04T12:41:19.428 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.423+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~3LCE9T53WDAI.1 size=1048576 2024-03-04T12:41:19.429 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.424+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~3LCE9T53WDAI.2 size=654747 2024-03-04T12:41:19.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.426+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=3LCE9T53WDAI tag=DAYVNSM1A64V type=write size=3800475 2024-03-04T12:41:19.432 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.427+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=5EB0BRG1IMY2 type=del size=1185381 2024-03-04T12:41:19.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.428+0000 7f093583d780 1 < completed write operation key=O6OUISHWZ7FU tag=MKVCH63Z72QG type=write size=596780 2024-03-04T12:41:19.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.429+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=YK84Y9ILW3OZ type=write size=322981 2024-03-04T12:41:19.436 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.431+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=WV0BANLFLIJ0 type=del 2024-03-04T12:41:19.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.433+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~M604WUDHHH39.0 size=1048576 2024-03-04T12:41:19.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.434+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~M604WUDHHH39.1 size=1048576 2024-03-04T12:41:19.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.434+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~M604WUDHHH39.2 size=781637 2024-03-04T12:41:19.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.434+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=M604WUDHHH39 tag=WCFG7HEDCEFH type=write size=3927365 2024-03-04T12:41:19.441 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.436+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=OKV4SLXRW41W type=del 2024-03-04T12:41:19.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.438+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~M6VDGX23TNFG.0 size=1048576 2024-03-04T12:41:19.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.439+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~M6VDGX23TNFG.1 size=1048576 2024-03-04T12:41:19.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.440+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~M6VDGX23TNFG.2 size=200168 2024-03-04T12:41:19.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.440+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=M6VDGX23TNFG tag=W67YSWB32Y3P type=write size=3345896 2024-03-04T12:41:19.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.441+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~K7JLRQK3CE3L.0 size=1048576 2024-03-04T12:41:19.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.442+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~K7JLRQK3CE3L.1 size=12582 2024-03-04T12:41:19.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.444+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=K7JLRQK3CE3L tag=3ESYT27SOO6I type=write size=2109734 2024-03-04T12:41:19.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.446+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~GBP6IU036MR6.0 size=934853 2024-03-04T12:41:19.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.446+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=GBP6IU036MR6 tag=ZMCCJPF8CGGX type=write size=1983429 2024-03-04T12:41:19.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.448+0000 7f093583d780 1 < suggested remove operation key=96PTQ2KHPMMM tag=VLP8JG9Q6VQJ type=write 2024-03-04T12:41:19.454 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.449+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=X0I04WPFD2T5 type=del size=84228 2024-03-04T12:41:19.455 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.450+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~T7IDTOUTHJOH.0 size=1048576 2024-03-04T12:41:19.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.451+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~T7IDTOUTHJOH.1 size=1048576 2024-03-04T12:41:19.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.452+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~T7IDTOUTHJOH.2 size=872155 2024-03-04T12:41:19.459 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.454+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=T7IDTOUTHJOH tag=X6Z7K4U8O6R5 type=write size=4017883 2024-03-04T12:41:19.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.456+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~2YIJJOC8DCRX.0 size=1048576 2024-03-04T12:41:19.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.457+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~2YIJJOC8DCRX.1 size=1048576 2024-03-04T12:41:19.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.458+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~2YIJJOC8DCRX.2 size=458528 2024-03-04T12:41:19.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.458+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=2YIJJOC8DCRX tag=FRTDEHZIXEWC type=write size=3604256 2024-03-04T12:41:19.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.459+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~QB33AGOUV0FZ.0 size=1048576 2024-03-04T12:41:19.465 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.460+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~QB33AGOUV0FZ.1 size=811128 2024-03-04T12:41:19.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.461+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=QB33AGOUV0FZ tag=4SU3NE1PQ12H type=write size=2908280 2024-03-04T12:41:19.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.463+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=P8GTI4TCIF05 type=del size=3423226 2024-03-04T12:41:19.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.464+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=TYK47CEMYP3B type=del 2024-03-04T12:41:19.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.465+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=TGBOWWBP1Z01 type=write size=604631 2024-03-04T12:41:19.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.465+0000 7f093583d780 1 < canceled part key=_multipart_3F8GI0JCUR6W.2~ZIDRXTSJ2U6L.0 size=519881 2024-03-04T12:41:19.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.473+0000 7f093583d780 1 < canceled multipart upload key=3F8GI0JCUR6W upload=ZIDRXTSJ2U6L tag=PVBOK3GVVLLU type=write size=1568457 2024-03-04T12:41:19.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.476+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~K67B2DAE0UK8.0 size=1048576 2024-03-04T12:41:19.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.476+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~K67B2DAE0UK8.1 size=1048576 2024-03-04T12:41:19.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.477+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~K67B2DAE0UK8.2 size=1019495 2024-03-04T12:41:19.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.477+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=K67B2DAE0UK8 tag=YUJUVG9C566X type=write size=4165223 2024-03-04T12:41:19.484 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.479+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~YC39UMEGINXK.0 size=1048576 2024-03-04T12:41:19.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.480+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~YC39UMEGINXK.1 size=314038 2024-03-04T12:41:19.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.482+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=YC39UMEGINXK tag=J7K7M9P38T3C type=write size=2411190 2024-03-04T12:41:19.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.483+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=K9UU2SLD2HTG type=del size=999213 2024-03-04T12:41:19.491 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.485+0000 7f093583d780 1 < suggested update operation key=GJ0FQ6EH9HJL tag=BRRT4A2WCHEC type=write size=715100 2024-03-04T12:41:19.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.486+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=OCQH70MZOAKO type=del size=4192516 2024-03-04T12:41:19.493 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.488+0000 7f093583d780 1 < canceled operation key=NQF43I07F2HT tag=14WGMZVFW66B type=del size=3651320 2024-03-04T12:41:19.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.490+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~HJZCJHX6DJLY.0 size=1029492 2024-03-04T12:41:19.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.490+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=HJZCJHX6DJLY tag=ZTKIFGEN54AW type=write size=2078068 2024-03-04T12:41:19.496 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.491+0000 7f093583d780 -1 < failed to complete operation key=GJ0FQ6EH9HJL tag=2E220N37BIWR type=del size=102751: (22) Invalid argument 2024-03-04T12:41:19.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.493+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~CCOFYNX1ZK95.0 size=1048576 2024-03-04T12:41:19.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.494+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~CCOFYNX1ZK95.1 size=1048576 2024-03-04T12:41:19.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.495+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~CCOFYNX1ZK95.2 size=90533 2024-03-04T12:41:19.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.495+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=CCOFYNX1ZK95 tag=C0PWADD8CI6G type=write size=3236261 2024-03-04T12:41:19.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.496+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~Y181POR9L24B.0 size=1048576 2024-03-04T12:41:19.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.496+0000 7f093583d780 1 < canceled part key=_multipart_NFM6LT89K5F4.2~Y181POR9L24B.1 size=356859 2024-03-04T12:41:19.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.499+0000 7f093583d780 1 < canceled multipart upload key=NFM6LT89K5F4 upload=Y181POR9L24B tag=8WUCT2FCNZKV type=write size=2454011 2024-03-04T12:41:19.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.502+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~BRZY1D03W7XZ.0 size=1048576 2024-03-04T12:41:19.508 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.503+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~BRZY1D03W7XZ.1 size=263760 2024-03-04T12:41:19.509 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.503+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=BRZY1D03W7XZ tag=KOAOINT0YMN1 type=write size=2360912 2024-03-04T12:41:19.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.504+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=NALS8UW84XSU type=del 2024-03-04T12:41:19.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.506+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~VOOX0C0UDAJ4.0 size=1048576 2024-03-04T12:41:19.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.507+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~VOOX0C0UDAJ4.1 size=1048576 2024-03-04T12:41:19.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.508+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~VOOX0C0UDAJ4.2 size=434798 2024-03-04T12:41:19.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.508+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=VOOX0C0UDAJ4 tag=2A49LDGA7GIM type=write size=3580526 2024-03-04T12:41:19.514 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.509+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=5EB0BRG1IMY2 type=del 2024-03-04T12:41:19.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.511+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~4P4OUHDMGTBM.0 size=1048576 2024-03-04T12:41:19.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.512+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~4P4OUHDMGTBM.1 size=1048576 2024-03-04T12:41:19.518 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.513+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~4P4OUHDMGTBM.2 size=532580 2024-03-04T12:41:19.518 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.513+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=4P4OUHDMGTBM tag=EV7ZFWU89NFV type=write size=3678308 2024-03-04T12:41:19.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.514+0000 7f093583d780 1 < completed write operation key=PT63VLFQQN0E tag=YK84Y9ILW3OZ type=write size=322981 2024-03-04T12:41:19.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.515+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=5N39I0R29PGW type=del size=3167760 2024-03-04T12:41:19.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.517+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~M604WUDHHH39.0 size=1048576 2024-03-04T12:41:19.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.517+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~M604WUDHHH39.1 size=1048576 2024-03-04T12:41:19.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.518+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~M604WUDHHH39.2 size=781637 2024-03-04T12:41:19.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.520+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=M604WUDHHH39 tag=WCFG7HEDCEFH type=write size=3927365 2024-03-04T12:41:19.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.521+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=LVWY9GE04OP0 type=del size=340914 2024-03-04T12:41:19.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.523+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~M6VDGX23TNFG.0 size=1048576 2024-03-04T12:41:19.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.524+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~M6VDGX23TNFG.1 size=1048576 2024-03-04T12:41:19.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.524+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~M6VDGX23TNFG.2 size=200168 2024-03-04T12:41:19.532 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.526+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=M6VDGX23TNFG tag=W67YSWB32Y3P type=write size=3345896 2024-03-04T12:41:19.533 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.527+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=ESKCAXVSTWZ3 type=del size=3823532 2024-03-04T12:41:19.534 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.529+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~GBP6IU036MR6.0 size=934853 2024-03-04T12:41:19.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.530+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=GBP6IU036MR6 tag=ZMCCJPF8CGGX type=write size=1983429 2024-03-04T12:41:19.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.531+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=LYEAZNHRJ277 type=write size=775517 2024-03-04T12:41:19.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.533+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=X0I04WPFD2T5 type=del 2024-03-04T12:41:19.539 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.534+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=A8VG5HVGRUIY type=del size=1841830 2024-03-04T12:41:19.540 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.535+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~2YIJJOC8DCRX.0 size=1048576 2024-03-04T12:41:19.541 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.535+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~2YIJJOC8DCRX.1 size=1048576 2024-03-04T12:41:19.542 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.536+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~2YIJJOC8DCRX.2 size=458528 2024-03-04T12:41:19.544 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.538+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=2YIJJOC8DCRX tag=FRTDEHZIXEWC type=write size=3604256 2024-03-04T12:41:19.546 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.540+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~4583PB4EKMRE.0 size=1048576 2024-03-04T12:41:19.547 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.541+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~4583PB4EKMRE.1 size=332817 2024-03-04T12:41:19.547 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.541+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=4583PB4EKMRE tag=K5BEWD5P1ZBY type=write size=2429969 2024-03-04T12:41:19.549 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.543+0000 7f093583d780 1 < suggested update operation key=I5NQBROT0WKE tag=P8GTI4TCIF05 type=del size=3423226 2024-03-04T12:41:19.551 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.545+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~IJ4XTEIJ8K5W.0 size=1048576 2024-03-04T12:41:19.552 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.546+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~IJ4XTEIJ8K5W.1 size=1048576 2024-03-04T12:41:19.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.547+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~IJ4XTEIJ8K5W.2 size=809421 2024-03-04T12:41:19.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.547+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=IJ4XTEIJ8K5W tag=EFUM3RIB0EHR type=write size=3955149 2024-03-04T12:41:19.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.548+0000 7f093583d780 1 < completed write operation key=Y4D4Q7NV5VMO tag=TGBOWWBP1Z01 type=write size=604631 2024-03-04T12:41:19.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.549+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=0OTMM3ZIIUJS type=del size=3880740 2024-03-04T12:41:19.556 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.550+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~K67B2DAE0UK8.0 size=1048576 2024-03-04T12:41:19.556 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.550+0000 7f093583d780 1 < canceled part key=_multipart_Y4D4Q7NV5VMO.2~K67B2DAE0UK8.1 size=1048576 2024-03-04T12:41:19.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.551+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~K67B2DAE0UK8.2 size=1019495 2024-03-04T12:41:19.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.553+0000 7f093583d780 1 < canceled multipart upload key=Y4D4Q7NV5VMO upload=K67B2DAE0UK8 tag=YUJUVG9C566X type=write size=4165223 2024-03-04T12:41:19.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.555+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~CA9BNX36NXZX.0 size=516138 2024-03-04T12:41:19.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.555+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=CA9BNX36NXZX tag=KE40L31RXGGV type=write size=1564714 2024-03-04T12:41:19.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.556+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=K9UU2SLD2HTG type=del 2024-03-04T12:41:19.564 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.558+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~Y8UWJGNQ60CI.0 size=246453 2024-03-04T12:41:19.564 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.558+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=Y8UWJGNQ60CI tag=TILP3EWKWG3D type=write size=1295029 2024-03-04T12:41:19.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.561+0000 7f093583d780 1 < suggested update operation key=FT2XNJYYT30J tag=OCQH70MZOAKO type=del size=4192516 2024-03-04T12:41:19.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.562+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=AJNIGQE3AXSA type=del size=1451593 2024-03-04T12:41:19.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.563+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~HJZCJHX6DJLY.0 size=1029492 2024-03-04T12:41:19.570 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.565+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=HJZCJHX6DJLY tag=ZTKIFGEN54AW type=write size=2078068 2024-03-04T12:41:19.571 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.566+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=JN9MOPO0MR7Z type=del size=2669724 2024-03-04T12:41:19.573 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.567+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~CCOFYNX1ZK95.0 size=1048576 2024-03-04T12:41:19.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.568+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~CCOFYNX1ZK95.1 size=1048576 2024-03-04T12:41:19.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.568+0000 7f093583d780 1 < canceled part key=_multipart_J6Y9V11BX06B.2~CCOFYNX1ZK95.2 size=90533 2024-03-04T12:41:19.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.571+0000 7f093583d780 1 < canceled multipart upload key=J6Y9V11BX06B upload=CCOFYNX1ZK95 tag=C0PWADD8CI6G type=write size=3236261 2024-03-04T12:41:19.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.573+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~K03RD1O6YGQM.0 size=836982 2024-03-04T12:41:19.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.573+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=K03RD1O6YGQM tag=YYGIP4HJ2QP3 type=write size=1885558 2024-03-04T12:41:19.579 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.574+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~BRZY1D03W7XZ.0 size=1048576 2024-03-04T12:41:19.580 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.575+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~BRZY1D03W7XZ.1 size=263760 2024-03-04T12:41:19.582 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.577+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=BRZY1D03W7XZ tag=KOAOINT0YMN1 type=write size=2360912 2024-03-04T12:41:19.584 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.578+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=3ATTYHDS8SO0 type=del size=1169504 2024-03-04T12:41:19.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.579+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~VOOX0C0UDAJ4.0 size=1048576 2024-03-04T12:41:19.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.580+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~VOOX0C0UDAJ4.1 size=1048576 2024-03-04T12:41:19.587 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.581+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~VOOX0C0UDAJ4.2 size=434798 2024-03-04T12:41:19.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.584+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=VOOX0C0UDAJ4 tag=2A49LDGA7GIM type=write size=3580526 2024-03-04T12:41:19.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.585+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=EUOTMZR23TIE type=del size=631217 2024-03-04T12:41:19.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.586+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~4P4OUHDMGTBM.0 size=1048576 2024-03-04T12:41:19.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.587+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~4P4OUHDMGTBM.1 size=1048576 2024-03-04T12:41:19.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.588+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~4P4OUHDMGTBM.2 size=532580 2024-03-04T12:41:19.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.590+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=4P4OUHDMGTBM tag=EV7ZFWU89NFV type=write size=3678308 2024-03-04T12:41:19.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.591+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=GQMVGDXV1M30 type=del size=2438945 2024-03-04T12:41:19.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.593+0000 7f093583d780 1 < canceled operation key=9E12MS7PETOK tag=5N39I0R29PGW type=del size=3167760 2024-03-04T12:41:19.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.595+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~B7WGZNQ8CAT9.0 size=394718 2024-03-04T12:41:19.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.595+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=B7WGZNQ8CAT9 tag=23AUJRJN7XHN type=write size=1443294 2024-03-04T12:41:19.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.598+0000 7f093583d780 1 < suggested update operation key=9VKN43CB955V tag=LVWY9GE04OP0 type=del size=340914 2024-03-04T12:41:19.604 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.599+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=0KUV9CY94D8B type=del size=3061553 2024-03-04T12:41:19.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.600+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=ESKCAXVSTWZ3 type=del 2024-03-04T12:41:19.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.603+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~KAU4ZLCWXV4D.0 size=737513 2024-03-04T12:41:19.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.603+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=KAU4ZLCWXV4D tag=SU93VL5R4EKU type=write size=1786089 2024-03-04T12:41:19.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.604+0000 7f093583d780 1 < canceled operation key=Q45PKXZVJ6YS tag=LYEAZNHRJ277 type=write size=775517 2024-03-04T12:41:19.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.605+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=MWJWHA2UQWDR type=del size=4103530 2024-03-04T12:41:19.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.608+0000 7f093583d780 1 < suggested update operation key=HG0EM344TJZY tag=A8VG5HVGRUIY type=del size=1841830 2024-03-04T12:41:19.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.610+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~O80A38I5V9MH.0 size=1048576 2024-03-04T12:41:19.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.611+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~O80A38I5V9MH.1 size=1048576 2024-03-04T12:41:19.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.612+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~O80A38I5V9MH.2 size=247250 2024-03-04T12:41:19.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.612+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=O80A38I5V9MH tag=K8WQB7Q2XHLL type=write size=3392978 2024-03-04T12:41:19.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.613+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~4583PB4EKMRE.0 size=1048576 2024-03-04T12:41:19.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.614+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~4583PB4EKMRE.1 size=332817 2024-03-04T12:41:19.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.616+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=4583PB4EKMRE tag=K5BEWD5P1ZBY type=write size=2429969 2024-03-04T12:41:19.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.618+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~DXTZLZL1L506.0 size=389339 2024-03-04T12:41:19.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.618+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=DXTZLZL1L506 tag=3OUGF5IQPJNW type=write size=1437915 2024-03-04T12:41:19.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.619+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~IJ4XTEIJ8K5W.0 size=1048576 2024-03-04T12:41:19.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.620+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~IJ4XTEIJ8K5W.1 size=1048576 2024-03-04T12:41:19.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.621+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~IJ4XTEIJ8K5W.2 size=809421 2024-03-04T12:41:19.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.623+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=IJ4XTEIJ8K5W tag=EFUM3RIB0EHR type=write size=3955149 2024-03-04T12:41:19.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.624+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=RWFXSK2ZRQB5 type=write size=298189 2024-03-04T12:41:19.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.626+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=0OTMM3ZIIUJS type=del 2024-03-04T12:41:19.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.628+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~WWPJESYRITX4.0 size=595932 2024-03-04T12:41:19.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.628+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=WWPJESYRITX4 tag=EXK4298Q8DUA type=write size=1644508 2024-03-04T12:41:19.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.629+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~CA9BNX36NXZX.0 size=516138 2024-03-04T12:41:19.636 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.631+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=CA9BNX36NXZX tag=KE40L31RXGGV type=write size=1564714 2024-03-04T12:41:19.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.633+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~PFELK5R3GOV0.0 size=623671 2024-03-04T12:41:19.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.633+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=PFELK5R3GOV0 tag=QPWM8WNLXYDG type=write size=1672247 2024-03-04T12:41:19.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.634+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~Y8UWJGNQ60CI.0 size=246453 2024-03-04T12:41:19.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.636+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=Y8UWJGNQ60CI tag=TILP3EWKWG3D type=write size=1295029 2024-03-04T12:41:19.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.638+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=UN5O2BRTSWTE type=del size=3550822 2024-03-04T12:41:19.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.639+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=AJNIGQE3AXSA type=del 2024-03-04T12:41:19.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.642+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~FVJ5KW8DBSK7.0 size=1048576 2024-03-04T12:41:19.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.643+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~FVJ5KW8DBSK7.1 size=547247 2024-03-04T12:41:19.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.643+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=FVJ5KW8DBSK7 tag=SXGEJE9TC3YW type=write size=2644399 2024-03-04T12:41:19.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.645+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=JN9MOPO0MR7Z type=del 2024-03-04T12:41:19.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.647+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~M23JS8SQW43H.0 size=275124 2024-03-04T12:41:19.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.647+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=M23JS8SQW43H tag=S68TAZ7QH7Q4 type=write size=1323700 2024-03-04T12:41:19.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.648+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~K03RD1O6YGQM.0 size=836982 2024-03-04T12:41:19.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.650+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=K03RD1O6YGQM tag=YYGIP4HJ2QP3 type=write size=1885558 2024-03-04T12:41:19.658 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.652+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~03332MA9R2ZL.0 size=1048576 2024-03-04T12:41:19.658 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.653+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~03332MA9R2ZL.1 size=1048576 2024-03-04T12:41:19.659 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.654+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~03332MA9R2ZL.2 size=894989 2024-03-04T12:41:19.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.654+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=03332MA9R2ZL tag=7B427H5MAO1I type=write size=4040717 2024-03-04T12:41:19.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.655+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=3ATTYHDS8SO0 type=del 2024-03-04T12:41:19.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.657+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~R36TP16P8167.0 size=386503 2024-03-04T12:41:19.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.657+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=R36TP16P8167 tag=BVWG1VLLVAZ7 type=write size=1435079 2024-03-04T12:41:19.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.659+0000 7f093583d780 1 < suggested remove operation key=YJXFSO53QVPS tag=EUOTMZR23TIE type=del 2024-03-04T12:41:19.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.661+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=YGES1DLDZJEU type=write size=191291 2024-03-04T12:41:19.668 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.662+0000 7f093583d780 1 < canceled operation key=PT63VLFQQN0E tag=GQMVGDXV1M30 type=del size=2438945 2024-03-04T12:41:19.669 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.663+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=VKWH3C6J3XB8 type=del size=1083093 2024-03-04T12:41:19.670 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.664+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~B7WGZNQ8CAT9.0 size=394718 2024-03-04T12:41:19.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.666+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=B7WGZNQ8CAT9 tag=23AUJRJN7XHN type=write size=1443294 2024-03-04T12:41:19.673 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.667+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=OKF1I1OBRT10 type=write size=951053 2024-03-04T12:41:19.674 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.668+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=0KUV9CY94D8B type=del 2024-03-04T12:41:19.676 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.670+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~M60MD6N84K72.0 size=1048576 2024-03-04T12:41:19.676 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.671+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~M60MD6N84K72.1 size=1048576 2024-03-04T12:41:19.677 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.672+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~M60MD6N84K72.2 size=287787 2024-03-04T12:41:19.677 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.672+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=M60MD6N84K72 tag=Q2ZOXI3XTY9S type=write size=3433515 2024-03-04T12:41:19.678 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.673+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~KAU4ZLCWXV4D.0 size=737513 2024-03-04T12:41:19.680 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.675+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=KAU4ZLCWXV4D tag=SU93VL5R4EKU type=write size=1786089 2024-03-04T12:41:19.681 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.676+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=NUG4AE5V2W7K type=del size=705086 2024-03-04T12:41:19.682 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.677+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=MWJWHA2UQWDR type=del 2024-03-04T12:41:19.684 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.678+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=YRFMXXYQDBPS type=write size=258697 2024-03-04T12:41:19.685 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.679+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~O80A38I5V9MH.0 size=1048576 2024-03-04T12:41:19.686 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.680+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~O80A38I5V9MH.1 size=1048576 2024-03-04T12:41:19.687 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.681+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~O80A38I5V9MH.2 size=247250 2024-03-04T12:41:19.689 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.683+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=O80A38I5V9MH tag=K8WQB7Q2XHLL type=write size=3392978 2024-03-04T12:41:19.690 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.684+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=MDZB9JC4FY45 type=del size=894133 2024-03-04T12:41:19.691 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.685+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~DXTZLZL1L506.0 size=389339 2024-03-04T12:41:19.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.687+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=DXTZLZL1L506 tag=3OUGF5IQPJNW type=write size=1437915 2024-03-04T12:41:19.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.689+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=RWQQ7T08QP9F type=del size=739329 2024-03-04T12:41:19.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.690+0000 7f093583d780 1 < completed write operation key=J6Y9V11BX06B tag=RWFXSK2ZRQB5 type=write size=298189 2024-03-04T12:41:19.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.691+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=2JXY51NQ1X8W type=del size=355923 2024-03-04T12:41:19.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.692+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~WWPJESYRITX4.0 size=595932 2024-03-04T12:41:19.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.694+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=WWPJESYRITX4 tag=EXK4298Q8DUA type=write size=1644508 2024-03-04T12:41:19.701 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.695+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=NAU7WU7P34BQ type=write size=114444 2024-03-04T12:41:19.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.696+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~PFELK5R3GOV0.0 size=623671 2024-03-04T12:41:19.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.698+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=PFELK5R3GOV0 tag=QPWM8WNLXYDG type=write size=1672247 2024-03-04T12:41:19.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.700+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=A5QGHEADWVNT type=del size=2762441 2024-03-04T12:41:19.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.701+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=UN5O2BRTSWTE type=del 2024-03-04T12:41:19.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.702+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=P3KWFIZ3OVHL type=del size=1359450 2024-03-04T12:41:19.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.703+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~FVJ5KW8DBSK7.0 size=1048576 2024-03-04T12:41:19.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.704+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~FVJ5KW8DBSK7.1 size=547247 2024-03-04T12:41:19.716 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.708+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=FVJ5KW8DBSK7 tag=SXGEJE9TC3YW type=write size=2644399 2024-03-04T12:41:19.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.711+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~KJL42S6U1EKZ.0 size=1048576 2024-03-04T12:41:19.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.712+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~KJL42S6U1EKZ.1 size=105141 2024-03-04T12:41:19.718 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.712+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=KJL42S6U1EKZ tag=3G5W895ADMZL type=write size=2202293 2024-03-04T12:41:19.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.713+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~M23JS8SQW43H.0 size=275124 2024-03-04T12:41:19.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.715+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=M23JS8SQW43H tag=S68TAZ7QH7Q4 type=write size=1323700 2024-03-04T12:41:19.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.716+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=32CY41L7UD46 type=del size=4035387 2024-03-04T12:41:19.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.718+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~03332MA9R2ZL.0 size=1048576 2024-03-04T12:41:19.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.719+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~03332MA9R2ZL.1 size=1048576 2024-03-04T12:41:19.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.720+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~03332MA9R2ZL.2 size=894989 2024-03-04T12:41:19.730 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.725+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=03332MA9R2ZL tag=7B427H5MAO1I type=write size=4040717 2024-03-04T12:41:19.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.726+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=S3FD7ZA8M5NW type=del size=1378452 2024-03-04T12:41:19.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.727+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~R36TP16P8167.0 size=386503 2024-03-04T12:41:19.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.729+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=R36TP16P8167 tag=BVWG1VLLVAZ7 type=write size=1435079 2024-03-04T12:41:19.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.731+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~QAE58HT5J76A.0 size=1048576 2024-03-04T12:41:19.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.732+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~QAE58HT5J76A.1 size=1048576 2024-03-04T12:41:19.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.733+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~QAE58HT5J76A.2 size=105152 2024-03-04T12:41:19.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.733+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=QAE58HT5J76A tag=NFIQM0H34FYE type=write size=3250880 2024-03-04T12:41:19.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.735+0000 7f093583d780 1 < suggested update operation key=GMKM2QEP072H tag=YGES1DLDZJEU type=write size=191291 2024-03-04T12:41:19.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.738+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~TDEE3NEBG7AJ.0 size=1048576 2024-03-04T12:41:19.744 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.739+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~TDEE3NEBG7AJ.1 size=1048576 2024-03-04T12:41:19.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.739+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~TDEE3NEBG7AJ.2 size=611860 2024-03-04T12:41:19.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.739+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=TDEE3NEBG7AJ tag=27XZ4J3LT2SJ type=write size=3757588 2024-03-04T12:41:19.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.741+0000 7f093583d780 1 < completed delete operation key=PT63VLFQQN0E tag=VKWH3C6J3XB8 type=del 2024-03-04T12:41:19.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.742+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=3STZDD1E44KP type=del size=2416716 2024-03-04T12:41:19.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.744+0000 7f093583d780 1 < suggested update operation key=YJXFSO53QVPS tag=OKF1I1OBRT10 type=write size=951053 2024-03-04T12:41:19.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.746+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~6M24FYQS4SH9.0 size=1048576 2024-03-04T12:41:19.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.747+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~6M24FYQS4SH9.1 size=771731 2024-03-04T12:41:19.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.747+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=6M24FYQS4SH9 tag=YID0K4LUM4L2 type=write size=2868883 2024-03-04T12:41:19.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.748+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~M60MD6N84K72.0 size=1048576 2024-03-04T12:41:19.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.749+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~M60MD6N84K72.1 size=1048576 2024-03-04T12:41:19.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.750+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~M60MD6N84K72.2 size=287787 2024-03-04T12:41:19.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.752+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=M60MD6N84K72 tag=Q2ZOXI3XTY9S type=write size=3433515 2024-03-04T12:41:19.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.754+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=UA1SMOK28CXT type=del size=3041839 2024-03-04T12:41:19.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.756+0000 7f093583d780 1 < suggested update operation key=I6DIP4VGHMNO tag=NUG4AE5V2W7K type=del size=705086 2024-03-04T12:41:19.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.757+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=E98763I5GJSH type=del size=1634925 2024-03-04T12:41:19.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.758+0000 7f093583d780 1 < completed write operation key=M0AOZ89IQNSK tag=YRFMXXYQDBPS type=write size=258697 2024-03-04T12:41:19.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.759+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=4HPNF2IJ2KB7 type=del size=2508250 2024-03-04T12:41:19.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.761+0000 7f093583d780 1 < suggested update operation key=AQI7H63EQSTN tag=MDZB9JC4FY45 type=del size=894133 2024-03-04T12:41:19.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.763+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=NJ1JA3EIIR2X type=write size=398824 2024-03-04T12:41:19.769 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.764+0000 7f093583d780 1 < canceled operation key=54FLC10FWKL6 tag=RWQQ7T08QP9F type=del size=739329 2024-03-04T12:41:19.770 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.765+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=20I9RFXC4XE3 type=del size=1590471 2024-03-04T12:41:19.772 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.766+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=2JXY51NQ1X8W type=del 2024-03-04T12:41:19.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.768+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~9OSWD5GI98MG.0 size=1048576 2024-03-04T12:41:19.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.770+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~9OSWD5GI98MG.1 size=1048576 2024-03-04T12:41:19.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.771+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~9OSWD5GI98MG.2 size=381559 2024-03-04T12:41:19.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.771+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=9OSWD5GI98MG tag=0ZIHLQBI6JNC type=write size=3527287 2024-03-04T12:41:19.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.772+0000 7f093583d780 1 < completed write operation key=HG0EM344TJZY tag=NAU7WU7P34BQ type=write size=114444 2024-03-04T12:41:19.778 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.773+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=4EAFSF0H0Z0V type=del size=3090666 2024-03-04T12:41:19.779 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.774+0000 7f093583d780 1 < completed delete operation key=O6OUISHWZ7FU tag=A5QGHEADWVNT type=del 2024-03-04T12:41:19.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.775+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=J9NGF78GNCWO type=del size=1867169 2024-03-04T12:41:19.782 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.776+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=P3KWFIZ3OVHL type=del 2024-03-04T12:41:19.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.777+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=X4VFDHHBETE3 type=write size=353159 2024-03-04T12:41:19.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.779+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~KJL42S6U1EKZ.0 size=1048576 2024-03-04T12:41:19.785 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.780+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~KJL42S6U1EKZ.1 size=105141 2024-03-04T12:41:19.787 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.781+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=KJL42S6U1EKZ tag=3G5W895ADMZL type=write size=2202293 2024-03-04T12:41:19.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.783+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~K6EI72YR8I4G.0 size=1048576 2024-03-04T12:41:19.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.784+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~K6EI72YR8I4G.1 size=1048576 2024-03-04T12:41:19.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.785+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~K6EI72YR8I4G.2 size=258614 2024-03-04T12:41:19.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.785+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=K6EI72YR8I4G tag=32EIQS342BYQ type=write size=3404342 2024-03-04T12:41:19.792 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.786+0000 7f093583d780 -1 < failed to complete operation key=AQI7H63EQSTN tag=32CY41L7UD46 type=del size=4035387: (22) Invalid argument 2024-03-04T12:41:19.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.788+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=2UCNIFUM0H24 type=del size=1306654 2024-03-04T12:41:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.789+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=S3FD7ZA8M5NW type=del 2024-03-04T12:41:19.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.791+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~NIRY1VJR599Z.0 size=1048576 2024-03-04T12:41:19.797 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.792+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~NIRY1VJR599Z.1 size=883844 2024-03-04T12:41:19.797 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.792+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=NIRY1VJR599Z tag=FYC9MVL3BU7C type=write size=2980996 2024-03-04T12:41:19.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.793+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~QAE58HT5J76A.0 size=1048576 2024-03-04T12:41:19.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.793+0000 7f093583d780 1 < canceled part key=_multipart_I5NQBROT0WKE.2~QAE58HT5J76A.1 size=1048576 2024-03-04T12:41:19.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.794+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~QAE58HT5J76A.2 size=105152 2024-03-04T12:41:19.801 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.796+0000 7f093583d780 1 < canceled multipart upload key=I5NQBROT0WKE upload=QAE58HT5J76A tag=NFIQM0H34FYE type=write size=3250880 2024-03-04T12:41:19.803 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.798+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~9BLYG1J9VB2Q.0 size=1048576 2024-03-04T12:41:19.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.799+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~9BLYG1J9VB2Q.1 size=1048576 2024-03-04T12:41:19.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.799+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~9BLYG1J9VB2Q.2 size=281891 2024-03-04T12:41:19.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.799+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=9BLYG1J9VB2Q tag=NH0R3DA6FGT0 type=write size=3427619 2024-03-04T12:41:19.806 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.801+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~TDEE3NEBG7AJ.0 size=1048576 2024-03-04T12:41:19.807 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.801+0000 7f093583d780 1 < canceled part key=_multipart_FT2XNJYYT30J.2~TDEE3NEBG7AJ.1 size=1048576 2024-03-04T12:41:19.807 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.802+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~TDEE3NEBG7AJ.2 size=611860 2024-03-04T12:41:19.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.804+0000 7f093583d780 1 < canceled multipart upload key=FT2XNJYYT30J upload=TDEE3NEBG7AJ tag=27XZ4J3LT2SJ type=write size=3757588 2024-03-04T12:41:19.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.806+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=HDKDELYWFH94 type=del size=2104566 2024-03-04T12:41:19.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.807+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=3STZDD1E44KP type=del 2024-03-04T12:41:19.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.808+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=LUINN5HEY21T type=del size=3322576 2024-03-04T12:41:19.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.809+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~6M24FYQS4SH9.0 size=1048576 2024-03-04T12:41:19.816 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.810+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~6M24FYQS4SH9.1 size=771731 2024-03-04T12:41:19.818 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.812+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=6M24FYQS4SH9 tag=YID0K4LUM4L2 type=write size=2868883 2024-03-04T12:41:19.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.813+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=ASH0URZXB57J type=del size=1067747 2024-03-04T12:41:19.821 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.816+0000 7f093583d780 1 < suggested remove operation key=2ZOV2JEQHXGS tag=UA1SMOK28CXT type=del 2024-03-04T12:41:19.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.818+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~D048M2ZWHHSF.0 size=302121 2024-03-04T12:41:19.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.818+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=D048M2ZWHHSF tag=K14IVGU6VYPS type=write size=1350697 2024-03-04T12:41:19.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.819+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=E98763I5GJSH type=del 2024-03-04T12:41:19.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.820+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=NK6OOFY68JRS type=del size=345478 2024-03-04T12:41:19.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.821+0000 7f093583d780 1 < completed delete operation key=O6OUISHWZ7FU tag=4HPNF2IJ2KB7 type=del 2024-03-04T12:41:19.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.822+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=0RXP10B36BRC type=del size=3700722 2024-03-04T12:41:19.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.824+0000 7f093583d780 1 < suggested remove operation key=HG0EM344TJZY tag=NJ1JA3EIIR2X type=write 2024-03-04T12:41:19.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.826+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=XAF6XXH79HB3 type=write size=732423 2024-03-04T12:41:19.835 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.828+0000 7f093583d780 1 < suggested update operation key=Y4D4Q7NV5VMO tag=20I9RFXC4XE3 type=del size=1590471 2024-03-04T12:41:19.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.830+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=RGVMCASAAFCX type=del size=1716268 2024-03-04T12:41:19.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.831+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~9OSWD5GI98MG.0 size=1048576 2024-03-04T12:41:19.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.832+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~9OSWD5GI98MG.1 size=1048576 2024-03-04T12:41:19.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.832+0000 7f093583d780 1 < canceled part key=_multipart_NFM6LT89K5F4.2~9OSWD5GI98MG.2 size=381559 2024-03-04T12:41:19.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.834+0000 7f093583d780 1 < canceled multipart upload key=NFM6LT89K5F4 upload=9OSWD5GI98MG tag=0ZIHLQBI6JNC type=write size=3527287 2024-03-04T12:41:19.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.836+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~IS2C3P9DH9N2.0 size=1048576 2024-03-04T12:41:19.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.837+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~IS2C3P9DH9N2.1 size=1048576 2024-03-04T12:41:19.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.838+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~IS2C3P9DH9N2.2 size=587965 2024-03-04T12:41:19.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.838+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=IS2C3P9DH9N2 tag=KBMIDQ32GEQD type=write size=3733693 2024-03-04T12:41:19.845 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.839+0000 7f093583d780 1 < canceled operation key=L4UQK3UJFXZC tag=4EAFSF0H0Z0V type=del size=3090666 2024-03-04T12:41:19.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.841+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~R9LBQPA61O7F.0 size=1048576 2024-03-04T12:41:19.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.842+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~R9LBQPA61O7F.1 size=445364 2024-03-04T12:41:19.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.842+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=R9LBQPA61O7F tag=XJLEP7QX913N type=write size=2542516 2024-03-04T12:41:19.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.844+0000 7f093583d780 1 < suggested remove operation key=AQI7H63EQSTN tag=J9NGF78GNCWO type=del 2024-03-04T12:41:19.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.845+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=V9HOGKAJQ2P3 type=del size=3109645 2024-03-04T12:41:19.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.846+0000 7f093583d780 1 < completed write operation key=I5NQBROT0WKE tag=X4VFDHHBETE3 type=write size=353159 2024-03-04T12:41:19.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.848+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~ATR9XL6RK2O9.0 size=1048576 2024-03-04T12:41:19.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.849+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~ATR9XL6RK2O9.1 size=320501 2024-03-04T12:41:19.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.849+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=ATR9XL6RK2O9 tag=G3A043869QD8 type=write size=2417653 2024-03-04T12:41:19.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.850+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~K6EI72YR8I4G.0 size=1048576 2024-03-04T12:41:19.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.851+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~K6EI72YR8I4G.1 size=1048576 2024-03-04T12:41:19.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.851+0000 7f093583d780 1 < canceled part key=_multipart_I5NQBROT0WKE.2~K6EI72YR8I4G.2 size=258614 2024-03-04T12:41:19.858 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.852+0000 7f093583d780 1 < canceled multipart upload key=I5NQBROT0WKE upload=K6EI72YR8I4G tag=32EIQS342BYQ type=write size=3404342 2024-03-04T12:41:19.859 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.854+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=SRE6XJ9RLU2O type=del size=3592726 2024-03-04T12:41:19.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.856+0000 7f093583d780 1 < suggested remove operation key=FT2XNJYYT30J tag=2UCNIFUM0H24 type=del 2024-03-04T12:41:19.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.857+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=3DI8U5AOK59P type=write size=929236 2024-03-04T12:41:19.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.858+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~NIRY1VJR599Z.0 size=1048576 2024-03-04T12:41:19.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.860+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~NIRY1VJR599Z.1 size=883844 2024-03-04T12:41:19.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.861+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=NIRY1VJR599Z tag=FYC9MVL3BU7C type=write size=2980996 2024-03-04T12:41:19.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.863+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~WHWUZI75EO0C.0 size=1048576 2024-03-04T12:41:19.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.865+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~WHWUZI75EO0C.1 size=1048576 2024-03-04T12:41:19.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.866+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~WHWUZI75EO0C.2 size=110507 2024-03-04T12:41:19.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.866+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=WHWUZI75EO0C tag=H32HX7YU4I6W type=write size=3256235 2024-03-04T12:41:19.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.867+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~9BLYG1J9VB2Q.0 size=1048576 2024-03-04T12:41:19.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.868+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~9BLYG1J9VB2Q.1 size=1048576 2024-03-04T12:41:19.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.869+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~9BLYG1J9VB2Q.2 size=281891 2024-03-04T12:41:19.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.870+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=9BLYG1J9VB2Q tag=NH0R3DA6FGT0 type=write size=3427619 2024-03-04T12:41:19.878 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.872+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~1V8JUN8JOF1I.0 size=1048576 2024-03-04T12:41:19.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.873+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~1V8JUN8JOF1I.1 size=174077 2024-03-04T12:41:19.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.873+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=1V8JUN8JOF1I tag=2N0A6PVZQ3AE type=write size=2271229 2024-03-04T12:41:19.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.875+0000 7f093583d780 1 < suggested remove operation key=GMKM2QEP072H tag=HDKDELYWFH94 type=del 2024-03-04T12:41:19.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.877+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=IX6DR0P1OT3V type=del size=781843 2024-03-04T12:41:19.884 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.878+0000 7f093583d780 -1 < failed to complete operation key=AQI7H63EQSTN tag=LUINN5HEY21T type=del size=3322576: (22) Invalid argument 2024-03-04T12:41:19.885 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.880+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=FPWJ3ALHB32T type=del size=2960802 2024-03-04T12:41:19.886 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.881+0000 7f093583d780 1 < canceled operation key=I6DIP4VGHMNO tag=ASH0URZXB57J type=del size=1067747 2024-03-04T12:41:19.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.882+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=HRR8787OQXPE type=write size=620178 2024-03-04T12:41:19.889 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.883+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~D048M2ZWHHSF.0 size=302121 2024-03-04T12:41:19.891 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.886+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=D048M2ZWHHSF tag=K14IVGU6VYPS type=write size=1350697 2024-03-04T12:41:19.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.887+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=LXYIDE7Q915T type=del size=2410156 2024-03-04T12:41:19.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.888+0000 7f093583d780 -1 < failed to complete operation key=FT2XNJYYT30J tag=NK6OOFY68JRS type=del size=345478: (22) Invalid argument 2024-03-04T12:41:19.895 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.889+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=UE2KT2XFSRC1 type=del size=1597349 2024-03-04T12:41:19.897 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.892+0000 7f093583d780 1 < suggested remove operation key=54FLC10FWKL6 tag=0RXP10B36BRC type=del 2024-03-04T12:41:19.899 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.893+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=U6YZ31PE8FL2 type=del size=2939366 2024-03-04T12:41:19.900 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.894+0000 7f093583d780 1 < completed write operation key=2R5WA9Q9ZAUG tag=XAF6XXH79HB3 type=write size=732423 2024-03-04T12:41:19.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.895+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=URUM3ZYI13R9 type=del size=3227038 2024-03-04T12:41:19.902 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.897+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=RGVMCASAAFCX type=del 2024-03-04T12:41:19.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.898+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=09YP9CDCCBPV type=del size=3149654 2024-03-04T12:41:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.899+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~IS2C3P9DH9N2.0 size=1048576 2024-03-04T12:41:19.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.900+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~IS2C3P9DH9N2.1 size=1048576 2024-03-04T12:41:19.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.901+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~IS2C3P9DH9N2.2 size=587965 2024-03-04T12:41:19.909 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.903+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=IS2C3P9DH9N2 tag=KBMIDQ32GEQD type=write size=3733693 2024-03-04T12:41:19.910 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.905+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=LYKLU1K3PMP6 type=del size=1863726 2024-03-04T12:41:19.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.906+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~R9LBQPA61O7F.0 size=1048576 2024-03-04T12:41:19.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.907+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~R9LBQPA61O7F.1 size=445364 2024-03-04T12:41:19.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.909+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=R9LBQPA61O7F tag=XJLEP7QX913N type=write size=2542516 2024-03-04T12:41:19.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.911+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~DSMK7A5LXOTG.0 size=1048576 2024-03-04T12:41:19.918 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.913+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~DSMK7A5LXOTG.1 size=1048576 2024-03-04T12:41:19.919 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.914+0000 7f093583d780 1 > prepared part key=_multipart_2ZOV2JEQHXGS.2~DSMK7A5LXOTG.2 size=1003433 2024-03-04T12:41:19.920 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.914+0000 7f093583d780 1 > prepared multipart upload key=2ZOV2JEQHXGS upload=DSMK7A5LXOTG tag=FS1SDSD6FQUD type=write size=4149161 2024-03-04T12:41:19.924 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.915+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=V9HOGKAJQ2P3 type=del 2024-03-04T12:41:19.924 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.916+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=Y4HXWMD2KNE8 type=del size=1907262 2024-03-04T12:41:19.924 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.917+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~ATR9XL6RK2O9.0 size=1048576 2024-03-04T12:41:19.924 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.918+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~ATR9XL6RK2O9.1 size=320501 2024-03-04T12:41:19.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.920+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=ATR9XL6RK2O9 tag=G3A043869QD8 type=write size=2417653 2024-03-04T12:41:19.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.921+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=9O9U7FX6LYU2 type=del size=1824304 2024-03-04T12:41:19.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.922+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=SRE6XJ9RLU2O type=del 2024-03-04T12:41:19.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.924+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=LMU4EB7XMX3A type=del size=1207507 2024-03-04T12:41:19.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.926+0000 7f093583d780 1 < suggested update operation key=Y4D4Q7NV5VMO tag=3DI8U5AOK59P type=write size=929236 2024-03-04T12:41:19.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.929+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~I793U613GZFP.0 size=1048576 2024-03-04T12:41:19.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.929+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~I793U613GZFP.1 size=444403 2024-03-04T12:41:19.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.929+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=I793U613GZFP tag=KY6FK8OD3O76 type=write size=2541555 2024-03-04T12:41:19.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.931+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~WHWUZI75EO0C.0 size=1048576 2024-03-04T12:41:19.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.932+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~WHWUZI75EO0C.1 size=1048576 2024-03-04T12:41:19.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.932+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~WHWUZI75EO0C.2 size=110507 2024-03-04T12:41:19.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.934+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=WHWUZI75EO0C tag=H32HX7YU4I6W type=write size=3256235 2024-03-04T12:41:19.941 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.935+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=GTDJMD9TS86J type=del size=502990 2024-03-04T12:41:19.942 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.936+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~1V8JUN8JOF1I.0 size=1048576 2024-03-04T12:41:19.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.937+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~1V8JUN8JOF1I.1 size=174077 2024-03-04T12:41:19.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.941+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=1V8JUN8JOF1I tag=2N0A6PVZQ3AE type=write size=2271229 2024-03-04T12:41:19.949 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.943+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~4M1VLZU68SZ9.0 size=220870 2024-03-04T12:41:19.949 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.943+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=4M1VLZU68SZ9 tag=Z2WXIFV3LOV5 type=write size=1269446 2024-03-04T12:41:19.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.944+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=IX6DR0P1OT3V type=del 2024-03-04T12:41:19.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.946+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=0OJFMQW05OI9 type=write size=909400 2024-03-04T12:41:19.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.947+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=FPWJ3ALHB32T type=del 2024-03-04T12:41:19.954 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.949+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~60WON2NGIN53.0 size=1048576 2024-03-04T12:41:19.955 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.949+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~60WON2NGIN53.1 size=1048576 2024-03-04T12:41:19.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.950+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~60WON2NGIN53.2 size=838961 2024-03-04T12:41:19.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.950+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=60WON2NGIN53 tag=D7RAYV22CYFY type=write size=3984689 2024-03-04T12:41:19.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.951+0000 7f093583d780 1 < completed write operation key=L4UQK3UJFXZC tag=HRR8787OQXPE type=write size=620178 2024-03-04T12:41:19.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.953+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=KKNX6C057Z7T type=del size=1723242 2024-03-04T12:41:19.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.954+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=LXYIDE7Q915T type=del 2024-03-04T12:41:19.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.955+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=I0RM85XMEYVJ type=del size=282239 2024-03-04T12:41:19.961 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.956+0000 7f093583d780 1 < completed delete operation key=9VKN43CB955V tag=UE2KT2XFSRC1 type=del 2024-03-04T12:41:19.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.957+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=40OC4SPTL060 type=del size=923280 2024-03-04T12:41:19.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.958+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=U6YZ31PE8FL2 type=del 2024-03-04T12:41:19.965 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.959+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=0NQT30UT1L2Z type=del size=1802887 2024-03-04T12:41:19.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.961+0000 7f093583d780 1 < suggested remove operation key=PT63VLFQQN0E tag=URUM3ZYI13R9 type=del 2024-03-04T12:41:19.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.962+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=EOXM74E287QA type=del size=1431083 2024-03-04T12:41:19.970 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.965+0000 7f093583d780 1 < suggested remove operation key=YJXFSO53QVPS tag=09YP9CDCCBPV type=del 2024-03-04T12:41:19.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.967+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~DRREMT8644YP.0 size=1048576 2024-03-04T12:41:19.973 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.968+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~DRREMT8644YP.1 size=1048576 2024-03-04T12:41:19.974 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.969+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~DRREMT8644YP.2 size=187393 2024-03-04T12:41:19.974 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.969+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=DRREMT8644YP tag=M8A3C9FKIWRC type=write size=3333121 2024-03-04T12:41:19.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.970+0000 7f093583d780 1 < canceled operation key=2R5WA9Q9ZAUG tag=LYKLU1K3PMP6 type=del size=1863726 2024-03-04T12:41:19.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.971+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=7YVFD4LGW746 type=del size=1498103 2024-03-04T12:41:19.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.972+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~DSMK7A5LXOTG.0 size=1048576 2024-03-04T12:41:19.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.973+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~DSMK7A5LXOTG.1 size=1048576 2024-03-04T12:41:19.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.974+0000 7f093583d780 1 < completed part key=_multipart_2ZOV2JEQHXGS.2~DSMK7A5LXOTG.2 size=1003433 2024-03-04T12:41:19.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.976+0000 7f093583d780 1 < completed multipart upload key=2ZOV2JEQHXGS upload=DSMK7A5LXOTG tag=FS1SDSD6FQUD type=write size=4149161 2024-03-04T12:41:19.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.978+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~3N4FCH0GNQWS.0 size=1048576 2024-03-04T12:41:19.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.979+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~3N4FCH0GNQWS.1 size=1048576 2024-03-04T12:41:19.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.980+0000 7f093583d780 1 > prepared part key=_multipart_54FLC10FWKL6.2~3N4FCH0GNQWS.2 size=94877 2024-03-04T12:41:19.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.980+0000 7f093583d780 1 > prepared multipart upload key=54FLC10FWKL6 upload=3N4FCH0GNQWS tag=C5G683NQN5KY type=write size=3240605 2024-03-04T12:41:19.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.981+0000 7f093583d780 1 < canceled operation key=OCOQJLUUNWRG tag=Y4HXWMD2KNE8 type=del size=1907262 2024-03-04T12:41:19.987 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.982+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=8E4YIMQ2SQO2 type=del size=2592786 2024-03-04T12:41:19.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.984+0000 7f093583d780 1 < suggested remove operation key=J6Y9V11BX06B tag=9O9U7FX6LYU2 type=del 2024-03-04T12:41:19.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.986+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=CIQAAIT36Z76 type=del size=55498 2024-03-04T12:41:19.993 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.987+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=LMU4EB7XMX3A type=del 2024-03-04T12:41:19.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.989+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~JLIMA06HX28X.0 size=794751 2024-03-04T12:41:19.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.989+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=JLIMA06HX28X tag=Q8SIITR2IS5A type=write size=1843327 2024-03-04T12:41:19.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.991+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~I793U613GZFP.0 size=1048576 2024-03-04T12:41:19.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.991+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~I793U613GZFP.1 size=444403 2024-03-04T12:41:19.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.993+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=I793U613GZFP tag=KY6FK8OD3O76 type=write size=2541555 2024-03-04T12:41:20.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.995+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=94SGEYUBXXC1 type=del size=4136292 2024-03-04T12:41:20.002 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.997+0000 7f093583d780 1 < suggested update operation key=96PTQ2KHPMMM tag=GTDJMD9TS86J type=del size=502990 2024-03-04T12:41:20.003 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.998+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=EWYWPQ3B2MH0 type=del size=185699 2024-03-04T12:41:20.005 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:19.999+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~4M1VLZU68SZ9.0 size=220870 2024-03-04T12:41:20.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.001+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=4M1VLZU68SZ9 tag=Z2WXIFV3LOV5 type=write size=1269446 2024-03-04T12:41:20.008 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.002+0000 7f093583d780 1 > prepared operation key=PT63VLFQQN0E tag=IRQZOW0RQR9P type=write size=74074 2024-03-04T12:41:20.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.005+0000 7f093583d780 1 < suggested remove operation key=I5NQBROT0WKE tag=0OJFMQW05OI9 type=write 2024-03-04T12:41:20.011 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.006+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=GXQ6A2QWIC8J type=write size=109231 2024-03-04T12:41:20.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.007+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~60WON2NGIN53.0 size=1048576 2024-03-04T12:41:20.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.008+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~60WON2NGIN53.1 size=1048576 2024-03-04T12:41:20.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.008+0000 7f093583d780 1 < canceled part key=_multipart_UAEQORB3BDBH.2~60WON2NGIN53.2 size=838961 2024-03-04T12:41:20.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.010+0000 7f093583d780 1 < canceled multipart upload key=UAEQORB3BDBH upload=60WON2NGIN53 tag=D7RAYV22CYFY type=write size=3984689 2024-03-04T12:41:20.017 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.011+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=S59RLVNJK3V7 type=del size=2982022 2024-03-04T12:41:20.018 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.012+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=KKNX6C057Z7T type=del 2024-03-04T12:41:20.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.013+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=PQW4KDGEGQR6 type=del size=263501 2024-03-04T12:41:20.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.015+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=I0RM85XMEYVJ type=del 2024-03-04T12:41:20.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.016+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=NK206LFQ4LN7 type=del size=1281361 2024-03-04T12:41:20.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.017+0000 7f093583d780 1 < completed delete operation key=L4UQK3UJFXZC tag=40OC4SPTL060 type=del 2024-03-04T12:41:20.025 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.019+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~MS5BCNHUGW53.0 size=135576 2024-03-04T12:41:20.025 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.019+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=MS5BCNHUGW53 tag=RJ10QO8ZBN1O type=write size=1184152 2024-03-04T12:41:20.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.021+0000 7f093583d780 -1 < failed to complete operation key=J6Y9V11BX06B tag=0NQT30UT1L2Z type=del size=1802887: (22) Invalid argument 2024-03-04T12:41:20.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.022+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=2YECL3GLN7GD type=del size=2326134 2024-03-04T12:41:20.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.023+0000 7f093583d780 -1 < failed to complete operation key=96PTQ2KHPMMM tag=EOXM74E287QA type=del size=1431083: (22) Invalid argument 2024-03-04T12:41:20.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.024+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=DDSKHI8WFXT2 type=del size=1085409 2024-03-04T12:41:20.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.025+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~DRREMT8644YP.0 size=1048576 2024-03-04T12:41:20.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.026+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~DRREMT8644YP.1 size=1048576 2024-03-04T12:41:20.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.027+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~DRREMT8644YP.2 size=187393 2024-03-04T12:41:20.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.029+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=DRREMT8644YP tag=M8A3C9FKIWRC type=write size=3333121 2024-03-04T12:41:20.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.031+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=7T0CNS7CT6BZ type=del size=2301610 2024-03-04T12:41:20.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.032+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=7YVFD4LGW746 type=del 2024-03-04T12:41:20.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.033+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=WZ8544IIQX3Q type=del size=193211 2024-03-04T12:41:20.040 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.034+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~3N4FCH0GNQWS.0 size=1048576 2024-03-04T12:41:20.041 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.035+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~3N4FCH0GNQWS.1 size=1048576 2024-03-04T12:41:20.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.036+0000 7f093583d780 1 < completed part key=_multipart_54FLC10FWKL6.2~3N4FCH0GNQWS.2 size=94877 2024-03-04T12:41:20.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.038+0000 7f093583d780 1 < completed multipart upload key=54FLC10FWKL6 upload=3N4FCH0GNQWS tag=C5G683NQN5KY type=write size=3240605 2024-03-04T12:41:20.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.040+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~QM3GI0IXBJ47.0 size=838825 2024-03-04T12:41:20.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.040+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=QM3GI0IXBJ47 tag=MQNDYQJOJ1Z0 type=write size=1887401 2024-03-04T12:41:20.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.042+0000 7f093583d780 1 < suggested remove operation key=Y4D4Q7NV5VMO tag=8E4YIMQ2SQO2 type=del 2024-03-04T12:41:20.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.044+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=YQ6CTREQVYHM type=del size=3856949 2024-03-04T12:41:20.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.045+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=CIQAAIT36Z76 type=del 2024-03-04T12:41:20.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.047+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~V2U8BU60I88U.0 size=260865 2024-03-04T12:41:20.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.047+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=V2U8BU60I88U tag=2WTQR78QAJ6C type=write size=1309441 2024-03-04T12:41:20.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.048+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~JLIMA06HX28X.0 size=794751 2024-03-04T12:41:20.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.051+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=JLIMA06HX28X tag=Q8SIITR2IS5A type=write size=1843327 2024-03-04T12:41:20.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.053+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~V5XGZGSQ9TYI.0 size=1048576 2024-03-04T12:41:20.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.054+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~V5XGZGSQ9TYI.1 size=1048576 2024-03-04T12:41:20.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.055+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~V5XGZGSQ9TYI.2 size=623466 2024-03-04T12:41:20.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.055+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=V5XGZGSQ9TYI tag=5WRYYP9KXIJB type=write size=3769194 2024-03-04T12:41:20.062 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.056+0000 7f093583d780 1 < canceled operation key=AQI7H63EQSTN tag=94SGEYUBXXC1 type=del size=4136292 2024-03-04T12:41:20.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.057+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=7L64DFD9Y7HC type=del size=1118169 2024-03-04T12:41:20.064 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.058+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=EWYWPQ3B2MH0 type=del 2024-03-04T12:41:20.065 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.060+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=VOHQ9QUZOZ5K type=del size=446861 2024-03-04T12:41:20.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.062+0000 7f093583d780 1 < suggested update operation key=PT63VLFQQN0E tag=IRQZOW0RQR9P type=write size=74074 2024-03-04T12:41:20.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.063+0000 7f093583d780 1 > prepared operation key=NFM6LT89K5F4 tag=ZC2IUA34QPFS type=write size=856736 2024-03-04T12:41:20.069 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.064+0000 7f093583d780 1 < completed write operation key=OCOQJLUUNWRG tag=GXQ6A2QWIC8J type=write size=109231 2024-03-04T12:41:20.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.066+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~LLX7A0LVNQE0.0 size=1048576 2024-03-04T12:41:20.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.067+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~LLX7A0LVNQE0.1 size=1048576 2024-03-04T12:41:20.073 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.068+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~LLX7A0LVNQE0.2 size=762802 2024-03-04T12:41:20.074 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.068+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=LLX7A0LVNQE0 tag=6SYKEK94HZK9 type=write size=3908530 2024-03-04T12:41:20.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.070+0000 7f093583d780 1 < suggested remove operation key=M0AOZ89IQNSK tag=S59RLVNJK3V7 type=del 2024-03-04T12:41:20.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.072+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~4RBF8KXZIJKI.0 size=1048576 2024-03-04T12:41:20.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.073+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~4RBF8KXZIJKI.1 size=364657 2024-03-04T12:41:20.079 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.073+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=4RBF8KXZIJKI tag=6O68B4IVVNLL type=write size=2461809 2024-03-04T12:41:20.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.074+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=PQW4KDGEGQR6 type=del 2024-03-04T12:41:20.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.075+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=3BKCIGC4G9J0 type=del size=3168140 2024-03-04T12:41:20.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.079+0000 7f093583d780 1 < suggested remove operation key=I6DIP4VGHMNO tag=NK206LFQ4LN7 type=del 2024-03-04T12:41:20.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.082+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~3UGK2EALEHRM.0 size=1048576 2024-03-04T12:41:20.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.083+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~3UGK2EALEHRM.1 size=968315 2024-03-04T12:41:20.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.083+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=3UGK2EALEHRM tag=BAMIIZX07MCM type=write size=3065467 2024-03-04T12:41:20.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.084+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~MS5BCNHUGW53.0 size=135576 2024-03-04T12:41:20.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.086+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=MS5BCNHUGW53 tag=RJ10QO8ZBN1O type=write size=1184152 2024-03-04T12:41:20.093 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.087+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=0NG3Q8DD8XNA type=del size=1127188 2024-03-04T12:41:20.094 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.088+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=2YECL3GLN7GD type=del 2024-03-04T12:41:20.095 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.090+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=EEKIJRC129WO type=del size=819846 2024-03-04T12:41:20.096 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.091+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=DDSKHI8WFXT2 type=del 2024-03-04T12:41:20.098 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.093+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~9QS5MLFISRJN.0 size=472957 2024-03-04T12:41:20.098 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.093+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=9QS5MLFISRJN tag=27IQBH5V1CDG type=write size=1521533 2024-03-04T12:41:20.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.094+0000 7f093583d780 1 < canceled operation key=J6Y9V11BX06B tag=7T0CNS7CT6BZ type=del size=2301610 2024-03-04T12:41:20.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.095+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=3OLPJL0OPAL8 type=del size=3075802 2024-03-04T12:41:20.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.096+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=WZ8544IIQX3Q type=del 2024-03-04T12:41:20.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.097+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=MBWXTQMYW1B2 type=del size=1383 2024-03-04T12:41:20.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.099+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~QM3GI0IXBJ47.0 size=838825 2024-03-04T12:41:20.108 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.102+0000 7f093583d780 1 < completed multipart upload key=TMAI6MOG2C4N upload=QM3GI0IXBJ47 tag=MQNDYQJOJ1Z0 type=write size=1887401 2024-03-04T12:41:20.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.104+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~3449I6OU0GGI.0 size=3074 2024-03-04T12:41:20.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.104+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=3449I6OU0GGI tag=E5GFN6HYFB3P type=write size=1051650 2024-03-04T12:41:20.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.106+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=YQ6CTREQVYHM type=del 2024-03-04T12:41:20.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.108+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~9ZANWG2ZVELU.0 size=1048576 2024-03-04T12:41:20.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.108+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~9ZANWG2ZVELU.1 size=326420 2024-03-04T12:41:20.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.108+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=9ZANWG2ZVELU tag=H6B8AJA55CS7 type=write size=2423572 2024-03-04T12:41:20.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.110+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~V2U8BU60I88U.0 size=260865 2024-03-04T12:41:20.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.111+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=V2U8BU60I88U tag=2WTQR78QAJ6C type=write size=1309441 2024-03-04T12:41:20.119 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.113+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~D1TMJV9C6ID1.0 size=1048576 2024-03-04T12:41:20.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.114+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~D1TMJV9C6ID1.1 size=236533 2024-03-04T12:41:20.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.114+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=D1TMJV9C6ID1 tag=NM2ACJO08NUW type=write size=2333685 2024-03-04T12:41:20.120 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.115+0000 7f093583d780 1 < canceled part key=_multipart_NQF43I07F2HT.2~V5XGZGSQ9TYI.0 size=1048576 2024-03-04T12:41:20.121 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.115+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~V5XGZGSQ9TYI.1 size=1048576 2024-03-04T12:41:20.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.116+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~V5XGZGSQ9TYI.2 size=623466 2024-03-04T12:41:20.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.118+0000 7f093583d780 1 < canceled multipart upload key=NQF43I07F2HT upload=V5XGZGSQ9TYI tag=5WRYYP9KXIJB type=write size=3769194 2024-03-04T12:41:20.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.119+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=N53Z0Y6A6AUK type=write size=544683 2024-03-04T12:41:20.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.121+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=7L64DFD9Y7HC type=del 2024-03-04T12:41:20.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.123+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~6YV4SF3P93K2.0 size=1048576 2024-03-04T12:41:20.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.124+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~6YV4SF3P93K2.1 size=1048576 2024-03-04T12:41:20.130 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.124+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~6YV4SF3P93K2.2 size=717001 2024-03-04T12:41:20.130 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.124+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=6YV4SF3P93K2 tag=6SBLGOR0RR7C type=write size=3862729 2024-03-04T12:41:20.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.128+0000 7f093583d780 1 < suggested update operation key=Q45PKXZVJ6YS tag=VOHQ9QUZOZ5K type=del size=446861 2024-03-04T12:41:20.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.129+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=49TO7CATRCNZ type=del size=1875481 2024-03-04T12:41:20.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.130+0000 7f093583d780 1 < completed write operation key=NFM6LT89K5F4 tag=ZC2IUA34QPFS type=write size=856736 2024-03-04T12:41:20.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.132+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~QTDYJEWJNUJ2.0 size=1048576 2024-03-04T12:41:20.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.133+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~QTDYJEWJNUJ2.1 size=1048576 2024-03-04T12:41:20.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.135+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~QTDYJEWJNUJ2.2 size=872529 2024-03-04T12:41:20.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.135+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=QTDYJEWJNUJ2 tag=46EIZ3M6FVRG type=write size=4018257 2024-03-04T12:41:20.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.136+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~LLX7A0LVNQE0.0 size=1048576 2024-03-04T12:41:20.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.137+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~LLX7A0LVNQE0.1 size=1048576 2024-03-04T12:41:20.143 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.137+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~LLX7A0LVNQE0.2 size=762802 2024-03-04T12:41:20.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.139+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=LLX7A0LVNQE0 tag=6SYKEK94HZK9 type=write size=3908530 2024-03-04T12:41:20.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.140+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=H1A7DBUGRLK4 type=del size=997341 2024-03-04T12:41:20.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.142+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~4RBF8KXZIJKI.0 size=1048576 2024-03-04T12:41:20.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.143+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~4RBF8KXZIJKI.1 size=364657 2024-03-04T12:41:20.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.145+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=4RBF8KXZIJKI tag=6O68B4IVVNLL type=write size=2461809 2024-03-04T12:41:20.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.147+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~QP2286ZKPU43.0 size=920088 2024-03-04T12:41:20.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.147+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=QP2286ZKPU43 tag=V28NNMGV7XC0 type=write size=1968664 2024-03-04T12:41:20.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.149+0000 7f093583d780 1 < suggested remove operation key=HG0EM344TJZY tag=3BKCIGC4G9J0 type=del 2024-03-04T12:41:20.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.151+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~NKFC79OY5YTB.0 size=1048576 2024-03-04T12:41:20.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.152+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~NKFC79OY5YTB.1 size=1048576 2024-03-04T12:41:20.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.153+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~NKFC79OY5YTB.2 size=203766 2024-03-04T12:41:20.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.153+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=NKFC79OY5YTB tag=1WT0ZXV2Z1A3 type=write size=3349494 2024-03-04T12:41:20.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.154+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~3UGK2EALEHRM.0 size=1048576 2024-03-04T12:41:20.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.155+0000 7f093583d780 1 < completed part key=_multipart_M0AOZ89IQNSK.2~3UGK2EALEHRM.1 size=968315 2024-03-04T12:41:20.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.157+0000 7f093583d780 1 < completed multipart upload key=M0AOZ89IQNSK upload=3UGK2EALEHRM tag=BAMIIZX07MCM type=write size=3065467 2024-03-04T12:41:20.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.158+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=29Y6CXPPRELF type=del size=1832068 2024-03-04T12:41:20.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.159+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=0NG3Q8DD8XNA type=del 2024-03-04T12:41:20.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.161+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=F85XRO6GAWN1 type=del size=3636882 2024-03-04T12:41:20.168 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.162+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=EEKIJRC129WO type=del 2024-03-04T12:41:20.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.164+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~DHSRDH9GCWJU.0 size=1048576 2024-03-04T12:41:20.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.165+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~DHSRDH9GCWJU.1 size=680617 2024-03-04T12:41:20.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.165+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=DHSRDH9GCWJU tag=SM9Y4FRCT93W type=write size=2777769 2024-03-04T12:41:20.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.166+0000 7f093583d780 1 < canceled part key=_multipart_U6F7IZ07CS9Q.2~9QS5MLFISRJN.0 size=472957 2024-03-04T12:41:20.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.167+0000 7f093583d780 1 < canceled multipart upload key=U6F7IZ07CS9Q upload=9QS5MLFISRJN tag=27IQBH5V1CDG type=write size=1521533 2024-03-04T12:41:20.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.169+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~1GJS8CCC3SM4.0 size=1048576 2024-03-04T12:41:20.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.170+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~1GJS8CCC3SM4.1 size=213122 2024-03-04T12:41:20.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.170+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=1GJS8CCC3SM4 tag=QN7ZN982N70N type=write size=2310274 2024-03-04T12:41:20.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.171+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=3OLPJL0OPAL8 type=del 2024-03-04T12:41:20.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.173+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=M8HB4DUZT7DD type=del size=2218404 2024-03-04T12:41:20.179 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.174+0000 7f093583d780 1 < canceled operation key=J6Y9V11BX06B tag=MBWXTQMYW1B2 type=del size=1383 2024-03-04T12:41:20.180 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.175+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=HCMMVOUCYBU7 type=del size=2523459 2024-03-04T12:41:20.181 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.175+0000 7f093583d780 1 < canceled part key=_multipart_3F8GI0JCUR6W.2~3449I6OU0GGI.0 size=3074 2024-03-04T12:41:20.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.177+0000 7f093583d780 1 < canceled multipart upload key=3F8GI0JCUR6W upload=3449I6OU0GGI tag=E5GFN6HYFB3P type=write size=1051650 2024-03-04T12:41:20.183 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.178+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=856BIQIUROW6 type=write size=739276 2024-03-04T12:41:20.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.179+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~9ZANWG2ZVELU.0 size=1048576 2024-03-04T12:41:20.185 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.180+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~9ZANWG2ZVELU.1 size=326420 2024-03-04T12:41:20.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.182+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=9ZANWG2ZVELU tag=H6B8AJA55CS7 type=write size=2423572 2024-03-04T12:41:20.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.183+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~FL0Q5AM8CW0T.0 size=1048576 2024-03-04T12:41:20.190 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.184+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~FL0Q5AM8CW0T.1 size=510718 2024-03-04T12:41:20.190 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.184+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=FL0Q5AM8CW0T tag=M7I9XN5X62BT type=write size=2607870 2024-03-04T12:41:20.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.185+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~D1TMJV9C6ID1.0 size=1048576 2024-03-04T12:41:20.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.186+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~D1TMJV9C6ID1.1 size=236533 2024-03-04T12:41:20.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.188+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=D1TMJV9C6ID1 tag=NM2ACJO08NUW type=write size=2333685 2024-03-04T12:41:20.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.190+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~B4S56UN20YOH.0 size=1048576 2024-03-04T12:41:20.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.191+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~B4S56UN20YOH.1 size=123885 2024-03-04T12:41:20.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.191+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=B4S56UN20YOH tag=7XFNCC4489P7 type=write size=2221037 2024-03-04T12:41:20.198 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.192+0000 7f093583d780 -1 < failed to complete operation key=Q45PKXZVJ6YS tag=N53Z0Y6A6AUK type=write size=544683: (22) Invalid argument 2024-03-04T12:41:20.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.193+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=O4LMPUPM1AV2 type=del size=1545290 2024-03-04T12:41:20.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.194+0000 7f093583d780 1 < canceled part key=_multipart_HG0EM344TJZY.2~6YV4SF3P93K2.0 size=1048576 2024-03-04T12:41:20.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.195+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~6YV4SF3P93K2.1 size=1048576 2024-03-04T12:41:20.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.196+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~6YV4SF3P93K2.2 size=717001 2024-03-04T12:41:20.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.198+0000 7f093583d780 1 < canceled multipart upload key=HG0EM344TJZY upload=6YV4SF3P93K2 tag=6SBLGOR0RR7C type=write size=3862729 2024-03-04T12:41:20.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.200+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~FM5V9IV8G71M.0 size=81550 2024-03-04T12:41:20.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.200+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=FM5V9IV8G71M tag=WKLF0IYZQWV1 type=write size=1130126 2024-03-04T12:41:20.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.201+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=49TO7CATRCNZ type=del 2024-03-04T12:41:20.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.202+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=E92ZRXK08OOQ type=del size=1770896 2024-03-04T12:41:20.209 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.203+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~QTDYJEWJNUJ2.0 size=1048576 2024-03-04T12:41:20.210 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.204+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~QTDYJEWJNUJ2.1 size=1048576 2024-03-04T12:41:20.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.205+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~QTDYJEWJNUJ2.2 size=872529 2024-03-04T12:41:20.212 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.207+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=QTDYJEWJNUJ2 tag=46EIZ3M6FVRG type=write size=4018257 2024-03-04T12:41:20.213 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.208+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=A78V6GV2EI74 type=del size=3032652 2024-03-04T12:41:20.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.209+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=H1A7DBUGRLK4 type=del 2024-03-04T12:41:20.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.211+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~SGVOB1RTXSKH.0 size=1048576 2024-03-04T12:41:20.217 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.212+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~SGVOB1RTXSKH.1 size=987521 2024-03-04T12:41:20.218 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.212+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=SGVOB1RTXSKH tag=5X8DZI58ZJVV type=write size=3084673 2024-03-04T12:41:20.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.213+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~QP2286ZKPU43.0 size=920088 2024-03-04T12:41:20.221 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.215+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=QP2286ZKPU43 tag=V28NNMGV7XC0 type=write size=1968664 2024-03-04T12:41:20.223 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.217+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~YG580H6RCABY.0 size=1048576 2024-03-04T12:41:20.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.218+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~YG580H6RCABY.1 size=632708 2024-03-04T12:41:20.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.218+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=YG580H6RCABY tag=J3E073FWLIP5 type=write size=2729860 2024-03-04T12:41:20.225 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.220+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~NKFC79OY5YTB.0 size=1048576 2024-03-04T12:41:20.225 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.220+0000 7f093583d780 1 < canceled part key=_multipart_NFM6LT89K5F4.2~NKFC79OY5YTB.1 size=1048576 2024-03-04T12:41:20.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.221+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~NKFC79OY5YTB.2 size=203766 2024-03-04T12:41:20.228 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.222+0000 7f093583d780 1 < canceled multipart upload key=NFM6LT89K5F4 upload=NKFC79OY5YTB tag=1WT0ZXV2Z1A3 type=write size=3349494 2024-03-04T12:41:20.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.225+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~AJ0Z1MUIOXHX.0 size=156961 2024-03-04T12:41:20.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.225+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=AJ0Z1MUIOXHX tag=ICQG20TPQHWL type=write size=1205537 2024-03-04T12:41:20.232 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.227+0000 7f093583d780 1 < suggested remove operation key=54FLC10FWKL6 tag=29Y6CXPPRELF type=del 2024-03-04T12:41:20.234 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.229+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~WC90TO5PY0UD.0 size=1048576 2024-03-04T12:41:20.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.230+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~WC90TO5PY0UD.1 size=994151 2024-03-04T12:41:20.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.230+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=WC90TO5PY0UD tag=6SLIFX847K3H type=write size=3091303 2024-03-04T12:41:20.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.231+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=F85XRO6GAWN1 type=del 2024-03-04T12:41:20.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.232+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=EYYPU503YQVG type=del size=2636378 2024-03-04T12:41:20.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.233+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~DHSRDH9GCWJU.0 size=1048576 2024-03-04T12:41:20.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.233+0000 7f093583d780 1 < canceled part key=_multipart_3F8GI0JCUR6W.2~DHSRDH9GCWJU.1 size=680617 2024-03-04T12:41:20.240 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.235+0000 7f093583d780 1 < canceled multipart upload key=3F8GI0JCUR6W upload=DHSRDH9GCWJU tag=SM9Y4FRCT93W type=write size=2777769 2024-03-04T12:41:20.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.237+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~4FUQQMPA9XXW.0 size=138975 2024-03-04T12:41:20.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.237+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=4FUQQMPA9XXW tag=CHNK84DD6YVZ type=write size=1187551 2024-03-04T12:41:20.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.238+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~1GJS8CCC3SM4.0 size=1048576 2024-03-04T12:41:20.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.239+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~1GJS8CCC3SM4.1 size=213122 2024-03-04T12:41:20.246 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.241+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=1GJS8CCC3SM4 tag=QN7ZN982N70N type=write size=2310274 2024-03-04T12:41:20.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.243+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~B8IY9AW2Y7W2.0 size=1048576 2024-03-04T12:41:20.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.244+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~B8IY9AW2Y7W2.1 size=1048576 2024-03-04T12:41:20.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.245+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~B8IY9AW2Y7W2.2 size=87999 2024-03-04T12:41:20.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.245+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=B8IY9AW2Y7W2 tag=R6DQF6E2357L type=write size=3233727 2024-03-04T12:41:20.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.246+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=M8HB4DUZT7DD type=del 2024-03-04T12:41:20.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.247+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=HX0Z00CP1HFZ type=del size=86705 2024-03-04T12:41:20.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.248+0000 7f093583d780 1 < completed delete operation key=UAEQORB3BDBH tag=HCMMVOUCYBU7 type=del 2024-03-04T12:41:20.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.250+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~B1NSU1RSGO4H.0 size=1048576 2024-03-04T12:41:20.257 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.251+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~B1NSU1RSGO4H.1 size=1048576 2024-03-04T12:41:20.257 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.252+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~B1NSU1RSGO4H.2 size=140978 2024-03-04T12:41:20.257 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.252+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=B1NSU1RSGO4H tag=MCX9HYJJ7HF2 type=write size=3286706 2024-03-04T12:41:20.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.253+0000 7f093583d780 1 < completed write operation key=9VKN43CB955V tag=856BIQIUROW6 type=write size=739276 2024-03-04T12:41:20.259 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.254+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=N8650KVGE22F type=del size=131619 2024-03-04T12:41:20.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.255+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~FL0Q5AM8CW0T.0 size=1048576 2024-03-04T12:41:20.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.256+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~FL0Q5AM8CW0T.1 size=510718 2024-03-04T12:41:20.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.258+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=FL0Q5AM8CW0T tag=M7I9XN5X62BT type=write size=2607870 2024-03-04T12:41:20.264 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.259+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=VGYZS1SL8I4S type=del size=1277202 2024-03-04T12:41:20.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.260+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~B4S56UN20YOH.0 size=1048576 2024-03-04T12:41:20.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.261+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~B4S56UN20YOH.1 size=123885 2024-03-04T12:41:20.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.264+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=B4S56UN20YOH tag=7XFNCC4489P7 type=write size=2221037 2024-03-04T12:41:20.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.265+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=4AFQ5TGMF35L type=del size=3002006 2024-03-04T12:41:20.272 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.266+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=O4LMPUPM1AV2 type=del 2024-03-04T12:41:20.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.267+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=MHIZZMWKOK4C type=del size=2206438 2024-03-04T12:41:20.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.269+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~FM5V9IV8G71M.0 size=81550 2024-03-04T12:41:20.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.270+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=FM5V9IV8G71M tag=WKLF0IYZQWV1 type=write size=1130126 2024-03-04T12:41:20.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.272+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=7MJHBJXMADO2 type=del size=2051378 2024-03-04T12:41:20.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.273+0000 7f093583d780 1 < canceled operation key=OCOQJLUUNWRG tag=E92ZRXK08OOQ type=del size=1770896 2024-03-04T12:41:20.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.274+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=4UIHZDRNLZ80 type=del size=435532 2024-03-04T12:41:20.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.275+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=A78V6GV2EI74 type=del 2024-03-04T12:41:20.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.277+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~1O6TPLER3N45.0 size=1048576 2024-03-04T12:41:20.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.278+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~1O6TPLER3N45.1 size=1048576 2024-03-04T12:41:20.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.278+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~1O6TPLER3N45.2 size=277271 2024-03-04T12:41:20.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.279+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=1O6TPLER3N45 tag=4WW1Q2MPJCSB type=write size=3422999 2024-03-04T12:41:20.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.280+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~SGVOB1RTXSKH.0 size=1048576 2024-03-04T12:41:20.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.281+0000 7f093583d780 1 < completed part key=_multipart_I6DIP4VGHMNO.2~SGVOB1RTXSKH.1 size=987521 2024-03-04T12:41:20.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.282+0000 7f093583d780 1 < completed multipart upload key=I6DIP4VGHMNO upload=SGVOB1RTXSKH tag=5X8DZI58ZJVV type=write size=3084673 2024-03-04T12:41:20.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.284+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=DW3AFS0CRE0C type=del size=2992245 2024-03-04T12:41:20.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.285+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~YG580H6RCABY.0 size=1048576 2024-03-04T12:41:20.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.286+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~YG580H6RCABY.1 size=632708 2024-03-04T12:41:20.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.288+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=YG580H6RCABY tag=J3E073FWLIP5 type=write size=2729860 2024-03-04T12:41:20.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.290+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~YJBP7421A178.0 size=1048576 2024-03-04T12:41:20.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.291+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~YJBP7421A178.1 size=570795 2024-03-04T12:41:20.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.291+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=YJBP7421A178 tag=80UJEY6MDW9O type=write size=2667947 2024-03-04T12:41:20.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.292+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~AJ0Z1MUIOXHX.0 size=156961 2024-03-04T12:41:20.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.294+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=AJ0Z1MUIOXHX tag=ICQG20TPQHWL type=write size=1205537 2024-03-04T12:41:20.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.295+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=A2PF4ZTCZ3XM type=del size=3662157 2024-03-04T12:41:20.302 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.296+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~WC90TO5PY0UD.0 size=1048576 2024-03-04T12:41:20.302 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.296+0000 7f093583d780 1 < canceled part key=_multipart_O6OUISHWZ7FU.2~WC90TO5PY0UD.1 size=994151 2024-03-04T12:41:20.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.298+0000 7f093583d780 1 < canceled multipart upload key=O6OUISHWZ7FU upload=WC90TO5PY0UD tag=6SLIFX847K3H type=write size=3091303 2024-03-04T12:41:20.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.299+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=17QKE2I7FFQB type=del size=1443595 2024-03-04T12:41:20.306 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.300+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=EYYPU503YQVG type=del 2024-03-04T12:41:20.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.301+0000 7f093583d780 1 > prepared operation key=F269PJEZ05IO tag=2BN3UO0ZTTUZ type=del size=589201 2024-03-04T12:41:20.308 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.303+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~4FUQQMPA9XXW.0 size=138975 2024-03-04T12:41:20.310 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.305+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=4FUQQMPA9XXW tag=CHNK84DD6YVZ type=write size=1187551 2024-03-04T12:41:20.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.307+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~ONVZ2WT4LVGI.0 size=1048576 2024-03-04T12:41:20.313 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.308+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~ONVZ2WT4LVGI.1 size=1048576 2024-03-04T12:41:20.314 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.309+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~ONVZ2WT4LVGI.2 size=341083 2024-03-04T12:41:20.314 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.309+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=ONVZ2WT4LVGI tag=Z6SP7FKOC2UE type=write size=3486811 2024-03-04T12:41:20.315 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.310+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~B8IY9AW2Y7W2.0 size=1048576 2024-03-04T12:41:20.316 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.311+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~B8IY9AW2Y7W2.1 size=1048576 2024-03-04T12:41:20.317 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.312+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~B8IY9AW2Y7W2.2 size=87999 2024-03-04T12:41:20.319 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.314+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=B8IY9AW2Y7W2 tag=R6DQF6E2357L type=write size=3233727 2024-03-04T12:41:20.320 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.315+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=6ISXSU47YL38 type=del size=2857367 2024-03-04T12:41:20.322 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.316+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=HX0Z00CP1HFZ type=del 2024-03-04T12:41:20.323 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.317+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=TGBGWQJ184E8 type=del size=1843066 2024-03-04T12:41:20.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.318+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~B1NSU1RSGO4H.0 size=1048576 2024-03-04T12:41:20.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.319+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~B1NSU1RSGO4H.1 size=1048576 2024-03-04T12:41:20.326 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.320+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~B1NSU1RSGO4H.2 size=140978 2024-03-04T12:41:20.328 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.322+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=B1NSU1RSGO4H tag=MCX9HYJJ7HF2 type=write size=3286706 2024-03-04T12:41:20.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.323+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=5JQQ6NB0MK4G type=del size=1896262 2024-03-04T12:41:20.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.324+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=N8650KVGE22F type=del 2024-03-04T12:41:20.333 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.327+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~1KV18X27P4XU.0 size=816270 2024-03-04T12:41:20.333 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.327+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=1KV18X27P4XU tag=4I8Q0O06KGA7 type=write size=1864846 2024-03-04T12:41:20.333 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.328+0000 7f093583d780 1 < canceled operation key=O6OUISHWZ7FU tag=VGYZS1SL8I4S type=del size=1277202 2024-03-04T12:41:20.335 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.330+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~RJ37UCJX8QTF.0 size=1048576 2024-03-04T12:41:20.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.331+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~RJ37UCJX8QTF.1 size=657538 2024-03-04T12:41:20.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.331+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=RJ37UCJX8QTF tag=IDHW7DBAI48H type=write size=2754690 2024-03-04T12:41:20.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.332+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=4AFQ5TGMF35L type=del 2024-03-04T12:41:20.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.335+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~FTGJDGI5X8T8.0 size=1048576 2024-03-04T12:41:20.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.336+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~FTGJDGI5X8T8.1 size=1048576 2024-03-04T12:41:20.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.337+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~FTGJDGI5X8T8.2 size=492624 2024-03-04T12:41:20.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.337+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=FTGJDGI5X8T8 tag=ABYDCPHK2H1Z type=write size=3638352 2024-03-04T12:41:20.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.338+0000 7f093583d780 1 < completed delete operation key=NQF43I07F2HT tag=MHIZZMWKOK4C type=del 2024-03-04T12:41:20.345 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.340+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~243AQKQFT0SN.0 size=343105 2024-03-04T12:41:20.345 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.340+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=243AQKQFT0SN tag=6BPVSRC31QMU type=write size=1391681 2024-03-04T12:41:20.347 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.341+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=7MJHBJXMADO2 type=del 2024-03-04T12:41:20.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.343+0000 7f093583d780 1 > prepared part key=_multipart_I5NQBROT0WKE.2~X6AM0GG1FJLX.0 size=868655 2024-03-04T12:41:20.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.343+0000 7f093583d780 1 > prepared multipart upload key=I5NQBROT0WKE upload=X6AM0GG1FJLX tag=T4G9HBVFVOT0 type=write size=1917231 2024-03-04T12:41:20.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.344+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=4UIHZDRNLZ80 type=del 2024-03-04T12:41:20.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.346+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~I0234LC0FDBJ.0 size=1032205 2024-03-04T12:41:20.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.346+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=I0234LC0FDBJ tag=PNT9L7K5K5ZN type=write size=2080781 2024-03-04T12:41:20.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.348+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~1O6TPLER3N45.0 size=1048576 2024-03-04T12:41:20.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.349+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~1O6TPLER3N45.1 size=1048576 2024-03-04T12:41:20.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.349+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~1O6TPLER3N45.2 size=277271 2024-03-04T12:41:20.357 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.352+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=1O6TPLER3N45 tag=4WW1Q2MPJCSB type=write size=3422999 2024-03-04T12:41:20.359 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.353+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=WPLY5G7MOOBZ type=del size=4157958 2024-03-04T12:41:20.360 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.354+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=DW3AFS0CRE0C type=del 2024-03-04T12:41:20.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.357+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~173IK6YQFOMR.0 size=414425 2024-03-04T12:41:20.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.357+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=173IK6YQFOMR tag=UANAZ4PPN0KZ type=write size=1463001 2024-03-04T12:41:20.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.358+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~YJBP7421A178.0 size=1048576 2024-03-04T12:41:20.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.358+0000 7f093583d780 1 < canceled part key=_multipart_3F8GI0JCUR6W.2~YJBP7421A178.1 size=570795 2024-03-04T12:41:20.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.360+0000 7f093583d780 1 < canceled multipart upload key=3F8GI0JCUR6W upload=YJBP7421A178 tag=80UJEY6MDW9O type=write size=2667947 2024-03-04T12:41:20.366 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.361+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=LX3O611FDA53 type=write size=564235 2024-03-04T12:41:20.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.362+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=A2PF4ZTCZ3XM type=del 2024-03-04T12:41:20.368 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.363+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=UTS7QV8UW0L7 type=write size=934063 2024-03-04T12:41:20.369 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.364+0000 7f093583d780 1 < completed delete operation key=F269PJEZ05IO tag=17QKE2I7FFQB type=del 2024-03-04T12:41:20.370 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.365+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=9F9SQ8T64S2N type=del size=3517392 2024-03-04T12:41:20.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.366+0000 7f093583d780 1 < canceled operation key=F269PJEZ05IO tag=2BN3UO0ZTTUZ type=del size=589201 2024-03-04T12:41:20.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.367+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=NP00JSX8IC5Z type=del size=376250 2024-03-04T12:41:20.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.368+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~ONVZ2WT4LVGI.0 size=1048576 2024-03-04T12:41:20.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.369+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~ONVZ2WT4LVGI.1 size=1048576 2024-03-04T12:41:20.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.372+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~ONVZ2WT4LVGI.2 size=341083 2024-03-04T12:41:20.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.374+0000 7f093583d780 1 < completed multipart upload key=NQF43I07F2HT upload=ONVZ2WT4LVGI tag=Z6SP7FKOC2UE type=write size=3486811 2024-03-04T12:41:20.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.376+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~BV0CO6DGQL20.0 size=1048576 2024-03-04T12:41:20.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.377+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~BV0CO6DGQL20.1 size=1048576 2024-03-04T12:41:20.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.377+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~BV0CO6DGQL20.2 size=512169 2024-03-04T12:41:20.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.377+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=BV0CO6DGQL20 tag=XQHGCMGQ3RKD type=write size=3657897 2024-03-04T12:41:20.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.379+0000 7f093583d780 1 < completed delete operation key=2R5WA9Q9ZAUG tag=6ISXSU47YL38 type=del 2024-03-04T12:41:20.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.381+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~R6ZR7EQUFB6D.0 size=1048576 2024-03-04T12:41:20.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.382+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~R6ZR7EQUFB6D.1 size=864835 2024-03-04T12:41:20.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.382+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=R6ZR7EQUFB6D tag=TLGNVB6OAU7Y type=write size=2961987 2024-03-04T12:41:20.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.383+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=TGBGWQJ184E8 type=del 2024-03-04T12:41:20.389 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.384+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=XTU7WCV77U5W type=del size=4097398 2024-03-04T12:41:20.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.385+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=5JQQ6NB0MK4G type=del 2024-03-04T12:41:20.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.387+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~9496GMYY8XZW.0 size=833538 2024-03-04T12:41:20.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.387+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=9496GMYY8XZW tag=T0D85GUDEOI9 type=write size=1882114 2024-03-04T12:41:20.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.387+0000 7f093583d780 1 < canceled part key=_multipart_F269PJEZ05IO.2~1KV18X27P4XU.0 size=816270 2024-03-04T12:41:20.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.389+0000 7f093583d780 1 < canceled multipart upload key=F269PJEZ05IO upload=1KV18X27P4XU tag=4I8Q0O06KGA7 type=write size=1864846 2024-03-04T12:41:20.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.391+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=1KRHVAU1IX50 type=del size=1257942 2024-03-04T12:41:20.397 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.392+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~RJ37UCJX8QTF.0 size=1048576 2024-03-04T12:41:20.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.393+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~RJ37UCJX8QTF.1 size=657538 2024-03-04T12:41:20.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.395+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=RJ37UCJX8QTF tag=IDHW7DBAI48H type=write size=2754690 2024-03-04T12:41:20.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.397+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~VGVY885XV7CW.0 size=805354 2024-03-04T12:41:20.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.397+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=VGVY885XV7CW tag=MX4HV8G9ATIA type=write size=1853930 2024-03-04T12:41:20.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.398+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~FTGJDGI5X8T8.0 size=1048576 2024-03-04T12:41:20.404 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.399+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~FTGJDGI5X8T8.1 size=1048576 2024-03-04T12:41:20.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.400+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~FTGJDGI5X8T8.2 size=492624 2024-03-04T12:41:20.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.402+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=FTGJDGI5X8T8 tag=ABYDCPHK2H1Z type=write size=3638352 2024-03-04T12:41:20.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.403+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=I3FD7ENYZIJ5 type=del size=3187555 2024-03-04T12:41:20.410 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.404+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~243AQKQFT0SN.0 size=343105 2024-03-04T12:41:20.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.406+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=243AQKQFT0SN tag=6BPVSRC31QMU type=write size=1391681 2024-03-04T12:41:20.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.407+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=YQOB19S9L681 type=del size=2704591 2024-03-04T12:41:20.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.408+0000 7f093583d780 1 < completed part key=_multipart_I5NQBROT0WKE.2~X6AM0GG1FJLX.0 size=868655 2024-03-04T12:41:20.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.410+0000 7f093583d780 1 < completed multipart upload key=I5NQBROT0WKE upload=X6AM0GG1FJLX tag=T4G9HBVFVOT0 type=write size=1917231 2024-03-04T12:41:20.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.412+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~RTD3E32TC58S.0 size=1048576 2024-03-04T12:41:20.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.413+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~RTD3E32TC58S.1 size=1048576 2024-03-04T12:41:20.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.414+0000 7f093583d780 1 > prepared part key=_multipart_GMKM2QEP072H.2~RTD3E32TC58S.2 size=828855 2024-03-04T12:41:20.420 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.414+0000 7f093583d780 1 > prepared multipart upload key=GMKM2QEP072H upload=RTD3E32TC58S tag=LLD7MUW1FBJV type=write size=3974583 2024-03-04T12:41:20.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.415+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~I0234LC0FDBJ.0 size=1032205 2024-03-04T12:41:20.423 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.417+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=I0234LC0FDBJ tag=PNT9L7K5K5ZN type=write size=2080781 2024-03-04T12:41:20.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.419+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~XV71FM8ZXS3M.0 size=595314 2024-03-04T12:41:20.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.419+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=XV71FM8ZXS3M tag=K802Y5GAYXIM type=write size=1643890 2024-03-04T12:41:20.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.420+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=WPLY5G7MOOBZ type=del 2024-03-04T12:41:20.427 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.422+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=1UOR42VRB63M type=del size=2536447 2024-03-04T12:41:20.429 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.423+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~173IK6YQFOMR.0 size=414425 2024-03-04T12:41:20.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.425+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=173IK6YQFOMR tag=UANAZ4PPN0KZ type=write size=1463001 2024-03-04T12:41:20.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.427+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~GKSLJKLJ5DAO.0 size=1048576 2024-03-04T12:41:20.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.428+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~GKSLJKLJ5DAO.1 size=949967 2024-03-04T12:41:20.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.428+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=GKSLJKLJ5DAO tag=NIK5W4HLC0LZ type=write size=3047119 2024-03-04T12:41:20.436 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.430+0000 7f093583d780 1 < suggested remove operation key=FT2XNJYYT30J tag=LX3O611FDA53 type=write 2024-03-04T12:41:20.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.431+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=MINJULA3UREK type=del size=4109116 2024-03-04T12:41:20.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.433+0000 7f093583d780 1 < completed write operation key=9VKN43CB955V tag=UTS7QV8UW0L7 type=write size=934063 2024-03-04T12:41:20.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.434+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=C2H2ELPN4CP0 type=write size=224092 2024-03-04T12:41:20.442 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.436+0000 7f093583d780 1 < suggested remove operation key=96PTQ2KHPMMM tag=9F9SQ8T64S2N type=del 2024-03-04T12:41:20.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.438+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~ZA003O595ULL.0 size=281840 2024-03-04T12:41:20.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.438+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=ZA003O595ULL tag=4XYZ0MEJZVIG type=write size=1330416 2024-03-04T12:41:20.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.439+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=NP00JSX8IC5Z type=del 2024-03-04T12:41:20.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.441+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=VBJJ96TYN141 type=del size=1501638 2024-03-04T12:41:20.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.442+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~BV0CO6DGQL20.0 size=1048576 2024-03-04T12:41:20.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.442+0000 7f093583d780 1 < canceled part key=_multipart_9E12MS7PETOK.2~BV0CO6DGQL20.1 size=1048576 2024-03-04T12:41:20.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.442+0000 7f093583d780 1 < canceled part key=_multipart_9E12MS7PETOK.2~BV0CO6DGQL20.2 size=512169 2024-03-04T12:41:20.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.444+0000 7f093583d780 1 < canceled multipart upload key=9E12MS7PETOK upload=BV0CO6DGQL20 tag=XQHGCMGQ3RKD type=write size=3657897 2024-03-04T12:41:20.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.446+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~Q53ULO9UGM7R.0 size=591556 2024-03-04T12:41:20.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.446+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=Q53ULO9UGM7R tag=6KDPIU5CR6Z7 type=write size=1640132 2024-03-04T12:41:20.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.447+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~R6ZR7EQUFB6D.0 size=1048576 2024-03-04T12:41:20.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.448+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~R6ZR7EQUFB6D.1 size=864835 2024-03-04T12:41:20.455 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.449+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=R6ZR7EQUFB6D tag=TLGNVB6OAU7Y type=write size=2961987 2024-03-04T12:41:20.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.451+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=AVRLG3JS6UU2 type=write size=886040 2024-03-04T12:41:20.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.452+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=XTU7WCV77U5W type=del 2024-03-04T12:41:20.459 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.454+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~0Z8Y93WY9QSW.0 size=1048576 2024-03-04T12:41:20.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.455+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~0Z8Y93WY9QSW.1 size=1048576 2024-03-04T12:41:20.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.455+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~0Z8Y93WY9QSW.2 size=73005 2024-03-04T12:41:20.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.455+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=0Z8Y93WY9QSW tag=MO0XTJUP31P8 type=write size=3218733 2024-03-04T12:41:20.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.457+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~9496GMYY8XZW.0 size=833538 2024-03-04T12:41:20.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.458+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=9496GMYY8XZW tag=T0D85GUDEOI9 type=write size=1882114 2024-03-04T12:41:20.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.460+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~81MCX2APFKVG.0 size=1048576 2024-03-04T12:41:20.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.461+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~81MCX2APFKVG.1 size=1048576 2024-03-04T12:41:20.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.462+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~81MCX2APFKVG.2 size=216858 2024-03-04T12:41:20.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.462+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=81MCX2APFKVG tag=DJMDLT9XV5OL type=write size=3362586 2024-03-04T12:41:20.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.463+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=1KRHVAU1IX50 type=del 2024-03-04T12:41:20.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.465+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~XJRMTP56O4TC.0 size=29200 2024-03-04T12:41:20.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.465+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=XJRMTP56O4TC tag=23OFEKBE0M3H type=write size=1077776 2024-03-04T12:41:20.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.466+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~VGVY885XV7CW.0 size=805354 2024-03-04T12:41:20.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.468+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=VGVY885XV7CW tag=MX4HV8G9ATIA type=write size=1853930 2024-03-04T12:41:20.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.469+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=MIN2J66ZHMKU type=write size=906460 2024-03-04T12:41:20.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.469+0000 7f093583d780 -1 < no bi entry to suggest for operation key=96PTQ2KHPMMM tag=I3FD7ENYZIJ5 type=del size=3187555: (2) No such file or directory 2024-03-04T12:41:20.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.471+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~QLM1KUWF7LQH.0 size=1048576 2024-03-04T12:41:20.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.472+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~QLM1KUWF7LQH.1 size=920768 2024-03-04T12:41:20.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.472+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=QLM1KUWF7LQH tag=RUO5MOP19JZQ type=write size=3017920 2024-03-04T12:41:20.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.473+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=YQOB19S9L681 type=del 2024-03-04T12:41:20.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.477+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~LQG5W7KIE56K.0 size=1048576 2024-03-04T12:41:20.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.479+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~LQG5W7KIE56K.1 size=745182 2024-03-04T12:41:20.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.479+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=LQG5W7KIE56K tag=3GQB27IK7CHT type=write size=2842334 2024-03-04T12:41:20.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.480+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~RTD3E32TC58S.0 size=1048576 2024-03-04T12:41:20.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.481+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~RTD3E32TC58S.1 size=1048576 2024-03-04T12:41:20.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.482+0000 7f093583d780 1 < completed part key=_multipart_GMKM2QEP072H.2~RTD3E32TC58S.2 size=828855 2024-03-04T12:41:20.490 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.484+0000 7f093583d780 1 < completed multipart upload key=GMKM2QEP072H upload=RTD3E32TC58S tag=LLD7MUW1FBJV type=write size=3974583 2024-03-04T12:41:20.491 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.485+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=CPOZUH443PLZ type=del size=3461173 2024-03-04T12:41:20.492 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.487+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~XV71FM8ZXS3M.0 size=595314 2024-03-04T12:41:20.495 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.489+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=XV71FM8ZXS3M tag=K802Y5GAYXIM type=write size=1643890 2024-03-04T12:41:20.496 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.490+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=XJL6R1E8PJGU type=del size=2436154 2024-03-04T12:41:20.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.492+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=1UOR42VRB63M type=del 2024-03-04T12:41:20.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.493+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=BCW6GU3N5N9A type=del size=184185 2024-03-04T12:41:20.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.494+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~GKSLJKLJ5DAO.0 size=1048576 2024-03-04T12:41:20.501 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.495+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~GKSLJKLJ5DAO.1 size=949967 2024-03-04T12:41:20.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.497+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=GKSLJKLJ5DAO tag=NIK5W4HLC0LZ type=write size=3047119 2024-03-04T12:41:20.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.499+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~DUK3EY7V229X.0 size=1048576 2024-03-04T12:41:20.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.500+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~DUK3EY7V229X.1 size=1048576 2024-03-04T12:41:20.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.502+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~DUK3EY7V229X.2 size=490893 2024-03-04T12:41:20.507 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.502+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=DUK3EY7V229X tag=MV7FWBL0Y87Z type=write size=3636621 2024-03-04T12:41:20.508 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.503+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=MINJULA3UREK type=del 2024-03-04T12:41:20.510 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.504+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=6ZZ66IEOXSQF type=del size=2604716 2024-03-04T12:41:20.511 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.505+0000 7f093583d780 1 < completed write operation key=TMAI6MOG2C4N tag=C2H2ELPN4CP0 type=write size=224092 2024-03-04T12:41:20.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.506+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=2HTLD8B2WLN3 type=del size=3757952 2024-03-04T12:41:20.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.507+0000 7f093583d780 1 < canceled part key=_multipart_AQI7H63EQSTN.2~ZA003O595ULL.0 size=281840 2024-03-04T12:41:20.514 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.509+0000 7f093583d780 1 < canceled multipart upload key=AQI7H63EQSTN upload=ZA003O595ULL tag=4XYZ0MEJZVIG type=write size=1330416 2024-03-04T12:41:20.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.510+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=PTN8A2DYX0NW type=del size=2001763 2024-03-04T12:41:20.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.511+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=VBJJ96TYN141 type=del 2024-03-04T12:41:20.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.512+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=2AC37G3WREUY type=del size=1482351 2024-03-04T12:41:20.518 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.513+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~Q53ULO9UGM7R.0 size=591556 2024-03-04T12:41:20.520 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.515+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=Q53ULO9UGM7R tag=6KDPIU5CR6Z7 type=write size=1640132 2024-03-04T12:41:20.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.516+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=466BC5O14CUD type=del size=1043231 2024-03-04T12:41:20.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.518+0000 7f093583d780 1 < suggested update operation key=L4UQK3UJFXZC tag=AVRLG3JS6UU2 type=write size=886040 2024-03-04T12:41:20.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.521+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~3YRWXB4BAIYQ.0 size=1048576 2024-03-04T12:41:20.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.521+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~3YRWXB4BAIYQ.1 size=1012882 2024-03-04T12:41:20.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.522+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=3YRWXB4BAIYQ tag=BZDH0XEH032L type=write size=3110034 2024-03-04T12:41:20.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.523+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~0Z8Y93WY9QSW.0 size=1048576 2024-03-04T12:41:20.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.524+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~0Z8Y93WY9QSW.1 size=1048576 2024-03-04T12:41:20.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.525+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~0Z8Y93WY9QSW.2 size=73005 2024-03-04T12:41:20.532 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.526+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=0Z8Y93WY9QSW tag=MO0XTJUP31P8 type=write size=3218733 2024-03-04T12:41:20.534 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.529+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~AV1VFS8JQ7CI.0 size=1048576 2024-03-04T12:41:20.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.529+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~AV1VFS8JQ7CI.1 size=142528 2024-03-04T12:41:20.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.529+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=AV1VFS8JQ7CI tag=M5FY53PQA0QF type=write size=2239680 2024-03-04T12:41:20.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.530+0000 7f093583d780 1 < canceled part key=_multipart_2XVNK3YEVHJ7.2~81MCX2APFKVG.0 size=1048576 2024-03-04T12:41:20.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.531+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~81MCX2APFKVG.1 size=1048576 2024-03-04T12:41:20.540 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.531+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~81MCX2APFKVG.2 size=216858 2024-03-04T12:41:20.540 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.533+0000 7f093583d780 1 < canceled multipart upload key=2XVNK3YEVHJ7 upload=81MCX2APFKVG tag=DJMDLT9XV5OL type=write size=3362586 2024-03-04T12:41:20.540 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.534+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=0611UI0743D8 type=del size=2363987 2024-03-04T12:41:20.541 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.535+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~XJRMTP56O4TC.0 size=29200 2024-03-04T12:41:20.543 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.537+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=XJRMTP56O4TC tag=23OFEKBE0M3H type=write size=1077776 2024-03-04T12:41:20.544 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.538+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=8J0Z9U6H9BM1 type=del size=665526 2024-03-04T12:41:20.545 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.540+0000 7f093583d780 1 < completed write operation key=M0AOZ89IQNSK tag=MIN2J66ZHMKU type=write size=906460 2024-03-04T12:41:20.546 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.541+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=2CTJH74WE5C3 type=del size=3115022 2024-03-04T12:41:20.547 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.542+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~QLM1KUWF7LQH.0 size=1048576 2024-03-04T12:41:20.547 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.542+0000 7f093583d780 1 < canceled part key=_multipart_Q45PKXZVJ6YS.2~QLM1KUWF7LQH.1 size=920768 2024-03-04T12:41:20.549 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.544+0000 7f093583d780 1 < canceled multipart upload key=Q45PKXZVJ6YS upload=QLM1KUWF7LQH tag=RUO5MOP19JZQ type=write size=3017920 2024-03-04T12:41:20.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.548+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~IJ71UIE76841.0 size=157987 2024-03-04T12:41:20.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.548+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=IJ71UIE76841 tag=RY79DBZK5S2C type=write size=1206563 2024-03-04T12:41:20.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.549+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~LQG5W7KIE56K.0 size=1048576 2024-03-04T12:41:20.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.549+0000 7f093583d780 1 < canceled part key=_multipart_9VKN43CB955V.2~LQG5W7KIE56K.1 size=745182 2024-03-04T12:41:20.556 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.551+0000 7f093583d780 1 < canceled multipart upload key=9VKN43CB955V upload=LQG5W7KIE56K tag=3GQB27IK7CHT type=write size=2842334 2024-03-04T12:41:20.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.552+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=D0HEXX45KC8L type=del size=3184066 2024-03-04T12:41:20.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.553+0000 7f093583d780 -1 < failed to complete operation key=L4UQK3UJFXZC tag=CPOZUH443PLZ type=del size=3461173: (22) Invalid argument 2024-03-04T12:41:20.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.555+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~AULOKOKQ254Z.0 size=1048576 2024-03-04T12:41:20.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.556+0000 7f093583d780 1 > prepared part key=_multipart_PT63VLFQQN0E.2~AULOKOKQ254Z.1 size=142681 2024-03-04T12:41:20.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.556+0000 7f093583d780 1 > prepared multipart upload key=PT63VLFQQN0E upload=AULOKOKQ254Z tag=AYYGN4POP8ZT type=write size=2239833 2024-03-04T12:41:20.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.557+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=XJL6R1E8PJGU type=del 2024-03-04T12:41:20.564 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.558+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=JUCCAJV9IFZM type=write size=908152 2024-03-04T12:41:20.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.559+0000 7f093583d780 -1 < failed to complete operation key=L4UQK3UJFXZC tag=BCW6GU3N5N9A type=del size=184185: (22) Invalid argument 2024-03-04T12:41:20.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.561+0000 7f093583d780 1 > prepared part key=_multipart_GJ0FQ6EH9HJL.2~PVZ3909HO2OM.0 size=685246 2024-03-04T12:41:20.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.561+0000 7f093583d780 1 > prepared multipart upload key=GJ0FQ6EH9HJL upload=PVZ3909HO2OM tag=ZUBJWN5U6VGW type=write size=1733822 2024-03-04T12:41:20.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.562+0000 7f093583d780 1 < canceled part key=_multipart_Q45PKXZVJ6YS.2~DUK3EY7V229X.0 size=1048576 2024-03-04T12:41:20.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.563+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~DUK3EY7V229X.1 size=1048576 2024-03-04T12:41:20.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.563+0000 7f093583d780 1 < canceled part key=_multipart_Q45PKXZVJ6YS.2~DUK3EY7V229X.2 size=490893 2024-03-04T12:41:20.570 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.564+0000 7f093583d780 1 < canceled multipart upload key=Q45PKXZVJ6YS upload=DUK3EY7V229X tag=MV7FWBL0Y87Z type=write size=3636621 2024-03-04T12:41:20.571 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.566+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=JEYG3AKYS8GU type=del size=3633156 2024-03-04T12:41:20.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.568+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=6ZZ66IEOXSQF type=del 2024-03-04T12:41:20.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.570+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~PLVK2Y706B9M.0 size=1048576 2024-03-04T12:41:20.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.571+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~PLVK2Y706B9M.1 size=1048576 2024-03-04T12:41:20.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.572+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~PLVK2Y706B9M.2 size=319389 2024-03-04T12:41:20.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.572+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=PLVK2Y706B9M tag=0LTGRRDGFOX8 type=write size=3465117 2024-03-04T12:41:20.579 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.573+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=2HTLD8B2WLN3 type=del 2024-03-04T12:41:20.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.575+0000 7f093583d780 1 > prepared part key=_multipart_OCOQJLUUNWRG.2~UTQX6PYGA462.0 size=738829 2024-03-04T12:41:20.581 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.575+0000 7f093583d780 1 > prepared multipart upload key=OCOQJLUUNWRG upload=UTQX6PYGA462 tag=XAE1THL230RG type=write size=1787405 2024-03-04T12:41:20.582 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.577+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=PTN8A2DYX0NW type=del 2024-03-04T12:41:20.584 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.579+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~DHECE9MZNH0I.0 size=1048576 2024-03-04T12:41:20.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.580+0000 7f093583d780 1 > prepared part key=_multipart_NFM6LT89K5F4.2~DHECE9MZNH0I.1 size=445648 2024-03-04T12:41:20.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.580+0000 7f093583d780 1 > prepared multipart upload key=NFM6LT89K5F4 upload=DHECE9MZNH0I tag=N3QUGIXW7X0D type=write size=2542800 2024-03-04T12:41:20.587 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.581+0000 7f093583d780 1 < completed delete operation key=HG0EM344TJZY tag=2AC37G3WREUY type=del 2024-03-04T12:41:20.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.583+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~ZRZFYSIG5OCE.0 size=665367 2024-03-04T12:41:20.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.583+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=ZRZFYSIG5OCE tag=THWKNV9MN3SI type=write size=1713943 2024-03-04T12:41:20.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.585+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=466BC5O14CUD type=del 2024-03-04T12:41:20.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.587+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~DGFXUURHS1PE.0 size=1048576 2024-03-04T12:41:20.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.588+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~DGFXUURHS1PE.1 size=1048576 2024-03-04T12:41:20.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.590+0000 7f093583d780 1 > prepared part key=_multipart_9VKN43CB955V.2~DGFXUURHS1PE.2 size=527634 2024-03-04T12:41:20.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.590+0000 7f093583d780 1 > prepared multipart upload key=9VKN43CB955V upload=DGFXUURHS1PE tag=NVFB6EOBHTOK type=write size=3673362 2024-03-04T12:41:20.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.591+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~3YRWXB4BAIYQ.0 size=1048576 2024-03-04T12:41:20.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.592+0000 7f093583d780 1 < completed part key=_multipart_O6OUISHWZ7FU.2~3YRWXB4BAIYQ.1 size=1012882 2024-03-04T12:41:20.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.594+0000 7f093583d780 1 < completed multipart upload key=O6OUISHWZ7FU upload=3YRWXB4BAIYQ tag=BZDH0XEH032L type=write size=3110034 2024-03-04T12:41:20.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.597+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~0WCQBGXI6641.0 size=1048576 2024-03-04T12:41:20.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.598+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~0WCQBGXI6641.1 size=1048576 2024-03-04T12:41:20.604 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.598+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~0WCQBGXI6641.2 size=791337 2024-03-04T12:41:20.604 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.598+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=0WCQBGXI6641 tag=FY7XR9GUE8U0 type=write size=3937065 2024-03-04T12:41:20.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.600+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~AV1VFS8JQ7CI.0 size=1048576 2024-03-04T12:41:20.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.601+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~AV1VFS8JQ7CI.1 size=142528 2024-03-04T12:41:20.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.603+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=AV1VFS8JQ7CI tag=M5FY53PQA0QF type=write size=2239680 2024-03-04T12:41:20.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.604+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=A9LE23ZGW04H type=write size=149101 2024-03-04T12:41:20.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.606+0000 7f093583d780 1 < suggested remove operation key=U6F7IZ07CS9Q tag=0611UI0743D8 type=del 2024-03-04T12:41:20.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.607+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=ZL260N4WJGR8 type=del size=3778576 2024-03-04T12:41:20.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.608+0000 7f093583d780 1 < completed delete operation key=I5NQBROT0WKE tag=8J0Z9U6H9BM1 type=del 2024-03-04T12:41:20.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.609+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=CTWJ0SRJ2N4P type=write size=373248 2024-03-04T12:41:20.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.611+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=2CTJH74WE5C3 type=del 2024-03-04T12:41:20.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.612+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=NRJ230C2WGLX type=del size=2076135 2024-03-04T12:41:20.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.612+0000 7f093583d780 1 < canceled part key=_multipart_TMAI6MOG2C4N.2~IJ71UIE76841.0 size=157987 2024-03-04T12:41:20.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.614+0000 7f093583d780 1 < canceled multipart upload key=TMAI6MOG2C4N upload=IJ71UIE76841 tag=RY79DBZK5S2C type=write size=1206563 2024-03-04T12:41:20.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.615+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=7E5E0Q38WYW3 type=del size=3020416 2024-03-04T12:41:20.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.616+0000 7f093583d780 -1 < failed to complete operation key=U6F7IZ07CS9Q tag=D0HEXX45KC8L type=del size=3184066: (22) Invalid argument 2024-03-04T12:41:20.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.617+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=7DYMARAMJGP2 type=del size=1304036 2024-03-04T12:41:20.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.618+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~AULOKOKQ254Z.0 size=1048576 2024-03-04T12:41:20.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.619+0000 7f093583d780 1 < completed part key=_multipart_PT63VLFQQN0E.2~AULOKOKQ254Z.1 size=142681 2024-03-04T12:41:20.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.621+0000 7f093583d780 1 < completed multipart upload key=PT63VLFQQN0E upload=AULOKOKQ254Z tag=AYYGN4POP8ZT type=write size=2239833 2024-03-04T12:41:20.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.622+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=C1SAH525DSMT type=del size=1661294 2024-03-04T12:41:20.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.624+0000 7f093583d780 1 < completed write operation key=I5NQBROT0WKE tag=JUCCAJV9IFZM type=write size=908152 2024-03-04T12:41:20.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.625+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=0CKSPAXQDR11 type=del size=3992842 2024-03-04T12:41:20.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.626+0000 7f093583d780 1 < completed part key=_multipart_GJ0FQ6EH9HJL.2~PVZ3909HO2OM.0 size=685246 2024-03-04T12:41:20.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.628+0000 7f093583d780 1 < completed multipart upload key=GJ0FQ6EH9HJL upload=PVZ3909HO2OM tag=ZUBJWN5U6VGW type=write size=1733822 2024-03-04T12:41:20.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.629+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=66R75S9CODIZ type=del size=2985404 2024-03-04T12:41:20.636 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.630+0000 7f093583d780 1 < completed delete operation key=AQI7H63EQSTN tag=JEYG3AKYS8GU type=del 2024-03-04T12:41:20.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.632+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~YM4RTRMIABMG.0 size=450094 2024-03-04T12:41:20.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.632+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=YM4RTRMIABMG tag=3J1HGNKRO41I type=write size=1498670 2024-03-04T12:41:20.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.633+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~PLVK2Y706B9M.0 size=1048576 2024-03-04T12:41:20.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.634+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~PLVK2Y706B9M.1 size=1048576 2024-03-04T12:41:20.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.635+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~PLVK2Y706B9M.2 size=319389 2024-03-04T12:41:20.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.637+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=PLVK2Y706B9M tag=0LTGRRDGFOX8 type=write size=3465117 2024-03-04T12:41:20.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.639+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~KQVKY23BAG8I.0 size=198897 2024-03-04T12:41:20.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.639+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=KQVKY23BAG8I tag=R2112I9WVVKN type=write size=1247473 2024-03-04T12:41:20.646 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.640+0000 7f093583d780 1 < completed part key=_multipart_OCOQJLUUNWRG.2~UTQX6PYGA462.0 size=738829 2024-03-04T12:41:20.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.642+0000 7f093583d780 1 < completed multipart upload key=OCOQJLUUNWRG upload=UTQX6PYGA462 tag=XAE1THL230RG type=write size=1787405 2024-03-04T12:41:20.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.645+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=G1O47O82CX02 type=del size=1963401 2024-03-04T12:41:20.651 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.646+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~DHECE9MZNH0I.0 size=1048576 2024-03-04T12:41:20.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.647+0000 7f093583d780 1 < completed part key=_multipart_NFM6LT89K5F4.2~DHECE9MZNH0I.1 size=445648 2024-03-04T12:41:20.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.649+0000 7f093583d780 1 < completed multipart upload key=NFM6LT89K5F4 upload=DHECE9MZNH0I tag=N3QUGIXW7X0D type=write size=2542800 2024-03-04T12:41:20.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.650+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=VLEOOY548W8C type=del size=1841862 2024-03-04T12:41:20.657 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.651+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~ZRZFYSIG5OCE.0 size=665367 2024-03-04T12:41:20.658 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.653+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=ZRZFYSIG5OCE tag=THWKNV9MN3SI type=write size=1713943 2024-03-04T12:41:20.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.655+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~F61TWH4L7Y6T.0 size=1048576 2024-03-04T12:41:20.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.656+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~F61TWH4L7Y6T.1 size=1048576 2024-03-04T12:41:20.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.657+0000 7f093583d780 1 > prepared part key=_multipart_NQF43I07F2HT.2~F61TWH4L7Y6T.2 size=391839 2024-03-04T12:41:20.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.657+0000 7f093583d780 1 > prepared multipart upload key=NQF43I07F2HT upload=F61TWH4L7Y6T tag=UOVJ9V29TDSZ type=write size=3537567 2024-03-04T12:41:20.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.658+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~DGFXUURHS1PE.0 size=1048576 2024-03-04T12:41:20.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.659+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~DGFXUURHS1PE.1 size=1048576 2024-03-04T12:41:20.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.660+0000 7f093583d780 1 < completed part key=_multipart_9VKN43CB955V.2~DGFXUURHS1PE.2 size=527634 2024-03-04T12:41:20.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.662+0000 7f093583d780 1 < completed multipart upload key=9VKN43CB955V upload=DGFXUURHS1PE tag=NVFB6EOBHTOK type=write size=3673362 2024-03-04T12:41:20.668 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.663+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=7UNIINIJYFKD type=del size=3940472 2024-03-04T12:41:20.668 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.663+0000 7f093583d780 1 < canceled part key=_multipart_YJXFSO53QVPS.2~0WCQBGXI6641.0 size=1048576 2024-03-04T12:41:20.669 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.664+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~0WCQBGXI6641.1 size=1048576 2024-03-04T12:41:20.670 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.665+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~0WCQBGXI6641.2 size=791337 2024-03-04T12:41:20.672 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.667+0000 7f093583d780 1 < canceled multipart upload key=YJXFSO53QVPS upload=0WCQBGXI6641 tag=FY7XR9GUE8U0 type=write size=3937065 2024-03-04T12:41:20.673 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.668+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=6884CFJBYXI1 type=write size=672954 2024-03-04T12:41:20.675 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.669+0000 7f093583d780 1 < completed write operation key=9E12MS7PETOK tag=A9LE23ZGW04H type=write size=149101 2024-03-04T12:41:20.676 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.670+0000 7f093583d780 1 > prepared operation key=Q45PKXZVJ6YS tag=0071MDUAI913 type=del size=4148216 2024-03-04T12:41:20.677 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.671+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=ZL260N4WJGR8 type=del 2024-03-04T12:41:20.678 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.672+0000 7f093583d780 1 > prepared operation key=OFTWI7UFD5L5 tag=QKWJKEAOL7C4 type=del size=277531 2024-03-04T12:41:20.679 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.673+0000 7f093583d780 1 < completed write operation key=YJXFSO53QVPS tag=CTWJ0SRJ2N4P type=write size=373248 2024-03-04T12:41:20.681 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.675+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~PUP9UC2KBNU7.0 size=1048576 2024-03-04T12:41:20.682 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.676+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~PUP9UC2KBNU7.1 size=1048576 2024-03-04T12:41:20.682 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.677+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~PUP9UC2KBNU7.2 size=948419 2024-03-04T12:41:20.683 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.677+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=PUP9UC2KBNU7 tag=IU2AWLUC6H0D type=write size=4094147 2024-03-04T12:41:20.684 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.678+0000 7f093583d780 1 < completed delete operation key=96PTQ2KHPMMM tag=NRJ230C2WGLX type=del 2024-03-04T12:41:20.685 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.679+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=XTIWGHPFQM2Y type=write size=816300 2024-03-04T12:41:20.686 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.680+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=7E5E0Q38WYW3 type=del 2024-03-04T12:41:20.687 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.681+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=WOK3EGU8WNQC type=del size=408697 2024-03-04T12:41:20.688 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.682+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=7DYMARAMJGP2 type=del 2024-03-04T12:41:20.690 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.684+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~M7TZDDQ2M0QN.0 size=1048576 2024-03-04T12:41:20.691 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.685+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~M7TZDDQ2M0QN.1 size=119132 2024-03-04T12:41:20.691 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.685+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=M7TZDDQ2M0QN tag=98XU3T2YGFWO type=write size=2216284 2024-03-04T12:41:20.692 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.686+0000 7f093583d780 1 < completed delete operation key=M0AOZ89IQNSK tag=C1SAH525DSMT type=del 2024-03-04T12:41:20.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.687+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=R79Y9VXAMXVF type=del size=4060641 2024-03-04T12:41:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.689+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=0CKSPAXQDR11 type=del 2024-03-04T12:41:20.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.691+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~F4I8ANI5OT27.0 size=491263 2024-03-04T12:41:20.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.691+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=F4I8ANI5OT27 tag=AW6J12JZ425G type=write size=1539839 2024-03-04T12:41:20.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.693+0000 7f093583d780 1 < suggested remove operation key=OCOQJLUUNWRG tag=66R75S9CODIZ type=del 2024-03-04T12:41:20.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.694+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=WUB22HT1GPET type=del size=3219080 2024-03-04T12:41:20.701 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.695+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~YM4RTRMIABMG.0 size=450094 2024-03-04T12:41:20.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.698+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=YM4RTRMIABMG tag=3J1HGNKRO41I type=write size=1498670 2024-03-04T12:41:20.706 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.701+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~NZ0V8WKW0KCU.0 size=854545 2024-03-04T12:41:20.706 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.701+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=NZ0V8WKW0KCU tag=UWR6AEMVP9N5 type=write size=1903121 2024-03-04T12:41:20.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.702+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~KQVKY23BAG8I.0 size=198897 2024-03-04T12:41:20.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.704+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=KQVKY23BAG8I tag=R2112I9WVVKN type=write size=1247473 2024-03-04T12:41:20.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.705+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=ZZULWVBBO0CI type=del size=404479 2024-03-04T12:41:20.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.706+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=G1O47O82CX02 type=del 2024-03-04T12:41:20.713 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.707+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=FPSQAXHDFSQR type=del size=3043035 2024-03-04T12:41:20.714 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.708+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=VLEOOY548W8C type=del 2024-03-04T12:41:20.716 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.710+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~N2869V66B202.0 size=1048576 2024-03-04T12:41:20.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.711+0000 7f093583d780 1 > prepared part key=_multipart_OFTWI7UFD5L5.2~N2869V66B202.1 size=788571 2024-03-04T12:41:20.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.711+0000 7f093583d780 1 > prepared multipart upload key=OFTWI7UFD5L5 upload=N2869V66B202 tag=78W9K03YZ02H type=write size=2885723 2024-03-04T12:41:20.718 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.713+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~F61TWH4L7Y6T.0 size=1048576 2024-03-04T12:41:20.718 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.713+0000 7f093583d780 1 < canceled part key=_multipart_NQF43I07F2HT.2~F61TWH4L7Y6T.1 size=1048576 2024-03-04T12:41:20.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.714+0000 7f093583d780 1 < completed part key=_multipart_NQF43I07F2HT.2~F61TWH4L7Y6T.2 size=391839 2024-03-04T12:41:20.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.716+0000 7f093583d780 1 < canceled multipart upload key=NQF43I07F2HT upload=F61TWH4L7Y6T tag=UOVJ9V29TDSZ type=write size=3537567 2024-03-04T12:41:20.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.717+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=2QDFQ4DY5KT6 type=del size=3350537 2024-03-04T12:41:20.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.719+0000 7f093583d780 -1 < failed to complete operation key=OCOQJLUUNWRG tag=7UNIINIJYFKD type=del size=3940472: (22) Invalid argument 2024-03-04T12:41:20.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.720+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=672HT6K1Q5B5 type=del size=3873680 2024-03-04T12:41:20.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.721+0000 7f093583d780 1 < completed write operation key=2XVNK3YEVHJ7 tag=6884CFJBYXI1 type=write size=672954 2024-03-04T12:41:20.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.723+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~XXOD0QT79AWA.0 size=1048576 2024-03-04T12:41:20.730 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.724+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~XXOD0QT79AWA.1 size=1048576 2024-03-04T12:41:20.730 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.725+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~XXOD0QT79AWA.2 size=33840 2024-03-04T12:41:20.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.725+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=XXOD0QT79AWA tag=615YR8FC9SRH type=write size=3179568 2024-03-04T12:41:20.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.726+0000 7f093583d780 1 < completed delete operation key=Q45PKXZVJ6YS tag=0071MDUAI913 type=del 2024-03-04T12:41:20.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.728+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~6KR4QZGXMAN2.0 size=1048576 2024-03-04T12:41:20.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.729+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~6KR4QZGXMAN2.1 size=1048576 2024-03-04T12:41:20.736 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.730+0000 7f093583d780 1 > prepared part key=_multipart_TMAI6MOG2C4N.2~6KR4QZGXMAN2.2 size=682889 2024-03-04T12:41:20.736 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.730+0000 7f093583d780 1 > prepared multipart upload key=TMAI6MOG2C4N upload=6KR4QZGXMAN2 tag=G7V7H3NSO23T type=write size=3828617 2024-03-04T12:41:20.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.731+0000 7f093583d780 1 < completed delete operation key=OFTWI7UFD5L5 tag=QKWJKEAOL7C4 type=del 2024-03-04T12:41:20.739 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.732+0000 7f093583d780 1 > prepared operation key=2XVNK3YEVHJ7 tag=FFZYHQW2H5KK type=del size=4122852 2024-03-04T12:41:20.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.734+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~PUP9UC2KBNU7.0 size=1048576 2024-03-04T12:41:20.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.734+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~PUP9UC2KBNU7.1 size=1048576 2024-03-04T12:41:20.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.735+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~PUP9UC2KBNU7.2 size=948419 2024-03-04T12:41:20.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.737+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=PUP9UC2KBNU7 tag=IU2AWLUC6H0D type=write size=4094147 2024-03-04T12:41:20.744 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.739+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=R3MFZEHZ33CI type=del size=2538493 2024-03-04T12:41:20.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.741+0000 7f093583d780 1 < suggested update operation key=I6DIP4VGHMNO tag=XTIWGHPFQM2Y type=write size=816300 2024-03-04T12:41:20.748 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.743+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~U0E165XSWI07.0 size=1048576 2024-03-04T12:41:20.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.744+0000 7f093583d780 1 > prepared part key=_multipart_9E12MS7PETOK.2~U0E165XSWI07.1 size=93046 2024-03-04T12:41:20.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.744+0000 7f093583d780 1 > prepared multipart upload key=9E12MS7PETOK upload=U0E165XSWI07 tag=QSSHNZ9NWPKF type=write size=2190198 2024-03-04T12:41:20.751 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.746+0000 7f093583d780 1 < suggested remove operation key=GMKM2QEP072H tag=WOK3EGU8WNQC type=del 2024-03-04T12:41:20.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.748+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~I86L1Q9WH16A.0 size=1048576 2024-03-04T12:41:20.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.749+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~I86L1Q9WH16A.1 size=1048576 2024-03-04T12:41:20.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.750+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~I86L1Q9WH16A.2 size=932978 2024-03-04T12:41:20.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.750+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=I86L1Q9WH16A tag=V286UB66MI3B type=write size=4078706 2024-03-04T12:41:20.757 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.751+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~M7TZDDQ2M0QN.0 size=1048576 2024-03-04T12:41:20.757 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.751+0000 7f093583d780 1 < canceled part key=_multipart_Q45PKXZVJ6YS.2~M7TZDDQ2M0QN.1 size=119132 2024-03-04T12:41:20.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.753+0000 7f093583d780 1 < canceled multipart upload key=Q45PKXZVJ6YS upload=M7TZDDQ2M0QN tag=98XU3T2YGFWO type=write size=2216284 2024-03-04T12:41:20.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.754+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=FUYOC1H2ZM8H type=del size=1389401 2024-03-04T12:41:20.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.755+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=R79Y9VXAMXVF type=del 2024-03-04T12:41:20.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.758+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~CPXLVMXTLM4A.0 size=212814 2024-03-04T12:41:20.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.758+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=CPXLVMXTLM4A tag=8M3Z6SC0213Z type=write size=1261390 2024-03-04T12:41:20.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.759+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~F4I8ANI5OT27.0 size=491263 2024-03-04T12:41:20.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.760+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=F4I8ANI5OT27 tag=AW6J12JZ425G type=write size=1539839 2024-03-04T12:41:20.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.762+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=U7MA8EEJQ66Y type=del size=3100532 2024-03-04T12:41:20.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.763+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=WUB22HT1GPET type=del 2024-03-04T12:41:20.769 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.764+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=KEQE1CB1GK91 type=del size=2475813 2024-03-04T12:41:20.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.765+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~NZ0V8WKW0KCU.0 size=854545 2024-03-04T12:41:20.772 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.767+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=NZ0V8WKW0KCU tag=UWR6AEMVP9N5 type=write size=1903121 2024-03-04T12:41:20.773 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.768+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=BOY5D2Y5QBOW type=del size=1170476 2024-03-04T12:41:20.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.769+0000 7f093583d780 1 < canceled operation key=96PTQ2KHPMMM tag=ZZULWVBBO0CI type=del size=404479 2024-03-04T12:41:20.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.771+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~YLO1ACLZL8H3.0 size=1048576 2024-03-04T12:41:20.778 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.772+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~YLO1ACLZL8H3.1 size=60392 2024-03-04T12:41:20.778 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.772+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=YLO1ACLZL8H3 tag=O6J27ZWEO6W7 type=write size=2157544 2024-03-04T12:41:20.779 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.774+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=FPSQAXHDFSQR type=del 2024-03-04T12:41:20.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.776+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~ST7MUUKB1KO6.0 size=1048576 2024-03-04T12:41:20.782 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.776+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~ST7MUUKB1KO6.1 size=764995 2024-03-04T12:41:20.782 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.776+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=ST7MUUKB1KO6 tag=QKM3N4WNMCZ3 type=write size=2862147 2024-03-04T12:41:20.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.778+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~N2869V66B202.0 size=1048576 2024-03-04T12:41:20.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.778+0000 7f093583d780 1 < completed part key=_multipart_OFTWI7UFD5L5.2~N2869V66B202.1 size=788571 2024-03-04T12:41:20.786 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.780+0000 7f093583d780 1 < completed multipart upload key=OFTWI7UFD5L5 upload=N2869V66B202 tag=78W9K03YZ02H type=write size=2885723 2024-03-04T12:41:20.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.782+0000 7f093583d780 1 > prepared part key=_multipart_M0AOZ89IQNSK.2~IFG4XAVVQWGR.0 size=257005 2024-03-04T12:41:20.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.782+0000 7f093583d780 1 > prepared multipart upload key=M0AOZ89IQNSK upload=IFG4XAVVQWGR tag=06VGOA97GAPB type=write size=1305581 2024-03-04T12:41:20.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.783+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=2QDFQ4DY5KT6 type=del 2024-03-04T12:41:20.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.784+0000 7f093583d780 1 > prepared operation key=9VKN43CB955V tag=G9HQV6WUSJZQ type=write size=123037 2024-03-04T12:41:20.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.786+0000 7f093583d780 1 < canceled operation key=L4UQK3UJFXZC tag=672HT6K1Q5B5 type=del size=3873680 2024-03-04T12:41:20.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.788+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~1O022QUMAGZE.0 size=955643 2024-03-04T12:41:20.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.788+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=1O022QUMAGZE tag=9FXIQMN685J9 type=write size=2004219 2024-03-04T12:41:20.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.790+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~XXOD0QT79AWA.0 size=1048576 2024-03-04T12:41:20.797 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.791+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~XXOD0QT79AWA.1 size=1048576 2024-03-04T12:41:20.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.792+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~XXOD0QT79AWA.2 size=33840 2024-03-04T12:41:20.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.794+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=XXOD0QT79AWA tag=615YR8FC9SRH type=write size=3179568 2024-03-04T12:41:20.801 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.796+0000 7f093583d780 1 > prepared part key=_multipart_Q45PKXZVJ6YS.2~Z037QKR253IL.0 size=472690 2024-03-04T12:41:20.801 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.796+0000 7f093583d780 1 > prepared multipart upload key=Q45PKXZVJ6YS upload=Z037QKR253IL tag=9HAX5T3HWJW7 type=write size=1521266 2024-03-04T12:41:20.802 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.797+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~6KR4QZGXMAN2.0 size=1048576 2024-03-04T12:41:20.802 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.797+0000 7f093583d780 1 < canceled part key=_multipart_TMAI6MOG2C4N.2~6KR4QZGXMAN2.1 size=1048576 2024-03-04T12:41:20.803 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.798+0000 7f093583d780 1 < completed part key=_multipart_TMAI6MOG2C4N.2~6KR4QZGXMAN2.2 size=682889 2024-03-04T12:41:20.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.799+0000 7f093583d780 1 < canceled multipart upload key=TMAI6MOG2C4N upload=6KR4QZGXMAN2 tag=G7V7H3NSO23T type=write size=3828617 2024-03-04T12:41:20.807 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.801+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~6F920OJUFR12.0 size=1048576 2024-03-04T12:41:20.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.802+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~6F920OJUFR12.1 size=1048576 2024-03-04T12:41:20.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.804+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~6F920OJUFR12.2 size=876170 2024-03-04T12:41:20.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.804+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=6F920OJUFR12 tag=ZMYNUIPDBYHN type=write size=4021898 2024-03-04T12:41:20.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.805+0000 7f093583d780 1 < completed delete operation key=2XVNK3YEVHJ7 tag=FFZYHQW2H5KK type=del 2024-03-04T12:41:20.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.806+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=ZWC7VW121EKU type=write size=764741 2024-03-04T12:41:20.813 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.807+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=R3MFZEHZ33CI type=del 2024-03-04T12:41:20.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.808+0000 7f093583d780 1 > prepared operation key=U6F7IZ07CS9Q tag=YNO9GVRSD51P type=del size=3875580 2024-03-04T12:41:20.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.810+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~U0E165XSWI07.0 size=1048576 2024-03-04T12:41:20.816 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.810+0000 7f093583d780 1 < completed part key=_multipart_9E12MS7PETOK.2~U0E165XSWI07.1 size=93046 2024-03-04T12:41:20.818 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.812+0000 7f093583d780 1 < completed multipart upload key=9E12MS7PETOK upload=U0E165XSWI07 tag=QSSHNZ9NWPKF type=write size=2190198 2024-03-04T12:41:20.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.813+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=52W907KX6G1Y type=del size=588725 2024-03-04T12:41:20.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.814+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~I86L1Q9WH16A.0 size=1048576 2024-03-04T12:41:20.821 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.815+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~I86L1Q9WH16A.1 size=1048576 2024-03-04T12:41:20.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.816+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~I86L1Q9WH16A.2 size=932978 2024-03-04T12:41:20.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.818+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=I86L1Q9WH16A tag=V286UB66MI3B type=write size=4078706 2024-03-04T12:41:20.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.819+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=I3FY9MY8RR1B type=del size=1361952 2024-03-04T12:41:20.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.820+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=FUYOC1H2ZM8H type=del 2024-03-04T12:41:20.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.822+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~QBT1AZ91GP6T.0 size=1048576 2024-03-04T12:41:20.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.823+0000 7f093583d780 1 > prepared part key=_multipart_U6F7IZ07CS9Q.2~QBT1AZ91GP6T.1 size=614988 2024-03-04T12:41:20.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.823+0000 7f093583d780 1 > prepared multipart upload key=U6F7IZ07CS9Q upload=QBT1AZ91GP6T tag=9RWZ7N5SHNG1 type=write size=2712140 2024-03-04T12:41:20.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.824+0000 7f093583d780 1 < completed part key=_multipart_UAEQORB3BDBH.2~CPXLVMXTLM4A.0 size=212814 2024-03-04T12:41:20.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.826+0000 7f093583d780 1 < completed multipart upload key=UAEQORB3BDBH upload=CPXLVMXTLM4A tag=8M3Z6SC0213Z type=write size=1261390 2024-03-04T12:41:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.827+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=R8AYSXO787NE type=del size=7253 2024-03-04T12:41:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.828+0000 7f093583d780 1 < canceled operation key=GJ0FQ6EH9HJL tag=U7MA8EEJQ66Y type=del size=3100532 2024-03-04T12:41:20.834 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.829+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=050MX5P56ROY type=write size=150313 2024-03-04T12:41:20.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.831+0000 7f093583d780 1 < suggested update operation key=UAEQORB3BDBH tag=KEQE1CB1GK91 type=del size=2475813 2024-03-04T12:41:20.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.832+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=UP41PHV0R70X type=del size=2027206 2024-03-04T12:41:20.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.833+0000 7f093583d780 1 < completed delete operation key=I6DIP4VGHMNO tag=BOY5D2Y5QBOW type=del 2024-03-04T12:41:20.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.835+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~B4XX0AMNSG7V.0 size=1048576 2024-03-04T12:41:20.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.836+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~B4XX0AMNSG7V.1 size=1048576 2024-03-04T12:41:20.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.837+0000 7f093583d780 1 > prepared part key=_multipart_2R5WA9Q9ZAUG.2~B4XX0AMNSG7V.2 size=697947 2024-03-04T12:41:20.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.837+0000 7f093583d780 1 > prepared multipart upload key=2R5WA9Q9ZAUG upload=B4XX0AMNSG7V tag=CQNDQUGHNM9P type=write size=3843675 2024-03-04T12:41:20.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.838+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~YLO1ACLZL8H3.0 size=1048576 2024-03-04T12:41:20.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.839+0000 7f093583d780 1 < completed part key=_multipart_J6Y9V11BX06B.2~YLO1ACLZL8H3.1 size=60392 2024-03-04T12:41:20.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.840+0000 7f093583d780 1 < completed multipart upload key=J6Y9V11BX06B upload=YLO1ACLZL8H3 tag=O6J27ZWEO6W7 type=write size=2157544 2024-03-04T12:41:20.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.843+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~5UEJ1QOIEL3N.0 size=1048576 2024-03-04T12:41:20.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.844+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~5UEJ1QOIEL3N.1 size=1048576 2024-03-04T12:41:20.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.844+0000 7f093583d780 1 > prepared part key=_multipart_3F8GI0JCUR6W.2~5UEJ1QOIEL3N.2 size=748731 2024-03-04T12:41:20.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.844+0000 7f093583d780 1 > prepared multipart upload key=3F8GI0JCUR6W upload=5UEJ1QOIEL3N tag=TMQM9LUBHX0U type=write size=3894459 2024-03-04T12:41:20.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.845+0000 7f093583d780 1 < canceled part key=_multipart_FT2XNJYYT30J.2~ST7MUUKB1KO6.0 size=1048576 2024-03-04T12:41:20.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.846+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~ST7MUUKB1KO6.1 size=764995 2024-03-04T12:41:20.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.847+0000 7f093583d780 1 < canceled multipart upload key=FT2XNJYYT30J upload=ST7MUUKB1KO6 tag=QKM3N4WNMCZ3 type=write size=2862147 2024-03-04T12:41:20.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.849+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=RTAQBQEOA6Z9 type=del size=249315 2024-03-04T12:41:20.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.849+0000 7f093583d780 1 < canceled part key=_multipart_M0AOZ89IQNSK.2~IFG4XAVVQWGR.0 size=257005 2024-03-04T12:41:20.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.851+0000 7f093583d780 1 < canceled multipart upload key=M0AOZ89IQNSK upload=IFG4XAVVQWGR tag=06VGOA97GAPB type=write size=1305581 2024-03-04T12:41:20.857 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.852+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=PIPJSZ7GM7BC type=del size=1713869 2024-03-04T12:41:20.859 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.854+0000 7f093583d780 1 < suggested remove operation key=9VKN43CB955V tag=G9HQV6WUSJZQ type=write 2024-03-04T12:41:20.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.856+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~GPVMDQCP2G3M.0 size=1048576 2024-03-04T12:41:20.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.857+0000 7f093583d780 1 > prepared part key=_multipart_FT2XNJYYT30J.2~GPVMDQCP2G3M.1 size=950354 2024-03-04T12:41:20.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.857+0000 7f093583d780 1 > prepared multipart upload key=FT2XNJYYT30J upload=GPVMDQCP2G3M tag=ZRFHGN80FLJ4 type=write size=3047506 2024-03-04T12:41:20.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.858+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~1O022QUMAGZE.0 size=955643 2024-03-04T12:41:20.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.860+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=1O022QUMAGZE tag=9FXIQMN685J9 type=write size=2004219 2024-03-04T12:41:20.866 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.861+0000 7f093583d780 1 > prepared operation key=3F8GI0JCUR6W tag=Y683DP6PE4QM type=del size=3205895 2024-03-04T12:41:20.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.863+0000 7f093583d780 1 < completed part key=_multipart_Q45PKXZVJ6YS.2~Z037QKR253IL.0 size=472690 2024-03-04T12:41:20.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.865+0000 7f093583d780 1 < completed multipart upload key=Q45PKXZVJ6YS upload=Z037QKR253IL tag=9HAX5T3HWJW7 type=write size=1521266 2024-03-04T12:41:20.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.867+0000 7f093583d780 1 > prepared part key=_multipart_Y4D4Q7NV5VMO.2~ZD1G813B7LCR.0 size=856253 2024-03-04T12:41:20.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.867+0000 7f093583d780 1 > prepared multipart upload key=Y4D4Q7NV5VMO upload=ZD1G813B7LCR tag=KVKAF96GEHVH type=write size=1904829 2024-03-04T12:41:20.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.868+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~6F920OJUFR12.0 size=1048576 2024-03-04T12:41:20.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.869+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~6F920OJUFR12.1 size=1048576 2024-03-04T12:41:20.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.870+0000 7f093583d780 1 < completed part key=_multipart_HG0EM344TJZY.2~6F920OJUFR12.2 size=876170 2024-03-04T12:41:20.878 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.872+0000 7f093583d780 1 < completed multipart upload key=HG0EM344TJZY upload=6F920OJUFR12 tag=ZMYNUIPDBYHN type=write size=4021898 2024-03-04T12:41:20.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.874+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~6FZ61NEYPZOT.0 size=1048576 2024-03-04T12:41:20.880 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.875+0000 7f093583d780 1 > prepared part key=_multipart_2XVNK3YEVHJ7.2~6FZ61NEYPZOT.1 size=869835 2024-03-04T12:41:20.880 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.875+0000 7f093583d780 1 > prepared multipart upload key=2XVNK3YEVHJ7 upload=6FZ61NEYPZOT tag=15ZNOHY6T08N type=write size=2966987 2024-03-04T12:41:20.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.876+0000 7f093583d780 1 < completed write operation key=3F8GI0JCUR6W tag=ZWC7VW121EKU type=write size=764741 2024-03-04T12:41:20.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.877+0000 7f093583d780 1 > prepared operation key=J6Y9V11BX06B tag=OWNZOJIPWCKV type=del size=2787494 2024-03-04T12:41:20.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.878+0000 7f093583d780 1 < completed delete operation key=U6F7IZ07CS9Q tag=YNO9GVRSD51P type=del 2024-03-04T12:41:20.885 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.879+0000 7f093583d780 1 > prepared operation key=FT2XNJYYT30J tag=9GL760LVZLPR type=del size=3717539 2024-03-04T12:41:20.886 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.880+0000 7f093583d780 1 < completed delete operation key=YJXFSO53QVPS tag=52W907KX6G1Y type=del 2024-03-04T12:41:20.887 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.882+0000 7f093583d780 1 > prepared operation key=Y4D4Q7NV5VMO tag=E97KIVE9W92P type=del size=730131 2024-03-04T12:41:20.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.883+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=I3FY9MY8RR1B type=del 2024-03-04T12:41:20.889 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.884+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=1OZKXVHJ5AKU type=del size=2424135 2024-03-04T12:41:20.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.885+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~QBT1AZ91GP6T.0 size=1048576 2024-03-04T12:41:20.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.886+0000 7f093583d780 1 < completed part key=_multipart_U6F7IZ07CS9Q.2~QBT1AZ91GP6T.1 size=614988 2024-03-04T12:41:20.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.888+0000 7f093583d780 1 < completed multipart upload key=U6F7IZ07CS9Q upload=QBT1AZ91GP6T tag=9RWZ7N5SHNG1 type=write size=2712140 2024-03-04T12:41:20.896 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.890+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~KS6YZ76WOWK6.0 size=1048576 2024-03-04T12:41:20.897 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.891+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~KS6YZ76WOWK6.1 size=1035586 2024-03-04T12:41:20.897 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.891+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=KS6YZ76WOWK6 tag=4PV9RE6JNPPZ type=write size=3132738 2024-03-04T12:41:20.898 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.893+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=R8AYSXO787NE type=del 2024-03-04T12:41:20.900 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.895+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~PYDDRNRG3OOV.0 size=1048576 2024-03-04T12:41:20.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.896+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~PYDDRNRG3OOV.1 size=870177 2024-03-04T12:41:20.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.896+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=PYDDRNRG3OOV tag=01KH3O4L22G1 type=write size=2967329 2024-03-04T12:41:20.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.898+0000 7f093583d780 1 < suggested update operation key=GMKM2QEP072H tag=050MX5P56ROY type=write size=150313 2024-03-04T12:41:20.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.900+0000 7f093583d780 1 > prepared part key=_multipart_O6OUISHWZ7FU.2~60OF05Q9TCGL.0 size=88254 2024-03-04T12:41:20.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.900+0000 7f093583d780 1 > prepared multipart upload key=O6OUISHWZ7FU upload=60OF05Q9TCGL tag=9TK7FAIXEOXC type=write size=1136830 2024-03-04T12:41:20.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.901+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=UP41PHV0R70X type=del 2024-03-04T12:41:20.909 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.904+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~D2Q8W3QCXFUW.0 size=1048576 2024-03-04T12:41:20.910 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.905+0000 7f093583d780 1 > prepared part key=_multipart_96PTQ2KHPMMM.2~D2Q8W3QCXFUW.1 size=577758 2024-03-04T12:41:20.910 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.905+0000 7f093583d780 1 > prepared multipart upload key=96PTQ2KHPMMM upload=D2Q8W3QCXFUW tag=X2Z7URTXXFGT type=write size=2674910 2024-03-04T12:41:20.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.906+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~B4XX0AMNSG7V.0 size=1048576 2024-03-04T12:41:20.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.907+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~B4XX0AMNSG7V.1 size=1048576 2024-03-04T12:41:20.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.909+0000 7f093583d780 1 < completed part key=_multipart_2R5WA9Q9ZAUG.2~B4XX0AMNSG7V.2 size=697947 2024-03-04T12:41:20.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.912+0000 7f093583d780 1 < completed multipart upload key=2R5WA9Q9ZAUG upload=B4XX0AMNSG7V tag=CQNDQUGHNM9P type=write size=3843675 2024-03-04T12:41:20.918 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.913+0000 7f093583d780 1 > prepared operation key=O6OUISHWZ7FU tag=X327YZYAIYPD type=del size=3344319 2024-03-04T12:41:20.920 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.914+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~5UEJ1QOIEL3N.0 size=1048576 2024-03-04T12:41:20.920 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.915+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~5UEJ1QOIEL3N.1 size=1048576 2024-03-04T12:41:20.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.916+0000 7f093583d780 1 < completed part key=_multipart_3F8GI0JCUR6W.2~5UEJ1QOIEL3N.2 size=748731 2024-03-04T12:41:20.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.918+0000 7f093583d780 1 < completed multipart upload key=3F8GI0JCUR6W upload=5UEJ1QOIEL3N tag=TMQM9LUBHX0U type=write size=3894459 2024-03-04T12:41:20.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.919+0000 7f093583d780 1 > prepared operation key=GJ0FQ6EH9HJL tag=QCQ50E2T1UE3 type=del size=3623141 2024-03-04T12:41:20.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.920+0000 7f093583d780 1 < completed delete operation key=9E12MS7PETOK tag=RTAQBQEOA6Z9 type=del 2024-03-04T12:41:20.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.921+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=ZK2T4SFR8T2W type=del size=3064745 2024-03-04T12:41:20.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.922+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=PIPJSZ7GM7BC type=del 2024-03-04T12:41:20.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.924+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~33LMD8ZAEEA3.0 size=1048576 2024-03-04T12:41:20.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.925+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~33LMD8ZAEEA3.1 size=1048576 2024-03-04T12:41:20.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.926+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~33LMD8ZAEEA3.2 size=86982 2024-03-04T12:41:20.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.926+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=33LMD8ZAEEA3 tag=B1CZJX1D8JHX type=write size=3232710 2024-03-04T12:41:20.933 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.927+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~GPVMDQCP2G3M.0 size=1048576 2024-03-04T12:41:20.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.928+0000 7f093583d780 1 < completed part key=_multipart_FT2XNJYYT30J.2~GPVMDQCP2G3M.1 size=950354 2024-03-04T12:41:20.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.930+0000 7f093583d780 1 < completed multipart upload key=FT2XNJYYT30J upload=GPVMDQCP2G3M tag=ZRFHGN80FLJ4 type=write size=3047506 2024-03-04T12:41:20.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.931+0000 7f093583d780 1 > prepared operation key=GMKM2QEP072H tag=42GZC7BLGX54 type=del size=226758 2024-03-04T12:41:20.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.933+0000 7f093583d780 1 < completed delete operation key=3F8GI0JCUR6W tag=Y683DP6PE4QM type=del 2024-03-04T12:41:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.934+0000 7f093583d780 1 > prepared operation key=OCOQJLUUNWRG tag=HFOLJDKM69DP type=del size=727630 2024-03-04T12:41:20.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.935+0000 7f093583d780 1 < completed part key=_multipart_Y4D4Q7NV5VMO.2~ZD1G813B7LCR.0 size=856253 2024-03-04T12:41:20.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.937+0000 7f093583d780 1 < completed multipart upload key=Y4D4Q7NV5VMO upload=ZD1G813B7LCR tag=KVKAF96GEHVH type=write size=1904829 2024-03-04T12:41:20.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.938+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=BAWDRHZOXFW4 type=del size=3010270 2024-03-04T12:41:20.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.939+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~6FZ61NEYPZOT.0 size=1048576 2024-03-04T12:41:20.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.941+0000 7f093583d780 1 < completed part key=_multipart_2XVNK3YEVHJ7.2~6FZ61NEYPZOT.1 size=869835 2024-03-04T12:41:20.949 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.943+0000 7f093583d780 1 < completed multipart upload key=2XVNK3YEVHJ7 upload=6FZ61NEYPZOT tag=15ZNOHY6T08N type=write size=2966987 2024-03-04T12:41:20.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.944+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=XKQ1LEGSFLC3 type=del size=2472425 2024-03-04T12:41:20.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.945+0000 7f093583d780 1 < completed delete operation key=J6Y9V11BX06B tag=OWNZOJIPWCKV type=del 2024-03-04T12:41:20.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.947+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=MG197AHSZP3K type=del size=1913455 2024-03-04T12:41:20.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.948+0000 7f093583d780 1 < completed delete operation key=FT2XNJYYT30J tag=9GL760LVZLPR type=del 2024-03-04T12:41:20.954 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.949+0000 7f093583d780 1 > prepared operation key=L4UQK3UJFXZC tag=GANXCQJ1FWPQ type=del size=3059910 2024-03-04T12:41:20.955 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.950+0000 7f093583d780 1 < completed delete operation key=Y4D4Q7NV5VMO tag=E97KIVE9W92P type=del 2024-03-04T12:41:20.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.951+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=PAR99QFGNK15 type=write size=447331 2024-03-04T12:41:20.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.952+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=1OZKXVHJ5AKU type=del 2024-03-04T12:41:20.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.954+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~4BMMK16LGJCS.0 size=1048576 2024-03-04T12:41:20.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.955+0000 7f093583d780 1 > prepared part key=_multipart_F269PJEZ05IO.2~4BMMK16LGJCS.1 size=408673 2024-03-04T12:41:20.961 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.955+0000 7f093583d780 1 > prepared multipart upload key=F269PJEZ05IO upload=4BMMK16LGJCS tag=A5DIF9DZDMJ3 type=write size=2505825 2024-03-04T12:41:20.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.956+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~KS6YZ76WOWK6.0 size=1048576 2024-03-04T12:41:20.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.957+0000 7f093583d780 1 < completed part key=_multipart_YJXFSO53QVPS.2~KS6YZ76WOWK6.1 size=1035586 2024-03-04T12:41:20.965 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.959+0000 7f093583d780 1 < completed multipart upload key=YJXFSO53QVPS upload=KS6YZ76WOWK6 tag=4PV9RE6JNPPZ type=write size=3132738 2024-03-04T12:41:20.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.960+0000 7f093583d780 1 > prepared operation key=I5NQBROT0WKE tag=K2K19F7375LH type=del size=3582337 2024-03-04T12:41:20.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.962+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~PYDDRNRG3OOV.0 size=1048576 2024-03-04T12:41:20.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.962+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~PYDDRNRG3OOV.1 size=870177 2024-03-04T12:41:20.970 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.964+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=PYDDRNRG3OOV tag=01KH3O4L22G1 type=write size=2967329 2024-03-04T12:41:20.971 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.965+0000 7f093583d780 1 > prepared operation key=54FLC10FWKL6 tag=EKOB5NHZTGYG type=del size=950931 2024-03-04T12:41:20.971 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.966+0000 7f093583d780 1 < canceled part key=_multipart_O6OUISHWZ7FU.2~60OF05Q9TCGL.0 size=88254 2024-03-04T12:41:20.973 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.967+0000 7f093583d780 1 < canceled multipart upload key=O6OUISHWZ7FU upload=60OF05Q9TCGL tag=9TK7FAIXEOXC type=write size=1136830 2024-03-04T12:41:20.974 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.968+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=AGY2QV2UKDP3 type=del size=2260303 2024-03-04T12:41:20.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.970+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~D2Q8W3QCXFUW.0 size=1048576 2024-03-04T12:41:20.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.970+0000 7f093583d780 1 < completed part key=_multipart_96PTQ2KHPMMM.2~D2Q8W3QCXFUW.1 size=577758 2024-03-04T12:41:20.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.972+0000 7f093583d780 1 < completed multipart upload key=96PTQ2KHPMMM upload=D2Q8W3QCXFUW tag=X2Z7URTXXFGT type=write size=2674910 2024-03-04T12:41:20.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.973+0000 7f093583d780 1 > prepared operation key=HG0EM344TJZY tag=YN4WGCDFAXNP type=del size=2636268 2024-03-04T12:41:20.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.976+0000 7f093583d780 1 < suggested update operation key=O6OUISHWZ7FU tag=X327YZYAIYPD type=del size=3344319 2024-03-04T12:41:20.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.977+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=54J1KL5EFC7K type=del size=4051565 2024-03-04T12:41:20.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.978+0000 7f093583d780 1 < completed delete operation key=GJ0FQ6EH9HJL tag=QCQ50E2T1UE3 type=del 2024-03-04T12:41:20.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.980+0000 7f093583d780 1 > prepared part key=_multipart_AQI7H63EQSTN.2~CZB5VTU0Z2D7.0 size=223303 2024-03-04T12:41:20.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.980+0000 7f093583d780 1 > prepared multipart upload key=AQI7H63EQSTN upload=CZB5VTU0Z2D7 tag=VCAVR2Y1IZW0 type=write size=1271879 2024-03-04T12:41:20.987 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.981+0000 7f093583d780 1 < completed delete operation key=2ZOV2JEQHXGS tag=ZK2T4SFR8T2W type=del 2024-03-04T12:41:20.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.982+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=F71HFBMQVZ8O type=del size=571398 2024-03-04T12:41:20.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.983+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~33LMD8ZAEEA3.0 size=1048576 2024-03-04T12:41:20.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.984+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~33LMD8ZAEEA3.1 size=1048576 2024-03-04T12:41:20.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.985+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~33LMD8ZAEEA3.2 size=86982 2024-03-04T12:41:20.993 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.987+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=33LMD8ZAEEA3 tag=B1CZJX1D8JHX type=write size=3232710 2024-03-04T12:41:20.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.988+0000 7f093583d780 1 > prepared operation key=TMAI6MOG2C4N tag=49ARTBO5H2IL type=del size=3128664 2024-03-04T12:41:20.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.989+0000 7f093583d780 1 < completed delete operation key=GMKM2QEP072H tag=42GZC7BLGX54 type=del 2024-03-04T12:41:20.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.991+0000 7f093583d780 1 > prepared operation key=NQF43I07F2HT tag=GY39DLCFLH3V type=del size=4089700 2024-03-04T12:41:20.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.992+0000 7f093583d780 1 < completed delete operation key=OCOQJLUUNWRG tag=HFOLJDKM69DP type=del 2024-03-04T12:41:20.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.994+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~CD4JXGQG6Z30.0 size=1048576 2024-03-04T12:41:21.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.995+0000 7f093583d780 1 > prepared part key=_multipart_2YD2M0JQNCC0.2~CD4JXGQG6Z30.1 size=631106 2024-03-04T12:41:21.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.995+0000 7f093583d780 1 > prepared multipart upload key=2YD2M0JQNCC0 upload=CD4JXGQG6Z30 tag=IPYXFZ42X48D type=write size=2728258 2024-03-04T12:41:21.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.996+0000 7f093583d780 1 < canceled operation key=HG0EM344TJZY tag=BAWDRHZOXFW4 type=del size=3010270 2024-03-04T12:41:21.002 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.997+0000 7f093583d780 1 > prepared operation key=YJXFSO53QVPS tag=CGT6HAB2JYU5 type=del size=887311 2024-03-04T12:41:21.004 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:20.998+0000 7f093583d780 1 < completed delete operation key=2YD2M0JQNCC0 tag=XKQ1LEGSFLC3 type=del 2024-03-04T12:41:21.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.000+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~9EKEP272A3LE.0 size=1048576 2024-03-04T12:41:21.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.001+0000 7f093583d780 1 > prepared part key=_multipart_YJXFSO53QVPS.2~9EKEP272A3LE.1 size=479377 2024-03-04T12:41:21.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.001+0000 7f093583d780 1 > prepared multipart upload key=YJXFSO53QVPS upload=9EKEP272A3LE tag=BDU5WKWA4QMP type=write size=2576529 2024-03-04T12:41:21.009 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.003+0000 7f093583d780 1 < suggested remove operation key=L4UQK3UJFXZC tag=MG197AHSZP3K type=del 2024-03-04T12:41:21.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.005+0000 7f093583d780 1 > prepared operation key=2R5WA9Q9ZAUG tag=BI2WIV8SEV0M type=write size=934598 2024-03-04T12:41:21.011 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.006+0000 7f093583d780 -1 < failed to complete operation key=L4UQK3UJFXZC tag=GANXCQJ1FWPQ type=del size=3059910: (22) Invalid argument 2024-03-04T12:41:21.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.007+0000 7f093583d780 1 > prepared operation key=9E12MS7PETOK tag=0GF5O6KLUFLI type=del size=1614949 2024-03-04T12:41:21.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.008+0000 7f093583d780 1 < completed write operation key=96PTQ2KHPMMM tag=PAR99QFGNK15 type=write size=447331 2024-03-04T12:41:21.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.010+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~LA9JH6X6YFXE.0 size=1048576 2024-03-04T12:41:21.017 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.011+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~LA9JH6X6YFXE.1 size=1048576 2024-03-04T12:41:21.018 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.012+0000 7f093583d780 1 > prepared part key=_multipart_UAEQORB3BDBH.2~LA9JH6X6YFXE.2 size=166977 2024-03-04T12:41:21.018 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.012+0000 7f093583d780 1 > prepared multipart upload key=UAEQORB3BDBH upload=LA9JH6X6YFXE tag=JFXNDNR9E9HD type=write size=3312705 2024-03-04T12:41:21.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.013+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~4BMMK16LGJCS.0 size=1048576 2024-03-04T12:41:21.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.014+0000 7f093583d780 1 < completed part key=_multipart_F269PJEZ05IO.2~4BMMK16LGJCS.1 size=408673 2024-03-04T12:41:21.023 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.018+0000 7f093583d780 1 < completed multipart upload key=F269PJEZ05IO upload=4BMMK16LGJCS tag=A5DIF9DZDMJ3 type=write size=2505825 2024-03-04T12:41:21.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.023+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~DQZV8JW7EKHO.0 size=1048576 2024-03-04T12:41:21.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.024+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~DQZV8JW7EKHO.1 size=1048576 2024-03-04T12:41:21.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.025+0000 7f093583d780 1 > prepared part key=_multipart_HG0EM344TJZY.2~DQZV8JW7EKHO.2 size=231708 2024-03-04T12:41:21.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.025+0000 7f093583d780 1 > prepared multipart upload key=HG0EM344TJZY upload=DQZV8JW7EKHO tag=FVNXFL6HQJSG type=write size=3377436 2024-03-04T12:41:21.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.027+0000 7f093583d780 1 < suggested remove operation key=I5NQBROT0WKE tag=K2K19F7375LH type=del 2024-03-04T12:41:21.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.028+0000 7f093583d780 1 > prepared operation key=M0AOZ89IQNSK tag=VKV9XLYG6Y2G type=write size=540301 2024-03-04T12:41:21.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.029+0000 7f093583d780 1 < completed delete operation key=54FLC10FWKL6 tag=EKOB5NHZTGYG type=del 2024-03-04T12:41:21.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.031+0000 7f093583d780 1 > prepared part key=_multipart_J6Y9V11BX06B.2~71RV8WWYKCM0.0 size=103915 2024-03-04T12:41:21.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.031+0000 7f093583d780 1 > prepared multipart upload key=J6Y9V11BX06B upload=71RV8WWYKCM0 tag=SJGZ5UOYQSYP type=write size=1152491 2024-03-04T12:41:21.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.034+0000 7f093583d780 1 < suggested update operation key=9E12MS7PETOK tag=AGY2QV2UKDP3 type=del size=2260303 2024-03-04T12:41:21.041 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.035+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~WKIIPLYASR7D.0 size=1048576 2024-03-04T12:41:21.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.036+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~WKIIPLYASR7D.1 size=568146 2024-03-04T12:41:21.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.036+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=WKIIPLYASR7D tag=KD1O2BZAXC4Q type=write size=2665298 2024-03-04T12:41:21.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.038+0000 7f093583d780 1 < suggested remove operation key=HG0EM344TJZY tag=YN4WGCDFAXNP type=del 2024-03-04T12:41:21.045 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.040+0000 7f093583d780 1 > prepared operation key=96PTQ2KHPMMM tag=QNADXMKA6SFQ type=del size=3284151 2024-03-04T12:41:21.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.042+0000 7f093583d780 1 < suggested remove operation key=AQI7H63EQSTN tag=54J1KL5EFC7K type=del 2024-03-04T12:41:21.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.043+0000 7f093583d780 1 > prepared operation key=2ZOV2JEQHXGS tag=DIBQIZKMT4L0 type=del size=1918986 2024-03-04T12:41:21.049 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.044+0000 7f093583d780 1 < completed part key=_multipart_AQI7H63EQSTN.2~CZB5VTU0Z2D7.0 size=223303 2024-03-04T12:41:21.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.046+0000 7f093583d780 1 < completed multipart upload key=AQI7H63EQSTN upload=CZB5VTU0Z2D7 tag=VCAVR2Y1IZW0 type=write size=1271879 2024-03-04T12:41:21.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.047+0000 7f093583d780 1 > prepared operation key=2YD2M0JQNCC0 tag=3JODC6XE9B8V type=del size=1456036 2024-03-04T12:41:21.054 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.048+0000 7f093583d780 -1 < failed to complete operation key=AQI7H63EQSTN tag=F71HFBMQVZ8O type=del size=571398: (22) Invalid argument 2024-03-04T12:41:21.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.050+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~ENRRGHYT69UF.0 size=1048576 2024-03-04T12:41:21.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.051+0000 7f093583d780 1 > prepared part key=_multipart_I6DIP4VGHMNO.2~ENRRGHYT69UF.1 size=684469 2024-03-04T12:41:21.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.051+0000 7f093583d780 1 > prepared multipart upload key=I6DIP4VGHMNO upload=ENRRGHYT69UF tag=19QLC9XHWR3A type=write size=2781621 2024-03-04T12:41:21.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.052+0000 7f093583d780 1 < completed delete operation key=TMAI6MOG2C4N tag=49ARTBO5H2IL type=del 2024-03-04T12:41:21.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.053+0000 7f093583d780 1 > prepared operation key=AQI7H63EQSTN tag=M6ZERKXCIUHB type=del size=4026048 2024-03-04T12:41:21.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.056+0000 7f093583d780 1 < suggested remove operation key=NQF43I07F2HT tag=GY39DLCFLH3V type=del 2024-03-04T12:41:21.062 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.057+0000 7f093583d780 1 > prepared operation key=I6DIP4VGHMNO tag=GAUAW8T6I95X type=del size=1670202 2024-03-04T12:41:21.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.058+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~CD4JXGQG6Z30.0 size=1048576 2024-03-04T12:41:21.064 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.059+0000 7f093583d780 1 < completed part key=_multipart_2YD2M0JQNCC0.2~CD4JXGQG6Z30.1 size=631106 2024-03-04T12:41:21.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.061+0000 7f093583d780 1 < completed multipart upload key=2YD2M0JQNCC0 upload=CD4JXGQG6Z30 tag=IPYXFZ42X48D type=write size=2728258 2024-03-04T12:41:21.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.063+0000 7f093583d780 1 > prepared part key=_multipart_L4UQK3UJFXZC.2~J3RS43UYZK4D.0 size=112645 2024-03-04T12:41:21.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.063+0000 7f093583d780 1 > prepared multipart upload key=L4UQK3UJFXZC upload=J3RS43UYZK4D tag=TU1TMYV0897L type=write size=1161221 2024-03-04T12:41:21.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.064+0000 7f093583d780 1 < canceled operation key=YJXFSO53QVPS tag=CGT6HAB2JYU5 type=del size=887311 2024-03-04T12:41:21.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:41:21.065+0000 7f093583d780 1 > prepared operation key=UAEQORB3BDBH tag=8GYS09ZNNIB3 type=del size=3575714 2024-03-04T12:41:21.072 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] cls_rgw_stats.simulate (8992 ms) 2024-03-04T12:41:21.072 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 1 test from cls_rgw_stats (8992 ms total) 2024-03-04T12:41:21.072 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:41:21.072 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:41:21.092 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 1 test from 1 test suite ran. (10892 ms total) 2024-03-04T12:41:21.092 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 1 test. 2024-03-04T12:41:21.096 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:41:21.096 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:41:21.176 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-03-04T12:41:21.177 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-03-04T12:41:21.177 DEBUG:teuthology.orchestra.run.smithi090:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-03-04T12:41:21.258 INFO:tasks.workunit.client.0.smithi090.stdout:Running main() from gmock_main.cc 2024-03-04T12:41:21.258 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 31 tests from 1 test suite. 2024-03-04T12:41:21.258 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:41:23.109 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 31 tests from CmpOmap 2024-03-04T12:41:23.109 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-03-04T12:41:23.124 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (15 ms) 2024-03-04T12:41:23.124 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-03-04T12:41:23.128 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (4 ms) 2024-03-04T12:41:23.128 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-03-04T12:41:23.130 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-03-04T12:41:23.130 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-03-04T12:41:23.134 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-03-04T12:41:23.134 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-03-04T12:41:23.140 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-03-04T12:41:23.140 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-03-04T12:41:23.145 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2024-03-04T12:41:23.146 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-03-04T12:41:23.149 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-03-04T12:41:23.149 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-03-04T12:41:23.152 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (4 ms) 2024-03-04T12:41:23.153 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-03-04T12:41:23.156 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-03-04T12:41:23.156 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-03-04T12:41:23.161 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-03-04T12:41:23.161 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-03-04T12:41:23.161 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-03-04T12:41:23.161 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-03-04T12:41:23.162 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-03-04T12:41:23.162 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-03-04T12:41:23.169 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-03-04T12:41:23.169 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-03-04T12:41:23.177 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (8 ms) 2024-03-04T12:41:23.177 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-03-04T12:41:23.183 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-03-04T12:41:23.184 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-03-04T12:41:23.190 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-03-04T12:41:23.190 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-03-04T12:41:23.197 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-03-04T12:41:23.198 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-03-04T12:41:23.206 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-03-04T12:41:23.206 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-03-04T12:41:23.209 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (4 ms) 2024-03-04T12:41:23.209 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-03-04T12:41:23.212 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-03-04T12:41:23.212 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-03-04T12:41:23.213 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-03-04T12:41:23.213 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-03-04T12:41:23.214 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-03-04T12:41:23.214 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-03-04T12:41:23.220 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (6 ms) 2024-03-04T12:41:23.220 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-03-04T12:41:23.226 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-03-04T12:41:23.226 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-03-04T12:41:23.233 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-03-04T12:41:23.233 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-03-04T12:41:23.242 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (10 ms) 2024-03-04T12:41:23.242 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-03-04T12:41:23.245 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-03-04T12:41:23.245 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-03-04T12:41:23.247 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-03-04T12:41:23.247 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-03-04T12:41:23.248 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-03-04T12:41:23.248 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-03-04T12:41:23.249 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-03-04T12:41:23.249 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-03-04T12:41:23.256 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-03-04T12:41:23.256 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 31 tests from CmpOmap (147 ms total) 2024-03-04T12:41:23.256 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:41:23.256 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:41:24.112 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 31 tests from 1 test suite ran. (2854 ms total) 2024-03-04T12:41:24.113 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 31 tests. 2024-03-04T12:41:24.115 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:41:24.115 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:41:24.199 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-03-04T12:41:24.200 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-03-04T12:41:24.200 DEBUG:teuthology.orchestra.run.smithi090:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-03-04T12:41:24.284 INFO:tasks.workunit.client.0.smithi090.stdout:Running main() from gmock_main.cc 2024-03-04T12:41:24.284 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-04T12:41:24.284 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:41:24.285 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 24 tests from TestCls2PCQueue 2024-03-04T12:41:24.285 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-03-04T12:41:27.143 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2859 ms) 2024-03-04T12:41:27.143 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-03-04T12:41:30.142 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (2999 ms) 2024-03-04T12:41:30.142 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-03-04T12:41:33.173 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.Reserve (3031 ms) 2024-03-04T12:41:33.173 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-03-04T12:41:36.192 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3019 ms) 2024-03-04T12:41:36.192 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-03-04T12:41:39.200 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.Commit (3007 ms) 2024-03-04T12:41:39.200 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-03-04T12:41:42.226 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.Stats (3028 ms) 2024-03-04T12:41:42.227 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-03-04T12:41:46.257 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4030 ms) 2024-03-04T12:41:46.257 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-03-04T12:41:49.292 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.Abort (3034 ms) 2024-03-04T12:41:49.292 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-03-04T12:41:52.305 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.ReserveError (3014 ms) 2024-03-04T12:41:52.306 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-03-04T12:41:55.326 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.CommitError (3021 ms) 2024-03-04T12:41:55.326 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-03-04T12:41:58.351 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.AbortError (3025 ms) 2024-03-04T12:41:58.351 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-03-04T12:42:01.377 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3026 ms) 2024-03-04T12:42:01.377 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-03-04T12:42:04.384 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3007 ms) 2024-03-04T12:42:04.384 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-03-04T12:42:07.412 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3028 ms) 2024-03-04T12:42:07.412 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-03-04T12:42:10.438 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3026 ms) 2024-03-04T12:42:10.439 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-03-04T12:42:13.453 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3015 ms) 2024-03-04T12:42:13.453 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-03-04T12:42:16.489 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3035 ms) 2024-03-04T12:42:16.489 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-03-04T12:42:19.497 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.Cleanup (3008 ms) 2024-03-04T12:42:19.498 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-03-04T12:42:29.536 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10036 ms) 2024-03-04T12:42:29.536 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-03-04T12:42:32.549 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3016 ms) 2024-03-04T12:42:32.549 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-03-04T12:42:44.587 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (12038 ms) 2024-03-04T12:42:44.588 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-03-04T12:42:48.609 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4020 ms) 2024-03-04T12:42:48.609 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-03-04T12:42:55.649 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (7042 ms) 2024-03-04T12:42:55.649 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-03-04T12:43:00.688 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5039 ms) 2024-03-04T12:43:00.691 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 24 tests from TestCls2PCQueue (96404 ms total) 2024-03-04T12:43:00.691 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:00.691 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:00.691 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 24 tests from 1 test suite ran. (96404 ms total) 2024-03-04T12:43:00.691 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 24 tests. 2024-03-04T12:43:00.693 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:43:00.693 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:43:00.751 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-03-04T12:43:00.752 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-03-04T12:43:00.753 DEBUG:teuthology.orchestra.run.smithi090:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-03-04T12:43:00.804 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:00.804 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:00.804 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 6 tests from 1 test suite. 2024-03-04T12:43:00.805 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:02.696 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 6 tests from rgw_gc_log 2024-03-04T12:43:02.696 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-03-04T12:43:02.710 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] rgw_gc_log.init_existing_queue (14 ms) 2024-03-04T12:43:02.710 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-03-04T12:43:02.713 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-03-04T12:43:02.713 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-03-04T12:43:02.715 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-03-04T12:43:02.716 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-03-04T12:43:02.717 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-03-04T12:43:02.717 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-03-04T12:43:02.720 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] rgw_gc_log.defer1_after_init (2 ms) 2024-03-04T12:43:02.720 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-03-04T12:43:02.722 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] rgw_gc_log.defer2_before_init (1 ms) 2024-03-04T12:43:02.722 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 6 tests from rgw_gc_log (26 ms total) 2024-03-04T12:43:02.722 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:02.722 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:03.713 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 6 tests from 1 test suite ran. (2909 ms total) 2024-03-04T12:43:03.713 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 6 tests. 2024-03-04T12:43:03.716 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:43:03.717 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:43:03.763 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-03-04T12:43:03.764 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-03-04T12:43:03.764 DEBUG:teuthology.orchestra.run.smithi090:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-03-04T12:43:03.858 INFO:tasks.workunit.client.0.smithi090.stdout:Running main() from gmock_main.cc 2024-03-04T12:43:03.858 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-04T12:43:03.858 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:03.858 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 4 tests from TestRGWObj 2024-03-04T12:43:03.858 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestRGWObj.underscore 2024-03-04T12:43:03.858 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj 2024-03-04T12:43:03.858 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj 2024-03-04T12:43:03.858 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: _obj ns= i= 2024-03-04T12:43:03.858 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj 2024-03-04T12:43:03.858 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: _obj ns= i= 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: _obj ns= i= 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout: "obj1": { 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.859 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.860 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.860 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.860 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.860 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.860 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.860 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.860 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.860 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.860 INFO:tasks.workunit.client.0.smithi090.stdout: "obj2": { 2024-03-04T12:43:03.860 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.860 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.860 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.861 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3": { 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.862 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3-2": { 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.863 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.864 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.864 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.864 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.864 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.864 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.864 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.864 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj 2024-03-04T12:43:03.864 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj 2024-03-04T12:43:03.864 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: _obj ns=ns i= 2024-03-04T12:43:03.864 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj 2024-03-04T12:43:03.864 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj 2024-03-04T12:43:03.864 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: _obj ns=ns i= 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: _obj ns=ns i= 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout: "obj1": { 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.865 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: "obj2": { 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.866 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3": { 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.867 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.868 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3-2": { 2024-03-04T12:43:03.869 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.869 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.869 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.869 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.869 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.869 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.869 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.869 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.869 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.869 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj[v1] 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj[v1] 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: _obj ns= i=v1 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj[v1] 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj[v1] 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: _obj ns= i=v1 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj[v1] 2024-03-04T12:43:03.870 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj[v1] 2024-03-04T12:43:03.871 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: _obj ns= i=v1 2024-03-04T12:43:03.871 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.871 INFO:tasks.workunit.client.0.smithi090.stdout: "obj1": { 2024-03-04T12:43:03.871 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.871 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.871 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.871 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.871 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.871 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.871 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.871 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "v1", 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: "obj2": { 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.872 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.873 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.873 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.873 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.873 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.873 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.873 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.873 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.873 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.874 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.874 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.874 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "v1", 2024-03-04T12:43:03.874 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.874 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.874 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.875 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3": { 2024-03-04T12:43:03.875 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.875 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.875 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.875 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.875 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.875 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.875 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.875 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.875 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.875 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.875 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.876 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.876 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.876 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.876 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.876 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.876 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.876 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3-2": { 2024-03-04T12:43:03.876 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.876 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.876 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.876 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.877 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.877 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.877 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.877 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.877 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.877 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.878 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.878 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.878 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.878 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "v1", 2024-03-04T12:43:03.878 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.878 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.879 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.879 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.879 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj[v1] 2024-03-04T12:43:03.879 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj[v1] 2024-03-04T12:43:03.879 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: _obj ns=ns i=v1 2024-03-04T12:43:03.879 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj[v1] 2024-03-04T12:43:03.879 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj[v1] 2024-03-04T12:43:03.879 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: _obj ns=ns i=v1 2024-03-04T12:43:03.879 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj[v1] 2024-03-04T12:43:03.879 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: _obj[v1] 2024-03-04T12:43:03.879 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: _obj ns=ns i=v1 2024-03-04T12:43:03.879 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: "obj1": { 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.880 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.881 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.881 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "v1", 2024-03-04T12:43:03.881 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.881 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.881 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.881 INFO:tasks.workunit.client.0.smithi090.stdout: "obj2": { 2024-03-04T12:43:03.882 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.882 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.882 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.882 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.882 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.882 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.883 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.883 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.883 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.883 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.883 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.883 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.884 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.884 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "v1", 2024-03-04T12:43:03.884 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.884 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.884 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.884 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3": { 2024-03-04T12:43:03.884 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.885 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.885 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.885 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.885 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.885 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.885 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.886 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.886 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.886 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.886 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.886 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.886 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.887 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.887 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.887 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.887 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.887 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3-2": { 2024-03-04T12:43:03.887 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.887 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.888 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.888 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.888 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.888 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.888 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.888 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.889 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.889 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.889 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.889 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.889 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_obj", 2024-03-04T12:43:03.889 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "v1", 2024-03-04T12:43:03.889 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.890 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.890 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.890 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.890 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-03-04T12:43:03.890 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestRGWObj.no_underscore 2024-03-04T12:43:03.890 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj 2024-03-04T12:43:03.890 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj 2024-03-04T12:43:03.891 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: obj ns= i= 2024-03-04T12:43:03.891 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj 2024-03-04T12:43:03.891 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj 2024-03-04T12:43:03.891 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: obj ns= i= 2024-03-04T12:43:03.891 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj 2024-03-04T12:43:03.891 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj 2024-03-04T12:43:03.891 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: obj ns= i= 2024-03-04T12:43:03.892 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.892 INFO:tasks.workunit.client.0.smithi090.stdout: "obj1": { 2024-03-04T12:43:03.892 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.892 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.892 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.892 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.892 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.893 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.893 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.893 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.893 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.893 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.893 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: "obj2": { 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.894 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.895 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.895 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.895 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.895 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.895 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.895 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.895 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.895 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.895 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.895 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.895 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3": { 2024-03-04T12:43:03.896 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.896 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.896 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.896 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.896 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.896 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.896 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.896 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.896 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.896 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.896 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.896 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3-2": { 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.897 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: obj ns=ns i= 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: obj ns=ns i= 2024-03-04T12:43:03.898 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: obj ns=ns i= 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout: "obj1": { 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.899 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.900 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.900 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.900 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.900 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.900 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.900 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.900 INFO:tasks.workunit.client.0.smithi090.stdout: "obj2": { 2024-03-04T12:43:03.900 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.900 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.900 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.900 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.900 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3": { 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.901 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.902 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3-2": { 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.903 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj[v1] 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj[v1] 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: obj ns= i=v1 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj[v1] 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj[v1] 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: obj ns= i=v1 2024-03-04T12:43:03.904 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj[v1] 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj[v1] 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: obj ns= i=v1 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout: "obj1": { 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.905 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "v1", 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "obj2": { 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.906 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "v1", 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3": { 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.907 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3-2": { 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.908 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "v1", 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.909 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj[v1] 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj[v1] 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: obj ns=ns i=v1 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj[v1] 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj[v1] 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: obj ns=ns i=v1 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj[v1] 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout:parsed: obj[v1] 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout:stripped: obj ns=ns i=v1 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout: "obj1": { 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.910 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "v1", 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: "obj2": { 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.911 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.912 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.912 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.912 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.912 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.912 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.912 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.912 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.912 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "v1", 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3": { 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.913 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: "obj3-2": { 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.914 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "obj", 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "v1", 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.915 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.916 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.917 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.918 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.918 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.918 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.918 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.918 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.918 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.918 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.918 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.918 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.918 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.918 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": "default-placement.data", 2024-03-04T12:43:03.919 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker_myobj", 2024-03-04T12:43:03.919 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:03.919 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.919 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.919 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.919 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.919 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.919 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.919 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.919 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.919 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.919 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.920 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.921 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.922 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.922 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.922 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.922 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.922 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.922 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.922 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.922 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.922 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.922 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.922 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.923 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.923 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.923 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.923 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.923 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.923 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.923 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.923 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.923 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker_myobj", 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.924 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.925 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.926 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.927 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": "default-placement.data", 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns_myobj", 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.928 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.929 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.930 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.931 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.932 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.932 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.932 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.932 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.932 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.932 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.933 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:03.933 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns_myobj", 2024-03-04T12:43:03.933 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:03.933 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.933 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.934 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.934 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.934 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.934 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.934 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.934 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.934 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.934 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.934 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.934 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.934 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.934 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.935 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.935 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.935 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.935 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.935 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.935 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.935 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.935 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.936 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.936 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.936 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.936 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.936 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.936 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.937 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.937 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.937 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.937 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.937 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.938 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.938 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.938 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.938 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.938 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.938 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.938 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.938 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.938 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.939 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": "default-placement.data", 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__:inst_myobj", 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.940 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.941 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.942 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.942 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.942 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.942 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.942 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.942 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.942 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.942 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.942 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.942 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.942 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.942 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.943 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.943 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.943 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.943 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.943 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.943 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.943 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.943 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.943 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.943 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.943 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.943 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__:inst_myobj", 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.944 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.945 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.946 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.947 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.948 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": "default-placement.data", 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns:inst_myobj", 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.949 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.950 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.951 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.952 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.952 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.952 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.952 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.952 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.952 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.952 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.952 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.952 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:03.953 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.953 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.953 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.953 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.953 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.953 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.953 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:03.953 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns:inst_myobj", 2024-03-04T12:43:03.954 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:03.954 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.954 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.954 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.954 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.954 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.954 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.955 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.955 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.955 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.955 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.955 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.955 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.955 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.955 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.956 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.956 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.956 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:03.956 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:03.956 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.956 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.956 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.957 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.957 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.957 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.957 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.957 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.957 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.958 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.958 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.958 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.958 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.958 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.958 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.958 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.958 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.959 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.959 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.959 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.959 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.959 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.959 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.959 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.959 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.960 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.960 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.960 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.960 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.960 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.960 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.960 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:03.961 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.961 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.961 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.961 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.961 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.961 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.961 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.961 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": "default-placement.data", 2024-03-04T12:43:03.962 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker___myobj", 2024-03-04T12:43:03.962 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj" 2024-03-04T12:43:03.962 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.962 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.962 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.962 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.962 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.963 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.963 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.963 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.963 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.963 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.963 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.963 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.964 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.964 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.964 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.964 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.964 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:03.964 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.965 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.965 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.965 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.965 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.965 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.965 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.965 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.966 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.966 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.966 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.966 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.966 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.966 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.966 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.967 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.967 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.967 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.967 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.967 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.967 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.967 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.968 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.968 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.968 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.968 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.968 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.968 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.968 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.969 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.969 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.969 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.969 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:03.969 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.969 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.969 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.969 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.970 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.970 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.970 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.970 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:03.970 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker___myobj", 2024-03-04T12:43:03.970 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj" 2024-03-04T12:43:03.971 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.971 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.971 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.971 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.971 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.971 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.971 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.972 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.972 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.972 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.972 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.972 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.972 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.972 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.973 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.973 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.973 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:03.973 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.973 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.973 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.973 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.973 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.974 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.974 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.974 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.974 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.974 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.974 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.974 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.974 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.975 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.975 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.975 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.975 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.975 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.975 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.975 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.976 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.976 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.976 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.976 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.976 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.976 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.976 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.977 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.977 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.977 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.977 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.977 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.977 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:03.977 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.977 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.978 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.978 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.978 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.978 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.978 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.978 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": "default-placement.data", 2024-03-04T12:43:03.978 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns__myobj", 2024-03-04T12:43:03.979 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:03.979 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.979 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.979 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.979 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.979 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.979 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.979 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.980 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.980 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.980 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.980 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.980 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.980 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.980 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.981 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.981 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.981 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:03.981 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.981 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.981 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.981 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.981 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.982 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.982 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.982 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.982 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.982 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.982 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.982 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.983 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.983 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.983 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.983 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.983 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.983 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.983 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.984 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.984 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.984 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.984 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.984 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.984 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.984 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.984 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.985 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.985 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.985 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.985 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.985 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.985 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:03.985 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.985 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.986 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.986 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.986 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.986 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.986 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.986 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:03.986 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns__myobj", 2024-03-04T12:43:03.986 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:03.987 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.987 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.987 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.987 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.987 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.987 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.987 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.987 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.988 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.988 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.988 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.988 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.988 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.988 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.988 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.989 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.989 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:03.989 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:03.989 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:03.989 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.989 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.989 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.989 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.989 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.989 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.989 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.990 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.991 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.992 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.992 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.992 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.992 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": "default-placement.data", 2024-03-04T12:43:03.992 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__:inst__myobj", 2024-03-04T12:43:03.992 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj" 2024-03-04T12:43:03.992 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.992 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.992 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.992 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.993 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.993 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:03.993 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.993 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.993 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.993 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.993 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:03.994 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.994 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:03.994 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.994 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.994 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.994 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:03.994 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:03.994 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.994 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.995 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.995 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.995 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.995 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.995 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.995 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.995 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.995 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.996 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.996 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.996 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.996 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.996 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.996 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.996 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.996 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.996 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:03.997 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__:inst__myobj", 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj" 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:03.998 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:03.999 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.000 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.001 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": "default-placement.data", 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns:inst__myobj", 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.002 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.003 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.004 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.005 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.006 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns:inst__myobj", 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.007 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.008 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.009 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.010 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": "default-placement.data", 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker___myobj_", 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj_" 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.011 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.012 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.013 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.014 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker___myobj_", 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj_" 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.015 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.016 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.017 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.018 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": "default-placement.data", 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns__myobj_", 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.019 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.020 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.021 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.022 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns__myobj_", 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.023 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.024 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.025 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.026 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": "default-placement.data", 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__:inst__myobj_", 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj_" 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.027 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.028 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.029 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.030 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__:inst__myobj_", 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj_" 2024-03-04T12:43:04.031 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.032 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.033 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.034 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": "default-placement.data", 2024-03-04T12:43:04.035 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "test", 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": "", 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": "" 2024-03-04T12:43:04.036 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.037 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: "obj": { 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.038 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.039 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.040 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.041 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.042 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.042 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker_myobj", 2024-03-04T12:43:04.042 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.042 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.042 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.042 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.042 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.042 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.042 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.042 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.042 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.042 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout:raw=.data-pool:marker_myobj 2024-03-04T12:43:04.043 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj2": { 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker_myobj", 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj2": { 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.044 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout:raw2=.data-pool:marker_myobj 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.045 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns_myobj", 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.046 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout:raw=.data-pool:marker__ns_myobj 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj2": { 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.047 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns_myobj", 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj2": { 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.048 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout:raw2=.data-pool:marker__ns_myobj 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__:inst_myobj", 2024-03-04T12:43:04.049 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.050 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout:raw=.data-pool:marker__:inst_myobj 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj2": { 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__:inst_myobj", 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.051 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj2": { 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.052 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout:raw2=.data-pool:marker__:inst_myobj 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns:inst_myobj", 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.053 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.054 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj2": { 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns:inst_myobj", 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.055 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj2": { 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "myobj", 2024-03-04T12:43:04.056 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker___myobj", 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj" 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.057 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.058 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout:raw=.data-pool:marker___myobj 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj2": { 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker___myobj", 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj" 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj2": { 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.059 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.060 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout:raw2=.data-pool:marker___myobj 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns__myobj", 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.061 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.062 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout:raw=.data-pool:marker__ns__myobj 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj2": { 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns__myobj", 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj2": { 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.063 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.064 INFO:tasks.workunit.client.0.smithi090.stdout:raw2=.data-pool:marker__ns__myobj 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__:inst__myobj", 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj" 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.065 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout:raw=.data-pool:marker__:inst__myobj 2024-03-04T12:43:04.066 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj2": { 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__:inst__myobj", 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj" 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj2": { 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.067 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout:raw2=.data-pool:marker__:inst__myobj 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.068 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns:inst__myobj", 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.069 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj2": { 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.070 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns:inst__myobj", 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj2": { 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.071 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj", 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.072 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker___myobj_", 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj_" 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.073 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout:raw=.data-pool:marker___myobj_ 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj2": { 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.074 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker___myobj_", 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj_" 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj2": { 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.075 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout:raw2=.data-pool:marker___myobj_ 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns__myobj_", 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.076 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.077 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout:raw=.data-pool:marker__ns__myobj_ 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj2": { 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns__myobj_", 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj2": { 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.078 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "", 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.079 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__:inst__myobj_", 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj_" 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.080 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.081 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj2": { 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__:inst__myobj_", 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "marker__myobj_" 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj2": { 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.082 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "" 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.083 INFO:tasks.workunit.client.0.smithi090.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj": { 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj": { 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.084 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.085 INFO:tasks.workunit.client.0.smithi090.stdout: "raw_obj2": { 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: "pool": ".data-pool", 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: "loc": "" 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: "new_obj2": { 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket": { 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "ebtest", 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: "marker": "marker", 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_id": "bucket-id", 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: "tenant": "", 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: "explicit_placement": { 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: "data_pool": ".data-pool", 2024-03-04T12:43:04.086 INFO:tasks.workunit.client.0.smithi090.stdout: "data_extra_pool": "", 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout: "index_pool": ".index-pool" 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout: "key": { 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout: "name": "_myobj_", 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout: "instance": "inst", 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout: "ns": "ns" 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:04.087 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:04.088 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-03-04T12:43:04.088 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 4 tests. 2024-03-04T12:43:04.088 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:43:04.088 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:43:04.131 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-03-04T12:43:04.132 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-03-04T12:43:04.133 DEBUG:teuthology.orchestra.run.smithi090:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-03-04T12:43:04.245 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:04.245 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:04.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.282+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.284+0000 7f6fddf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.284+0000 7f6fddf31800 20 realm 2024-03-04T12:43:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.284+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.284+0000 7f6fddf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.284+0000 7f6fddf31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:43:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.284+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.284+0000 7f6fddf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.284+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.285+0000 7f6fddf31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:43:04.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.285+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.286+0000 7f6fddf31800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:43:04.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.286+0000 7f6fddf31800 20 searching for the correct realm 2024-03-04T12:43:04.496 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.490+0000 7f6fd3fff640 0 -- 172.21.15.90:0/416561210 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f6fc40a9f10 msgr2=0x7f6fc40aa5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:43:04.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.494+0000 7f6fd9c38640 0 -- 172.21.15.90:0/416561210 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f6fc40b0570 msgr2=0x7f6fc40b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:43:04.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.701+0000 7f6fddf31800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:43:04.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.701+0000 7f6fddf31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:43:04.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.701+0000 7f6fddf31800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:43:04.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.701+0000 7f6fddf31800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:43:04.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.701+0000 7f6fddf31800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:43:04.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.701+0000 7f6fddf31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:43:04.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.701+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.701+0000 7f6fddf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:04.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.701+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.702+0000 7f6fddf31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:43:04.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.702+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.702+0000 7f6fddf31800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:43:04.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.702+0000 7f6fddf31800 20 zone default found 2024-03-04T12:43:04.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.702+0000 7f6fddf31800 4 Realm: () 2024-03-04T12:43:04.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.702+0000 7f6fddf31800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:43:04.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.702+0000 7f6fddf31800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:43:04.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.702+0000 7f6fddf31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:43:04.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.702+0000 7f6fddf31800 20 zonegroup default 2024-03-04T12:43:04.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.702+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.702+0000 7f6fddf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:04.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.702+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.703+0000 7f6fddf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:04.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.703+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.703+0000 7f6fddf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:04.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.703+0000 7f6fddf31800 20 started sync module instance, tier type = 2024-03-04T12:43:04.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.703+0000 7f6fddf31800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:43:04.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.713+0000 7f6fddf31800 20 add_watcher() i=0 2024-03-04T12:43:04.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.713+0000 7f6fddf31800 20 add_watcher() i=1 2024-03-04T12:43:04.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.713+0000 7f6fddf31800 20 add_watcher() i=2 2024-03-04T12:43:04.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.713+0000 7f6fddf31800 20 add_watcher() i=3 2024-03-04T12:43:04.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.713+0000 7f6fddf31800 20 add_watcher() i=4 2024-03-04T12:43:04.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.713+0000 7f6fddf31800 20 add_watcher() i=5 2024-03-04T12:43:04.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.713+0000 7f6fddf31800 20 add_watcher() i=6 2024-03-04T12:43:04.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.714+0000 7f6fddf31800 20 add_watcher() i=7 2024-03-04T12:43:04.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.714+0000 7f6fddf31800 2 all 8 watchers are set, enabling cache 2024-03-04T12:43:04.722 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.716+0000 7f6e8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:43:04.722 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.716+0000 7f6fddf31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:43:04.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.716+0000 7f6fddf31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:43:04.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.716+0000 7f6fddf31800 5 note: GC not initialized 2024-03-04T12:43:04.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.716+0000 7f6e8a7fc640 20 reqs_thread_entry: start 2024-03-04T12:43:04.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.717+0000 7f6fddf31800 20 init_complete bucket index max shards: 11 2024-03-04T12:43:04.724 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.717+0000 7f6fddf31800 20 Filter name: none 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.717+0000 7f6dfbfff640 20 reqs_thread_entry: start 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.717+0000 7f6fddf31800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.717+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.717+0000 7f6fddf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.717+0000 7f6fddf31800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.717+0000 7f6fddf31800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.717+0000 7f6fddf31800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.717+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.718+0000 7f6fddf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.718+0000 7f6fddf31800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.718+0000 7f6fddf31800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.718+0000 7f6fddf31800 10 cache get: name=default.rgw.meta+users.keys+sdkrMgyiacR3OWZufhPCUUyvYWs= : miss 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.718+0000 7f6fddf31800 20 rados->read ofs=0 len=0 2024-03-04T12:43:04.725 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.718+0000 7f6fddf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:04.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.718+0000 7f6fddf31800 10 cache put: name=default.rgw.meta+users.keys+sdkrMgyiacR3OWZufhPCUUyvYWs= info.flags=0x0 2024-03-04T12:43:04.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.718+0000 7f6fddf31800 10 adding default.rgw.meta+users.keys+sdkrMgyiacR3OWZufhPCUUyvYWs= to cache LRU end 2024-03-04T12:43:04.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.718+0000 7f6fddf31800 10 cache get: name=default.rgw.meta+users.keys+sdkrMgyiacR3OWZufhPCUUyvYWs= : hit (negative entry) 2024-03-04T12:43:04.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.718+0000 7f6fddf31800 10 cache get: name=default.rgw.meta+users.keys+sdkrMgyiacR3OWZufhPCUUyvYWs= : hit (negative entry) 2024-03-04T12:43:04.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.719+0000 7f6fddf31800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-03-04T12:43:04.726 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.719+0000 7f6fddf31800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-04T12:43:04.727 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.719+0000 7f6fddf31800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-03-04T12:43:04.727 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.720+0000 7f6ebd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1035087118337 cookie 94793132080368 notifier 5300 bl.length()=664 2024-03-04T12:43:04.727 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.720+0000 7f6ebd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-03-04T12:43:04.727 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.720+0000 7f6ebd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-04T12:43:04.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.721+0000 7f6fddf31800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-03-04T12:43:04.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.721+0000 7f6fddf31800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-04T12:43:04.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.721+0000 7f6fddf31800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-03-04T12:43:04.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.722+0000 7f6ebd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1035087118336 cookie 94793132076384 notifier 5300 bl.length()=194 2024-03-04T12:43:04.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.722+0000 7f6ebd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-03-04T12:43:04.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.722+0000 7f6ebd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-04T12:43:04.730 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.724+0000 7f6fddf31800 10 cache put: name=default.rgw.meta+users.keys+sdkrMgyiacR3OWZufhPCUUyvYWs= info.flags=0x7 2024-03-04T12:43:04.730 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.724+0000 7f6fddf31800 10 moving default.rgw.meta+users.keys+sdkrMgyiacR3OWZufhPCUUyvYWs= to cache LRU end 2024-03-04T12:43:04.730 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.724+0000 7f6fddf31800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:sdkrMgyiacR3OWZufhPCUUyvYWs=, ofs0, ns] 2024-03-04T12:43:04.730 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.724+0000 7f6ebcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1035087118340 cookie 94793132073456 notifier 5300 bl.length()=203 2024-03-04T12:43:04.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.724+0000 7f6ebcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+sdkrMgyiacR3OWZufhPCUUyvYWs= info.flags=0x7 2024-03-04T12:43:04.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.724+0000 7f6ebcff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+sdkrMgyiacR3OWZufhPCUUyvYWs= to cache LRU end 2024-03-04T12:43:04.731 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:04.731 INFO:tasks.workunit.client.0.smithi090.stdout: "user_id": "ceph-test-librgw-file", 2024-03-04T12:43:04.731 INFO:tasks.workunit.client.0.smithi090.stdout: "display_name": "librgw test user", 2024-03-04T12:43:04.731 INFO:tasks.workunit.client.0.smithi090.stdout: "email": "librgw@example.com", 2024-03-04T12:43:04.731 INFO:tasks.workunit.client.0.smithi090.stdout: "suspended": 0, 2024-03-04T12:43:04.731 INFO:tasks.workunit.client.0.smithi090.stdout: "max_buckets": 1000, 2024-03-04T12:43:04.731 INFO:tasks.workunit.client.0.smithi090.stdout: "subusers": [], 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: "keys": [ 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: { 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: "user": "ceph-test-librgw-file", 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: "access_key": "sdkrMgyiacR3OWZufhPCUUyvYWs=", 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: "secret_key": "l1WDNIbLtgMm8DJ6492p9mWiMBPOLXALF83BKXzSNvyCQ6qIOA94yg==", 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: "active": true 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: ], 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: "swift_keys": [], 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: "caps": [], 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: "op_mask": "read, write, delete", 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: "default_placement": "", 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: "default_storage_class": "", 2024-03-04T12:43:04.732 INFO:tasks.workunit.client.0.smithi090.stdout: "placement_tags": [], 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_quota": { 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "enabled": false, 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "max_size": -1, 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "max_objects": -1 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "user_quota": { 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "enabled": false, 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "max_size": -1, 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "max_objects": -1 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:04.733 INFO:tasks.workunit.client.0.smithi090.stdout: "temp_url_keys": [], 2024-03-04T12:43:04.734 INFO:tasks.workunit.client.0.smithi090.stdout: "type": "rgw", 2024-03-04T12:43:04.734 INFO:tasks.workunit.client.0.smithi090.stdout: "mfa_ids": [] 2024-03-04T12:43:04.734 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:04.734 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:04.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.725+0000 7f6e8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:43:04.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.728+0000 7f6fddf31800 20 remove_watcher() i=0 2024-03-04T12:43:04.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.728+0000 7f6fddf31800 2 removed watcher, disabling cache 2024-03-04T12:43:04.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.729+0000 7f6fddf31800 20 remove_watcher() i=1 2024-03-04T12:43:04.736 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.730+0000 7f6fddf31800 20 remove_watcher() i=2 2024-03-04T12:43:04.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.731+0000 7f6fddf31800 20 remove_watcher() i=3 2024-03-04T12:43:04.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.732+0000 7f6fddf31800 20 remove_watcher() i=4 2024-03-04T12:43:04.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.733+0000 7f6fddf31800 20 remove_watcher() i=5 2024-03-04T12:43:04.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.734+0000 7f6fddf31800 20 remove_watcher() i=6 2024-03-04T12:43:04.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:04.735+0000 7f6fddf31800 20 remove_watcher() i=7 2024-03-04T12:43:04.751 INFO:tasks.workunit.client.0.smithi090.stdout:phase 1.1 2024-03-04T12:43:04.771 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-04T12:43:04.771 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:04.771 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 24 tests from LibRGW 2024-03-04T12:43:04.771 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:43:04.781 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:04.782 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:04.956 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.INIT (185 ms) 2024-03-04T12:43:04.956 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-04T12:43:04.957 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-04T12:43:04.957 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:43:04.957 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-04T12:43:04.957 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-04T12:43:04.967 INFO:tasks.workunit.client.0.smithi090.stdout:creating: nfsroot:foo/bar/baz/quux 2024-03-04T12:43:04.971 INFO:tasks.workunit.client.0.smithi090.stdout:creating: nfsroot:foo/f1 2024-03-04T12:43:04.974 INFO:tasks.workunit.client.0.smithi090.stdout:creating: nfsroot:foo/f2 2024-03-04T12:43:04.979 INFO:tasks.workunit.client.0.smithi090.stdout:creating: nfsroot:foo/bar/f1 2024-03-04T12:43:04.983 INFO:tasks.workunit.client.0.smithi090.stdout:creating: nfsroot:foo/bar/d1/ 2024-03-04T12:43:04.985 INFO:tasks.workunit.client.0.smithi090.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-03-04T12:43:04.988 INFO:tasks.workunit.client.0.smithi090.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-03-04T12:43:04.991 INFO:tasks.workunit.client.0.smithi090.stdout:creating: nfsroot:foo/bar/baz/momma 2024-03-04T12:43:04.993 INFO:tasks.workunit.client.0.smithi090.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-03-04T12:43:04.995 INFO:tasks.workunit.client.0.smithi090.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-03-04T12:43:04.997 INFO:tasks.workunit.client.0.smithi090.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-03-04T12:43:05.001 INFO:tasks.workunit.client.0.smithi090.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-03-04T12:43:05.003 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SETUP_HIER1 (47 ms) 2024-03-04T12:43:05.003 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-04T12:43:05.099 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SETUP_DIRS1 (95 ms) 2024-03-04T12:43:05.099 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SETATTR 2024-03-04T12:43:05.099 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-04T12:43:05.099 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-04T12:43:05.115 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (16 ms) 2024-03-04T12:43:05.115 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-04T12:43:05.154 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (39 ms) 2024-03-04T12:43:05.154 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-04T12:43:05.155 INFO:tasks.workunit.client.0.smithi090.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-03-04T12:43:05.159 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-03-04T12:43:05.159 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-04T12:43:05.160 INFO:tasks.workunit.client.0.smithi090.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-03-04T12:43:05.168 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (6 ms) 2024-03-04T12:43:05.168 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-04T12:43:05.168 INFO:tasks.workunit.client.0.smithi090.stdout:scanning objects in /bdirs1/dir_0 2024-03-04T12:43:05.168 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-04T12:43:05.168 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-04T12:43:05.168 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-04T12:43:05.168 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-04T12:43:05.168 INFO:tasks.workunit.client.0.smithi090.stdout:scanning objects in /bdirs1/dir_1 2024-03-04T12:43:05.168 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-04T12:43:05.168 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-04T12:43:05.168 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-04T12:43:05.168 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-04T12:43:05.169 INFO:tasks.workunit.client.0.smithi090.stdout:scanning objects in /bdirs1/dir_2 2024-03-04T12:43:05.169 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-04T12:43:05.169 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-04T12:43:05.169 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-04T12:43:05.169 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-04T12:43:05.169 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-04T12:43:05.169 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-04T12:43:05.169 INFO:tasks.workunit.client.0.smithi090.stdout:read back objects in /bdirs1/dir_0 2024-03-04T12:43:05.169 INFO:tasks.workunit.client.0.smithi090.stdout:reading 0,256 dir_0/sfile_0 2024-03-04T12:43:05.169 INFO:tasks.workunit.client.0.smithi090.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-04T12:43:05.169 INFO:tasks.workunit.client.0.smithi090.stdout:reading 0,256 dir_0/sfile_1 2024-03-04T12:43:05.170 INFO:tasks.workunit.client.0.smithi090.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-04T12:43:05.170 INFO:tasks.workunit.client.0.smithi090.stdout:read back objects in /bdirs1/dir_1 2024-03-04T12:43:05.170 INFO:tasks.workunit.client.0.smithi090.stdout:reading 0,256 dir_1/sfile_0 2024-03-04T12:43:05.170 INFO:tasks.workunit.client.0.smithi090.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-04T12:43:05.170 INFO:tasks.workunit.client.0.smithi090.stdout:reading 0,256 dir_1/sfile_1 2024-03-04T12:43:05.170 INFO:tasks.workunit.client.0.smithi090.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-04T12:43:05.170 INFO:tasks.workunit.client.0.smithi090.stdout:read back objects in /bdirs1/dir_2 2024-03-04T12:43:05.171 INFO:tasks.workunit.client.0.smithi090.stdout:reading 0,256 dir_2/sfile_0 2024-03-04T12:43:05.171 INFO:tasks.workunit.client.0.smithi090.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-04T12:43:05.171 INFO:tasks.workunit.client.0.smithi090.stdout:reading 0,256 dir_2/sfile_1 2024-03-04T12:43:05.172 INFO:tasks.workunit.client.0.smithi090.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-04T12:43:05.172 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READ_DIRS1 (6 ms) 2024-03-04T12:43:05.172 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-04T12:43:05.345 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READF_SETUP1 (173 ms) 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:release sdir_0 type: DIR refs: 2 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:release sfile_0 type: FILE refs: 2 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:release sdir_1 type: DIR refs: 2 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:release sfile_1 type: FILE refs: 2 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:release sdir_0 type: DIR refs: 2 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:release sfile_0 type: FILE refs: 2 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:release sdir_1 type: DIR refs: 2 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:release sfile_1 type: FILE refs: 2 2024-03-04T12:43:05.346 INFO:tasks.workunit.client.0.smithi090.stdout:release sdir_0 type: DIR refs: 2 2024-03-04T12:43:05.347 INFO:tasks.workunit.client.0.smithi090.stdout:release sfile_0 type: FILE refs: 2 2024-03-04T12:43:05.347 INFO:tasks.workunit.client.0.smithi090.stdout:release sdir_1 type: DIR refs: 2 2024-03-04T12:43:05.347 INFO:tasks.workunit.client.0.smithi090.stdout:release sfile_1 type: FILE refs: 2 2024-03-04T12:43:05.347 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-04T12:43:05.347 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.HIER1 2024-03-04T12:43:05.352 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/f2 (f2): FILE 2024-03-04T12:43:05.353 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/f1 (f1): FILE 2024-03-04T12:43:05.355 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-03-04T12:43:05.357 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-03-04T12:43:05.360 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-04T12:43:05.360 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-04T12:43:05.360 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-03-04T12:43:05.361 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-03-04T12:43:05.361 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-04T12:43:05.362 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-04T12:43:05.362 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-03-04T12:43:05.364 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-03-04T12:43:05.364 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-03-04T12:43:05.365 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar (bar): DIR 2024-03-04T12:43:05.365 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo (foo): DIR 2024-03-04T12:43:05.365 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot (nfsroot): DIR 2024-03-04T12:43:05.365 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.HIER1 (19 ms) 2024-03-04T12:43:05.365 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-04T12:43:05.365 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-04T12:43:05.365 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-04T12:43:05.365 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-04T12:43:05.365 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-04T12:43:05.365 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-04T12:43:05.365 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-04T12:43:05.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-04T12:43:05.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:43:05.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:43:05.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:43:05.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:43:05.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:43:05.366 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:05.358+0000 7fb6532448c0 -1 shutting down 2024-03-04T12:43:05.366 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:05.359+0000 7fb52ef1e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65561, si_uid : 1000, si_addr0x3e800010019, si_status0 2024-03-04T12:43:05.422 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SHUTDOWN (58 ms) 2024-03-04T12:43:05.422 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 24 tests from LibRGW (651 ms total) 2024-03-04T12:43:05.422 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:05.423 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:05.423 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 24 tests from 1 test suite ran. (651 ms total) 2024-03-04T12:43:05.423 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 24 tests. 2024-03-04T12:43:05.428 INFO:tasks.workunit.client.0.smithi090.stdout:phase 1.2 2024-03-04T12:43:05.448 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-04T12:43:05.448 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:05.448 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 24 tests from LibRGW 2024-03-04T12:43:05.448 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:43:05.456 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:05.456 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:05.823 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.INIT (373 ms) 2024-03-04T12:43:05.823 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-04T12:43:05.823 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-04T12:43:05.823 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:43:05.823 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-04T12:43:05.823 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-04T12:43:05.823 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SETATTR 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-04T12:43:05.824 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.HIER1 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-04T12:43:05.825 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-04T12:43:05.826 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-04T12:43:05.826 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-04T12:43:05.826 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-04T12:43:05.826 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-04T12:43:05.826 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:43:05.826 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:43:05.826 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:43:05.826 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:43:05.826 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:43:05.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:05.815+0000 7fdf2b6128c0 -1 shutting down 2024-03-04T12:43:05.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:05.816+0000 7fde0328b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66178, si_uid : 1000, si_addr0x3e800010282, si_status0 2024-03-04T12:43:05.896 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SHUTDOWN (74 ms) 2024-03-04T12:43:05.896 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 24 tests from LibRGW (448 ms total) 2024-03-04T12:43:05.896 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:05.896 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:05.896 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 24 tests from 1 test suite ran. (448 ms total) 2024-03-04T12:43:05.896 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 24 tests. 2024-03-04T12:43:05.901 INFO:tasks.workunit.client.0.smithi090.stdout:phase 1.3 2024-03-04T12:43:05.921 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-04T12:43:05.921 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:05.921 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 24 tests from LibRGW 2024-03-04T12:43:05.921 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:43:05.931 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:05.931 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:06.303 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.INIT (382 ms) 2024-03-04T12:43:06.303 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-04T12:43:06.304 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-04T12:43:06.304 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:43:06.304 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-04T12:43:06.304 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-04T12:43:06.309 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-03-04T12:43:06.309 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-04T12:43:06.365 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SETUP_DIRS1 (56 ms) 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SETATTR 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout:scanning objects in /bdirs1/dir_0 2024-03-04T12:43:06.366 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout:scanning objects in /bdirs1/dir_1 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout:scanning objects in /bdirs1/dir_2 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-04T12:43:06.367 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-04T12:43:06.368 INFO:tasks.workunit.client.0.smithi090.stdout:read back objects in /bdirs1/dir_0 2024-03-04T12:43:06.368 INFO:tasks.workunit.client.0.smithi090.stdout:reading 0,256 dir_0/sfile_0 2024-03-04T12:43:06.368 INFO:tasks.workunit.client.0.smithi090.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-04T12:43:06.368 INFO:tasks.workunit.client.0.smithi090.stdout:reading 0,256 dir_0/sfile_1 2024-03-04T12:43:06.368 INFO:tasks.workunit.client.0.smithi090.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-04T12:43:06.368 INFO:tasks.workunit.client.0.smithi090.stdout:read back objects in /bdirs1/dir_1 2024-03-04T12:43:06.368 INFO:tasks.workunit.client.0.smithi090.stdout:reading 0,256 dir_1/sfile_0 2024-03-04T12:43:06.369 INFO:tasks.workunit.client.0.smithi090.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-04T12:43:06.369 INFO:tasks.workunit.client.0.smithi090.stdout:reading 0,256 dir_1/sfile_1 2024-03-04T12:43:06.369 INFO:tasks.workunit.client.0.smithi090.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-04T12:43:06.369 INFO:tasks.workunit.client.0.smithi090.stdout:read back objects in /bdirs1/dir_2 2024-03-04T12:43:06.370 INFO:tasks.workunit.client.0.smithi090.stdout:reading 0,256 dir_2/sfile_0 2024-03-04T12:43:06.370 INFO:tasks.workunit.client.0.smithi090.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-04T12:43:06.370 INFO:tasks.workunit.client.0.smithi090.stdout:reading 0,256 dir_2/sfile_1 2024-03-04T12:43:06.372 INFO:tasks.workunit.client.0.smithi090.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-04T12:43:06.372 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READ_DIRS1 (7 ms) 2024-03-04T12:43:06.372 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-04T12:43:06.372 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-03-04T12:43:06.372 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:release sdir_0 type: DIR refs: 2 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:release sfile_0 type: FILE refs: 2 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:release sdir_1 type: DIR refs: 2 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:release sfile_1 type: FILE refs: 2 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:release sdir_0 type: DIR refs: 2 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:release sfile_0 type: FILE refs: 2 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:release sdir_1 type: DIR refs: 2 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:release sfile_1 type: FILE refs: 2 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:release sdir_0 type: DIR refs: 2 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:release sfile_0 type: FILE refs: 2 2024-03-04T12:43:06.373 INFO:tasks.workunit.client.0.smithi090.stdout:release sdir_1 type: DIR refs: 2 2024-03-04T12:43:06.374 INFO:tasks.workunit.client.0.smithi090.stdout:release sfile_1 type: FILE refs: 2 2024-03-04T12:43:06.374 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-04T12:43:06.374 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.HIER1 2024-03-04T12:43:06.378 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/f2 (f2): FILE 2024-03-04T12:43:06.379 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/f1 (f1): FILE 2024-03-04T12:43:06.382 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-03-04T12:43:06.383 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-03-04T12:43:06.386 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-04T12:43:06.386 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-04T12:43:06.387 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-03-04T12:43:06.387 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-03-04T12:43:06.388 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-04T12:43:06.388 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-04T12:43:06.389 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-03-04T12:43:06.391 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-03-04T12:43:06.391 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-03-04T12:43:06.391 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo/bar (bar): DIR 2024-03-04T12:43:06.391 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot/foo (foo): DIR 2024-03-04T12:43:06.391 INFO:tasks.workunit.client.0.smithi090.stdout:/nfsroot (nfsroot): DIR 2024-03-04T12:43:06.391 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.HIER1 (19 ms) 2024-03-04T12:43:06.391 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-04T12:43:06.391 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-04T12:43:06.391 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-04T12:43:06.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-04T12:43:06.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-04T12:43:06.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-04T12:43:06.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-04T12:43:06.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-04T12:43:06.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:43:06.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:43:06.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:43:06.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:43:06.392 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:43:06.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:06.384+0000 7f27a3ac18c0 -1 shutting down 2024-03-04T12:43:06.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:06.385+0000 7f267f7a5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66795, si_uid : 1000, si_addr0x3e8000104eb, si_status0 2024-03-04T12:43:06.470 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SHUTDOWN (79 ms) 2024-03-04T12:43:06.470 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 24 tests from LibRGW (549 ms total) 2024-03-04T12:43:06.470 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:06.471 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:06.471 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 24 tests from 1 test suite ran. (549 ms total) 2024-03-04T12:43:06.471 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 24 tests. 2024-03-04T12:43:06.476 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2.1 2024-03-04T12:43:06.496 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-04T12:43:06.496 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:06.496 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 9 tests from LibRGW 2024-03-04T12:43:06.496 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:43:06.505 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:06.505 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:06.878 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.INIT (382 ms) 2024-03-04T12:43:06.878 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:43:06.878 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-04T12:43:06.878 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-04T12:43:06.886 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-03-04T12:43:06.887 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-04T12:43:06.887 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-04T12:43:06.887 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-03-04T12:43:06.894 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave0 2024-03-04T12:43:06.902 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave1 2024-03-04T12:43:06.910 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave2 2024-03-04T12:43:06.918 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave3 2024-03-04T12:43:06.925 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave4 2024-03-04T12:43:06.933 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave5 2024-03-04T12:43:06.941 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave6 2024-03-04T12:43:06.949 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave7 2024-03-04T12:43:06.956 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave8 2024-03-04T12:43:06.967 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave9 2024-03-04T12:43:06.967 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (81 ms) 2024-03-04T12:43:06.967 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-03-04T12:43:07.257 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (290 ms) 2024-03-04T12:43:07.257 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:43:07.257 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:43:07.257 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:43:07.258 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:43:07.258 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:43:07.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:07.251+0000 7f410a4428c0 -1 shutting down 2024-03-04T12:43:07.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:07.252+0000 7f3fe39a7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67412, si_uid : 1000, si_addr0x3e800010754, si_status0 2024-03-04T12:43:07.346 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SHUTDOWN (89 ms) 2024-03-04T12:43:07.346 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 9 tests from LibRGW (850 ms total) 2024-03-04T12:43:07.346 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:07.346 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:07.346 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 9 tests from 1 test suite ran. (850 ms total) 2024-03-04T12:43:07.346 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 9 tests. 2024-03-04T12:43:07.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2.2 2024-03-04T12:43:07.372 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-04T12:43:07.372 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:07.372 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 9 tests from LibRGW 2024-03-04T12:43:07.372 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:43:07.381 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:07.381 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:07.756 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.INIT (384 ms) 2024-03-04T12:43:07.756 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:43:07.757 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:43:07.757 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-04T12:43:07.758 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-04T12:43:07.758 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-04T12:43:07.789 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.DELETE_BUCKET (32 ms) 2024-03-04T12:43:07.789 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-03-04T12:43:07.795 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave0 2024-03-04T12:43:07.803 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave1 2024-03-04T12:43:07.812 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave2 2024-03-04T12:43:07.824 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave3 2024-03-04T12:43:07.832 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave4 2024-03-04T12:43:07.842 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave5 2024-03-04T12:43:07.851 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave6 2024-03-04T12:43:07.863 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave7 2024-03-04T12:43:07.869 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave8 2024-03-04T12:43:07.876 INFO:tasks.workunit.client.0.smithi090.stdout:created: sorrydave9 2024-03-04T12:43:07.876 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (88 ms) 2024-03-04T12:43:07.876 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-03-04T12:43:08.134 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (257 ms) 2024-03-04T12:43:08.134 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:43:08.134 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:43:08.134 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:43:08.134 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:43:08.134 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:43:08.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:08.128+0000 7efeb85a28c0 -1 shutting down 2024-03-04T12:43:08.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:08.129+0000 7efd9427c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68031, si_uid : 1000, si_addr0x3e8000109bf, si_status0 2024-03-04T12:43:08.223 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SHUTDOWN (89 ms) 2024-03-04T12:43:08.223 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 9 tests from LibRGW (851 ms total) 2024-03-04T12:43:08.223 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:08.223 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:08.223 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 9 tests from 1 test suite ran. (851 ms total) 2024-03-04T12:43:08.223 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 9 tests. 2024-03-04T12:43:08.228 INFO:tasks.workunit.client.0.smithi090.stdout:phase 3.1 2024-03-04T12:43:08.538 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 13 tests from 1 test suite. 2024-03-04T12:43:08.538 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:08.538 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 13 tests from LibRGW 2024-03-04T12:43:08.538 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:43:08.547 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:08.547 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:08.920 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.INIT (382 ms) 2024-03-04T12:43:08.920 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:43:08.921 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:43:08.921 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-04T12:43:08.929 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-03-04T12:43:08.929 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-04T12:43:08.931 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-03-04T12:43:08.931 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-04T12:43:08.933 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-03-04T12:43:08.933 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LARGE1 2024-03-04T12:43:08.986 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LARGE1 (52 ms) 2024-03-04T12:43:08.986 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LARGE2 2024-03-04T12:43:09.022 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LARGE2 (36 ms) 2024-03-04T12:43:09.022 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-04T12:43:09.022 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-04T12:43:09.022 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-04T12:43:09.022 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-03-04T12:43:09.022 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-04T12:43:09.022 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-04T12:43:09.023 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:43:09.023 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:43:09.023 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:43:09.023 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:43:09.023 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:43:09.023 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:09.016+0000 7f9a2223a8c0 -1 shutting down 2024-03-04T12:43:09.023 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:09.018+0000 7f98fb744640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68648, si_uid : 1000, si_addr0x3e800010c28, si_status0 2024-03-04T12:43:09.086 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SHUTDOWN (64 ms) 2024-03-04T12:43:09.086 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 13 tests from LibRGW (548 ms total) 2024-03-04T12:43:09.086 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:09.087 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:09.087 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 13 tests from 1 test suite ran. (548 ms total) 2024-03-04T12:43:09.087 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 13 tests. 2024-03-04T12:43:09.093 INFO:tasks.workunit.client.0.smithi090.stdout:phase 3.2 2024-03-04T12:43:09.410 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 13 tests from 1 test suite. 2024-03-04T12:43:09.410 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:09.410 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 13 tests from LibRGW 2024-03-04T12:43:09.410 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:43:09.418 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:09.418 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:09.592 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.INIT (182 ms) 2024-03-04T12:43:09.592 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:43:09.592 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:43:09.592 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-04T12:43:09.592 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-04T12:43:09.592 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-04T12:43:09.597 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-03-04T12:43:09.597 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-04T12:43:09.600 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-03-04T12:43:09.601 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LARGE1 2024-03-04T12:43:09.660 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LARGE1 (59 ms) 2024-03-04T12:43:09.660 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LARGE2 2024-03-04T12:43:09.660 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-03-04T12:43:09.660 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-04T12:43:09.660 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-04T12:43:09.660 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-04T12:43:09.664 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-03-04T12:43:09.664 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-04T12:43:09.691 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.DELETE_BUCKET (28 ms) 2024-03-04T12:43:09.692 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:43:09.692 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:43:09.692 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:43:09.692 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:43:09.692 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:43:09.692 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:09.686+0000 7efeb5f328c0 -1 shutting down 2024-03-04T12:43:09.692 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:09.687+0000 7efd8fed0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69265, si_uid : 1000, si_addr0x3e800010e91, si_status0 2024-03-04T12:43:09.757 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SHUTDOWN (65 ms) 2024-03-04T12:43:09.757 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 13 tests from LibRGW (347 ms total) 2024-03-04T12:43:09.758 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:09.758 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:09.758 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 13 tests from 1 test suite ran. (347 ms total) 2024-03-04T12:43:09.758 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 13 tests. 2024-03-04T12:43:09.764 INFO:tasks.workunit.client.0.smithi090.stdout:phase 4.1 2024-03-04T12:43:09.785 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-04T12:43:09.785 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:09.785 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 11 tests from LibRGW 2024-03-04T12:43:09.785 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.TVAR 2024-03-04T12:43:09.785 INFO:tasks.workunit.client.0.smithi090.stdout:read i1: 64001 2024-03-04T12:43:09.785 INFO:tasks.workunit.client.0.smithi090.stdout:read s1: blunderbuss 2024-03-04T12:43:09.786 INFO:tasks.workunit.client.0.smithi090.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-03-04T12:43:09.786 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:43:09.796 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:09.796 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:10.169 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.INIT (384 ms) 2024-03-04T12:43:10.169 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:43:10.169 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:43:10.169 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-04T12:43:10.187 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (18 ms) 2024-03-04T12:43:10.188 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-04T12:43:10.702 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_0 2024-03-04T12:43:10.702 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_1 2024-03-04T12:43:10.702 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_2 2024-03-04T12:43:10.702 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_3 2024-03-04T12:43:10.702 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_4 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_5 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_6 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_7 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_8 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_9 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_10 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_11 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_12 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_13 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_14 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_15 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_16 2024-03-04T12:43:10.703 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_17 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_18 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_19 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_20 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_21 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_22 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_23 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_24 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_25 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_26 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_27 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_28 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_29 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_30 2024-03-04T12:43:10.704 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_31 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_32 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_33 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_34 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_35 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_36 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_37 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_38 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_39 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_40 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_41 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_42 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_43 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_44 2024-03-04T12:43:10.705 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_45 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_46 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_47 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_48 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_49 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_50 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_51 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_52 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_53 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_54 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_55 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_56 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_57 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_58 2024-03-04T12:43:10.706 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_59 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_60 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_61 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_62 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_63 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_64 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_65 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_66 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_67 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_68 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_69 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_70 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_71 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_72 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_73 2024-03-04T12:43:10.707 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_74 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_75 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_76 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_77 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_78 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_79 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_80 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_81 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_82 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_83 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_84 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_85 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_86 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_87 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_88 2024-03-04T12:43:10.708 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_89 2024-03-04T12:43:10.709 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_90 2024-03-04T12:43:10.709 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_91 2024-03-04T12:43:10.709 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_92 2024-03-04T12:43:10.709 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_93 2024-03-04T12:43:10.709 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_94 2024-03-04T12:43:10.709 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_95 2024-03-04T12:43:10.709 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_96 2024-03-04T12:43:10.709 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_97 2024-03-04T12:43:10.709 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_98 2024-03-04T12:43:10.709 INFO:tasks.workunit.client.0.smithi090.stdout:created: dmarker:f_99 2024-03-04T12:43:10.709 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (514 ms) 2024-03-04T12:43:10.709 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-04T12:43:10.711 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-03-04T12:43:10.711 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-03-04T12:43:10.711 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-04T12:43:10.711 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-04T12:43:10.711 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-04T12:43:10.711 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-04T12:43:10.711 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-04T12:43:10.711 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-04T12:43:10.711 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-04T12:43:10.711 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-04T12:43:10.711 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-04T12:43:10.712 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-04T12:43:10.713 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-04T12:43:10.714 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-04T12:43:10.714 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-04T12:43:10.714 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-04T12:43:10.714 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-04T12:43:10.714 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-04T12:43:10.714 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-04T12:43:10.714 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-04T12:43:10.714 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-04T12:43:10.714 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-04T12:43:10.715 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-04T12:43:10.715 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-04T12:43:10.715 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-04T12:43:10.715 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-04T12:43:10.715 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-04T12:43:10.715 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-04T12:43:10.715 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-04T12:43:10.715 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-04T12:43:10.715 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-04T12:43:10.715 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-04T12:43:10.716 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-04T12:43:10.716 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-04T12:43:10.716 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-04T12:43:10.716 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-04T12:43:10.716 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-04T12:43:10.716 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-04T12:43:10.716 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-04T12:43:10.717 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-04T12:43:10.718 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-04T12:43:10.718 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-04T12:43:10.718 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-04T12:43:10.718 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-04T12:43:10.718 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-04T12:43:10.718 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-04T12:43:10.718 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-04T12:43:10.718 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-04T12:43:10.718 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-04T12:43:10.718 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-04T12:43:10.718 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-03-04T12:43:10.719 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-04T12:43:10.720 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-04T12:43:10.720 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-04T12:43:10.720 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-04T12:43:10.720 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-04T12:43:10.720 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-04T12:43:10.720 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-04T12:43:10.720 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-04T12:43:10.720 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-04T12:43:10.720 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-04T12:43:10.720 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-04T12:43:10.721 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-04T12:43:10.722 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-04T12:43:10.723 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-04T12:43:10.724 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-04T12:43:10.725 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-04T12:43:10.726 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-04T12:43:10.727 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-04T12:43:10.727 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-03-04T12:43:10.727 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-04T12:43:10.727 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-04T12:43:10.727 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:43:10.727 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:43:10.727 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:43:10.727 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:43:10.727 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:43:10.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:10.701+0000 7f07c70338c0 -1 shutting down 2024-03-04T12:43:10.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:10.702+0000 7f06a2d0d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69882, si_uid : 1000, si_addr0x3e8000110fa, si_status0 2024-03-04T12:43:10.846 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SHUTDOWN (139 ms) 2024-03-04T12:43:10.846 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 11 tests from LibRGW (1061 ms total) 2024-03-04T12:43:10.846 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:10.846 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:10.846 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 11 tests from 1 test suite ran. (1061 ms total) 2024-03-04T12:43:10.847 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 11 tests. 2024-03-04T12:43:10.853 INFO:tasks.workunit.client.0.smithi090.stdout:phase 4.2 2024-03-04T12:43:10.873 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-04T12:43:10.873 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:10.873 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 11 tests from LibRGW 2024-03-04T12:43:10.874 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.TVAR 2024-03-04T12:43:10.874 INFO:tasks.workunit.client.0.smithi090.stdout:read i1: 64001 2024-03-04T12:43:10.874 INFO:tasks.workunit.client.0.smithi090.stdout:read s1: blunderbuss 2024-03-04T12:43:10.874 INFO:tasks.workunit.client.0.smithi090.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-03-04T12:43:10.874 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:43:10.881 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:10.881 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:11.256 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.INIT (383 ms) 2024-03-04T12:43:11.256 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:43:11.257 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:43:11.257 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-04T12:43:11.265 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (9 ms) 2024-03-04T12:43:11.266 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-04T12:43:11.266 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-04T12:43:11.266 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-04T12:43:11.266 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-04T12:43:11.266 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-03-04T12:43:11.268 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-04T12:43:11.268 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-04T12:43:11.268 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-04T12:43:11.268 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-04T12:43:11.268 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-04T12:43:11.268 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-04T12:43:11.269 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-04T12:43:11.270 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-04T12:43:11.271 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-04T12:43:11.272 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-04T12:43:11.272 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-04T12:43:11.272 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-04T12:43:11.272 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-04T12:43:11.272 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-04T12:43:11.272 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-04T12:43:11.272 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-04T12:43:11.273 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-04T12:43:11.274 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-04T12:43:11.275 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-03-04T12:43:11.276 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-04T12:43:11.276 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-04T12:43:11.276 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:43:11.276 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:43:11.276 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:43:11.276 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:43:11.276 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:43:11.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:11.262+0000 7fe96332c8c0 -1 shutting down 2024-03-04T12:43:11.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:11.263+0000 7fe83d2c9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70499, si_uid : 1000, si_addr0x3e800011363, si_status0 2024-03-04T12:43:11.333 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SHUTDOWN (65 ms) 2024-03-04T12:43:11.333 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 11 tests from LibRGW (460 ms total) 2024-03-04T12:43:11.333 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:11.333 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:11.333 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 11 tests from 1 test suite ran. (460 ms total) 2024-03-04T12:43:11.333 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 11 tests. 2024-03-04T12:43:11.338 INFO:tasks.workunit.client.0.smithi090.stdout:phase 5.1 2024-03-04T12:43:11.367 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 19 tests from 1 test suite. 2024-03-04T12:43:11.368 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:11.368 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 19 tests from LibRGW 2024-03-04T12:43:11.368 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:43:11.378 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:11.378 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:11.550 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.INIT (182 ms) 2024-03-04T12:43:11.550 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:43:11.551 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:43:11.551 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-04T12:43:11.559 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-03-04T12:43:11.559 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-04T12:43:11.562 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-03-04T12:43:11.562 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-03-04T12:43:11.562 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-03-04T12:43:11.562 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-04T12:43:11.563 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-03-04T12:43:11.563 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-03-04T12:43:11.563 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-03-04T12:43:11.564 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-03-04T12:43:11.568 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-03-04T12:43:11.568 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-03-04T12:43:11.569 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.WRITEV 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READV 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READV (0 ms) 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-03-04T12:43:11.570 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-04T12:43:11.571 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-04T12:43:11.571 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:43:11.571 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:43:11.571 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:43:11.571 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:43:11.571 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:43:11.571 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:11.564+0000 7f973af2b8c0 -1 shutting down 2024-03-04T12:43:11.571 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:11.565+0000 7f9614ec9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71116, si_uid : 1000, si_addr0x3e8000115cc, si_status0 2024-03-04T12:43:11.626 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SHUTDOWN (56 ms) 2024-03-04T12:43:11.626 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 19 tests from LibRGW (258 ms total) 2024-03-04T12:43:11.626 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:11.626 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:11.626 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 19 tests from 1 test suite ran. (258 ms total) 2024-03-04T12:43:11.626 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 19 tests. 2024-03-04T12:43:11.631 INFO:tasks.workunit.client.0.smithi090.stdout:phase 5.2 2024-03-04T12:43:11.661 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] Running 19 tests from 1 test suite. 2024-03-04T12:43:11.661 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment set-up. 2024-03-04T12:43:11.661 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 19 tests from LibRGW 2024-03-04T12:43:11.661 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:43:11.668 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:11.668 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:12.043 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.INIT (382 ms) 2024-03-04T12:43:12.043 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:43:12.043 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:43:12.044 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-04T12:43:12.044 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-04T12:43:12.044 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-04T12:43:12.049 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-03-04T12:43:12.049 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-03-04T12:43:12.049 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-03-04T12:43:12.049 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-04T12:43:12.049 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-03-04T12:43:12.049 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-03-04T12:43:12.049 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-03-04T12:43:12.049 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-03-04T12:43:12.049 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-03-04T12:43:12.049 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-03-04T12:43:12.050 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-03-04T12:43:12.050 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-04T12:43:12.050 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-04T12:43:12.050 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-03-04T12:43:12.050 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-03-04T12:43:12.050 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.WRITEV 2024-03-04T12:43:12.050 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-03-04T12:43:12.050 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READV 2024-03-04T12:43:12.050 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READV (0 ms) 2024-03-04T12:43:12.050 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-03-04T12:43:12.050 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-03-04T12:43:12.050 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-04T12:43:12.053 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-03-04T12:43:12.053 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-04T12:43:12.079 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.DELETE_BUCKET (26 ms) 2024-03-04T12:43:12.079 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:43:12.079 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:43:12.079 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:43:12.079 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:43:12.079 INFO:tasks.workunit.client.0.smithi090.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:43:12.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.073+0000 7fa410e3a8c0 -1 shutting down 2024-03-04T12:43:12.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.074+0000 7fa2ea6b1640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71733, si_uid : 1000, si_addr0x3e800011835, si_status0 2024-03-04T12:43:12.207 INFO:tasks.workunit.client.0.smithi090.stdout:[ OK ] LibRGW.SHUTDOWN (128 ms) 2024-03-04T12:43:12.207 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] 19 tests from LibRGW (546 ms total) 2024-03-04T12:43:12.207 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:12.207 INFO:tasks.workunit.client.0.smithi090.stdout:[----------] Global test environment tear-down 2024-03-04T12:43:12.207 INFO:tasks.workunit.client.0.smithi090.stdout:[==========] 19 tests from 1 test suite ran. (546 ms total) 2024-03-04T12:43:12.207 INFO:tasks.workunit.client.0.smithi090.stdout:[ PASSED ] 19 tests. 2024-03-04T12:43:12.213 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:43:12.213 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:43:12.253 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-03-04T12:43:12.254 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-03-04T12:43:12.254 DEBUG:teuthology.orchestra.run.smithi090:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-03-04T12:43:12.323 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' -z ']' 2024-03-04T12:43:12.324 INFO:tasks.workunit.client.0.smithi090.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-04T12:43:12.324 INFO:tasks.workunit.client.0.smithi090.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-04T12:43:12.324 INFO:tasks.workunit.client.0.smithi090.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-04T12:43:12.324 INFO:tasks.workunit.client.0.smithi090.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-04T12:43:12.324 INFO:tasks.workunit.client.0.smithi090.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-03-04T12:43:12.359 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:43:12.359 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:43:12.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.386+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.388+0000 7f17ecabe800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:12.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.388+0000 7f17ecabe800 20 realm 2024-03-04T12:43:12.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.388+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.388+0000 7f17ecabe800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:12.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.388+0000 7f17ecabe800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:43:12.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.388+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.388+0000 7f17ecabe800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:12.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.388+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.389+0000 7f17ecabe800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:43:12.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.389+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.389+0000 7f17ecabe800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:43:12.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.389+0000 7f17ecabe800 20 searching for the correct realm 2024-03-04T12:43:12.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.392+0000 7f17ea5ba640 0 -- 172.21.15.90:0/893055641 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f17e407a030 msgr2=0x7f17e40ce7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:43:12.401 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.396+0000 7f17ea5ba640 0 -- 172.21.15.90:0/893055641 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f17e007f1f0 msgr2=0x7f17e0088990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:43:12.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.602+0000 7f17ecabe800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:43:12.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.602+0000 7f17ecabe800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:43:12.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.602+0000 7f17ecabe800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:43:12.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.602+0000 7f17ecabe800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:43:12.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.602+0000 7f17ecabe800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.602+0000 7f17ecabe800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.602+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.602+0000 7f17ecabe800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.602+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.602+0000 7f17ecabe800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.602+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.603+0000 7f17ecabe800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.603+0000 7f17ecabe800 20 zone default found 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.603+0000 7f17ecabe800 4 Realm: () 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.603+0000 7f17ecabe800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.603+0000 7f17ecabe800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.603+0000 7f17ecabe800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.603+0000 7f17ecabe800 20 zonegroup default 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.603+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.603+0000 7f17ecabe800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:12.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.603+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.603+0000 7f17ecabe800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:12.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.603+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.604+0000 7f17ecabe800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:12.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.604+0000 7f17ecabe800 20 started sync module instance, tier type = 2024-03-04T12:43:12.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.604+0000 7f17ecabe800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:43:12.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.612+0000 7f17ecabe800 20 add_watcher() i=0 2024-03-04T12:43:12.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.612+0000 7f17ecabe800 20 add_watcher() i=1 2024-03-04T12:43:12.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.612+0000 7f17ecabe800 20 add_watcher() i=2 2024-03-04T12:43:12.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.612+0000 7f17ecabe800 20 add_watcher() i=3 2024-03-04T12:43:12.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.612+0000 7f17ecabe800 20 add_watcher() i=4 2024-03-04T12:43:12.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.612+0000 7f17ecabe800 20 add_watcher() i=5 2024-03-04T12:43:12.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.612+0000 7f17ecabe800 20 add_watcher() i=6 2024-03-04T12:43:12.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.613+0000 7f17ecabe800 20 add_watcher() i=7 2024-03-04T12:43:12.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.613+0000 7f17ecabe800 2 all 8 watchers are set, enabling cache 2024-03-04T12:43:12.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.614+0000 7f16a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:43:12.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.615+0000 7f17ecabe800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:43:12.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.615+0000 7f17ecabe800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:43:12.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.615+0000 7f17ecabe800 5 note: GC not initialized 2024-03-04T12:43:12.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.615+0000 7f161b7fe640 20 reqs_thread_entry: start 2024-03-04T12:43:12.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.615+0000 7f17ecabe800 20 init_complete bucket index max shards: 11 2024-03-04T12:43:12.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.615+0000 7f17ecabe800 20 Filter name: none 2024-03-04T12:43:12.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.615+0000 7f16197fa640 20 reqs_thread_entry: start 2024-03-04T12:43:12.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.615+0000 7f17ecabe800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-03-04T12:43:12.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.615+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:12.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-03-04T12:43:12.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-04T12:43:12.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-03-04T12:43:12.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:12.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-03-04T12:43:12.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-04T12:43:12.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-03-04T12:43:12.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 20 rados->read ofs=0 len=0 2024-03-04T12:43:12.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:43:12.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-03-04T12:43:12.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-04T12:43:12.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-03-04T12:43:12.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.616+0000 7f17ecabe800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-03-04T12:43:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.617+0000 7f17ecabe800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-03-04T12:43:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.617+0000 7f17ecabe800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-04T12:43:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.617+0000 7f17ecabe800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-03-04T12:43:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.617+0000 7f16cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1035087118344 cookie 93904513445360 notifier 5793 bl.length()=644 2024-03-04T12:43:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.617+0000 7f16cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-03-04T12:43:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.617+0000 7f16cdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-04T12:43:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.619+0000 7f17ecabe800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-03-04T12:43:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.619+0000 7f17ecabe800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-04T12:43:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.619+0000 7f17ecabe800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-03-04T12:43:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.619+0000 7f16cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1035087118343 cookie 93904513431344 notifier 5793 bl.length()=187 2024-03-04T12:43:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.619+0000 7f16cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-03-04T12:43:12.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.619+0000 7f16cd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-04T12:43:12.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.621+0000 7f17ecabe800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-03-04T12:43:12.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.621+0000 7f17ecabe800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-04T12:43:12.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.621+0000 7f17ecabe800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-03-04T12:43:12.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.621+0000 7f16cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1035087118344 cookie 93904513431344 notifier 5793 bl.length()=197 2024-03-04T12:43:12.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.621+0000 7f16cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-03-04T12:43:12.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.621+0000 7f16cdffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-04T12:43:12.629 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:43:12.629 INFO:tasks.workunit.client.0.smithi090.stdout: "user_id": "ceph-test-maven", 2024-03-04T12:43:12.629 INFO:tasks.workunit.client.0.smithi090.stdout: "display_name": "maven test user", 2024-03-04T12:43:12.629 INFO:tasks.workunit.client.0.smithi090.stdout: "email": "sigv4@example.com", 2024-03-04T12:43:12.629 INFO:tasks.workunit.client.0.smithi090.stdout: "suspended": 0, 2024-03-04T12:43:12.629 INFO:tasks.workunit.client.0.smithi090.stdout: "max_buckets": 1000, 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: "subusers": [], 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: "keys": [ 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: { 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: "user": "ceph-test-maven", 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: "active": true 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: ], 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: "swift_keys": [], 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: "caps": [], 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: "op_mask": "read, write, delete", 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: "default_placement": "", 2024-03-04T12:43:12.630 INFO:tasks.workunit.client.0.smithi090.stdout: "default_storage_class": "", 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "placement_tags": [], 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_quota": { 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "enabled": false, 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "max_size": -1, 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "max_objects": -1 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "user_quota": { 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "enabled": false, 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "max_size": -1, 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: "max_objects": -1 2024-03-04T12:43:12.631 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:43:12.632 INFO:tasks.workunit.client.0.smithi090.stdout: "temp_url_keys": [], 2024-03-04T12:43:12.632 INFO:tasks.workunit.client.0.smithi090.stdout: "type": "rgw", 2024-03-04T12:43:12.632 INFO:tasks.workunit.client.0.smithi090.stdout: "mfa_ids": [] 2024-03-04T12:43:12.632 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:43:12.632 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:43:12.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.623+0000 7f16a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:43:12.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.625+0000 7f17ecabe800 20 remove_watcher() i=0 2024-03-04T12:43:12.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.625+0000 7f17ecabe800 2 removed watcher, disabling cache 2024-03-04T12:43:12.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.626+0000 7f17ecabe800 20 remove_watcher() i=1 2024-03-04T12:43:12.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.627+0000 7f17ecabe800 20 remove_watcher() i=2 2024-03-04T12:43:12.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.628+0000 7f17ecabe800 20 remove_watcher() i=3 2024-03-04T12:43:12.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.629+0000 7f17ecabe800 20 remove_watcher() i=4 2024-03-04T12:43:12.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.630+0000 7f17ecabe800 20 remove_watcher() i=5 2024-03-04T12:43:12.636 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.631+0000 7f17ecabe800 20 remove_watcher() i=6 2024-03-04T12:43:12.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:43:12.632+0000 7f17ecabe800 20 remove_watcher() i=7 2024-03-04T12:43:12.647 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' -z ']' 2024-03-04T12:43:12.647 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-03-04T12:43:12.648 INFO:tasks.workunit.client.0.smithi090.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-03-04T12:43:12.649 INFO:tasks.workunit.client.0.smithi090.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi090.front.sepia.ceph.com:443 2024-03-04T12:43:12.649 INFO:tasks.workunit.client.0.smithi090.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi090.front.sepia.ceph.com:443 2024-03-04T12:43:12.649 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-03-04T12:43:12.649 INFO:tasks.workunit.client.0.smithi090.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-03-04T12:43:12.649 INFO:tasks.workunit.client.0.smithi090.stderr:+ ./mvnw clean package 2024-03-04T12:43:12.657 INFO:tasks.workunit.client.0.smithi090.stdout:Warning: JAVA_HOME environment variable is not set. 2024-03-04T12:43:14.173 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Scanning for projects... 2024-03-04T12:43:14.320 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-03-04T12:43:14.411 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 60 kB/s) 2024-03-04T12:43:14.424 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-03-04T12:43:14.472 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.7 MB/s) 2024-03-04T12:43:14.478 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-03-04T12:43:14.502 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.3 MB/s) 2024-03-04T12:43:14.525 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:14.526 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-03-04T12:43:14.526 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Building jcksum 1.0 2024-03-04T12:43:14.526 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] from pom.xml 2024-03-04T12:43:14.526 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-03-04T12:43:14.528 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-03-04T12:43:14.548 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 253 kB/s) 2024-03-04T12:43:14.554 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-03-04T12:43:14.581 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 381 kB/s) 2024-03-04T12:43:14.584 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-03-04T12:43:14.602 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.4 MB/s) 2024-03-04T12:43:14.607 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-03-04T12:43:14.625 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-03-04T12:43:14.638 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-03-04T12:43:14.657 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.8 MB/s) 2024-03-04T12:43:14.664 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-03-04T12:43:14.682 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 453 kB/s) 2024-03-04T12:43:14.686 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-03-04T12:43:14.705 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 450 kB/s) 2024-03-04T12:43:14.706 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-03-04T12:43:14.725 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.5 MB/s) 2024-03-04T12:43:14.731 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-03-04T12:43:14.749 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.2 MB/s) 2024-03-04T12:43:14.755 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-03-04T12:43:14.774 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.6 MB/s) 2024-03-04T12:43:14.781 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-03-04T12:43:14.799 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 545 kB/s) 2024-03-04T12:43:14.804 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-03-04T12:43:14.824 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.5 MB/s) 2024-03-04T12:43:14.832 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-03-04T12:43:14.850 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 296 kB/s) 2024-03-04T12:43:14.852 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-03-04T12:43:14.872 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.1 MB/s) 2024-03-04T12:43:14.875 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-03-04T12:43:14.898 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.2 MB/s) 2024-03-04T12:43:14.904 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-03-04T12:43:14.922 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.3 MB/s) 2024-03-04T12:43:14.930 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-03-04T12:43:14.948 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 313 kB/s) 2024-03-04T12:43:14.951 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-03-04T12:43:14.970 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.3 MB/s) 2024-03-04T12:43:14.977 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-03-04T12:43:14.994 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-03-04T12:43:14.996 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-03-04T12:43:15.015 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 550 kB/s) 2024-03-04T12:43:15.017 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-03-04T12:43:15.035 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.4 MB/s) 2024-03-04T12:43:15.038 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-03-04T12:43:15.056 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.2 MB/s) 2024-03-04T12:43:15.060 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-03-04T12:43:15.078 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.5 MB/s) 2024-03-04T12:43:15.094 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-03-04T12:43:15.111 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 338 kB/s) 2024-03-04T12:43:15.113 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-03-04T12:43:15.132 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.2 MB/s) 2024-03-04T12:43:15.137 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-03-04T12:43:15.156 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-03-04T12:43:15.163 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-03-04T12:43:15.191 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 143 kB/s) 2024-03-04T12:43:15.194 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-03-04T12:43:15.225 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 50 kB/s) 2024-03-04T12:43:15.226 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-03-04T12:43:15.257 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 74 kB/s) 2024-03-04T12:43:15.262 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-03-04T12:43:15.291 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 125 kB/s) 2024-03-04T12:43:15.297 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-03-04T12:43:15.315 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 170 kB/s) 2024-03-04T12:43:15.321 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-03-04T12:43:15.340 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 548 kB/s) 2024-03-04T12:43:15.346 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-03-04T12:43:15.364 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 94 kB/s) 2024-03-04T12:43:15.368 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-03-04T12:43:15.385 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 225 kB/s) 2024-03-04T12:43:15.389 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-03-04T12:43:15.406 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 289 kB/s) 2024-03-04T12:43:15.409 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-03-04T12:43:15.427 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 64 kB/s) 2024-03-04T12:43:15.429 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-03-04T12:43:15.446 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 226 kB/s) 2024-03-04T12:43:15.448 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-03-04T12:43:15.465 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 767 kB/s) 2024-03-04T12:43:15.468 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-03-04T12:43:15.485 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 204 kB/s) 2024-03-04T12:43:15.489 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-03-04T12:43:15.506 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 136 kB/s) 2024-03-04T12:43:15.510 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-03-04T12:43:15.527 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 171 kB/s) 2024-03-04T12:43:15.530 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-03-04T12:43:15.548 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 412 kB/s) 2024-03-04T12:43:15.551 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-03-04T12:43:15.569 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 303 kB/s) 2024-03-04T12:43:15.573 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-03-04T12:43:15.591 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 194 kB/s) 2024-03-04T12:43:15.596 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-03-04T12:43:15.614 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 244 kB/s) 2024-03-04T12:43:15.616 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-03-04T12:43:15.634 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 127 kB/s) 2024-03-04T12:43:15.638 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-03-04T12:43:15.655 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 379 kB/s) 2024-03-04T12:43:15.660 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-03-04T12:43:15.676 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 337 kB/s) 2024-03-04T12:43:15.680 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-03-04T12:43:15.698 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 165 kB/s) 2024-03-04T12:43:15.701 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-03-04T12:43:15.719 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 193 kB/s) 2024-03-04T12:43:15.722 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-03-04T12:43:15.740 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-03-04T12:43:15.742 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-03-04T12:43:15.759 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-03-04T12:43:15.762 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-03-04T12:43:15.779 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 413 kB/s) 2024-03-04T12:43:15.782 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-03-04T12:43:15.799 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-03-04T12:43:15.802 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-03-04T12:43:15.820 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.9 MB/s) 2024-03-04T12:43:15.825 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-03-04T12:43:15.843 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 950 kB/s) 2024-03-04T12:43:15.848 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-03-04T12:43:15.866 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 276 kB/s) 2024-03-04T12:43:15.868 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-03-04T12:43:15.885 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-03-04T12:43:15.889 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-03-04T12:43:15.906 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-03-04T12:43:15.909 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-03-04T12:43:15.928 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.4 MB/s) 2024-03-04T12:43:15.934 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-03-04T12:43:15.951 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 922 kB/s) 2024-03-04T12:43:15.955 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-03-04T12:43:15.971 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 908 kB/s) 2024-03-04T12:43:15.973 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-03-04T12:43:15.994 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.0 MB/s) 2024-03-04T12:43:15.996 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-03-04T12:43:16.013 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.1 MB/s) 2024-03-04T12:43:16.016 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-03-04T12:43:16.034 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-03-04T12:43:16.036 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-03-04T12:43:16.057 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.9 MB/s) 2024-03-04T12:43:16.062 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-03-04T12:43:16.079 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 213 kB/s) 2024-03-04T12:43:16.081 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-03-04T12:43:16.098 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 812 kB/s) 2024-03-04T12:43:16.101 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-03-04T12:43:16.118 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 189 kB/s) 2024-03-04T12:43:16.120 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-03-04T12:43:16.137 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 177 kB/s) 2024-03-04T12:43:16.139 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-03-04T12:43:16.156 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 120 kB/s) 2024-03-04T12:43:16.158 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-03-04T12:43:16.176 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 167 kB/s) 2024-03-04T12:43:16.177 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-03-04T12:43:16.195 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 85 kB/s) 2024-03-04T12:43:16.197 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-03-04T12:43:16.214 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-03-04T12:43:16.215 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-03-04T12:43:16.233 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 178 kB/s) 2024-03-04T12:43:16.234 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-03-04T12:43:16.251 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 189 kB/s) 2024-03-04T12:43:16.254 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-03-04T12:43:16.273 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-03-04T12:43:16.274 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-03-04T12:43:16.291 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 57 kB/s) 2024-03-04T12:43:16.293 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-03-04T12:43:16.311 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 180 kB/s) 2024-03-04T12:43:16.312 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-03-04T12:43:16.330 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 190 kB/s) 2024-03-04T12:43:16.331 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-03-04T12:43:16.348 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-03-04T12:43:16.350 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-03-04T12:43:16.367 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 202 kB/s) 2024-03-04T12:43:16.369 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-03-04T12:43:16.386 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 178 kB/s) 2024-03-04T12:43:16.402 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-03-04T12:43:16.500 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 34 MB/s) 2024-03-04T12:43:16.501 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-03-04T12:43:16.501 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-03-04T12:43:16.501 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-03-04T12:43:16.501 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-03-04T12:43:16.502 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-03-04T12:43:16.521 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 790 kB/s) 2024-03-04T12:43:16.521 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-03-04T12:43:16.541 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 411 kB/s) 2024-03-04T12:43:16.541 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-03-04T12:43:16.574 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.4/49 kB Progress (2): 1.4/49 kB | 1.4/35 kB Progress (2): 2.8/49 kB | 1.4/35 kB Progress (2): 2.8/49 kB | 2.8/35 kB Progress (2): 4.1/49 kB | 2.8/35 kB Progress (2): 4.1/49 kB | 4.1/35 kB Progress (2): 5.5/49 kB | 4.1/35 kB Progress (2): 5.5/49 kB | 5.5/35 kB Progress (2): 6.9/49 kB | 5.5/35 kB Progress (2): 6.9/49 kB | 6.9/35 kB Progress (2): 8.3/49 kB | 6.9/35 kB Progress (2): 8.3/49 kB | 8.3/35 kB Progress (2): 9.7/49 kB | 8.3/35 kB Progress (2): 9.7/49 kB | 9.7/35 kB Progress (2): 11/49 kB | 9.7/35 kB Progress (2): 11/49 kB | 11/35 kB Progress (2): 12/49 kB | 11/35 kB Progress (2): 12/49 kB | 12/35 kB Progress (2): 14/49 kB | 12/35 kB Progress (2): 15/49 kB | 12/35 kB Progress (3): 15/49 kB | 12/35 kB | 16/782 kB Progress (3): 15/49 kB | 14/35 kB | 16/782 kB Progress (3): 15/49 kB | 14/35 kB | 33/782 kB Progress (3): 15/49 kB | 15/35 kB | 33/782 kB Progress (4): 15/49 kB | 15/35 kB | 33/782 kB | 16/71 kB Progress (5): 15/49 kB | 15/35 kB | 33/782 kB | 16/71 kB | 1.4/98 kB Progress (5): 15/49 kB | 15/35 kB | 49/782 kB | 16/71 kB | 1.4/98 kB Progress (5): 15/49 kB | 15/35 kB | 49/782 kB | 16/71 kB | 2.8/98 kB Progress (5): 15/49 kB | 15/35 kB | 49/782 kB | 16/71 kB | 4.1/98 kB Progress (5): 15/49 kB | 15/35 kB | 49/782 kB | 16/71 kB | 5.5/98 kB Progress (5): 15/49 kB | 15/35 kB | 66/782 kB | 16/71 kB | 5.5/98 kB Progress (5): 15/49 kB | 15/35 kB | 66/782 kB | 16/71 kB | 6.9/98 kB Progress (5): 15/49 kB | 15/35 kB | 66/782 kB | 16/71 kB | 8.3/98 kB Progress (5): 15/49 kB | 15/35 kB | 66/782 kB | 16/71 kB | 9.7/98 kB Progress (5): 15/49 kB | 15/35 kB | 82/782 kB | 16/71 kB | 9.7/98 kB Progress (5): 15/49 kB | 15/35 kB | 82/782 kB | 16/71 kB | 11/98 kB Progress (5): 15/49 kB | 15/35 kB | 82/782 kB | 16/71 kB | 12/98 kB Progress (5): 15/49 kB | 15/35 kB | 98/782 kB | 16/71 kB | 12/98 kB Progress (5): 17/49 kB | 15/35 kB | 98/782 kB | 16/71 kB | 12/98 kB Progress (5): 18/49 kB | 15/35 kB | 98/782 kB | 16/71 kB | 12/98 kB Progress (5): 18/49 kB | 15/35 kB | 115/782 kB | 16/71 kB | 12/98 kB Progress (5): 18/49 kB | 17/35 kB | 115/782 kB | 16/71 kB | 12/98 kB Progress (5): 18/49 kB | 18/35 kB | 115/782 kB | 16/71 kB | 12/98 kB Progress (5): 18/49 kB | 18/35 kB | 131/782 kB | 16/71 kB | 12/98 kB Progress (5): 18/49 kB | 18/35 kB | 147/782 kB | 16/71 kB | 12/98 kB Progress (5): 18/49 kB | 18/35 kB | 164/782 kB | 16/71 kB | 12/98 kB Progress (5): 18/49 kB | 18/35 kB | 180/782 kB | 16/71 kB | 12/98 kB Progress (5): 18/49 kB | 18/35 kB | 180/782 kB | 16/71 kB | 14/98 kB Progress (5): 18/49 kB | 18/35 kB | 180/782 kB | 16/71 kB | 15/98 kB Progress (5): 18/49 kB | 18/35 kB | 180/782 kB | 16/71 kB | 16/98 kB Progress (5): 18/49 kB | 18/35 kB | 197/782 kB | 16/71 kB | 16/98 kB Progress (5): 18/49 kB | 18/35 kB | 213/782 kB | 16/71 kB | 16/98 kB Progress (5): 18/49 kB | 18/35 kB | 229/782 kB | 16/71 kB | 16/98 kB Progress (5): 18/49 kB | 18/35 kB | 246/782 kB | 16/71 kB | 16/98 kB Progress (5): 18/49 kB | 18/35 kB | 262/782 kB | 16/71 kB | 16/98 kB Progress (5): 18/49 kB | 18/35 kB | 279/782 kB | 16/71 kB | 16/98 kB Progress (5): 19/49 kB | 18/35 kB | 279/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 18/35 kB | 279/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 18/35 kB | 295/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 19/35 kB | 295/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 21/35 kB | 295/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 21/35 kB | 311/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 21/35 kB | 328/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 21/35 kB | 344/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 21/35 kB | 360/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 21/35 kB | 377/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 21/35 kB | 393/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 21/35 kB | 410/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 21/35 kB | 426/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 21/35 kB | 442/782 kB | 16/71 kB | 16/98 kB Progress (5): 21/49 kB | 21/35 kB | 459/782 kB | 16/71 kB | 16/98 kB Progress (5): 22/49 kB | 21/35 kB | 459/782 kB | 16/71 kB | 16/98 kB Progress (5): 22/49 kB | 22/35 kB | 459/782 kB | 16/71 kB | 16/98 kB Progress (5): 23/49 kB | 22/35 kB | 459/782 kB | 16/71 kB | 16/98 kB Progress (5): 23/49 kB | 22/35 kB | 475/782 kB | 16/71 kB | 16/98 kB Progress (5): 25/49 kB | 22/35 kB | 475/782 kB | 16/71 kB | 16/98 kB Progress (5): 25/49 kB | 23/35 kB | 475/782 kB | 16/71 kB | 16/98 kB Progress (5): 26/49 kB | 23/35 kB | 475/782 kB | 16/71 kB | 16/98 kB Progress (5): 26/49 kB | 23/35 kB | 492/782 kB | 16/71 kB | 16/98 kB Progress (5): 28/49 kB | 23/35 kB | 492/782 kB | 16/71 kB | 16/98 kB Progress (5): 28/49 kB | 25/35 kB | 492/782 kB | 16/71 kB | 16/98 kB Progress (5): 29/49 kB | 25/35 kB | 492/782 kB | 16/71 kB | 16/98 kB Progress (5): 29/49 kB | 26/35 kB | 492/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 26/35 kB | 492/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 26/35 kB | 508/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 28/35 kB | 508/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 29/35 kB | 508/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 29/35 kB | 524/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 524/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 541/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 557/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 573/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 585/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 601/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 617/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 634/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 650/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 667/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 683/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 699/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 716/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 732/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 749/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 765/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 781/782 kB | 16/71 kB | 16/98 kB Progress (5): 30/49 kB | 30/35 kB | 782 kB | 16/71 kB | 16/98 kB Progress (5): 32/49 kB | 30/35 kB | 782 kB | 16/71 kB | 16/98 kB Progress (5): 33/49 kB | 30/35 kB | 782 kB | 16/71 kB | 16/98 kB Progress (5): 34/49 kB | 30/35 kB | 782 kB | 16/71 kB | 16/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 11 MB/s) 2024-03-04T12:43:16.574 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-03-04T12:43:16.574 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (4): 34/49 kB | 32/35 kB | 16/71 kB | 16/98 kB Progress (4): 36/49 kB | 32/35 kB | 16/71 kB | 16/98 kB Progress (4): 36/49 kB | 33/35 kB | 16/71 kB | 16/98 kB Progress (4): 37/49 kB | 33/35 kB | 16/71 kB | 16/98 kB Progress (4): 37/49 kB | 34/35 kB | 16/71 kB | 16/98 kB Progress (4): 37/49 kB | 35 kB | 16/71 kB | 16/98 kB Progress (4): 37/49 kB | 35 kB | 33/71 kB | 16/98 kB Progress (4): 39/49 kB | 35 kB | 33/71 kB | 16/98 kB Progress (4): 40/49 kB | 35 kB | 33/71 kB | 16/98 kB Progress (4): 41/49 kB | 35 kB | 33/71 kB | 16/98 kB Progress (4): 43/49 kB | 35 kB | 33/71 kB | 16/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 482 kB/s) 2024-03-04T12:43:16.574 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-03-04T12:43:16.576 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (3): 43/49 kB | 33/71 kB | 32/98 kB Progress (3): 44/49 kB | 33/71 kB | 32/98 kB Progress (3): 46/49 kB | 33/71 kB | 32/98 kB Progress (3): 47/49 kB | 33/71 kB | 32/98 kB Progress (3): 48/49 kB | 33/71 kB | 32/98 kB Progress (3): 49 kB | 33/71 kB | 32/98 kB Progress (3): 49 kB | 49/71 kB | 32/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 665 kB/s) 2024-03-04T12:43:16.576 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-03-04T12:43:16.588 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 49/71 kB | 49/98 kB Progress (2): 66/71 kB | 49/98 kB Progress (2): 71 kB | 49/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 802 kB/s) 2024-03-04T12:43:16.589 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-03-04T12:43:16.591 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 49/98 kB | 1.4/11 kB Progress (2): 49/98 kB | 2.8/11 kB Progress (2): 49/98 kB | 4.1/11 kB Progress (2): 65/98 kB | 4.1/11 kB Progress (2): 65/98 kB | 5.5/11 kB Progress (2): 65/98 kB | 6.9/11 kB Progress (2): 65/98 kB | 8.3/11 kB Progress (2): 65/98 kB | 9.7/11 kB Progress (2): 65/98 kB | 11/11 kB Progress (2): 65/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 128 kB/s) 2024-03-04T12:43:16.591 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-03-04T12:43:16.595 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 65/98 kB | 16/205 kB Progress (2): 65/98 kB | 33/205 kB Progress (2): 65/98 kB | 49/205 kB Progress (2): 65/98 kB | 66/205 kB Progress (2): 65/98 kB | 82/205 kB Progress (2): 81/98 kB | 82/205 kB Progress (2): 81/98 kB | 98/205 kB Progress (2): 81/98 kB | 115/205 kB Progress (2): 81/98 kB | 131/205 kB Progress (2): 98/98 kB | 131/205 kB Progress (2): 98 kB | 131/205 kB Progress (2): 98 kB | 147/205 kB Progress (3): 98 kB | 147/205 kB | 16/30 kB Progress (3): 98 kB | 164/205 kB | 16/30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.0 MB/s) 2024-03-04T12:43:16.595 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 180/205 kB | 16/30 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-03-04T12:43:16.596 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 197/205 kB | 16/30 kB Progress (2): 205 kB | 16/30 kB Progress (2): 205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.2 MB/s) 2024-03-04T12:43:16.596 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-03-04T12:43:16.597 INFO:tasks.workunit.client.0.smithi090.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 321 kB/s) 2024-03-04T12:43:16.597 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-03-04T12:43:16.613 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/81 kB Progress (1): 32/81 kB Progress (1): 49/81 kB Progress (1): 65/81 kB Progress (2): 65/81 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 120 kB/s) 2024-03-04T12:43:16.613 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-03-04T12:43:16.617 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 65/81 kB | 16/151 kB Progress (2): 65/81 kB | 32/151 kB Progress (2): 65/81 kB | 49/151 kB Progress (2): 65/81 kB | 65/151 kB Progress (3): 65/81 kB | 65/151 kB | 16/182 kB Progress (3): 65/81 kB | 81/151 kB | 16/182 kB Progress (3): 65/81 kB | 98/151 kB | 16/182 kB Progress (3): 65/81 kB | 98/151 kB | 33/182 kB Progress (3): 65/81 kB | 114/151 kB | 33/182 kB Progress (3): 65/81 kB | 130/151 kB | 33/182 kB Progress (3): 65/81 kB | 147/151 kB | 33/182 kB Progress (3): 65/81 kB | 151 kB | 33/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.3 MB/s) 2024-03-04T12:43:16.618 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-03-04T12:43:16.620 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 65/81 kB | 49/182 kB Progress (2): 65/81 kB | 66/182 kB Progress (2): 81 kB | 66/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 683 kB/s) 2024-03-04T12:43:16.621 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-03-04T12:43:16.631 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 66/182 kB | 1.4/798 kB Progress (2): 66/182 kB | 2.8/798 kB Progress (2): 66/182 kB | 4.1/798 kB Progress (2): 66/182 kB | 5.5/798 kB Progress (2): 66/182 kB | 6.9/798 kB Progress (2): 66/182 kB | 8.3/798 kB Progress (2): 66/182 kB | 9.7/798 kB Progress (2): 66/182 kB | 11/798 kB Progress (2): 66/182 kB | 12/798 kB Progress (2): 66/182 kB | 14/798 kB Progress (2): 66/182 kB | 15/798 kB Progress (2): 66/182 kB | 16/798 kB Progress (2): 66/182 kB | 32/798 kB Progress (2): 66/182 kB | 49/798 kB Progress (2): 82/182 kB | 49/798 kB Progress (3): 82/182 kB | 49/798 kB | 16/27 kB Progress (3): 98/182 kB | 49/798 kB | 16/27 kB Progress (3): 98/182 kB | 49/798 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 213 kB/s) 2024-03-04T12:43:16.631 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-03-04T12:43:16.636 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 115/182 kB | 49/798 kB Progress (2): 131/182 kB | 49/798 kB Progress (2): 147/182 kB | 49/798 kB Progress (3): 147/182 kB | 49/798 kB | 16/30 kB Progress (3): 164/182 kB | 49/798 kB | 16/30 kB Progress (3): 164/182 kB | 49/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 226 kB/s) 2024-03-04T12:43:16.636 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-03-04T12:43:16.637 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 180/182 kB | 49/798 kB Progress (2): 182 kB | 49/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.4 MB/s) 2024-03-04T12:43:16.637 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 65/798 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-03-04T12:43:16.652 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 65/798 kB | 16/385 kB Progress (2): 81/798 kB | 16/385 kB Progress (2): 81/798 kB | 33/385 kB Progress (2): 98/798 kB | 33/385 kB Progress (2): 98/798 kB | 49/385 kB Progress (2): 98/798 kB | 66/385 kB Progress (2): 114/798 kB | 66/385 kB Progress (2): 114/798 kB | 82/385 kB Progress (2): 130/798 kB | 82/385 kB Progress (2): 130/798 kB | 98/385 kB Progress (2): 130/798 kB | 115/385 kB Progress (2): 130/798 kB | 131/385 kB Progress (2): 147/798 kB | 131/385 kB Progress (2): 147/798 kB | 147/385 kB Progress (2): 163/798 kB | 147/385 kB Progress (2): 180/798 kB | 147/385 kB Progress (2): 196/798 kB | 147/385 kB Progress (3): 196/798 kB | 147/385 kB | 13 kB Progress (3): 212/798 kB | 147/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 88 kB/s) 2024-03-04T12:43:16.652 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-03-04T12:43:16.655 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (3): 212/798 kB | 147/385 kB | 16/75 kB Progress (3): 212/798 kB | 147/385 kB | 32/75 kB Progress (3): 212/798 kB | 164/385 kB | 32/75 kB Progress (3): 212/798 kB | 180/385 kB | 32/75 kB Progress (3): 212/798 kB | 180/385 kB | 49/75 kB Progress (3): 229/798 kB | 180/385 kB | 49/75 kB Progress (3): 229/798 kB | 180/385 kB | 65/75 kB Progress (4): 229/798 kB | 180/385 kB | 65/75 kB | 16/780 kB Progress (4): 229/798 kB | 180/385 kB | 75 kB | 16/780 kB Progress (4): 229/798 kB | 197/385 kB | 75 kB | 16/780 kB Progress (4): 229/798 kB | 197/385 kB | 75 kB | 33/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 494 kB/s) 2024-03-04T12:43:16.655 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-03-04T12:43:16.662 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (3): 229/798 kB | 197/385 kB | 49/780 kB Progress (3): 245/798 kB | 197/385 kB | 49/780 kB Progress (3): 245/798 kB | 213/385 kB | 49/780 kB Progress (3): 245/798 kB | 213/385 kB | 62/780 kB Progress (3): 262/798 kB | 213/385 kB | 62/780 kB Progress (3): 262/798 kB | 213/385 kB | 79/780 kB Progress (3): 262/798 kB | 229/385 kB | 79/780 kB Progress (3): 262/798 kB | 246/385 kB | 79/780 kB Progress (3): 262/798 kB | 246/385 kB | 95/780 kB Progress (3): 262/798 kB | 246/385 kB | 112/780 kB Progress (3): 278/798 kB | 246/385 kB | 112/780 kB Progress (3): 278/798 kB | 262/385 kB | 112/780 kB Progress (3): 278/798 kB | 279/385 kB | 112/780 kB Progress (3): 294/798 kB | 279/385 kB | 112/780 kB Progress (3): 294/798 kB | 279/385 kB | 128/780 kB Progress (3): 294/798 kB | 279/385 kB | 144/780 kB Progress (3): 311/798 kB | 279/385 kB | 144/780 kB Progress (3): 327/798 kB | 279/385 kB | 144/780 kB Progress (3): 327/798 kB | 295/385 kB | 144/780 kB Progress (3): 327/798 kB | 311/385 kB | 144/780 kB Progress (3): 327/798 kB | 311/385 kB | 161/780 kB Progress (3): 327/798 kB | 311/385 kB | 177/780 kB Progress (3): 343/798 kB | 311/385 kB | 177/780 kB Progress (3): 343/798 kB | 328/385 kB | 177/780 kB Progress (3): 343/798 kB | 328/385 kB | 193/780 kB Progress (3): 343/798 kB | 344/385 kB | 193/780 kB Progress (3): 343/798 kB | 344/385 kB | 210/780 kB Progress (3): 360/798 kB | 344/385 kB | 210/780 kB Progress (3): 360/798 kB | 360/385 kB | 210/780 kB Progress (3): 360/798 kB | 377/385 kB | 210/780 kB Progress (3): 376/798 kB | 377/385 kB | 210/780 kB Progress (3): 376/798 kB | 377/385 kB | 226/780 kB Progress (3): 376/798 kB | 385 kB | 226/780 kB Progress (3): 376/798 kB | 385 kB | 243/780 kB Progress (3): 393/798 kB | 385 kB | 243/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.4 MB/s) 2024-03-04T12:43:16.662 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-03-04T12:43:16.687 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 402/798 kB | 243/780 kB Progress (2): 418/798 kB | 243/780 kB Progress (2): 435/798 kB | 243/780 kB Progress (2): 451/798 kB | 243/780 kB Progress (2): 468/798 kB | 243/780 kB Progress (2): 484/798 kB | 243/780 kB Progress (2): 500/798 kB | 243/780 kB Progress (2): 500/798 kB | 259/780 kB Progress (2): 500/798 kB | 275/780 kB Progress (2): 500/798 kB | 292/780 kB Progress (2): 500/798 kB | 308/780 kB Progress (2): 500/798 kB | 325/780 kB Progress (2): 517/798 kB | 325/780 kB Progress (2): 533/798 kB | 325/780 kB Progress (2): 549/798 kB | 325/780 kB Progress (2): 566/798 kB | 325/780 kB Progress (2): 566/798 kB | 341/780 kB Progress (2): 566/798 kB | 357/780 kB Progress (2): 566/798 kB | 374/780 kB Progress (3): 566/798 kB | 374/780 kB | 16/329 kB Progress (3): 566/798 kB | 390/780 kB | 16/329 kB Progress (3): 582/798 kB | 390/780 kB | 16/329 kB Progress (3): 599/798 kB | 390/780 kB | 16/329 kB Progress (3): 615/798 kB | 390/780 kB | 16/329 kB Progress (4): 615/798 kB | 390/780 kB | 16/329 kB | 16/501 kB Progress (4): 615/798 kB | 390/780 kB | 16/329 kB | 33/501 kB Progress (4): 631/798 kB | 390/780 kB | 16/329 kB | 33/501 kB Progress (4): 631/798 kB | 390/780 kB | 16/329 kB | 49/501 kB Progress (4): 631/798 kB | 406/780 kB | 16/329 kB | 49/501 kB Progress (4): 631/798 kB | 406/780 kB | 16/329 kB | 66/501 kB Progress (4): 631/798 kB | 406/780 kB | 16/329 kB | 82/501 kB Progress (4): 631/798 kB | 406/780 kB | 16/329 kB | 98/501 kB Progress (4): 631/798 kB | 406/780 kB | 33/329 kB | 98/501 kB Progress (4): 631/798 kB | 406/780 kB | 33/329 kB | 115/501 kB Progress (4): 631/798 kB | 406/780 kB | 33/329 kB | 131/501 kB Progress (4): 631/798 kB | 406/780 kB | 33/329 kB | 147/501 kB Progress (4): 631/798 kB | 406/780 kB | 33/329 kB | 164/501 kB Progress (4): 631/798 kB | 406/780 kB | 33/329 kB | 180/501 kB Progress (4): 648/798 kB | 406/780 kB | 33/329 kB | 180/501 kB Progress (4): 648/798 kB | 406/780 kB | 33/329 kB | 197/501 kB Progress (4): 664/798 kB | 406/780 kB | 33/329 kB | 197/501 kB Progress (4): 664/798 kB | 406/780 kB | 33/329 kB | 213/501 kB Progress (4): 681/798 kB | 406/780 kB | 33/329 kB | 213/501 kB Progress (4): 681/798 kB | 423/780 kB | 33/329 kB | 213/501 kB Progress (4): 681/798 kB | 423/780 kB | 33/329 kB | 229/501 kB Progress (4): 681/798 kB | 439/780 kB | 33/329 kB | 229/501 kB Progress (4): 681/798 kB | 439/780 kB | 33/329 kB | 246/501 kB Progress (4): 681/798 kB | 456/780 kB | 33/329 kB | 246/501 kB Progress (4): 681/798 kB | 456/780 kB | 33/329 kB | 256/501 kB Progress (4): 681/798 kB | 456/780 kB | 33/329 kB | 272/501 kB Progress (4): 681/798 kB | 456/780 kB | 33/329 kB | 289/501 kB Progress (4): 681/798 kB | 456/780 kB | 33/329 kB | 305/501 kB Progress (4): 681/798 kB | 456/780 kB | 33/329 kB | 321/501 kB Progress (4): 681/798 kB | 456/780 kB | 49/329 kB | 321/501 kB Progress (4): 681/798 kB | 456/780 kB | 49/329 kB | 338/501 kB Progress (4): 697/798 kB | 456/780 kB | 49/329 kB | 338/501 kB Progress (4): 697/798 kB | 472/780 kB | 49/329 kB | 338/501 kB Progress (4): 697/798 kB | 472/780 kB | 49/329 kB | 354/501 kB Progress (4): 697/798 kB | 488/780 kB | 49/329 kB | 354/501 kB Progress (4): 697/798 kB | 488/780 kB | 49/329 kB | 370/501 kB Progress (4): 697/798 kB | 488/780 kB | 66/329 kB | 370/501 kB Progress (4): 697/798 kB | 505/780 kB | 66/329 kB | 370/501 kB Progress (4): 697/798 kB | 505/780 kB | 66/329 kB | 387/501 kB Progress (4): 713/798 kB | 505/780 kB | 66/329 kB | 387/501 kB Progress (4): 713/798 kB | 521/780 kB | 66/329 kB | 387/501 kB Progress (4): 713/798 kB | 521/780 kB | 66/329 kB | 403/501 kB Progress (4): 730/798 kB | 521/780 kB | 66/329 kB | 403/501 kB Progress (4): 730/798 kB | 538/780 kB | 66/329 kB | 403/501 kB Progress (4): 746/798 kB | 538/780 kB | 66/329 kB | 403/501 kB Progress (4): 746/798 kB | 538/780 kB | 66/329 kB | 420/501 kB Progress (4): 746/798 kB | 538/780 kB | 82/329 kB | 420/501 kB Progress (4): 762/798 kB | 538/780 kB | 82/329 kB | 420/501 kB Progress (4): 762/798 kB | 554/780 kB | 82/329 kB | 420/501 kB Progress (4): 762/798 kB | 554/780 kB | 82/329 kB | 436/501 kB Progress (4): 762/798 kB | 570/780 kB | 82/329 kB | 436/501 kB Progress (4): 762/798 kB | 570/780 kB | 82/329 kB | 452/501 kB Progress (4): 779/798 kB | 570/780 kB | 82/329 kB | 452/501 kB Progress (4): 779/798 kB | 587/780 kB | 82/329 kB | 452/501 kB Progress (4): 779/798 kB | 587/780 kB | 82/329 kB | 469/501 kB Progress (4): 795/798 kB | 587/780 kB | 82/329 kB | 469/501 kB Progress (4): 798 kB | 587/780 kB | 82/329 kB | 469/501 kB Progress (4): 798 kB | 603/780 kB | 82/329 kB | 469/501 kB Progress (4): 798 kB | 603/780 kB | 82/329 kB | 485/501 kB Progress (4): 798 kB | 619/780 kB | 82/329 kB | 485/501 kB Progress (4): 798 kB | 619/780 kB | 82/329 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 4.4 MB/s) 2024-03-04T12:43:16.687 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (3): 619/780 kB | 98/329 kB | 501 kB Progress (3): 636/780 kB | 98/329 kB | 501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-03-04T12:43:16.687 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (3): 652/780 kB | 98/329 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.8 MB/s) 2024-03-04T12:43:16.687 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-03-04T12:43:16.690 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 669/780 kB | 98/329 kB Progress (2): 685/780 kB | 98/329 kB Progress (2): 701/780 kB | 98/329 kB Progress (2): 718/780 kB | 98/329 kB Progress (2): 734/780 kB | 98/329 kB Progress (3): 734/780 kB | 98/329 kB | 16/354 kB Progress (3): 734/780 kB | 98/329 kB | 33/354 kB Progress (3): 734/780 kB | 98/329 kB | 49/354 kB Progress (3): 734/780 kB | 98/329 kB | 66/354 kB Progress (3): 734/780 kB | 98/329 kB | 82/354 kB Progress (3): 734/780 kB | 98/329 kB | 98/354 kB Progress (3): 734/780 kB | 98/329 kB | 115/354 kB Progress (3): 734/780 kB | 98/329 kB | 131/354 kB Progress (3): 734/780 kB | 98/329 kB | 147/354 kB Progress (3): 734/780 kB | 98/329 kB | 164/354 kB Progress (3): 734/780 kB | 98/329 kB | 180/354 kB Progress (3): 734/780 kB | 98/329 kB | 197/354 kB Progress (3): 751/780 kB | 98/329 kB | 197/354 kB Progress (3): 751/780 kB | 98/329 kB | 213/354 kB Progress (3): 751/780 kB | 98/329 kB | 229/354 kB Progress (3): 751/780 kB | 98/329 kB | 246/354 kB Progress (3): 751/780 kB | 98/329 kB | 262/354 kB Progress (3): 767/780 kB | 98/329 kB | 262/354 kB Progress (3): 780 kB | 98/329 kB | 262/354 kB Progress (3): 780 kB | 98/329 kB | 279/354 kB Progress (3): 780 kB | 98/329 kB | 295/354 kB Progress (3): 780 kB | 98/329 kB | 311/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.2 MB/s) 2024-03-04T12:43:16.690 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-03-04T12:43:16.691 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 98/329 kB | 328/354 kB Progress (2): 98/329 kB | 344/354 kB Progress (2): 115/329 kB | 344/354 kB Progress (2): 115/329 kB | 354 kB Progress (2): 131/329 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.9 MB/s) 2024-03-04T12:43:16.691 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-03-04T12:43:16.702 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 147/329 kB Progress (1): 164/329 kB Progress (1): 180/329 kB Progress (1): 197/329 kB Progress (1): 213/329 kB Progress (1): 229/329 kB Progress (1): 246/329 kB Progress (1): 256/329 kB Progress (1): 272/329 kB Progress (1): 289/329 kB Progress (1): 305/329 kB Progress (2): 305/329 kB | 16/41 kB Progress (2): 305/329 kB | 33/41 kB Progress (2): 305/329 kB | 41 kB Progress (3): 305/329 kB | 41 kB | 6.4 kB Progress (3): 321/329 kB | 41 kB | 6.4 kB Progress (3): 329 kB | 41 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 209 kB/s) 2024-03-04T12:43:16.702 INFO:tasks.workunit.client.0.smithi090.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 32 kB/s) 2024-03-04T12:43:16.702 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-03-04T12:43:16.702 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-03-04T12:43:16.702 INFO:tasks.workunit.client.0.smithi090.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.7 MB/s) 2024-03-04T12:43:16.702 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-03-04T12:43:16.718 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 66/586 kB Progress (1): 82/586 kB Progress (1): 98/586 kB Progress (1): 115/586 kB Progress (1): 131/586 kB Progress (1): 147/586 kB Progress (1): 164/586 kB Progress (1): 180/586 kB Progress (1): 197/586 kB Progress (1): 213/586 kB Progress (1): 229/586 kB Progress (1): 246/586 kB Progress (1): 256/586 kB Progress (1): 272/586 kB Progress (1): 289/586 kB Progress (2): 289/586 kB | 16/211 kB Progress (2): 289/586 kB | 33/211 kB Progress (2): 305/586 kB | 33/211 kB Progress (2): 321/586 kB | 33/211 kB Progress (2): 338/586 kB | 33/211 kB Progress (2): 354/586 kB | 33/211 kB Progress (2): 354/586 kB | 49/211 kB Progress (2): 354/586 kB | 66/211 kB Progress (2): 370/586 kB | 66/211 kB Progress (2): 387/586 kB | 66/211 kB Progress (2): 403/586 kB | 66/211 kB Progress (2): 420/586 kB | 66/211 kB Progress (2): 420/586 kB | 82/211 kB Progress (2): 420/586 kB | 98/211 kB Progress (2): 436/586 kB | 98/211 kB Progress (2): 452/586 kB | 98/211 kB Progress (2): 469/586 kB | 98/211 kB Progress (2): 469/586 kB | 115/211 kB Progress (2): 485/586 kB | 115/211 kB Progress (2): 485/586 kB | 131/211 kB Progress (2): 485/586 kB | 147/211 kB Progress (2): 485/586 kB | 164/211 kB Progress (2): 502/586 kB | 164/211 kB Progress (2): 518/586 kB | 164/211 kB Progress (2): 534/586 kB | 164/211 kB Progress (2): 551/586 kB | 164/211 kB Progress (2): 551/586 kB | 180/211 kB Progress (2): 551/586 kB | 197/211 kB Progress (2): 567/586 kB | 197/211 kB Progress (2): 583/586 kB | 197/211 kB Progress (2): 586 kB | 197/211 kB Progress (2): 586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 986 kB/s) 2024-03-04T12:43:16.719 INFO:tasks.workunit.client.0.smithi090.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.7 MB/s) 2024-03-04T12:43:16.719 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-03-04T12:43:16.719 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-03-04T12:43:16.732 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.8 kB Progress (2): 6.8 kB | 16/106 kB Progress (2): 6.8 kB | 33/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 30 kB/s) 2024-03-04T12:43:16.732 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-03-04T12:43:16.734 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 49/106 kB Progress (1): 66/106 kB Progress (2): 66/106 kB | 14 kB Progress (2): 82/106 kB | 14 kB Progress (2): 98/106 kB | 14 kB Progress (2): 106 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 62 kB/s) 2024-03-04T12:43:16.734 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-03-04T12:43:16.734 INFO:tasks.workunit.client.0.smithi090.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 462 kB/s) 2024-03-04T12:43:16.734 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-03-04T12:43:16.752 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/205 kB Progress (1): 32/205 kB Progress (1): 49/205 kB Progress (1): 65/205 kB Progress (1): 81/205 kB Progress (1): 98/205 kB Progress (2): 98/205 kB | 15 kB Progress (2): 114/205 kB | 15 kB Progress (2): 130/205 kB | 15 kB Progress (2): 147/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 62 kB/s) 2024-03-04T12:43:16.752 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-03-04T12:43:16.752 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 163/205 kB Progress (2): 163/205 kB | 16/16 kB Progress (2): 163/205 kB | 16 kB Progress (2): 180/205 kB | 16 kB Progress (2): 196/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 66 kB/s) 2024-03-04T12:43:16.752 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-03-04T12:43:16.753 INFO:tasks.workunit.client.0.smithi090.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 823 kB/s) 2024-03-04T12:43:16.753 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-03-04T12:43:16.758 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (1): 98/245 kB Progress (1): 115/245 kB Progress (1): 131/245 kB Progress (1): 147/245 kB Progress (1): 164/245 kB Progress (1): 180/245 kB Progress (1): 197/245 kB Progress (1): 213/245 kB Progress (1): 229/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 963 kB/s) 2024-03-04T12:43:16.759 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-03-04T12:43:16.761 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 25 kB/s) 2024-03-04T12:43:16.769 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/23 kB Progress (2): 16/23 kB | 16/24 kB Progress (2): 23 kB | 16/24 kB Progress (2): 23 kB | 24 kB Progress (3): 23 kB | 24 kB | 16/17 kB Progress (3): 23 kB | 24 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 91 kB/s) 2024-03-04T12:43:16.769 INFO:tasks.workunit.client.0.smithi090.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 85 kB/s) 2024-03-04T12:43:16.769 INFO:tasks.workunit.client.0.smithi090.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 65 kB/s) 2024-03-04T12:43:16.777 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 673 kB/s) 2024-03-04T12:43:16.795 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:16.795 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-03-04T12:43:16.801 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-03-04T12:43:16.817 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 343 kB/s) 2024-03-04T12:43:16.819 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-03-04T12:43:16.836 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 300 kB/s) 2024-03-04T12:43:16.838 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-03-04T12:43:16.856 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.4 MB/s) 2024-03-04T12:43:16.859 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-03-04T12:43:16.876 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 839 kB/s) 2024-03-04T12:43:16.883 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-03-04T12:43:16.900 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.7 MB/s) 2024-03-04T12:43:16.901 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-03-04T12:43:16.922 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 10 MB/s) 2024-03-04T12:43:16.958 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:16.958 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-03-04T12:43:16.961 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-03-04T12:43:16.978 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 156 kB/s) 2024-03-04T12:43:16.979 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-03-04T12:43:16.996 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.4 MB/s) 2024-03-04T12:43:16.999 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-03-04T12:43:17.016 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 516 kB/s) 2024-03-04T12:43:17.018 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-03-04T12:43:17.036 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.4 MB/s) 2024-03-04T12:43:17.039 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-03-04T12:43:17.056 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 355 kB/s) 2024-03-04T12:43:17.057 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-03-04T12:43:17.080 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 146 kB/s) 2024-03-04T12:43:17.083 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-03-04T12:43:17.100 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 36 kB/s) 2024-03-04T12:43:17.101 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-03-04T12:43:17.120 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 171 kB/s) 2024-03-04T12:43:17.120 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-03-04T12:43:17.136 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 829 kB/s) 2024-03-04T12:43:17.138 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-03-04T12:43:17.154 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 200 kB/s) 2024-03-04T12:43:17.155 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-03-04T12:43:17.172 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 522 kB/s) 2024-03-04T12:43:17.173 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-03-04T12:43:17.190 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 523 kB/s) 2024-03-04T12:43:17.192 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-03-04T12:43:17.209 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 471 kB/s) 2024-03-04T12:43:17.212 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-03-04T12:43:17.230 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.1 MB/s) 2024-03-04T12:43:17.233 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-03-04T12:43:17.250 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 319 kB/s) 2024-03-04T12:43:17.252 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-03-04T12:43:17.269 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.8 MB/s) 2024-03-04T12:43:17.273 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-03-04T12:43:17.289 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 300 kB/s) 2024-03-04T12:43:17.293 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-03-04T12:43:17.313 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.5 MB/s) 2024-03-04T12:43:17.313 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-03-04T12:43:17.313 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-03-04T12:43:17.313 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-03-04T12:43:17.313 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-03-04T12:43:17.313 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-03-04T12:43:17.330 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 8.5 kB Progress (3): 2.5 kB | 8.5 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 147 kB/s) 2024-03-04T12:43:17.330 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-03-04T12:43:17.330 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 8.5 kB | 33/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 530 kB/s) 2024-03-04T12:43:17.330 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-03-04T12:43:17.330 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.4 MB/s) 2024-03-04T12:43:17.331 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/55 kB Progress (1): 33/55 kB Progress (1): 49/55 kB Progress (1): 55 kB Progress (2): 55 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.1 MB/s) 2024-03-04T12:43:17.335 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 33/269 kB Progress (1): 49/269 kB Progress (1): 66/269 kB Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 11 MB/s) 2024-03-04T12:43:17.355 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/327 kB Progress (1): 32/327 kB Progress (1): 49/327 kB Progress (2): 49/327 kB | 16/587 kB Progress (2): 65/327 kB | 16/587 kB Progress (2): 65/327 kB | 33/587 kB Progress (2): 65/327 kB | 49/587 kB Progress (2): 81/327 kB | 49/587 kB Progress (2): 98/327 kB | 49/587 kB Progress (2): 114/327 kB | 49/587 kB Progress (2): 114/327 kB | 66/587 kB Progress (2): 114/327 kB | 82/587 kB Progress (2): 114/327 kB | 98/587 kB Progress (2): 114/327 kB | 115/587 kB Progress (2): 114/327 kB | 131/587 kB Progress (2): 114/327 kB | 147/587 kB Progress (2): 114/327 kB | 164/587 kB Progress (2): 130/327 kB | 164/587 kB Progress (2): 130/327 kB | 180/587 kB Progress (2): 147/327 kB | 180/587 kB Progress (2): 163/327 kB | 180/587 kB Progress (2): 163/327 kB | 197/587 kB Progress (2): 180/327 kB | 197/587 kB Progress (2): 180/327 kB | 213/587 kB Progress (2): 180/327 kB | 229/587 kB Progress (2): 180/327 kB | 246/587 kB Progress (2): 196/327 kB | 246/587 kB Progress (2): 196/327 kB | 256/587 kB Progress (2): 212/327 kB | 256/587 kB Progress (2): 229/327 kB | 256/587 kB Progress (2): 229/327 kB | 272/587 kB Progress (2): 229/327 kB | 289/587 kB Progress (2): 229/327 kB | 305/587 kB Progress (2): 229/327 kB | 321/587 kB Progress (2): 229/327 kB | 338/587 kB Progress (2): 229/327 kB | 354/587 kB Progress (2): 245/327 kB | 354/587 kB Progress (2): 245/327 kB | 370/587 kB Progress (2): 262/327 kB | 370/587 kB Progress (2): 262/327 kB | 387/587 kB Progress (2): 278/327 kB | 387/587 kB Progress (2): 278/327 kB | 403/587 kB Progress (2): 294/327 kB | 403/587 kB Progress (2): 294/327 kB | 420/587 kB Progress (2): 294/327 kB | 436/587 kB Progress (2): 294/327 kB | 452/587 kB Progress (2): 294/327 kB | 469/587 kB Progress (2): 311/327 kB | 469/587 kB Progress (2): 311/327 kB | 485/587 kB Progress (2): 327/327 kB | 485/587 kB Progress (2): 327/327 kB | 502/587 kB Progress (2): 327 kB | 502/587 kB Progress (2): 327 kB | 518/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 7.8 MB/s) 2024-03-04T12:43:17.356 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 534/587 kB Progress (1): 551/587 kB Progress (1): 567/587 kB Progress (1): 583/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-03-04T12:43:17.385 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-03-04T12:43:17.386 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:17.386 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-03-04T12:43:17.389 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-03-04T12:43:17.406 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 296 kB/s) 2024-03-04T12:43:17.408 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-03-04T12:43:17.424 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 397 kB/s) 2024-03-04T12:43:17.425 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-03-04T12:43:17.443 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 1.9 MB/s) 2024-03-04T12:43:17.445 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-03-04T12:43:17.461 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 873 kB/s) 2024-03-04T12:43:17.463 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-03-04T12:43:17.481 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 48 kB/s) 2024-03-04T12:43:17.483 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-03-04T12:43:17.500 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 249 kB/s) 2024-03-04T12:43:17.502 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-03-04T12:43:17.518 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.0 MB/s) 2024-03-04T12:43:17.521 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-03-04T12:43:17.538 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 292 kB/s) 2024-03-04T12:43:17.540 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-03-04T12:43:17.557 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 244 kB/s) 2024-03-04T12:43:17.560 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-03-04T12:43:17.577 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 139 kB/s) 2024-03-04T12:43:17.578 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-03-04T12:43:17.596 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 664 kB/s) 2024-03-04T12:43:17.598 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-03-04T12:43:17.615 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 958 kB/s) 2024-03-04T12:43:17.617 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-03-04T12:43:17.635 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 386 kB/s) 2024-03-04T12:43:17.638 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-03-04T12:43:17.655 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 59 kB/s) 2024-03-04T12:43:17.657 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-03-04T12:43:17.674 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 493 kB/s) 2024-03-04T12:43:17.676 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-03-04T12:43:17.693 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 158 kB/s) 2024-03-04T12:43:17.696 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-03-04T12:43:17.712 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-03-04T12:43:17.715 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-03-04T12:43:17.732 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 67 kB/s) 2024-03-04T12:43:17.735 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-03-04T12:43:17.752 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 43 kB/s) 2024-03-04T12:43:17.753 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-03-04T12:43:17.770 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 355 kB/s) 2024-03-04T12:43:17.771 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-03-04T12:43:17.788 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.5 MB/s) 2024-03-04T12:43:17.792 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-03-04T12:43:17.809 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 67 kB/s) 2024-03-04T12:43:17.811 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-03-04T12:43:17.828 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 78 kB/s) 2024-03-04T12:43:17.835 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-03-04T12:43:17.852 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 796 kB/s) 2024-03-04T12:43:17.853 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-03-04T12:43:17.853 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-03-04T12:43:17.853 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-03-04T12:43:17.853 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-03-04T12:43:17.853 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-03-04T12:43:17.868 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 248 kB/s) 2024-03-04T12:43:17.869 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-03-04T12:43:17.873 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/122 kB Progress (1): 32/122 kB Progress (1): 49/122 kB Progress (2): 49/122 kB | 16/27 kB Progress (2): 49/122 kB | 27 kB Progress (3): 49/122 kB | 27 kB | 16/55 kB Progress (3): 49/122 kB | 27 kB | 33/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.6 MB/s) 2024-03-04T12:43:17.873 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-03-04T12:43:17.873 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 49/122 kB | 49/55 kB Progress (2): 49/122 kB | 55 kB Progress (3): 49/122 kB | 55 kB | 16/334 kB Progress (3): 49/122 kB | 55 kB | 32/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 2.9 MB/s) 2024-03-04T12:43:17.873 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-03-04T12:43:17.874 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 49/122 kB | 49/334 kB Progress (2): 65/122 kB | 49/334 kB Progress (2): 65/122 kB | 65/334 kB Progress (2): 81/122 kB | 65/334 kB Progress (2): 81/122 kB | 81/334 kB Progress (2): 98/122 kB | 81/334 kB Progress (2): 98/122 kB | 98/334 kB Progress (2): 98/122 kB | 114/334 kB Progress (2): 98/122 kB | 131/334 kB Progress (2): 98/122 kB | 147/334 kB Progress (2): 98/122 kB | 163/334 kB Progress (2): 98/122 kB | 180/334 kB Progress (2): 98/122 kB | 196/334 kB Progress (2): 98/122 kB | 212/334 kB Progress (2): 98/122 kB | 229/334 kB Progress (2): 98/122 kB | 245/334 kB Progress (2): 98/122 kB | 262/334 kB Progress (2): 114/122 kB | 262/334 kB Progress (2): 114/122 kB | 278/334 kB Progress (2): 122 kB | 278/334 kB Progress (2): 122 kB | 294/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 5.6 MB/s) 2024-03-04T12:43:17.875 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 15 MB/s) 2024-03-04T12:43:17.889 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (2): 197/267 kB | 4.7 kB Progress (2): 213/267 kB | 4.7 kB Progress (3): 213/267 kB | 4.7 kB | 16/23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 133 kB/s) 2024-03-04T12:43:17.889 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 213/267 kB | 23 kB Progress (2): 229/267 kB | 23 kB Progress (2): 246/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 633 kB/s) 2024-03-04T12:43:17.889 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.4 MB/s) 2024-03-04T12:43:17.935 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Changes detected - recompiling the module! :source 2024-03-04T12:43:17.936 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-03-04T12:43:18.503 INFO:tasks.workunit.client.0.smithi090.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-03-04T12:43:18.503 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:18.503 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-03-04T12:43:18.506 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-03-04T12:43:18.506 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:18.506 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-03-04T12:43:18.510 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-03-04T12:43:18.510 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-03-04T12:43:18.659 INFO:tasks.workunit.client.0.smithi090.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-03-04T12:43:18.660 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:18.660 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-03-04T12:43:18.663 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-03-04T12:43:18.681 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 367 kB/s) 2024-03-04T12:43:18.684 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-03-04T12:43:18.728 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 80 kB/s) 2024-03-04T12:43:18.731 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-03-04T12:43:18.774 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 78 kB/s) 2024-03-04T12:43:18.777 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-03-04T12:43:18.826 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 83 kB/s) 2024-03-04T12:43:18.829 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-03-04T12:43:18.888 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 56 kB/s) 2024-03-04T12:43:18.891 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-03-04T12:43:18.967 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 58 kB/s) 2024-03-04T12:43:18.971 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-03-04T12:43:19.019 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 36 kB/s) 2024-03-04T12:43:19.022 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-03-04T12:43:19.050 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 81 kB/s) 2024-03-04T12:43:19.051 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-03-04T12:43:19.085 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 914 kB/s) 2024-03-04T12:43:19.088 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-03-04T12:43:19.138 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 38 kB/s) 2024-03-04T12:43:19.141 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-03-04T12:43:19.209 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 85 kB/s) 2024-03-04T12:43:19.211 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-03-04T12:43:19.271 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 39 kB/s) 2024-03-04T12:43:19.272 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-03-04T12:43:19.330 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 392 kB/s) 2024-03-04T12:43:19.331 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-03-04T12:43:19.388 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 669 kB/s) 2024-03-04T12:43:19.390 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-03-04T12:43:19.440 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 305 kB/s) 2024-03-04T12:43:19.442 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-03-04T12:43:19.488 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 184 kB/s) 2024-03-04T12:43:19.490 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-03-04T12:43:19.520 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 883 kB/s) 2024-03-04T12:43:19.523 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-03-04T12:43:19.541 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 448 kB/s) 2024-03-04T12:43:19.544 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-03-04T12:43:19.560 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 128 kB/s) 2024-03-04T12:43:19.563 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-03-04T12:43:19.580 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 144 kB/s) 2024-03-04T12:43:19.583 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-03-04T12:43:19.601 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 86 kB/s) 2024-03-04T12:43:19.602 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-03-04T12:43:19.626 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 133 kB/s) 2024-03-04T12:43:19.627 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-03-04T12:43:19.648 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.0 MB/s) 2024-03-04T12:43:19.650 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-03-04T12:43:19.666 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 398 kB/s) 2024-03-04T12:43:19.668 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-03-04T12:43:19.686 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 753 kB/s) 2024-03-04T12:43:19.688 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-03-04T12:43:19.705 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 174 kB/s) 2024-03-04T12:43:19.706 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-03-04T12:43:19.723 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 425 kB/s) 2024-03-04T12:43:19.724 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-03-04T12:43:19.741 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 525 kB/s) 2024-03-04T12:43:19.743 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-03-04T12:43:19.761 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 115 kB/s) 2024-03-04T12:43:19.763 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-03-04T12:43:19.780 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 131 kB/s) 2024-03-04T12:43:19.783 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-03-04T12:43:19.800 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 178 kB/s) 2024-03-04T12:43:19.803 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-03-04T12:43:19.828 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 599 kB/s) 2024-03-04T12:43:19.830 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-03-04T12:43:19.865 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 427 kB/s) 2024-03-04T12:43:19.867 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-03-04T12:43:19.900 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 407 kB/s) 2024-03-04T12:43:19.901 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-03-04T12:43:19.933 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 150 kB/s) 2024-03-04T12:43:19.935 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-03-04T12:43:19.960 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 251 kB/s) 2024-03-04T12:43:19.962 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-03-04T12:43:19.982 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.6 MB/s) 2024-03-04T12:43:19.985 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-03-04T12:43:20.002 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.0 MB/s) 2024-03-04T12:43:20.004 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-03-04T12:43:20.022 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 822 kB/s) 2024-03-04T12:43:20.024 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-03-04T12:43:20.042 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 39 kB/s) 2024-03-04T12:43:20.044 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-03-04T12:43:20.063 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 253 kB/s) 2024-03-04T12:43:20.064 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-03-04T12:43:20.081 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 494 kB/s) 2024-03-04T12:43:20.083 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-03-04T12:43:20.100 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 166 kB/s) 2024-03-04T12:43:20.103 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-03-04T12:43:20.121 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 236 kB/s) 2024-03-04T12:43:20.123 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-03-04T12:43:20.141 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 108 kB/s) 2024-03-04T12:43:20.143 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-03-04T12:43:20.160 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 204 kB/s) 2024-03-04T12:43:20.163 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-03-04T12:43:20.179 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-03-04T12:43:20.181 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-03-04T12:43:20.198 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 793 kB/s) 2024-03-04T12:43:20.199 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-03-04T12:43:20.217 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.1 MB/s) 2024-03-04T12:43:20.219 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-03-04T12:43:20.235 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 23 kB/s) 2024-03-04T12:43:20.236 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-03-04T12:43:20.254 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 359 kB/s) 2024-03-04T12:43:20.255 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-03-04T12:43:20.272 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 432 kB/s) 2024-03-04T12:43:20.273 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-03-04T12:43:20.289 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 302 kB/s) 2024-03-04T12:43:20.291 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-03-04T12:43:20.308 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 430 kB/s) 2024-03-04T12:43:20.310 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-03-04T12:43:20.331 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.0 MB/s) 2024-03-04T12:43:20.333 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-03-04T12:43:20.351 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.3 MB/s) 2024-03-04T12:43:20.354 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-03-04T12:43:20.371 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.4 MB/s) 2024-03-04T12:43:20.374 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-03-04T12:43:20.390 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 332 kB/s) 2024-03-04T12:43:20.392 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-03-04T12:43:20.409 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 267 kB/s) 2024-03-04T12:43:20.410 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-03-04T12:43:20.427 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 200 kB/s) 2024-03-04T12:43:20.428 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-03-04T12:43:20.445 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-03-04T12:43:20.447 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-03-04T12:43:20.464 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 139 kB/s) 2024-03-04T12:43:20.469 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-03-04T12:43:20.492 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 262/308 kB Progress (1): 279/308 kB Progress (1): 295/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 13 MB/s) 2024-03-04T12:43:20.493 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-03-04T12:43:20.493 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-03-04T12:43:20.493 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-03-04T12:43:20.494 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-03-04T12:43:20.494 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-03-04T12:43:20.511 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 14 kB Progress (2): 14 kB | 16/26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-03-04T12:43:20.511 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-03-04T12:43:20.512 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 26 kB Progress (2): 26 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.4 MB/s) 2024-03-04T12:43:20.512 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-03-04T12:43:20.512 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 8.2 kB | 16/118 kB Progress (2): 8.2 kB | 33/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 430 kB/s) 2024-03-04T12:43:20.513 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-03-04T12:43:20.514 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 49/118 kB Progress (1): 66/118 kB Progress (1): 82/118 kB Progress (1): 98/118 kB Progress (1): 115/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.6 MB/s) 2024-03-04T12:43:20.514 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-03-04T12:43:20.524 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/171 kB Progress (1): 32/171 kB Progress (1): 49/171 kB Progress (1): 65/171 kB Progress (1): 81/171 kB Progress (1): 98/171 kB Progress (1): 114/171 kB Progress (1): 130/171 kB Progress (1): 147/171 kB Progress (1): 163/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 5.5 MB/s) 2024-03-04T12:43:20.524 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-03-04T12:43:20.533 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/146 kB Progress (2): 16/146 kB | 16/136 kB Progress (2): 33/146 kB | 16/136 kB Progress (3): 33/146 kB | 16/136 kB | 16/61 kB Progress (3): 49/146 kB | 16/136 kB | 16/61 kB Progress (3): 49/146 kB | 33/136 kB | 16/61 kB Progress (3): 49/146 kB | 33/136 kB | 33/61 kB Progress (3): 66/146 kB | 33/136 kB | 33/61 kB Progress (3): 66/146 kB | 49/136 kB | 33/61 kB Progress (4): 66/146 kB | 49/136 kB | 33/61 kB | 16/501 kB Progress (4): 66/146 kB | 49/136 kB | 49/61 kB | 16/501 kB Progress (4): 82/146 kB | 49/136 kB | 49/61 kB | 16/501 kB Progress (4): 82/146 kB | 66/136 kB | 49/61 kB | 16/501 kB Progress (4): 82/146 kB | 66/136 kB | 49/61 kB | 33/501 kB Progress (4): 82/146 kB | 66/136 kB | 61 kB | 33/501 kB Progress (4): 98/146 kB | 66/136 kB | 61 kB | 33/501 kB Progress (4): 98/146 kB | 82/136 kB | 61 kB | 33/501 kB Progress (4): 98/146 kB | 82/136 kB | 61 kB | 49/501 kB Progress (4): 115/146 kB | 82/136 kB | 61 kB | 49/501 kB Progress (4): 115/146 kB | 98/136 kB | 61 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.6 MB/s) 2024-03-04T12:43:20.534 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-03-04T12:43:20.534 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (3): 115/146 kB | 98/136 kB | 66/501 kB Progress (3): 131/146 kB | 98/136 kB | 66/501 kB Progress (3): 131/146 kB | 115/136 kB | 66/501 kB Progress (3): 131/146 kB | 115/136 kB | 82/501 kB Progress (3): 146 kB | 115/136 kB | 82/501 kB Progress (3): 146 kB | 131/136 kB | 82/501 kB Progress (3): 146 kB | 136 kB | 82/501 kB Progress (3): 146 kB | 136 kB | 98/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.7 MB/s) 2024-03-04T12:43:20.534 INFO:tasks.workunit.client.0.smithi090.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.5 MB/s) 2024-03-04T12:43:20.534 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-03-04T12:43:20.538 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 115/501 kB Progress (1): 131/501 kB Progress (1): 147/501 kB Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 256/501 kB Progress (1): 272/501 kB Progress (1): 289/501 kB Progress (1): 305/501 kB Progress (1): 321/501 kB Progress (1): 338/501 kB Progress (1): 354/501 kB Progress (1): 370/501 kB Progress (1): 387/501 kB Progress (1): 403/501 kB Progress (1): 420/501 kB Progress (1): 436/501 kB Progress (1): 452/501 kB Progress (1): 469/501 kB Progress (1): 485/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-03-04T12:43:20.547 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/58 kB Progress (1): 33/58 kB Progress (1): 49/58 kB Progress (1): 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.1 MB/s) 2024-03-04T12:43:20.555 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 64/124 kB Progress (1): 81/124 kB Progress (1): 97/124 kB Progress (1): 113/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.0 MB/s) 2024-03-04T12:43:20.628 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 18 MB/s) 2024-03-04T12:43:20.694 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:20.694 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-03-04T12:43:20.697 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-03-04T12:43:20.719 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 195 kB/s) 2024-03-04T12:43:20.721 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-03-04T12:43:20.738 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 288 kB/s) 2024-03-04T12:43:20.740 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-03-04T12:43:20.757 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.7 MB/s) 2024-03-04T12:43:20.759 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-03-04T12:43:20.780 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 978 kB/s) 2024-03-04T12:43:20.782 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-03-04T12:43:20.808 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 199 kB/s) 2024-03-04T12:43:20.810 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-03-04T12:43:20.826 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 245 kB/s) 2024-03-04T12:43:20.828 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-03-04T12:43:20.847 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 334 kB/s) 2024-03-04T12:43:20.849 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-03-04T12:43:20.866 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 368 kB/s) 2024-03-04T12:43:20.868 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-03-04T12:43:20.884 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.2 MB/s) 2024-03-04T12:43:20.887 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-03-04T12:43:20.904 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 855 kB/s) 2024-03-04T12:43:20.906 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-03-04T12:43:20.923 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 114 kB/s) 2024-03-04T12:43:20.925 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-03-04T12:43:20.942 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 483 kB/s) 2024-03-04T12:43:20.943 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-03-04T12:43:20.961 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.5 MB/s) 2024-03-04T12:43:20.968 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-03-04T12:43:20.983 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.0 MB/s) 2024-03-04T12:43:20.984 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-03-04T12:43:20.984 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-03-04T12:43:20.984 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-03-04T12:43:20.984 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-03-04T12:43:20.984 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-03-04T12:43:21.001 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Progress (2): 26 kB | 16/58 kB Progress (2): 26 kB | 33/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-03-04T12:43:21.001 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-03-04T12:43:21.001 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 49/58 kB Progress (1): 58 kB Progress (2): 58 kB | 16/211 kB Progress (2): 58 kB | 33/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-03-04T12:43:21.001 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-03-04T12:43:21.003 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 49/211 kB Progress (2): 49/211 kB | 16/79 kB Progress (2): 49/211 kB | 32/79 kB Progress (3): 49/211 kB | 32/79 kB | 0/1.0 MB Progress (3): 49/211 kB | 49/79 kB | 0/1.0 MB Progress (3): 49/211 kB | 49/79 kB | 0/1.0 MB Progress (3): 66/211 kB | 49/79 kB | 0/1.0 MB Progress (3): 82/211 kB | 49/79 kB | 0/1.0 MB Progress (3): 98/211 kB | 49/79 kB | 0/1.0 MB Progress (3): 98/211 kB | 65/79 kB | 0/1.0 MB Progress (3): 115/211 kB | 65/79 kB | 0/1.0 MB Progress (3): 115/211 kB | 79 kB | 0/1.0 MB Progress (3): 115/211 kB | 79 kB | 0/1.0 MB Progress (3): 131/211 kB | 79 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.0 MB/s) 2024-03-04T12:43:21.006 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 131/211 kB | 0.1/1.0 MB Progress (2): 147/211 kB | 0.1/1.0 MB Progress (2): 164/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 197/211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 9.6 MB/s) 2024-03-04T12:43:21.019 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (2): 0.5/1.0 MB | 16/116 kB Progress (2): 0.5/1.0 MB | 16/116 kB Progress (2): 0.5/1.0 MB | 32/116 kB Progress (2): 0.5/1.0 MB | 49/116 kB Progress (2): 0.6/1.0 MB | 49/116 kB Progress (2): 0.6/1.0 MB | 65/116 kB Progress (2): 0.6/1.0 MB | 81/116 kB Progress (2): 0.6/1.0 MB | 81/116 kB Progress (2): 0.6/1.0 MB | 98/116 kB Progress (2): 0.6/1.0 MB | 98/116 kB Progress (2): 0.6/1.0 MB | 114/116 kB Progress (2): 0.6/1.0 MB | 116 kB Progress (2): 0.6/1.0 MB | 116 kB Progress (3): 0.6/1.0 MB | 116 kB | 16/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.3 MB/s) 2024-03-04T12:43:21.022 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 0.6/1.0 MB | 16/267 kB Progress (2): 0.6/1.0 MB | 33/267 kB Progress (2): 0.6/1.0 MB | 49/267 kB Progress (2): 0.6/1.0 MB | 49/267 kB Progress (2): 0.6/1.0 MB | 66/267 kB Progress (2): 0.7/1.0 MB | 66/267 kB Progress (2): 0.7/1.0 MB | 82/267 kB Progress (2): 0.7/1.0 MB | 98/267 kB Progress (2): 0.7/1.0 MB | 98/267 kB Progress (2): 0.7/1.0 MB | 115/267 kB Progress (2): 0.7/1.0 MB | 131/267 kB Progress (2): 0.7/1.0 MB | 131/267 kB Progress (2): 0.7/1.0 MB | 147/267 kB Progress (2): 0.7/1.0 MB | 164/267 kB Progress (2): 0.7/1.0 MB | 164/267 kB Progress (2): 0.7/1.0 MB | 180/267 kB Progress (2): 0.7/1.0 MB | 180/267 kB Progress (2): 0.7/1.0 MB | 197/267 kB Progress (2): 0.7/1.0 MB | 213/267 kB Progress (2): 0.7/1.0 MB | 229/267 kB Progress (2): 0.7/1.0 MB | 246/267 kB Progress (2): 0.7/1.0 MB | 246/267 kB Progress (2): 0.7/1.0 MB | 262/267 kB Progress (2): 0.7/1.0 MB | 267 kB Progress (2): 0.7/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.0 MB/s) 2024-03-04T12:43:21.029 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 23 MB/s) 2024-03-04T12:43:21.151 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-03-04T12:43:21.193 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-04T12:43:21.193 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] BUILD SUCCESS 2024-03-04T12:43:21.193 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-04T12:43:21.194 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Total time: 7.058 s 2024-03-04T12:43:21.194 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Finished at: 2024-03-04T12:43:21Z 2024-03-04T12:43:21.194 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-04T12:43:21.218 INFO:tasks.workunit.client.0.smithi090.stderr:+ ./mvnw test -Dtest=PutObjects 2024-03-04T12:43:21.226 INFO:tasks.workunit.client.0.smithi090.stdout:Warning: JAVA_HOME environment variable is not set. 2024-03-04T12:43:22.189 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Scanning for projects... 2024-03-04T12:43:22.263 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:22.263 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-03-04T12:43:22.263 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Building jcksum 1.0 2024-03-04T12:43:22.263 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] from pom.xml 2024-03-04T12:43:22.264 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-03-04T12:43:22.507 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:22.507 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-03-04T12:43:22.597 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-03-04T12:43:22.598 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:22.598 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-03-04T12:43:22.690 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Nothing to compile - all classes are up to date 2024-03-04T12:43:22.690 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:22.691 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-03-04T12:43:22.692 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-03-04T12:43:22.692 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:22.692 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-03-04T12:43:22.696 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Nothing to compile - all classes are up to date 2024-03-04T12:43:22.696 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:22.697 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-03-04T12:43:22.872 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-03-04T12:43:23.076 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-03-04T12:43:23.301 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 20 kB/s) 2024-03-04T12:43:23.310 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-03-04T12:43:23.352 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 62 kB/s) 2024-03-04T12:43:23.360 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-03-04T12:43:23.401 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 67 kB/s) 2024-03-04T12:43:23.407 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-03-04T12:43:23.429 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 138 kB/s) 2024-03-04T12:43:23.432 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-03-04T12:43:23.453 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 169 kB/s) 2024-03-04T12:43:23.456 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-03-04T12:43:23.476 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 84 kB/s) 2024-03-04T12:43:23.479 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-03-04T12:43:23.498 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 142 kB/s) 2024-03-04T12:43:23.506 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-03-04T12:43:23.533 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 17/27 kB Progress (1): 19/27 kB Progress (1): 20/27 kB Progress (1): 21/27 kB Progress (1): 23/27 kB Progress (1): 24/27 kB Progress (1): 25/27 kB Progress (1): 27/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.0 MB/s) 2024-03-04T12:43:23.535 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-03-04T12:43:23.535 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-03-04T12:43:23.535 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-03-04T12:43:23.536 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-03-04T12:43:23.537 INFO:tasks.workunit.client.0.smithi090.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-03-04T12:43:23.558 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 731 kB/s) 2024-03-04T12:43:23.599 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (1): 4.1/7.7 kB Progress (1): 5.5/7.7 kB Progress (1): 6.9/7.7 kB Progress (2): 6.9/7.7 kB | 16/169 kB Progress (2): 7.7 kB | 16/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 120 kB/s) 2024-03-04T12:43:23.635 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 16/169 kB | 16/103 kB Progress (3): 16/169 kB | 16/103 kB | 16/189 kB Progress (3): 16/169 kB | 33/103 kB | 16/189 kB Progress (3): 33/169 kB | 33/103 kB | 16/189 kB Progress (3): 33/169 kB | 33/103 kB | 33/189 kB Progress (3): 33/169 kB | 49/103 kB | 33/189 kB Progress (3): 49/169 kB | 49/103 kB | 33/189 kB Progress (3): 49/169 kB | 49/103 kB | 49/189 kB Progress (3): 66/169 kB | 49/103 kB | 49/189 kB Progress (3): 66/169 kB | 66/103 kB | 49/189 kB Progress (3): 66/169 kB | 66/103 kB | 66/189 kB Progress (3): 82/169 kB | 66/103 kB | 66/189 kB Progress (3): 82/169 kB | 82/103 kB | 66/189 kB Progress (3): 82/169 kB | 82/103 kB | 82/189 kB Progress (3): 98/169 kB | 82/103 kB | 82/189 kB Progress (3): 98/169 kB | 98/103 kB | 82/189 kB Progress (3): 98/169 kB | 98/103 kB | 98/189 kB Progress (3): 98/169 kB | 103 kB | 98/189 kB Progress (3): 115/169 kB | 103 kB | 98/189 kB Progress (3): 115/169 kB | 103 kB | 115/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.0 MB/s) 2024-03-04T12:43:23.643 INFO:tasks.workunit.client.0.smithi090.stdout:Progress (2): 131/169 kB | 115/189 kB Progress (2): 131/169 kB | 131/189 kB Progress (2): 147/169 kB | 131/189 kB Progress (2): 147/169 kB | 147/189 kB Progress (2): 147/169 kB | 164/189 kB Progress (2): 164/169 kB | 164/189 kB Progress (2): 164/169 kB | 180/189 kB Progress (2): 169 kB | 180/189 kB Progress (2): 169 kB | 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.6 MB/s) 2024-03-04T12:43:23.643 INFO:tasks.workunit.client.0.smithi090.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.8 MB/s) 2024-03-04T12:43:23.660 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:23.660 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] ------------------------------------------------------- 2024-03-04T12:43:23.661 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] T E S T S 2024-03-04T12:43:23.661 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] ------------------------------------------------------- 2024-03-04T12:43:24.138 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-03-04T12:43:24.250 INFO:tasks.workunit.client.0.smithi090.stdout:PutObjects.java: starting test run: 2024-03-04T12:43:24.250 INFO:tasks.workunit.client.0.smithi090.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-04T12:43:24.250 INFO:tasks.workunit.client.0.smithi090.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-04T12:43:24.250 INFO:tasks.workunit.client.0.smithi090.stdout: EndpointUrl=https://smithi090.front.sepia.ceph.com:443 2024-03-04T12:43:24.251 INFO:tasks.workunit.client.0.smithi090.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-03-04T12:43:24.347 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: Environment Variables Read 2024-03-04T12:43:24.648 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: S3 Client Initialized 2024-03-04T12:43:24.648 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: Generating File 2024-03-04T12:43:24.649 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: File Generated 2024-03-04T12:43:24.649 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: Generating File 2024-03-04T12:43:24.649 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: File Generated 2024-03-04T12:43:24.649 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: Generating File 2024-03-04T12:43:24.749 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: File Generated 2024-03-04T12:43:24.749 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: Generating File 2024-03-04T12:43:24.749 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: File Generated 2024-03-04T12:43:24.749 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: Generating File 2024-03-04T12:43:24.749 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: File Generated 2024-03-04T12:43:24.749 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: Generating File 2024-03-04T12:43:24.749 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: File Generated 2024-03-04T12:43:24.749 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: Generated Big Files 2024-03-04T12:43:24.948 INFO:tasks.workunit.client.0.smithi090.stdout:HeadBucketResponse() 2024-03-04T12:43:24.949 INFO:tasks.workunit.client.0.smithi090.stdout:sheik is ready 2024-03-04T12:43:24.949 INFO:tasks.workunit.client.0.smithi090.stdout:DEBUG: Test Bucket Created 2024-03-04T12:43:25.048 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileNoCksum called with file-0b 2024-03-04T12:43:25.114 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileNoCksum called with file-8b 2024-03-04T12:43:25.148 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileNoCksum called with file-200b 2024-03-04T12:43:25.202 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileNoCksum called with file-21983b 2024-03-04T12:43:25.249 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileNoCksum called with file-5519b 2024-03-04T12:43:25.338 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileNoCksum called with file-204329b 2024-03-04T12:43:25.349 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileNoCksum called with file-256k 2024-03-04T12:43:25.449 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileNoCksum called with file-1m 2024-03-04T12:43:25.549 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-03-04T12:43:25.649 INFO:tasks.workunit.client.0.smithi090.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-03-04T12:43:27.452 INFO:tasks.workunit.client.0.smithi090.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-03-04T12:43:27.853 INFO:tasks.workunit.client.0.smithi090.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-03-04T12:43:29.719 INFO:tasks.workunit.client.0.smithi090.stdout:arg: file-0b 2024-03-04T12:43:29.720 INFO:tasks.workunit.client.0.smithi090.stdout:arg: file-8b 2024-03-04T12:43:29.721 INFO:tasks.workunit.client.0.smithi090.stdout:arg: file-200b 2024-03-04T12:43:29.722 INFO:tasks.workunit.client.0.smithi090.stdout:arg: file-21983b 2024-03-04T12:43:29.723 INFO:tasks.workunit.client.0.smithi090.stdout:arg: file-5519b 2024-03-04T12:43:29.723 INFO:tasks.workunit.client.0.smithi090.stdout:arg: file-204329b 2024-03-04T12:43:29.724 INFO:tasks.workunit.client.0.smithi090.stdout:arg: file-256k 2024-03-04T12:43:29.725 INFO:tasks.workunit.client.0.smithi090.stdout:arg: file-1m 2024-03-04T12:43:29.726 INFO:tasks.workunit.client.0.smithi090.stdout:arg: file-1038757b 2024-03-04T12:43:29.755 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileCksum called with file-0b 2024-03-04T12:43:29.755 INFO:tasks.workunit.client.0.smithi090.stdout:PutObjectResponse 2024-03-04T12:43:29.815 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileCksum called with file-8b 2024-03-04T12:43:29.815 INFO:tasks.workunit.client.0.smithi090.stdout:PutObjectResponse 2024-03-04T12:43:29.856 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileCksum called with file-200b 2024-03-04T12:43:29.856 INFO:tasks.workunit.client.0.smithi090.stdout:PutObjectResponse 2024-03-04T12:43:29.931 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileCksum called with file-21983b 2024-03-04T12:43:29.931 INFO:tasks.workunit.client.0.smithi090.stdout:PutObjectResponse 2024-03-04T12:43:29.956 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileCksum called with file-5519b 2024-03-04T12:43:29.956 INFO:tasks.workunit.client.0.smithi090.stdout:PutObjectResponse 2024-03-04T12:43:30.056 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileCksum called with file-204329b 2024-03-04T12:43:30.056 INFO:tasks.workunit.client.0.smithi090.stdout:PutObjectResponse 2024-03-04T12:43:30.086 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileCksum called with file-256k 2024-03-04T12:43:30.086 INFO:tasks.workunit.client.0.smithi090.stdout:PutObjectResponse 2024-03-04T12:43:30.156 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileCksum called with file-1m 2024-03-04T12:43:30.156 INFO:tasks.workunit.client.0.smithi090.stdout:PutObjectResponse 2024-03-04T12:43:30.247 INFO:tasks.workunit.client.0.smithi090.stdout:putObjectFromFileCksum called with file-1038757b 2024-03-04T12:43:30.247 INFO:tasks.workunit.client.0.smithi090.stdout:PutObjectResponse 2024-03-04T12:43:30.256 INFO:tasks.workunit.client.0.smithi090.stdout:mpuObjectFromFileCksum called with file-5m 2024-03-04T12:43:30.557 INFO:tasks.workunit.client.0.smithi090.stdout:mpuObjectFromFileCksum called with file-10m 2024-03-04T12:43:30.957 INFO:tasks.workunit.client.0.smithi090.stdout:mpuObjectFromFileCksum called with file-100m 2024-03-04T12:43:32.981 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.835 s -- in io.ceph.jcksum.PutObjects 2024-03-04T12:43:32.994 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:32.994 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Results: 2024-03-04T12:43:32.994 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:32.994 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-03-04T12:43:32.994 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] 2024-03-04T12:43:32.996 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-04T12:43:32.996 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] BUILD SUCCESS 2024-03-04T12:43:32.996 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-04T12:43:32.997 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Total time: 10.827 s 2024-03-04T12:43:32.997 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] Finished at: 2024-03-04T12:43:32Z 2024-03-04T12:43:32.997 INFO:tasks.workunit.client.0.smithi090.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-04T12:43:33.020 INFO:tasks.workunit.client.0.smithi090.stderr:+ exit 2024-03-04T12:43:33.020 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:43:33.020 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:43:33.099 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-03-04T12:43:33.100 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-04T12:43:33.456 DEBUG:teuthology.parallel:result is None 2024-03-04T12:43:33.457 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:43:33.496 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:43:33.496 DEBUG:teuthology.orchestra.run.smithi090:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:43:33.563 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:43:33.563 INFO:teuthology.run_tasks:Running task workunit... 2024-03-04T12:43:33.574 INFO:tasks.workunit:Pulling workunits from ref 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:43:33.574 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-04T12:43:33.574 DEBUG:teuthology.orchestra.run.smithi090:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:43:33.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:43:33.630 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-04T12:43:33.630 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:43:33.697 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-04T12:43:33.698 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-04T12:43:33.765 INFO:tasks.workunit:timeout=3h 2024-03-04T12:43:33.765 INFO:tasks.workunit:cleanup=True 2024-03-04T12:43:33.766 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:43:33.834 INFO:tasks.workunit.client.0.smithi090.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-04T12:44:14.099 INFO:tasks.workunit.client.0.smithi090.stderr:Note: switching to '3aec390336fdfdc8f927818b718cfb0361bd47c8'. 2024-03-04T12:44:14.099 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:44:14.099 INFO:tasks.workunit.client.0.smithi090.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr:state without impacting any branches by switching back to a branch. 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr: git switch -c 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr:Or undo this operation with: 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr: git switch - 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:44:14.100 INFO:tasks.workunit.client.0.smithi090.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-04T12:44:14.101 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:44:14.101 INFO:tasks.workunit.client.0.smithi090.stderr:HEAD is now at 3aec390336f qa/d4n: Start redis up before rgw 2024-03-04T12:44:14.105 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-04T12:44:14.171 INFO:tasks.workunit.client.0.smithi090.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-04T12:44:14.173 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:44:14.173 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-04T12:44:14.247 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-04T12:44:14.296 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-04T12:44:14.334 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:44:14.336 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:44:14.336 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-04T12:44:14.375 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:44:14.378 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:44:14.378 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-04T12:44:14.447 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-03-04T12:44:14.448 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-03-04T12:44:14.448 DEBUG:teuthology.orchestra.run.smithi090:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-03-04T12:44:14.519 INFO:tasks.workunit.client.0.smithi090.stdout:INFO: fully qualified domain name: smithi090.front.sepia.ceph.com 2024-03-04T12:44:14.520 INFO:tasks.workunit.client.0.smithi090.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-03-04T12:44:14.520 INFO:tasks.workunit.client.0.smithi090.stdout:== TESTING NON-VERSIONED BUCKET == 2024-03-04T12:44:16.973 INFO:tasks.workunit.client.0.smithi090.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-04T12:44:17.194 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting pip 2024-03-04T12:44:17.200 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-04T12:44:17.247 INFO:tasks.workunit.client.0.smithi090.stdout:Installing collected packages: pip 2024-03-04T12:44:17.247 INFO:tasks.workunit.client.0.smithi090.stdout: Attempting uninstall: pip 2024-03-04T12:44:17.247 INFO:tasks.workunit.client.0.smithi090.stdout: Found existing installation: pip 21.2.3 2024-03-04T12:44:17.395 INFO:tasks.workunit.client.0.smithi090.stdout: Uninstalling pip-21.2.3: 2024-03-04T12:44:17.402 INFO:tasks.workunit.client.0.smithi090.stdout: Successfully uninstalled pip-21.2.3 2024-03-04T12:44:18.353 INFO:tasks.workunit.client.0.smithi090.stdout:Successfully installed pip-24.0 2024-03-04T12:44:19.204 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting boto3 2024-03-04T12:44:19.206 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached boto3-1.34.54-py3-none-any.whl.metadata (6.6 kB) 2024-03-04T12:44:19.746 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting botocore<1.35.0,>=1.34.54 (from boto3) 2024-03-04T12:44:19.747 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached botocore-1.34.54-py3-none-any.whl.metadata (5.7 kB) 2024-03-04T12:44:19.805 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-04T12:44:19.806 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-04T12:44:19.868 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-04T12:44:19.869 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-04T12:44:19.936 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:44:19.938 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-04T12:44:20.019 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:44:20.021 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-03-04T12:44:20.184 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:44:20.185 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-04T12:44:20.207 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached boto3-1.34.54-py3-none-any.whl (139 kB) 2024-03-04T12:44:20.209 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached botocore-1.34.54-py3-none-any.whl (12.0 MB) 2024-03-04T12:44:20.229 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-04T12:44:20.230 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-04T12:44:20.232 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-04T12:44:20.233 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-03-04T12:44:20.235 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-04T12:44:20.337 INFO:tasks.workunit.client.0.smithi090.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-04T12:44:21.369 INFO:tasks.workunit.client.0.smithi090.stdout:Successfully installed boto3-1.34.54 botocore-1.34.54 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-03-04T12:44:21.614 INFO:tasks.workunit.client.0.smithi090.stdout:INFO: creating user 2024-03-04T12:44:22.122 INFO:tasks.workunit.client.0.smithi090.stdout:{ 2024-03-04T12:44:22.122 INFO:tasks.workunit.client.0.smithi090.stdout: "user_id": "testid", 2024-03-04T12:44:22.122 INFO:tasks.workunit.client.0.smithi090.stdout: "display_name": "M. Tester", 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: "email": "tester@ceph.com", 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: "suspended": 0, 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: "max_buckets": 1000, 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: "subusers": [], 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: "keys": [ 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: { 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: "user": "testid", 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: "access_key": "0555b35654ad1656d804", 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: "active": true 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: } 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: ], 2024-03-04T12:44:22.123 INFO:tasks.workunit.client.0.smithi090.stdout: "swift_keys": [], 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "caps": [], 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "op_mask": "read, write, delete", 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "default_placement": "", 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "default_storage_class": "", 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "placement_tags": [], 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "bucket_quota": { 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "enabled": false, 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "max_size": -1, 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "max_objects": -1 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "user_quota": { 2024-03-04T12:44:22.124 INFO:tasks.workunit.client.0.smithi090.stdout: "enabled": false, 2024-03-04T12:44:22.125 INFO:tasks.workunit.client.0.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:44:22.125 INFO:tasks.workunit.client.0.smithi090.stdout: "max_size": -1, 2024-03-04T12:44:22.125 INFO:tasks.workunit.client.0.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:44:22.125 INFO:tasks.workunit.client.0.smithi090.stdout: "max_objects": -1 2024-03-04T12:44:22.125 INFO:tasks.workunit.client.0.smithi090.stdout: }, 2024-03-04T12:44:22.125 INFO:tasks.workunit.client.0.smithi090.stdout: "temp_url_keys": [], 2024-03-04T12:44:22.125 INFO:tasks.workunit.client.0.smithi090.stdout: "type": "rgw", 2024-03-04T12:44:22.125 INFO:tasks.workunit.client.0.smithi090.stdout: "mfa_ids": [] 2024-03-04T12:44:22.125 INFO:tasks.workunit.client.0.smithi090.stdout:} 2024-03-04T12:44:22.125 INFO:tasks.workunit.client.0.smithi090.stdout: 2024-03-04T12:44:28.445 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:28.445 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:28.475 INFO:tasks.workunit.client.0.smithi090.stderr:5+0 records in 2024-03-04T12:44:28.475 INFO:tasks.workunit.client.0.smithi090.stderr:5+0 records out 2024-03-04T12:44:28.475 INFO:tasks.workunit.client.0.smithi090.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0150786 s, 348 MB/s 2024-03-04T12:44:28.478 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:28.478 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:28.535 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:28.536 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:28.599 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:28.600 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:28.660 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:28.660 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:28.726 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:28.726 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:28.788 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:28.788 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:28.849 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:28.849 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:28.910 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:28.911 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:28.970 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:28.970 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:29.034 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:29.035 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:29.102 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:29.102 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:29.163 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:29.163 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:29.223 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:29.223 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:29.288 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:29.288 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:29.341 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:44:29.341 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:44:29.350 INFO:tasks.workunit.client.0.smithi090.stdout:bucket nams is reupload-bkt-103308 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:endpoint is https://smithi090.front.sepia.ceph.com:443 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:start UploadId=2~xnvehB56zeiPBm253K9DwD5v9hchPYq 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 1 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1} 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 1 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 2} 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1} 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1} 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1} 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1} 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1} 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1} 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1} 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1} 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1} 2024-03-04T12:44:29.351 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1} 2024-03-04T12:44:29.352 INFO:tasks.workunit.client.0.smithi090.stdout:phase 2 uploaded part {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1} 2024-03-04T12:44:29.352 INFO:tasks.workunit.client.0.smithi090.stdout:aborting multipart upload, parts=[{'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 1}, {'ETag': '"e85049839f03114ff3c3e39b779da11d"', 'PartNumber': 2}] 2024-03-04T12:44:30.324 INFO:tasks.workunit.client.0.smithi090.stdout:radosgw-admin bucket radoslist: 2024-03-04T12:44:30.383 INFO:tasks.workunit.client.0.smithi090.stdout:rados ls: 2024-03-04T12:44:30.398 INFO:tasks.workunit.client.0.smithi090.stdout:== PASSED == 2024-03-04T12:44:30.398 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:44:30.399 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:44:30.478 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-03-04T12:44:30.478 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-04T12:44:30.853 DEBUG:teuthology.parallel:result is None 2024-03-04T12:44:30.853 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:44:30.893 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:44:30.894 DEBUG:teuthology.orchestra.run.smithi090:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:44:30.960 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:44:30.960 INFO:teuthology.run_tasks:Running task ragweed... 2024-03-04T12:44:30.974 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-03-04T12:44:30.974 INFO:tasks.ragweed:Downloading ragweed... 2024-03-04T12:44:30.975 INFO:tasks.ragweed:Using branch 'wip-rgw-d4n' for ragweed 2024-03-04T12:44:30.975 DEBUG:teuthology.orchestra.run.smithi090:> git clone -b wip-rgw-d4n https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-03-04T12:44:31.027 INFO:teuthology.orchestra.run.smithi090.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-03-04T12:44:31.072 INFO:teuthology.orchestra.run.smithi090.stderr:fatal: Remote branch wip-rgw-d4n not found in upstream origin 2024-03-04T12:44:31.073 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-03-04T12:44:31.074 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-03-04T12:44:31.074 DEBUG:teuthology.orchestra.run.smithi090:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-03-04T12:44:31.142 INFO:teuthology.orchestra.run.smithi090.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-03-04T12:44:31.299 INFO:tasks.ragweed:Creating rgw users... 2024-03-04T12:44:31.300 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-03-04T12:44:31.300 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key OJIFRVNHHEVAVVJRESZY --secret ovYPFKrdHm+WCQCYR2wyE55UngMRnmgFtf6CQBIiqD3+jsmu8/rohQ== --email ragweed.client.0+test@test.test --system false 2024-03-04T12:44:31.403 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:44:31.403 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:44:31.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.428+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.430+0000 7f3e77730800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.430+0000 7f3e77730800 20 realm 2024-03-04T12:44:31.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.430+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.430+0000 7f3e77730800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.430+0000 7f3e77730800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:44:31.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.430+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.430+0000 7f3e77730800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.430+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.431+0000 7f3e77730800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:44:31.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.431+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.432+0000 7f3e77730800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:44:31.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.432+0000 7f3e77730800 20 searching for the correct realm 2024-03-04T12:44:31.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.435+0000 7f3e734c2640 0 -- 172.21.15.90:0/1491710347 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f3e6c0199c0 msgr2=0x7f3e6c029440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:44:31.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.439+0000 7f3e734c2640 0 -- 172.21.15.90:0/1491710347 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f3e64049410 msgr2=0x7f3e64049870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:44:31.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.443+0000 7f3e77730800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:44:31.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.443+0000 7f3e77730800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:44:31.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.443+0000 7f3e77730800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:44:31.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.443+0000 7f3e77730800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:44:31.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.443+0000 7f3e77730800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:44:31.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.443+0000 7f3e77730800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:44:31.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.443+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.444+0000 7f3e77730800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.444+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.444+0000 7f3e77730800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.444+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.444+0000 7f3e77730800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.444+0000 7f3e77730800 20 zone default found 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.444+0000 7f3e77730800 4 Realm: () 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.444+0000 7f3e77730800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.444+0000 7f3e77730800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.444+0000 7f3e77730800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.444+0000 7f3e77730800 20 zonegroup default 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.444+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.445+0000 7f3e77730800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.445+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.445+0000 7f3e77730800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.445+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.445+0000 7f3e77730800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.445+0000 7f3e77730800 20 started sync module instance, tier type = 2024-03-04T12:44:31.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.445+0000 7f3e77730800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:44:31.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.454+0000 7f3e77730800 20 add_watcher() i=0 2024-03-04T12:44:31.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.454+0000 7f3e77730800 20 add_watcher() i=1 2024-03-04T12:44:31.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.454+0000 7f3e77730800 20 add_watcher() i=2 2024-03-04T12:44:31.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.454+0000 7f3e77730800 20 add_watcher() i=3 2024-03-04T12:44:31.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.454+0000 7f3e77730800 20 add_watcher() i=4 2024-03-04T12:44:31.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.454+0000 7f3e77730800 20 add_watcher() i=5 2024-03-04T12:44:31.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.454+0000 7f3e77730800 20 add_watcher() i=6 2024-03-04T12:44:31.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.455+0000 7f3e77730800 20 add_watcher() i=7 2024-03-04T12:44:31.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.455+0000 7f3e77730800 2 all 8 watchers are set, enabling cache 2024-03-04T12:44:31.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.457+0000 7f3d29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:44:31.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.457+0000 7f3e77730800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:44:31.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.457+0000 7f3e77730800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:44:31.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.457+0000 7f3e77730800 5 note: GC not initialized 2024-03-04T12:44:31.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.457+0000 7f3d28fe1640 20 reqs_thread_entry: start 2024-03-04T12:44:31.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.458+0000 7f3e77730800 20 init_complete bucket index max shards: 11 2024-03-04T12:44:31.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.458+0000 7f3e77730800 20 Filter name: none 2024-03-04T12:44:31.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.458+0000 7f3ca27fc640 20 reqs_thread_entry: start 2024-03-04T12:44:31.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.458+0000 7f3e77730800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-03-04T12:44:31.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.458+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.458+0000 7f3e77730800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.458+0000 7f3e77730800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-03-04T12:44:31.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.458+0000 7f3e77730800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-04T12:44:31.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.458+0000 7f3e77730800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-03-04T12:44:31.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.458+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.459+0000 7f3e77730800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.459+0000 7f3e77730800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-03-04T12:44:31.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.459+0000 7f3e77730800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-04T12:44:31.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.459+0000 7f3e77730800 10 cache get: name=default.rgw.meta+users.keys+OJIFRVNHHEVAVVJRESZY : miss 2024-03-04T12:44:31.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.459+0000 7f3e77730800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.459+0000 7f3e77730800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.459+0000 7f3e77730800 10 cache put: name=default.rgw.meta+users.keys+OJIFRVNHHEVAVVJRESZY info.flags=0x0 2024-03-04T12:44:31.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.459+0000 7f3e77730800 10 adding default.rgw.meta+users.keys+OJIFRVNHHEVAVVJRESZY to cache LRU end 2024-03-04T12:44:31.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.459+0000 7f3e77730800 10 cache get: name=default.rgw.meta+users.keys+OJIFRVNHHEVAVVJRESZY : hit (negative entry) 2024-03-04T12:44:31.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.459+0000 7f3e77730800 10 cache get: name=default.rgw.meta+users.keys+OJIFRVNHHEVAVVJRESZY : hit (negative entry) 2024-03-04T12:44:31.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.460+0000 7f3e77730800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-03-04T12:44:31.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.460+0000 7f3e77730800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-04T12:44:31.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.460+0000 7f3e77730800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-03-04T12:44:31.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.460+0000 7f3d56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1047972020242 cookie 94351075709504 notifier 5606 bl.length()=642 2024-03-04T12:44:31.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.460+0000 7f3d56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-03-04T12:44:31.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.460+0000 7f3d56ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-04T12:44:31.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.462+0000 7f3e77730800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-03-04T12:44:31.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.462+0000 7f3e77730800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-04T12:44:31.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.462+0000 7f3e77730800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-03-04T12:44:31.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.463+0000 7f3d56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1047972020233 cookie 94351075702720 notifier 5606 bl.length()=202 2024-03-04T12:44:31.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.463+0000 7f3d56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-03-04T12:44:31.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.463+0000 7f3d56ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-04T12:44:31.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.464+0000 7f3e77730800 10 cache put: name=default.rgw.meta+users.keys+OJIFRVNHHEVAVVJRESZY info.flags=0x7 2024-03-04T12:44:31.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.464+0000 7f3e77730800 10 moving default.rgw.meta+users.keys+OJIFRVNHHEVAVVJRESZY to cache LRU end 2024-03-04T12:44:31.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.464+0000 7f3e77730800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJIFRVNHHEVAVVJRESZY, ofs0, ns] 2024-03-04T12:44:31.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.464+0000 7f3d567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1047972020243 cookie 94351075698304 notifier 5606 bl.length()=190 2024-03-04T12:44:31.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.464+0000 7f3d567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJIFRVNHHEVAVVJRESZY info.flags=0x7 2024-03-04T12:44:31.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.464+0000 7f3d567fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJIFRVNHHEVAVVJRESZY to cache LRU end 2024-03-04T12:44:31.471 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T12:44:31.471 INFO:teuthology.orchestra.run.smithi090.stdout: "user_id": "ragweed.client.0", 2024-03-04T12:44:31.471 INFO:teuthology.orchestra.run.smithi090.stdout: "display_name": "Mr. ragweed.client.0", 2024-03-04T12:44:31.471 INFO:teuthology.orchestra.run.smithi090.stdout: "email": "ragweed.client.0+test@test.test", 2024-03-04T12:44:31.471 INFO:teuthology.orchestra.run.smithi090.stdout: "suspended": 0, 2024-03-04T12:44:31.471 INFO:teuthology.orchestra.run.smithi090.stdout: "max_buckets": 1000, 2024-03-04T12:44:31.471 INFO:teuthology.orchestra.run.smithi090.stdout: "subusers": [], 2024-03-04T12:44:31.471 INFO:teuthology.orchestra.run.smithi090.stdout: "keys": [ 2024-03-04T12:44:31.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:44:31.471 INFO:teuthology.orchestra.run.smithi090.stdout: "user": "ragweed.client.0", 2024-03-04T12:44:31.471 INFO:teuthology.orchestra.run.smithi090.stdout: "access_key": "OJIFRVNHHEVAVVJRESZY", 2024-03-04T12:44:31.471 INFO:teuthology.orchestra.run.smithi090.stdout: "secret_key": "ovYPFKrdHm+WCQCYR2wyE55UngMRnmgFtf6CQBIiqD3+jsmu8/rohQ==", 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: "active": true 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: "swift_keys": [], 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": [], 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: "op_mask": "read, write, delete", 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: "default_placement": "", 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: "default_storage_class": "", 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: "placement_tags": [], 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: "bucket_quota": { 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:44:31.472 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: "user_quota": { 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: "temp_url_keys": [], 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "rgw", 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: "mfa_ids": [] 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T12:44:31.473 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:44:31.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.466+0000 7f3d29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:44:31.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.468+0000 7f3e77730800 20 remove_watcher() i=0 2024-03-04T12:44:31.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.468+0000 7f3e77730800 2 removed watcher, disabling cache 2024-03-04T12:44:31.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.469+0000 7f3e77730800 20 remove_watcher() i=1 2024-03-04T12:44:31.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.470+0000 7f3e77730800 20 remove_watcher() i=2 2024-03-04T12:44:31.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.471+0000 7f3e77730800 20 remove_watcher() i=3 2024-03-04T12:44:31.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.472+0000 7f3e77730800 20 remove_watcher() i=4 2024-03-04T12:44:31.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.473+0000 7f3e77730800 20 remove_watcher() i=5 2024-03-04T12:44:31.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.474+0000 7f3e77730800 20 remove_watcher() i=6 2024-03-04T12:44:31.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.475+0000 7f3e77730800 20 remove_watcher() i=7 2024-03-04T12:44:31.490 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-03-04T12:44:31.491 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ZHJATEDWFDOGZAJBEZRW --secret IC0hqsK7L2VPd4JUzaYJ2cDBpN+JteH+MIsnH/ZY4P8qWZecZqCgEA== --email sysuser.client.0+test@test.test --system true 2024-03-04T12:44:31.554 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:44:31.554 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:44:31.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.579+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.581+0000 7fba4dc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.581+0000 7fba4dc12800 20 realm 2024-03-04T12:44:31.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.581+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.581+0000 7fba4dc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.581+0000 7fba4dc12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:44:31.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.581+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.581+0000 7fba4dc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.581+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.582+0000 7fba4dc12800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:44:31.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.582+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.583+0000 7fba4dc12800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:44:31.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.583+0000 7fba4dc12800 20 searching for the correct realm 2024-03-04T12:44:31.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.586+0000 7fba49b5f640 0 -- 172.21.15.90:0/3313340684 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x5567f1c53350 msgr2=0x7fba3c0bfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:44:31.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.793+0000 7fba4935e640 0 -- 172.21.15.90:0/3313340684 >> [v2:172.21.15.184:6824/1880219084,v1:172.21.15.184:6825/1880219084] conn(0x5567f1d9d940 msgr2=0x5567f1d9fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:44:31.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.795+0000 7fba4dc12800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:44:31.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.795+0000 7fba4dc12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:44:31.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.795+0000 7fba4dc12800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:44:31.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.795+0000 7fba4dc12800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:44:31.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.795+0000 7fba4dc12800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:44:31.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.795+0000 7fba4dc12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:44:31.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.795+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.796+0000 7fba4dc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.796+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.796+0000 7fba4dc12800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:44:31.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.796+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.796+0000 7fba4dc12800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:44:31.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.796+0000 7fba4dc12800 20 zone default found 2024-03-04T12:44:31.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.796+0000 7fba4dc12800 4 Realm: () 2024-03-04T12:44:31.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.796+0000 7fba4dc12800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:44:31.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.796+0000 7fba4dc12800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:44:31.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.796+0000 7fba4dc12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:44:31.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.796+0000 7fba4dc12800 20 zonegroup default 2024-03-04T12:44:31.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.796+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.797+0000 7fba4dc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.797+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.797+0000 7fba4dc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.797+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.797+0000 7fba4dc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.797+0000 7fba4dc12800 20 started sync module instance, tier type = 2024-03-04T12:44:31.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.797+0000 7fba4dc12800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:44:31.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.806+0000 7fba4dc12800 20 add_watcher() i=0 2024-03-04T12:44:31.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.806+0000 7fba4dc12800 20 add_watcher() i=1 2024-03-04T12:44:31.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.806+0000 7fba4dc12800 20 add_watcher() i=2 2024-03-04T12:44:31.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.806+0000 7fba4dc12800 20 add_watcher() i=3 2024-03-04T12:44:31.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.806+0000 7fba4dc12800 20 add_watcher() i=4 2024-03-04T12:44:31.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.806+0000 7fba4dc12800 20 add_watcher() i=5 2024-03-04T12:44:31.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.806+0000 7fba4dc12800 20 add_watcher() i=6 2024-03-04T12:44:31.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.807+0000 7fba4dc12800 20 add_watcher() i=7 2024-03-04T12:44:31.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.807+0000 7fba4dc12800 2 all 8 watchers are set, enabling cache 2024-03-04T12:44:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.809+0000 7fb8ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:44:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.809+0000 7fba4dc12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:44:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.809+0000 7fba4dc12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:44:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.809+0000 7fba4dc12800 5 note: GC not initialized 2024-03-04T12:44:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.809+0000 7fb8fe7e4640 20 reqs_thread_entry: start 2024-03-04T12:44:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.809+0000 7fba4dc12800 20 init_complete bucket index max shards: 11 2024-03-04T12:44:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.809+0000 7fba4dc12800 20 Filter name: none 2024-03-04T12:44:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.809+0000 7fb86ffff640 20 reqs_thread_entry: start 2024-03-04T12:44:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.809+0000 7fba4dc12800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-03-04T12:44:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.809+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.810+0000 7fba4dc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.810+0000 7fba4dc12800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-03-04T12:44:31.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.810+0000 7fba4dc12800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-04T12:44:31.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.810+0000 7fba4dc12800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-03-04T12:44:31.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.810+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.810+0000 7fba4dc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.810+0000 7fba4dc12800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-03-04T12:44:31.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.810+0000 7fba4dc12800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-04T12:44:31.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.810+0000 7fba4dc12800 10 cache get: name=default.rgw.meta+users.keys+ZHJATEDWFDOGZAJBEZRW : miss 2024-03-04T12:44:31.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.810+0000 7fba4dc12800 20 rados->read ofs=0 len=0 2024-03-04T12:44:31.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.811+0000 7fba4dc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:44:31.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.811+0000 7fba4dc12800 10 cache put: name=default.rgw.meta+users.keys+ZHJATEDWFDOGZAJBEZRW info.flags=0x0 2024-03-04T12:44:31.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.811+0000 7fba4dc12800 10 adding default.rgw.meta+users.keys+ZHJATEDWFDOGZAJBEZRW to cache LRU end 2024-03-04T12:44:31.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.811+0000 7fba4dc12800 10 cache get: name=default.rgw.meta+users.keys+ZHJATEDWFDOGZAJBEZRW : hit (negative entry) 2024-03-04T12:44:31.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.811+0000 7fba4dc12800 10 cache get: name=default.rgw.meta+users.keys+ZHJATEDWFDOGZAJBEZRW : hit (negative entry) 2024-03-04T12:44:31.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.812+0000 7fba4dc12800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-03-04T12:44:31.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.812+0000 7fba4dc12800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-04T12:44:31.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.812+0000 7fba4dc12800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-03-04T12:44:31.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.812+0000 7fb92cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1047972020234 cookie 93904927628592 notifier 5925 bl.length()=642 2024-03-04T12:44:31.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.812+0000 7fb92cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-03-04T12:44:31.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.812+0000 7fb92cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-04T12:44:31.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.814+0000 7fba4dc12800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-03-04T12:44:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.814+0000 7fba4dc12800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-04T12:44:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.814+0000 7fba4dc12800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-03-04T12:44:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.814+0000 7fb92cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1047972020244 cookie 93904927629648 notifier 5925 bl.length()=202 2024-03-04T12:44:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.814+0000 7fb92cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-03-04T12:44:31.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.814+0000 7fb92cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-04T12:44:31.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.816+0000 7fba4dc12800 10 cache put: name=default.rgw.meta+users.keys+ZHJATEDWFDOGZAJBEZRW info.flags=0x7 2024-03-04T12:44:31.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.816+0000 7fba4dc12800 10 moving default.rgw.meta+users.keys+ZHJATEDWFDOGZAJBEZRW to cache LRU end 2024-03-04T12:44:31.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.816+0000 7fba4dc12800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:ZHJATEDWFDOGZAJBEZRW, ofs0, ns] 2024-03-04T12:44:31.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.817+0000 7fb91bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1047972020235 cookie 93904927628592 notifier 5925 bl.length()=190 2024-03-04T12:44:31.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.817+0000 7fb91bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZHJATEDWFDOGZAJBEZRW info.flags=0x7 2024-03-04T12:44:31.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.817+0000 7fb91bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZHJATEDWFDOGZAJBEZRW to cache LRU end 2024-03-04T12:44:31.823 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T12:44:31.823 INFO:teuthology.orchestra.run.smithi090.stdout: "user_id": "sysuser.client.0", 2024-03-04T12:44:31.823 INFO:teuthology.orchestra.run.smithi090.stdout: "display_name": "Mr. sysuser.client.0", 2024-03-04T12:44:31.823 INFO:teuthology.orchestra.run.smithi090.stdout: "email": "sysuser.client.0+test@test.test", 2024-03-04T12:44:31.823 INFO:teuthology.orchestra.run.smithi090.stdout: "suspended": 0, 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: "max_buckets": 1000, 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: "subusers": [], 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: "keys": [ 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: "user": "sysuser.client.0", 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: "access_key": "ZHJATEDWFDOGZAJBEZRW", 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: "secret_key": "IC0hqsK7L2VPd4JUzaYJ2cDBpN+JteH+MIsnH/ZY4P8qWZecZqCgEA==", 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: "active": true 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: "swift_keys": [], 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": [], 2024-03-04T12:44:31.824 INFO:teuthology.orchestra.run.smithi090.stdout: "op_mask": "read, write, delete", 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "system": true, 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "default_placement": "", 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "default_storage_class": "", 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "placement_tags": [], 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "bucket_quota": { 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "user_quota": { 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:44:31.825 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:44:31.826 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:44:31.826 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:44:31.826 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:44:31.826 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:44:31.826 INFO:teuthology.orchestra.run.smithi090.stdout: "temp_url_keys": [], 2024-03-04T12:44:31.826 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "rgw", 2024-03-04T12:44:31.826 INFO:teuthology.orchestra.run.smithi090.stdout: "mfa_ids": [] 2024-03-04T12:44:31.826 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T12:44:31.826 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:44:31.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.818+0000 7fb8ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:44:31.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.821+0000 7fba4dc12800 20 remove_watcher() i=0 2024-03-04T12:44:31.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.821+0000 7fba4dc12800 2 removed watcher, disabling cache 2024-03-04T12:44:31.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.822+0000 7fba4dc12800 20 remove_watcher() i=1 2024-03-04T12:44:31.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.823+0000 7fba4dc12800 20 remove_watcher() i=2 2024-03-04T12:44:31.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.824+0000 7fba4dc12800 20 remove_watcher() i=3 2024-03-04T12:44:31.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.825+0000 7fba4dc12800 20 remove_watcher() i=4 2024-03-04T12:44:31.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.826+0000 7fba4dc12800 20 remove_watcher() i=5 2024-03-04T12:44:31.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.827+0000 7fba4dc12800 20 remove_watcher() i=6 2024-03-04T12:44:31.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:44:31.828+0000 7fba4dc12800 20 remove_watcher() i=7 2024-03-04T12:44:31.843 INFO:tasks.ragweed:Configuring ragweed... 2024-03-04T12:44:31.843 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:44:31.843 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-03-04T12:44:31.870 INFO:tasks.ragweed:Configuring boto... 2024-03-04T12:44:31.870 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:44:31.871 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-03-04T12:44:31.937 DEBUG:teuthology.orchestra.run.smithi090:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-03-04T12:44:32.112 INFO:teuthology.orchestra.run.smithi090.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-03-04T12:44:32.296 INFO:teuthology.orchestra.run.smithi090.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-03-04T12:44:32.770 INFO:teuthology.orchestra.run.smithi090.stdout:py installdeps: -rrequirements.txt 2024-03-04T12:44:40.578 INFO:teuthology.orchestra.run.smithi090.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-03-04T12:44:42.786 INFO:teuthology.orchestra.run.smithi090.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2021.10.8,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-299/tmp/wheel/cockpit-299-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.0,execnet==2.0.2,file-magic==0.4.0,gevent==24.2.1,google-auth==2.28.0,gpg==1.15.1,greenlet==3.0.3,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.4.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.1.0,python-dateutil==2.8.1,python-linux-procfs==0.7.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=e17b6ab450bbe60a3f3e86242e2a29cc15b149e61f3a412b0a51ebcb05d07eaf,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.5,sepolicy==3.5,setools==4.4.3,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,sos==4.3,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.4.0,urllib3==1.26.5,WebOb==1.8.7,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==6.2 2024-03-04T12:44:42.787 INFO:teuthology.orchestra.run.smithi090.stdout:py run-test-pre: PYTHONHASHSEED='4249275627' 2024-03-04T12:44:42.787 INFO:teuthology.orchestra.run.smithi090.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-03-04T12:44:42.995 INFO:teuthology.orchestra.run.smithi090.stdout:============================= test session starts ============================== 2024-03-04T12:44:42.996 INFO:teuthology.orchestra.run.smithi090.stdout:platform linux -- Python 3.9.17, pytest-8.1.0, pluggy-1.4.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-03-04T12:44:42.996 INFO:teuthology.orchestra.run.smithi090.stdout:cachedir: .tox/py/.pytest_cache 2024-03-04T12:44:42.996 INFO:teuthology.orchestra.run.smithi090.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-03-04T12:44:42.996 INFO:teuthology.orchestra.run.smithi090.stdout:configfile: pytest.ini 2024-03-04T12:44:43.101 INFO:teuthology.orchestra.run.smithi090.stdout:collecting ... collected 9 items 2024-03-04T12:44:43.101 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:44:45.453 INFO:teuthology.orchestra.run.smithi090.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-03-04T12:44:46.301 INFO:teuthology.orchestra.run.smithi090.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-03-04T12:44:47.090 INFO:teuthology.orchestra.run.smithi090.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-03-04T12:44:47.976 INFO:teuthology.orchestra.run.smithi090.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-03-04T12:44:48.791 INFO:teuthology.orchestra.run.smithi090.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-03-04T12:44:55.234 INFO:teuthology.orchestra.run.smithi090.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-03-04T12:44:56.946 INFO:teuthology.orchestra.run.smithi090.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-03-04T12:44:59.218 INFO:teuthology.orchestra.run.smithi090.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-03-04T12:45:02.510 INFO:teuthology.orchestra.run.smithi090.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-03-04T12:45:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:45:02.511 INFO:teuthology.orchestra.run.smithi090.stdout:=============================== warnings summary =============================== 2024-03-04T12:45:02.511 INFO:teuthology.orchestra.run.smithi090.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-03-04T12:45:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-03-04T12:45:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: import imp 2024-03-04T12:45:02.511 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:45:02.511 INFO:teuthology.orchestra.run.smithi090.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-03-04T12:45:02.511 INFO:teuthology.orchestra.run.smithi090.stdout:======================== 9 passed, 1 warning in 19.51s ========================= 2024-03-04T12:45:02.544 INFO:teuthology.orchestra.run.smithi090.stdout:___________________________________ summary ____________________________________ 2024-03-04T12:45:02.544 INFO:teuthology.orchestra.run.smithi090.stdout: py: commands succeeded 2024-03-04T12:45:02.544 INFO:teuthology.orchestra.run.smithi090.stdout: congratulations :) 2024-03-04T12:45:02.557 INFO:tasks.ragweed:Cleaning up boto... 2024-03-04T12:45:02.558 DEBUG:teuthology.orchestra.run.smithi090:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-03-04T12:45:02.585 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-03-04T12:45:02.679 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:45:02.679 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:45:02.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.702+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.703+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:02.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.703+0000 7f2cf692d800 20 realm 2024-03-04T12:45:02.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.703+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.703+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:02.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.703+0000 7f2cf692d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:45:02.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.703+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.704+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:02.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.704+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.704+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:45:02.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.704+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.705+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:45:02.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.705+0000 7f2cf692d800 20 searching for the correct realm 2024-03-04T12:45:02.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.708+0000 7f2cf257a640 0 -- 172.21.15.90:0/527339221 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f2cec05dde0 msgr2=0x7f2cec05ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:45:02.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.712+0000 7f2cf257a640 0 -- 172.21.15.90:0/527339221 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f2ce4096930 msgr2=0x7f2ce4093390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:45:02.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.918+0000 7f2cf692d800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:45:02.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.918+0000 7f2cf692d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:45:02.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.918+0000 7f2cf692d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:45:02.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.918+0000 7f2cf692d800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:45:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.918+0000 7f2cf692d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:45:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.918+0000 7f2cf692d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:45:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.918+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:45:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:45:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 20 zone default found 2024-03-04T12:45:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 4 Realm: () 2024-03-04T12:45:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:45:02.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:45:02.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:45:02.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 20 zonegroup default 2024-03-04T12:45:02.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.919+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:02.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.920+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.920+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:02.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.920+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.920+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:02.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.920+0000 7f2cf692d800 20 started sync module instance, tier type = 2024-03-04T12:45:02.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.920+0000 7f2cf692d800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:45:02.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.930+0000 7f2cf692d800 20 add_watcher() i=0 2024-03-04T12:45:02.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.930+0000 7f2cf692d800 20 add_watcher() i=1 2024-03-04T12:45:02.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.930+0000 7f2cf692d800 20 add_watcher() i=2 2024-03-04T12:45:02.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.930+0000 7f2cf692d800 20 add_watcher() i=3 2024-03-04T12:45:02.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.930+0000 7f2cf692d800 20 add_watcher() i=4 2024-03-04T12:45:02.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.930+0000 7f2cf692d800 20 add_watcher() i=5 2024-03-04T12:45:02.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.930+0000 7f2cf692d800 20 add_watcher() i=6 2024-03-04T12:45:02.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.931+0000 7f2cf692d800 20 add_watcher() i=7 2024-03-04T12:45:02.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.931+0000 7f2cf692d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:45:02.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.933+0000 7f2ba8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:45:02.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.933+0000 7f2cf692d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:45:02.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.933+0000 7f2cf692d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:45:02.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.970+0000 7f2b237fe640 20 reqs_thread_entry: start 2024-03-04T12:45:02.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.970+0000 7f2cf692d800 20 init_complete bucket index max shards: 11 2024-03-04T12:45:02.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.970+0000 7f2cf692d800 20 Filter name: none 2024-03-04T12:45:02.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.970+0000 7f2b217fa640 20 reqs_thread_entry: start 2024-03-04T12:45:02.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.970+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-03-04T12:45:02.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.970+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.971+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=453 2024-03-04T12:45:02.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.971+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-03-04T12:45:02.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.971+0000 7f2cf692d800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-04T12:45:02.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.971+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:02.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.971+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4 : miss 2024-03-04T12:45:02.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.971+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:02.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.972+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:45:02.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.972+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4 info.flags=0x17 2024-03-04T12:45:02.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.972+0000 7f2cf692d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4 to cache LRU end 2024-03-04T12:45:02.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.972+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:02.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.972+0000 7f2cf692d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:45:02.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.972+0000 7f2cf692d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4 2024-03-04T12:45:02.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.972+0000 7f2cf692d800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-03-04T12:45:02.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.973+0000 7f2cf692d800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-03-04T12:45:02.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.973+0000 7f2cf692d800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-03-04T12:45:02.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.973+0000 7f2cf692d800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-03-04T12:45:02.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.974+0000 7f2cf692d800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-03-04T12:45:02.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.974+0000 7f2cf692d800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-03-04T12:45:02.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.974+0000 7f2cf692d800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-03-04T12:45:02.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.974+0000 7f2cf692d800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-03-04T12:45:02.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.975+0000 7f2cf692d800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-03-04T12:45:02.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.976+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0576c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x56189e4a9388 s->prefetch_data=0 2024-03-04T12:45:02.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.976+0000 7f2cf692d800 10 manifest: total_size = 5215 2024-03-04T12:45:02.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.976+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4448641747401922174 2024-03-04T12:45:02.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.976+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0576c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x56189e4a9388 s->prefetch_data=0 2024-03-04T12:45:02.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.976+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e4a9388 2024-03-04T12:45:02.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.976+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4.1 2024-03-04T12:45:02.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.978+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:02.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.978+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5215 stripe_ofs=5215 part_ofs=0 rule->part_size=0 2024-03-04T12:45:02.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.978+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4448641747401922174 2024-03-04T12:45:02.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.978+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:02.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.978+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.J748fjT5QAbLHvVWDtti4bHasRTtQti_0 2024-03-04T12:45:02.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.978+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-04T12:45:02.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.978+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:02.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.978+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4448641747401922174 2024-03-04T12:45:02.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.979+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-03-04T12:45:02.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.979+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0576c0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x56189e431598 s->prefetch_data=0 2024-03-04T12:45:02.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.980+0000 7f2cf692d800 10 manifest: total_size = 4807 2024-03-04T12:45:02.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.980+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14046541780323815699 2024-03-04T12:45:02.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.980+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0576c0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x56189e431598 s->prefetch_data=0 2024-03-04T12:45:02.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.980+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e431598 2024-03-04T12:45:02.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.980+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4.2 2024-03-04T12:45:02.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.982+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:02.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.982+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4807 stripe_ofs=4807 part_ofs=0 rule->part_size=0 2024-03-04T12:45:02.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.982+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14046541780323815699 2024-03-04T12:45:02.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.982+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:02.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.982+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.QvLPxx3ohpFWrh1oHGqbuVCDzhSowOS_0 2024-03-04T12:45:02.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.982+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-04T12:45:02.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.982+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:02.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.982+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14046541780323815699 2024-03-04T12:45:02.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.983+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-03-04T12:45:02.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.983+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0576c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x56189e431598 s->prefetch_data=0 2024-03-04T12:45:02.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.984+0000 7f2cf692d800 10 manifest: total_size = 4961 2024-03-04T12:45:02.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.984+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6033768491510279195 2024-03-04T12:45:02.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.984+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0576c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x56189e431598 s->prefetch_data=0 2024-03-04T12:45:02.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.984+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e431598 2024-03-04T12:45:02.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.984+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4.2 2024-03-04T12:45:02.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.987+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:02.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.987+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4961 stripe_ofs=4961 part_ofs=0 rule->part_size=0 2024-03-04T12:45:02.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.987+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6033768491510279195 2024-03-04T12:45:02.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.987+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:02.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.987+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.5WPt-YN2-791oooY5CdXVBcNPaf5vI-_0 2024-03-04T12:45:02.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.987+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-04T12:45:02.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.987+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:02.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.987+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6033768491510279195 2024-03-04T12:45:02.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.988+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-03-04T12:45:02.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.988+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0576c0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x56189e431578 s->prefetch_data=0 2024-03-04T12:45:02.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.989+0000 7f2cf692d800 10 manifest: total_size = 7447 2024-03-04T12:45:02.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.989+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13243424865187786640 2024-03-04T12:45:02.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.989+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0576c0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x56189e431578 s->prefetch_data=0 2024-03-04T12:45:02.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.989+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e431578 2024-03-04T12:45:02.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.989+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4.3 2024-03-04T12:45:02.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.991+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:02.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.991+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=7447 stripe_ofs=7447 part_ofs=0 rule->part_size=0 2024-03-04T12:45:02.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.991+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13243424865187786640 2024-03-04T12:45:02.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.991+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:02.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.991+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.ebXzYELir-4-akVpDrRtsQDJkUSlmuZ_0 2024-03-04T12:45:02.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.991+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-04T12:45:02.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.991+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.991+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13243424865187786640 2024-03-04T12:45:03.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.993+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-03-04T12:45:03.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.993+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05cb60 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x56189e431578 s->prefetch_data=0 2024-03-04T12:45:03.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.993+0000 7f2cf692d800 10 manifest: total_size = 7555 2024-03-04T12:45:03.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.993+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13075715566042930173 2024-03-04T12:45:03.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.993+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05cb60 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x56189e431578 s->prefetch_data=0 2024-03-04T12:45:03.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.993+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e431578 2024-03-04T12:45:03.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.993+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4.4 2024-03-04T12:45:03.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.995+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.995+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=7555 stripe_ofs=7555 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.995+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13075715566042930173 2024-03-04T12:45:03.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.995+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.995+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.WCqYnZjfsAla1DxEAlUVdYWB-hX5ojB_0 2024-03-04T12:45:03.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.995+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-04T12:45:03.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.995+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.995+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13075715566042930173 2024-03-04T12:45:03.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.997+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-03-04T12:45:03.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.997+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0576c0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x56189e431548 s->prefetch_data=0 2024-03-04T12:45:03.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.997+0000 7f2cf692d800 10 manifest: total_size = 7544 2024-03-04T12:45:03.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.997+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14137185255432477116 2024-03-04T12:45:03.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.997+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0576c0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x56189e431548 s->prefetch_data=0 2024-03-04T12:45:03.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.997+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e431548 2024-03-04T12:45:03.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.997+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4.4 2024-03-04T12:45:03.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.999+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.999+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=7544 stripe_ofs=7544 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.999+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14137185255432477116 2024-03-04T12:45:03.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.999+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.999+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.tK9zWgmLNnLM6hYko-Gbk5chnI8rsqP_0 2024-03-04T12:45:03.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.999+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-04T12:45:03.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.999+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:02.999+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14137185255432477116 2024-03-04T12:45:03.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.000+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-03-04T12:45:03.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.001+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc07aa10 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x56189e431508 s->prefetch_data=0 2024-03-04T12:45:03.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.001+0000 7f2cf692d800 10 manifest: total_size = 12654 2024-03-04T12:45:03.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.001+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.129809551865370974 2024-03-04T12:45:03.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.001+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc07aa10 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x56189e431508 s->prefetch_data=0 2024-03-04T12:45:03.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.001+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e431508 2024-03-04T12:45:03.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.001+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4.5 2024-03-04T12:45:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.003+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.003+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=12654 stripe_ofs=12654 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.003+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.129809551865370974 2024-03-04T12:45:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.003+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.003+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.SSEGmEjVRaFIdD2oorbgHtSemygKDC-_0 2024-03-04T12:45:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.003+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-03-04T12:45:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.003+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.003+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.129809551865370974 2024-03-04T12:45:03.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.004+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-03-04T12:45:03.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.005+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0576c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x56189e431508 s->prefetch_data=0 2024-03-04T12:45:03.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.005+0000 7f2cf692d800 10 manifest: total_size = 5093 2024-03-04T12:45:03.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.005+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.374907358464523883 2024-03-04T12:45:03.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.005+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0576c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x56189e431508 s->prefetch_data=0 2024-03-04T12:45:03.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.005+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e431508 2024-03-04T12:45:03.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.005+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4.7 2024-03-04T12:45:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.007+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.007+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5093 stripe_ofs=5093 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.007+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.374907358464523883 2024-03-04T12:45:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.007+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.007+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.QrjivzhUjPMQvbweoLD0uMvWQnyd5Qf_0 2024-03-04T12:45:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.007+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-03-04T12:45:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.007+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.007+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.374907358464523883 2024-03-04T12:45:03.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.008+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-03-04T12:45:03.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.008+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc07aa10 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x56189e431508 s->prefetch_data=0 2024-03-04T12:45:03.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.009+0000 7f2cf692d800 10 manifest: total_size = 38008 2024-03-04T12:45:03.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.009+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4644290029589540113 2024-03-04T12:45:03.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.009+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc07aa10 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x56189e431508 s->prefetch_data=0 2024-03-04T12:45:03.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.009+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e431508 2024-03-04T12:45:03.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.009+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4.8 2024-03-04T12:45:03.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.011+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.011+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=38008 stripe_ofs=38008 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.011+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4644290029589540113 2024-03-04T12:45:03.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.011+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.011+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.wg3JgjKuH18qYmgLB7my2o0Z67ZefLj_0 2024-03-04T12:45:03.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.011+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-04T12:45:03.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.011+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.011+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4644290029589540113 2024-03-04T12:45:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.012+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-03-04T12:45:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.012+0000 7f2cf692d800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:45:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.012+0000 7f2cf692d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:45:03.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.013+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:45:03.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.013+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:45:03.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.013+0000 7f2cf692d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:45:03.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.013+0000 7f2cf692d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:45:03.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.013+0000 7f2cf692d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4])"; uploads.size()=0; is_truncated=0 2024-03-04T12:45:03.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.015+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-03-04T12:45:03.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.015+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.015+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=204 2024-03-04T12:45:03.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.015+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-03-04T12:45:03.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.015+0000 7f2cf692d800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-03-04T12:45:03.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.016+0000 7f2cf692d800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-03-04T12:45:03.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.016+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-03-04T12:45:03.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.016+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824029 cookie 94663734114752 notifier 5955 bl.length()=162 2024-03-04T12:45:03.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.018+0000 7f2cf692d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4 from cache 2024-03-04T12:45:03.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.018+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4, ofs0, ns] 2024-03-04T12:45:03.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.018+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824059 cookie 94663734132880 notifier 5955 bl.length()=219 2024-03-04T12:45:03.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.021+0000 7f2cf692d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4 : miss 2024-03-04T12:45:03.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.021+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.021+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.021+0000 7f2cf692d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4 info.flags=0x0 2024-03-04T12:45:03.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.021+0000 7f2cf692d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4 to cache LRU end 2024-03-04T12:45:03.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.023+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11 : miss 2024-03-04T12:45:03.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.023+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.024+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=409 2024-03-04T12:45:03.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.024+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11 info.flags=0x17 2024-03-04T12:45:03.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.024+0000 7f2cf692d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11 to cache LRU end 2024-03-04T12:45:03.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.024+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:03.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.024+0000 7f2cf692d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:45:03.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.024+0000 7f2cf692d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11 2024-03-04T12:45:03.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.027+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo 2024-03-04T12:45:03.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.027+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec0661e0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x56189e44cb88 s->prefetch_data=0 2024-03-04T12:45:03.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.027+0000 7f2cf692d800 10 manifest: total_size = 18874368 2024-03-04T12:45:03.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.027+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16461061621600055906 2024-03-04T12:45:03.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.027+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec0661e0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x56189e44cb88 s->prefetch_data=0 2024-03-04T12:45:03.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.027+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e44cb88 2024-03-04T12:45:03.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.027+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11.10 2024-03-04T12:45:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16461061621600055906 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__multipart_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.1 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__shadow_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.1_1 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__multipart_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.2 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__shadow_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.2_1 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1081 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__multipart_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.3 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1327 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__shadow_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.3_1 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1571 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__multipart_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.4 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1817 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.030+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16461061621600055906 2024-03-04T12:45:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.031+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo 2024-03-04T12:45:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.031+0000 7f2cf692d800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:45:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.031+0000 7f2cf692d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:45:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.032+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:45:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.032+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:45:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.032+0000 7f2cf692d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:45:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.032+0000 7f2cf692d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:45:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.032+0000 7f2cf692d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11])"; uploads.size()=0; is_truncated=0 2024-03-04T12:45:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.034+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-03-04T12:45:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.034+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.034+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=235 2024-03-04T12:45:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.034+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-03-04T12:45:03.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.034+0000 7f2cf692d800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-03-04T12:45:03.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.035+0000 7f2cf692d800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-03-04T12:45:03.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.035+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-03-04T12:45:03.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.035+0000 7f2bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824050 cookie 94663734117680 notifier 5955 bl.length()=191 2024-03-04T12:45:03.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.037+0000 7f2cf692d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11 from cache 2024-03-04T12:45:03.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.037+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11, ofs0, ns] 2024-03-04T12:45:03.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.037+0000 7f2bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824051 cookie 94663734117680 notifier 5955 bl.length()=249 2024-03-04T12:45:03.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.041+0000 7f2cf692d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11 : miss 2024-03-04T12:45:03.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.041+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.042+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.042+0000 7f2cf692d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11 info.flags=0x0 2024-03-04T12:45:03.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.042+0000 7f2cf692d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11 to cache LRU end 2024-03-04T12:45:03.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.044+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12 : miss 2024-03-04T12:45:03.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.044+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.044+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=416 2024-03-04T12:45:03.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.044+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12 info.flags=0x17 2024-03-04T12:45:03.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.044+0000 7f2cf692d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12 to cache LRU end 2024-03-04T12:45:03.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.044+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:03.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.044+0000 7f2cf692d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:45:03.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.044+0000 7f2cf692d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12 2024-03-04T12:45:03.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.048+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo 2024-03-04T12:45:03.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.048+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05a310 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x56189e449388 s->prefetch_data=0 2024-03-04T12:45:03.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.049+0000 7f2cf692d800 10 manifest: total_size = 886297 2024-03-04T12:45:03.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.049+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12333260455574309796 2024-03-04T12:45:03.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.049+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05a310 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x56189e449388 s->prefetch_data=0 2024-03-04T12:45:03.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.049+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e449388 2024-03-04T12:45:03.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.049+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12.10 2024-03-04T12:45:03.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:45:03.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-03-04T12:45:03.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-03-04T12:45:03.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:45:03.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-03-04T12:45:03.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-03-04T12:45:03.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:45:03.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-03-04T12:45:03.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-03-04T12:45:03.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-03-04T12:45:03.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-03-04T12:45:03.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-03-04T12:45:03.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12333260455574309796 2024-03-04T12:45:03.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12__multipart_foo.2~sIgV_VazsY-HhJsXKdbQAUl8HINlZ9k.1 2024-03-04T12:45:03.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-03-04T12:45:03.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12__multipart_foo.2~sIgV_VazsY-HhJsXKdbQAUl8HINlZ9k.2 2024-03-04T12:45:03.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-03-04T12:45:03.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12__multipart_foo.2~sIgV_VazsY-HhJsXKdbQAUl8HINlZ9k.3 2024-03-04T12:45:03.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-03-04T12:45:03.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12__multipart_foo.2~sIgV_VazsY-HhJsXKdbQAUl8HINlZ9k.4 2024-03-04T12:45:03.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-03-04T12:45:03.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.051+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12333260455574309796 2024-03-04T12:45:03.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.052+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo 2024-03-04T12:45:03.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.052+0000 7f2cf692d800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:45:03.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.052+0000 7f2cf692d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:45:03.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.053+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:45:03.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.053+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:45:03.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.053+0000 7f2cf692d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:45:03.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.053+0000 7f2cf692d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:45:03.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.053+0000 7f2cf692d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12])"; uploads.size()=0; is_truncated=0 2024-03-04T12:45:03.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.055+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-03-04T12:45:03.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.055+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.055+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=242 2024-03-04T12:45:03.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.055+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-03-04T12:45:03.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.055+0000 7f2cf692d800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-03-04T12:45:03.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.056+0000 7f2cf692d800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-03-04T12:45:03.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.056+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-03-04T12:45:03.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.057+0000 7f2bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824016 cookie 94663734121856 notifier 5955 bl.length()=198 2024-03-04T12:45:03.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.058+0000 7f2cf692d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12 from cache 2024-03-04T12:45:03.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.058+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12, ofs0, ns] 2024-03-04T12:45:03.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.058+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824060 cookie 94663734135376 notifier 5955 bl.length()=256 2024-03-04T12:45:03.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.062+0000 7f2cf692d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12 : miss 2024-03-04T12:45:03.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.062+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.062+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.062+0000 7f2cf692d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12 info.flags=0x0 2024-03-04T12:45:03.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.062+0000 7f2cf692d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12 to cache LRU end 2024-03-04T12:45:03.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.064+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10 : miss 2024-03-04T12:45:03.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.064+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.064+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=411 2024-03-04T12:45:03.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.064+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10 info.flags=0x17 2024-03-04T12:45:03.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.064+0000 7f2cf692d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10 to cache LRU end 2024-03-04T12:45:03.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.064+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:03.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.064+0000 7f2cf692d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:45:03.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.064+0000 7f2cf692d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10 2024-03-04T12:45:03.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.068+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo[H0vgYIw22BqZ1vS8IUeBZ9sn19cxx44] 2024-03-04T12:45:03.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.068+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10.10 2024-03-04T12:45:03.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.069+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aaab0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x56189e433bc8 s->prefetch_data=0 2024-03-04T12:45:03.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.069+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to l10qzihmyzrsvevnzoqr83djspv6ehbq 2024-03-04T12:45:03.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.069+0000 7f2cf692d800 20 get_obj_state_impl: setting s->olh_tag to us2qbyrpjdx7hejasjyxampx5vpk44c1 2024-03-04T12:45:03.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.069+0000 7f2cf692d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=us2qbyrpjdx7hejasjyxampx5vpk44c1 2024-03-04T12:45:03.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.070+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10.10 2024-03-04T12:45:03.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.071+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10.10 2024-03-04T12:45:03.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.072+0000 7f2cf692d800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-03-04T12:45:03.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.072+0000 7f2cf692d800 20 olh_log_entry: epoch=3 op=3 key=foo[H0vgYIw22BqZ1vS8IUeBZ9sn19cxx44] 2024-03-04T12:45:03.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.072+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aaab0 obj=test-client.0-r-test-multipart-index-versioning.1:_:H0vgYIw22BqZ1vS8IUeBZ9sn19cxx44_foo state=0x56189e43c0e8 s->prefetch_data=0 2024-03-04T12:45:03.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.072+0000 7f2cf692d800 10 manifest: total_size = 1667 2024-03-04T12:45:03.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.072+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11826440884600772743 2024-03-04T12:45:03.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.072+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aaab0 obj=test-client.0-r-test-multipart-index-versioning.1:_:H0vgYIw22BqZ1vS8IUeBZ9sn19cxx44_foo state=0x56189e43c0e8 s->prefetch_data=0 2024-03-04T12:45:03.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.072+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e43c0e8 2024-03-04T12:45:03.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.072+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10.10 2024-03-04T12:45:03.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-04T12:45:03.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-03-04T12:45:03.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-03-04T12:45:03.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-04T12:45:03.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-03-04T12:45:03.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-03-04T12:45:03.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-04T12:45:03.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11826440884600772743 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10__multipart_foo.2~JYMph1NQQbPBAsPbT_Lp5ZGRnjGzqRl.1 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10__multipart_foo.2~JYMph1NQQbPBAsPbT_Lp5ZGRnjGzqRl.2 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10__multipart_foo.2~JYMph1NQQbPBAsPbT_Lp5ZGRnjGzqRl.3 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10__multipart_foo.2~JYMph1NQQbPBAsPbT_Lp5ZGRnjGzqRl.4 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-03-04T12:45:03.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.074+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11826440884600772743 2024-03-04T12:45:03.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.075+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo[H0vgYIw22BqZ1vS8IUeBZ9sn19cxx44] 2024-03-04T12:45:03.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.076+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aaab0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x56189e433bc8 s->prefetch_data=0 2024-03-04T12:45:03.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.077+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10.10 2024-03-04T12:45:03.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.079+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10.10 2024-03-04T12:45:03.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.079+0000 7f2cf692d800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:45:03.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.079+0000 7f2cf692d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:45:03.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.080+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:45:03.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.080+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:45:03.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.080+0000 7f2cf692d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:45:03.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.080+0000 7f2cf692d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:45:03.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.080+0000 7f2cf692d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10])"; uploads.size()=0; is_truncated=0 2024-03-04T12:45:03.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.081+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-03-04T12:45:03.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.081+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.082+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=237 2024-03-04T12:45:03.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.082+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-03-04T12:45:03.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.082+0000 7f2cf692d800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-03-04T12:45:03.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.083+0000 7f2cf692d800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-03-04T12:45:03.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.083+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-03-04T12:45:03.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.083+0000 7f2bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824017 cookie 94663734121856 notifier 5955 bl.length()=193 2024-03-04T12:45:03.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.084+0000 7f2cf692d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10 from cache 2024-03-04T12:45:03.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.084+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10, ofs0, ns] 2024-03-04T12:45:03.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.085+0000 7f2bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824030 cookie 94663734123872 notifier 5955 bl.length()=251 2024-03-04T12:45:03.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.087+0000 7f2cf692d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10 : miss 2024-03-04T12:45:03.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.087+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.088+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.088+0000 7f2cf692d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10 info.flags=0x0 2024-03-04T12:45:03.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.088+0000 7f2cf692d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10 to cache LRU end 2024-03-04T12:45:03.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.090+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9 : miss 2024-03-04T12:45:03.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.090+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.090+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=399 2024-03-04T12:45:03.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.090+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9 info.flags=0x17 2024-03-04T12:45:03.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.090+0000 7f2cf692d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9 to cache LRU end 2024-03-04T12:45:03.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.090+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:03.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.090+0000 7f2cf692d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:45:03.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.090+0000 7f2cf692d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9 2024-03-04T12:45:03.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.094+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo 2024-03-04T12:45:03.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.094+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e44ea30 obj=test-client.0-r-test-multipart-simple.1:foo state=0x56189e43c0e8 s->prefetch_data=0 2024-03-04T12:45:03.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.094+0000 7f2cf692d800 10 manifest: total_size = 74198 2024-03-04T12:45:03.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.094+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11906545806180745552 2024-03-04T12:45:03.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.094+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e44ea30 obj=test-client.0-r-test-multipart-simple.1:foo state=0x56189e43c0e8 s->prefetch_data=0 2024-03-04T12:45:03.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.094+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e43c0e8 2024-03-04T12:45:03.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.094+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9.10 2024-03-04T12:45:03.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-03-04T12:45:03.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-03-04T12:45:03.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-03-04T12:45:03.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-03-04T12:45:03.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-03-04T12:45:03.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-03-04T12:45:03.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-03-04T12:45:03.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-03-04T12:45:03.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-03-04T12:45:03.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11906545806180745552 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9__multipart_foo.2~E5fG0h0FF85MoKfMEoCK6PoBuSwHmLv.1 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9__multipart_foo.2~E5fG0h0FF85MoKfMEoCK6PoBuSwHmLv.2 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9__multipart_foo.2~E5fG0h0FF85MoKfMEoCK6PoBuSwHmLv.3 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9__multipart_foo.2~E5fG0h0FF85MoKfMEoCK6PoBuSwHmLv.4 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.097+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11906545806180745552 2024-03-04T12:45:03.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.098+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo 2024-03-04T12:45:03.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.098+0000 7f2cf692d800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:45:03.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.098+0000 7f2cf692d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:45:03.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.099+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:45:03.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.099+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:45:03.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.099+0000 7f2cf692d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:45:03.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.099+0000 7f2cf692d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:45:03.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.099+0000 7f2cf692d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9])"; uploads.size()=0; is_truncated=0 2024-03-04T12:45:03.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.100+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-03-04T12:45:03.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.100+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.101+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=225 2024-03-04T12:45:03.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.101+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-03-04T12:45:03.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.101+0000 7f2cf692d800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-03-04T12:45:03.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.102+0000 7f2cf692d800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-03-04T12:45:03.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.102+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-03-04T12:45:03.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.102+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824031 cookie 94663734123872 notifier 5955 bl.length()=183 2024-03-04T12:45:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.104+0000 7f2cf692d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9 from cache 2024-03-04T12:45:03.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.104+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9, ofs0, ns] 2024-03-04T12:45:03.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.104+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824020 cookie 94663734126368 notifier 5955 bl.length()=240 2024-03-04T12:45:03.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.106+0000 7f2cf692d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9 : miss 2024-03-04T12:45:03.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.106+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.107+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.107+0000 7f2cf692d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9 info.flags=0x0 2024-03-04T12:45:03.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.107+0000 7f2cf692d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9 to cache LRU end 2024-03-04T12:45:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.111+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15 : miss 2024-03-04T12:45:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.111+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.112+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=407 2024-03-04T12:45:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.112+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15 info.flags=0x17 2024-03-04T12:45:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.112+0000 7f2cf692d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15 to cache LRU end 2024-03-04T12:45:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.112+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:03.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.112+0000 7f2cf692d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:45:03.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.112+0000 7f2cf692d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15 2024-03-04T12:45:03.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.112+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-03-04T12:45:03.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.113+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-03-04T12:45:03.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.113+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-04T12:45:03.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.114+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-03-04T12:45:03.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.114+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-03-04T12:45:03.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.114+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-04T12:45:03.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.115+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-03-04T12:45:03.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.115+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-04T12:45:03.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.115+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-03-04T12:45:03.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.115+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-03-04T12:45:03.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.115+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-03-04T12:45:03.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.115+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-03-04T12:45:03.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.116+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aa820 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.116+0000 7f2cf692d800 10 manifest: total_size = 324647 2024-03-04T12:45:03.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.116+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to _cMw1JFcGlUoofwBJsn_fGFGlXRmASSY 2024-03-04T12:45:03.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.116+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aa820 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.116+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e449c18 2024-03-04T12:45:03.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.116+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15.0 2024-03-04T12:45:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.118+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.118+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.118+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: _cMw1JFcGlUoofwBJsn_fGFGlXRmASSY 2024-03-04T12:45:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.118+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.118+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.fkWDqoBrAG81VSo0Tyh107PlsgiO1-6_0 2024-03-04T12:45:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.118+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-04T12:45:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.118+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.118+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _cMw1JFcGlUoofwBJsn_fGFGlXRmASSY 2024-03-04T12:45:03.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.119+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-03-04T12:45:03.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.120+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aa820 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.120+0000 7f2cf692d800 10 manifest: total_size = 5242880 2024-03-04T12:45:03.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.120+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to _ExB55sYjYKTyts0C4Lz0HoQR-4zceNL 2024-03-04T12:45:03.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.120+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aa820 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.120+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e4489e8 2024-03-04T12:45:03.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.120+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15.2 2024-03-04T12:45:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.122+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.122+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.122+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.122+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.122+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: _ExB55sYjYKTyts0C4Lz0HoQR-4zceNL 2024-03-04T12:45:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.122+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.122+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.2T3c0gixP9AcRMM6n7fDHYUWI9ssiX1_0 2024-03-04T12:45:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.122+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-04T12:45:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.122+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.2T3c0gixP9AcRMM6n7fDHYUWI9ssiX1_1 2024-03-04T12:45:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.122+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-03-04T12:45:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.122+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.122+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _ExB55sYjYKTyts0C4Lz0HoQR-4zceNL 2024-03-04T12:45:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.123+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-03-04T12:45:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.124+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aa820 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.124+0000 7f2cf692d800 10 manifest: total_size = 5242880 2024-03-04T12:45:03.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.124+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12649941423062809509 2024-03-04T12:45:03.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.124+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aa820 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.124+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e4489e8 2024-03-04T12:45:03.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.124+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15.3 2024-03-04T12:45:03.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.127+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.127+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.127+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.127+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.127+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12649941423062809509 2024-03-04T12:45:03.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.127+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.127+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_0 2024-03-04T12:45:03.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.127+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-03-04T12:45:03.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.127+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_1 2024-03-04T12:45:03.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.127+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-03-04T12:45:03.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.127+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.128+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12649941423062809509 2024-03-04T12:45:03.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.129+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-04T12:45:03.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.129+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aa820 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.129+0000 7f2cf692d800 10 manifest: total_size = 5242880 2024-03-04T12:45:03.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.129+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to _5qGpQQ9kO49LbVRPoNiwfhL7Rt8lDro 2024-03-04T12:45:03.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.129+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aa820 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.129+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e4489e8 2024-03-04T12:45:03.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.129+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15.5 2024-03-04T12:45:03.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.131+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.131+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.131+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.131+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.131+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: _5qGpQQ9kO49LbVRPoNiwfhL7Rt8lDro 2024-03-04T12:45:03.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.131+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.131+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.D3mFdGxZrREQmaxopSgjNIwk41Fm3hV_0 2024-03-04T12:45:03.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.131+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-04T12:45:03.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.131+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.D3mFdGxZrREQmaxopSgjNIwk41Fm3hV_1 2024-03-04T12:45:03.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.131+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-03-04T12:45:03.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.131+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.131+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _5qGpQQ9kO49LbVRPoNiwfhL7Rt8lDro 2024-03-04T12:45:03.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.132+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-03-04T12:45:03.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.133+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc07a7d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.133+0000 7f2cf692d800 10 manifest: total_size = 5242880 2024-03-04T12:45:03.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.133+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to _Ag12p5qhdAMKsDXg08wUv2tN4kGgU_5 2024-03-04T12:45:03.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.133+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc07a7d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.133+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e4489e8 2024-03-04T12:45:03.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.133+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15.5 2024-03-04T12:45:03.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.135+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.135+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.135+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.135+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.135+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: _Ag12p5qhdAMKsDXg08wUv2tN4kGgU_5 2024-03-04T12:45:03.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.135+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.135+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.2plAO1UrZ86B0hVKf8UjZptYSw1FNa3_0 2024-03-04T12:45:03.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.135+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-04T12:45:03.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.135+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.2plAO1UrZ86B0hVKf8UjZptYSw1FNa3_1 2024-03-04T12:45:03.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.135+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-03-04T12:45:03.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.135+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.135+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _Ag12p5qhdAMKsDXg08wUv2tN4kGgU_5 2024-03-04T12:45:03.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.136+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-03-04T12:45:03.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.136+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc07a7d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.136+0000 7f2cf692d800 10 manifest: total_size = 324647 2024-03-04T12:45:03.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.136+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12524464277266614591 2024-03-04T12:45:03.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.136+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc07a7d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.136+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e4489e8 2024-03-04T12:45:03.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.136+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15.5 2024-03-04T12:45:03.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.139+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.139+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.139+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12524464277266614591 2024-03-04T12:45:03.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.139+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.139+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.JiaCq-7DUIO8jSELxt17iRHEd-MVaTX_0 2024-03-04T12:45:03.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.139+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-03-04T12:45:03.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.139+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.139+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12524464277266614591 2024-03-04T12:45:03.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.140+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-04T12:45:03.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.140+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05a4b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.141+0000 7f2cf692d800 10 manifest: total_size = 5242880 2024-03-04T12:45:03.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.141+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to _mDnLiTxVLyrCpaYND3dGzfdRwPgAk4C 2024-03-04T12:45:03.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.141+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05a4b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.141+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e4489e8 2024-03-04T12:45:03.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.141+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15.7 2024-03-04T12:45:03.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.143+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.143+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.143+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.143+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.143+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: _mDnLiTxVLyrCpaYND3dGzfdRwPgAk4C 2024-03-04T12:45:03.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.143+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.143+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.GlOPa-m5ngyy-UrQuIshbUyrNLTitHd_0 2024-03-04T12:45:03.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.143+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-04T12:45:03.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.143+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.GlOPa-m5ngyy-UrQuIshbUyrNLTitHd_1 2024-03-04T12:45:03.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.143+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-03-04T12:45:03.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.143+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.143+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _mDnLiTxVLyrCpaYND3dGzfdRwPgAk4C 2024-03-04T12:45:03.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.144+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-03-04T12:45:03.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.144+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc07aa10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.144+0000 7f2cf692d800 10 manifest: total_size = 5242880 2024-03-04T12:45:03.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.144+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5538951145949265990 2024-03-04T12:45:03.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.144+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc07aa10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.144+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e4489e8 2024-03-04T12:45:03.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.144+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15.7 2024-03-04T12:45:03.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.147+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.147+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.147+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.147+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.147+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5538951145949265990 2024-03-04T12:45:03.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.147+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.147+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_0 2024-03-04T12:45:03.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.147+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-03-04T12:45:03.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.147+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_1 2024-03-04T12:45:03.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.147+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-03-04T12:45:03.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.147+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.147+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5538951145949265990 2024-03-04T12:45:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.148+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-04T12:45:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.148+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec066350 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.148+0000 7f2cf692d800 10 manifest: total_size = 324647 2024-03-04T12:45:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.148+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.148+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.148+0000 7f2cf692d800 10 generate_fake_tag new tag=9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.JiaCq-7DUIO8jSELxt17iRHEd-MVaTX_1_14f2fb2a148055c29f8bd605d200ab78 2024-03-04T12:45:03.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.148+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.JiaCq-7DUIO8jSELxt17iRHEd-MVaTX_1_14f2fb2a148055c29f8bd605d200ab78 2024-03-04T12:45:03.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.148+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec066350 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.148+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e4489e8 2024-03-04T12:45:03.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.148+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15.7 2024-03-04T12:45:03.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.150+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.150+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.150+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.JiaCq-7DUIO8jSELxt17iRHEd-MVaTX_1_14f2fb2a148055c29f8bd605d200ab78 2024-03-04T12:45:03.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.150+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.150+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.JiaCq-7DUIO8jSELxt17iRHEd-MVaTX_0 2024-03-04T12:45:03.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.150+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 389 2024-03-04T12:45:03.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.150+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.150+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.JiaCq-7DUIO8jSELxt17iRHEd-MVaTX_1_14f2fb2a148055c29f8bd605d200ab78 2024-03-04T12:45:03.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.151+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-03-04T12:45:03.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.151+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec066350 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.152+0000 7f2cf692d800 10 manifest: total_size = 5242880 2024-03-04T12:45:03.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.152+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.152+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.152+0000 7f2cf692d800 10 generate_fake_tag new tag=9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_1_094a84ef45d50e50f1f4de097c905286 2024-03-04T12:45:03.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.152+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_1_094a84ef45d50e50f1f4de097c905286 2024-03-04T12:45:03.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.152+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec066350 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.152+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e4489e8 2024-03-04T12:45:03.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.152+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15.8 2024-03-04T12:45:03.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.154+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.154+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.154+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.154+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.154+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_1_094a84ef45d50e50f1f4de097c905286 2024-03-04T12:45:03.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.154+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.154+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_0 2024-03-04T12:45:03.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.154+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 398 2024-03-04T12:45:03.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.154+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_1 2024-03-04T12:45:03.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.154+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 637 2024-03-04T12:45:03.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.154+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.154+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_1_094a84ef45d50e50f1f4de097c905286 2024-03-04T12:45:03.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.155+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-03-04T12:45:03.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.155+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05a4b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.155+0000 7f2cf692d800 10 manifest: total_size = 324647 2024-03-04T12:45:03.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.155+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to _3HBvMxvg1tVLHoJc3662yM9S2XQ9xrj 2024-03-04T12:45:03.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.155+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05a4b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.155+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e4489e8 2024-03-04T12:45:03.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.155+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15.8 2024-03-04T12:45:03.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.158+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.158+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.158+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: _3HBvMxvg1tVLHoJc3662yM9S2XQ9xrj 2024-03-04T12:45:03.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.158+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.158+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.anEBD73fyK39xCfdLDIhmb_TANdzpjK_0 2024-03-04T12:45:03.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.158+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-04T12:45:03.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.158+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.158+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _3HBvMxvg1tVLHoJc3662yM9S2XQ9xrj 2024-03-04T12:45:03.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.159+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-03-04T12:45:03.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.159+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0538b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.159+0000 7f2cf692d800 10 manifest: total_size = 5242880 2024-03-04T12:45:03.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.159+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.159+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.159+0000 7f2cf692d800 10 generate_fake_tag new tag=9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_1_9e9c2623d4a7d045babc8d6140e6c719 2024-03-04T12:45:03.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.159+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_1_9e9c2623d4a7d045babc8d6140e6c719 2024-03-04T12:45:03.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.159+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0538b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x56189e4489e8 s->prefetch_data=0 2024-03-04T12:45:03.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.159+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e4489e8 2024-03-04T12:45:03.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.159+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15.9 2024-03-04T12:45:03.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.161+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.161+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.161+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.161+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.161+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_1_9e9c2623d4a7d045babc8d6140e6c719 2024-03-04T12:45:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.161+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.161+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_0 2024-03-04T12:45:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.161+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 396 2024-03-04T12:45:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.161+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_1 2024-03-04T12:45:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.161+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-03-04T12:45:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.161+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.161+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_1_9e9c2623d4a7d045babc8d6140e6c719 2024-03-04T12:45:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.162+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-03-04T12:45:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.163+0000 7f2cf692d800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:45:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.163+0000 7f2cf692d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:45:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.163+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:45:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.163+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:45:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.163+0000 7f2cf692d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:45:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.163+0000 7f2cf692d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:45:03.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.163+0000 7f2cf692d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15])"; uploads.size()=0; is_truncated=0 2024-03-04T12:45:03.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.165+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-03-04T12:45:03.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.165+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.165+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=233 2024-03-04T12:45:03.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.165+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-03-04T12:45:03.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.165+0000 7f2cf692d800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-03-04T12:45:03.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.167+0000 7f2cf692d800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-03-04T12:45:03.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.167+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-03-04T12:45:03.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.167+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824018 cookie 94663734121856 notifier 5955 bl.length()=189 2024-03-04T12:45:03.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.169+0000 7f2cf692d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15 from cache 2024-03-04T12:45:03.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.169+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15, ofs0, ns] 2024-03-04T12:45:03.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.169+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824032 cookie 94663734123872 notifier 5955 bl.length()=247 2024-03-04T12:45:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.171+0000 7f2cf692d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15 : miss 2024-03-04T12:45:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.171+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.171+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.171+0000 7f2cf692d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15 info.flags=0x0 2024-03-04T12:45:03.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.171+0000 7f2cf692d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15 to cache LRU end 2024-03-04T12:45:03.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.173+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16 : miss 2024-03-04T12:45:03.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.173+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.174+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=417 2024-03-04T12:45:03.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.174+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16 info.flags=0x17 2024-03-04T12:45:03.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.174+0000 7f2cf692d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16 to cache LRU end 2024-03-04T12:45:03.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.174+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:03.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.174+0000 7f2cf692d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:45:03.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.174+0000 7f2cf692d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16 2024-03-04T12:45:03.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.174+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-03-04T12:45:03.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.175+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-03-04T12:45:03.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.175+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-04T12:45:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.176+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-03-04T12:45:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.176+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-03-04T12:45:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.176+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-04T12:45:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.177+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-03-04T12:45:03.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.177+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-04T12:45:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.177+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-03-04T12:45:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.177+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-03-04T12:45:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.177+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-03-04T12:45:03.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.178+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-03-04T12:45:03.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.178+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e42a5a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x56189e430d58 s->prefetch_data=0 2024-03-04T12:45:03.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.178+0000 7f2cf692d800 10 manifest: total_size = 541681 2024-03-04T12:45:03.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.178+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to _4imWX8h5OnJvop6NiKJTejwXem6YlMM 2024-03-04T12:45:03.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.178+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e42a5a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x56189e430d58 s->prefetch_data=0 2024-03-04T12:45:03.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.178+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e430d58 2024-03-04T12:45:03.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.178+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16.0 2024-03-04T12:45:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.180+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.180+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.180+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: _4imWX8h5OnJvop6NiKJTejwXem6YlMM 2024-03-04T12:45:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.180+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.180+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.HB6w-wSWZwOV4FjQR-Lual0vwX8Dg2i_0 2024-03-04T12:45:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.180+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-04T12:45:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.180+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.180+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _4imWX8h5OnJvop6NiKJTejwXem6YlMM 2024-03-04T12:45:03.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.181+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-03-04T12:45:03.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.182+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05d950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x56189e430d58 s->prefetch_data=0 2024-03-04T12:45:03.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.182+0000 7f2cf692d800 10 manifest: total_size = 11534336 2024-03-04T12:45:03.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.182+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to _9TU2q5M0SmSGMzGvmDdbcmYmwiZBuZw 2024-03-04T12:45:03.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.182+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05d950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x56189e430d58 s->prefetch_data=0 2024-03-04T12:45:03.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.182+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e430d58 2024-03-04T12:45:03.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.182+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16.2 2024-03-04T12:45:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: _9TU2q5M0SmSGMzGvmDdbcmYmwiZBuZw 2024-03-04T12:45:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.bB5pf4MqibZKWzocgGJXJPJwJEhrNdG_0 2024-03-04T12:45:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-04T12:45:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.bB5pf4MqibZKWzocgGJXJPJwJEhrNdG_1 2024-03-04T12:45:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-03-04T12:45:03.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.bB5pf4MqibZKWzocgGJXJPJwJEhrNdG_2 2024-03-04T12:45:03.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-03-04T12:45:03.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.184+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _9TU2q5M0SmSGMzGvmDdbcmYmwiZBuZw 2024-03-04T12:45:03.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.185+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2ce40b8480 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x56189e430d58 s->prefetch_data=0 2024-03-04T12:45:03.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.185+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-03-04T12:45:03.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.185+0000 7f2cf692d800 10 manifest: total_size = 11534336 2024-03-04T12:45:03.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.185+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9639297755641970622 2024-03-04T12:45:03.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.185+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2ce40b8480 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x56189e430d58 s->prefetch_data=0 2024-03-04T12:45:03.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.185+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e430d58 2024-03-04T12:45:03.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.185+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16.3 2024-03-04T12:45:03.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9639297755641970622 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1_1 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.2 2024-03-04T12:45:03.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-03-04T12:45:03.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.2_1 2024-03-04T12:45:03.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-03-04T12:45:03.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.3 2024-03-04T12:45:03.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-03-04T12:45:03.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.188+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9639297755641970622 2024-03-04T12:45:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.189+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-04T12:45:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.189+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2ce40b8480 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x56189e430d58 s->prefetch_data=0 2024-03-04T12:45:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.189+0000 7f2cf692d800 10 manifest: total_size = 11534336 2024-03-04T12:45:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.189+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to _g8KOKi1UA86-KKA71U9uYLcpGp1gO7_ 2024-03-04T12:45:03.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.189+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2ce40b8480 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x56189e430d58 s->prefetch_data=0 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.189+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e430d58 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.189+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16.5 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: _g8KOKi1UA86-KKA71U9uYLcpGp1gO7_ 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.p6zuKIxAESooBk3CNk1oWF8Dopn_1jE_0 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-04T12:45:03.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.p6zuKIxAESooBk3CNk1oWF8Dopn_1jE_1 2024-03-04T12:45:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-03-04T12:45:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.p6zuKIxAESooBk3CNk1oWF8Dopn_1jE_2 2024-03-04T12:45:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-03-04T12:45:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.191+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _g8KOKi1UA86-KKA71U9uYLcpGp1gO7_ 2024-03-04T12:45:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.192+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2ce40b8480 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x56189e430d58 s->prefetch_data=0 2024-03-04T12:45:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.192+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-03-04T12:45:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.193+0000 7f2cf692d800 10 manifest: total_size = 11534336 2024-03-04T12:45:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.193+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to _PTOt6IoguAfkDOqIZqOX88Oc2tS4eBp 2024-03-04T12:45:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.193+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2ce40b8480 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x56189e430d58 s->prefetch_data=0 2024-03-04T12:45:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.193+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e430d58 2024-03-04T12:45:03.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.193+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16.5 2024-03-04T12:45:03.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: _PTOt6IoguAfkDOqIZqOX88Oc2tS4eBp 2024-03-04T12:45:03.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.wgokfsORPIEEVM0liUwgacypBuVss8r_0 2024-03-04T12:45:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-04T12:45:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.wgokfsORPIEEVM0liUwgacypBuVss8r_1 2024-03-04T12:45:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-03-04T12:45:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.wgokfsORPIEEVM0liUwgacypBuVss8r_2 2024-03-04T12:45:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-03-04T12:45:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.195+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _PTOt6IoguAfkDOqIZqOX88Oc2tS4eBp 2024-03-04T12:45:03.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.196+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-03-04T12:45:03.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.196+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05cb60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.196+0000 7f2cf692d800 10 manifest: total_size = 541681 2024-03-04T12:45:03.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.196+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11978490666276407046 2024-03-04T12:45:03.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.196+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05cb60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.196+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e43d128 2024-03-04T12:45:03.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.196+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16.5 2024-03-04T12:45:03.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:45:03.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-03-04T12:45:03.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11978490666276407046 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.1 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.2 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-03-04T12:45:03.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.3 2024-03-04T12:45:03.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-03-04T12:45:03.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.198+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11978490666276407046 2024-03-04T12:45:03.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.199+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-04T12:45:03.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.200+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e3a4060 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.200+0000 7f2cf692d800 10 manifest: total_size = 11534336 2024-03-04T12:45:03.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.200+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to _4mXFfaXyH0Lzw38rF-2NbXizmDr_FqG 2024-03-04T12:45:03.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.200+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e3a4060 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.200+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e43d128 2024-03-04T12:45:03.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.200+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16.7 2024-03-04T12:45:03.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: _4mXFfaXyH0Lzw38rF-2NbXizmDr_FqG 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.At-mztM2riM63UmzqgTnqfnNbX3SPS__0 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.At-mztM2riM63UmzqgTnqfnNbX3SPS__1 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.At-mztM2riM63UmzqgTnqfnNbX3SPS__2 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.202+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _4mXFfaXyH0Lzw38rF-2NbXizmDr_FqG 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.203+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-03-04T12:45:03.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.204+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e3a4060 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.204+0000 7f2cf692d800 10 manifest: total_size = 11534336 2024-03-04T12:45:03.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.204+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5437292840366431913 2024-03-04T12:45:03.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.204+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e3a4060 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.204+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e43d128 2024-03-04T12:45:03.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.204+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16.7 2024-03-04T12:45:03.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5437292840366431913 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1_1 2024-03-04T12:45:03.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-03-04T12:45:03.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.2 2024-03-04T12:45:03.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-03-04T12:45:03.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.2_1 2024-03-04T12:45:03.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-03-04T12:45:03.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.3 2024-03-04T12:45:03.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-03-04T12:45:03.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.206+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5437292840366431913 2024-03-04T12:45:03.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.207+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e449600 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.207+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-04T12:45:03.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.207+0000 7f2cf692d800 10 manifest: total_size = 541681 2024-03-04T12:45:03.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.207+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:45:03.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.207+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-03-04T12:45:03.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.207+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-03-04T12:45:03.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.207+0000 7f2cf692d800 10 generate_fake_tag new tag=9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.2_67bc19265e03d855e0e6a78b2e8523e3 2024-03-04T12:45:03.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.207+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.2_67bc19265e03d855e0e6a78b2e8523e3 2024-03-04T12:45:03.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.207+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e449600 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.207+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e43d128 2024-03-04T12:45:03.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.207+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16.7 2024-03-04T12:45:03.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.2_67bc19265e03d855e0e6a78b2e8523e3 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.1 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2024-03-04T12:45:03.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.2 2024-03-04T12:45:03.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 704 2024-03-04T12:45:03.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.3 2024-03-04T12:45:03.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 968 2024-03-04T12:45:03.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.210+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.2_67bc19265e03d855e0e6a78b2e8523e3 2024-03-04T12:45:03.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.211+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-03-04T12:45:03.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.211+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05a4b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.211+0000 7f2cf692d800 10 manifest: total_size = 11534336 2024-03-04T12:45:03.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.211+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.211+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.211+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.211+0000 7f2cf692d800 10 generate_fake_tag new tag=9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1_1_84254bc068a326e756f8cd8032864a32 2024-03-04T12:45:03.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.211+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1_1_84254bc068a326e756f8cd8032864a32 2024-03-04T12:45:03.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.211+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05a4b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.211+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e43d128 2024-03-04T12:45:03.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.211+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16.8 2024-03-04T12:45:03.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.213+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.213+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.213+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.213+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.213+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.213+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.213+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.213+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.213+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.213+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.213+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.213+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1_1_84254bc068a326e756f8cd8032864a32 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 448 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1_1 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 719 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.2 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 992 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.2_1 2024-03-04T12:45:03.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1263 2024-03-04T12:45:03.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.3 2024-03-04T12:45:03.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1536 2024-03-04T12:45:03.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.214+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1_1_84254bc068a326e756f8cd8032864a32 2024-03-04T12:45:03.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.215+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-03-04T12:45:03.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.215+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e435bc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.215+0000 7f2cf692d800 10 manifest: total_size = 541681 2024-03-04T12:45:03.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.215+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to _05YWIC92c2TLy9TNKsR3W-8xmB7bpyd 2024-03-04T12:45:03.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.215+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e435bc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.215+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e43d128 2024-03-04T12:45:03.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.215+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16.8 2024-03-04T12:45:03.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.218+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.218+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.218+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: _05YWIC92c2TLy9TNKsR3W-8xmB7bpyd 2024-03-04T12:45:03.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.218+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.218+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.bxRnBQA-LMpPfQO5f9qLnEeUgtbyPdt_0 2024-03-04T12:45:03.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.218+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-04T12:45:03.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.218+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.218+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _05YWIC92c2TLy9TNKsR3W-8xmB7bpyd 2024-03-04T12:45:03.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.219+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05d950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.219+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-03-04T12:45:03.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.219+0000 7f2cf692d800 10 manifest: total_size = 11534336 2024-03-04T12:45:03.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.219+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.219+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.219+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.219+0000 7f2cf692d800 10 generate_fake_tag new tag=9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1_1_2275a546903cf0f5aaabc79bebf2ab40 2024-03-04T12:45:03.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.219+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1_1_2275a546903cf0f5aaabc79bebf2ab40 2024-03-04T12:45:03.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.219+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05d950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x56189e43d128 s->prefetch_data=0 2024-03-04T12:45:03.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.219+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e43d128 2024-03-04T12:45:03.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.219+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16.9 2024-03-04T12:45:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1_1_2275a546903cf0f5aaabc79bebf2ab40 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1 2024-03-04T12:45:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2024-03-04T12:45:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1_1 2024-03-04T12:45:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 705 2024-03-04T12:45:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.2 2024-03-04T12:45:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 972 2024-03-04T12:45:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.2_1 2024-03-04T12:45:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1237 2024-03-04T12:45:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.3 2024-03-04T12:45:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1504 2024-03-04T12:45:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.221+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1_1_2275a546903cf0f5aaabc79bebf2ab40 2024-03-04T12:45:03.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.223+0000 7f2cf692d800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:45:03.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.223+0000 7f2cf692d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:45:03.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.223+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-03-04T12:45:03.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.223+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:45:03.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.223+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:45:03.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.223+0000 7f2cf692d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:45:03.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.223+0000 7f2cf692d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:45:03.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.223+0000 7f2cf692d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16])"; uploads.size()=0; is_truncated=0 2024-03-04T12:45:03.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.225+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-03-04T12:45:03.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.225+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.225+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=243 2024-03-04T12:45:03.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.225+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-03-04T12:45:03.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.225+0000 7f2cf692d800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-03-04T12:45:03.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.226+0000 7f2cf692d800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-03-04T12:45:03.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.226+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-03-04T12:45:03.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.227+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824021 cookie 94663734126368 notifier 5955 bl.length()=199 2024-03-04T12:45:03.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.228+0000 7f2cf692d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16 from cache 2024-03-04T12:45:03.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.228+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16, ofs0, ns] 2024-03-04T12:45:03.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.228+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824013 cookie 94663734131312 notifier 5955 bl.length()=257 2024-03-04T12:45:03.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.231+0000 7f2cf692d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16 : miss 2024-03-04T12:45:03.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.231+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.231+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.231+0000 7f2cf692d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16 info.flags=0x0 2024-03-04T12:45:03.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.231+0000 7f2cf692d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16 to cache LRU end 2024-03-04T12:45:03.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.233+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14 : miss 2024-03-04T12:45:03.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.233+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.234+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=412 2024-03-04T12:45:03.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.234+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14 info.flags=0x17 2024-03-04T12:45:03.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.234+0000 7f2cf692d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14 to cache LRU end 2024-03-04T12:45:03.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.234+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:03.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.234+0000 7f2cf692d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:45:03.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.234+0000 7f2cf692d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14 2024-03-04T12:45:03.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.235+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-04T12:45:03.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.236+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-04T12:45:03.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.236+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-04T12:45:03.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.237+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e42a5a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x56189e448168 s->prefetch_data=0 2024-03-04T12:45:03.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.238+0000 7f2cf692d800 10 manifest: total_size = 11534336 2024-03-04T12:45:03.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.238+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17486071241571340808 2024-03-04T12:45:03.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.238+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e42a5a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x56189e448168 s->prefetch_data=0 2024-03-04T12:45:03.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.238+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e448168 2024-03-04T12:45:03.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.238+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14.3 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:45:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17486071241571340808 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-FROZEN.2~QX1TRjzxD6VWkTQsTg9tK4AKf1JZt0e.1 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__shadow_foo-FROZEN.2~QX1TRjzxD6VWkTQsTg9tK4AKf1JZt0e.1_1 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-FROZEN.2~QX1TRjzxD6VWkTQsTg9tK4AKf1JZt0e.2 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__shadow_foo-FROZEN.2~QX1TRjzxD6VWkTQsTg9tK4AKf1JZt0e.2_1 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-FROZEN.2~QX1TRjzxD6VWkTQsTg9tK4AKf1JZt0e.3 2024-03-04T12:45:03.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-03-04T12:45:03.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.240+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17486071241571340808 2024-03-04T12:45:03.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.241+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-04T12:45:03.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.241+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e43f6e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.241+0000 7f2cf692d800 10 manifest: total_size = 1087 2024-03-04T12:45:03.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.241+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6437584966347240911 2024-03-04T12:45:03.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.241+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e43f6e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.241+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e449c18 2024-03-04T12:45:03.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.241+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14.5 2024-03-04T12:45:03.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-04T12:45:03.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6437584966347240911 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-STANDARD.2~C7FvvchTTn-9FeFMkcplXdXU9Txv47S.1 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-STANDARD.2~C7FvvchTTn-9FeFMkcplXdXU9Txv47S.2 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-STANDARD.2~C7FvvchTTn-9FeFMkcplXdXU9Txv47S.3 2024-03-04T12:45:03.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-03-04T12:45:03.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.244+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6437584966347240911 2024-03-04T12:45:03.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.245+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-04T12:45:03.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.245+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05d4e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.246+0000 7f2cf692d800 10 manifest: total_size = 11534336 2024-03-04T12:45:03.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.246+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14076461130301922375 2024-03-04T12:45:03.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.246+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05d4e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.246+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e449c18 2024-03-04T12:45:03.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.246+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14.7 2024-03-04T12:45:03.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-04T12:45:03.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14076461130301922375 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-LUKEWARM.2~DKZrOjkXIJakmkWTW_Br-2TTQ_SrVIP.1 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__shadow_foo-LUKEWARM.2~DKZrOjkXIJakmkWTW_Br-2TTQ_SrVIP.1_1 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-LUKEWARM.2~DKZrOjkXIJakmkWTW_Br-2TTQ_SrVIP.2 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__shadow_foo-LUKEWARM.2~DKZrOjkXIJakmkWTW_Br-2TTQ_SrVIP.2_1 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-LUKEWARM.2~DKZrOjkXIJakmkWTW_Br-2TTQ_SrVIP.3 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.248+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14076461130301922375 2024-03-04T12:45:03.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.249+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-04T12:45:03.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.249+0000 7f2cf692d800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:45:03.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.249+0000 7f2cf692d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:45:03.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.250+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:45:03.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.250+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:45:03.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.250+0000 7f2cf692d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:45:03.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.250+0000 7f2cf692d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:45:03.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.250+0000 7f2cf692d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14])"; uploads.size()=0; is_truncated=0 2024-03-04T12:45:03.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.251+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-03-04T12:45:03.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.251+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.252+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=238 2024-03-04T12:45:03.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.252+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-03-04T12:45:03.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.252+0000 7f2cf692d800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-03-04T12:45:03.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.254+0000 7f2cf692d800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-03-04T12:45:03.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.254+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-03-04T12:45:03.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.255+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824061 cookie 94663734132880 notifier 5955 bl.length()=194 2024-03-04T12:45:03.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.256+0000 7f2cf692d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14 from cache 2024-03-04T12:45:03.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.256+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14, ofs0, ns] 2024-03-04T12:45:03.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.257+0000 7f2bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824014 cookie 94663734131312 notifier 5955 bl.length()=252 2024-03-04T12:45:03.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.259+0000 7f2cf692d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14 : miss 2024-03-04T12:45:03.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.259+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.259+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.259+0000 7f2cf692d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14 info.flags=0x0 2024-03-04T12:45:03.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.259+0000 7f2cf692d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14 to cache LRU end 2024-03-04T12:45:03.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.261+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13 : miss 2024-03-04T12:45:03.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.261+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.262+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=402 2024-03-04T12:45:03.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.262+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13 info.flags=0x17 2024-03-04T12:45:03.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.262+0000 7f2cf692d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13 to cache LRU end 2024-03-04T12:45:03.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.262+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:03.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.262+0000 7f2cf692d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:45:03.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.262+0000 7f2cf692d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13 2024-03-04T12:45:03.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.264+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-04T12:45:03.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.264+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-04T12:45:03.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.265+0000 7f2cf692d800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-04T12:45:03.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.266+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e44b360 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x56189e3a2dd8 s->prefetch_data=0 2024-03-04T12:45:03.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.267+0000 7f2cf692d800 10 manifest: total_size = 10485760 2024-03-04T12:45:03.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.267+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11445943614669277341 2024-03-04T12:45:03.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.267+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e44b360 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x56189e3a2dd8 s->prefetch_data=0 2024-03-04T12:45:03.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.267+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e3a2dd8 2024-03-04T12:45:03.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.267+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13.3 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11445943614669277341 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.hl5JMgN6Y2rDRAxlT5MUu5JVmsl-yK8_0 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.hl5JMgN6Y2rDRAxlT5MUu5JVmsl-yK8_1 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-03-04T12:45:03.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.hl5JMgN6Y2rDRAxlT5MUu5JVmsl-yK8_2 2024-03-04T12:45:03.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-03-04T12:45:03.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.269+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11445943614669277341 2024-03-04T12:45:03.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.270+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-04T12:45:03.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.270+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aa820 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x56189e3a2dd8 s->prefetch_data=0 2024-03-04T12:45:03.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.270+0000 7f2cf692d800 10 manifest: total_size = 3312 2024-03-04T12:45:03.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.270+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10509456626276625691 2024-03-04T12:45:03.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.270+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e4aa820 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x56189e3a2dd8 s->prefetch_data=0 2024-03-04T12:45:03.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.270+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e3a2dd8 2024-03-04T12:45:03.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.270+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13.5 2024-03-04T12:45:03.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.272+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.272+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=3312 stripe_ofs=3312 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.272+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10509456626276625691 2024-03-04T12:45:03.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.272+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.272+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.UolwZ1aszqPgj_oyXGrF0KEhNaK1B39_0 2024-03-04T12:45:03.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.272+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-03-04T12:45:03.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.272+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.272+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10509456626276625691 2024-03-04T12:45:03.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.273+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-04T12:45:03.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.274+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05a4b0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x56189e3a2dd8 s->prefetch_data=0 2024-03-04T12:45:03.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.274+0000 7f2cf692d800 10 manifest: total_size = 10485760 2024-03-04T12:45:03.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.274+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14088493918940893319 2024-03-04T12:45:03.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.274+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05a4b0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x56189e3a2dd8 s->prefetch_data=0 2024-03-04T12:45:03.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.274+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e3a2dd8 2024-03-04T12:45:03.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.274+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13.7 2024-03-04T12:45:03.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14088493918940893319 2024-03-04T12:45:03.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.NJRKUTwhvpaw6hKnz4ASxB-oQ7u4OxR_0 2024-03-04T12:45:03.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-03-04T12:45:03.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.NJRKUTwhvpaw6hKnz4ASxB-oQ7u4OxR_1 2024-03-04T12:45:03.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-03-04T12:45:03.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.NJRKUTwhvpaw6hKnz4ASxB-oQ7u4OxR_2 2024-03-04T12:45:03.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2024-03-04T12:45:03.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.276+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14088493918940893319 2024-03-04T12:45:03.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.277+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-04T12:45:03.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.277+0000 7f2cf692d800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:45:03.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.277+0000 7f2cf692d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:45:03.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.278+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:45:03.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.278+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:45:03.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.278+0000 7f2cf692d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:45:03.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.278+0000 7f2cf692d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:45:03.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.278+0000 7f2cf692d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13])"; uploads.size()=0; is_truncated=0 2024-03-04T12:45:03.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.280+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-03-04T12:45:03.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.280+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.280+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=228 2024-03-04T12:45:03.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.280+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-03-04T12:45:03.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.280+0000 7f2cf692d800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-03-04T12:45:03.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.281+0000 7f2cf692d800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-03-04T12:45:03.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.281+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-03-04T12:45:03.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.281+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824019 cookie 94663734121856 notifier 5955 bl.length()=184 2024-03-04T12:45:03.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.283+0000 7f2cf692d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13 from cache 2024-03-04T12:45:03.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.283+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13, ofs0, ns] 2024-03-04T12:45:03.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.283+0000 7f2bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824062 cookie 94663734135376 notifier 5955 bl.length()=242 2024-03-04T12:45:03.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.286+0000 7f2cf692d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13 : miss 2024-03-04T12:45:03.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.286+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.287+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.287+0000 7f2cf692d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13 info.flags=0x0 2024-03-04T12:45:03.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.287+0000 7f2cf692d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13 to cache LRU end 2024-03-04T12:45:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.289+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6 : miss 2024-03-04T12:45:03.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.289+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.289+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=397 2024-03-04T12:45:03.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.289+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6 info.flags=0x17 2024-03-04T12:45:03.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.289+0000 7f2cf692d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6 to cache LRU end 2024-03-04T12:45:03.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.289+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:03.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.289+0000 7f2cf692d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:45:03.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.289+0000 7f2cf692d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6 2024-03-04T12:45:03.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.290+0000 7f2cf692d800 10 cls_bucket_list_unordered: got ___ 2024-03-04T12:45:03.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.290+0000 7f2cf692d800 10 cls_bucket_list_unordered: got __ _ 2024-03-04T12:45:03.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.291+0000 7f2cf692d800 10 cls_bucket_list_unordered: got __ 2024-03-04T12:45:03.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.292+0000 7f2cf692d800 10 cls_bucket_list_unordered: got obj 2024-03-04T12:45:03.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.293+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e43dcb0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.293+0000 7f2cf692d800 10 manifest: total_size = 0 2024-03-04T12:45:03.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.293+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8927242998745438025 2024-03-04T12:45:03.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.293+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e43dcb0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.293+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e449c18 2024-03-04T12:45:03.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.293+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6.2 2024-03-04T12:45:03.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.295+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05d4e0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.295+0000 7f2cf692d800 10 manifest: total_size = 0 2024-03-04T12:45:03.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.295+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8014596392143208065 2024-03-04T12:45:03.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.295+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05d4e0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.295+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e449c18 2024-03-04T12:45:03.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.295+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6.3 2024-03-04T12:45:03.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.296+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=___ 2024-03-04T12:45:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.297+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05d950 obj=test-client.0-r-test-small-obj-data.1:__ state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.298+0000 7f2cf692d800 10 manifest: total_size = 0 2024-03-04T12:45:03.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.298+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15948049531204864233 2024-03-04T12:45:03.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.298+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05d950 obj=test-client.0-r-test-small-obj-data.1:__ state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.298+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e449c18 2024-03-04T12:45:03.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.298+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6.6 2024-03-04T12:45:03.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.298+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-03-04T12:45:03.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.300+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc03a580 obj=test-client.0-r-test-small-obj-data.1:obj state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.300+0000 7f2cf692d800 10 manifest: total_size = 0 2024-03-04T12:45:03.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.300+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.148957241435599992 2024-03-04T12:45:03.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.300+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc03a580 obj=test-client.0-r-test-small-obj-data.1:obj state=0x56189e449c18 s->prefetch_data=0 2024-03-04T12:45:03.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.300+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e449c18 2024-03-04T12:45:03.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.300+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6.8 2024-03-04T12:45:03.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.301+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=__ 2024-03-04T12:45:03.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.302+0000 7f2cf692d800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:45:03.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.302+0000 7f2cf692d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:45:03.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.303+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=obj 2024-03-04T12:45:03.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.304+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:45:03.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.304+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:45:03.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.304+0000 7f2cf692d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:45:03.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.304+0000 7f2cf692d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:45:03.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.304+0000 7f2cf692d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6])"; uploads.size()=0; is_truncated=0 2024-03-04T12:45:03.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.306+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-03-04T12:45:03.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.306+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.307+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=223 2024-03-04T12:45:03.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.307+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-03-04T12:45:03.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.307+0000 7f2cf692d800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-03-04T12:45:03.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.308+0000 7f2cf692d800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-03-04T12:45:03.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.308+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-03-04T12:45:03.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.308+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824052 cookie 94663734117680 notifier 5955 bl.length()=181 2024-03-04T12:45:03.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.310+0000 7f2cf692d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6 from cache 2024-03-04T12:45:03.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.310+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6, ofs0, ns] 2024-03-04T12:45:03.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.310+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824033 cookie 94663734114752 notifier 5955 bl.length()=238 2024-03-04T12:45:03.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.313+0000 7f2cf692d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6 : miss 2024-03-04T12:45:03.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.313+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.313+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.313+0000 7f2cf692d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6 info.flags=0x0 2024-03-04T12:45:03.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.313+0000 7f2cf692d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6 to cache LRU end 2024-03-04T12:45:03.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.315+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7 : miss 2024-03-04T12:45:03.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.315+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.316+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=397 2024-03-04T12:45:03.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.316+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7 info.flags=0x17 2024-03-04T12:45:03.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.316+0000 7f2cf692d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7 to cache LRU end 2024-03-04T12:45:03.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.316+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:03.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.316+0000 7f2cf692d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:45:03.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.316+0000 7f2cf692d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7 2024-03-04T12:45:03.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.318+0000 7f2cf692d800 10 cls_bucket_list_unordered: got ___ 2024-03-04T12:45:03.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.318+0000 7f2cf692d800 10 cls_bucket_list_unordered: got __ _ 2024-03-04T12:45:03.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.319+0000 7f2cf692d800 10 cls_bucket_list_unordered: got __ 2024-03-04T12:45:03.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.320+0000 7f2cf692d800 10 cls_bucket_list_unordered: got obj 2024-03-04T12:45:03.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.320+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e438020 obj=test-client.0-r-test-small-obj-data.2:___ state=0x56189e44d068 s->prefetch_data=0 2024-03-04T12:45:03.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.320+0000 7f2cf692d800 10 manifest: total_size = 524288 2024-03-04T12:45:03.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.320+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5567522123342858996 2024-03-04T12:45:03.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.320+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e438020 obj=test-client.0-r-test-small-obj-data.2:___ state=0x56189e44d068 s->prefetch_data=0 2024-03-04T12:45:03.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.320+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e44d068 2024-03-04T12:45:03.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.321+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7.2 2024-03-04T12:45:03.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.323+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.323+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.323+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5567522123342858996 2024-03-04T12:45:03.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.323+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.323+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7__shadow_.YvN0tpq5puGYwjroGbavNnDkbkXatF2_0 2024-03-04T12:45:03.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.323+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-04T12:45:03.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.323+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.323+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5567522123342858996 2024-03-04T12:45:03.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.324+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=___ 2024-03-04T12:45:03.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.324+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e438020 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x56189e44d068 s->prefetch_data=0 2024-03-04T12:45:03.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.324+0000 7f2cf692d800 10 manifest: total_size = 524288 2024-03-04T12:45:03.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.324+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2451880170801922542 2024-03-04T12:45:03.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.324+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e438020 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x56189e44d068 s->prefetch_data=0 2024-03-04T12:45:03.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.324+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e44d068 2024-03-04T12:45:03.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.324+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7.3 2024-03-04T12:45:03.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.326+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.326+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.326+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2451880170801922542 2024-03-04T12:45:03.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.326+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.326+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7__shadow_.cyW9vZCXjxEky9UQiXHDGtRv1nsUiFL_0 2024-03-04T12:45:03.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.326+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-04T12:45:03.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.326+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.326+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2451880170801922542 2024-03-04T12:45:03.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.327+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-03-04T12:45:03.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.328+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e438020 obj=test-client.0-r-test-small-obj-data.2:__ state=0x56189e44d068 s->prefetch_data=0 2024-03-04T12:45:03.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.328+0000 7f2cf692d800 10 manifest: total_size = 524288 2024-03-04T12:45:03.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.328+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15358263107747482271 2024-03-04T12:45:03.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.328+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e438020 obj=test-client.0-r-test-small-obj-data.2:__ state=0x56189e44d068 s->prefetch_data=0 2024-03-04T12:45:03.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.328+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e44d068 2024-03-04T12:45:03.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.328+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7.6 2024-03-04T12:45:03.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.330+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.330+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.330+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15358263107747482271 2024-03-04T12:45:03.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.330+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.330+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7__shadow_.B3h5EBNpvETp0N66pVi1LvJHxr5a4tG_0 2024-03-04T12:45:03.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.330+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-04T12:45:03.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.330+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.330+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15358263107747482271 2024-03-04T12:45:03.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.331+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=__ 2024-03-04T12:45:03.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.331+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e438020 obj=test-client.0-r-test-small-obj-data.2:obj state=0x56189e44d068 s->prefetch_data=0 2024-03-04T12:45:03.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.332+0000 7f2cf692d800 10 manifest: total_size = 38 2024-03-04T12:45:03.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.332+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9424338689814720128 2024-03-04T12:45:03.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.332+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e438020 obj=test-client.0-r-test-small-obj-data.2:obj state=0x56189e44d068 s->prefetch_data=0 2024-03-04T12:45:03.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.332+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e44d068 2024-03-04T12:45:03.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.332+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7.8 2024-03-04T12:45:03.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.334+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.334+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.334+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9424338689814720128 2024-03-04T12:45:03.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.334+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.334+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7__shadow_.Azi0PSE-xeYY_HLiiQchvoGVgNWu19f_0 2024-03-04T12:45:03.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.334+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-04T12:45:03.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.334+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.334+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9424338689814720128 2024-03-04T12:45:03.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.335+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=obj 2024-03-04T12:45:03.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.335+0000 7f2cf692d800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:45:03.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.335+0000 7f2cf692d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:45:03.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.336+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:45:03.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.336+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:45:03.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.336+0000 7f2cf692d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:45:03.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.336+0000 7f2cf692d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:45:03.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.336+0000 7f2cf692d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7])"; uploads.size()=0; is_truncated=0 2024-03-04T12:45:03.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.337+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-03-04T12:45:03.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.337+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.338+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=223 2024-03-04T12:45:03.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.338+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-03-04T12:45:03.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.338+0000 7f2cf692d800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-03-04T12:45:03.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.339+0000 7f2cf692d800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-03-04T12:45:03.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.339+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-03-04T12:45:03.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.339+0000 7f2bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824053 cookie 94663734117680 notifier 5955 bl.length()=181 2024-03-04T12:45:03.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.341+0000 7f2cf692d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7 from cache 2024-03-04T12:45:03.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.341+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7, ofs0, ns] 2024-03-04T12:45:03.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.341+0000 7f2bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824034 cookie 94663734114752 notifier 5955 bl.length()=238 2024-03-04T12:45:03.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.343+0000 7f2cf692d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7 : miss 2024-03-04T12:45:03.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.343+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.344+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.344+0000 7f2cf692d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7 info.flags=0x0 2024-03-04T12:45:03.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.344+0000 7f2cf692d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7 to cache LRU end 2024-03-04T12:45:03.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.346+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8 : miss 2024-03-04T12:45:03.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.346+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.346+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=397 2024-03-04T12:45:03.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.346+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8 info.flags=0x17 2024-03-04T12:45:03.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.346+0000 7f2cf692d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8 to cache LRU end 2024-03-04T12:45:03.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.346+0000 7f2cf692d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:03.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.346+0000 7f2cf692d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:45:03.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.346+0000 7f2cf692d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8 2024-03-04T12:45:03.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.347+0000 7f2cf692d800 10 cls_bucket_list_unordered: got ___ 2024-03-04T12:45:03.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.348+0000 7f2cf692d800 10 cls_bucket_list_unordered: got __ _ 2024-03-04T12:45:03.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.349+0000 7f2cf692d800 10 cls_bucket_list_unordered: got __ 2024-03-04T12:45:03.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.349+0000 7f2cf692d800 10 cls_bucket_list_unordered: got obj 2024-03-04T12:45:03.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.350+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05d4e0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x56189e3a14f8 s->prefetch_data=0 2024-03-04T12:45:03.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.350+0000 7f2cf692d800 10 manifest: total_size = 55 2024-03-04T12:45:03.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.350+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3218230263259982134 2024-03-04T12:45:03.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.350+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cec05d4e0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x56189e3a14f8 s->prefetch_data=0 2024-03-04T12:45:03.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.350+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e3a14f8 2024-03-04T12:45:03.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.350+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8.2 2024-03-04T12:45:03.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.352+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.352+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.352+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3218230263259982134 2024-03-04T12:45:03.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.352+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.352+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8__shadow_.ZQ1XwYwII22TrgywEdq4GfWdk30okNF_0 2024-03-04T12:45:03.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.352+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-04T12:45:03.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.352+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.352+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3218230263259982134 2024-03-04T12:45:03.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.353+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=___ 2024-03-04T12:45:03.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.354+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e435ac0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x56189e3a14f8 s->prefetch_data=0 2024-03-04T12:45:03.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.354+0000 7f2cf692d800 10 manifest: total_size = 49187 2024-03-04T12:45:03.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.354+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15966295111669766117 2024-03-04T12:45:03.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.354+0000 7f2cf692d800 20 get_obj_state: octx=0x56189e435ac0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x56189e3a14f8 s->prefetch_data=0 2024-03-04T12:45:03.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.354+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e3a14f8 2024-03-04T12:45:03.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.354+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8.3 2024-03-04T12:45:03.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.356+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.356+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.356+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15966295111669766117 2024-03-04T12:45:03.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.356+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.356+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8__shadow_.RbKJIst664UuE_JaLzL78gYlrzhAvSC_0 2024-03-04T12:45:03.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.356+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-04T12:45:03.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.356+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.356+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15966295111669766117 2024-03-04T12:45:03.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.357+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-03-04T12:45:03.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.357+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0538b0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x56189e3a14f8 s->prefetch_data=0 2024-03-04T12:45:03.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.358+0000 7f2cf692d800 10 manifest: total_size = 55 2024-03-04T12:45:03.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.358+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3469867616764009457 2024-03-04T12:45:03.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.358+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0538b0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x56189e3a14f8 s->prefetch_data=0 2024-03-04T12:45:03.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.358+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e3a14f8 2024-03-04T12:45:03.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.358+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8.6 2024-03-04T12:45:03.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.360+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.360+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.360+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3469867616764009457 2024-03-04T12:45:03.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.360+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.360+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8__shadow_.Skeg0fXEDiR-LGUn_H57QXhj9nly8bh_0 2024-03-04T12:45:03.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.360+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-04T12:45:03.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.360+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.360+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3469867616764009457 2024-03-04T12:45:03.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.361+0000 7f2bd57fa640 20 handle_completion(): completion ok for obj=__ 2024-03-04T12:45:03.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.362+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0538b0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x56189e3a14d8 s->prefetch_data=0 2024-03-04T12:45:03.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.362+0000 7f2cf692d800 10 manifest: total_size = 1035 2024-03-04T12:45:03.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.362+0000 7f2cf692d800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13232151550821571829 2024-03-04T12:45:03.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.362+0000 7f2cf692d800 20 get_obj_state: octx=0x7f2cdc0538b0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x56189e3a14d8 s->prefetch_data=0 2024-03-04T12:45:03.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.362+0000 7f2cf692d800 20 prepare_atomic_modification: state is not atomic. state=0x56189e3a14d8 2024-03-04T12:45:03.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.362+0000 7f2cf692d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8.8 2024-03-04T12:45:03.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.364+0000 7f2cf692d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:45:03.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.364+0000 7f2cf692d800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-03-04T12:45:03.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.364+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13232151550821571829 2024-03-04T12:45:03.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.364+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:45:03.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.364+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8__shadow_.sJeLN2jsvyooUZVTAZrPBTsf906MFzR_0 2024-03-04T12:45:03.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.364+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-04T12:45:03.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.364+0000 7f2cf692d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:45:03.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.364+0000 7f2cf692d800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13232151550821571829 2024-03-04T12:45:03.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.365+0000 7f2bd5ffb640 20 handle_completion(): completion ok for obj=obj 2024-03-04T12:45:03.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.365+0000 7f2cf692d800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:45:03.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.365+0000 7f2cf692d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:45:03.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.366+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:45:03.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.366+0000 7f2cf692d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:45:03.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.366+0000 7f2cf692d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:45:03.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.366+0000 7f2cf692d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:45:03.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.366+0000 7f2cf692d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8])"; uploads.size()=0; is_truncated=0 2024-03-04T12:45:03.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.368+0000 7f2cf692d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-03-04T12:45:03.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.368+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.368+0000 7f2cf692d800 20 rados_obj.operate() r=0 bl.length=223 2024-03-04T12:45:03.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.368+0000 7f2cf692d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-03-04T12:45:03.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.368+0000 7f2cf692d800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-03-04T12:45:03.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.369+0000 7f2cf692d800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-03-04T12:45:03.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.369+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-03-04T12:45:03.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.370+0000 7f2bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824054 cookie 94663734117680 notifier 5955 bl.length()=181 2024-03-04T12:45:03.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.371+0000 7f2cf692d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8 from cache 2024-03-04T12:45:03.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.371+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8, ofs0, ns] 2024-03-04T12:45:03.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.371+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824035 cookie 94663734114752 notifier 5955 bl.length()=238 2024-03-04T12:45:03.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.376+0000 7f2cf692d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8 : miss 2024-03-04T12:45:03.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.376+0000 7f2cf692d800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.376+0000 7f2cf692d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.376+0000 7f2cf692d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8 info.flags=0x0 2024-03-04T12:45:03.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.376+0000 7f2cf692d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8 to cache LRU end 2024-03-04T12:45:03.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.378+0000 7f2cf692d800 10 removing key index: OJIFRVNHHEVAVVJRESZY 2024-03-04T12:45:03.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.379+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:OJIFRVNHHEVAVVJRESZY, ofs0, ns] 2024-03-04T12:45:03.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.380+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824036 cookie 94663734114752 notifier 5955 bl.length()=170 2024-03-04T12:45:03.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.380+0000 7f2cf692d800 10 removing email index: ragweed.client.0+test@test.test 2024-03-04T12:45:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.381+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-03-04T12:45:03.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.381+0000 7f2bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824020 cookie 94663734121856 notifier 5955 bl.length()=182 2024-03-04T12:45:03.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.382+0000 7f2cf692d800 10 removing user buckets index 2024-03-04T12:45:03.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.383+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-03-04T12:45:03.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.383+0000 7f2bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824063 cookie 94663734132880 notifier 5955 bl.length()=173 2024-03-04T12:45:03.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.383+0000 7f2cf692d800 10 removing user index: ragweed.client.0 2024-03-04T12:45:03.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.384+0000 7f2cf692d800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-03-04T12:45:03.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.384+0000 7f2cf692d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-03-04T12:45:03.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.385+0000 7f2bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824037 cookie 94663734123872 notifier 5955 bl.length()=165 2024-03-04T12:45:03.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.386+0000 7f2ba8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:45:03.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.388+0000 7f2cf692d800 20 remove_watcher() i=0 2024-03-04T12:45:03.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.388+0000 7f2cf692d800 2 removed watcher, disabling cache 2024-03-04T12:45:03.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.389+0000 7f2cf692d800 20 remove_watcher() i=1 2024-03-04T12:45:03.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.390+0000 7f2cf692d800 20 remove_watcher() i=2 2024-03-04T12:45:03.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.391+0000 7f2cf692d800 20 remove_watcher() i=3 2024-03-04T12:45:03.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.392+0000 7f2cf692d800 20 remove_watcher() i=4 2024-03-04T12:45:03.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.393+0000 7f2cf692d800 20 remove_watcher() i=5 2024-03-04T12:45:03.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.394+0000 7f2cf692d800 20 remove_watcher() i=6 2024-03-04T12:45:03.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.395+0000 7f2cf692d800 20 remove_watcher() i=7 2024-03-04T12:45:03.411 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-03-04T12:45:03.507 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:45:03.507 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:45:03.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.530+0000 7f2d60533800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.531+0000 7f2d60533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.531+0000 7f2d60533800 20 realm 2024-03-04T12:45:03.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.531+0000 7f2d60533800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.531+0000 7f2d60533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.531+0000 7f2d60533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:45:03.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.531+0000 7f2d60533800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.531+0000 7f2d60533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.531+0000 7f2d60533800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.532+0000 7f2d60533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:45:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.532+0000 7f2d60533800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.533+0000 7f2d60533800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:45:03.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.533+0000 7f2d60533800 20 searching for the correct realm 2024-03-04T12:45:03.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.535+0000 7f2d53a63640 0 -- 172.21.15.90:0/264347050 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f2d4406f070 msgr2=0x7f2d440992e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:45:03.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.539+0000 7f2d5c264640 0 -- 172.21.15.90:0/264347050 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f2d440af7a0 msgr2=0x7f2d440989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:45:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.745+0000 7f2d60533800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:45:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.745+0000 7f2d60533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:45:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.745+0000 7f2d60533800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:45:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.745+0000 7f2d60533800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:45:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.745+0000 7f2d60533800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:45:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.745+0000 7f2d60533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:45:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.745+0000 7f2d60533800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.745+0000 7f2d60533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.745+0000 7f2d60533800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.745+0000 7f2d60533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:45:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.745+0000 7f2d60533800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:45:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 20 zone default found 2024-03-04T12:45:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 4 Realm: () 2024-03-04T12:45:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:45:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:45:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:45:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 20 zonegroup default 2024-03-04T12:45:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:03.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 20 started sync module instance, tier type = 2024-03-04T12:45:03.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.746+0000 7f2d60533800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:45:03.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.755+0000 7f2d60533800 20 add_watcher() i=0 2024-03-04T12:45:03.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.755+0000 7f2d60533800 20 add_watcher() i=1 2024-03-04T12:45:03.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.755+0000 7f2d60533800 20 add_watcher() i=2 2024-03-04T12:45:03.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.755+0000 7f2d60533800 20 add_watcher() i=3 2024-03-04T12:45:03.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.755+0000 7f2d60533800 20 add_watcher() i=4 2024-03-04T12:45:03.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.755+0000 7f2d60533800 20 add_watcher() i=5 2024-03-04T12:45:03.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.755+0000 7f2d60533800 20 add_watcher() i=6 2024-03-04T12:45:03.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.756+0000 7f2d60533800 20 add_watcher() i=7 2024-03-04T12:45:03.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.756+0000 7f2d60533800 2 all 8 watchers are set, enabling cache 2024-03-04T12:45:03.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.757+0000 7f2c127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:45:03.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.757+0000 7f2d60533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:45:03.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.757+0000 7f2d60533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:45:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.790+0000 7f2c117e2640 20 reqs_thread_entry: start 2024-03-04T12:45:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.790+0000 7f2d60533800 20 init_complete bucket index max shards: 11 2024-03-04T12:45:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.790+0000 7f2d60533800 20 Filter name: none 2024-03-04T12:45:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.790+0000 7f2b82ffd640 20 reqs_thread_entry: start 2024-03-04T12:45:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.790+0000 7f2d60533800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-03-04T12:45:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.790+0000 7f2d60533800 20 rados->read ofs=0 len=0 2024-03-04T12:45:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.791+0000 7f2d60533800 20 rados_obj.operate() r=0 bl.length=453 2024-03-04T12:45:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.791+0000 7f2d60533800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-03-04T12:45:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.791+0000 7f2d60533800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-04T12:45:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.791+0000 7f2d60533800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:45:03.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.791+0000 7f2d60533800 10 removing key index: ZHJATEDWFDOGZAJBEZRW 2024-03-04T12:45:03.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.792+0000 7f2d60533800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:ZHJATEDWFDOGZAJBEZRW, ofs0, ns] 2024-03-04T12:45:03.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.793+0000 7f2c3b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824021 cookie 94331164927440 notifier 5672 bl.length()=170 2024-03-04T12:45:03.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.793+0000 7f2d60533800 10 removing email index: sysuser.client.0+test@test.test 2024-03-04T12:45:03.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.794+0000 7f2d60533800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-03-04T12:45:03.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.794+0000 7f2c3b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824038 cookie 94331164924592 notifier 5672 bl.length()=182 2024-03-04T12:45:03.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.795+0000 7f2d60533800 10 removing user buckets index 2024-03-04T12:45:03.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.796+0000 7f2d60533800 10 removing user index: sysuser.client.0 2024-03-04T12:45:03.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.797+0000 7f2d60533800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-03-04T12:45:03.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.797+0000 7f2d60533800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-03-04T12:45:03.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.797+0000 7f2c3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824022 cookie 94331164927440 notifier 5672 bl.length()=165 2024-03-04T12:45:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.798+0000 7f2c127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:45:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.800+0000 7f2d60533800 20 remove_watcher() i=0 2024-03-04T12:45:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.800+0000 7f2d60533800 2 removed watcher, disabling cache 2024-03-04T12:45:03.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.801+0000 7f2d60533800 20 remove_watcher() i=1 2024-03-04T12:45:03.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.802+0000 7f2d60533800 20 remove_watcher() i=2 2024-03-04T12:45:03.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.803+0000 7f2d60533800 20 remove_watcher() i=3 2024-03-04T12:45:03.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.804+0000 7f2d60533800 20 remove_watcher() i=4 2024-03-04T12:45:03.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.805+0000 7f2d60533800 20 remove_watcher() i=5 2024-03-04T12:45:03.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.806+0000 7f2d60533800 20 remove_watcher() i=6 2024-03-04T12:45:03.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:45:03.807+0000 7f2d60533800 20 remove_watcher() i=7 2024-03-04T12:45:03.823 INFO:tasks.ragweed:Removing ragweed... 2024-03-04T12:45:03.824 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-03-04T12:45:03.894 INFO:teuthology.run_tasks:Running task workunit... 2024-03-04T12:45:03.904 INFO:tasks.workunit:Pulling workunits from ref 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:45:03.904 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-04T12:45:03.904 DEBUG:teuthology.orchestra.run.smithi090:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:45:03.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:45:03.932 INFO:teuthology.orchestra.run.smithi090.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-04T12:45:03.932 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:45:03.999 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-04T12:45:04.000 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-04T12:45:04.067 INFO:tasks.workunit:timeout=3h 2024-03-04T12:45:04.067 INFO:tasks.workunit:cleanup=True 2024-03-04T12:45:04.067 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:45:04.134 INFO:tasks.workunit.client.0.smithi090.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-04T12:45:45.047 INFO:tasks.workunit.client.0.smithi090.stderr:Note: switching to '3aec390336fdfdc8f927818b718cfb0361bd47c8'. 2024-03-04T12:45:45.048 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:45:45.048 INFO:tasks.workunit.client.0.smithi090.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-04T12:45:45.048 INFO:tasks.workunit.client.0.smithi090.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-04T12:45:45.048 INFO:tasks.workunit.client.0.smithi090.stderr:state without impacting any branches by switching back to a branch. 2024-03-04T12:45:45.048 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:45:45.048 INFO:tasks.workunit.client.0.smithi090.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-04T12:45:45.048 INFO:tasks.workunit.client.0.smithi090.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-04T12:45:45.048 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:45:45.048 INFO:tasks.workunit.client.0.smithi090.stderr: git switch -c 2024-03-04T12:45:45.048 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:45:45.048 INFO:tasks.workunit.client.0.smithi090.stderr:Or undo this operation with: 2024-03-04T12:45:45.049 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:45:45.049 INFO:tasks.workunit.client.0.smithi090.stderr: git switch - 2024-03-04T12:45:45.049 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:45:45.049 INFO:tasks.workunit.client.0.smithi090.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-04T12:45:45.049 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:45:45.049 INFO:tasks.workunit.client.0.smithi090.stderr:HEAD is now at 3aec390336f qa/d4n: Start redis up before rgw 2024-03-04T12:45:45.052 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-04T12:45:45.121 INFO:tasks.workunit.client.0.smithi090.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-04T12:45:45.123 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:45:45.123 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-04T12:45:45.171 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-04T12:45:45.219 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-04T12:45:45.258 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:45:45.259 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:45:45.259 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-04T12:45:45.297 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:45:45.300 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:45:45.301 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-04T12:45:45.368 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-03-04T12:45:45.369 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-03-04T12:45:45.370 DEBUG:teuthology.orchestra.run.smithi090:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-03-04T12:45:45.440 INFO:tasks.workunit.client.0.smithi090.stderr:+ ulimit -c 0 2024-03-04T12:45:45.440 INFO:tasks.workunit.client.0.smithi090.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-03-04T12:45:45.440 INFO:tasks.workunit.client.0.smithi090.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:45:45.441 INFO:tasks.workunit.client.0.smithi090.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:45:47.843 INFO:tasks.workunit.client.0.smithi090.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-03-04T12:45:47.843 INFO:tasks.workunit.client.0.smithi090.stderr:++ deactivate nondestructive 2024-03-04T12:45:47.843 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -n '' ']' 2024-03-04T12:45:47.843 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -n '' ']' 2024-03-04T12:45:47.843 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:45:47.844 INFO:tasks.workunit.client.0.smithi090.stderr:++ hash -r 2024-03-04T12:45:47.844 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -n '' ']' 2024-03-04T12:45:47.844 INFO:tasks.workunit.client.0.smithi090.stderr:++ unset VIRTUAL_ENV 2024-03-04T12:45:47.844 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-03-04T12:45:47.844 INFO:tasks.workunit.client.0.smithi090.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:45:47.844 INFO:tasks.workunit.client.0.smithi090.stderr:++ export VIRTUAL_ENV 2024-03-04T12:45:47.844 INFO:tasks.workunit.client.0.smithi090.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:45:47.845 INFO:tasks.workunit.client.0.smithi090.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:45:47.845 INFO:tasks.workunit.client.0.smithi090.stderr:++ export PATH 2024-03-04T12:45:47.845 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -n '' ']' 2024-03-04T12:45:47.845 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -z '' ']' 2024-03-04T12:45:47.845 INFO:tasks.workunit.client.0.smithi090.stderr:++ _OLD_VIRTUAL_PS1= 2024-03-04T12:45:47.845 INFO:tasks.workunit.client.0.smithi090.stderr:++ PS1='(rgw) ' 2024-03-04T12:45:47.845 INFO:tasks.workunit.client.0.smithi090.stderr:++ export PS1 2024-03-04T12:45:47.846 INFO:tasks.workunit.client.0.smithi090.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:45:47.846 INFO:tasks.workunit.client.0.smithi090.stderr:++ hash -r 2024-03-04T12:45:47.846 INFO:tasks.workunit.client.0.smithi090.stderr:+ pip install pip --upgrade 2024-03-04T12:45:48.070 INFO:tasks.workunit.client.0.smithi090.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-04T12:45:48.278 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting pip 2024-03-04T12:45:48.284 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-04T12:45:48.332 INFO:tasks.workunit.client.0.smithi090.stdout:Installing collected packages: pip 2024-03-04T12:45:48.332 INFO:tasks.workunit.client.0.smithi090.stdout: Attempting uninstall: pip 2024-03-04T12:45:48.332 INFO:tasks.workunit.client.0.smithi090.stdout: Found existing installation: pip 21.2.3 2024-03-04T12:45:48.479 INFO:tasks.workunit.client.0.smithi090.stdout: Uninstalling pip-21.2.3: 2024-03-04T12:45:48.484 INFO:tasks.workunit.client.0.smithi090.stdout: Successfully uninstalled pip-21.2.3 2024-03-04T12:45:49.455 INFO:tasks.workunit.client.0.smithi090.stdout:Successfully installed pip-24.0 2024-03-04T12:45:49.506 INFO:tasks.workunit.client.0.smithi090.stderr:+ pip install boto3 2024-03-04T12:45:50.413 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting boto3 2024-03-04T12:45:50.415 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached boto3-1.34.54-py3-none-any.whl.metadata (6.6 kB) 2024-03-04T12:45:50.978 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting botocore<1.35.0,>=1.34.54 (from boto3) 2024-03-04T12:45:50.980 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached botocore-1.34.54-py3-none-any.whl.metadata (5.7 kB) 2024-03-04T12:45:51.124 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-04T12:45:51.125 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-04T12:45:51.211 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-04T12:45:51.212 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-04T12:45:51.296 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:45:51.297 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-04T12:45:51.406 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:45:51.407 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-03-04T12:45:51.635 INFO:tasks.workunit.client.0.smithi090.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:45:51.636 INFO:tasks.workunit.client.0.smithi090.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-04T12:45:51.660 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached boto3-1.34.54-py3-none-any.whl (139 kB) 2024-03-04T12:45:51.661 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached botocore-1.34.54-py3-none-any.whl (12.0 MB) 2024-03-04T12:45:51.682 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-04T12:45:51.683 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-04T12:45:51.684 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-04T12:45:51.686 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-03-04T12:45:51.687 INFO:tasks.workunit.client.0.smithi090.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-04T12:45:51.792 INFO:tasks.workunit.client.0.smithi090.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-04T12:45:52.828 INFO:tasks.workunit.client.0.smithi090.stdout:Successfully installed boto3-1.34.54 botocore-1.34.54 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-03-04T12:45:52.964 INFO:tasks.workunit.client.0.smithi090.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-03-04T12:45:53.091 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-03-04T12:45:53.123 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:45:53.123 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:45:53.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.150+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.151+0000 7fe2ff12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:53.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.151+0000 7fe2ff12c800 20 realm 2024-03-04T12:45:53.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.151+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.152+0000 7fe2ff12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:53.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.152+0000 7fe2ff12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:45:53.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.152+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.152+0000 7fe2ff12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:53.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.152+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.153+0000 7fe2ff12c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:45:53.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.153+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.153+0000 7fe2ff12c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:45:53.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.153+0000 7fe2ff12c800 20 searching for the correct realm 2024-03-04T12:45:53.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.157+0000 7fe2fb662640 0 -- 172.21.15.90:0/62278257 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x55c458a9dcf0 msgr2=0x55c458aa0120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:45:53.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.160+0000 7fe2f2660640 0 -- 172.21.15.90:0/62278257 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fe2e4061070 msgr2=0x7fe2e40863f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:45:53.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:45:53.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:45:53.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:45:53.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:45:53.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:45:53.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:45:53.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:53.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:45:53.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 zone default found 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 4 Realm: () 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 zonegroup default 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.165+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.166+0000 7fe2ff12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.166+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.166+0000 7fe2ff12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.166+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.166+0000 7fe2ff12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:53.174 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.166+0000 7fe2ff12c800 20 started sync module instance, tier type = 2024-03-04T12:45:53.174 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.166+0000 7fe2ff12c800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:45:53.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.176+0000 7fe2ff12c800 20 add_watcher() i=0 2024-03-04T12:45:53.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.176+0000 7fe2ff12c800 20 add_watcher() i=1 2024-03-04T12:45:53.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.176+0000 7fe2ff12c800 20 add_watcher() i=2 2024-03-04T12:45:53.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.176+0000 7fe2ff12c800 20 add_watcher() i=3 2024-03-04T12:45:53.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.176+0000 7fe2ff12c800 20 add_watcher() i=4 2024-03-04T12:45:53.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.176+0000 7fe2ff12c800 20 add_watcher() i=5 2024-03-04T12:45:53.182 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.176+0000 7fe2ff12c800 20 add_watcher() i=6 2024-03-04T12:45:53.183 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.177+0000 7fe2ff12c800 20 add_watcher() i=7 2024-03-04T12:45:53.183 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.177+0000 7fe2ff12c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:45:53.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.179+0000 7fe1b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:45:53.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.179+0000 7fe2ff12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:45:53.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.179+0000 7fe2ff12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:45:53.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.179+0000 7fe2ff12c800 5 note: GC not initialized 2024-03-04T12:45:53.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.179+0000 7fe12bfff640 20 reqs_thread_entry: start 2024-03-04T12:45:53.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.179+0000 7fe2ff12c800 20 init_complete bucket index max shards: 11 2024-03-04T12:45:53.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.179+0000 7fe2ff12c800 20 Filter name: none 2024-03-04T12:45:53.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.179+0000 7fe129ffb640 20 reqs_thread_entry: start 2024-03-04T12:45:53.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.179+0000 7fe2ff12c800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-03-04T12:45:53.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.179+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.180+0000 7fe2ff12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:53.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.180+0000 7fe2ff12c800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-03-04T12:45:53.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.180+0000 7fe2ff12c800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-03-04T12:45:53.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.180+0000 7fe2ff12c800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-03-04T12:45:53.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.180+0000 7fe2ff12c800 20 rados->read ofs=0 len=0 2024-03-04T12:45:53.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.180+0000 7fe2ff12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:45:53.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.180+0000 7fe2ff12c800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-03-04T12:45:53.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.180+0000 7fe2ff12c800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-04T12:45:53.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.180+0000 7fe2ff12c800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-03-04T12:45:53.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.180+0000 7fe2ff12c800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-03-04T12:45:53.188 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.181+0000 7fe2ff12c800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-03-04T12:45:53.188 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.181+0000 7fe2ff12c800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-03-04T12:45:53.188 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.181+0000 7fe2ff12c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-03-04T12:45:53.188 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.182+0000 7fe1de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824064 cookie 94301789556384 notifier 5991 bl.length()=536 2024-03-04T12:45:53.188 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.182+0000 7fe1de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-03-04T12:45:53.188 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.182+0000 7fe1de7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-03-04T12:45:53.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.183+0000 7fe2ff12c800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-04T12:45:53.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.183+0000 7fe2ff12c800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-04T12:45:53.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.183+0000 7fe2ff12c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-03-04T12:45:53.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.183+0000 7fe1de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824065 cookie 94301789552544 notifier 5991 bl.length()=180 2024-03-04T12:45:53.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.183+0000 7fe1de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-04T12:45:53.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.183+0000 7fe1de7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-04T12:45:53.190 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.184+0000 7fe1b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:45:53.192 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.187+0000 7fe2ff12c800 20 remove_watcher() i=0 2024-03-04T12:45:53.192 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.187+0000 7fe2ff12c800 2 removed watcher, disabling cache 2024-03-04T12:45:53.193 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.188+0000 7fe2ff12c800 20 remove_watcher() i=1 2024-03-04T12:45:53.194 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.189+0000 7fe2ff12c800 20 remove_watcher() i=2 2024-03-04T12:45:53.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.190+0000 7fe2ff12c800 20 remove_watcher() i=3 2024-03-04T12:45:53.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.191+0000 7fe2ff12c800 20 remove_watcher() i=4 2024-03-04T12:45:53.198 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.192+0000 7fe2ff12c800 20 remove_watcher() i=5 2024-03-04T12:45:53.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.193+0000 7fe2ff12c800 20 remove_watcher() i=6 2024-03-04T12:45:53.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:45:53.194+0000 7fe2ff12c800 20 remove_watcher() i=7 2024-03-04T12:46:03.476 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:03.476 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:03.521 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:03.521 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:03.535 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:03.535 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:03.550 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:03.550 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:03.556 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:03.556 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:03.599 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:03.599 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:03.641 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard add 2024-03-04T12:46:03.641 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:03.642 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-04T12:46:03.671 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:03.671 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:03.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.698+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.700+0000 7fd281d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:03.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.700+0000 7fd281d2c800 20 realm 2024-03-04T12:46:03.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.700+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.700+0000 7fd281d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:03.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.700+0000 7fd281d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:03.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.700+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.700+0000 7fd281d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:03.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.700+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.701+0000 7fd281d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:03.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.701+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.702+0000 7fd281d2c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:03.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.702+0000 7fd281d2c800 20 searching for the correct realm 2024-03-04T12:46:03.712 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.705+0000 7fd27e262640 0 -- 172.21.15.90:0/2627336708 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x556f6591a680 msgr2=0x556f6591cb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:03.716 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.709+0000 7fd27da61640 0 -- 172.21.15.90:0/2627336708 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fd268091930 msgr2=0x7fd2680763b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:03.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.713+0000 7fd281d2c800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:03.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.713+0000 7fd281d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:03.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.713+0000 7fd281d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:03.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.713+0000 7fd281d2c800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:03.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.713+0000 7fd281d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:03.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.713+0000 7fd281d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:03.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.713+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.713+0000 7fd281d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:03.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.713+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:03.721 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.722 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:03.722 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 20 zone default found 2024-03-04T12:46:03.722 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 4 Realm: () 2024-03-04T12:46:03.722 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:03.722 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:03.722 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:03.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 20 zonegroup default 2024-03-04T12:46:03.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:03.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.714+0000 7fd281d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:03.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.715+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.715+0000 7fd281d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:03.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.715+0000 7fd281d2c800 20 started sync module instance, tier type = 2024-03-04T12:46:03.723 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.715+0000 7fd281d2c800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:03.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.724+0000 7fd281d2c800 20 add_watcher() i=0 2024-03-04T12:46:03.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.724+0000 7fd281d2c800 20 add_watcher() i=1 2024-03-04T12:46:03.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.724+0000 7fd281d2c800 20 add_watcher() i=2 2024-03-04T12:46:03.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.724+0000 7fd281d2c800 20 add_watcher() i=3 2024-03-04T12:46:03.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.724+0000 7fd281d2c800 20 add_watcher() i=4 2024-03-04T12:46:03.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.724+0000 7fd281d2c800 20 add_watcher() i=5 2024-03-04T12:46:03.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.724+0000 7fd281d2c800 20 add_watcher() i=6 2024-03-04T12:46:03.731 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.725+0000 7fd281d2c800 20 add_watcher() i=7 2024-03-04T12:46:03.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.725+0000 7fd281d2c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:03.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.726+0000 7fd12f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:03.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.727+0000 7fd281d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:03.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.727+0000 7fd281d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:03.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.727+0000 7fd281d2c800 5 note: GC not initialized 2024-03-04T12:46:03.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.727+0000 7fd12e7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:03.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.727+0000 7fd281d2c800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:03.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.727+0000 7fd281d2c800 20 Filter name: none 2024-03-04T12:46:03.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.727+0000 7fd09ffff640 20 reqs_thread_entry: start 2024-03-04T12:46:03.735 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.727+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.728+0000 7fd281d2c800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:46:03.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.728+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.729+0000 7fd281d2c800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:46:03.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.729+0000 7fd281d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:03.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.729+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.729+0000 7fd281d2c800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:46:03.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.729+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.730+0000 7fd281d2c800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:46:03.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.730+0000 7fd281d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:03.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.731+0000 7fd281d2c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.731+0000 7fd281d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:03.738 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.732+0000 7fd12f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:03.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.734+0000 7fd281d2c800 20 remove_watcher() i=0 2024-03-04T12:46:03.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.734+0000 7fd281d2c800 2 removed watcher, disabling cache 2024-03-04T12:46:03.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.735+0000 7fd281d2c800 20 remove_watcher() i=1 2024-03-04T12:46:03.742 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.736+0000 7fd281d2c800 20 remove_watcher() i=2 2024-03-04T12:46:03.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.737+0000 7fd281d2c800 20 remove_watcher() i=3 2024-03-04T12:46:03.744 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.738+0000 7fd281d2c800 20 remove_watcher() i=4 2024-03-04T12:46:03.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.739+0000 7fd281d2c800 20 remove_watcher() i=5 2024-03-04T12:46:03.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.740+0000 7fd281d2c800 20 remove_watcher() i=6 2024-03-04T12:46:03.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.740+0000 7fd281d2c800 20 remove_watcher() i=7 2024-03-04T12:46:03.756 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:03.756 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:03.757 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: a-bucket id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-03-04T12:46:03.757 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:03.758 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-03-04T12:46:03.788 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:03.788 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:03.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.813+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.821 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.814+0000 7fb6e812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:03.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.814+0000 7fb6e812d800 20 realm 2024-03-04T12:46:03.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.814+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.815+0000 7fb6e812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:03.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.815+0000 7fb6e812d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:03.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.815+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.815+0000 7fb6e812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:03.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.815+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.816+0000 7fb6e812d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:03.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.816+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:03.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.816+0000 7fb6e812d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:03.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.816+0000 7fb6e812d800 20 searching for the correct realm 2024-03-04T12:46:03.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:03.820+0000 7fb6e457b640 0 -- 172.21.15.90:0/3960008354 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7fb6cc068040 msgr2=0x7fb6cc08c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:04.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.026+0000 7fb6e3d7a640 0 -- 172.21.15.90:0/3960008354 >> [v2:172.21.15.184:6824/1880219084,v1:172.21.15.184:6825/1880219084] conn(0x560066ec6720 msgr2=0x560066ec8b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:04.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.029+0000 7fb6e812d800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:04.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.029+0000 7fb6e812d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:04.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.029+0000 7fb6e812d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:04.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.029+0000 7fb6e812d800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:04.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.029+0000 7fb6e812d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:04.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.029+0000 7fb6e812d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:04.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.029+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.029+0000 7fb6e812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.029+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.030+0000 7fb6e812d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:04.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.030+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.030+0000 7fb6e812d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:04.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.030+0000 7fb6e812d800 20 zone default found 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.030+0000 7fb6e812d800 4 Realm: () 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.030+0000 7fb6e812d800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.030+0000 7fb6e812d800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.030+0000 7fb6e812d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.030+0000 7fb6e812d800 20 zonegroup default 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.030+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.030+0000 7fb6e812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.030+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.031+0000 7fb6e812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.031+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.031+0000 7fb6e812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.031+0000 7fb6e812d800 20 started sync module instance, tier type = 2024-03-04T12:46:04.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.031+0000 7fb6e812d800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:04.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.040+0000 7fb6e812d800 20 add_watcher() i=0 2024-03-04T12:46:04.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.040+0000 7fb6e812d800 20 add_watcher() i=1 2024-03-04T12:46:04.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.040+0000 7fb6e812d800 20 add_watcher() i=2 2024-03-04T12:46:04.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.040+0000 7fb6e812d800 20 add_watcher() i=3 2024-03-04T12:46:04.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.040+0000 7fb6e812d800 20 add_watcher() i=4 2024-03-04T12:46:04.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.040+0000 7fb6e812d800 20 add_watcher() i=5 2024-03-04T12:46:04.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.040+0000 7fb6e812d800 20 add_watcher() i=6 2024-03-04T12:46:04.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.041+0000 7fb6e812d800 20 add_watcher() i=7 2024-03-04T12:46:04.048 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.041+0000 7fb6e812d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:04.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.043+0000 7fb599fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:04.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.043+0000 7fb6e812d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:04.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.043+0000 7fb6e812d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:04.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.043+0000 7fb6e812d800 5 note: GC not initialized 2024-03-04T12:46:04.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.043+0000 7fb598fe1640 20 reqs_thread_entry: start 2024-03-04T12:46:04.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.043+0000 7fb6e812d800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:04.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.043+0000 7fb6e812d800 20 Filter name: none 2024-03-04T12:46:04.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.044+0000 7fb5127fc640 20 reqs_thread_entry: start 2024-03-04T12:46:04.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.044+0000 7fb6e812d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-04T12:46:04.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.044+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.044+0000 7fb6e812d800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:46:04.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.044+0000 7fb6e812d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-04T12:46:04.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.044+0000 7fb6e812d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-04T12:46:04.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.044+0000 7fb6e812d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 : miss 2024-03-04T12:46:04.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.044+0000 7fb6e812d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.045+0000 7fb6e812d800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:46:04.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.045+0000 7fb6e812d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:46:04.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.045+0000 7fb6e812d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:46:04.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.045+0000 7fb6e812d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:04.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.045+0000 7fb6e812d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:46:04.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.045+0000 7fb6e812d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 2024-03-04T12:46:04.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.046+0000 7fb599fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:04.055 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.049+0000 7fb6e812d800 20 remove_watcher() i=0 2024-03-04T12:46:04.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.049+0000 7fb6e812d800 2 removed watcher, disabling cache 2024-03-04T12:46:04.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.050+0000 7fb6e812d800 20 remove_watcher() i=1 2024-03-04T12:46:04.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.051+0000 7fb6e812d800 20 remove_watcher() i=2 2024-03-04T12:46:04.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.052+0000 7fb6e812d800 20 remove_watcher() i=3 2024-03-04T12:46:04.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.053+0000 7fb6e812d800 20 remove_watcher() i=4 2024-03-04T12:46:04.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.054+0000 7fb6e812d800 20 remove_watcher() i=5 2024-03-04T12:46:04.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.055+0000 7fb6e812d800 20 remove_watcher() i=6 2024-03-04T12:46:04.062 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.056+0000 7fb6e812d800 20 remove_watcher() i=7 2024-03-04T12:46:04.073 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin reshard list 2024-03-04T12:46:04.098 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:04.099 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:04.131 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.125+0000 7fa48de85800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.126+0000 7fa48de85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.126+0000 7fa48de85800 20 realm 2024-03-04T12:46:04.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.126+0000 7fa48de85800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.126+0000 7fa48de85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.126+0000 7fa48de85800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:04.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.126+0000 7fa48de85800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.126+0000 7fa48de85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.126+0000 7fa48de85800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.127+0000 7fa48de85800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:04.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.127+0000 7fa48de85800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.128+0000 7fa48de85800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:04.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.128+0000 7fa48de85800 20 searching for the correct realm 2024-03-04T12:46:04.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.131+0000 7fa48c182640 0 -- 172.21.15.90:0/1780596085 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x55c9dc683870 msgr2=0x55c9dc685d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:04.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.134+0000 7fa48b981640 0 -- 172.21.15.90:0/1780596085 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fa48007c6e0 msgr2=0x7fa480092040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:04.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.139+0000 7fa48de85800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:04.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.139+0000 7fa48de85800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:04.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.139+0000 7fa48de85800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:04.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.139+0000 7fa48de85800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:04.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.139+0000 7fa48de85800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:04.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.139+0000 7fa48de85800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:04.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.139+0000 7fa48de85800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:04.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:04.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 20 zone default found 2024-03-04T12:46:04.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 4 Realm: () 2024-03-04T12:46:04.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:04.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:04.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:04.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 20 zonegroup default 2024-03-04T12:46:04.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.140+0000 7fa48de85800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.141+0000 7fa48de85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.141+0000 7fa48de85800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.141+0000 7fa48de85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.141+0000 7fa48de85800 20 started sync module instance, tier type = 2024-03-04T12:46:04.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.141+0000 7fa48de85800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:04.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.150+0000 7fa48de85800 20 add_watcher() i=0 2024-03-04T12:46:04.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.150+0000 7fa48de85800 20 add_watcher() i=1 2024-03-04T12:46:04.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.150+0000 7fa48de85800 20 add_watcher() i=2 2024-03-04T12:46:04.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.150+0000 7fa48de85800 20 add_watcher() i=3 2024-03-04T12:46:04.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.150+0000 7fa48de85800 20 add_watcher() i=4 2024-03-04T12:46:04.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.150+0000 7fa48de85800 20 add_watcher() i=5 2024-03-04T12:46:04.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.150+0000 7fa48de85800 20 add_watcher() i=6 2024-03-04T12:46:04.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.151+0000 7fa48de85800 20 add_watcher() i=7 2024-03-04T12:46:04.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.151+0000 7fa48de85800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:04.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.153+0000 7fa341fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:04.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.153+0000 7fa48de85800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:04.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.153+0000 7fa48de85800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:04.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.153+0000 7fa48de85800 5 note: GC not initialized 2024-03-04T12:46:04.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.153+0000 7fa340fe1640 20 reqs_thread_entry: start 2024-03-04T12:46:04.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.153+0000 7fa48de85800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:04.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.153+0000 7fa48de85800 20 Filter name: none 2024-03-04T12:46:04.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.153+0000 7fa2ba7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:04.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.159+0000 7fa341fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:04.168 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.162+0000 7fa48de85800 20 remove_watcher() i=0 2024-03-04T12:46:04.168 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.162+0000 7fa48de85800 2 removed watcher, disabling cache 2024-03-04T12:46:04.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.163+0000 7fa48de85800 20 remove_watcher() i=1 2024-03-04T12:46:04.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.164+0000 7fa48de85800 20 remove_watcher() i=2 2024-03-04T12:46:04.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.165+0000 7fa48de85800 20 remove_watcher() i=3 2024-03-04T12:46:04.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.166+0000 7fa48de85800 20 remove_watcher() i=4 2024-03-04T12:46:04.174 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.167+0000 7fa48de85800 20 remove_watcher() i=5 2024-03-04T12:46:04.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.168+0000 7fa48de85800 20 remove_watcher() i=6 2024-03-04T12:46:04.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.169+0000 7fa48de85800 20 remove_watcher() i=7 2024-03-04T12:46:04.185 INFO:tasks.workunit.client.0.smithi090.stderr:bucket name a-bucket 2024-03-04T12:46:04.185 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard process 2024-03-04T12:46:04.185 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:04.187 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin reshard process 2024-03-04T12:46:04.212 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:04.212 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:04.246 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.239+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.240+0000 7f817c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.240+0000 7f817c8c0800 20 realm 2024-03-04T12:46:04.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.240+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.240+0000 7f817c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.240+0000 7f817c8c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:04.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.240+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.240+0000 7f817c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.240+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.241+0000 7f817c8c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:04.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.241+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.242+0000 7f817c8c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:04.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.242+0000 7f817c8c0800 20 searching for the correct realm 2024-03-04T12:46:04.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.243+0000 7f817a3bc640 0 -- 172.21.15.90:0/2981101660 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x56426e4ade80 msgr2=0x7f81740b2280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:04.254 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.247+0000 7f817a3bc640 0 -- 172.21.15.90:0/2981101660 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f8044079d00 msgr2=0x7f804407c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:04.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.253+0000 7f817c8c0800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:04.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.253+0000 7f817c8c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:04.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.253+0000 7f817c8c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:04.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.253+0000 7f817c8c0800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:04.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.253+0000 7f817c8c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:04.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.253+0000 7f817c8c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:04.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.253+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.260 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.253+0000 7f817c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.253+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.253+0000 7f817c8c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:04.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.253+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:04.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 20 zone default found 2024-03-04T12:46:04.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 4 Realm: () 2024-03-04T12:46:04.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:04.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:04.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:04.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 20 zonegroup default 2024-03-04T12:46:04.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:04.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 20 started sync module instance, tier type = 2024-03-04T12:46:04.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.254+0000 7f817c8c0800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:04.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.263+0000 7f817c8c0800 20 add_watcher() i=0 2024-03-04T12:46:04.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.263+0000 7f817c8c0800 20 add_watcher() i=1 2024-03-04T12:46:04.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.263+0000 7f817c8c0800 20 add_watcher() i=2 2024-03-04T12:46:04.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.263+0000 7f817c8c0800 20 add_watcher() i=3 2024-03-04T12:46:04.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.263+0000 7f817c8c0800 20 add_watcher() i=4 2024-03-04T12:46:04.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.263+0000 7f817c8c0800 20 add_watcher() i=5 2024-03-04T12:46:04.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.263+0000 7f817c8c0800 20 add_watcher() i=6 2024-03-04T12:46:04.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.264+0000 7f817c8c0800 20 add_watcher() i=7 2024-03-04T12:46:04.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.264+0000 7f817c8c0800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:04.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.266+0000 7f8030fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:04.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.266+0000 7f817c8c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:04.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.266+0000 7f817c8c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:04.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.266+0000 7f817c8c0800 5 note: GC not initialized 2024-03-04T12:46:04.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.266+0000 7f7fab7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:04.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.266+0000 7f817c8c0800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:04.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.267+0000 7f817c8c0800 20 Filter name: none 2024-03-04T12:46:04.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.267+0000 7f7fa97fa640 20 reqs_thread_entry: start 2024-03-04T12:46:04.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.267+0000 7f817c8c0800 20 processing logshard = reshard.0000000000 2024-03-04T12:46:04.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.269+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-03-04T12:46:04.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.269+0000 7f817c8c0800 20 processing logshard = reshard.0000000001 2024-03-04T12:46:04.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.271+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-03-04T12:46:04.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.271+0000 7f817c8c0800 20 processing logshard = reshard.0000000002 2024-03-04T12:46:04.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.274+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-03-04T12:46:04.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.274+0000 7f817c8c0800 20 processing logshard = reshard.0000000003 2024-03-04T12:46:04.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.276+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-03-04T12:46:04.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.276+0000 7f817c8c0800 20 processing logshard = reshard.0000000004 2024-03-04T12:46:04.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.278+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-03-04T12:46:04.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.278+0000 7f817c8c0800 20 processing logshard = reshard.0000000005 2024-03-04T12:46:04.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.281+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-03-04T12:46:04.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.281+0000 7f817c8c0800 20 processing logshard = reshard.0000000006 2024-03-04T12:46:04.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.283+0000 7f817c8c0800 20 process_entry resharding a-bucket 2024-03-04T12:46:04.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.283+0000 7f817c8c0800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-04T12:46:04.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.283+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.283+0000 7f817c8c0800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:46:04.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.283+0000 7f817c8c0800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-03-04T12:46:04.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.283+0000 7f817c8c0800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-04T12:46:04.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.283+0000 7f817c8c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 : miss 2024-03-04T12:46:04.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.283+0000 7f817c8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.284+0000 7f817c8c0800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:46:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.284+0000 7f817c8c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:46:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.284+0000 7f817c8c0800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:46:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.284+0000 7f817c8c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:04.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.284+0000 7f817c8c0800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:46:04.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.284+0000 7f817c8c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 2024-03-04T12:46:04.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.292+0000 7f817c8c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:46:04.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.292+0000 7f817c8c0800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:46:04.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.293+0000 7f817c8c0800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:46:04.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.293+0000 7f817c8c0800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17, ofs0, ns] 2024-03-04T12:46:04.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.293+0000 7f805dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824056 cookie 94843320794912 notifier 5756 bl.length()=789 2024-03-04T12:46:04.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.293+0000 7f805dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:46:04.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.293+0000 7f805dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:46:04.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.293+0000 7f805dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:46:04.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.293+0000 7f817c8c0800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): orig_sources= new_sources= 2024-03-04T12:46:04.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.293+0000 7f817c8c0800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): potential sources added=[] removed=[] 2024-03-04T12:46:04.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.293+0000 7f817c8c0800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): orig_dests= new_dests= 2024-03-04T12:46:04.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.293+0000 7f817c8c0800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): potential dests added=[] removed=[] 2024-03-04T12:46:04.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.0 2024-03-04T12:46:04.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.0 2024-03-04T12:46:04.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.1 2024-03-04T12:46:04.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.1 2024-03-04T12:46:04.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.2 2024-03-04T12:46:04.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.2 2024-03-04T12:46:04.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.3 2024-03-04T12:46:04.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.3 2024-03-04T12:46:04.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.4 2024-03-04T12:46:04.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.4 2024-03-04T12:46:04.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.5 2024-03-04T12:46:04.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.5 2024-03-04T12:46:04.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.6 2024-03-04T12:46:04.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.6 2024-03-04T12:46:04.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.7 2024-03-04T12:46:04.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.7 2024-03-04T12:46:04.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.8 2024-03-04T12:46:04.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.8 2024-03-04T12:46:04.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.9 2024-03-04T12:46:04.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.9 2024-03-04T12:46:04.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.10 2024-03-04T12:46:04.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.10 2024-03-04T12:46:04.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.11 2024-03-04T12:46:04.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.11 2024-03-04T12:46:04.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.0 2024-03-04T12:46:04.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.296+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1 2024-03-04T12:46:04.306 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.297+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2 2024-03-04T12:46:04.306 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.297+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.3 2024-03-04T12:46:04.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.297+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.4 2024-03-04T12:46:04.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.298+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.5 2024-03-04T12:46:04.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.298+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.6 2024-03-04T12:46:04.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.299+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.7 2024-03-04T12:46:04.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.299+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.8 2024-03-04T12:46:04.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.299+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.9 2024-03-04T12:46:04.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.300+0000 7f817c8c0800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.10 2024-03-04T12:46:04.308 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.300+0000 7f817c8c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 : hit (requested=0x17, cached=0x17) 2024-03-04T12:46:04.308 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.300+0000 7f817c8c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 2024-03-04T12:46:04.308 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.301+0000 7f817c8c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:46:04.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.301+0000 7f817c8c0800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:46:04.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.301+0000 7f817c8c0800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:46:04.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.301+0000 7f817c8c0800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17, ofs0, ns] 2024-03-04T12:46:04.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.302+0000 7f805d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824057 cookie 94843320794912 notifier 5756 bl.length()=757 2024-03-04T12:46:04.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.302+0000 7f805d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:46:04.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.302+0000 7f805d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:46:04.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.302+0000 7f805d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:46:04.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.302+0000 7f817c8c0800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): orig_sources= new_sources= 2024-03-04T12:46:04.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.302+0000 7f817c8c0800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): potential sources added=[] removed=[] 2024-03-04T12:46:04.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.302+0000 7f817c8c0800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): orig_dests= new_dests= 2024-03-04T12:46:04.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.302+0000 7f817c8c0800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): potential dests added=[] removed=[] 2024-03-04T12:46:04.311 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.304+0000 7f817c8c0800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-04T12:46:04.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.305+0000 7f817c8c0800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-03-04T12:46:04.314 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.307+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-03-04T12:46:04.314 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.307+0000 7f817c8c0800 20 processing logshard = reshard.0000000007 2024-03-04T12:46:04.316 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.309+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-03-04T12:46:04.316 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.309+0000 7f817c8c0800 20 processing logshard = reshard.0000000008 2024-03-04T12:46:04.318 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.311+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-03-04T12:46:04.318 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.311+0000 7f817c8c0800 20 processing logshard = reshard.0000000009 2024-03-04T12:46:04.320 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.314+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-03-04T12:46:04.320 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.314+0000 7f817c8c0800 20 processing logshard = reshard.0000000010 2024-03-04T12:46:04.322 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.316+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-03-04T12:46:04.322 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.316+0000 7f817c8c0800 20 processing logshard = reshard.0000000011 2024-03-04T12:46:04.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.318+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-03-04T12:46:04.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.318+0000 7f817c8c0800 20 processing logshard = reshard.0000000012 2024-03-04T12:46:04.327 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.320+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-03-04T12:46:04.327 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.320+0000 7f817c8c0800 20 processing logshard = reshard.0000000013 2024-03-04T12:46:04.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.323+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-03-04T12:46:04.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.323+0000 7f817c8c0800 20 processing logshard = reshard.0000000014 2024-03-04T12:46:04.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.325+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-03-04T12:46:04.332 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.325+0000 7f817c8c0800 20 processing logshard = reshard.0000000015 2024-03-04T12:46:04.334 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.327+0000 7f817c8c0800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-03-04T12:46:04.334 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.328+0000 7f8030fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:04.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.330+0000 7f817c8c0800 20 remove_watcher() i=0 2024-03-04T12:46:04.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.330+0000 7f817c8c0800 2 removed watcher, disabling cache 2024-03-04T12:46:04.337 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.331+0000 7f817c8c0800 20 remove_watcher() i=1 2024-03-04T12:46:04.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.332+0000 7f817c8c0800 20 remove_watcher() i=2 2024-03-04T12:46:04.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.333+0000 7f817c8c0800 20 remove_watcher() i=3 2024-03-04T12:46:04.340 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.334+0000 7f817c8c0800 20 remove_watcher() i=4 2024-03-04T12:46:04.341 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.335+0000 7f817c8c0800 20 remove_watcher() i=5 2024-03-04T12:46:04.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.336+0000 7f817c8c0800 20 remove_watcher() i=6 2024-03-04T12:46:04.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:04.337+0000 7f817c8c0800 20 remove_watcher() i=7 2024-03-04T12:46:09.360 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-04T12:46:09.391 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:09.392 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:09.429 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.424+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.425+0000 7f22ca412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:09.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.425+0000 7f22ca412800 20 realm 2024-03-04T12:46:09.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.425+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.425+0000 7f22ca412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:09.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.425+0000 7f22ca412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:09.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.425+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.426+0000 7f22ca412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:09.432 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.426+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.432 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.426+0000 7f22ca412800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:09.432 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.426+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.427+0000 7f22ca412800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:09.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.427+0000 7f22ca412800 20 searching for the correct realm 2024-03-04T12:46:09.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.430+0000 7f22bd3a8640 0 -- 172.21.15.90:0/3269407476 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f22b008f3f0 msgr2=0x7f22b005eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:09.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.434+0000 7f22c5ba9640 0 -- 172.21.15.90:0/3269407476 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f22b005fe80 msgr2=0x7f22b0077190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:09.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.641+0000 7f22ca412800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:09.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.641+0000 7f22ca412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:09.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.641+0000 7f22ca412800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:09.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.641+0000 7f22ca412800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:09.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.641+0000 7f22ca412800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:09.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.641+0000 7f22ca412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:09.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.641+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.642+0000 7f22ca412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:09.648 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.642+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.642+0000 7f22ca412800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.642+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.642+0000 7f22ca412800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.642+0000 7f22ca412800 20 zone default found 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.642+0000 7f22ca412800 4 Realm: () 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.642+0000 7f22ca412800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.642+0000 7f22ca412800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.642+0000 7f22ca412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.642+0000 7f22ca412800 20 zonegroup default 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.642+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.643+0000 7f22ca412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.643+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.643+0000 7f22ca412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.643+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.644+0000 7f22ca412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:09.651 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.644+0000 7f22ca412800 20 started sync module instance, tier type = 2024-03-04T12:46:09.651 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.644+0000 7f22ca412800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:09.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.654+0000 7f22ca412800 20 add_watcher() i=0 2024-03-04T12:46:09.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.654+0000 7f22ca412800 20 add_watcher() i=1 2024-03-04T12:46:09.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.654+0000 7f22ca412800 20 add_watcher() i=2 2024-03-04T12:46:09.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.654+0000 7f22ca412800 20 add_watcher() i=3 2024-03-04T12:46:09.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.654+0000 7f22ca412800 20 add_watcher() i=4 2024-03-04T12:46:09.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.654+0000 7f22ca412800 20 add_watcher() i=5 2024-03-04T12:46:09.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.654+0000 7f22ca412800 20 add_watcher() i=6 2024-03-04T12:46:09.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.655+0000 7f22ca412800 20 add_watcher() i=7 2024-03-04T12:46:09.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.655+0000 7f22ca412800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:09.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.657+0000 7f21777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:09.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.658+0000 7f22ca412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:09.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.658+0000 7f22ca412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:09.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.658+0000 7f22ca412800 5 note: GC not initialized 2024-03-04T12:46:09.664 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.658+0000 7f21767fc640 20 reqs_thread_entry: start 2024-03-04T12:46:09.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.658+0000 7f22ca412800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:09.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.658+0000 7f22ca412800 20 Filter name: none 2024-03-04T12:46:09.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.658+0000 7f20e7fff640 20 reqs_thread_entry: start 2024-03-04T12:46:09.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.658+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.659+0000 7f22ca412800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:46:09.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.659+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.660+0000 7f22ca412800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:46:09.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.660+0000 7f22ca412800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:09.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.660+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.660+0000 7f22ca412800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:46:09.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.660+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.666 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.660+0000 7f22ca412800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:46:09.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.660+0000 7f22ca412800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:09.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.662+0000 7f22ca412800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.662+0000 7f22ca412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:09.668 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.663+0000 7f21777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:09.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.665+0000 7f22ca412800 20 remove_watcher() i=0 2024-03-04T12:46:09.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.665+0000 7f22ca412800 2 removed watcher, disabling cache 2024-03-04T12:46:09.672 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.667+0000 7f22ca412800 20 remove_watcher() i=1 2024-03-04T12:46:09.673 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.668+0000 7f22ca412800 20 remove_watcher() i=2 2024-03-04T12:46:09.674 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.669+0000 7f22ca412800 20 remove_watcher() i=3 2024-03-04T12:46:09.676 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.670+0000 7f22ca412800 20 remove_watcher() i=4 2024-03-04T12:46:09.677 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.671+0000 7f22ca412800 20 remove_watcher() i=5 2024-03-04T12:46:09.678 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.672+0000 7f22ca412800 20 remove_watcher() i=6 2024-03-04T12:46:09.679 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.673+0000 7f22ca412800 20 remove_watcher() i=7 2024-03-04T12:46:09.690 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:09.690 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:09.690 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: a-bucket id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-03-04T12:46:09.690 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:09.690 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard add non empty bucket 2024-03-04T12:46:09.690 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:09.695 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:09.695 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:09.705 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:09.705 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:09.712 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:09.712 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:09.720 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:09.721 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:09.729 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:09.729 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:09.736 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:09.737 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:09.744 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:09.744 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:09.751 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:09.751 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:09.758 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-04T12:46:09.785 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:09.785 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:09.817 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.812+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.813+0000 7f4d4b0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:09.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.813+0000 7f4d4b0c0800 20 realm 2024-03-04T12:46:09.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.813+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.813+0000 7f4d4b0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:09.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.813+0000 7f4d4b0c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:09.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.813+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.814+0000 7f4d4b0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:09.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.814+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.814+0000 7f4d4b0c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:09.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.814+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:09.821 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.815+0000 7f4d4b0c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:09.821 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.815+0000 7f4d4b0c0800 20 searching for the correct realm 2024-03-04T12:46:09.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.818+0000 7f4d48bbc640 0 -- 172.21.15.90:0/262898872 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f4d44076040 msgr2=0x7f4d44076930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:09.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:09.822+0000 7f4d48bbc640 0 -- 172.21.15.90:0/262898872 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f4d30074120 msgr2=0x7f4d30003a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:10.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.028+0000 7f4d4b0c0800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:10.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.028+0000 7f4d4b0c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:10.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.028+0000 7f4d4b0c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:10.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.028+0000 7f4d4b0c0800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:10.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.028+0000 7f4d4b0c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:10.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.028+0000 7f4d4b0c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:10.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.029+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.029+0000 7f4d4b0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.029+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.029+0000 7f4d4b0c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:10.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.029+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.030+0000 7f4d4b0c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:10.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.030+0000 7f4d4b0c0800 20 zone default found 2024-03-04T12:46:10.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.030+0000 7f4d4b0c0800 4 Realm: () 2024-03-04T12:46:10.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.030+0000 7f4d4b0c0800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:10.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.030+0000 7f4d4b0c0800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:10.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.030+0000 7f4d4b0c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:10.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.030+0000 7f4d4b0c0800 20 zonegroup default 2024-03-04T12:46:10.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.030+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.030+0000 7f4d4b0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.030+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.030+0000 7f4d4b0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.030+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.031+0000 7f4d4b0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.031+0000 7f4d4b0c0800 20 started sync module instance, tier type = 2024-03-04T12:46:10.038 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.031+0000 7f4d4b0c0800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:10.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.040+0000 7f4d4b0c0800 20 add_watcher() i=0 2024-03-04T12:46:10.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.040+0000 7f4d4b0c0800 20 add_watcher() i=1 2024-03-04T12:46:10.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.040+0000 7f4d4b0c0800 20 add_watcher() i=2 2024-03-04T12:46:10.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.040+0000 7f4d4b0c0800 20 add_watcher() i=3 2024-03-04T12:46:10.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.040+0000 7f4d4b0c0800 20 add_watcher() i=4 2024-03-04T12:46:10.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.040+0000 7f4d4b0c0800 20 add_watcher() i=5 2024-03-04T12:46:10.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.040+0000 7f4d4b0c0800 20 add_watcher() i=6 2024-03-04T12:46:10.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.041+0000 7f4d4b0c0800 20 add_watcher() i=7 2024-03-04T12:46:10.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.041+0000 7f4d4b0c0800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:10.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.043+0000 7f4bfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:10.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.043+0000 7f4d4b0c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:10.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.043+0000 7f4d4b0c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:10.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.043+0000 7f4d4b0c0800 5 note: GC not initialized 2024-03-04T12:46:10.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.044+0000 7f4bfdfe3640 20 reqs_thread_entry: start 2024-03-04T12:46:10.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.044+0000 7f4d4b0c0800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:10.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.044+0000 7f4d4b0c0800 20 Filter name: none 2024-03-04T12:46:10.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.044+0000 7f4b6f7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:10.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.044+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.044+0000 7f4d4b0c0800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:46:10.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.044+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.045+0000 7f4d4b0c0800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:46:10.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.045+0000 7f4d4b0c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:10.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.045+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.045+0000 7f4d4b0c0800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:46:10.051 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.045+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.046+0000 7f4d4b0c0800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:46:10.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.046+0000 7f4d4b0c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:10.052 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.047+0000 7f4d4b0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.047+0000 7f4d4b0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.053 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.048+0000 7f4bfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:10.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.050+0000 7f4d4b0c0800 20 remove_watcher() i=0 2024-03-04T12:46:10.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.050+0000 7f4d4b0c0800 2 removed watcher, disabling cache 2024-03-04T12:46:10.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.052+0000 7f4d4b0c0800 20 remove_watcher() i=1 2024-03-04T12:46:10.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.053+0000 7f4d4b0c0800 20 remove_watcher() i=2 2024-03-04T12:46:10.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.054+0000 7f4d4b0c0800 20 remove_watcher() i=3 2024-03-04T12:46:10.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.055+0000 7f4d4b0c0800 20 remove_watcher() i=4 2024-03-04T12:46:10.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.056+0000 7f4d4b0c0800 20 remove_watcher() i=5 2024-03-04T12:46:10.062 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.057+0000 7f4d4b0c0800 20 remove_watcher() i=6 2024-03-04T12:46:10.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.057+0000 7f4d4b0c0800 20 remove_watcher() i=7 2024-03-04T12:46:10.073 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:10.073 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:10.074 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: a-bucket id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-03-04T12:46:10.074 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:10.074 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-03-04T12:46:10.104 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:10.104 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:10.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.131+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.132+0000 7f0b31830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.132+0000 7f0b31830800 20 realm 2024-03-04T12:46:10.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.132+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.133+0000 7f0b31830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.133+0000 7f0b31830800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:10.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.133+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.133+0000 7f0b31830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.133+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.134+0000 7f0b31830800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:10.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.134+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.134+0000 7f0b31830800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:10.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.134+0000 7f0b31830800 20 searching for the correct realm 2024-03-04T12:46:10.143 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.138+0000 7f0b2d258640 0 -- 172.21.15.90:0/433557573 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x5605fb0e5370 msgr2=0x5605fb0e7830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:10.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.141+0000 7f0b24256640 0 -- 172.21.15.90:0/433557573 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f0b1402a910 msgr2=0x7f0b140353f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:10.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.145+0000 7f0b31830800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:10.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.145+0000 7f0b31830800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:10.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.145+0000 7f0b31830800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:10.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.145+0000 7f0b31830800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:10.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.145+0000 7f0b31830800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:10.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.145+0000 7f0b31830800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:10.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.145+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.145+0000 7f0b31830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.145+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.146+0000 7f0b31830800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:10.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.146+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.146+0000 7f0b31830800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:10.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.146+0000 7f0b31830800 20 zone default found 2024-03-04T12:46:10.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.146+0000 7f0b31830800 4 Realm: () 2024-03-04T12:46:10.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.146+0000 7f0b31830800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:10.153 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.146+0000 7f0b31830800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:10.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.146+0000 7f0b31830800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:10.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.146+0000 7f0b31830800 20 zonegroup default 2024-03-04T12:46:10.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.146+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.146+0000 7f0b31830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.146+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.147+0000 7f0b31830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.147+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.147+0000 7f0b31830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.147+0000 7f0b31830800 20 started sync module instance, tier type = 2024-03-04T12:46:10.154 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.147+0000 7f0b31830800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:10.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.155+0000 7f0b31830800 20 add_watcher() i=0 2024-03-04T12:46:10.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.155+0000 7f0b31830800 20 add_watcher() i=1 2024-03-04T12:46:10.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.155+0000 7f0b31830800 20 add_watcher() i=2 2024-03-04T12:46:10.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.155+0000 7f0b31830800 20 add_watcher() i=3 2024-03-04T12:46:10.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.155+0000 7f0b31830800 20 add_watcher() i=4 2024-03-04T12:46:10.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.155+0000 7f0b31830800 20 add_watcher() i=5 2024-03-04T12:46:10.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.155+0000 7f0b31830800 20 add_watcher() i=6 2024-03-04T12:46:10.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.156+0000 7f0b31830800 20 add_watcher() i=7 2024-03-04T12:46:10.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.156+0000 7f0b31830800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:10.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.158+0000 7f09e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:10.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.158+0000 7f0b31830800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:10.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.158+0000 7f0b31830800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:10.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.158+0000 7f0b31830800 5 note: GC not initialized 2024-03-04T12:46:10.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.158+0000 7f09e27e4640 20 reqs_thread_entry: start 2024-03-04T12:46:10.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.158+0000 7f0b31830800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:10.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.158+0000 7f0b31830800 20 Filter name: none 2024-03-04T12:46:10.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f09db7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:10.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f0b31830800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-04T12:46:10.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f0b31830800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:46:10.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f0b31830800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-04T12:46:10.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f0b31830800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-04T12:46:10.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f0b31830800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 : miss 2024-03-04T12:46:10.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f0b31830800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f0b31830800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:46:10.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f0b31830800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:46:10.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f0b31830800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:46:10.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f0b31830800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:10.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.159+0000 7f0b31830800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:46:10.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.160+0000 7f0b31830800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 2024-03-04T12:46:10.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.161+0000 7f09e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:10.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.163+0000 7f0b31830800 20 remove_watcher() i=0 2024-03-04T12:46:10.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.163+0000 7f0b31830800 2 removed watcher, disabling cache 2024-03-04T12:46:10.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.164+0000 7f0b31830800 20 remove_watcher() i=1 2024-03-04T12:46:10.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.165+0000 7f0b31830800 20 remove_watcher() i=2 2024-03-04T12:46:10.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.167+0000 7f0b31830800 20 remove_watcher() i=3 2024-03-04T12:46:10.174 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.168+0000 7f0b31830800 20 remove_watcher() i=4 2024-03-04T12:46:10.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.169+0000 7f0b31830800 20 remove_watcher() i=5 2024-03-04T12:46:10.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.170+0000 7f0b31830800 20 remove_watcher() i=6 2024-03-04T12:46:10.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.171+0000 7f0b31830800 20 remove_watcher() i=7 2024-03-04T12:46:10.187 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin reshard list 2024-03-04T12:46:10.213 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:10.213 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:10.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.239+0000 7f4bed81b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.241+0000 7f4bed81b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.241+0000 7f4bed81b800 20 realm 2024-03-04T12:46:10.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.241+0000 7f4bed81b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.241+0000 7f4bed81b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.241+0000 7f4bed81b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:10.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.241+0000 7f4bed81b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.241+0000 7f4bed81b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.241+0000 7f4bed81b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.242+0000 7f4bed81b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:10.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.242+0000 7f4bed81b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.243+0000 7f4bed81b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:10.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.243+0000 7f4bed81b800 20 searching for the correct realm 2024-03-04T12:46:10.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.245+0000 7f4bebb18640 0 -- 172.21.15.90:0/4263012757 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x5564434e8fd0 msgr2=0x5564434eb460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:10.255 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.249+0000 7f4beb317640 0 -- 172.21.15.90:0/4263012757 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f4be0080900 msgr2=0x7f4be005b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.254+0000 7f4bed81b800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.254+0000 7f4bed81b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.254+0000 7f4bed81b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.254+0000 7f4bed81b800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.254+0000 7f4bed81b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.254+0000 7f4bed81b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.254+0000 7f4bed81b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.254+0000 7f4bed81b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.254+0000 7f4bed81b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.254+0000 7f4bed81b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.254+0000 7f4bed81b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.255+0000 7f4bed81b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:10.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.255+0000 7f4bed81b800 20 zone default found 2024-03-04T12:46:10.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.255+0000 7f4bed81b800 4 Realm: () 2024-03-04T12:46:10.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.255+0000 7f4bed81b800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:10.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.255+0000 7f4bed81b800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:10.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.255+0000 7f4bed81b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:10.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.255+0000 7f4bed81b800 20 zonegroup default 2024-03-04T12:46:10.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.255+0000 7f4bed81b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.255+0000 7f4bed81b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.255+0000 7f4bed81b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.256+0000 7f4bed81b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.256+0000 7f4bed81b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.256+0000 7f4bed81b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.256+0000 7f4bed81b800 20 started sync module instance, tier type = 2024-03-04T12:46:10.263 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.256+0000 7f4bed81b800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:10.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.264+0000 7f4bed81b800 20 add_watcher() i=0 2024-03-04T12:46:10.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.264+0000 7f4bed81b800 20 add_watcher() i=1 2024-03-04T12:46:10.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.264+0000 7f4bed81b800 20 add_watcher() i=2 2024-03-04T12:46:10.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.264+0000 7f4bed81b800 20 add_watcher() i=3 2024-03-04T12:46:10.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.264+0000 7f4bed81b800 20 add_watcher() i=4 2024-03-04T12:46:10.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.264+0000 7f4bed81b800 20 add_watcher() i=5 2024-03-04T12:46:10.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.264+0000 7f4bed81b800 20 add_watcher() i=6 2024-03-04T12:46:10.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.265+0000 7f4bed81b800 20 add_watcher() i=7 2024-03-04T12:46:10.271 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.265+0000 7f4bed81b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:10.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.267+0000 7f4aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:10.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.267+0000 7f4bed81b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:10.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.267+0000 7f4bed81b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:10.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.267+0000 7f4bed81b800 5 note: GC not initialized 2024-03-04T12:46:10.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.268+0000 7f4aa0fe1640 20 reqs_thread_entry: start 2024-03-04T12:46:10.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.268+0000 7f4bed81b800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:10.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.268+0000 7f4bed81b800 20 Filter name: none 2024-03-04T12:46:10.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.268+0000 7f4a1a7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:10.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.273+0000 7f4aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:10.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.275+0000 7f4bed81b800 20 remove_watcher() i=0 2024-03-04T12:46:10.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.275+0000 7f4bed81b800 2 removed watcher, disabling cache 2024-03-04T12:46:10.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.276+0000 7f4bed81b800 20 remove_watcher() i=1 2024-03-04T12:46:10.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.277+0000 7f4bed81b800 20 remove_watcher() i=2 2024-03-04T12:46:10.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.278+0000 7f4bed81b800 20 remove_watcher() i=3 2024-03-04T12:46:10.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.279+0000 7f4bed81b800 20 remove_watcher() i=4 2024-03-04T12:46:10.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.280+0000 7f4bed81b800 20 remove_watcher() i=5 2024-03-04T12:46:10.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.281+0000 7f4bed81b800 20 remove_watcher() i=6 2024-03-04T12:46:10.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.282+0000 7f4bed81b800 20 remove_watcher() i=7 2024-03-04T12:46:10.297 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard process non empty bucket 2024-03-04T12:46:10.297 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:10.298 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin reshard process 2024-03-04T12:46:10.323 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:10.324 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:10.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.351+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.361 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.352+0000 7f92a5c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.361 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.352+0000 7f92a5c67800 20 realm 2024-03-04T12:46:10.361 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.352+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.361 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.352+0000 7f92a5c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.361 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.352+0000 7f92a5c67800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:10.361 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.352+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.361 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.352+0000 7f92a5c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.361 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.352+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.353+0000 7f92a5c67800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:10.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.353+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.353+0000 7f92a5c67800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:10.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.354+0000 7f92a5c67800 20 searching for the correct realm 2024-03-04T12:46:10.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.356+0000 7f92a2f69640 0 -- 172.21.15.90:0/799920852 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f9298017030 msgr2=0x7f9298057750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:10.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.360+0000 7f92a376a640 0 -- 172.21.15.90:0/799920852 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f929805ab20 msgr2=0x7f929805d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:10.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.566+0000 7f92a5c67800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:10.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.566+0000 7f92a5c67800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:10.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.566+0000 7f92a5c67800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:10.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.566+0000 7f92a5c67800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:10.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.566+0000 7f92a5c67800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:10.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.566+0000 7f92a5c67800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:10.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.566+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.566+0000 7f92a5c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.573 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.566+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.573 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.566+0000 7f92a5c67800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:10.573 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.566+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:10.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 20 zone default found 2024-03-04T12:46:10.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 4 Realm: () 2024-03-04T12:46:10.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:10.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:10.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:10.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 20 zonegroup default 2024-03-04T12:46:10.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.574 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 20 started sync module instance, tier type = 2024-03-04T12:46:10.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.567+0000 7f92a5c67800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:10.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.577+0000 7f92a5c67800 20 add_watcher() i=0 2024-03-04T12:46:10.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.577+0000 7f92a5c67800 20 add_watcher() i=1 2024-03-04T12:46:10.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.577+0000 7f92a5c67800 20 add_watcher() i=2 2024-03-04T12:46:10.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.577+0000 7f92a5c67800 20 add_watcher() i=3 2024-03-04T12:46:10.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.577+0000 7f92a5c67800 20 add_watcher() i=4 2024-03-04T12:46:10.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.577+0000 7f92a5c67800 20 add_watcher() i=5 2024-03-04T12:46:10.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.577+0000 7f92a5c67800 20 add_watcher() i=6 2024-03-04T12:46:10.583 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.578+0000 7f92a5c67800 20 add_watcher() i=7 2024-03-04T12:46:10.584 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.578+0000 7f92a5c67800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:10.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.579+0000 7f9159fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:10.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.580+0000 7f92a5c67800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:10.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.580+0000 7f92a5c67800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:10.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.580+0000 7f92a5c67800 5 note: GC not initialized 2024-03-04T12:46:10.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.580+0000 7f9158fe1640 20 reqs_thread_entry: start 2024-03-04T12:46:10.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.580+0000 7f92a5c67800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:10.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.580+0000 7f92a5c67800 20 Filter name: none 2024-03-04T12:46:10.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.580+0000 7f90d27fc640 20 reqs_thread_entry: start 2024-03-04T12:46:10.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.580+0000 7f92a5c67800 20 processing logshard = reshard.0000000000 2024-03-04T12:46:10.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.582+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-03-04T12:46:10.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.582+0000 7f92a5c67800 20 processing logshard = reshard.0000000001 2024-03-04T12:46:10.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.585+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-03-04T12:46:10.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.585+0000 7f92a5c67800 20 processing logshard = reshard.0000000002 2024-03-04T12:46:10.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.587+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-03-04T12:46:10.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.587+0000 7f92a5c67800 20 processing logshard = reshard.0000000003 2024-03-04T12:46:10.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.589+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-03-04T12:46:10.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.589+0000 7f92a5c67800 20 processing logshard = reshard.0000000004 2024-03-04T12:46:10.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.592+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-03-04T12:46:10.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.592+0000 7f92a5c67800 20 processing logshard = reshard.0000000005 2024-03-04T12:46:10.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.595+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-03-04T12:46:10.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.595+0000 7f92a5c67800 20 processing logshard = reshard.0000000006 2024-03-04T12:46:10.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.596+0000 7f92a5c67800 20 process_entry resharding a-bucket 2024-03-04T12:46:10.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.596+0000 7f92a5c67800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-04T12:46:10.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.596+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.596+0000 7f92a5c67800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:46:10.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.596+0000 7f92a5c67800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-03-04T12:46:10.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.596+0000 7f92a5c67800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-04T12:46:10.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.596+0000 7f92a5c67800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 : miss 2024-03-04T12:46:10.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.596+0000 7f92a5c67800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.597+0000 7f92a5c67800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:46:10.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.597+0000 7f92a5c67800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:46:10.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.597+0000 7f92a5c67800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:46:10.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.597+0000 7f92a5c67800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:10.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.597+0000 7f92a5c67800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:46:10.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.597+0000 7f92a5c67800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 2024-03-04T12:46:10.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.603+0000 7f92a5c67800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:46:10.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.603+0000 7f92a5c67800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:46:10.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.603+0000 7f92a5c67800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:46:10.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.603+0000 7f92a5c67800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17, ofs0, ns] 2024-03-04T12:46:10.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.603+0000 7f9186ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824058 cookie 93855709613840 notifier 6156 bl.length()=789 2024-03-04T12:46:10.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.603+0000 7f9186ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:46:10.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.603+0000 7f9186ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:46:10.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.603+0000 7f9186ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:46:10.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.604+0000 7f92a5c67800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): orig_sources= new_sources= 2024-03-04T12:46:10.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.604+0000 7f92a5c67800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): potential sources added=[] removed=[] 2024-03-04T12:46:10.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.604+0000 7f92a5c67800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): orig_dests= new_dests= 2024-03-04T12:46:10.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.604+0000 7f92a5c67800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): potential dests added=[] removed=[] 2024-03-04T12:46:10.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.0 2024-03-04T12:46:10.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.0 2024-03-04T12:46:10.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.1 2024-03-04T12:46:10.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.1 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.2 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.2 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.3 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.3 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.4 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.4 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.5 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.5 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.6 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.6 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.7 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.7 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.8 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.8 2024-03-04T12:46:10.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.9 2024-03-04T12:46:10.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.9 2024-03-04T12:46:10.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.10 2024-03-04T12:46:10.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.10 2024-03-04T12:46:10.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.11 2024-03-04T12:46:10.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.11 2024-03-04T12:46:10.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.12 2024-03-04T12:46:10.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.12 2024-03-04T12:46:10.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.0 2024-03-04T12:46:10.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.606+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.0 2024-03-04T12:46:10.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.607+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.1 2024-03-04T12:46:10.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.607+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.1 2024-03-04T12:46:10.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.607+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.2 2024-03-04T12:46:10.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.607+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.2 2024-03-04T12:46:10.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.608+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.3 2024-03-04T12:46:10.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.608+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.3 2024-03-04T12:46:10.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.608+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.4 2024-03-04T12:46:10.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.608+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.4 2024-03-04T12:46:10.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.609+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.5 2024-03-04T12:46:10.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.609+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.5 2024-03-04T12:46:10.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.609+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.6 2024-03-04T12:46:10.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.609+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.6 2024-03-04T12:46:10.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.609+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.7 2024-03-04T12:46:10.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.609+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.7 2024-03-04T12:46:10.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.610+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.8 2024-03-04T12:46:10.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.610+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.8 2024-03-04T12:46:10.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.610+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.9 2024-03-04T12:46:10.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.610+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.9 2024-03-04T12:46:10.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.611+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.10 2024-03-04T12:46:10.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.611+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.10 2024-03-04T12:46:10.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.611+0000 7f92a5c67800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.11 2024-03-04T12:46:10.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.611+0000 7f92a5c67800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.1.11 2024-03-04T12:46:10.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.613+0000 7f92a5c67800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 : hit (requested=0x17, cached=0x17) 2024-03-04T12:46:10.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.613+0000 7f92a5c67800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 2024-03-04T12:46:10.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.614+0000 7f92a5c67800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:46:10.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.614+0000 7f92a5c67800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:46:10.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.614+0000 7f92a5c67800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:46:10.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.614+0000 7f92a5c67800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17, ofs0, ns] 2024-03-04T12:46:10.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.614+0000 7f91867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824059 cookie 93855709613840 notifier 6156 bl.length()=757 2024-03-04T12:46:10.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.614+0000 7f91867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:46:10.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.614+0000 7f91867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:46:10.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.614+0000 7f91867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:46:10.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.615+0000 7f92a5c67800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): orig_sources= new_sources= 2024-03-04T12:46:10.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.615+0000 7f92a5c67800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): potential sources added=[] removed=[] 2024-03-04T12:46:10.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.615+0000 7f92a5c67800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): orig_dests= new_dests= 2024-03-04T12:46:10.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.615+0000 7f92a5c67800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): potential dests added=[] removed=[] 2024-03-04T12:46:10.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.617+0000 7f92a5c67800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-04T12:46:10.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.618+0000 7f92a5c67800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-03-04T12:46:10.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.620+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-03-04T12:46:10.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.620+0000 7f92a5c67800 20 processing logshard = reshard.0000000007 2024-03-04T12:46:10.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.623+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-03-04T12:46:10.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.623+0000 7f92a5c67800 20 processing logshard = reshard.0000000008 2024-03-04T12:46:10.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.625+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-03-04T12:46:10.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.625+0000 7f92a5c67800 20 processing logshard = reshard.0000000009 2024-03-04T12:46:10.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.627+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-03-04T12:46:10.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.627+0000 7f92a5c67800 20 processing logshard = reshard.0000000010 2024-03-04T12:46:10.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.629+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-03-04T12:46:10.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.629+0000 7f92a5c67800 20 processing logshard = reshard.0000000011 2024-03-04T12:46:10.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.632+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-03-04T12:46:10.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.632+0000 7f92a5c67800 20 processing logshard = reshard.0000000012 2024-03-04T12:46:10.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.634+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-03-04T12:46:10.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.634+0000 7f92a5c67800 20 processing logshard = reshard.0000000013 2024-03-04T12:46:10.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.636+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-03-04T12:46:10.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.636+0000 7f92a5c67800 20 processing logshard = reshard.0000000014 2024-03-04T12:46:10.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.638+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-03-04T12:46:10.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.638+0000 7f92a5c67800 20 processing logshard = reshard.0000000015 2024-03-04T12:46:10.646 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.641+0000 7f92a5c67800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-03-04T12:46:10.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.641+0000 7f9159fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:10.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.643+0000 7f92a5c67800 20 remove_watcher() i=0 2024-03-04T12:46:10.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.643+0000 7f92a5c67800 2 removed watcher, disabling cache 2024-03-04T12:46:10.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.644+0000 7f92a5c67800 20 remove_watcher() i=1 2024-03-04T12:46:10.651 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.645+0000 7f92a5c67800 20 remove_watcher() i=2 2024-03-04T12:46:10.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.646+0000 7f92a5c67800 20 remove_watcher() i=3 2024-03-04T12:46:10.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.647+0000 7f92a5c67800 20 remove_watcher() i=4 2024-03-04T12:46:10.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.648+0000 7f92a5c67800 20 remove_watcher() i=5 2024-03-04T12:46:10.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.649+0000 7f92a5c67800 20 remove_watcher() i=6 2024-03-04T12:46:10.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.650+0000 7f92a5c67800 20 remove_watcher() i=7 2024-03-04T12:46:10.666 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-04T12:46:10.694 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:10.694 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:10.727 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.721+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.722+0000 7f7d63210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.728 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.722+0000 7f7d63210800 20 realm 2024-03-04T12:46:10.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.722+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.723+0000 7f7d63210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.723+0000 7f7d63210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:10.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.723+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.723+0000 7f7d63210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.723+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.724+0000 7f7d63210800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:10.729 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.724+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.730 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.724+0000 7f7d63210800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:10.730 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.724+0000 7f7d63210800 20 searching for the correct realm 2024-03-04T12:46:10.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.727+0000 7f7d5e7f0640 0 -- 172.21.15.90:0/939597128 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f7d500b3070 msgr2=0x7f7d500a1210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:10.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.731+0000 7f7d5e7f0640 0 -- 172.21.15.90:0/939597128 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f7d54008940 msgr2=0x7f7d5405f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:10.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:10.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:10.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:10.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:10.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:10.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:10.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:10.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.937+0000 7f7d63210800 20 zone default found 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 4 Realm: () 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 20 zonegroup default 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 20 started sync module instance, tier type = 2024-03-04T12:46:10.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.938+0000 7f7d63210800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:10.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.947+0000 7f7d63210800 20 add_watcher() i=0 2024-03-04T12:46:10.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.947+0000 7f7d63210800 20 add_watcher() i=1 2024-03-04T12:46:10.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.947+0000 7f7d63210800 20 add_watcher() i=2 2024-03-04T12:46:10.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.947+0000 7f7d63210800 20 add_watcher() i=3 2024-03-04T12:46:10.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.947+0000 7f7d63210800 20 add_watcher() i=4 2024-03-04T12:46:10.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.947+0000 7f7d63210800 20 add_watcher() i=5 2024-03-04T12:46:10.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.947+0000 7f7d63210800 20 add_watcher() i=6 2024-03-04T12:46:10.954 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.948+0000 7f7d63210800 20 add_watcher() i=7 2024-03-04T12:46:10.954 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.948+0000 7f7d63210800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:10.955 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.950+0000 7f7c14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:10.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.950+0000 7f7d63210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:10.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.950+0000 7f7d63210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:10.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.950+0000 7f7d63210800 5 note: GC not initialized 2024-03-04T12:46:10.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.950+0000 7f7b8f7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:10.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.950+0000 7f7d63210800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:10.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.951+0000 7f7d63210800 20 Filter name: none 2024-03-04T12:46:10.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.951+0000 7f7b8d7fa640 20 reqs_thread_entry: start 2024-03-04T12:46:10.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.951+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.951+0000 7f7d63210800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:46:10.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.951+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.952+0000 7f7d63210800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:46:10.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.952+0000 7f7d63210800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:10.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.952+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.952+0000 7f7d63210800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:46:10.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.952+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.953+0000 7f7d63210800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:46:10.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.953+0000 7f7d63210800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:10.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.953+0000 7f7d63210800 20 rados->read ofs=0 len=0 2024-03-04T12:46:10.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.954+0000 7f7d63210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:10.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.954+0000 7f7c14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:10.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.956+0000 7f7d63210800 20 remove_watcher() i=0 2024-03-04T12:46:10.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.956+0000 7f7d63210800 2 removed watcher, disabling cache 2024-03-04T12:46:10.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.957+0000 7f7d63210800 20 remove_watcher() i=1 2024-03-04T12:46:10.964 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.958+0000 7f7d63210800 20 remove_watcher() i=2 2024-03-04T12:46:10.965 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.959+0000 7f7d63210800 20 remove_watcher() i=3 2024-03-04T12:46:10.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.960+0000 7f7d63210800 20 remove_watcher() i=4 2024-03-04T12:46:10.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.961+0000 7f7d63210800 20 remove_watcher() i=5 2024-03-04T12:46:10.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.962+0000 7f7d63210800 20 remove_watcher() i=6 2024-03-04T12:46:10.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:10.963+0000 7f7d63210800 20 remove_watcher() i=7 2024-03-04T12:46:10.979 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:10.979 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:10.979 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: a-bucket id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-03-04T12:46:10.979 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:10.979 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-03-04T12:46:10.979 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:10.981 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:10.981 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:10.995 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:10.995 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.038 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.038 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.046 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.046 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.053 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.053 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.060 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.060 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.067 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.067 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.074 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.075 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.082 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.082 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.089 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.089 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.097 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.097 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.104 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.104 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.111 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.112 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.119 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.119 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.126 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.126 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.133 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.133 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.140 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.140 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.147 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.147 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.154 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.154 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.161 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.161 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.168 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.168 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.175 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.176 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.183 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-04T12:46:11.210 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:11.210 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:11.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.236+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.238+0000 7fbd18832800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.238+0000 7fbd18832800 20 realm 2024-03-04T12:46:11.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.238+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.238+0000 7fbd18832800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.238+0000 7fbd18832800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:11.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.238+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.238+0000 7fbd18832800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.238+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.239+0000 7fbd18832800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:11.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.239+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.239+0000 7fbd18832800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:11.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.239+0000 7fbd18832800 20 searching for the correct realm 2024-03-04T12:46:11.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.242+0000 7fbd132d8640 0 -- 172.21.15.90:0/3109386740 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fbd0808f2e0 msgr2=0x7fbd08014d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:11.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.245+0000 7fbd13ad9640 0 -- 172.21.15.90:0/3109386740 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fbd0807f020 msgr2=0x7fbd08002600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:11.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.451+0000 7fbd18832800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:11.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.451+0000 7fbd18832800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:11.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.451+0000 7fbd18832800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:11.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.451+0000 7fbd18832800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:11.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.451+0000 7fbd18832800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:11.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.451+0000 7fbd18832800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:11.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.451+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.451+0000 7fbd18832800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.451+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.451+0000 7fbd18832800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:11.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.451+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:11.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 20 zone default found 2024-03-04T12:46:11.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 4 Realm: () 2024-03-04T12:46:11.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:11.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:11.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:11.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 20 zonegroup default 2024-03-04T12:46:11.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.460 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 20 started sync module instance, tier type = 2024-03-04T12:46:11.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.452+0000 7fbd18832800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:11.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.461+0000 7fbd18832800 20 add_watcher() i=0 2024-03-04T12:46:11.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.461+0000 7fbd18832800 20 add_watcher() i=1 2024-03-04T12:46:11.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.461+0000 7fbd18832800 20 add_watcher() i=2 2024-03-04T12:46:11.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.461+0000 7fbd18832800 20 add_watcher() i=3 2024-03-04T12:46:11.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.461+0000 7fbd18832800 20 add_watcher() i=4 2024-03-04T12:46:11.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.461+0000 7fbd18832800 20 add_watcher() i=5 2024-03-04T12:46:11.468 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.461+0000 7fbd18832800 20 add_watcher() i=6 2024-03-04T12:46:11.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.462+0000 7fbd18832800 20 add_watcher() i=7 2024-03-04T12:46:11.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.462+0000 7fbd18832800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:11.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.463+0000 7fbbc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:11.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.464+0000 7fbd18832800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:11.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.464+0000 7fbd18832800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:11.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.464+0000 7fbd18832800 5 note: GC not initialized 2024-03-04T12:46:11.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.464+0000 7fbbc8fe1640 20 reqs_thread_entry: start 2024-03-04T12:46:11.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.464+0000 7fbd18832800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:11.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.464+0000 7fbd18832800 20 Filter name: none 2024-03-04T12:46:11.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.464+0000 7fbb427fc640 20 reqs_thread_entry: start 2024-03-04T12:46:11.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.464+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.465+0000 7fbd18832800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:11.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.465+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.465+0000 7fbd18832800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:11.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.465+0000 7fbd18832800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:11.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.465+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.466+0000 7fbd18832800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:11.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.466+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.466+0000 7fbd18832800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:11.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.466+0000 7fbd18832800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:11.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.467+0000 7fbd18832800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.467+0000 7fbd18832800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.468+0000 7fbbc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:11.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.470+0000 7fbd18832800 20 remove_watcher() i=0 2024-03-04T12:46:11.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.470+0000 7fbd18832800 2 removed watcher, disabling cache 2024-03-04T12:46:11.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.471+0000 7fbd18832800 20 remove_watcher() i=1 2024-03-04T12:46:11.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.472+0000 7fbd18832800 20 remove_watcher() i=2 2024-03-04T12:46:11.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.473+0000 7fbd18832800 20 remove_watcher() i=3 2024-03-04T12:46:11.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.474+0000 7fbd18832800 20 remove_watcher() i=4 2024-03-04T12:46:11.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.475+0000 7fbd18832800 20 remove_watcher() i=5 2024-03-04T12:46:11.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.476+0000 7fbd18832800 20 remove_watcher() i=6 2024-03-04T12:46:11.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.477+0000 7fbd18832800 20 remove_watcher() i=7 2024-03-04T12:46:11.492 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:11.492 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:11.492 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-set-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:46:11.492 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:11.493 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-03-04T12:46:11.525 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:11.526 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:11.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.552+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.553+0000 7f592af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.553+0000 7f592af1f800 20 realm 2024-03-04T12:46:11.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.553+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.554+0000 7f592af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.554+0000 7f592af1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:11.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.554+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.554+0000 7f592af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.554+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.555+0000 7f592af1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:11.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.555+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.555+0000 7f592af1f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:11.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.555+0000 7f592af1f800 20 searching for the correct realm 2024-03-04T12:46:11.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.558+0000 7f5926be9640 0 -- 172.21.15.90:0/2400146851 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f592005cc20 msgr2=0x7f59200508e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:11.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.561+0000 7f5926be9640 0 -- 172.21.15.90:0/2400146851 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f5910013b90 msgr2=0x7f5910064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:11.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.767+0000 7f592af1f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:11.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.767+0000 7f592af1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:11.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.767+0000 7f592af1f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:11.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.767+0000 7f592af1f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:11.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.767+0000 7f592af1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:11.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.767+0000 7f592af1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:11.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.767+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.768+0000 7f592af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.768+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.768+0000 7f592af1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.768+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.768+0000 7f592af1f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.768+0000 7f592af1f800 20 zone default found 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.768+0000 7f592af1f800 4 Realm: () 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.768+0000 7f592af1f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.768+0000 7f592af1f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.768+0000 7f592af1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.768+0000 7f592af1f800 20 zonegroup default 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.768+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.769+0000 7f592af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.769+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.769+0000 7f592af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.769+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.769+0000 7f592af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.769+0000 7f592af1f800 20 started sync module instance, tier type = 2024-03-04T12:46:11.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.769+0000 7f592af1f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:11.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.778+0000 7f592af1f800 20 add_watcher() i=0 2024-03-04T12:46:11.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.778+0000 7f592af1f800 20 add_watcher() i=1 2024-03-04T12:46:11.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.778+0000 7f592af1f800 20 add_watcher() i=2 2024-03-04T12:46:11.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.778+0000 7f592af1f800 20 add_watcher() i=3 2024-03-04T12:46:11.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.778+0000 7f592af1f800 20 add_watcher() i=4 2024-03-04T12:46:11.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.778+0000 7f592af1f800 20 add_watcher() i=5 2024-03-04T12:46:11.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.778+0000 7f592af1f800 20 add_watcher() i=6 2024-03-04T12:46:11.785 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.779+0000 7f592af1f800 20 add_watcher() i=7 2024-03-04T12:46:11.785 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.779+0000 7f592af1f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:11.786 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.781+0000 7f57dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:11.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.781+0000 7f592af1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:11.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.781+0000 7f592af1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:11.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.781+0000 7f592af1f800 5 note: GC not initialized 2024-03-04T12:46:11.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.781+0000 7f5757fff640 20 reqs_thread_entry: start 2024-03-04T12:46:11.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.781+0000 7f592af1f800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:11.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.781+0000 7f592af1f800 20 Filter name: none 2024-03-04T12:46:11.788 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f5755ffb640 20 reqs_thread_entry: start 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 : miss 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 info.flags=0x17 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 to cache LRU end 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:11.789 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.782+0000 7f592af1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 2024-03-04T12:46:11.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.786+0000 7f592af1f800 -1 Injecting error=-5 at location=set_target_layout 2024-03-04T12:46:11.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.786+0000 7f592af1f800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-03-04T12:46:11.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.792+0000 7f57dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:11.800 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.795+0000 7f592af1f800 20 remove_watcher() i=0 2024-03-04T12:46:11.800 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.795+0000 7f592af1f800 2 removed watcher, disabling cache 2024-03-04T12:46:11.801 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.795+0000 7f592af1f800 20 remove_watcher() i=1 2024-03-04T12:46:11.802 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.796+0000 7f592af1f800 20 remove_watcher() i=2 2024-03-04T12:46:11.803 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.798+0000 7f592af1f800 20 remove_watcher() i=3 2024-03-04T12:46:11.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.799+0000 7f592af1f800 20 remove_watcher() i=4 2024-03-04T12:46:11.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.800+0000 7f592af1f800 20 remove_watcher() i=5 2024-03-04T12:46:11.806 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.800+0000 7f592af1f800 20 remove_watcher() i=6 2024-03-04T12:46:11.807 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.801+0000 7f592af1f800 20 remove_watcher() i=7 2024-03-04T12:46:11.818 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-04T12:46:11.844 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:11.845 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:11.877 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.871+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.873+0000 7f711672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.873+0000 7f711672f800 20 realm 2024-03-04T12:46:11.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.873+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.873+0000 7f711672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.873+0000 7f711672f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:11.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.873+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.873+0000 7f711672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.873+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.880 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.874+0000 7f711672f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:11.880 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.874+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.880 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.874+0000 7f711672f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:11.880 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.874+0000 7f711672f800 20 searching for the correct realm 2024-03-04T12:46:11.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.877+0000 7f7111c30640 0 -- 172.21.15.90:0/1064096986 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f710804bc10 msgr2=0x7f71080a5a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:11.887 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.881+0000 7f7111c30640 0 -- 172.21.15.90:0/1064096986 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f6fdc079cd0 msgr2=0x7f6fdc07c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:11.891 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.885+0000 7f711672f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:11.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.885+0000 7f711672f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:11.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.885+0000 7f711672f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:11.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.885+0000 7f711672f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:11.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.885+0000 7f711672f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:11.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.885+0000 7f711672f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:11.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.885+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.885+0000 7f711672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.885+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.885+0000 7f711672f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:11.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.885+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:11.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 20 zone default found 2024-03-04T12:46:11.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 4 Realm: () 2024-03-04T12:46:11.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:11.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:11.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:11.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 20 zonegroup default 2024-03-04T12:46:11.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 20 started sync module instance, tier type = 2024-03-04T12:46:11.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.886+0000 7f711672f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:11.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.895+0000 7f711672f800 20 add_watcher() i=0 2024-03-04T12:46:11.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.895+0000 7f711672f800 20 add_watcher() i=1 2024-03-04T12:46:11.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.895+0000 7f711672f800 20 add_watcher() i=2 2024-03-04T12:46:11.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.895+0000 7f711672f800 20 add_watcher() i=3 2024-03-04T12:46:11.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.895+0000 7f711672f800 20 add_watcher() i=4 2024-03-04T12:46:11.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.895+0000 7f711672f800 20 add_watcher() i=5 2024-03-04T12:46:11.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.895+0000 7f711672f800 20 add_watcher() i=6 2024-03-04T12:46:11.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.896+0000 7f711672f800 20 add_watcher() i=7 2024-03-04T12:46:11.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.896+0000 7f711672f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.898+0000 7f6fc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.898+0000 7f711672f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.898+0000 7f711672f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.898+0000 7f711672f800 5 note: GC not initialized 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.898+0000 7f6f437fe640 20 reqs_thread_entry: start 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.898+0000 7f711672f800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.898+0000 7f711672f800 20 Filter name: none 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.899+0000 7f6f417fa640 20 reqs_thread_entry: start 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.899+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.899+0000 7f711672f800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.899+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.899+0000 7f711672f800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.899+0000 7f711672f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:11.907 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.899+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.899+0000 7f711672f800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:11.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.899+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.900+0000 7f711672f800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:11.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.900+0000 7f711672f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:11.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.901+0000 7f711672f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:11.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.901+0000 7f711672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:11.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.901+0000 7f6fc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:11.910 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.904+0000 7f711672f800 20 remove_watcher() i=0 2024-03-04T12:46:11.910 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.904+0000 7f711672f800 2 removed watcher, disabling cache 2024-03-04T12:46:11.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.905+0000 7f711672f800 20 remove_watcher() i=1 2024-03-04T12:46:11.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.906+0000 7f711672f800 20 remove_watcher() i=2 2024-03-04T12:46:11.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.907+0000 7f711672f800 20 remove_watcher() i=3 2024-03-04T12:46:11.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.908+0000 7f711672f800 20 remove_watcher() i=4 2024-03-04T12:46:11.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.909+0000 7f711672f800 20 remove_watcher() i=5 2024-03-04T12:46:11.916 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.910+0000 7f711672f800 20 remove_watcher() i=6 2024-03-04T12:46:11.916 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:11.911+0000 7f711672f800 20 remove_watcher() i=7 2024-03-04T12:46:11.926 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:11.926 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:11.926 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-set-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:46:11.926 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:11.928 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.929 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.936 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:11.936 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:11.979 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:46:12.008 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:12.008 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:12.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.036+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.037+0000 7f2f5914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.037+0000 7f2f5914b800 20 realm 2024-03-04T12:46:12.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.037+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.037+0000 7f2f5914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.037+0000 7f2f5914b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:12.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.037+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.038+0000 7f2f5914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.038+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.038+0000 7f2f5914b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:12.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.038+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.045 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.039+0000 7f2f5914b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:12.045 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.039+0000 7f2f5914b800 20 searching for the correct realm 2024-03-04T12:46:12.047 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.042+0000 7f2f56c47640 0 -- 172.21.15.90:0/3921361642 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f2f50018070 msgr2=0x7f2f500582d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:12.050 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.045+0000 7f2f56c47640 0 -- 172.21.15.90:0/3921361642 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f2f40095060 msgr2=0x7f2f4005d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:12.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.050+0000 7f2f5914b800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:12.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.050+0000 7f2f5914b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:12.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.050+0000 7f2f5914b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:12.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.050+0000 7f2f5914b800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:12.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.050+0000 7f2f5914b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:12.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.050+0000 7f2f5914b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:12.056 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.050+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.050+0000 7f2f5914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.057 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.050+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.051+0000 7f2f5914b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:12.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.051+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.051+0000 7f2f5914b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:12.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.051+0000 7f2f5914b800 20 zone default found 2024-03-04T12:46:12.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.051+0000 7f2f5914b800 4 Realm: () 2024-03-04T12:46:12.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.051+0000 7f2f5914b800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:12.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.051+0000 7f2f5914b800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:12.058 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.051+0000 7f2f5914b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:12.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.051+0000 7f2f5914b800 20 zonegroup default 2024-03-04T12:46:12.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.051+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.051+0000 7f2f5914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.051+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.052+0000 7f2f5914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.052+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.052+0000 7f2f5914b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.052+0000 7f2f5914b800 20 started sync module instance, tier type = 2024-03-04T12:46:12.059 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.052+0000 7f2f5914b800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:12.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.060+0000 7f2f5914b800 20 add_watcher() i=0 2024-03-04T12:46:12.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.060+0000 7f2f5914b800 20 add_watcher() i=1 2024-03-04T12:46:12.066 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.060+0000 7f2f5914b800 20 add_watcher() i=2 2024-03-04T12:46:12.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.060+0000 7f2f5914b800 20 add_watcher() i=3 2024-03-04T12:46:12.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.060+0000 7f2f5914b800 20 add_watcher() i=4 2024-03-04T12:46:12.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.060+0000 7f2f5914b800 20 add_watcher() i=5 2024-03-04T12:46:12.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.060+0000 7f2f5914b800 20 add_watcher() i=6 2024-03-04T12:46:12.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.061+0000 7f2f5914b800 20 add_watcher() i=7 2024-03-04T12:46:12.067 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.061+0000 7f2f5914b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:12.068 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.063+0000 7f2e0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:12.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.063+0000 7f2f5914b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:12.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.063+0000 7f2f5914b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:12.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.063+0000 7f2f5914b800 5 note: GC not initialized 2024-03-04T12:46:12.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.063+0000 7f2d87fff640 20 reqs_thread_entry: start 2024-03-04T12:46:12.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:12.070 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 20 Filter name: none 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2d85ffb640 20 reqs_thread_entry: start 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 : miss 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 info.flags=0x17 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 to cache LRU end 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:12.071 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.064+0000 7f2f5914b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 2024-03-04T12:46:12.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.071+0000 7f2f5914b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 info.flags=0x17 2024-03-04T12:46:12.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.071+0000 7f2f5914b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 to cache LRU end 2024-03-04T12:46:12.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.071+0000 7f2f5914b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:12.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.071+0000 7f2f5914b800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19, ofs0, ns] 2024-03-04T12:46:12.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.072+0000 7f2e39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824061 cookie 94739151814768 notifier 5924 bl.length()=887 2024-03-04T12:46:12.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.072+0000 7f2e39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 info.flags=0x17 2024-03-04T12:46:12.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.072+0000 7f2e39ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 to cache LRU end 2024-03-04T12:46:12.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.072+0000 7f2e39ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:12.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.072+0000 7f2f5914b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19]): orig_sources= new_sources= 2024-03-04T12:46:12.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.072+0000 7f2f5914b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19]): potential sources added=[] removed=[] 2024-03-04T12:46:12.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.072+0000 7f2f5914b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19]): orig_dests= new_dests= 2024-03-04T12:46:12.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.072+0000 7f2f5914b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19]): potential dests added=[] removed=[] 2024-03-04T12:46:12.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.0 2024-03-04T12:46:12.080 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.0 2024-03-04T12:46:12.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.1 2024-03-04T12:46:12.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.1 2024-03-04T12:46:12.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.2 2024-03-04T12:46:12.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.2 2024-03-04T12:46:12.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.3 2024-03-04T12:46:12.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.3 2024-03-04T12:46:12.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.4 2024-03-04T12:46:12.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.4 2024-03-04T12:46:12.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.5 2024-03-04T12:46:12.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.5 2024-03-04T12:46:12.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.6 2024-03-04T12:46:12.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.6 2024-03-04T12:46:12.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.7 2024-03-04T12:46:12.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.7 2024-03-04T12:46:12.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.8 2024-03-04T12:46:12.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.8 2024-03-04T12:46:12.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.9 2024-03-04T12:46:12.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.9 2024-03-04T12:46:12.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.10 2024-03-04T12:46:12.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.10 2024-03-04T12:46:12.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.11 2024-03-04T12:46:12.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1.11 2024-03-04T12:46:12.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.074+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.0 2024-03-04T12:46:12.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.075+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.1 2024-03-04T12:46:12.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.075+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.2 2024-03-04T12:46:12.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.076+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.3 2024-03-04T12:46:12.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.076+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.4 2024-03-04T12:46:12.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.077+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.5 2024-03-04T12:46:12.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.077+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.6 2024-03-04T12:46:12.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.077+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.7 2024-03-04T12:46:12.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.078+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.8 2024-03-04T12:46:12.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.078+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.9 2024-03-04T12:46:12.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.079+0000 7f2f5914b800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19.10 2024-03-04T12:46:12.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.083+0000 7f2f5914b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 : hit (requested=0x17, cached=0x17) 2024-03-04T12:46:12.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.083+0000 7f2f5914b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 2024-03-04T12:46:12.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.085+0000 7f2f5914b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 info.flags=0x17 2024-03-04T12:46:12.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.085+0000 7f2f5914b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 to cache LRU end 2024-03-04T12:46:12.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.085+0000 7f2f5914b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:12.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.085+0000 7f2f5914b800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19, ofs0, ns] 2024-03-04T12:46:12.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.085+0000 7f2e3a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824062 cookie 94739151814768 notifier 5924 bl.length()=855 2024-03-04T12:46:12.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.085+0000 7f2e3a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 info.flags=0x17 2024-03-04T12:46:12.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.085+0000 7f2e3a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 to cache LRU end 2024-03-04T12:46:12.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.085+0000 7f2e3a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:12.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.085+0000 7f2f5914b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19]): orig_sources= new_sources= 2024-03-04T12:46:12.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.085+0000 7f2f5914b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19]): potential sources added=[] removed=[] 2024-03-04T12:46:12.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.085+0000 7f2f5914b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19]): orig_dests= new_dests= 2024-03-04T12:46:12.092 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.085+0000 7f2f5914b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19]): potential dests added=[] removed=[] 2024-03-04T12:46:12.093 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.088+0000 7f2f5914b800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-03-04T12:46:12.095 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.089+0000 7f2e0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:12.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.091+0000 7f2f5914b800 20 remove_watcher() i=0 2024-03-04T12:46:12.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.091+0000 7f2f5914b800 2 removed watcher, disabling cache 2024-03-04T12:46:12.098 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.092+0000 7f2f5914b800 20 remove_watcher() i=1 2024-03-04T12:46:12.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.093+0000 7f2f5914b800 20 remove_watcher() i=2 2024-03-04T12:46:12.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.094+0000 7f2f5914b800 20 remove_watcher() i=3 2024-03-04T12:46:12.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.095+0000 7f2f5914b800 20 remove_watcher() i=4 2024-03-04T12:46:12.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.096+0000 7f2f5914b800 20 remove_watcher() i=5 2024-03-04T12:46:12.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.097+0000 7f2f5914b800 20 remove_watcher() i=6 2024-03-04T12:46:12.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.098+0000 7f2f5914b800 20 remove_watcher() i=7 2024-03-04T12:46:12.115 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-04T12:46:12.142 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:12.142 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:12.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.170+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.171+0000 7f102c51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.171+0000 7f102c51f800 20 realm 2024-03-04T12:46:12.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.171+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.171+0000 7f102c51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.171+0000 7f102c51f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:12.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.171+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.171+0000 7f102c51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.171+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.172+0000 7f102c51f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:12.179 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.172+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.179 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.173+0000 7f102c51f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:12.179 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.173+0000 7f102c51f800 20 searching for the correct realm 2024-03-04T12:46:12.181 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.175+0000 7f101fa80640 0 -- 172.21.15.90:0/2157933772 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f101007c040 msgr2=0x7f101006b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:12.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.380+0000 7f1028281640 0 -- 172.21.15.90:0/2157933772 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f101006b040 msgr2=0x7f101008f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:12.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.586+0000 7f102c51f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:12.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.586+0000 7f102c51f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:12.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.586+0000 7f102c51f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:12.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.586+0000 7f102c51f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:12.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.586+0000 7f102c51f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:12.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.586+0000 7f102c51f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:12.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.586+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.586+0000 7f102c51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.586+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.587+0000 7f102c51f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:12.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.587+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.587+0000 7f102c51f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.587+0000 7f102c51f800 20 zone default found 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.587+0000 7f102c51f800 4 Realm: () 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.587+0000 7f102c51f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.587+0000 7f102c51f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.587+0000 7f102c51f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.587+0000 7f102c51f800 20 zonegroup default 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.587+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.587+0000 7f102c51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.587+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.588+0000 7f102c51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.588+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.588+0000 7f102c51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.588+0000 7f102c51f800 20 started sync module instance, tier type = 2024-03-04T12:46:12.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.588+0000 7f102c51f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:12.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.597+0000 7f102c51f800 20 add_watcher() i=0 2024-03-04T12:46:12.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.597+0000 7f102c51f800 20 add_watcher() i=1 2024-03-04T12:46:12.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.597+0000 7f102c51f800 20 add_watcher() i=2 2024-03-04T12:46:12.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.597+0000 7f102c51f800 20 add_watcher() i=3 2024-03-04T12:46:12.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.597+0000 7f102c51f800 20 add_watcher() i=4 2024-03-04T12:46:12.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.597+0000 7f102c51f800 20 add_watcher() i=5 2024-03-04T12:46:12.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.597+0000 7f102c51f800 20 add_watcher() i=6 2024-03-04T12:46:12.604 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.598+0000 7f102c51f800 20 add_watcher() i=7 2024-03-04T12:46:12.604 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.598+0000 7f102c51f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:12.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.599+0000 7f0edefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:12.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.600+0000 7f102c51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:12.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.600+0000 7f102c51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:12.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.600+0000 7f102c51f800 5 note: GC not initialized 2024-03-04T12:46:12.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.600+0000 7f0eddfdb640 20 reqs_thread_entry: start 2024-03-04T12:46:12.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.600+0000 7f102c51f800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:12.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.600+0000 7f102c51f800 20 Filter name: none 2024-03-04T12:46:12.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.600+0000 7f0e4f7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:12.607 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.600+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.601+0000 7f102c51f800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:12.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.601+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.601+0000 7f102c51f800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:12.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.601+0000 7f102c51f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:12.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.601+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.601+0000 7f102c51f800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:12.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.601+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.602+0000 7f102c51f800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:12.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.602+0000 7f102c51f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:12.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.603+0000 7f102c51f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.603+0000 7f102c51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.604+0000 7f0edefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:12.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.606+0000 7f102c51f800 20 remove_watcher() i=0 2024-03-04T12:46:12.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.606+0000 7f102c51f800 2 removed watcher, disabling cache 2024-03-04T12:46:12.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.607+0000 7f102c51f800 20 remove_watcher() i=1 2024-03-04T12:46:12.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.608+0000 7f102c51f800 20 remove_watcher() i=2 2024-03-04T12:46:12.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.609+0000 7f102c51f800 20 remove_watcher() i=3 2024-03-04T12:46:12.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.610+0000 7f102c51f800 20 remove_watcher() i=4 2024-03-04T12:46:12.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.611+0000 7f102c51f800 20 remove_watcher() i=5 2024-03-04T12:46:12.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.612+0000 7f102c51f800 20 remove_watcher() i=6 2024-03-04T12:46:12.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.613+0000 7f102c51f800 20 remove_watcher() i=7 2024-03-04T12:46:12.628 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:12.628 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:12.628 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-set-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:46:12.629 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:12.630 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.630 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.634 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.634 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.679 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.679 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.705 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-03-04T12:46:12.705 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:12.706 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.706 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.718 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.718 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.761 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.761 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.769 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.769 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.775 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.776 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.782 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.783 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.789 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.789 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.796 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.797 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.803 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.804 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.811 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.811 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.817 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.818 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.824 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.824 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.831 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.831 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.838 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.838 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.844 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.844 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.851 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.851 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.858 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.858 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.865 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.865 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.872 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.872 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.879 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.879 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.886 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.886 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.892 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:12.892 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:12.900 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-04T12:46:12.927 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:12.927 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:12.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.954+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.961 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.955+0000 7f7b16542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.955+0000 7f7b16542800 20 realm 2024-03-04T12:46:12.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.955+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.956+0000 7f7b16542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.956+0000 7f7b16542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:12.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.956+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.956+0000 7f7b16542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:12.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.956+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.957+0000 7f7b16542800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:12.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.957+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:12.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.957+0000 7f7b16542800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:12.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.957+0000 7f7b16542800 20 searching for the correct realm 2024-03-04T12:46:12.965 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.959+0000 7f7b11a40640 0 -- 172.21.15.90:0/4110246177 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f7b0806e040 msgr2=0x7f7b0805f6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:12.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:12.963+0000 7f7b12241640 0 -- 172.21.15.90:0/4110246177 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f7b08020040 msgr2=0x7f7b0800c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:13.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.169+0000 7f7b16542800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:13.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.169+0000 7f7b16542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:13.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.169+0000 7f7b16542800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:13.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.169+0000 7f7b16542800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:13.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.169+0000 7f7b16542800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:13.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.169+0000 7f7b16542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:13.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.169+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.169+0000 7f7b16542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.169+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.169+0000 7f7b16542800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:13.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.169+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.170+0000 7f7b16542800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:13.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.170+0000 7f7b16542800 20 zone default found 2024-03-04T12:46:13.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.170+0000 7f7b16542800 4 Realm: () 2024-03-04T12:46:13.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.170+0000 7f7b16542800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:13.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.170+0000 7f7b16542800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:13.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.170+0000 7f7b16542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:13.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.170+0000 7f7b16542800 20 zonegroup default 2024-03-04T12:46:13.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.170+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.170+0000 7f7b16542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.177 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.170+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.170+0000 7f7b16542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.171+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.171+0000 7f7b16542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.171+0000 7f7b16542800 20 started sync module instance, tier type = 2024-03-04T12:46:13.178 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.171+0000 7f7b16542800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:13.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.180+0000 7f7b16542800 20 add_watcher() i=0 2024-03-04T12:46:13.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.180+0000 7f7b16542800 20 add_watcher() i=1 2024-03-04T12:46:13.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.180+0000 7f7b16542800 20 add_watcher() i=2 2024-03-04T12:46:13.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.180+0000 7f7b16542800 20 add_watcher() i=3 2024-03-04T12:46:13.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.180+0000 7f7b16542800 20 add_watcher() i=4 2024-03-04T12:46:13.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.180+0000 7f7b16542800 20 add_watcher() i=5 2024-03-04T12:46:13.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.180+0000 7f7b16542800 20 add_watcher() i=6 2024-03-04T12:46:13.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.181+0000 7f7b16542800 20 add_watcher() i=7 2024-03-04T12:46:13.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.181+0000 7f7b16542800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:13.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.182+0000 7f79c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:13.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.182+0000 7f7b16542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:13.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.182+0000 7f7b16542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:13.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.182+0000 7f7b16542800 5 note: GC not initialized 2024-03-04T12:46:13.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.183+0000 7f79437fe640 20 reqs_thread_entry: start 2024-03-04T12:46:13.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.183+0000 7f7b16542800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:13.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.183+0000 7f7b16542800 20 Filter name: none 2024-03-04T12:46:13.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.183+0000 7f79417fa640 20 reqs_thread_entry: start 2024-03-04T12:46:13.189 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.183+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.190 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.183+0000 7f7b16542800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:13.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.184+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.184+0000 7f7b16542800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:13.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.184+0000 7f7b16542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:13.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.184+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.184+0000 7f7b16542800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:13.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.184+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.185+0000 7f7b16542800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:13.191 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.185+0000 7f7b16542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:13.192 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.186+0000 7f7b16542800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.192 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.186+0000 7f7b16542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.193 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.187+0000 7f79c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:13.195 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.189+0000 7f7b16542800 20 remove_watcher() i=0 2024-03-04T12:46:13.195 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.189+0000 7f7b16542800 2 removed watcher, disabling cache 2024-03-04T12:46:13.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.190+0000 7f7b16542800 20 remove_watcher() i=1 2024-03-04T12:46:13.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.191+0000 7f7b16542800 20 remove_watcher() i=2 2024-03-04T12:46:13.198 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.192+0000 7f7b16542800 20 remove_watcher() i=3 2024-03-04T12:46:13.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.193+0000 7f7b16542800 20 remove_watcher() i=4 2024-03-04T12:46:13.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.194+0000 7f7b16542800 20 remove_watcher() i=5 2024-03-04T12:46:13.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.195+0000 7f7b16542800 20 remove_watcher() i=6 2024-03-04T12:46:13.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.196+0000 7f7b16542800 20 remove_watcher() i=7 2024-03-04T12:46:13.211 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:13.212 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:13.212 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-set-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:46:13.212 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:13.213 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-03-04T12:46:13.248 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:13.248 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:13.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.276+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.277+0000 7fb2cf709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.277+0000 7fb2cf709800 20 realm 2024-03-04T12:46:13.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.277+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.277+0000 7fb2cf709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.277+0000 7fb2cf709800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:13.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.277+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.278+0000 7fb2cf709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.278+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.278+0000 7fb2cf709800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:13.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.278+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.279+0000 7fb2cf709800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:13.285 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.279+0000 7fb2cf709800 20 searching for the correct realm 2024-03-04T12:46:13.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.283+0000 7fb2cda06640 0 -- 172.21.15.90:0/3281213518 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7fb2c4043a60 msgr2=0x7fb2c405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:13.494 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.488+0000 7fb2cd205640 0 -- 172.21.15.90:0/3281213518 >> [v2:172.21.15.184:6824/1880219084,v1:172.21.15.184:6825/1880219084] conn(0x556abb6de970 msgr2=0x556abb6e0d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:13.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.490+0000 7fb2cf709800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:13.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.490+0000 7fb2cf709800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:13.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.490+0000 7fb2cf709800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:13.497 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.490+0000 7fb2cf709800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.490+0000 7fb2cf709800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.490+0000 7fb2cf709800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.490+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 20 zone default found 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 4 Realm: () 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:13.498 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 20 zonegroup default 2024-03-04T12:46:13.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.491+0000 7fb2cf709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.492+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.492+0000 7fb2cf709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.492+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.492+0000 7fb2cf709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.499 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.492+0000 7fb2cf709800 20 started sync module instance, tier type = 2024-03-04T12:46:13.500 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.492+0000 7fb2cf709800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:13.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.506+0000 7fb2cf709800 20 add_watcher() i=0 2024-03-04T12:46:13.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.506+0000 7fb2cf709800 20 add_watcher() i=1 2024-03-04T12:46:13.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.506+0000 7fb2cf709800 20 add_watcher() i=2 2024-03-04T12:46:13.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.506+0000 7fb2cf709800 20 add_watcher() i=3 2024-03-04T12:46:13.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.506+0000 7fb2cf709800 20 add_watcher() i=4 2024-03-04T12:46:13.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.506+0000 7fb2cf709800 20 add_watcher() i=5 2024-03-04T12:46:13.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.506+0000 7fb2cf709800 20 add_watcher() i=6 2024-03-04T12:46:13.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.507+0000 7fb2cf709800 20 add_watcher() i=7 2024-03-04T12:46:13.513 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.507+0000 7fb2cf709800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:13.514 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.508+0000 7fb1837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:13.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb2cf709800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb2cf709800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb2cf709800 5 note: GC not initialized 2024-03-04T12:46:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb1827e4640 20 reqs_thread_entry: start 2024-03-04T12:46:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb2cf709800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb2cf709800 20 Filter name: none 2024-03-04T12:46:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb0f3fff640 20 reqs_thread_entry: start 2024-03-04T12:46:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb2cf709800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-04T12:46:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb2cf709800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb2cf709800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-04T12:46:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb2cf709800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-04T12:46:13.516 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb2cf709800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 : miss 2024-03-04T12:46:13.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.509+0000 7fb2cf709800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.510+0000 7fb2cf709800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:13.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.510+0000 7fb2cf709800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 info.flags=0x17 2024-03-04T12:46:13.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.510+0000 7fb2cf709800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 to cache LRU end 2024-03-04T12:46:13.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.510+0000 7fb2cf709800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:13.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.510+0000 7fb2cf709800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:13.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.510+0000 7fb2cf709800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 2024-03-04T12:46:13.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.515+0000 7fb2cf709800 -1 Injecting error=-125 at location=set_target_layout 2024-03-04T12:46:13.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.517+0000 7fb2cf709800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 info.flags=0x17 2024-03-04T12:46:13.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.517+0000 7fb2cf709800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 to cache LRU end 2024-03-04T12:46:13.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.517+0000 7fb2cf709800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:13.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.517+0000 7fb2cf709800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20, ofs0, ns] 2024-03-04T12:46:13.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.517+0000 7fb19ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824065 cookie 93916899482800 notifier 6297 bl.length()=887 2024-03-04T12:46:13.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.517+0000 7fb19ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 info.flags=0x17 2024-03-04T12:46:13.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.517+0000 7fb19ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 to cache LRU end 2024-03-04T12:46:13.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.517+0000 7fb19ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:13.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.517+0000 7fb2cf709800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20]): orig_sources= new_sources= 2024-03-04T12:46:13.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.517+0000 7fb2cf709800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20]): potential sources added=[] removed=[] 2024-03-04T12:46:13.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.517+0000 7fb2cf709800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20]): orig_dests= new_dests= 2024-03-04T12:46:13.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.517+0000 7fb2cf709800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20]): potential dests added=[] removed=[] 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.0 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.0 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.1 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.1 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.2 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.2 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.3 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.3 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.4 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.4 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.5 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.5 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.6 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.6 2024-03-04T12:46:13.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.7 2024-03-04T12:46:13.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.7 2024-03-04T12:46:13.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.8 2024-03-04T12:46:13.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.8 2024-03-04T12:46:13.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.9 2024-03-04T12:46:13.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.9 2024-03-04T12:46:13.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.10 2024-03-04T12:46:13.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.10 2024-03-04T12:46:13.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.11 2024-03-04T12:46:13.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1.11 2024-03-04T12:46:13.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.0 2024-03-04T12:46:13.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.520+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.1 2024-03-04T12:46:13.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.521+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.2 2024-03-04T12:46:13.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.521+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.3 2024-03-04T12:46:13.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.521+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.4 2024-03-04T12:46:13.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.522+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.5 2024-03-04T12:46:13.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.522+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.6 2024-03-04T12:46:13.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.523+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.7 2024-03-04T12:46:13.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.523+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.8 2024-03-04T12:46:13.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.524+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.9 2024-03-04T12:46:13.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.525+0000 7fb2cf709800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20.10 2024-03-04T12:46:13.533 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.527+0000 7fb2cf709800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 : hit (requested=0x17, cached=0x17) 2024-03-04T12:46:13.533 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.527+0000 7fb2cf709800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 2024-03-04T12:46:13.534 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.528+0000 7fb2cf709800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 info.flags=0x17 2024-03-04T12:46:13.534 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.528+0000 7fb2cf709800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 to cache LRU end 2024-03-04T12:46:13.534 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.528+0000 7fb2cf709800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:13.534 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.528+0000 7fb2cf709800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20, ofs0, ns] 2024-03-04T12:46:13.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.529+0000 7fb1b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824066 cookie 93916899482800 notifier 6297 bl.length()=855 2024-03-04T12:46:13.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.529+0000 7fb1b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 info.flags=0x17 2024-03-04T12:46:13.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.529+0000 7fb1b0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 to cache LRU end 2024-03-04T12:46:13.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.529+0000 7fb1b0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:13.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.529+0000 7fb2cf709800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20]): orig_sources= new_sources= 2024-03-04T12:46:13.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.529+0000 7fb2cf709800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20]): potential sources added=[] removed=[] 2024-03-04T12:46:13.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.529+0000 7fb2cf709800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20]): orig_dests= new_dests= 2024-03-04T12:46:13.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.529+0000 7fb2cf709800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20]): potential dests added=[] removed=[] 2024-03-04T12:46:13.539 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.531+0000 7fb2cf709800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-03-04T12:46:13.540 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.533+0000 7fb1837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:13.541 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.535+0000 7fb2cf709800 20 remove_watcher() i=0 2024-03-04T12:46:13.541 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.535+0000 7fb2cf709800 2 removed watcher, disabling cache 2024-03-04T12:46:13.542 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.536+0000 7fb2cf709800 20 remove_watcher() i=1 2024-03-04T12:46:13.543 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.537+0000 7fb2cf709800 20 remove_watcher() i=2 2024-03-04T12:46:13.544 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.538+0000 7fb2cf709800 20 remove_watcher() i=3 2024-03-04T12:46:13.545 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.539+0000 7fb2cf709800 20 remove_watcher() i=4 2024-03-04T12:46:13.546 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.540+0000 7fb2cf709800 20 remove_watcher() i=5 2024-03-04T12:46:13.546 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.541+0000 7fb2cf709800 20 remove_watcher() i=6 2024-03-04T12:46:13.547 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.542+0000 7fb2cf709800 20 remove_watcher() i=7 2024-03-04T12:46:13.558 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-04T12:46:13.587 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:13.587 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:13.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.613+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.615+0000 7faa3272f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.615+0000 7faa3272f800 20 realm 2024-03-04T12:46:13.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.615+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.615+0000 7faa3272f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.615+0000 7faa3272f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:13.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.615+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.615+0000 7faa3272f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.615+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.616+0000 7faa3272f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:13.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.616+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.617+0000 7faa3272f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:13.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.617+0000 7faa3272f800 20 searching for the correct realm 2024-03-04T12:46:13.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.619+0000 7faa2e431640 0 -- 172.21.15.90:0/816864520 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7faa2005e040 msgr2=0x7faa200c69d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:13.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.623+0000 7faa2e431640 0 -- 172.21.15.90:0/816864520 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7faa18087c40 msgr2=0x7faa1806d030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:13.835 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.829+0000 7faa3272f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.829+0000 7faa3272f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.829+0000 7faa3272f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.829+0000 7faa3272f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.829+0000 7faa3272f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.829+0000 7faa3272f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.829+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.829+0000 7faa3272f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.829+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.829+0000 7faa3272f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.829+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:13.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 20 zone default found 2024-03-04T12:46:13.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 4 Realm: () 2024-03-04T12:46:13.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:13.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:13.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:13.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 20 zonegroup default 2024-03-04T12:46:13.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 20 started sync module instance, tier type = 2024-03-04T12:46:13.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.830+0000 7faa3272f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:13.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.841+0000 7faa3272f800 20 add_watcher() i=0 2024-03-04T12:46:13.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.841+0000 7faa3272f800 20 add_watcher() i=1 2024-03-04T12:46:13.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.841+0000 7faa3272f800 20 add_watcher() i=2 2024-03-04T12:46:13.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.841+0000 7faa3272f800 20 add_watcher() i=3 2024-03-04T12:46:13.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.841+0000 7faa3272f800 20 add_watcher() i=4 2024-03-04T12:46:13.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.841+0000 7faa3272f800 20 add_watcher() i=5 2024-03-04T12:46:13.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.841+0000 7faa3272f800 20 add_watcher() i=6 2024-03-04T12:46:13.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.843+0000 7faa3272f800 20 add_watcher() i=7 2024-03-04T12:46:13.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.843+0000 7faa3272f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:13.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.844+0000 7fa8e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:13.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.845+0000 7faa3272f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:13.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.845+0000 7faa3272f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:13.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.845+0000 7faa3272f800 5 note: GC not initialized 2024-03-04T12:46:13.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.845+0000 7fa85f7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:13.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.845+0000 7faa3272f800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:13.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.845+0000 7faa3272f800 20 Filter name: none 2024-03-04T12:46:13.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.845+0000 7fa85d7fa640 20 reqs_thread_entry: start 2024-03-04T12:46:13.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.845+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.846+0000 7faa3272f800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:13.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.846+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.846+0000 7faa3272f800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:13.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.846+0000 7faa3272f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:13.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.846+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.846+0000 7faa3272f800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:13.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.846+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.847+0000 7faa3272f800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:13.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.847+0000 7faa3272f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:13.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.847+0000 7faa3272f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:13.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.848+0000 7faa3272f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:13.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.848+0000 7fa8e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:13.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.851+0000 7faa3272f800 20 remove_watcher() i=0 2024-03-04T12:46:13.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.851+0000 7faa3272f800 2 removed watcher, disabling cache 2024-03-04T12:46:13.857 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.852+0000 7faa3272f800 20 remove_watcher() i=1 2024-03-04T12:46:13.858 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.853+0000 7faa3272f800 20 remove_watcher() i=2 2024-03-04T12:46:13.860 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.854+0000 7faa3272f800 20 remove_watcher() i=3 2024-03-04T12:46:13.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.855+0000 7faa3272f800 20 remove_watcher() i=4 2024-03-04T12:46:13.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.856+0000 7faa3272f800 20 remove_watcher() i=5 2024-03-04T12:46:13.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.857+0000 7faa3272f800 20 remove_watcher() i=6 2024-03-04T12:46:13.864 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:13.858+0000 7faa3272f800 20 remove_watcher() i=7 2024-03-04T12:46:13.873 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:13.873 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:13.874 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-set-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-03-04T12:46:13.874 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:13.875 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:13.876 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:13.878 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:13.878 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:13.938 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:13.938 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:13.964 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard bucket with abort at set_target_layout 2024-03-04T12:46:13.964 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:13.965 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:13.965 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:13.976 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:13.976 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.019 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.019 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.027 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.028 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.034 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.035 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.041 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.041 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.049 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.049 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.056 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.057 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.063 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.063 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.070 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.070 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.076 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.076 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.084 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.084 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.090 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.091 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.097 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.097 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.104 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.104 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.111 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.111 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.118 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.118 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.124 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.125 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.133 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.133 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.140 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.140 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.147 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.147 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.154 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:14.155 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:14.162 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-04T12:46:14.189 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:14.189 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:14.222 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.216+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.223 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.217+0000 7fd66e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.217+0000 7fd66e4c0800 20 realm 2024-03-04T12:46:14.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.217+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.218+0000 7fd66e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.218+0000 7fd66e4c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:14.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.218+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.218+0000 7fd66e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.224 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.218+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.225 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.218+0000 7fd66e4c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:14.225 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.218+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.225 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.219+0000 7fd66e4c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:14.225 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.219+0000 7fd66e4c0800 20 searching for the correct realm 2024-03-04T12:46:14.228 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.222+0000 7fd66c7bd640 0 -- 172.21.15.90:0/3584690201 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x55f92ac880c0 msgr2=0x55f92ac8a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:14.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.226+0000 7fd66b7bb640 0 -- 172.21.15.90:0/3584690201 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fd660080040 msgr2=0x7fd660056570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:14.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.229+0000 7fd66e4c0800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:14.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.229+0000 7fd66e4c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:14.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.229+0000 7fd66e4c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:14.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.229+0000 7fd66e4c0800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:14.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.229+0000 7fd66e4c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:14.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.229+0000 7fd66e4c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:14.235 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.229+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.229+0000 7fd66e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.229+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.229+0000 7fd66e4c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:14.236 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.229+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:14.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 20 zone default found 2024-03-04T12:46:14.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 4 Realm: () 2024-03-04T12:46:14.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:14.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:14.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:14.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 20 zonegroup default 2024-03-04T12:46:14.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 20 started sync module instance, tier type = 2024-03-04T12:46:14.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.230+0000 7fd66e4c0800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:14.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.238+0000 7fd66e4c0800 20 add_watcher() i=0 2024-03-04T12:46:14.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.238+0000 7fd66e4c0800 20 add_watcher() i=1 2024-03-04T12:46:14.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.238+0000 7fd66e4c0800 20 add_watcher() i=2 2024-03-04T12:46:14.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.238+0000 7fd66e4c0800 20 add_watcher() i=3 2024-03-04T12:46:14.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.238+0000 7fd66e4c0800 20 add_watcher() i=4 2024-03-04T12:46:14.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.238+0000 7fd66e4c0800 20 add_watcher() i=5 2024-03-04T12:46:14.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.238+0000 7fd66e4c0800 20 add_watcher() i=6 2024-03-04T12:46:14.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.239+0000 7fd66e4c0800 20 add_watcher() i=7 2024-03-04T12:46:14.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.239+0000 7fd66e4c0800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:14.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.241+0000 7fd521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:14.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.241+0000 7fd66e4c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:14.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.241+0000 7fd66e4c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:14.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.241+0000 7fd66e4c0800 5 note: GC not initialized 2024-03-04T12:46:14.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.241+0000 7fd520fe1640 20 reqs_thread_entry: start 2024-03-04T12:46:14.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.241+0000 7fd66e4c0800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:14.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.242+0000 7fd66e4c0800 20 Filter name: none 2024-03-04T12:46:14.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.242+0000 7fd49a7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:14.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.242+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.242+0000 7fd66e4c0800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:14.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.242+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.243+0000 7fd66e4c0800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:14.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.243+0000 7fd66e4c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:14.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.243+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.243+0000 7fd66e4c0800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:14.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.243+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.243+0000 7fd66e4c0800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:14.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.243+0000 7fd66e4c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:14.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.244+0000 7fd66e4c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.244+0000 7fd66e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.245+0000 7fd521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:14.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.247+0000 7fd66e4c0800 20 remove_watcher() i=0 2024-03-04T12:46:14.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.247+0000 7fd66e4c0800 2 removed watcher, disabling cache 2024-03-04T12:46:14.254 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.248+0000 7fd66e4c0800 20 remove_watcher() i=1 2024-03-04T12:46:14.255 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.249+0000 7fd66e4c0800 20 remove_watcher() i=2 2024-03-04T12:46:14.255 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.250+0000 7fd66e4c0800 20 remove_watcher() i=3 2024-03-04T12:46:14.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.251+0000 7fd66e4c0800 20 remove_watcher() i=4 2024-03-04T12:46:14.257 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.252+0000 7fd66e4c0800 20 remove_watcher() i=5 2024-03-04T12:46:14.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.253+0000 7fd66e4c0800 20 remove_watcher() i=6 2024-03-04T12:46:14.259 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.254+0000 7fd66e4c0800 20 remove_watcher() i=7 2024-03-04T12:46:14.269 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.269 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:14.269 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: abort-at-set-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:46:14.269 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.270 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-03-04T12:46:14.303 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:14.303 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:14.336 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.330+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.332+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.332+0000 7f499b067800 20 realm 2024-03-04T12:46:14.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.332+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.332+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.332+0000 7f499b067800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:14.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.332+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.332+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.332+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.333+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:14.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.333+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.333+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:14.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.333+0000 7f499b067800 20 searching for the correct realm 2024-03-04T12:46:14.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.336+0000 7f4998b63640 0 -- 172.21.15.90:0/3102904642 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f4990033040 msgr2=0x7f4990024aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:14.345 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.339+0000 7f4998b63640 0 -- 172.21.15.90:0/3102904642 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f498c0397d0 msgr2=0x7f498c042990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:14.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:14.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:14.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:14.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:14.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:14.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:14.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.545+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.545+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.545+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:14.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 20 zone default found 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 4 Realm: () 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 20 zonegroup default 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.546+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.554 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.547+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.547+0000 7f499b067800 20 started sync module instance, tier type = 2024-03-04T12:46:14.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.547+0000 7f499b067800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:14.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=0 2024-03-04T12:46:14.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=1 2024-03-04T12:46:14.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=2 2024-03-04T12:46:14.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=3 2024-03-04T12:46:14.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=4 2024-03-04T12:46:14.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=5 2024-03-04T12:46:14.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=6 2024-03-04T12:46:14.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.556+0000 7f499b067800 20 add_watcher() i=7 2024-03-04T12:46:14.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.556+0000 7f499b067800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:14.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.558+0000 7f484efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.558+0000 7f499b067800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.558+0000 7f499b067800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.558+0000 7f499b067800 5 note: GC not initialized 2024-03-04T12:46:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.558+0000 7f484dfe3640 20 reqs_thread_entry: start 2024-03-04T12:46:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.558+0000 7f499b067800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.558+0000 7f499b067800 20 Filter name: none 2024-03-04T12:46:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f47bf7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-04T12:46:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-04T12:46:14.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-04T12:46:14.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 : miss 2024-03-04T12:46:14.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:14.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 info.flags=0x17 2024-03-04T12:46:14.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 to cache LRU end 2024-03-04T12:46:14.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:14.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:14.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.559+0000 7f499b067800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 2024-03-04T12:46:14.569 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f499b067800 time 2024-03-04T12:46:14.564952+0000 2024-03-04T12:46:14.569 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:46:14.570 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:14.570 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f499e380e86] 2024-03-04T12:46:14.570 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f499e381044] 2024-03-04T12:46:14.570 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dac975deb1] 2024-03-04T12:46:14.570 INFO:tasks.workunit.client.0.smithi090.stderr: 4: radosgw-admin(+0x7e4532) [0x55dac9768532] 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dac9771d1b] 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr: 6: main() 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f499d23feb0] 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr: 8: __libc_start_main() 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr: 9: _start() 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.564+0000 7f499b067800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f499b067800 time 2024-03-04T12:46:14.564952+0000 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f499e380e86] 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f499e381044] 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dac975deb1] 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr: 4: radosgw-admin(+0x7e4532) [0x55dac9768532] 2024-03-04T12:46:14.571 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dac9771d1b] 2024-03-04T12:46:14.572 INFO:tasks.workunit.client.0.smithi090.stderr: 6: main() 2024-03-04T12:46:14.572 INFO:tasks.workunit.client.0.smithi090.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f499d23feb0] 2024-03-04T12:46:14.572 INFO:tasks.workunit.client.0.smithi090.stderr: 8: __libc_start_main() 2024-03-04T12:46:14.572 INFO:tasks.workunit.client.0.smithi090.stderr: 9: _start() 2024-03-04T12:46:14.572 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.572 INFO:tasks.workunit.client.0.smithi090.stderr:*** Caught signal (Aborted) ** 2024-03-04T12:46:14.572 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7f499b067800 thread_name:radosgw-admin 2024-03-04T12:46:14.595 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:14.596 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f499d254db0] 2024-03-04T12:46:14.596 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f499d2a154c] 2024-03-04T12:46:14.596 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:46:14.596 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:46:14.596 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f499e380ee0] 2024-03-04T12:46:14.596 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f499e381044] 2024-03-04T12:46:14.596 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dac975deb1] 2024-03-04T12:46:14.596 INFO:tasks.workunit.client.0.smithi090.stderr: 8: radosgw-admin(+0x7e4532) [0x55dac9768532] 2024-03-04T12:46:14.596 INFO:tasks.workunit.client.0.smithi090.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dac9771d1b] 2024-03-04T12:46:14.596 INFO:tasks.workunit.client.0.smithi090.stderr: 10: main() 2024-03-04T12:46:14.596 INFO:tasks.workunit.client.0.smithi090.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f499d23feb0] 2024-03-04T12:46:14.596 INFO:tasks.workunit.client.0.smithi090.stderr: 12: __libc_start_main() 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: 13: _start() 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.565+0000 7f499b067800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7f499b067800 thread_name:radosgw-admin 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f499d254db0] 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f499d2a154c] 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f499e380ee0] 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f499e381044] 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dac975deb1] 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: 8: radosgw-admin(+0x7e4532) [0x55dac9768532] 2024-03-04T12:46:14.597 INFO:tasks.workunit.client.0.smithi090.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dac9771d1b] 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr: 10: main() 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f499d23feb0] 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr: 12: __libc_start_main() 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr: 13: _start() 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr:--- begin dump of recent events --- 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr: -499> 2024-03-04T12:46:14.314+0000 7f4999364640 10 monclient: _finish_hunting 0 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr: -498> 2024-03-04T12:46:14.314+0000 7f4999364640 1 monclient: found mon.noname-a 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr: -497> 2024-03-04T12:46:14.314+0000 7f4999364640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr: -496> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr: -495> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:46:14.598 INFO:tasks.workunit.client.0.smithi090.stderr: -494> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: dump: 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr: -493> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: _finish_auth 0 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr: -492> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: _check_auth_tickets 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr: -491> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:14.599 INFO:tasks.workunit.client.0.smithi090.stderr: -490> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr: -489> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr: -488> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: dump: 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.600 INFO:tasks.workunit.client.0.smithi090.stderr: -487> 2024-03-04T12:46:14.315+0000 7f499b067800 5 monclient: authenticate success, global_id 6339 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr: -486> 2024-03-04T12:46:14.315+0000 7f499b067800 10 monclient: get_monmap_and_config success 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr: -485> 2024-03-04T12:46:14.315+0000 7f499b067800 4 set_mon_vals no callback set 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr: -484> 2024-03-04T12:46:14.315+0000 7f499b067800 10 monclient: shutdown 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr: -483> 2024-03-04T12:46:14.315+0000 7f499b067800 5 asok(0x55dacbead0c0) unregister_commands rotate-key 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr: -482> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient: build_initial_monmap 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr: -481> 2024-03-04T12:46:14.316+0000 7f499b067800 1 build_initial for_mkfs: 0 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr: -480> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient: monmap: 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.601 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: -479> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding auth protocol: cephx 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: -478> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding auth protocol: cephx 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: -477> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding auth protocol: cephx 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: -476> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: secure 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: -475> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: crc 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: -474> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: secure 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: -473> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: crc 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: -472> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: secure 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: -471> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: crc 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: -470> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: crc 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: -469> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: secure 2024-03-04T12:46:14.602 INFO:tasks.workunit.client.0.smithi090.stderr: -468> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: crc 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -467> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: secure 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -466> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: crc 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -465> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: secure 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -464> 2024-03-04T12:46:14.316+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -463> 2024-03-04T12:46:14.316+0000 7f499b067800 1 librados: starting msgr at 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -462> 2024-03-04T12:46:14.316+0000 7f499b067800 1 librados: starting objecter 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -461> 2024-03-04T12:46:14.316+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command objecter_requests hook 0x55dacc0cf670 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -460> 2024-03-04T12:46:14.316+0000 7f499b067800 1 librados: setting wanted keys 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -459> 2024-03-04T12:46:14.316+0000 7f499b067800 1 librados: calling monclient init 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -458> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient: init 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -457> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding auth protocol: cephx 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -456> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding auth protocol: cephx 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -455> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding auth protocol: cephx 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -454> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: secure 2024-03-04T12:46:14.603 INFO:tasks.workunit.client.0.smithi090.stderr: -453> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: crc 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -452> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: secure 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -451> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: crc 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -450> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: secure 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -449> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: crc 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -448> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: crc 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -447> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: secure 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -446> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: crc 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -445> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: secure 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -444> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: crc 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -443> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: secure 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -442> 2024-03-04T12:46:14.316+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -441> 2024-03-04T12:46:14.316+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.604 INFO:tasks.workunit.client.0.smithi090.stderr: -440> 2024-03-04T12:46:14.316+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command rotate-key hook 0x55dacc0ca8a8 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -439> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -438> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -437> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): picked mon.noname-b con 0x55dacbf42640 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -436> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): picked mon.noname-c con 0x55dacbf778b0 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -435> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): picked mon.noname-a con 0x55dacc1095d0 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -434> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -433> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -432> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -431> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -430> 2024-03-04T12:46:14.317+0000 7f499b067800 10 monclient(hunting): authenticate will time out at 1406.648264s 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -429> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): get_auth_request con 0x55dacbf778b0 auth_method 0 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -428> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -427> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.605 INFO:tasks.workunit.client.0.smithi090.stderr: -426> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -425> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): get_auth_request con 0x55dacbf42640 auth_method 0 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -424> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -423> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -422> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -421> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): get_auth_request con 0x55dacc1095d0 auth_method 0 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -420> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -419> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -418> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -417> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -416> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -415> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -414> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -413> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -412> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -411> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.606 INFO:tasks.workunit.client.0.smithi090.stderr: -410> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr: -409> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr: -408> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): handle_auth_done global_id 6020 payload 824 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr: -407> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient: _finish_hunting 0 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr: -406> 2024-03-04T12:46:14.317+0000 7f4998362640 1 monclient: found mon.noname-c 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr: -405> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr: -404> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr: -403> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr: -402> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: dump: 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.607 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr: -401> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: _finish_auth 0 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr: -400> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: _check_auth_tickets 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr: -399> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr: -398> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr: -397> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr: -396> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: dump: 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.608 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr: -395> 2024-03-04T12:46:14.317+0000 7f499b067800 5 monclient: authenticate success, global_id 6020 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr: -394> 2024-03-04T12:46:14.317+0000 7f4886e0d640 4 set_mon_vals no callback set 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr: -393> 2024-03-04T12:46:14.317+0000 7f499b067800 10 monclient: _renew_subs 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr: -392> 2024-03-04T12:46:14.317+0000 7f499b067800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr: -391> 2024-03-04T12:46:14.317+0000 7f499b067800 10 monclient: _renew_subs 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr: -390> 2024-03-04T12:46:14.317+0000 7f499b067800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr: -389> 2024-03-04T12:46:14.317+0000 7f499b067800 1 librados: init done 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr: -388> 2024-03-04T12:46:14.319+0000 7f488560a640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr: -387> 2024-03-04T12:46:14.319+0000 7f488560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:14.609 INFO:tasks.workunit.client.0.smithi090.stderr: -386> 2024-03-04T12:46:14.319+0000 7f488560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr: -385> 2024-03-04T12:46:14.319+0000 7f4998b63640 10 monclient: get_auth_request con 0x7f4880069f00 auth_method 0 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr: -384> 2024-03-04T12:46:14.319+0000 7f4999364640 10 monclient: get_auth_request con 0x55dacc0f0710 auth_method 0 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr: -383> 2024-03-04T12:46:14.320+0000 7f4998b63640 10 monclient: get_auth_request con 0x55dacc1168c0 auth_method 0 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr: -382> 2024-03-04T12:46:14.321+0000 7f4998362640 10 monclient: get_auth_request con 0x55dacc11ac20 auth_method 0 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr: -381> 2024-03-04T12:46:14.322+0000 7f499b067800 10 monclient: build_initial_monmap 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr: -380> 2024-03-04T12:46:14.322+0000 7f499b067800 1 build_initial for_mkfs: 0 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr: -379> 2024-03-04T12:46:14.322+0000 7f499b067800 10 monclient: monmap: 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:14.610 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: -378> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding auth protocol: cephx 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: -377> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding auth protocol: cephx 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: -376> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding auth protocol: cephx 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: -375> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: secure 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: -374> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: crc 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: -373> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: secure 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: -372> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: crc 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: -371> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: secure 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: -370> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: crc 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: -369> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: crc 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: -368> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: secure 2024-03-04T12:46:14.611 INFO:tasks.workunit.client.0.smithi090.stderr: -367> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: crc 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -366> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: secure 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -365> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: crc 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -364> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: secure 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -363> 2024-03-04T12:46:14.322+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -362> 2024-03-04T12:46:14.322+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command objecter_requests cmddesc objecter_requests hook 0x55dacc125070 EEXIST 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -361> 2024-03-04T12:46:14.322+0000 7f499b067800 10 monclient: init 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -360> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding auth protocol: cephx 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -359> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding auth protocol: cephx 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -358> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding auth protocol: cephx 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -357> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: secure 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -356> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: crc 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -355> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: secure 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -354> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: crc 2024-03-04T12:46:14.612 INFO:tasks.workunit.client.0.smithi090.stderr: -353> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: secure 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -352> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: crc 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -351> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: crc 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -350> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: secure 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -349> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: crc 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -348> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: secure 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -347> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: crc 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -346> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: secure 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -345> 2024-03-04T12:46:14.323+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -344> 2024-03-04T12:46:14.323+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -343> 2024-03-04T12:46:14.323+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command rotate-key cmddesc rotate-key hook 0x55dacc11e1b0 EEXIST 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -342> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -341> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -340> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): picked mon.noname-c con 0x55dacc149dd0 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -339> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): picked mon.noname-b con 0x55dacc14a1b0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:14.613 INFO:tasks.workunit.client.0.smithi090.stderr: -338> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): picked mon.noname-a con 0x55dacc145270 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -337> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -336> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -335> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -334> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -333> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): authenticate will time out at 1406.654643s 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -332> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): get_auth_request con 0x55dacc149dd0 auth_method 0 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -331> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -330> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -329> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -328> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): get_auth_request con 0x55dacc145270 auth_method 0 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -327> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -326> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -325> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.614 INFO:tasks.workunit.client.0.smithi090.stderr: -324> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr: -323> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr: -322> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr: -321> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr: -320> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr: -319> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr: -318> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): handle_auth_done global_id 6023 payload 824 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr: -317> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient: _finish_hunting 0 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr: -316> 2024-03-04T12:46:14.323+0000 7f4998b63640 1 monclient: found mon.noname-c 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr: -315> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr: -314> 2024-03-04T12:46:14.323+0000 7f487e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr: -313> 2024-03-04T12:46:14.323+0000 7f487e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr: -312> 2024-03-04T12:46:14.323+0000 7f487e7fc640 10 monclient: dump: 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.615 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr: -311> 2024-03-04T12:46:14.323+0000 7f487e7fc640 10 monclient: _finish_auth 0 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr: -310> 2024-03-04T12:46:14.323+0000 7f487e7fc640 10 monclient: _check_auth_tickets 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr: -309> 2024-03-04T12:46:14.324+0000 7f487e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr: -308> 2024-03-04T12:46:14.324+0000 7f487e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr: -307> 2024-03-04T12:46:14.324+0000 7f487e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr: -306> 2024-03-04T12:46:14.324+0000 7f487e7fc640 10 monclient: dump: 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.616 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr: -305> 2024-03-04T12:46:14.324+0000 7f499b067800 5 monclient: authenticate success, global_id 6023 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr: -304> 2024-03-04T12:46:14.324+0000 7f4999b65640 4 set_mon_vals no callback set 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr: -303> 2024-03-04T12:46:14.324+0000 7f499b067800 10 monclient: _renew_subs 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr: -302> 2024-03-04T12:46:14.324+0000 7f499b067800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr: -301> 2024-03-04T12:46:14.324+0000 7f499b067800 10 monclient: _renew_subs 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr: -300> 2024-03-04T12:46:14.324+0000 7f499b067800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr: -299> 2024-03-04T12:46:14.325+0000 7f487e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr: -298> 2024-03-04T12:46:14.325+0000 7f487e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:14.617 INFO:tasks.workunit.client.0.smithi090.stderr: -297> 2024-03-04T12:46:14.325+0000 7f487e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr: -296> 2024-03-04T12:46:14.325+0000 7f499b067800 10 monclient: get_monmap_and_config 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr: -295> 2024-03-04T12:46:14.325+0000 7f499b067800 10 monclient: build_initial_monmap 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr: -294> 2024-03-04T12:46:14.325+0000 7f499b067800 1 build_initial for_mkfs: 0 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr: -293> 2024-03-04T12:46:14.325+0000 7f499b067800 10 monclient: monmap: 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr: -292> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding auth protocol: cephx 2024-03-04T12:46:14.618 INFO:tasks.workunit.client.0.smithi090.stderr: -291> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding auth protocol: cephx 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -290> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding auth protocol: cephx 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -289> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -288> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -287> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -286> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -285> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -284> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -283> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -282> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -281> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -280> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -279> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -278> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -277> 2024-03-04T12:46:14.325+0000 7f4998362640 10 monclient: get_auth_request con 0x7f4870069dc0 auth_method 0 2024-03-04T12:46:14.619 INFO:tasks.workunit.client.0.smithi090.stderr: -276> 2024-03-04T12:46:14.326+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -275> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient: init 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -274> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding auth protocol: cephx 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -273> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding auth protocol: cephx 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -272> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding auth protocol: cephx 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -271> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: secure 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -270> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: crc 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -269> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: secure 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -268> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: crc 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -267> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: secure 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -266> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: crc 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -265> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: crc 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -264> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: secure 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -263> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: crc 2024-03-04T12:46:14.620 INFO:tasks.workunit.client.0.smithi090.stderr: -262> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: secure 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -261> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: crc 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -260> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: secure 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -259> 2024-03-04T12:46:14.326+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -258> 2024-03-04T12:46:14.326+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -257> 2024-03-04T12:46:14.326+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command rotate-key cmddesc rotate-key hook 0x7ffef65646c8 EEXIST 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -256> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -255> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -254> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): picked mon.noname-a con 0x55dacc19c190 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -253> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): picked mon.noname-c con 0x55dacc19c570 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -252> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): picked mon.noname-b con 0x55dacc18e2f0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -251> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -250> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -249> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -248> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -247> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): authenticate will time out at 1406.658024s 2024-03-04T12:46:14.621 INFO:tasks.workunit.client.0.smithi090.stderr: -246> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): get_auth_request con 0x55dacc19c190 auth_method 0 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -245> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -244> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -243> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -242> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): get_auth_request con 0x55dacc19c570 auth_method 0 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -241> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -240> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -239> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -238> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -237> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -236> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -235> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -234> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -233> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -232> 2024-03-04T12:46:14.326+0000 7f4999364640 10 monclient(hunting): get_auth_request con 0x55dacc18e2f0 auth_method 0 2024-03-04T12:46:14.622 INFO:tasks.workunit.client.0.smithi090.stderr: -231> 2024-03-04T12:46:14.326+0000 7f4999364640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr: -230> 2024-03-04T12:46:14.326+0000 7f4999364640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr: -229> 2024-03-04T12:46:14.326+0000 7f4999364640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr: -228> 2024-03-04T12:46:14.327+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr: -227> 2024-03-04T12:46:14.327+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr: -226> 2024-03-04T12:46:14.327+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr: -225> 2024-03-04T12:46:14.327+0000 7f4998362640 10 monclient(hunting): handle_auth_done global_id 6026 payload 274 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr: -224> 2024-03-04T12:46:14.327+0000 7f4998362640 10 monclient: _finish_hunting 0 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr: -223> 2024-03-04T12:46:14.327+0000 7f4998362640 1 monclient: found mon.noname-c 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr: -222> 2024-03-04T12:46:14.327+0000 7f4998362640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr: -221> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr: -220> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr: -219> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: dump: 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.623 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr: -218> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: _finish_auth 0 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr: -217> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: _check_auth_tickets 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr: -216> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr: -215> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.624 INFO:tasks.workunit.client.0.smithi090.stderr: -214> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr: -213> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: dump: 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr: -212> 2024-03-04T12:46:14.327+0000 7f499b067800 5 monclient: authenticate success, global_id 6026 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr: -211> 2024-03-04T12:46:14.327+0000 7f499b067800 10 monclient: get_monmap_and_config success 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr: -210> 2024-03-04T12:46:14.327+0000 7f499b067800 4 set_mon_vals no callback set 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr: -209> 2024-03-04T12:46:14.327+0000 7f499b067800 10 monclient: shutdown 2024-03-04T12:46:14.625 INFO:tasks.workunit.client.0.smithi090.stderr: -208> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient: build_initial_monmap 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr: -207> 2024-03-04T12:46:14.328+0000 7f499b067800 1 build_initial for_mkfs: 0 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr: -206> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient: monmap: 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr: -205> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding auth protocol: cephx 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr: -204> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding auth protocol: cephx 2024-03-04T12:46:14.626 INFO:tasks.workunit.client.0.smithi090.stderr: -203> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding auth protocol: cephx 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -202> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -201> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -200> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -199> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -198> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -197> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -196> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -195> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -194> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -193> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -192> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -191> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -190> 2024-03-04T12:46:14.328+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -189> 2024-03-04T12:46:14.328+0000 7f499b067800 1 librados: starting msgr at 2024-03-04T12:46:14.627 INFO:tasks.workunit.client.0.smithi090.stderr: -188> 2024-03-04T12:46:14.328+0000 7f499b067800 1 librados: starting objecter 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -187> 2024-03-04T12:46:14.328+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command objecter_requests cmddesc objecter_requests hook 0x55dacc1449c0 EEXIST 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -186> 2024-03-04T12:46:14.328+0000 7f499b067800 1 librados: setting wanted keys 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -185> 2024-03-04T12:46:14.328+0000 7f499b067800 1 librados: calling monclient init 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -184> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient: init 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -183> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding auth protocol: cephx 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -182> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding auth protocol: cephx 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -181> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding auth protocol: cephx 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -180> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: secure 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -179> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: crc 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -178> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: secure 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -177> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: crc 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -176> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: secure 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -175> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: crc 2024-03-04T12:46:14.628 INFO:tasks.workunit.client.0.smithi090.stderr: -174> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: crc 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -173> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: secure 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -172> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: crc 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -171> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: secure 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -170> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: crc 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -169> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: secure 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -168> 2024-03-04T12:46:14.328+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -167> 2024-03-04T12:46:14.328+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -166> 2024-03-04T12:46:14.328+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command rotate-key cmddesc rotate-key hook 0x55dacc166c38 EEXIST 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -165> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -164> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -163> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): picked mon.noname-a con 0x55dacc18e2f0 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -162> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): picked mon.noname-c con 0x55dacc19c190 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -161> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): picked mon.noname-b con 0x55dacc18cda0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -160> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -159> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.629 INFO:tasks.workunit.client.0.smithi090.stderr: -158> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -157> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -156> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): authenticate will time out at 1406.660203s 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -155> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): get_auth_request con 0x55dacc18e2f0 auth_method 0 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -154> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -153> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -152> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -151> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): get_auth_request con 0x55dacc19c190 auth_method 0 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -150> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -149> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -148> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -147> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): get_auth_request con 0x55dacc18cda0 auth_method 0 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -146> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.630 INFO:tasks.workunit.client.0.smithi090.stderr: -145> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -144> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -143> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -142> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -141> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -140> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -139> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -138> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -137> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -136> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -135> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -134> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): handle_auth_done global_id 6029 payload 824 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -133> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient: _finish_hunting 0 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -132> 2024-03-04T12:46:14.329+0000 7f4998362640 1 monclient: found mon.noname-c 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -131> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.631 INFO:tasks.workunit.client.0.smithi090.stderr: -130> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr: -129> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr: -128> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: dump: 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr: -127> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: _finish_auth 0 2024-03-04T12:46:14.632 INFO:tasks.workunit.client.0.smithi090.stderr: -126> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: _check_auth_tickets 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr: -125> 2024-03-04T12:46:14.329+0000 7f499b067800 5 monclient: authenticate success, global_id 6029 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr: -124> 2024-03-04T12:46:14.329+0000 7f499b067800 10 monclient: _renew_subs 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr: -123> 2024-03-04T12:46:14.329+0000 7f499b067800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr: -122> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr: -121> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr: -120> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr: -119> 2024-03-04T12:46:14.329+0000 7f486ffff640 4 set_mon_vals no callback set 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr: -118> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: dump: 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.633 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr: -117> 2024-03-04T12:46:14.329+0000 7f499b067800 10 monclient: _renew_subs 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr: -116> 2024-03-04T12:46:14.329+0000 7f499b067800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr: -115> 2024-03-04T12:46:14.329+0000 7f499b067800 1 librados: init done 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr: -114> 2024-03-04T12:46:14.329+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command cr dump hook 0x55dacc1aa2e8 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr: -113> 2024-03-04T12:46:14.330+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr: -112> 2024-03-04T12:46:14.331+0000 7f486e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr: -111> 2024-03-04T12:46:14.331+0000 7f486e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr: -110> 2024-03-04T12:46:14.331+0000 7f486e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr: -109> 2024-03-04T12:46:14.331+0000 7f4998b63640 10 monclient: get_auth_request con 0x7f4864069eb0 auth_method 0 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr: -108> 2024-03-04T12:46:14.331+0000 7f4999364640 10 monclient: get_auth_request con 0x55dacc1b7380 auth_method 0 2024-03-04T12:46:14.634 INFO:tasks.workunit.client.0.smithi090.stderr: -107> 2024-03-04T12:46:14.332+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -106> 2024-03-04T12:46:14.332+0000 7f499b067800 20 realm 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -105> 2024-03-04T12:46:14.332+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -104> 2024-03-04T12:46:14.332+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -103> 2024-03-04T12:46:14.332+0000 7f499b067800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -102> 2024-03-04T12:46:14.332+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -101> 2024-03-04T12:46:14.332+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -100> 2024-03-04T12:46:14.332+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -99> 2024-03-04T12:46:14.332+0000 7f4998b63640 10 monclient: get_auth_request con 0x55dacc1bb740 auth_method 0 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -98> 2024-03-04T12:46:14.333+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -97> 2024-03-04T12:46:14.333+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -96> 2024-03-04T12:46:14.333+0000 7f4998362640 10 monclient: get_auth_request con 0x55dacc1bee40 auth_method 0 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -95> 2024-03-04T12:46:14.333+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -94> 2024-03-04T12:46:14.333+0000 7f499b067800 20 searching for the correct realm 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -93> 2024-03-04T12:46:14.334+0000 7f4999364640 10 monclient: get_auth_request con 0x55dacc1c3b40 auth_method 0 2024-03-04T12:46:14.635 INFO:tasks.workunit.client.0.smithi090.stderr: -92> 2024-03-04T12:46:14.334+0000 7f4998b63640 10 monclient: get_auth_request con 0x7f4990033040 auth_method 0 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -91> 2024-03-04T12:46:14.335+0000 7f4998362640 10 monclient: get_auth_request con 0x7f498c018070 auth_method 0 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -90> 2024-03-04T12:46:14.336+0000 7f4998b63640 0 -- 172.21.15.90:0/3102904642 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f4990033040 msgr2=0x7f4990024aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -89> 2024-03-04T12:46:14.336+0000 7f486e7fc640 1 client.6029.objecter ms_handle_reset 0x7f4990033040 session 0x7f499001f040 osd.7 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -88> 2024-03-04T12:46:14.336+0000 7f486e7fc640 10 monclient: _renew_subs 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -87> 2024-03-04T12:46:14.336+0000 7f486e7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -86> 2024-03-04T12:46:14.336+0000 7f4998b63640 10 monclient: get_auth_request con 0x7f4864079d50 auth_method 0 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -85> 2024-03-04T12:46:14.337+0000 7f4999364640 10 monclient: get_auth_request con 0x7f498c0806a0 auth_method 0 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -84> 2024-03-04T12:46:14.339+0000 7f4998b63640 10 monclient: get_auth_request con 0x7f498c0397d0 auth_method 0 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -83> 2024-03-04T12:46:14.339+0000 7f4998b63640 0 -- 172.21.15.90:0/3102904642 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f498c0397d0 msgr2=0x7f498c042990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -82> 2024-03-04T12:46:14.540+0000 7f4998b63640 10 monclient: get_auth_request con 0x7f498c0397d0 auth_method 0 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -81> 2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -80> 2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:14.636 INFO:tasks.workunit.client.0.smithi090.stderr: -79> 2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -78> 2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -77> 2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -76> 2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -75> 2024-03-04T12:46:14.545+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -74> 2024-03-04T12:46:14.545+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -73> 2024-03-04T12:46:14.545+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -72> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -71> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -70> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -69> 2024-03-04T12:46:14.546+0000 7f499b067800 20 zone default found 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -68> 2024-03-04T12:46:14.546+0000 7f499b067800 4 Realm: () 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -67> 2024-03-04T12:46:14.546+0000 7f499b067800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -66> 2024-03-04T12:46:14.546+0000 7f499b067800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -65> 2024-03-04T12:46:14.546+0000 7f499b067800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:14.637 INFO:tasks.workunit.client.0.smithi090.stderr: -64> 2024-03-04T12:46:14.546+0000 7f499b067800 20 zonegroup default 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -63> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -62> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -61> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -60> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -59> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -58> 2024-03-04T12:46:14.547+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -57> 2024-03-04T12:46:14.547+0000 7f499b067800 20 started sync module instance, tier type = 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -56> 2024-03-04T12:46:14.547+0000 7f499b067800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -55> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=0 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -54> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=1 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -53> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=2 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -52> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=3 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -51> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=4 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -50> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=5 2024-03-04T12:46:14.638 INFO:tasks.workunit.client.0.smithi090.stderr: -49> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=6 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -48> 2024-03-04T12:46:14.556+0000 7f499b067800 20 add_watcher() i=7 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -47> 2024-03-04T12:46:14.556+0000 7f499b067800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -46> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding auth protocol: cephx 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -45> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding auth protocol: cephx 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -44> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding auth protocol: cephx 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -43> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: secure 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -42> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: crc 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -41> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: secure 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -40> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: crc 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -39> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: secure 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -38> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: crc 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -37> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: crc 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -36> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: secure 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -35> 2024-03-04T12:46:14.558+0000 7f484efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -34> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: crc 2024-03-04T12:46:14.639 INFO:tasks.workunit.client.0.smithi090.stderr: -33> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: secure 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -32> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: crc 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -31> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: secure 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -30> 2024-03-04T12:46:14.558+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -29> 2024-03-04T12:46:14.558+0000 7f499b067800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -28> 2024-03-04T12:46:14.558+0000 7f499b067800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -27> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command cache list hook 0x55dacc19a710 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -26> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command cache inspect hook 0x55dacc19a710 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -25> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command cache erase hook 0x55dacc19a710 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -24> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command cache zap hook 0x55dacc19a710 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -23> 2024-03-04T12:46:14.558+0000 7f499b067800 5 note: GC not initialized 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -22> 2024-03-04T12:46:14.558+0000 7f484dfe3640 20 reqs_thread_entry: start 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -21> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command sync trace show hook 0x7f498c082050 2024-03-04T12:46:14.640 INFO:tasks.workunit.client.0.smithi090.stderr: -20> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command sync trace history hook 0x7f498c082050 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -19> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command sync trace active hook 0x7f498c082050 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -18> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command sync trace active_short hook 0x7f498c082050 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -17> 2024-03-04T12:46:14.558+0000 7f499b067800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -16> 2024-03-04T12:46:14.558+0000 7f499b067800 20 Filter name: none 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -15> 2024-03-04T12:46:14.559+0000 7f47bf7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -14> 2024-03-04T12:46:14.559+0000 7f499b067800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -13> 2024-03-04T12:46:14.559+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -12> 2024-03-04T12:46:14.559+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -11> 2024-03-04T12:46:14.559+0000 7f499b067800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -10> 2024-03-04T12:46:14.559+0000 7f499b067800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -9> 2024-03-04T12:46:14.559+0000 7f499b067800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 : miss 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -8> 2024-03-04T12:46:14.559+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -7> 2024-03-04T12:46:14.559+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:14.641 INFO:tasks.workunit.client.0.smithi090.stderr: -6> 2024-03-04T12:46:14.559+0000 7f499b067800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 info.flags=0x17 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: -5> 2024-03-04T12:46:14.559+0000 7f499b067800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 to cache LRU end 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: -4> 2024-03-04T12:46:14.559+0000 7f499b067800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: -3> 2024-03-04T12:46:14.559+0000 7f499b067800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: -2> 2024-03-04T12:46:14.559+0000 7f499b067800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: -1> 2024-03-04T12:46:14.564+0000 7f499b067800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f499b067800 time 2024-03-04T12:46:14.564952+0000 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f499e380e86] 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f499e381044] 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dac975deb1] 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: 4: radosgw-admin(+0x7e4532) [0x55dac9768532] 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dac9771d1b] 2024-03-04T12:46:14.642 INFO:tasks.workunit.client.0.smithi090.stderr: 6: main() 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f499d23feb0] 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 8: __libc_start_main() 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 9: _start() 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 0> 2024-03-04T12:46:14.565+0000 7f499b067800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7f499b067800 thread_name:radosgw-admin 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f499d254db0] 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f499d2a154c] 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f499e380ee0] 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f499e381044] 2024-03-04T12:46:14.643 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dac975deb1] 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: 8: radosgw-admin(+0x7e4532) [0x55dac9768532] 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dac9771d1b] 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: 10: main() 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f499d23feb0] 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: 12: __libc_start_main() 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: 13: _start() 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr:--- logging levels --- 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 none 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 lockdep 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 context 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 crush 2024-03-04T12:46:14.644 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_balancer 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_locker 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log_expire 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_migrator 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 buffer 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 timer 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 filer 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 striper 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 objecter 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rados 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_mirror 2024-03-04T12:46:14.645 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_replay 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_pwl 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 journaler 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objectcacher 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 client 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 osd 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 optracker 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objclass 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 filestore 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 journal 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 ms 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mon 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 0/10 monc 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 paxos 2024-03-04T12:46:14.646 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 tp 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 auth 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 crypto 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 finisher 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 reserver 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 heartbeatmap 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 perfcounter 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 20/20 rgw 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_sync 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_datacache 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_access 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_flight 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 javaclient 2024-03-04T12:46:14.647 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 asok 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 throttle 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 refs 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 compressor 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluestore 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluefs 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 bdev 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 kstore 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 4/ 5 rocksdb 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 fuse 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 2/ 5 mgr 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mgrc 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 dpdk 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 eventtrace 2024-03-04T12:46:14.648 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 prioritycache 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 test 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephsqlite 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_onode 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_odata 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_omap 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_tm 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_t 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_epm 2024-03-04T12:46:14.649 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_lba 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cache 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_journal 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_device 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_backref 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 alienstore 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mclock 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cyanstore 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 ceph_exporter 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 memstore 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 trace 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: -2/-2 (syslog threshold) 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 99/99 (stderr threshold) 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:46:14.650 INFO:tasks.workunit.client.0.smithi090.stderr: 7f47bf7fe640 / http_manager 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: 7f484dfe3640 / http_manager 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: 7f484efe5640 / rgw_dt_lg_renew 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: 7f486e7fc640 / ms_dispatch 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: 7f486ffff640 / io_context_pool 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: 7f487e7fc640 / ms_dispatch 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: 7f488560a640 / ms_dispatch 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: 7f4886e0d640 / io_context_pool 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: 7f4998362640 / msgr-worker-2 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: 7f4998b63640 / msgr-worker-1 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: 7f4999364640 / msgr-worker-0 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: 7f4999b65640 / io_context_pool 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: 7f499b067800 / radosgw-admin 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: max_recent 500 2024-03-04T12:46:14.651 INFO:tasks.workunit.client.0.smithi090.stderr: max_new 1000 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr: log_file /var/log/ceph/ceph-client.admin.91214.log 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr:--- end dump of recent events --- 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr:--- begin dump of recent events --- 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr: -499> 2024-03-04T12:46:14.314+0000 7f4999364640 10 monclient: _finish_hunting 0 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr: -498> 2024-03-04T12:46:14.314+0000 7f4999364640 1 monclient: found mon.noname-a 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr: -497> 2024-03-04T12:46:14.314+0000 7f4999364640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr: -496> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr: -495> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr: -494> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: dump: 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.652 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr: -493> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: _finish_auth 0 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr: -492> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: _check_auth_tickets 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr: -491> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr: -490> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr: -489> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr: -488> 2024-03-04T12:46:14.315+0000 7f4886e0d640 10 monclient: dump: 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.653 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr: -487> 2024-03-04T12:46:14.315+0000 7f499b067800 5 monclient: authenticate success, global_id 6339 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr: -486> 2024-03-04T12:46:14.315+0000 7f499b067800 10 monclient: get_monmap_and_config success 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr: -485> 2024-03-04T12:46:14.315+0000 7f499b067800 4 set_mon_vals no callback set 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr: -484> 2024-03-04T12:46:14.315+0000 7f499b067800 10 monclient: shutdown 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr: -483> 2024-03-04T12:46:14.315+0000 7f499b067800 5 asok(0x55dacbead0c0) unregister_commands rotate-key 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr: -482> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient: build_initial_monmap 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr: -481> 2024-03-04T12:46:14.316+0000 7f499b067800 1 build_initial for_mkfs: 0 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr: -480> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient: monmap: 2024-03-04T12:46:14.654 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr: -479> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding auth protocol: cephx 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr: -478> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding auth protocol: cephx 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr: -477> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding auth protocol: cephx 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr: -476> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: secure 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr: -475> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: crc 2024-03-04T12:46:14.655 INFO:tasks.workunit.client.0.smithi090.stderr: -474> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: secure 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -473> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: crc 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -472> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: secure 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -471> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: crc 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -470> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: crc 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -469> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: secure 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -468> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: crc 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -467> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: secure 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -466> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: crc 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -465> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0cd5c0) adding con mode: secure 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -464> 2024-03-04T12:46:14.316+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -463> 2024-03-04T12:46:14.316+0000 7f499b067800 1 librados: starting msgr at 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -462> 2024-03-04T12:46:14.316+0000 7f499b067800 1 librados: starting objecter 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -461> 2024-03-04T12:46:14.316+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command objecter_requests hook 0x55dacc0cf670 2024-03-04T12:46:14.656 INFO:tasks.workunit.client.0.smithi090.stderr: -460> 2024-03-04T12:46:14.316+0000 7f499b067800 1 librados: setting wanted keys 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -459> 2024-03-04T12:46:14.316+0000 7f499b067800 1 librados: calling monclient init 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -458> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient: init 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -457> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding auth protocol: cephx 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -456> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding auth protocol: cephx 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -455> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding auth protocol: cephx 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -454> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: secure 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -453> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: crc 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -452> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: secure 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -451> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: crc 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -450> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: secure 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -449> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: crc 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -448> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: crc 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -447> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: secure 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -446> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: crc 2024-03-04T12:46:14.657 INFO:tasks.workunit.client.0.smithi090.stderr: -445> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: secure 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -444> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: crc 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -443> 2024-03-04T12:46:14.316+0000 7f499b067800 5 AuthRegistry(0x55dacc0ca760) adding con mode: secure 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -442> 2024-03-04T12:46:14.316+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -441> 2024-03-04T12:46:14.316+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -440> 2024-03-04T12:46:14.316+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command rotate-key hook 0x55dacc0ca8a8 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -439> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -438> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -437> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): picked mon.noname-b con 0x55dacbf42640 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -436> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): picked mon.noname-c con 0x55dacbf778b0 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -435> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): picked mon.noname-a con 0x55dacc1095d0 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -434> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -433> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -432> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -431> 2024-03-04T12:46:14.316+0000 7f499b067800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:14.658 INFO:tasks.workunit.client.0.smithi090.stderr: -430> 2024-03-04T12:46:14.317+0000 7f499b067800 10 monclient(hunting): authenticate will time out at 1406.648264s 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -429> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): get_auth_request con 0x55dacbf778b0 auth_method 0 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -428> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -427> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -426> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -425> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): get_auth_request con 0x55dacbf42640 auth_method 0 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -424> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -423> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -422> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -421> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): get_auth_request con 0x55dacc1095d0 auth_method 0 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -420> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -419> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -418> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -417> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.659 INFO:tasks.workunit.client.0.smithi090.stderr: -416> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -415> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -414> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -413> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -412> 2024-03-04T12:46:14.317+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -411> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -410> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -409> 2024-03-04T12:46:14.317+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -408> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient(hunting): handle_auth_done global_id 6020 payload 824 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -407> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient: _finish_hunting 0 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -406> 2024-03-04T12:46:14.317+0000 7f4998362640 1 monclient: found mon.noname-c 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -405> 2024-03-04T12:46:14.317+0000 7f4998362640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -404> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -403> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr: -402> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: dump: 2024-03-04T12:46:14.660 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr: -401> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: _finish_auth 0 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr: -400> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: _check_auth_tickets 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr: -399> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr: -398> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.661 INFO:tasks.workunit.client.0.smithi090.stderr: -397> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr: -396> 2024-03-04T12:46:14.317+0000 7f488560a640 10 monclient: dump: 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr: -395> 2024-03-04T12:46:14.317+0000 7f499b067800 5 monclient: authenticate success, global_id 6020 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr: -394> 2024-03-04T12:46:14.317+0000 7f4886e0d640 4 set_mon_vals no callback set 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr: -393> 2024-03-04T12:46:14.317+0000 7f499b067800 10 monclient: _renew_subs 2024-03-04T12:46:14.662 INFO:tasks.workunit.client.0.smithi090.stderr: -392> 2024-03-04T12:46:14.317+0000 7f499b067800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -391> 2024-03-04T12:46:14.317+0000 7f499b067800 10 monclient: _renew_subs 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -390> 2024-03-04T12:46:14.317+0000 7f499b067800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -389> 2024-03-04T12:46:14.317+0000 7f499b067800 1 librados: init done 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -388> 2024-03-04T12:46:14.319+0000 7f488560a640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -387> 2024-03-04T12:46:14.319+0000 7f488560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -386> 2024-03-04T12:46:14.319+0000 7f488560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -385> 2024-03-04T12:46:14.319+0000 7f4998b63640 10 monclient: get_auth_request con 0x7f4880069f00 auth_method 0 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -384> 2024-03-04T12:46:14.319+0000 7f4999364640 10 monclient: get_auth_request con 0x55dacc0f0710 auth_method 0 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -383> 2024-03-04T12:46:14.320+0000 7f4998b63640 10 monclient: get_auth_request con 0x55dacc1168c0 auth_method 0 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -382> 2024-03-04T12:46:14.321+0000 7f4998362640 10 monclient: get_auth_request con 0x55dacc11ac20 auth_method 0 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -381> 2024-03-04T12:46:14.322+0000 7f499b067800 10 monclient: build_initial_monmap 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -380> 2024-03-04T12:46:14.322+0000 7f499b067800 1 build_initial for_mkfs: 0 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr: -379> 2024-03-04T12:46:14.322+0000 7f499b067800 10 monclient: monmap: 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:14.663 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr: -378> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding auth protocol: cephx 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr: -377> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding auth protocol: cephx 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr: -376> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding auth protocol: cephx 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr: -375> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: secure 2024-03-04T12:46:14.664 INFO:tasks.workunit.client.0.smithi090.stderr: -374> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: crc 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -373> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: secure 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -372> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: crc 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -371> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: secure 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -370> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: crc 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -369> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: crc 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -368> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: secure 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -367> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: crc 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -366> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: secure 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -365> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: crc 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -364> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11f960) adding con mode: secure 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -363> 2024-03-04T12:46:14.322+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -362> 2024-03-04T12:46:14.322+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command objecter_requests cmddesc objecter_requests hook 0x55dacc125070 EEXIST 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -361> 2024-03-04T12:46:14.322+0000 7f499b067800 10 monclient: init 2024-03-04T12:46:14.665 INFO:tasks.workunit.client.0.smithi090.stderr: -360> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding auth protocol: cephx 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -359> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding auth protocol: cephx 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -358> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding auth protocol: cephx 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -357> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: secure 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -356> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: crc 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -355> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: secure 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -354> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: crc 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -353> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: secure 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -352> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: crc 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -351> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: crc 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -350> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: secure 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -349> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: crc 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -348> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: secure 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -347> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: crc 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -346> 2024-03-04T12:46:14.322+0000 7f499b067800 5 AuthRegistry(0x55dacc11e068) adding con mode: secure 2024-03-04T12:46:14.666 INFO:tasks.workunit.client.0.smithi090.stderr: -345> 2024-03-04T12:46:14.323+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -344> 2024-03-04T12:46:14.323+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -343> 2024-03-04T12:46:14.323+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command rotate-key cmddesc rotate-key hook 0x55dacc11e1b0 EEXIST 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -342> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -341> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -340> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): picked mon.noname-c con 0x55dacc149dd0 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -339> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): picked mon.noname-b con 0x55dacc14a1b0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -338> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): picked mon.noname-a con 0x55dacc145270 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -337> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -336> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -335> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -334> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -333> 2024-03-04T12:46:14.323+0000 7f499b067800 10 monclient(hunting): authenticate will time out at 1406.654643s 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -332> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): get_auth_request con 0x55dacc149dd0 auth_method 0 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -331> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -330> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.667 INFO:tasks.workunit.client.0.smithi090.stderr: -329> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.668 INFO:tasks.workunit.client.0.smithi090.stderr: -328> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): get_auth_request con 0x55dacc145270 auth_method 0 2024-03-04T12:46:14.668 INFO:tasks.workunit.client.0.smithi090.stderr: -327> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.668 INFO:tasks.workunit.client.0.smithi090.stderr: -326> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.668 INFO:tasks.workunit.client.0.smithi090.stderr: -325> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.668 INFO:tasks.workunit.client.0.smithi090.stderr: -324> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.668 INFO:tasks.workunit.client.0.smithi090.stderr: -323> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.668 INFO:tasks.workunit.client.0.smithi090.stderr: -322> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.668 INFO:tasks.workunit.client.0.smithi090.stderr: -321> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.668 INFO:tasks.workunit.client.0.smithi090.stderr: -320> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.668 INFO:tasks.workunit.client.0.smithi090.stderr: -319> 2024-03-04T12:46:14.323+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.668 INFO:tasks.workunit.client.0.smithi090.stderr: -318> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient(hunting): handle_auth_done global_id 6023 payload 824 2024-03-04T12:46:14.668 INFO:tasks.workunit.client.0.smithi090.stderr: -317> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient: _finish_hunting 0 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr: -316> 2024-03-04T12:46:14.323+0000 7f4998b63640 1 monclient: found mon.noname-c 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr: -315> 2024-03-04T12:46:14.323+0000 7f4998b63640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr: -314> 2024-03-04T12:46:14.323+0000 7f487e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr: -313> 2024-03-04T12:46:14.323+0000 7f487e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr: -312> 2024-03-04T12:46:14.323+0000 7f487e7fc640 10 monclient: dump: 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.669 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr: -311> 2024-03-04T12:46:14.323+0000 7f487e7fc640 10 monclient: _finish_auth 0 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr: -310> 2024-03-04T12:46:14.323+0000 7f487e7fc640 10 monclient: _check_auth_tickets 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr: -309> 2024-03-04T12:46:14.324+0000 7f487e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr: -308> 2024-03-04T12:46:14.324+0000 7f487e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr: -307> 2024-03-04T12:46:14.324+0000 7f487e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr: -306> 2024-03-04T12:46:14.324+0000 7f487e7fc640 10 monclient: dump: 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.670 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: -305> 2024-03-04T12:46:14.324+0000 7f499b067800 5 monclient: authenticate success, global_id 6023 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: -304> 2024-03-04T12:46:14.324+0000 7f4999b65640 4 set_mon_vals no callback set 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: -303> 2024-03-04T12:46:14.324+0000 7f499b067800 10 monclient: _renew_subs 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: -302> 2024-03-04T12:46:14.324+0000 7f499b067800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: -301> 2024-03-04T12:46:14.324+0000 7f499b067800 10 monclient: _renew_subs 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: -300> 2024-03-04T12:46:14.324+0000 7f499b067800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: -299> 2024-03-04T12:46:14.325+0000 7f487e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: -298> 2024-03-04T12:46:14.325+0000 7f487e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: -297> 2024-03-04T12:46:14.325+0000 7f487e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: -296> 2024-03-04T12:46:14.325+0000 7f499b067800 10 monclient: get_monmap_and_config 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: -295> 2024-03-04T12:46:14.325+0000 7f499b067800 10 monclient: build_initial_monmap 2024-03-04T12:46:14.671 INFO:tasks.workunit.client.0.smithi090.stderr: -294> 2024-03-04T12:46:14.325+0000 7f499b067800 1 build_initial for_mkfs: 0 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr: -293> 2024-03-04T12:46:14.325+0000 7f499b067800 10 monclient: monmap: 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr: -292> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding auth protocol: cephx 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr: -291> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding auth protocol: cephx 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr: -290> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding auth protocol: cephx 2024-03-04T12:46:14.672 INFO:tasks.workunit.client.0.smithi090.stderr: -289> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -288> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -287> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -286> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -285> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -284> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -283> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -282> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -281> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -280> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -279> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -278> 2024-03-04T12:46:14.325+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -277> 2024-03-04T12:46:14.325+0000 7f4998362640 10 monclient: get_auth_request con 0x7f4870069dc0 auth_method 0 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -276> 2024-03-04T12:46:14.326+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.673 INFO:tasks.workunit.client.0.smithi090.stderr: -275> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient: init 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -274> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding auth protocol: cephx 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -273> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding auth protocol: cephx 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -272> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding auth protocol: cephx 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -271> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: secure 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -270> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: crc 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -269> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: secure 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -268> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: crc 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -267> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: secure 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -266> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: crc 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -265> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: crc 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -264> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: secure 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -263> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: crc 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -262> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: secure 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -261> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: crc 2024-03-04T12:46:14.674 INFO:tasks.workunit.client.0.smithi090.stderr: -260> 2024-03-04T12:46:14.326+0000 7f499b067800 5 AuthRegistry(0x7ffef6564580) adding con mode: secure 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -259> 2024-03-04T12:46:14.326+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -258> 2024-03-04T12:46:14.326+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -257> 2024-03-04T12:46:14.326+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command rotate-key cmddesc rotate-key hook 0x7ffef65646c8 EEXIST 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -256> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -255> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -254> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): picked mon.noname-a con 0x55dacc19c190 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -253> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): picked mon.noname-c con 0x55dacc19c570 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -252> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): picked mon.noname-b con 0x55dacc18e2f0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -251> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -250> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -249> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -248> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -247> 2024-03-04T12:46:14.326+0000 7f499b067800 10 monclient(hunting): authenticate will time out at 1406.658024s 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -246> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): get_auth_request con 0x55dacc19c190 auth_method 0 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -245> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.675 INFO:tasks.workunit.client.0.smithi090.stderr: -244> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -243> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -242> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): get_auth_request con 0x55dacc19c570 auth_method 0 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -241> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -240> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -239> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -238> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -237> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -236> 2024-03-04T12:46:14.326+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -235> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -234> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -233> 2024-03-04T12:46:14.326+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -232> 2024-03-04T12:46:14.326+0000 7f4999364640 10 monclient(hunting): get_auth_request con 0x55dacc18e2f0 auth_method 0 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -231> 2024-03-04T12:46:14.326+0000 7f4999364640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -230> 2024-03-04T12:46:14.326+0000 7f4999364640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.676 INFO:tasks.workunit.client.0.smithi090.stderr: -229> 2024-03-04T12:46:14.326+0000 7f4999364640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr: -228> 2024-03-04T12:46:14.327+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr: -227> 2024-03-04T12:46:14.327+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr: -226> 2024-03-04T12:46:14.327+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr: -225> 2024-03-04T12:46:14.327+0000 7f4998362640 10 monclient(hunting): handle_auth_done global_id 6026 payload 274 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr: -224> 2024-03-04T12:46:14.327+0000 7f4998362640 10 monclient: _finish_hunting 0 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr: -223> 2024-03-04T12:46:14.327+0000 7f4998362640 1 monclient: found mon.noname-c 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr: -222> 2024-03-04T12:46:14.327+0000 7f4998362640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr: -221> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr: -220> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr: -219> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: dump: 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.677 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr: -218> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: _finish_auth 0 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr: -217> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: _check_auth_tickets 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr: -216> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr: -215> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr: -214> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr: -213> 2024-03-04T12:46:14.327+0000 7f486ffff640 10 monclient: dump: 2024-03-04T12:46:14.678 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr: -212> 2024-03-04T12:46:14.327+0000 7f499b067800 5 monclient: authenticate success, global_id 6026 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr: -211> 2024-03-04T12:46:14.327+0000 7f499b067800 10 monclient: get_monmap_and_config success 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr: -210> 2024-03-04T12:46:14.327+0000 7f499b067800 4 set_mon_vals no callback set 2024-03-04T12:46:14.679 INFO:tasks.workunit.client.0.smithi090.stderr: -209> 2024-03-04T12:46:14.327+0000 7f499b067800 10 monclient: shutdown 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr: -208> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient: build_initial_monmap 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr: -207> 2024-03-04T12:46:14.328+0000 7f499b067800 1 build_initial for_mkfs: 0 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr: -206> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient: monmap: 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:14.680 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -205> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding auth protocol: cephx 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -204> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding auth protocol: cephx 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -203> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding auth protocol: cephx 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -202> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -201> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -200> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -199> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -198> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -197> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -196> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -195> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -194> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -193> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -192> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: crc 2024-03-04T12:46:14.681 INFO:tasks.workunit.client.0.smithi090.stderr: -191> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc167920) adding con mode: secure 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -190> 2024-03-04T12:46:14.328+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -189> 2024-03-04T12:46:14.328+0000 7f499b067800 1 librados: starting msgr at 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -188> 2024-03-04T12:46:14.328+0000 7f499b067800 1 librados: starting objecter 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -187> 2024-03-04T12:46:14.328+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command objecter_requests cmddesc objecter_requests hook 0x55dacc1449c0 EEXIST 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -186> 2024-03-04T12:46:14.328+0000 7f499b067800 1 librados: setting wanted keys 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -185> 2024-03-04T12:46:14.328+0000 7f499b067800 1 librados: calling monclient init 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -184> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient: init 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -183> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding auth protocol: cephx 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -182> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding auth protocol: cephx 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -181> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding auth protocol: cephx 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -180> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: secure 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -179> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: crc 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -178> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: secure 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -177> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: crc 2024-03-04T12:46:14.682 INFO:tasks.workunit.client.0.smithi090.stderr: -176> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: secure 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -175> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: crc 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -174> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: crc 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -173> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: secure 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -172> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: crc 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -171> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: secure 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -170> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: crc 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -169> 2024-03-04T12:46:14.328+0000 7f499b067800 5 AuthRegistry(0x55dacc166af0) adding con mode: secure 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -168> 2024-03-04T12:46:14.328+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -167> 2024-03-04T12:46:14.328+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -166> 2024-03-04T12:46:14.328+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command rotate-key cmddesc rotate-key hook 0x55dacc166c38 EEXIST 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -165> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -164> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -163> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): picked mon.noname-a con 0x55dacc18e2f0 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:14.683 INFO:tasks.workunit.client.0.smithi090.stderr: -162> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): picked mon.noname-c con 0x55dacc19c190 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -161> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): picked mon.noname-b con 0x55dacc18cda0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -160> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -159> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -158> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -157> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -156> 2024-03-04T12:46:14.328+0000 7f499b067800 10 monclient(hunting): authenticate will time out at 1406.660203s 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -155> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): get_auth_request con 0x55dacc18e2f0 auth_method 0 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -154> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -153> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -152> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -151> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): get_auth_request con 0x55dacc19c190 auth_method 0 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -150> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.684 INFO:tasks.workunit.client.0.smithi090.stderr: -149> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -148> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -147> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): get_auth_request con 0x55dacc18cda0 auth_method 0 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -146> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -145> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -144> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -143> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -142> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -141> 2024-03-04T12:46:14.329+0000 7f4998b63640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -140> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -139> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -138> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -137> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -136> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:14.685 INFO:tasks.workunit.client.0.smithi090.stderr: -135> 2024-03-04T12:46:14.329+0000 7f4999364640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr: -134> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient(hunting): handle_auth_done global_id 6029 payload 824 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr: -133> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient: _finish_hunting 0 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr: -132> 2024-03-04T12:46:14.329+0000 7f4998362640 1 monclient: found mon.noname-c 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr: -131> 2024-03-04T12:46:14.329+0000 7f4998362640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr: -130> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr: -129> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr: -128> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: dump: 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.686 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr: -127> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: _finish_auth 0 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr: -126> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: _check_auth_tickets 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr: -125> 2024-03-04T12:46:14.329+0000 7f499b067800 5 monclient: authenticate success, global_id 6029 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr: -124> 2024-03-04T12:46:14.329+0000 7f499b067800 10 monclient: _renew_subs 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr: -123> 2024-03-04T12:46:14.329+0000 7f499b067800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr: -122> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr: -121> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr: -120> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr: -119> 2024-03-04T12:46:14.329+0000 7f486ffff640 4 set_mon_vals no callback set 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr: -118> 2024-03-04T12:46:14.329+0000 7f486e7fc640 10 monclient: dump: 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:14.687 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr: -117> 2024-03-04T12:46:14.329+0000 7f499b067800 10 monclient: _renew_subs 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr: -116> 2024-03-04T12:46:14.329+0000 7f499b067800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr: -115> 2024-03-04T12:46:14.329+0000 7f499b067800 1 librados: init done 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr: -114> 2024-03-04T12:46:14.329+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command cr dump hook 0x55dacc1aa2e8 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr: -113> 2024-03-04T12:46:14.330+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.688 INFO:tasks.workunit.client.0.smithi090.stderr: -112> 2024-03-04T12:46:14.331+0000 7f486e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -111> 2024-03-04T12:46:14.331+0000 7f486e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -110> 2024-03-04T12:46:14.331+0000 7f486e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -109> 2024-03-04T12:46:14.331+0000 7f4998b63640 10 monclient: get_auth_request con 0x7f4864069eb0 auth_method 0 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -108> 2024-03-04T12:46:14.331+0000 7f4999364640 10 monclient: get_auth_request con 0x55dacc1b7380 auth_method 0 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -107> 2024-03-04T12:46:14.332+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -106> 2024-03-04T12:46:14.332+0000 7f499b067800 20 realm 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -105> 2024-03-04T12:46:14.332+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -104> 2024-03-04T12:46:14.332+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -103> 2024-03-04T12:46:14.332+0000 7f499b067800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -102> 2024-03-04T12:46:14.332+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -101> 2024-03-04T12:46:14.332+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -100> 2024-03-04T12:46:14.332+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -99> 2024-03-04T12:46:14.332+0000 7f4998b63640 10 monclient: get_auth_request con 0x55dacc1bb740 auth_method 0 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -98> 2024-03-04T12:46:14.333+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:14.689 INFO:tasks.workunit.client.0.smithi090.stderr: -97> 2024-03-04T12:46:14.333+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -96> 2024-03-04T12:46:14.333+0000 7f4998362640 10 monclient: get_auth_request con 0x55dacc1bee40 auth_method 0 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -95> 2024-03-04T12:46:14.333+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -94> 2024-03-04T12:46:14.333+0000 7f499b067800 20 searching for the correct realm 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -93> 2024-03-04T12:46:14.334+0000 7f4999364640 10 monclient: get_auth_request con 0x55dacc1c3b40 auth_method 0 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -92> 2024-03-04T12:46:14.334+0000 7f4998b63640 10 monclient: get_auth_request con 0x7f4990033040 auth_method 0 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -91> 2024-03-04T12:46:14.335+0000 7f4998362640 10 monclient: get_auth_request con 0x7f498c018070 auth_method 0 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -90> 2024-03-04T12:46:14.336+0000 7f4998b63640 0 -- 172.21.15.90:0/3102904642 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f4990033040 msgr2=0x7f4990024aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -89> 2024-03-04T12:46:14.336+0000 7f486e7fc640 1 client.6029.objecter ms_handle_reset 0x7f4990033040 session 0x7f499001f040 osd.7 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -88> 2024-03-04T12:46:14.336+0000 7f486e7fc640 10 monclient: _renew_subs 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -87> 2024-03-04T12:46:14.336+0000 7f486e7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -86> 2024-03-04T12:46:14.336+0000 7f4998b63640 10 monclient: get_auth_request con 0x7f4864079d50 auth_method 0 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -85> 2024-03-04T12:46:14.337+0000 7f4999364640 10 monclient: get_auth_request con 0x7f498c0806a0 auth_method 0 2024-03-04T12:46:14.690 INFO:tasks.workunit.client.0.smithi090.stderr: -84> 2024-03-04T12:46:14.339+0000 7f4998b63640 10 monclient: get_auth_request con 0x7f498c0397d0 auth_method 0 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -83> 2024-03-04T12:46:14.339+0000 7f4998b63640 0 -- 172.21.15.90:0/3102904642 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f498c0397d0 msgr2=0x7f498c042990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -82> 2024-03-04T12:46:14.540+0000 7f4998b63640 10 monclient: get_auth_request con 0x7f498c0397d0 auth_method 0 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -81> 2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -80> 2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -79> 2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -78> 2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -77> 2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -76> 2024-03-04T12:46:14.545+0000 7f499b067800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -75> 2024-03-04T12:46:14.545+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -74> 2024-03-04T12:46:14.545+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -73> 2024-03-04T12:46:14.545+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -72> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -71> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.691 INFO:tasks.workunit.client.0.smithi090.stderr: -70> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -69> 2024-03-04T12:46:14.546+0000 7f499b067800 20 zone default found 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -68> 2024-03-04T12:46:14.546+0000 7f499b067800 4 Realm: () 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -67> 2024-03-04T12:46:14.546+0000 7f499b067800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -66> 2024-03-04T12:46:14.546+0000 7f499b067800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -65> 2024-03-04T12:46:14.546+0000 7f499b067800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -64> 2024-03-04T12:46:14.546+0000 7f499b067800 20 zonegroup default 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -63> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -62> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -61> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -60> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -59> 2024-03-04T12:46:14.546+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -58> 2024-03-04T12:46:14.547+0000 7f499b067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -57> 2024-03-04T12:46:14.547+0000 7f499b067800 20 started sync module instance, tier type = 2024-03-04T12:46:14.692 INFO:tasks.workunit.client.0.smithi090.stderr: -56> 2024-03-04T12:46:14.547+0000 7f499b067800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -55> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=0 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -54> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=1 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -53> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=2 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -52> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=3 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -51> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=4 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -50> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=5 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -49> 2024-03-04T12:46:14.555+0000 7f499b067800 20 add_watcher() i=6 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -48> 2024-03-04T12:46:14.556+0000 7f499b067800 20 add_watcher() i=7 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -47> 2024-03-04T12:46:14.556+0000 7f499b067800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -46> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding auth protocol: cephx 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -45> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding auth protocol: cephx 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -44> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding auth protocol: cephx 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -43> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: secure 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -42> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: crc 2024-03-04T12:46:14.693 INFO:tasks.workunit.client.0.smithi090.stderr: -41> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: secure 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -40> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: crc 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -39> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: secure 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -38> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: crc 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -37> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: crc 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -36> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: secure 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -35> 2024-03-04T12:46:14.558+0000 7f484efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -34> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: crc 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -33> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: secure 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -32> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: crc 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -31> 2024-03-04T12:46:14.558+0000 7f499b067800 5 AuthRegistry(0x7ffef6564a10) adding con mode: secure 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -30> 2024-03-04T12:46:14.558+0000 7f499b067800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -29> 2024-03-04T12:46:14.558+0000 7f499b067800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -28> 2024-03-04T12:46:14.558+0000 7f499b067800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -27> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command cache list hook 0x55dacc19a710 2024-03-04T12:46:14.694 INFO:tasks.workunit.client.0.smithi090.stderr: -26> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command cache inspect hook 0x55dacc19a710 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -25> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command cache erase hook 0x55dacc19a710 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -24> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command cache zap hook 0x55dacc19a710 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -23> 2024-03-04T12:46:14.558+0000 7f499b067800 5 note: GC not initialized 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -22> 2024-03-04T12:46:14.558+0000 7f484dfe3640 20 reqs_thread_entry: start 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -21> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command sync trace show hook 0x7f498c082050 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -20> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command sync trace history hook 0x7f498c082050 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -19> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command sync trace active hook 0x7f498c082050 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -18> 2024-03-04T12:46:14.558+0000 7f499b067800 5 asok(0x55dacbead0c0) register_command sync trace active_short hook 0x7f498c082050 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -17> 2024-03-04T12:46:14.558+0000 7f499b067800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -16> 2024-03-04T12:46:14.558+0000 7f499b067800 20 Filter name: none 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -15> 2024-03-04T12:46:14.559+0000 7f47bf7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -14> 2024-03-04T12:46:14.559+0000 7f499b067800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -13> 2024-03-04T12:46:14.559+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -12> 2024-03-04T12:46:14.559+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:14.695 INFO:tasks.workunit.client.0.smithi090.stderr: -11> 2024-03-04T12:46:14.559+0000 7f499b067800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-04T12:46:14.696 INFO:tasks.workunit.client.0.smithi090.stderr: -10> 2024-03-04T12:46:14.559+0000 7f499b067800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-04T12:46:14.696 INFO:tasks.workunit.client.0.smithi090.stderr: -9> 2024-03-04T12:46:14.559+0000 7f499b067800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 : miss 2024-03-04T12:46:14.696 INFO:tasks.workunit.client.0.smithi090.stderr: -8> 2024-03-04T12:46:14.559+0000 7f499b067800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.696 INFO:tasks.workunit.client.0.smithi090.stderr: -7> 2024-03-04T12:46:14.559+0000 7f499b067800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:14.696 INFO:tasks.workunit.client.0.smithi090.stderr: -6> 2024-03-04T12:46:14.559+0000 7f499b067800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 info.flags=0x17 2024-03-04T12:46:14.696 INFO:tasks.workunit.client.0.smithi090.stderr: -5> 2024-03-04T12:46:14.559+0000 7f499b067800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 to cache LRU end 2024-03-04T12:46:14.696 INFO:tasks.workunit.client.0.smithi090.stderr: -4> 2024-03-04T12:46:14.559+0000 7f499b067800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:14.696 INFO:tasks.workunit.client.0.smithi090.stderr: -3> 2024-03-04T12:46:14.559+0000 7f499b067800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:14.696 INFO:tasks.workunit.client.0.smithi090.stderr: -2> 2024-03-04T12:46:14.559+0000 7f499b067800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 2024-03-04T12:46:14.696 INFO:tasks.workunit.client.0.smithi090.stderr: -1> 2024-03-04T12:46:14.564+0000 7f499b067800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f499b067800 time 2024-03-04T12:46:14.564952+0000 2024-03-04T12:46:14.696 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:46:14.696 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f499e380e86] 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f499e381044] 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dac975deb1] 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 4: radosgw-admin(+0x7e4532) [0x55dac9768532] 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dac9771d1b] 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 6: main() 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f499d23feb0] 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 8: __libc_start_main() 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 9: _start() 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 0> 2024-03-04T12:46:14.565+0000 7f499b067800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7f499b067800 thread_name:radosgw-admin 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:14.697 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f499d254db0] 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f499d2a154c] 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f499e380ee0] 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f499e381044] 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dac975deb1] 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 8: radosgw-admin(+0x7e4532) [0x55dac9768532] 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dac9771d1b] 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 10: main() 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f499d23feb0] 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 12: __libc_start_main() 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 13: _start() 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr:--- logging levels --- 2024-03-04T12:46:14.698 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 none 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 lockdep 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 context 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 crush 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_balancer 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_locker 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log_expire 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_migrator 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 buffer 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 timer 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 filer 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 striper 2024-03-04T12:46:14.699 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 objecter 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rados 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_mirror 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_replay 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_pwl 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 journaler 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objectcacher 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 client 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 osd 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 optracker 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objclass 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 filestore 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 journal 2024-03-04T12:46:14.700 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 ms 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mon 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 0/10 monc 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 paxos 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 tp 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 auth 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 crypto 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 finisher 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 reserver 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 heartbeatmap 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 perfcounter 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 20/20 rgw 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_sync 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_datacache 2024-03-04T12:46:14.701 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_access 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_flight 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 javaclient 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 asok 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 throttle 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 refs 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 compressor 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluestore 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluefs 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 bdev 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 kstore 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 4/ 5 rocksdb 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 fuse 2024-03-04T12:46:14.702 INFO:tasks.workunit.client.0.smithi090.stderr: 2/ 5 mgr 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mgrc 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 dpdk 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 eventtrace 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 prioritycache 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 test 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephsqlite 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_onode 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_odata 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_omap 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_tm 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_t 2024-03-04T12:46:14.703 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_epm 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_lba 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cache 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_journal 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_device 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_backref 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 alienstore 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mclock 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cyanstore 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 ceph_exporter 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 memstore 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 trace 2024-03-04T12:46:14.704 INFO:tasks.workunit.client.0.smithi090.stderr: -2/-2 (syslog threshold) 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 99/99 (stderr threshold) 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f47bf7fe640 / http_manager 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f484dfe3640 / http_manager 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f484efe5640 / rgw_dt_lg_renew 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f486e7fc640 / ms_dispatch 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f486ffff640 / io_context_pool 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f487e7fc640 / ms_dispatch 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f488560a640 / ms_dispatch 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f4886e0d640 / io_context_pool 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f4998362640 / msgr-worker-2 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f4998b63640 / msgr-worker-1 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f4999364640 / msgr-worker-0 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f4999b65640 / io_context_pool 2024-03-04T12:46:14.705 INFO:tasks.workunit.client.0.smithi090.stderr: 7f499b067800 / radosgw-admin 2024-03-04T12:46:14.706 INFO:tasks.workunit.client.0.smithi090.stderr: max_recent 500 2024-03-04T12:46:14.706 INFO:tasks.workunit.client.0.smithi090.stderr: max_new 1000 2024-03-04T12:46:14.706 INFO:tasks.workunit.client.0.smithi090.stderr: log_file /var/lib/ceph/crash/2024-03-04T12:46:14.566557Z_e37f3b81-4499-489c-9efb-6a02e4c7c7fc/log 2024-03-04T12:46:14.706 INFO:tasks.workunit.client.0.smithi090.stderr:--- end dump of recent events --- 2024-03-04T12:46:14.706 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-04T12:46:14.707 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:14.707 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:14.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.638+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.639+0000 7f524b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.639+0000 7f524b12a800 20 realm 2024-03-04T12:46:14.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.639+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.639+0000 7f524b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.639+0000 7f524b12a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:14.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.639+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.639+0000 7f524b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:14.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.639+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.640+0000 7f524b12a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:14.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.640+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:14.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.641+0000 7f524b12a800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:14.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.641+0000 7f524b12a800 20 searching for the correct realm 2024-03-04T12:46:14.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.845+0000 7f52466be640 0 -- 172.21.15.90:0/854030663 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x55bbb24dee70 msgr2=0x7f523c0b5980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:14.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:14.848+0000 7f5246ebf640 0 -- 172.21.15.90:0/854030663 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f523c077360 msgr2=0x7f523c0d8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:15.060 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.054+0000 7f524b12a800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:15.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.054+0000 7f524b12a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:15.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.054+0000 7f524b12a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:15.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.054+0000 7f524b12a800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:15.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.054+0000 7f524b12a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:15.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.054+0000 7f524b12a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:15.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.054+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:15.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:15.061 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.062 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:15.062 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 20 zone default found 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 4 Realm: () 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 20 zonegroup default 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.055+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.056+0000 7f524b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.056+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.056+0000 7f524b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.056+0000 7f524b12a800 20 started sync module instance, tier type = 2024-03-04T12:46:15.063 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.056+0000 7f524b12a800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:15.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.066+0000 7f524b12a800 20 add_watcher() i=0 2024-03-04T12:46:15.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.066+0000 7f524b12a800 20 add_watcher() i=1 2024-03-04T12:46:15.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.066+0000 7f524b12a800 20 add_watcher() i=2 2024-03-04T12:46:15.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.066+0000 7f524b12a800 20 add_watcher() i=3 2024-03-04T12:46:15.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.066+0000 7f524b12a800 20 add_watcher() i=4 2024-03-04T12:46:15.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.066+0000 7f524b12a800 20 add_watcher() i=5 2024-03-04T12:46:15.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.066+0000 7f524b12a800 20 add_watcher() i=6 2024-03-04T12:46:15.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.067+0000 7f524b12a800 20 add_watcher() i=7 2024-03-04T12:46:15.072 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.067+0000 7f524b12a800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:15.074 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.069+0000 7f50fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:15.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.069+0000 7f524b12a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:15.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.069+0000 7f524b12a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:15.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.069+0000 7f524b12a800 5 note: GC not initialized 2024-03-04T12:46:15.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.069+0000 7f5077fff640 20 reqs_thread_entry: start 2024-03-04T12:46:15.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.069+0000 7f524b12a800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:15.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.069+0000 7f524b12a800 20 Filter name: none 2024-03-04T12:46:15.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.070+0000 7f5075ffb640 20 reqs_thread_entry: start 2024-03-04T12:46:15.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.070+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.070+0000 7f524b12a800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:15.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.070+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.071+0000 7f524b12a800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:15.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.071+0000 7f524b12a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:15.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.071+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.071+0000 7f524b12a800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:15.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.071+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.071+0000 7f524b12a800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:15.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.071+0000 7f524b12a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:15.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.072+0000 7f524b12a800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.078 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.072+0000 7f524b12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:15.079 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.073+0000 7f50fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:15.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.075+0000 7f524b12a800 20 remove_watcher() i=0 2024-03-04T12:46:15.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.075+0000 7f524b12a800 2 removed watcher, disabling cache 2024-03-04T12:46:15.082 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.076+0000 7f524b12a800 20 remove_watcher() i=1 2024-03-04T12:46:15.083 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.077+0000 7f524b12a800 20 remove_watcher() i=2 2024-03-04T12:46:15.084 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.078+0000 7f524b12a800 20 remove_watcher() i=3 2024-03-04T12:46:15.085 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.079+0000 7f524b12a800 20 remove_watcher() i=4 2024-03-04T12:46:15.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.080+0000 7f524b12a800 20 remove_watcher() i=5 2024-03-04T12:46:15.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.081+0000 7f524b12a800 20 remove_watcher() i=6 2024-03-04T12:46:15.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.082+0000 7f524b12a800 20 remove_watcher() i=7 2024-03-04T12:46:15.098 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:15.098 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:15.098 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: abort-at-set-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:46:15.098 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:15.099 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:15.100 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:15.107 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:15.107 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:15.149 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:46:15.179 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:15.179 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:15.213 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.207+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.209+0000 7f9e10844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:15.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.209+0000 7f9e10844800 20 realm 2024-03-04T12:46:15.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.209+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.209+0000 7f9e10844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:15.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.209+0000 7f9e10844800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:15.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.209+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.209+0000 7f9e10844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:15.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.209+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.210+0000 7f9e10844800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:15.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.210+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.211+0000 7f9e10844800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:15.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.211+0000 7f9e10844800 20 searching for the correct realm 2024-03-04T12:46:15.220 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.214+0000 7f9e0eb41640 0 -- 172.21.15.90:0/2893015243 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x5639ee6c5da0 msgr2=0x5639ee6c8190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:15.223 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.217+0000 7f9e05b3f640 0 -- 172.21.15.90:0/2893015243 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f9df8024040 msgr2=0x7f9df8062790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:15.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.221+0000 7f9e10844800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:15.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.221+0000 7f9e10844800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:15.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.221+0000 7f9e10844800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:15.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.221+0000 7f9e10844800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:15.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.221+0000 7f9e10844800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:15.227 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.221+0000 7f9e10844800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:15.228 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.221+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.228 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.221+0000 7f9e10844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:15.228 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.221+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.222+0000 7f9e10844800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:15.229 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.222+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.222+0000 7f9e10844800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:15.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.222+0000 7f9e10844800 20 zone default found 2024-03-04T12:46:15.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.222+0000 7f9e10844800 4 Realm: () 2024-03-04T12:46:15.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.222+0000 7f9e10844800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:15.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.222+0000 7f9e10844800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:15.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.222+0000 7f9e10844800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:15.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.222+0000 7f9e10844800 20 zonegroup default 2024-03-04T12:46:15.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.222+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.222+0000 7f9e10844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:15.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.222+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.223+0000 7f9e10844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:15.230 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.223+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.223+0000 7f9e10844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:15.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.223+0000 7f9e10844800 20 started sync module instance, tier type = 2024-03-04T12:46:15.231 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.223+0000 7f9e10844800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:15.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.232+0000 7f9e10844800 20 add_watcher() i=0 2024-03-04T12:46:15.237 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.232+0000 7f9e10844800 20 add_watcher() i=1 2024-03-04T12:46:15.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.232+0000 7f9e10844800 20 add_watcher() i=2 2024-03-04T12:46:15.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.232+0000 7f9e10844800 20 add_watcher() i=3 2024-03-04T12:46:15.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.232+0000 7f9e10844800 20 add_watcher() i=4 2024-03-04T12:46:15.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.232+0000 7f9e10844800 20 add_watcher() i=5 2024-03-04T12:46:15.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.232+0000 7f9e10844800 20 add_watcher() i=6 2024-03-04T12:46:15.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.232+0000 7f9e10844800 20 add_watcher() i=7 2024-03-04T12:46:15.238 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.232+0000 7f9e10844800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:15.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.234+0000 7f9cc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:15.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.234+0000 7f9e10844800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:15.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.234+0000 7f9e10844800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:15.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.234+0000 7f9e10844800 5 note: GC not initialized 2024-03-04T12:46:15.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.235+0000 7f9c3f7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:15.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.235+0000 7f9e10844800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:15.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.235+0000 7f9e10844800 20 Filter name: none 2024-03-04T12:46:15.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.235+0000 7f9c3d7fa640 20 reqs_thread_entry: start 2024-03-04T12:46:15.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.235+0000 7f9e10844800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-04T12:46:15.241 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.235+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.236+0000 7f9e10844800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:15.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.236+0000 7f9e10844800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-04T12:46:15.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.236+0000 7f9e10844800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-04T12:46:15.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.236+0000 7f9e10844800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 : miss 2024-03-04T12:46:15.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.236+0000 7f9e10844800 20 rados->read ofs=0 len=0 2024-03-04T12:46:15.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.236+0000 7f9e10844800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:15.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.236+0000 7f9e10844800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 info.flags=0x17 2024-03-04T12:46:15.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.236+0000 7f9e10844800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 to cache LRU end 2024-03-04T12:46:15.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.236+0000 7f9e10844800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:15.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.236+0000 7f9e10844800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:15.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.236+0000 7f9e10844800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 2024-03-04T12:46:15.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.237+0000 7f9e10844800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 to be held by another RGW process; skipping for now 2024-03-04T12:46:15.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.238+0000 7f9cc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:15.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.240+0000 7f9e10844800 20 remove_watcher() i=0 2024-03-04T12:46:15.246 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.240+0000 7f9e10844800 2 removed watcher, disabling cache 2024-03-04T12:46:15.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.241+0000 7f9e10844800 20 remove_watcher() i=1 2024-03-04T12:46:15.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.242+0000 7f9e10844800 20 remove_watcher() i=2 2024-03-04T12:46:15.249 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.243+0000 7f9e10844800 20 remove_watcher() i=3 2024-03-04T12:46:15.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.244+0000 7f9e10844800 20 remove_watcher() i=4 2024-03-04T12:46:15.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.245+0000 7f9e10844800 20 remove_watcher() i=5 2024-03-04T12:46:15.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.246+0000 7f9e10844800 20 remove_watcher() i=6 2024-03-04T12:46:15.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:15.247+0000 7f9e10844800 20 remove_watcher() i=7 2024-03-04T12:46:15.262 INFO:tasks.workunit.client.0.smithi090.stderr:waiting 30 seconds for reshard lock to expire... 2024-03-04T12:46:45.284 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:46:45.318 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:45.318 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:45.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.350+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.357 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.351+0000 7f3d2dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.357 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.351+0000 7f3d2dd33800 20 realm 2024-03-04T12:46:45.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.351+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.351+0000 7f3d2dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.351+0000 7f3d2dd33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:45.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.351+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.351+0000 7f3d2dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.351+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.358 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.353+0000 7f3d2dd33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:45.359 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.353+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.359 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.353+0000 7f3d2dd33800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:45.359 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.353+0000 7f3d2dd33800 20 searching for the correct realm 2024-03-04T12:46:45.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.357+0000 7f3d2a265640 0 -- 172.21.15.90:0/2269826903 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x559b4b550690 msgr2=0x559b4b552b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:45.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.361+0000 7f3d29a64640 0 -- 172.21.15.90:0/2269826903 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f3d20046870 msgr2=0x7f3d200093c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:45.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.568+0000 7f3d2dd33800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:45.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.568+0000 7f3d2dd33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:45.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.568+0000 7f3d2dd33800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:45.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.568+0000 7f3d2dd33800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:45.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.568+0000 7f3d2dd33800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:45.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.568+0000 7f3d2dd33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:45.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.568+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.568+0000 7f3d2dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.568+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.569+0000 7f3d2dd33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:45.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.569+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.569+0000 7f3d2dd33800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:45.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.569+0000 7f3d2dd33800 20 zone default found 2024-03-04T12:46:45.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.569+0000 7f3d2dd33800 4 Realm: () 2024-03-04T12:46:45.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.569+0000 7f3d2dd33800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:45.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.569+0000 7f3d2dd33800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:45.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.569+0000 7f3d2dd33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:45.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.569+0000 7f3d2dd33800 20 zonegroup default 2024-03-04T12:46:45.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.569+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.569+0000 7f3d2dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.569+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.570+0000 7f3d2dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.570+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.570+0000 7f3d2dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.570+0000 7f3d2dd33800 20 started sync module instance, tier type = 2024-03-04T12:46:45.578 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.570+0000 7f3d2dd33800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:45.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.579+0000 7f3d2dd33800 20 add_watcher() i=0 2024-03-04T12:46:45.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.579+0000 7f3d2dd33800 20 add_watcher() i=1 2024-03-04T12:46:45.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.579+0000 7f3d2dd33800 20 add_watcher() i=2 2024-03-04T12:46:45.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.579+0000 7f3d2dd33800 20 add_watcher() i=3 2024-03-04T12:46:45.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.579+0000 7f3d2dd33800 20 add_watcher() i=4 2024-03-04T12:46:45.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.579+0000 7f3d2dd33800 20 add_watcher() i=5 2024-03-04T12:46:45.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.579+0000 7f3d2dd33800 20 add_watcher() i=6 2024-03-04T12:46:45.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.580+0000 7f3d2dd33800 20 add_watcher() i=7 2024-03-04T12:46:45.586 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.580+0000 7f3d2dd33800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:45.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.582+0000 7f3bdb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:45.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.583+0000 7f3d2dd33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:45.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.583+0000 7f3d2dd33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:45.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.583+0000 7f3d2dd33800 5 note: GC not initialized 2024-03-04T12:46:45.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.583+0000 7f3bda7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:45.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.583+0000 7f3d2dd33800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:45.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.583+0000 7f3d2dd33800 20 Filter name: none 2024-03-04T12:46:45.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.583+0000 7f3b4bfff640 20 reqs_thread_entry: start 2024-03-04T12:46:45.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.583+0000 7f3d2dd33800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-04T12:46:45.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.583+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.584+0000 7f3d2dd33800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:45.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.584+0000 7f3d2dd33800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-04T12:46:45.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.584+0000 7f3d2dd33800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-04T12:46:45.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.584+0000 7f3d2dd33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 : miss 2024-03-04T12:46:45.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.584+0000 7f3d2dd33800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.584+0000 7f3d2dd33800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:45.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.584+0000 7f3d2dd33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 info.flags=0x17 2024-03-04T12:46:45.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.584+0000 7f3d2dd33800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 to cache LRU end 2024-03-04T12:46:45.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.584+0000 7f3d2dd33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:45.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.584+0000 7f3d2dd33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:45.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.584+0000 7f3d2dd33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 2024-03-04T12:46:45.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.589+0000 7f3d2dd33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 info.flags=0x17 2024-03-04T12:46:45.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.589+0000 7f3d2dd33800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 to cache LRU end 2024-03-04T12:46:45.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.589+0000 7f3d2dd33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:45.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.589+0000 7f3d2dd33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21, ofs0, ns] 2024-03-04T12:46:45.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.589+0000 7f3c0cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824067 cookie 94125472181472 notifier 6408 bl.length()=887 2024-03-04T12:46:45.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.589+0000 7f3c0cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 info.flags=0x17 2024-03-04T12:46:45.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.589+0000 7f3c0cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 to cache LRU end 2024-03-04T12:46:45.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.589+0000 7f3c0cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:45.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.590+0000 7f3d2dd33800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21]): orig_sources= new_sources= 2024-03-04T12:46:45.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.590+0000 7f3d2dd33800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21]): potential sources added=[] removed=[] 2024-03-04T12:46:45.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.590+0000 7f3d2dd33800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21]): orig_dests= new_dests= 2024-03-04T12:46:45.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.590+0000 7f3d2dd33800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21]): potential dests added=[] removed=[] 2024-03-04T12:46:45.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.0 2024-03-04T12:46:45.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.0 2024-03-04T12:46:45.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.1 2024-03-04T12:46:45.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.1 2024-03-04T12:46:45.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.2 2024-03-04T12:46:45.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.2 2024-03-04T12:46:45.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.3 2024-03-04T12:46:45.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.3 2024-03-04T12:46:45.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.4 2024-03-04T12:46:45.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.4 2024-03-04T12:46:45.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.5 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.5 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.6 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.6 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.7 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.7 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.8 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.8 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.9 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.9 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.10 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.10 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.11 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1.11 2024-03-04T12:46:45.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.592+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.0 2024-03-04T12:46:45.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.593+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.1 2024-03-04T12:46:45.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.593+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.2 2024-03-04T12:46:45.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.594+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.3 2024-03-04T12:46:45.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.594+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.4 2024-03-04T12:46:45.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.595+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.5 2024-03-04T12:46:45.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.596+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.6 2024-03-04T12:46:45.602 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.596+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.7 2024-03-04T12:46:45.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.597+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.8 2024-03-04T12:46:45.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.598+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.9 2024-03-04T12:46:45.604 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.599+0000 7f3d2dd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21.10 2024-03-04T12:46:45.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.602+0000 7f3d2dd33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 : hit (requested=0x17, cached=0x17) 2024-03-04T12:46:45.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.602+0000 7f3d2dd33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 2024-03-04T12:46:45.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.603+0000 7f3d2dd33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 info.flags=0x17 2024-03-04T12:46:45.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.603+0000 7f3d2dd33800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 to cache LRU end 2024-03-04T12:46:45.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.603+0000 7f3d2dd33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:45.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.603+0000 7f3d2dd33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21, ofs0, ns] 2024-03-04T12:46:45.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.604+0000 7f3c0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824068 cookie 94125472181472 notifier 6408 bl.length()=855 2024-03-04T12:46:45.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.604+0000 7f3c0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 info.flags=0x17 2024-03-04T12:46:45.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.604+0000 7f3c0d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 to cache LRU end 2024-03-04T12:46:45.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.604+0000 7f3c0d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:45.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.604+0000 7f3d2dd33800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21]): orig_sources= new_sources= 2024-03-04T12:46:45.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.604+0000 7f3d2dd33800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21]): potential sources added=[] removed=[] 2024-03-04T12:46:45.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.604+0000 7f3d2dd33800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21]): orig_dests= new_dests= 2024-03-04T12:46:45.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.604+0000 7f3d2dd33800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21]): potential dests added=[] removed=[] 2024-03-04T12:46:45.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.606+0000 7f3d2dd33800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2024-03-04T12:46:45.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.608+0000 7f3bdb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:45.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.610+0000 7f3d2dd33800 20 remove_watcher() i=0 2024-03-04T12:46:45.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.610+0000 7f3d2dd33800 2 removed watcher, disabling cache 2024-03-04T12:46:45.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.612+0000 7f3d2dd33800 20 remove_watcher() i=1 2024-03-04T12:46:45.618 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.613+0000 7f3d2dd33800 20 remove_watcher() i=2 2024-03-04T12:46:45.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.614+0000 7f3d2dd33800 20 remove_watcher() i=3 2024-03-04T12:46:45.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.615+0000 7f3d2dd33800 20 remove_watcher() i=4 2024-03-04T12:46:45.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.616+0000 7f3d2dd33800 20 remove_watcher() i=5 2024-03-04T12:46:45.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.617+0000 7f3d2dd33800 20 remove_watcher() i=6 2024-03-04T12:46:45.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.618+0000 7f3d2dd33800 20 remove_watcher() i=7 2024-03-04T12:46:45.635 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-04T12:46:45.662 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:45.663 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:45.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.689+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.691+0000 7f7562133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.691+0000 7f7562133800 20 realm 2024-03-04T12:46:45.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.691+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.691+0000 7f7562133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.691+0000 7f7562133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:45.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.691+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.691+0000 7f7562133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.691+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.692+0000 7f7562133800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:45.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.692+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.693+0000 7f7562133800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:45.699 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.693+0000 7f7562133800 20 searching for the correct realm 2024-03-04T12:46:45.701 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.696+0000 7f755e665640 0 -- 172.21.15.90:0/1440063793 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x559dc0419ec0 msgr2=0x559dc041c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:45.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.699+0000 7f755de64640 0 -- 172.21.15.90:0/1440063793 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f7548014400 msgr2=0x7f7548014880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:45.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.905+0000 7f7562133800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:45.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.905+0000 7f7562133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:45.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.905+0000 7f7562133800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:45.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.905+0000 7f7562133800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:45.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.905+0000 7f7562133800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:45.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.905+0000 7f7562133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:45.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.905+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.905+0000 7f7562133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.905+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.905+0000 7f7562133800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:45.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.905+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:45.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 20 zone default found 2024-03-04T12:46:45.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 4 Realm: () 2024-03-04T12:46:45.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:45.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:45.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:45.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 20 zonegroup default 2024-03-04T12:46:45.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.906+0000 7f7562133800 20 started sync module instance, tier type = 2024-03-04T12:46:45.915 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.907+0000 7f7562133800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:45.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.915+0000 7f7562133800 20 add_watcher() i=0 2024-03-04T12:46:45.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.915+0000 7f7562133800 20 add_watcher() i=1 2024-03-04T12:46:45.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.915+0000 7f7562133800 20 add_watcher() i=2 2024-03-04T12:46:45.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.915+0000 7f7562133800 20 add_watcher() i=3 2024-03-04T12:46:45.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.915+0000 7f7562133800 20 add_watcher() i=4 2024-03-04T12:46:45.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.915+0000 7f7562133800 20 add_watcher() i=5 2024-03-04T12:46:45.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.915+0000 7f7562133800 20 add_watcher() i=6 2024-03-04T12:46:45.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.916+0000 7f7562133800 20 add_watcher() i=7 2024-03-04T12:46:45.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.916+0000 7f7562133800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:45.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.918+0000 7f740f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:45.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.919+0000 7f7562133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:45.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.919+0000 7f7562133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:45.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.919+0000 7f7562133800 5 note: GC not initialized 2024-03-04T12:46:45.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.919+0000 7f740e7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:45.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.919+0000 7f7562133800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:45.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.919+0000 7f7562133800 20 Filter name: none 2024-03-04T12:46:45.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.919+0000 7f737ffff640 20 reqs_thread_entry: start 2024-03-04T12:46:45.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.919+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.920+0000 7f7562133800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:45.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.920+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.920+0000 7f7562133800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:45.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.920+0000 7f7562133800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:45.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.920+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.921+0000 7f7562133800 20 rados_obj.operate() r=0 bl.length=194 2024-03-04T12:46:45.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.921+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.921+0000 7f7562133800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:46:45.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.921+0000 7f7562133800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:45.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.922+0000 7f7562133800 20 rados->read ofs=0 len=0 2024-03-04T12:46:45.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.922+0000 7f7562133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:45.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.923+0000 7f740f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:45.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.925+0000 7f7562133800 20 remove_watcher() i=0 2024-03-04T12:46:45.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.925+0000 7f7562133800 2 removed watcher, disabling cache 2024-03-04T12:46:45.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.926+0000 7f7562133800 20 remove_watcher() i=1 2024-03-04T12:46:45.933 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.927+0000 7f7562133800 20 remove_watcher() i=2 2024-03-04T12:46:45.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.928+0000 7f7562133800 20 remove_watcher() i=3 2024-03-04T12:46:45.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.929+0000 7f7562133800 20 remove_watcher() i=4 2024-03-04T12:46:45.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.930+0000 7f7562133800 20 remove_watcher() i=5 2024-03-04T12:46:45.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.931+0000 7f7562133800 20 remove_watcher() i=6 2024-03-04T12:46:45.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:45.932+0000 7f7562133800 20 remove_watcher() i=7 2024-03-04T12:46:45.947 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:45.947 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:45.947 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: abort-at-set-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:46:45.947 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:45.949 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:45.949 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:45.952 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:45.952 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:45.996 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:45.996 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.021 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-03-04T12:46:46.022 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:46.023 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.023 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.033 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.034 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.076 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.076 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.083 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.083 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.090 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.090 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.097 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.097 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.104 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.104 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.111 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.111 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.118 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.118 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.125 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.125 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.131 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.131 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.139 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.139 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.147 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.147 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.153 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.153 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.160 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.160 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.167 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.167 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.174 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.174 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.181 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.181 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.188 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.188 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.196 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.196 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.202 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.203 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.209 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:46.209 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:46.217 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-04T12:46:46.243 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:46.243 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:46.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.270+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.272+0000 7f74c5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:46.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.272+0000 7f74c5f1f800 20 realm 2024-03-04T12:46:46.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.272+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.272+0000 7f74c5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:46.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.272+0000 7f74c5f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:46.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.272+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.272+0000 7f74c5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:46.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.272+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.273+0000 7f74c5f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:46.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.273+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.273+0000 7f74c5f1f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:46.279 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.273+0000 7f74c5f1f800 20 searching for the correct realm 2024-03-04T12:46:46.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.275+0000 7f74b9479640 0 -- 172.21.15.90:0/352699080 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f74ac02d040 msgr2=0x7f74ac02d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:46.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.482+0000 7f74c1c7a640 0 -- 172.21.15.90:0/352699080 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f74ac05f040 msgr2=0x7f74ac05f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:46.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.687+0000 7f74c5f1f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:46.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.687+0000 7f74c5f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.687+0000 7f74c5f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.687+0000 7f74c5f1f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.687+0000 7f74c5f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.687+0000 7f74c5f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.687+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 20 zone default found 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 4 Realm: () 2024-03-04T12:46:46.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:46.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:46.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:46.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 20 zonegroup default 2024-03-04T12:46:46.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:46.696 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.688+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.689+0000 7f74c5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:46.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.689+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.689+0000 7f74c5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:46.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.689+0000 7f74c5f1f800 20 started sync module instance, tier type = 2024-03-04T12:46:46.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.689+0000 7f74c5f1f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:46.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.698+0000 7f74c5f1f800 20 add_watcher() i=0 2024-03-04T12:46:46.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.698+0000 7f74c5f1f800 20 add_watcher() i=1 2024-03-04T12:46:46.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.698+0000 7f74c5f1f800 20 add_watcher() i=2 2024-03-04T12:46:46.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.698+0000 7f74c5f1f800 20 add_watcher() i=3 2024-03-04T12:46:46.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.698+0000 7f74c5f1f800 20 add_watcher() i=4 2024-03-04T12:46:46.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.698+0000 7f74c5f1f800 20 add_watcher() i=5 2024-03-04T12:46:46.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.698+0000 7f74c5f1f800 20 add_watcher() i=6 2024-03-04T12:46:46.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.699+0000 7f74c5f1f800 20 add_watcher() i=7 2024-03-04T12:46:46.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.699+0000 7f74c5f1f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:46.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.700+0000 7f73737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:46.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.701+0000 7f74c5f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:46.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.701+0000 7f74c5f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:46.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.701+0000 7f74c5f1f800 5 note: GC not initialized 2024-03-04T12:46:46.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.701+0000 7f73727fc640 20 reqs_thread_entry: start 2024-03-04T12:46:46.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.701+0000 7f74c5f1f800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:46.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.701+0000 7f74c5f1f800 20 Filter name: none 2024-03-04T12:46:46.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.701+0000 7f72e3fff640 20 reqs_thread_entry: start 2024-03-04T12:46:46.708 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.701+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.702+0000 7f74c5f1f800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:46.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.702+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.702+0000 7f74c5f1f800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:46.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.702+0000 7f74c5f1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:46.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.703+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.703+0000 7f74c5f1f800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:46.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.703+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.703+0000 7f74c5f1f800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:46.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.703+0000 7f74c5f1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:46.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.704+0000 7f74c5f1f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.710 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.704+0000 7f74c5f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:46.711 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.705+0000 7f73737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:46.713 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.707+0000 7f74c5f1f800 20 remove_watcher() i=0 2024-03-04T12:46:46.713 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.707+0000 7f74c5f1f800 2 removed watcher, disabling cache 2024-03-04T12:46:46.714 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.708+0000 7f74c5f1f800 20 remove_watcher() i=1 2024-03-04T12:46:46.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.709+0000 7f74c5f1f800 20 remove_watcher() i=2 2024-03-04T12:46:46.716 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.710+0000 7f74c5f1f800 20 remove_watcher() i=3 2024-03-04T12:46:46.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.711+0000 7f74c5f1f800 20 remove_watcher() i=4 2024-03-04T12:46:46.718 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.712+0000 7f74c5f1f800 20 remove_watcher() i=5 2024-03-04T12:46:46.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.713+0000 7f74c5f1f800 20 remove_watcher() i=6 2024-03-04T12:46:46.720 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.714+0000 7f74c5f1f800 20 remove_watcher() i=7 2024-03-04T12:46:46.729 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:46.729 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:46.729 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-block-writes id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:46:46.729 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:46.730 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-03-04T12:46:46.763 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:46.763 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:46.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.790+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.792+0000 7f69a168c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:46.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.792+0000 7f69a168c800 20 realm 2024-03-04T12:46:46.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.792+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.792+0000 7f69a168c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:46.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.792+0000 7f69a168c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:46.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.792+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.792+0000 7f69a168c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:46.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.792+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.793+0000 7f69a168c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:46.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.793+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:46.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.793+0000 7f69a168c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:46.800 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.793+0000 7f69a168c800 20 searching for the correct realm 2024-03-04T12:46:46.800 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.795+0000 7f699f188640 0 -- 172.21.15.90:0/3539923581 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x55faea9e0f70 msgr2=0x7f69980a0040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:47.005 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:46.999+0000 7f699e987640 0 -- 172.21.15.90:0/3539923581 >> [v2:172.21.15.90:6817/137526376,v1:172.21.15.90:6819/137526376] conn(0x55faeac493e0 msgr2=0x55faeac4b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:47.011 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.005+0000 7f69a168c800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:47.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.005+0000 7f69a168c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:47.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.005+0000 7f69a168c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:47.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.005+0000 7f69a168c800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:47.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.005+0000 7f69a168c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:47.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.005+0000 7f69a168c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:47.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.005+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.005+0000 7f69a168c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.005+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.006+0000 7f69a168c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:47.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.006+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.006+0000 7f69a168c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:47.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.006+0000 7f69a168c800 20 zone default found 2024-03-04T12:46:47.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.006+0000 7f69a168c800 4 Realm: () 2024-03-04T12:46:47.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.006+0000 7f69a168c800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:47.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.006+0000 7f69a168c800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:47.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.006+0000 7f69a168c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:47.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.006+0000 7f69a168c800 20 zonegroup default 2024-03-04T12:46:47.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.006+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.006+0000 7f69a168c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.006+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.007+0000 7f69a168c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.007+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.007+0000 7f69a168c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.007+0000 7f69a168c800 20 started sync module instance, tier type = 2024-03-04T12:46:47.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.007+0000 7f69a168c800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:47.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.016+0000 7f69a168c800 20 add_watcher() i=0 2024-03-04T12:46:47.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.016+0000 7f69a168c800 20 add_watcher() i=1 2024-03-04T12:46:47.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.016+0000 7f69a168c800 20 add_watcher() i=2 2024-03-04T12:46:47.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.016+0000 7f69a168c800 20 add_watcher() i=3 2024-03-04T12:46:47.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.016+0000 7f69a168c800 20 add_watcher() i=4 2024-03-04T12:46:47.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.016+0000 7f69a168c800 20 add_watcher() i=5 2024-03-04T12:46:47.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.016+0000 7f69a168c800 20 add_watcher() i=6 2024-03-04T12:46:47.023 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.017+0000 7f69a168c800 20 add_watcher() i=7 2024-03-04T12:46:47.023 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.017+0000 7f69a168c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:47.025 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.019+0000 7f6855fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:47.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.019+0000 7f69a168c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:47.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.019+0000 7f69a168c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:47.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.019+0000 7f69a168c800 5 note: GC not initialized 2024-03-04T12:46:47.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.019+0000 7f6854fe1640 20 reqs_thread_entry: start 2024-03-04T12:46:47.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.019+0000 7f69a168c800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:47.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.019+0000 7f69a168c800 20 Filter name: none 2024-03-04T12:46:47.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.019+0000 7f67ce7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:47.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.019+0000 7f69a168c800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-03-04T12:46:47.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.019+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.020+0000 7f69a168c800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:47.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.020+0000 7f69a168c800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-03-04T12:46:47.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.020+0000 7f69a168c800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-03-04T12:46:47.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.020+0000 7f69a168c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 : miss 2024-03-04T12:46:47.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.020+0000 7f69a168c800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.020+0000 7f69a168c800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:47.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.020+0000 7f69a168c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 info.flags=0x17 2024-03-04T12:46:47.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.020+0000 7f69a168c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 to cache LRU end 2024-03-04T12:46:47.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.020+0000 7f69a168c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:47.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.020+0000 7f69a168c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:47.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.020+0000 7f69a168c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 2024-03-04T12:46:47.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.025+0000 7f69a168c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 info.flags=0x17 2024-03-04T12:46:47.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.025+0000 7f69a168c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 to cache LRU end 2024-03-04T12:46:47.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.025+0000 7f69a168c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:47.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.025+0000 7f69a168c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22, ofs0, ns] 2024-03-04T12:46:47.031 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.025+0000 7f68827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824016 cookie 94536168987168 notifier 6465 bl.length()=877 2024-03-04T12:46:47.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.025+0000 7f68827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 info.flags=0x17 2024-03-04T12:46:47.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.025+0000 7f68827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 to cache LRU end 2024-03-04T12:46:47.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.025+0000 7f68827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:47.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.026+0000 7f69a168c800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): orig_sources= new_sources= 2024-03-04T12:46:47.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.026+0000 7f69a168c800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): potential sources added=[] removed=[] 2024-03-04T12:46:47.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.026+0000 7f69a168c800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): orig_dests= new_dests= 2024-03-04T12:46:47.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.026+0000 7f69a168c800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): potential dests added=[] removed=[] 2024-03-04T12:46:47.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.026+0000 7f69a168c800 -1 Injecting error=-5 at location=block_writes 2024-03-04T12:46:47.033 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.026+0000 7f69a168c800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-03-04T12:46:47.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.028+0000 7f69a168c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 : hit (requested=0x17, cached=0x17) 2024-03-04T12:46:47.034 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.028+0000 7f69a168c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 2024-03-04T12:46:47.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.029+0000 7f69a168c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 info.flags=0x17 2024-03-04T12:46:47.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.029+0000 7f69a168c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 to cache LRU end 2024-03-04T12:46:47.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.029+0000 7f69a168c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:47.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.029+0000 7f69a168c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22, ofs0, ns] 2024-03-04T12:46:47.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.029+0000 7f6882ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824017 cookie 94536168987168 notifier 6465 bl.length()=845 2024-03-04T12:46:47.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.029+0000 7f6882ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 info.flags=0x17 2024-03-04T12:46:47.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.029+0000 7f6882ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 to cache LRU end 2024-03-04T12:46:47.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.029+0000 7f6882ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:47.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.030+0000 7f69a168c800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): orig_sources= new_sources= 2024-03-04T12:46:47.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.030+0000 7f69a168c800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): potential sources added=[] removed=[] 2024-03-04T12:46:47.036 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.030+0000 7f69a168c800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): orig_dests= new_dests= 2024-03-04T12:46:47.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.030+0000 7f69a168c800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): potential dests added=[] removed=[] 2024-03-04T12:46:47.037 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.032+0000 7f6855fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:47.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.034+0000 7f69a168c800 20 remove_watcher() i=0 2024-03-04T12:46:47.039 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.034+0000 7f69a168c800 2 removed watcher, disabling cache 2024-03-04T12:46:47.040 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.035+0000 7f69a168c800 20 remove_watcher() i=1 2024-03-04T12:46:47.041 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.035+0000 7f69a168c800 20 remove_watcher() i=2 2024-03-04T12:46:47.042 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.036+0000 7f69a168c800 20 remove_watcher() i=3 2024-03-04T12:46:47.043 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.037+0000 7f69a168c800 20 remove_watcher() i=4 2024-03-04T12:46:47.044 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.038+0000 7f69a168c800 20 remove_watcher() i=5 2024-03-04T12:46:47.045 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.039+0000 7f69a168c800 20 remove_watcher() i=6 2024-03-04T12:46:47.046 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.040+0000 7f69a168c800 20 remove_watcher() i=7 2024-03-04T12:46:47.056 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-04T12:46:47.085 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:47.085 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:47.322 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.316+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.318+0000 7f417a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.318+0000 7f417a126800 20 realm 2024-03-04T12:46:47.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.318+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.318+0000 7f417a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.318+0000 7f417a126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:47.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.318+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.318+0000 7f417a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.318+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.319+0000 7f417a126800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:47.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.319+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.320+0000 7f417a126800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:47.326 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.320+0000 7f417a126800 20 searching for the correct realm 2024-03-04T12:46:47.327 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.322+0000 7f416d6ba640 0 -- 172.21.15.90:0/3040745536 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f416003d040 msgr2=0x7f4160048460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:47.533 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.528+0000 7f4175ebb640 0 -- 172.21.15.90:0/3040745536 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f4160031400 msgr2=0x7f4160031880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:47.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.734+0000 7f417a126800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:47.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.734+0000 7f417a126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:47.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.734+0000 7f417a126800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:47.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.734+0000 7f417a126800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:47.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.734+0000 7f417a126800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:47.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.734+0000 7f417a126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:47.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.734+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.735+0000 7f417a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.741 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.735+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.742 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.735+0000 7f417a126800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:47.742 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.735+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.742 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.735+0000 7f417a126800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:47.742 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.735+0000 7f417a126800 20 zone default found 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.735+0000 7f417a126800 4 Realm: () 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.735+0000 7f417a126800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.735+0000 7f417a126800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.735+0000 7f417a126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.735+0000 7f417a126800 20 zonegroup default 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.735+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.736+0000 7f417a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.736+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.736+0000 7f417a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.736+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.736+0000 7f417a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.736+0000 7f417a126800 20 started sync module instance, tier type = 2024-03-04T12:46:47.743 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.736+0000 7f417a126800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:47.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.747+0000 7f417a126800 20 add_watcher() i=0 2024-03-04T12:46:47.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.747+0000 7f417a126800 20 add_watcher() i=1 2024-03-04T12:46:47.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.747+0000 7f417a126800 20 add_watcher() i=2 2024-03-04T12:46:47.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.747+0000 7f417a126800 20 add_watcher() i=3 2024-03-04T12:46:47.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.747+0000 7f417a126800 20 add_watcher() i=4 2024-03-04T12:46:47.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.747+0000 7f417a126800 20 add_watcher() i=5 2024-03-04T12:46:47.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.747+0000 7f417a126800 20 add_watcher() i=6 2024-03-04T12:46:47.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.747+0000 7f417a126800 20 add_watcher() i=7 2024-03-04T12:46:47.753 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.747+0000 7f417a126800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:47.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.749+0000 7f40277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:47.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.749+0000 7f417a126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:47.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.749+0000 7f417a126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:47.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.750+0000 7f417a126800 5 note: GC not initialized 2024-03-04T12:46:47.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.750+0000 7f40267fc640 20 reqs_thread_entry: start 2024-03-04T12:46:47.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.750+0000 7f417a126800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:47.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.750+0000 7f417a126800 20 Filter name: none 2024-03-04T12:46:47.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.750+0000 7f3f97fff640 20 reqs_thread_entry: start 2024-03-04T12:46:47.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.750+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.757 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.750+0000 7f417a126800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:47.757 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.750+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.757 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.751+0000 7f417a126800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:47.757 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.751+0000 7f417a126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:47.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.751+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.752+0000 7f417a126800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:47.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.752+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.753+0000 7f417a126800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:47.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.753+0000 7f417a126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:47.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.754+0000 7f417a126800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.754+0000 7f417a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.755+0000 7f40277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:47.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.757+0000 7f417a126800 20 remove_watcher() i=0 2024-03-04T12:46:47.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.757+0000 7f417a126800 2 removed watcher, disabling cache 2024-03-04T12:46:47.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.758+0000 7f417a126800 20 remove_watcher() i=1 2024-03-04T12:46:47.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.759+0000 7f417a126800 20 remove_watcher() i=2 2024-03-04T12:46:47.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.760+0000 7f417a126800 20 remove_watcher() i=3 2024-03-04T12:46:47.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.761+0000 7f417a126800 20 remove_watcher() i=4 2024-03-04T12:46:47.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.762+0000 7f417a126800 20 remove_watcher() i=5 2024-03-04T12:46:47.769 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.763+0000 7f417a126800 20 remove_watcher() i=6 2024-03-04T12:46:47.770 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.764+0000 7f417a126800 20 remove_watcher() i=7 2024-03-04T12:46:47.779 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:47.780 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:47.780 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-block-writes id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:46:47.780 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:47.781 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:47.781 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:47.789 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:47.789 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:47.832 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:46:47.865 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:47.865 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:47.899 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.893+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.900 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.894+0000 7f67cea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.900 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.894+0000 7f67cea44800 20 realm 2024-03-04T12:46:47.900 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.894+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.900 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.894+0000 7f67cea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.900 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.894+0000 7f67cea44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:47.900 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.894+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.900 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.894+0000 7f67cea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.894+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.895+0000 7f67cea44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:47.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.895+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.896+0000 7f67cea44800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:47.901 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.896+0000 7f67cea44800 20 searching for the correct realm 2024-03-04T12:46:47.904 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.899+0000 7f67ccd41640 0 -- 172.21.15.90:0/1417917428 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x56151d6810c0 msgr2=0x56151d683540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:47.908 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.902+0000 7f67c3d3f640 0 -- 172.21.15.90:0/1417917428 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f67b4019040 msgr2=0x7f67b405cd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:47.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.905+0000 7f67cea44800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:47.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.905+0000 7f67cea44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:47.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.905+0000 7f67cea44800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:47.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.905+0000 7f67cea44800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:47.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.905+0000 7f67cea44800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:47.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.905+0000 7f67cea44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:47.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.905+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:47.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:47.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 20 zone default found 2024-03-04T12:46:47.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 4 Realm: () 2024-03-04T12:46:47.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:47.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:47.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:47.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 20 zonegroup default 2024-03-04T12:46:47.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.906+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.907+0000 7f67cea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.907+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.907+0000 7f67cea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:47.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.907+0000 7f67cea44800 20 started sync module instance, tier type = 2024-03-04T12:46:47.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.907+0000 7f67cea44800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:47.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.915+0000 7f67cea44800 20 add_watcher() i=0 2024-03-04T12:46:47.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.915+0000 7f67cea44800 20 add_watcher() i=1 2024-03-04T12:46:47.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.915+0000 7f67cea44800 20 add_watcher() i=2 2024-03-04T12:46:47.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.915+0000 7f67cea44800 20 add_watcher() i=3 2024-03-04T12:46:47.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.915+0000 7f67cea44800 20 add_watcher() i=4 2024-03-04T12:46:47.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.915+0000 7f67cea44800 20 add_watcher() i=5 2024-03-04T12:46:47.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.915+0000 7f67cea44800 20 add_watcher() i=6 2024-03-04T12:46:47.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.916+0000 7f67cea44800 20 add_watcher() i=7 2024-03-04T12:46:47.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.916+0000 7f67cea44800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:47.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.918+0000 7f6682fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:47.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.918+0000 7f67cea44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:47.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.918+0000 7f67cea44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:47.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.918+0000 7f67cea44800 5 note: GC not initialized 2024-03-04T12:46:47.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.918+0000 7f6681fdb640 20 reqs_thread_entry: start 2024-03-04T12:46:47.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.918+0000 7f67cea44800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:47.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.918+0000 7f67cea44800 20 Filter name: none 2024-03-04T12:46:47.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.918+0000 7f65f37fe640 20 reqs_thread_entry: start 2024-03-04T12:46:47.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.918+0000 7f67cea44800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-03-04T12:46:47.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.918+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.919+0000 7f67cea44800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:47.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.919+0000 7f67cea44800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-03-04T12:46:47.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.919+0000 7f67cea44800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-03-04T12:46:47.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.919+0000 7f67cea44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 : miss 2024-03-04T12:46:47.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.919+0000 7f67cea44800 20 rados->read ofs=0 len=0 2024-03-04T12:46:47.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.919+0000 7f67cea44800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:47.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.919+0000 7f67cea44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 info.flags=0x17 2024-03-04T12:46:47.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.919+0000 7f67cea44800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 to cache LRU end 2024-03-04T12:46:47.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.919+0000 7f67cea44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:47.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.919+0000 7f67cea44800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:47.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.919+0000 7f67cea44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 2024-03-04T12:46:47.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.924+0000 7f67cea44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 info.flags=0x17 2024-03-04T12:46:47.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.924+0000 7f67cea44800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 to cache LRU end 2024-03-04T12:46:47.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.924+0000 7f67cea44800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:47.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.924+0000 7f67cea44800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22, ofs0, ns] 2024-03-04T12:46:47.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.924+0000 7f66a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824018 cookie 94648687743664 notifier 6158 bl.length()=877 2024-03-04T12:46:47.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.924+0000 7f66a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 info.flags=0x17 2024-03-04T12:46:47.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.924+0000 7f66a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 to cache LRU end 2024-03-04T12:46:47.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.924+0000 7f66a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:47.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.925+0000 7f67cea44800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): orig_sources= new_sources= 2024-03-04T12:46:47.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.925+0000 7f67cea44800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): potential sources added=[] removed=[] 2024-03-04T12:46:47.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.925+0000 7f67cea44800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): orig_dests= new_dests= 2024-03-04T12:46:47.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.925+0000 7f67cea44800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): potential dests added=[] removed=[] 2024-03-04T12:46:47.933 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.0 2024-03-04T12:46:47.933 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.0 2024-03-04T12:46:47.933 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.1 2024-03-04T12:46:47.933 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.1 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.2 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.2 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.3 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.3 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.4 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.4 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.5 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.5 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.6 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.6 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.7 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.7 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.8 2024-03-04T12:46:47.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.8 2024-03-04T12:46:47.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.9 2024-03-04T12:46:47.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.9 2024-03-04T12:46:47.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.10 2024-03-04T12:46:47.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.10 2024-03-04T12:46:47.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.11 2024-03-04T12:46:47.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1.11 2024-03-04T12:46:47.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.927+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.0 2024-03-04T12:46:47.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.928+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.1 2024-03-04T12:46:47.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.928+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.2 2024-03-04T12:46:47.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.929+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.3 2024-03-04T12:46:47.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.929+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.4 2024-03-04T12:46:47.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.930+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.5 2024-03-04T12:46:47.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.930+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.6 2024-03-04T12:46:47.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.931+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.7 2024-03-04T12:46:47.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.931+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.8 2024-03-04T12:46:47.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.932+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.9 2024-03-04T12:46:47.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.932+0000 7f67cea44800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22.10 2024-03-04T12:46:47.941 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.935+0000 7f67cea44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 : hit (requested=0x17, cached=0x17) 2024-03-04T12:46:47.941 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.935+0000 7f67cea44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 2024-03-04T12:46:47.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.936+0000 7f67cea44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 info.flags=0x17 2024-03-04T12:46:47.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.936+0000 7f67cea44800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 to cache LRU end 2024-03-04T12:46:47.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.936+0000 7f67cea44800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:47.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.936+0000 7f67cea44800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22, ofs0, ns] 2024-03-04T12:46:47.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.937+0000 7f66a37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824019 cookie 94648687743664 notifier 6158 bl.length()=845 2024-03-04T12:46:47.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.937+0000 7f66a37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 info.flags=0x17 2024-03-04T12:46:47.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.937+0000 7f66a37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 to cache LRU end 2024-03-04T12:46:47.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.937+0000 7f66a37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:47.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.937+0000 7f67cea44800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): orig_sources= new_sources= 2024-03-04T12:46:47.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.937+0000 7f67cea44800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): potential sources added=[] removed=[] 2024-03-04T12:46:47.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.937+0000 7f67cea44800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): orig_dests= new_dests= 2024-03-04T12:46:47.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.937+0000 7f67cea44800 20 handle_bi_update(): bucket=:error-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22]): potential dests added=[] removed=[] 2024-03-04T12:46:47.945 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.939+0000 7f67cea44800 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2024-03-04T12:46:47.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.941+0000 7f6682fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:47.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.944+0000 7f67cea44800 20 remove_watcher() i=0 2024-03-04T12:46:47.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.944+0000 7f67cea44800 2 removed watcher, disabling cache 2024-03-04T12:46:47.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.945+0000 7f67cea44800 20 remove_watcher() i=1 2024-03-04T12:46:47.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.945+0000 7f67cea44800 20 remove_watcher() i=2 2024-03-04T12:46:47.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.947+0000 7f67cea44800 20 remove_watcher() i=3 2024-03-04T12:46:47.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.948+0000 7f67cea44800 20 remove_watcher() i=4 2024-03-04T12:46:47.954 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.948+0000 7f67cea44800 20 remove_watcher() i=5 2024-03-04T12:46:47.955 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.949+0000 7f67cea44800 20 remove_watcher() i=6 2024-03-04T12:46:47.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:47.950+0000 7f67cea44800 20 remove_watcher() i=7 2024-03-04T12:46:47.967 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-04T12:46:47.994 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:47.994 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:48.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.020+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.022+0000 7f3341824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.022+0000 7f3341824800 20 realm 2024-03-04T12:46:48.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.022+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.022+0000 7f3341824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.022+0000 7f3341824800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:48.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.022+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.022+0000 7f3341824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.029 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.022+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.029 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.023+0000 7f3341824800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:48.029 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.023+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.024+0000 7f3341824800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:48.030 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.024+0000 7f3341824800 20 searching for the correct realm 2024-03-04T12:46:48.032 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.027+0000 7f333f327640 0 -- 172.21.15.90:0/2477036242 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f33380a73c0 msgr2=0x7f3338007220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:48.035 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.030+0000 7f333f327640 0 -- 172.21.15.90:0/2477036242 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f3328057be0 msgr2=0x7f3328089630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:48.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.236+0000 7f3341824800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:48.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.236+0000 7f3341824800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:48.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.236+0000 7f3341824800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:48.242 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.236+0000 7f3341824800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:48.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.236+0000 7f3341824800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:48.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.236+0000 7f3341824800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:48.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.236+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.236+0000 7f3341824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.243 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.236+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.237+0000 7f3341824800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:48.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.237+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.237+0000 7f3341824800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:48.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.237+0000 7f3341824800 20 zone default found 2024-03-04T12:46:48.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.237+0000 7f3341824800 4 Realm: () 2024-03-04T12:46:48.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.237+0000 7f3341824800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:48.244 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.237+0000 7f3341824800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:48.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.237+0000 7f3341824800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:48.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.237+0000 7f3341824800 20 zonegroup default 2024-03-04T12:46:48.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.237+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.237+0000 7f3341824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.237+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.238+0000 7f3341824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.238+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.238+0000 7f3341824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.238+0000 7f3341824800 20 started sync module instance, tier type = 2024-03-04T12:46:48.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.238+0000 7f3341824800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:48.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.247+0000 7f3341824800 20 add_watcher() i=0 2024-03-04T12:46:48.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.247+0000 7f3341824800 20 add_watcher() i=1 2024-03-04T12:46:48.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.247+0000 7f3341824800 20 add_watcher() i=2 2024-03-04T12:46:48.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.247+0000 7f3341824800 20 add_watcher() i=3 2024-03-04T12:46:48.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.247+0000 7f3341824800 20 add_watcher() i=4 2024-03-04T12:46:48.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.247+0000 7f3341824800 20 add_watcher() i=5 2024-03-04T12:46:48.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.247+0000 7f3341824800 20 add_watcher() i=6 2024-03-04T12:46:48.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.248+0000 7f3341824800 20 add_watcher() i=7 2024-03-04T12:46:48.254 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.248+0000 7f3341824800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:48.255 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.249+0000 7f31f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:48.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.250+0000 7f3341824800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:48.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.250+0000 7f3341824800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:48.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.250+0000 7f3341824800 5 note: GC not initialized 2024-03-04T12:46:48.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.250+0000 7f31f4fe1640 20 reqs_thread_entry: start 2024-03-04T12:46:48.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.250+0000 7f3341824800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:48.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.250+0000 7f3341824800 20 Filter name: none 2024-03-04T12:46:48.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.250+0000 7f316e7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:48.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.250+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.251+0000 7f3341824800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:48.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.251+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.251+0000 7f3341824800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:48.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.251+0000 7f3341824800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:48.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.251+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.252+0000 7f3341824800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:48.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.252+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.252+0000 7f3341824800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:48.258 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.252+0000 7f3341824800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:48.259 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.253+0000 7f3341824800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.259 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.253+0000 7f3341824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.259 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.254+0000 7f31f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:48.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.256+0000 7f3341824800 20 remove_watcher() i=0 2024-03-04T12:46:48.261 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.256+0000 7f3341824800 2 removed watcher, disabling cache 2024-03-04T12:46:48.262 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.257+0000 7f3341824800 20 remove_watcher() i=1 2024-03-04T12:46:48.264 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.258+0000 7f3341824800 20 remove_watcher() i=2 2024-03-04T12:46:48.264 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.259+0000 7f3341824800 20 remove_watcher() i=3 2024-03-04T12:46:48.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.260+0000 7f3341824800 20 remove_watcher() i=4 2024-03-04T12:46:48.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.260+0000 7f3341824800 20 remove_watcher() i=5 2024-03-04T12:46:48.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.261+0000 7f3341824800 20 remove_watcher() i=6 2024-03-04T12:46:48.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.262+0000 7f3341824800 20 remove_watcher() i=7 2024-03-04T12:46:48.278 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:48.278 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:48.278 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-block-writes id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:46:48.278 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:48.280 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.280 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.283 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.283 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.326 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.326 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.351 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard bucket with abort at block_writes 2024-03-04T12:46:48.351 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:48.352 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.352 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.363 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.363 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.406 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.406 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.414 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.414 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.422 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.423 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.430 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.430 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.437 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.437 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.445 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.445 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.452 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.452 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.459 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.459 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.466 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.466 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.473 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.473 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.480 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.480 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.487 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.487 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.494 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.494 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.501 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.502 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.509 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.509 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.516 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.516 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.523 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.523 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.531 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.531 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.538 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.538 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.545 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:48.545 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:48.553 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-04T12:46:48.579 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:48.579 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:48.611 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.606+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.607+0000 7fbc58222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.607+0000 7fbc58222800 20 realm 2024-03-04T12:46:48.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.607+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.607+0000 7fbc58222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.607+0000 7fbc58222800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:48.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.607+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.608+0000 7fbc58222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.608+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.608+0000 7fbc58222800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:48.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.608+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.609+0000 7fbc58222800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:48.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.609+0000 7fbc58222800 20 searching for the correct realm 2024-03-04T12:46:48.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.611+0000 7fbc55d1e640 0 -- 172.21.15.90:0/3272453425 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7fbc50014980 msgr2=0x7fbc50032450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:48.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.615+0000 7fbc55d1e640 0 -- 172.21.15.90:0/3272453425 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fbc4005a420 msgr2=0x7fbc4005a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:48.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.821+0000 7fbc58222800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:48.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.821+0000 7fbc58222800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:48.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.821+0000 7fbc58222800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:48.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.821+0000 7fbc58222800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:48.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.821+0000 7fbc58222800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:48.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.821+0000 7fbc58222800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:48.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.821+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.821+0000 7fbc58222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.821+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.821+0000 7fbc58222800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:48.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.821+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.822+0000 7fbc58222800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:48.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.822+0000 7fbc58222800 20 zone default found 2024-03-04T12:46:48.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.822+0000 7fbc58222800 4 Realm: () 2024-03-04T12:46:48.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.822+0000 7fbc58222800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:48.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.822+0000 7fbc58222800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:48.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.822+0000 7fbc58222800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:48.830 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.822+0000 7fbc58222800 20 zonegroup default 2024-03-04T12:46:48.830 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.822+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.830 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.822+0000 7fbc58222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.830 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.822+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.830 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.823+0000 7fbc58222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.830 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.823+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.823+0000 7fbc58222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.823+0000 7fbc58222800 20 started sync module instance, tier type = 2024-03-04T12:46:48.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.823+0000 7fbc58222800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:48.837 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.832+0000 7fbc58222800 20 add_watcher() i=0 2024-03-04T12:46:48.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.832+0000 7fbc58222800 20 add_watcher() i=1 2024-03-04T12:46:48.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.832+0000 7fbc58222800 20 add_watcher() i=2 2024-03-04T12:46:48.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.832+0000 7fbc58222800 20 add_watcher() i=3 2024-03-04T12:46:48.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.832+0000 7fbc58222800 20 add_watcher() i=4 2024-03-04T12:46:48.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.832+0000 7fbc58222800 20 add_watcher() i=5 2024-03-04T12:46:48.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.832+0000 7fbc58222800 20 add_watcher() i=6 2024-03-04T12:46:48.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.833+0000 7fbc58222800 20 add_watcher() i=7 2024-03-04T12:46:48.838 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.833+0000 7fbc58222800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:48.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.835+0000 7fbb077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:48.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.835+0000 7fbc58222800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:48.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.835+0000 7fbc58222800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:48.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.835+0000 7fbc58222800 5 note: GC not initialized 2024-03-04T12:46:48.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.835+0000 7fbb067fc640 20 reqs_thread_entry: start 2024-03-04T12:46:48.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.835+0000 7fbc58222800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:48.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.835+0000 7fbc58222800 20 Filter name: none 2024-03-04T12:46:48.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.835+0000 7fba77fff640 20 reqs_thread_entry: start 2024-03-04T12:46:48.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.835+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.836+0000 7fbc58222800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:48.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.836+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.836+0000 7fbc58222800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:48.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.836+0000 7fbc58222800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:48.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.836+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.837+0000 7fbc58222800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:48.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.837+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.837+0000 7fbc58222800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:48.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.837+0000 7fbc58222800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:48.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.838+0000 7fbc58222800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.838+0000 7fbc58222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.845 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.839+0000 7fbb077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:48.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.841+0000 7fbc58222800 20 remove_watcher() i=0 2024-03-04T12:46:48.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.841+0000 7fbc58222800 2 removed watcher, disabling cache 2024-03-04T12:46:48.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.842+0000 7fbc58222800 20 remove_watcher() i=1 2024-03-04T12:46:48.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.843+0000 7fbc58222800 20 remove_watcher() i=2 2024-03-04T12:46:48.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.844+0000 7fbc58222800 20 remove_watcher() i=3 2024-03-04T12:46:48.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.845+0000 7fbc58222800 20 remove_watcher() i=4 2024-03-04T12:46:48.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.846+0000 7fbc58222800 20 remove_watcher() i=5 2024-03-04T12:46:48.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.847+0000 7fbc58222800 20 remove_watcher() i=6 2024-03-04T12:46:48.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.848+0000 7fbc58222800 20 remove_watcher() i=7 2024-03-04T12:46:48.864 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:48.864 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:48.864 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: abort-at-block-writes id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:46:48.864 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:48.864 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-03-04T12:46:48.897 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:48.897 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:48.930 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.924+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.925+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.925+0000 7fe5db0c0800 20 realm 2024-03-04T12:46:48.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.925+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.926+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.926+0000 7fe5db0c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:48.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.926+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.926+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:48.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.926+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.927+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:48.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.927+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:48.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.927+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:48.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.927+0000 7fe5db0c0800 20 searching for the correct realm 2024-03-04T12:46:48.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.930+0000 7fe5d03c2640 0 -- 172.21.15.90:0/91571499 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fe5c0053030 msgr2=0x7fe5c00997a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:48.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:48.933+0000 7fe5d8bc3640 0 -- 172.21.15.90:0/91571499 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fe5c009f8a0 msgr2=0x7fe5c00ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:49.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:49.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:49.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:49.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:49.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:49.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:49.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:49.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:49.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 zone default found 2024-03-04T12:46:49.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.140+0000 7fe5db0c0800 4 Realm: () 2024-03-04T12:46:49.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.140+0000 7fe5db0c0800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:49.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.140+0000 7fe5db0c0800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:49.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.140+0000 7fe5db0c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:49.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 zonegroup default 2024-03-04T12:46:49.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.141+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.141+0000 7fe5db0c0800 20 started sync module instance, tier type = 2024-03-04T12:46:49.148 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.141+0000 7fe5db0c0800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:49.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=0 2024-03-04T12:46:49.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=1 2024-03-04T12:46:49.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=2 2024-03-04T12:46:49.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=3 2024-03-04T12:46:49.155 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=4 2024-03-04T12:46:49.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=5 2024-03-04T12:46:49.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=6 2024-03-04T12:46:49.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.150+0000 7fe5db0c0800 20 add_watcher() i=7 2024-03-04T12:46:49.156 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.150+0000 7fe5db0c0800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:49.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.152+0000 7fe48efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:49.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.152+0000 7fe5db0c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:49.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.152+0000 7fe5db0c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:49.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 note: GC not initialized 2024-03-04T12:46:49.159 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.152+0000 7fe48dfe3640 20 reqs_thread_entry: start 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 Filter name: none 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe3ff7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 : miss 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:46:49.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:49.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:49.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 2024-03-04T12:46:49.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.158+0000 7fe5db0c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:46:49.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.158+0000 7fe5db0c0800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:46:49.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.158+0000 7fe5db0c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:49.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.158+0000 7fe5db0c0800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23, ofs0, ns] 2024-03-04T12:46:49.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.158+0000 7fe4af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824071 cookie 94523763640800 notifier 6558 bl.length()=877 2024-03-04T12:46:49.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.158+0000 7fe4af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:46:49.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.158+0000 7fe4af7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:46:49.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.158+0000 7fe4af7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:49.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.159+0000 7fe5db0c0800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): orig_sources= new_sources= 2024-03-04T12:46:49.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.159+0000 7fe5db0c0800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): potential sources added=[] removed=[] 2024-03-04T12:46:49.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.159+0000 7fe5db0c0800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): orig_dests= new_dests= 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.159+0000 7fe5db0c0800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): potential dests added=[] removed=[] 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe5db0c0800 time 2024-03-04T12:46:49.160037+0000 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe5de580e86] 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fe5de581044] 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8068edeb1] 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55f806901d74] 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr: 5: main() 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fe5dd23feb0] 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr: 7: __libc_start_main() 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr: 8: _start() 2024-03-04T12:46:49.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.159+0000 7fe5db0c0800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe5db0c0800 time 2024-03-04T12:46:49.160037+0000 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe5de580e86] 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fe5de581044] 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8068edeb1] 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55f806901d74] 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr: 5: main() 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fe5dd23feb0] 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr: 7: __libc_start_main() 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr: 8: _start() 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.167 INFO:tasks.workunit.client.0.smithi090.stderr:*** Caught signal (Aborted) ** 2024-03-04T12:46:49.168 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7fe5db0c0800 thread_name:radosgw-admin 2024-03-04T12:46:49.185 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:49.185 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe5dd254db0] 2024-03-04T12:46:49.185 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe5dd2a154c] 2024-03-04T12:46:49.185 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:46:49.185 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:46:49.185 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe5de580ee0] 2024-03-04T12:46:49.185 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fe5de581044] 2024-03-04T12:46:49.185 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8068edeb1] 2024-03-04T12:46:49.185 INFO:tasks.workunit.client.0.smithi090.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55f806901d74] 2024-03-04T12:46:49.185 INFO:tasks.workunit.client.0.smithi090.stderr: 9: main() 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fe5dd23feb0] 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 11: __libc_start_main() 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 12: _start() 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.160+0000 7fe5db0c0800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7fe5db0c0800 thread_name:radosgw-admin 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe5dd254db0] 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe5dd2a154c] 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe5de580ee0] 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fe5de581044] 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8068edeb1] 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55f806901d74] 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 9: main() 2024-03-04T12:46:49.186 INFO:tasks.workunit.client.0.smithi090.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fe5dd23feb0] 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr: 11: __libc_start_main() 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr: 12: _start() 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr:--- begin dump of recent events --- 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr: -499> 2024-03-04T12:46:48.909+0000 7fe4c6e0d640 10 monclient: _check_auth_tickets 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr: -498> 2024-03-04T12:46:48.909+0000 7fe4c6e0d640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr: -497> 2024-03-04T12:46:48.909+0000 7fe4c6e0d640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr: -496> 2024-03-04T12:46:48.909+0000 7fe4c6e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr: -495> 2024-03-04T12:46:48.909+0000 7fe4c6e0d640 10 monclient: dump: 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.187 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr: -494> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 monclient: authenticate success, global_id 6546 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr: -493> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 10 monclient: get_monmap_and_config success 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr: -492> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 4 set_mon_vals no callback set 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr: -491> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 10 monclient: shutdown 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr: -490> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) unregister_commands rotate-key 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr: -489> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 10 monclient: build_initial_monmap 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr: -488> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 1 build_initial for_mkfs: 0 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr: -487> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 10 monclient: monmap: 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:49.188 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: -486> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding auth protocol: cephx 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: -485> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding auth protocol: cephx 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: -484> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding auth protocol: cephx 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: -483> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: secure 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: -482> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: crc 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: -481> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: secure 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: -480> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: crc 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: -479> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: secure 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: -478> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: crc 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: -477> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: crc 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: -476> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: secure 2024-03-04T12:46:49.189 INFO:tasks.workunit.client.0.smithi090.stderr: -475> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: crc 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -474> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: secure 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -473> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: crc 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -472> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: secure 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -471> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -470> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 1 librados: starting msgr at 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -469> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 1 librados: starting objecter 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -468> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command objecter_requests hook 0x55f8074b08c0 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -467> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 1 librados: setting wanted keys 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -466> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 1 librados: calling monclient init 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -465> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient: init 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -464> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding auth protocol: cephx 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -463> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding auth protocol: cephx 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -462> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding auth protocol: cephx 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -461> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: secure 2024-03-04T12:46:49.190 INFO:tasks.workunit.client.0.smithi090.stderr: -460> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: crc 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -459> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: secure 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -458> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: crc 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -457> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: secure 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -456> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: crc 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -455> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: crc 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -454> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: secure 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -453> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: crc 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -452> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: secure 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -451> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: crc 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -450> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: secure 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -449> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -448> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -447> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command rotate-key hook 0x55f8074aaed8 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -446> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -445> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:46:49.191 INFO:tasks.workunit.client.0.smithi090.stderr: -444> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-b con 0x55f807330f70 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -443> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-c con 0x55f807352d30 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -442> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-a con 0x55f807353660 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -441> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -440> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -439> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -438> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -437> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): authenticate will time out at 1441.242075s 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -436> 2024-03-04T12:46:48.910+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request con 0x55f807352d30 auth_method 0 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -435> 2024-03-04T12:46:48.910+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -434> 2024-03-04T12:46:48.910+0000 7fe5d03c2640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -433> 2024-03-04T12:46:48.910+0000 7fe5d03c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -432> 2024-03-04T12:46:48.910+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request con 0x55f807353660 auth_method 0 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -431> 2024-03-04T12:46:48.910+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -430> 2024-03-04T12:46:48.910+0000 7fe5d93c4640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -429> 2024-03-04T12:46:48.910+0000 7fe5d93c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -428> 2024-03-04T12:46:48.910+0000 7fe5d8bc3640 10 monclient(hunting): get_auth_request con 0x55f807330f70 auth_method 0 2024-03-04T12:46:49.192 INFO:tasks.workunit.client.0.smithi090.stderr: -427> 2024-03-04T12:46:48.910+0000 7fe5d8bc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -426> 2024-03-04T12:46:48.910+0000 7fe5d8bc3640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -425> 2024-03-04T12:46:48.910+0000 7fe5d8bc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -424> 2024-03-04T12:46:48.910+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -423> 2024-03-04T12:46:48.910+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -422> 2024-03-04T12:46:48.911+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -421> 2024-03-04T12:46:48.911+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -420> 2024-03-04T12:46:48.911+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -419> 2024-03-04T12:46:48.911+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -418> 2024-03-04T12:46:48.911+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -417> 2024-03-04T12:46:48.911+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -416> 2024-03-04T12:46:48.911+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -415> 2024-03-04T12:46:48.911+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_done global_id 6200 payload 824 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -414> 2024-03-04T12:46:48.911+0000 7fe5d03c2640 10 monclient: _finish_hunting 0 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -413> 2024-03-04T12:46:48.911+0000 7fe5d03c2640 1 monclient: found mon.noname-c 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -412> 2024-03-04T12:46:48.911+0000 7fe5d03c2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:46:49.193 INFO:tasks.workunit.client.0.smithi090.stderr: -411> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr: -410> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr: -409> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: dump: 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr: -408> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: _finish_auth 0 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr: -407> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: _check_auth_tickets 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr: -406> 2024-03-04T12:46:48.911+0000 7fe5db0c0800 5 monclient: authenticate success, global_id 6200 2024-03-04T12:46:49.194 INFO:tasks.workunit.client.0.smithi090.stderr: -405> 2024-03-04T12:46:48.911+0000 7fe5db0c0800 10 monclient: _renew_subs 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr: -404> 2024-03-04T12:46:48.911+0000 7fe5db0c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr: -403> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr: -402> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr: -401> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr: -400> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: dump: 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr: -399> 2024-03-04T12:46:48.911+0000 7fe4c6e0d640 4 set_mon_vals no callback set 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr: -398> 2024-03-04T12:46:48.911+0000 7fe5db0c0800 10 monclient: _renew_subs 2024-03-04T12:46:49.195 INFO:tasks.workunit.client.0.smithi090.stderr: -397> 2024-03-04T12:46:48.911+0000 7fe5db0c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr: -396> 2024-03-04T12:46:48.911+0000 7fe5db0c0800 1 librados: init done 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr: -395> 2024-03-04T12:46:48.913+0000 7fe4c560a640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr: -394> 2024-03-04T12:46:48.913+0000 7fe4c560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr: -393> 2024-03-04T12:46:48.913+0000 7fe4c560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr: -392> 2024-03-04T12:46:48.913+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x7fe4c0069eb0 auth_method 0 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr: -391> 2024-03-04T12:46:48.913+0000 7fe5d93c4640 10 monclient: get_auth_request con 0x55f8074e94e0 auth_method 0 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr: -390> 2024-03-04T12:46:48.914+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x55f8074f5d90 auth_method 0 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr: -389> 2024-03-04T12:46:48.914+0000 7fe5d03c2640 10 monclient: get_auth_request con 0x55f8074fa220 auth_method 0 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr: -388> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 10 monclient: build_initial_monmap 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr: -387> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 1 build_initial for_mkfs: 0 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr: -386> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 10 monclient: monmap: 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:49.196 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr: -385> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding auth protocol: cephx 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr: -384> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding auth protocol: cephx 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr: -383> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding auth protocol: cephx 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr: -382> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: secure 2024-03-04T12:46:49.197 INFO:tasks.workunit.client.0.smithi090.stderr: -381> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: crc 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -380> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: secure 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -379> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: crc 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -378> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: secure 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -377> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: crc 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -376> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: crc 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -375> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: secure 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -374> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: crc 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -373> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: secure 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -372> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: crc 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -371> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: secure 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -370> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -369> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command objecter_requests cmddesc objecter_requests hook 0x55f807502d80 EEXIST 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -368> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient: init 2024-03-04T12:46:49.198 INFO:tasks.workunit.client.0.smithi090.stderr: -367> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding auth protocol: cephx 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -366> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding auth protocol: cephx 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -365> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding auth protocol: cephx 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -364> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: secure 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -363> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: crc 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -362> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: secure 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -361> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: crc 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -360> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: secure 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -359> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: crc 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -358> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: crc 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -357> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: secure 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -356> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: crc 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -355> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: secure 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -354> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: crc 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -353> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: secure 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -352> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -351> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.199 INFO:tasks.workunit.client.0.smithi090.stderr: -350> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command rotate-key cmddesc rotate-key hook 0x55f8074fd860 EEXIST 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -349> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -348> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -347> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-c con 0x55f8075295b0 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -346> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-a con 0x55f807529990 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -345> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-b con 0x55f80753c340 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -344> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -343> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -342> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -341> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -340> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): authenticate will time out at 1441.248165s 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -339> 2024-03-04T12:46:48.916+0000 7fe5d8bc3640 10 monclient(hunting): get_auth_request con 0x55f8075295b0 auth_method 0 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -338> 2024-03-04T12:46:48.916+0000 7fe5d8bc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -337> 2024-03-04T12:46:48.916+0000 7fe5d8bc3640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -336> 2024-03-04T12:46:48.916+0000 7fe5d8bc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -335> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request con 0x55f807529990 auth_method 0 2024-03-04T12:46:49.200 INFO:tasks.workunit.client.0.smithi090.stderr: -334> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -333> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -332> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -331> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -330> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -329> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -328> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -327> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -326> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -325> 2024-03-04T12:46:48.917+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request con 0x55f80753c340 auth_method 0 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -324> 2024-03-04T12:46:48.917+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -323> 2024-03-04T12:46:48.917+0000 7fe5d93c4640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -322> 2024-03-04T12:46:48.917+0000 7fe5d93c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -321> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_done global_id 6203 payload 824 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -320> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 10 monclient: _finish_hunting 0 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -319> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 1 monclient: found mon.noname-c 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -318> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:46:49.201 INFO:tasks.workunit.client.0.smithi090.stderr: -317> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr: -316> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr: -315> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: dump: 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr: -314> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: _finish_auth 0 2024-03-04T12:46:49.202 INFO:tasks.workunit.client.0.smithi090.stderr: -313> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: _check_auth_tickets 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr: -312> 2024-03-04T12:46:48.917+0000 7fe5db0c0800 5 monclient: authenticate success, global_id 6203 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr: -311> 2024-03-04T12:46:48.917+0000 7fe5db0c0800 10 monclient: _renew_subs 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr: -310> 2024-03-04T12:46:48.917+0000 7fe5db0c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr: -309> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr: -308> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr: -307> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr: -306> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: dump: 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.203 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr: -305> 2024-03-04T12:46:48.917+0000 7fe5d9bc5640 4 set_mon_vals no callback set 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr: -304> 2024-03-04T12:46:48.917+0000 7fe5db0c0800 10 monclient: _renew_subs 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr: -303> 2024-03-04T12:46:48.917+0000 7fe5db0c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr: -302> 2024-03-04T12:46:48.919+0000 7fe4be7fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr: -301> 2024-03-04T12:46:48.919+0000 7fe4be7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr: -300> 2024-03-04T12:46:48.919+0000 7fe4be7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr: -299> 2024-03-04T12:46:48.919+0000 7fe5d03c2640 10 monclient: get_auth_request con 0x7fe4b0069de0 auth_method 0 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr: -298> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 10 monclient: get_monmap_and_config 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr: -297> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 10 monclient: build_initial_monmap 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr: -296> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 1 build_initial for_mkfs: 0 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr: -295> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 10 monclient: monmap: 2024-03-04T12:46:49.204 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr: -294> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding auth protocol: cephx 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr: -293> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding auth protocol: cephx 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr: -292> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding auth protocol: cephx 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr: -291> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: secure 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr: -290> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: crc 2024-03-04T12:46:49.205 INFO:tasks.workunit.client.0.smithi090.stderr: -289> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: secure 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -288> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: crc 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -287> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: secure 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -286> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: crc 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -285> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: crc 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -284> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: secure 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -283> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: crc 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -282> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: secure 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -281> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: crc 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -280> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: secure 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -279> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -278> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 10 monclient: init 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -277> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding auth protocol: cephx 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -276> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding auth protocol: cephx 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -275> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding auth protocol: cephx 2024-03-04T12:46:49.206 INFO:tasks.workunit.client.0.smithi090.stderr: -274> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: secure 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -273> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: crc 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -272> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: secure 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -271> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: crc 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -270> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: secure 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -269> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: crc 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -268> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: crc 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -267> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: secure 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -266> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: crc 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -265> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: secure 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -264> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: crc 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -263> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: secure 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -262> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -261> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -260> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command rotate-key cmddesc rotate-key hook 0x7ffd1287b0e8 EEXIST 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -259> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:49.207 INFO:tasks.workunit.client.0.smithi090.stderr: -258> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -257> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-c con 0x55f80757b930 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -256> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-b con 0x55f80757bd10 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -255> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-a con 0x55f80756da90 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -254> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -253> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -252> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -251> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -250> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): authenticate will time out at 1441.251600s 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -249> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): get_auth_request con 0x55f80757b930 auth_method 0 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -248> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -247> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -246> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -245> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request con 0x55f80756da90 auth_method 0 2024-03-04T12:46:49.208 INFO:tasks.workunit.client.0.smithi090.stderr: -244> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -243> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -242> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -241> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -240> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -239> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -238> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -237> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -236> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -235> 2024-03-04T12:46:48.920+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request con 0x55f80757bd10 auth_method 0 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -234> 2024-03-04T12:46:48.920+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -233> 2024-03-04T12:46:48.920+0000 7fe5d03c2640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -232> 2024-03-04T12:46:48.920+0000 7fe5d03c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -231> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_done global_id 6555 payload 274 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -230> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient: _finish_hunting 0 2024-03-04T12:46:49.209 INFO:tasks.workunit.client.0.smithi090.stderr: -229> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 1 monclient: found mon.noname-a 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr: -228> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr: -227> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr: -226> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr: -225> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: dump: 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.210 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr: -224> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: _finish_auth 0 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr: -223> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: _check_auth_tickets 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr: -222> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr: -221> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr: -220> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr: -219> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: dump: 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.211 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr: -218> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 5 monclient: authenticate success, global_id 6555 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr: -217> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient: get_monmap_and_config success 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr: -216> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 4 set_mon_vals no callback set 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr: -215> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 10 monclient: shutdown 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr: -214> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 10 monclient: build_initial_monmap 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr: -213> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 1 build_initial for_mkfs: 0 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr: -212> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 10 monclient: monmap: 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:49.212 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr: -211> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding auth protocol: cephx 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr: -210> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding auth protocol: cephx 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr: -209> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding auth protocol: cephx 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr: -208> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: secure 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr: -207> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: crc 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr: -206> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: secure 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr: -205> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: crc 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr: -204> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: secure 2024-03-04T12:46:49.213 INFO:tasks.workunit.client.0.smithi090.stderr: -203> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: crc 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -202> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: crc 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -201> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: secure 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -200> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: crc 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -199> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: secure 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -198> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: crc 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -197> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: secure 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -196> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -195> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 1 librados: starting msgr at 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -194> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 1 librados: starting objecter 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -193> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command objecter_requests cmddesc objecter_requests hook 0x55f807549d50 EEXIST 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -192> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 1 librados: setting wanted keys 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -191> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 1 librados: calling monclient init 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -190> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 10 monclient: init 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -189> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding auth protocol: cephx 2024-03-04T12:46:49.214 INFO:tasks.workunit.client.0.smithi090.stderr: -188> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding auth protocol: cephx 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -187> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding auth protocol: cephx 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -186> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: secure 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -185> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: crc 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -184> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: secure 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -183> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: crc 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -182> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: secure 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -181> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: crc 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -180> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: crc 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -179> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: secure 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -178> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: crc 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -177> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: secure 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -176> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: crc 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -175> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: secure 2024-03-04T12:46:49.215 INFO:tasks.workunit.client.0.smithi090.stderr: -174> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -173> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -172> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command rotate-key cmddesc rotate-key hook 0x55f80753f098 EEXIST 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -171> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -170> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -169> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-b con 0x55f80756da90 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -168> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-c con 0x55f80757b930 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -167> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-a con 0x55f80756fa50 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -166> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -165> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -164> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -163> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -162> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): authenticate will time out at 1441.253709s 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -161> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request con 0x55f80756fa50 auth_method 0 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -160> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.216 INFO:tasks.workunit.client.0.smithi090.stderr: -159> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -158> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -157> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request con 0x55f80757b930 auth_method 0 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -156> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -155> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -154> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -153> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -152> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -151> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -150> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -149> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -148> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -147> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_done global_id 6558 payload 824 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -146> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient: _finish_hunting 0 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -145> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 1 monclient: found mon.noname-a 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -144> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:46:49.217 INFO:tasks.workunit.client.0.smithi090.stderr: -143> 2024-03-04T12:46:48.922+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x55f80756da90 auth_method 0 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr: -142> 2024-03-04T12:46:48.922+0000 7fe4ae7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr: -141> 2024-03-04T12:46:48.922+0000 7fe4ae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr: -140> 2024-03-04T12:46:48.922+0000 7fe4ae7fc640 10 monclient: dump: 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr: -139> 2024-03-04T12:46:48.923+0000 7fe4ae7fc640 10 monclient: _finish_auth 0 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr: -138> 2024-03-04T12:46:48.923+0000 7fe4ae7fc640 10 monclient: _check_auth_tickets 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr: -137> 2024-03-04T12:46:48.923+0000 7fe4ae7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr: -136> 2024-03-04T12:46:48.923+0000 7fe4ae7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.218 INFO:tasks.workunit.client.0.smithi090.stderr: -135> 2024-03-04T12:46:48.923+0000 7fe4ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr: -134> 2024-03-04T12:46:48.923+0000 7fe4ae7fc640 10 monclient: dump: 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr: -133> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 5 monclient: authenticate success, global_id 6558 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr: -132> 2024-03-04T12:46:48.923+0000 7fe4affff640 4 set_mon_vals no callback set 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr: -131> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 10 monclient: _renew_subs 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr: -130> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:46:49.219 INFO:tasks.workunit.client.0.smithi090.stderr: -129> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 10 monclient: _renew_subs 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -128> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -127> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 1 librados: init done 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -126> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command cr dump hook 0x55f80756c618 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -125> 2024-03-04T12:46:48.924+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -124> 2024-03-04T12:46:48.925+0000 7fe4ae7fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -123> 2024-03-04T12:46:48.925+0000 7fe4ae7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -122> 2024-03-04T12:46:48.925+0000 7fe4ae7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -121> 2024-03-04T12:46:48.925+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x7fe4a4069eb0 auth_method 0 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -120> 2024-03-04T12:46:48.925+0000 7fe5d03c2640 10 monclient: get_auth_request con 0x55f807596b90 auth_method 0 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -119> 2024-03-04T12:46:48.925+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -118> 2024-03-04T12:46:48.925+0000 7fe5db0c0800 20 realm 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -117> 2024-03-04T12:46:48.925+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -116> 2024-03-04T12:46:48.926+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -115> 2024-03-04T12:46:48.926+0000 7fe5db0c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:49.220 INFO:tasks.workunit.client.0.smithi090.stderr: -114> 2024-03-04T12:46:48.926+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -113> 2024-03-04T12:46:48.926+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -112> 2024-03-04T12:46:48.926+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -111> 2024-03-04T12:46:48.926+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x55f80759ad20 auth_method 0 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -110> 2024-03-04T12:46:48.927+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -109> 2024-03-04T12:46:48.927+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -108> 2024-03-04T12:46:48.927+0000 7fe5d03c2640 10 monclient: get_auth_request con 0x55f80759e5a0 auth_method 0 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -107> 2024-03-04T12:46:48.927+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -106> 2024-03-04T12:46:48.927+0000 7fe5db0c0800 20 searching for the correct realm 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -105> 2024-03-04T12:46:48.927+0000 7fe5d93c4640 10 monclient: get_auth_request con 0x55f8075a3250 auth_method 0 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -104> 2024-03-04T12:46:48.928+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x7fe5d401f050 auth_method 0 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -103> 2024-03-04T12:46:48.929+0000 7fe5d03c2640 10 monclient: get_auth_request con 0x7fe5c0053030 auth_method 0 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -102> 2024-03-04T12:46:48.930+0000 7fe5d03c2640 0 -- 172.21.15.90:0/91571499 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fe5c0053030 msgr2=0x7fe5c00997a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -101> 2024-03-04T12:46:48.930+0000 7fe4ae7fc640 1 client.6558.objecter ms_handle_reset 0x7fe5c0053030 session 0x7fe5c00c0040 osd.4 2024-03-04T12:46:49.221 INFO:tasks.workunit.client.0.smithi090.stderr: -100> 2024-03-04T12:46:48.930+0000 7fe4ae7fc640 10 monclient: _renew_subs 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -99> 2024-03-04T12:46:48.930+0000 7fe4ae7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -98> 2024-03-04T12:46:48.930+0000 7fe5d03c2640 10 monclient: get_auth_request con 0x7fe4a4079cd0 auth_method 0 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -97> 2024-03-04T12:46:48.931+0000 7fe5d93c4640 10 monclient: get_auth_request con 0x7fe5c00997a0 auth_method 0 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -96> 2024-03-04T12:46:48.933+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x7fe5c009f8a0 auth_method 0 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -95> 2024-03-04T12:46:48.933+0000 7fe5d8bc3640 0 -- 172.21.15.90:0/91571499 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fe5c009f8a0 msgr2=0x7fe5c00ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -94> 2024-03-04T12:46:49.134+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x7fe5c009f8a0 auth_method 0 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -93> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -92> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -91> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -90> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -89> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -88> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -87> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -86> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.222 INFO:tasks.workunit.client.0.smithi090.stderr: -85> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -84> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -83> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -82> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -81> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 zone default found 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -80> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 4 Realm: () 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -79> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -78> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -77> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -76> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 zonegroup default 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -75> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -74> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -73> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -72> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -71> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.223 INFO:tasks.workunit.client.0.smithi090.stderr: -70> 2024-03-04T12:46:49.141+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -69> 2024-03-04T12:46:49.141+0000 7fe5db0c0800 20 started sync module instance, tier type = 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -68> 2024-03-04T12:46:49.141+0000 7fe5db0c0800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -67> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=0 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -66> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=1 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -65> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=2 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -64> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=3 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -63> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=4 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -62> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=5 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -61> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=6 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -60> 2024-03-04T12:46:49.150+0000 7fe5db0c0800 20 add_watcher() i=7 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -59> 2024-03-04T12:46:49.150+0000 7fe5db0c0800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -58> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding auth protocol: cephx 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -57> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding auth protocol: cephx 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -56> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding auth protocol: cephx 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -55> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: secure 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -54> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: crc 2024-03-04T12:46:49.224 INFO:tasks.workunit.client.0.smithi090.stderr: -53> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: secure 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -52> 2024-03-04T12:46:49.152+0000 7fe48efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -51> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: crc 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -50> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: secure 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -49> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: crc 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -48> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: crc 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -47> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: secure 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -46> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: crc 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -45> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: secure 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -44> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: crc 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -43> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: secure 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -42> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -41> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -40> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:49.225 INFO:tasks.workunit.client.0.smithi090.stderr: -39> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command cache list hook 0x55f807572b50 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -38> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command cache inspect hook 0x55f807572b50 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -37> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command cache erase hook 0x55f807572b50 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -36> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command cache zap hook 0x55f807572b50 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -35> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 note: GC not initialized 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -34> 2024-03-04T12:46:49.152+0000 7fe48dfe3640 20 reqs_thread_entry: start 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -33> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command sync trace show hook 0x7fe5d400c4f0 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -32> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command sync trace history hook 0x7fe5d400c4f0 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -31> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command sync trace active hook 0x7fe5d400c4f0 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -30> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command sync trace active_short hook 0x7fe5d400c4f0 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -29> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -28> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 Filter name: none 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -27> 2024-03-04T12:46:49.153+0000 7fe3ff7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -26> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -25> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -24> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:49.226 INFO:tasks.workunit.client.0.smithi090.stderr: -23> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -22> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -21> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 : miss 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -20> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -19> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -18> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -17> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -16> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -15> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -14> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -13> 2024-03-04T12:46:49.158+0000 7fe5db0c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -12> 2024-03-04T12:46:49.158+0000 7fe5db0c0800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -11> 2024-03-04T12:46:49.158+0000 7fe5db0c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -10> 2024-03-04T12:46:49.158+0000 7fe5db0c0800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23, ofs0, ns] 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -9> 2024-03-04T12:46:49.158+0000 7fe4af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824071 cookie 94523763640800 notifier 6558 bl.length()=877 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -8> 2024-03-04T12:46:49.158+0000 7fe4af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:46:49.227 INFO:tasks.workunit.client.0.smithi090.stderr: -7> 2024-03-04T12:46:49.158+0000 7fe4af7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: -6> 2024-03-04T12:46:49.158+0000 7fe4af7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: -5> 2024-03-04T12:46:49.159+0000 7fe5db0c0800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): orig_sources= new_sources= 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: -4> 2024-03-04T12:46:49.159+0000 7fe5db0c0800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): potential sources added=[] removed=[] 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: -3> 2024-03-04T12:46:49.159+0000 7fe5db0c0800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): orig_dests= new_dests= 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: -2> 2024-03-04T12:46:49.159+0000 7fe5db0c0800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): potential dests added=[] removed=[] 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: -1> 2024-03-04T12:46:49.159+0000 7fe5db0c0800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe5db0c0800 time 2024-03-04T12:46:49.160037+0000 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe5de580e86] 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fe5de581044] 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8068edeb1] 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55f806901d74] 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: 5: main() 2024-03-04T12:46:49.228 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fe5dd23feb0] 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 7: __libc_start_main() 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 8: _start() 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 0> 2024-03-04T12:46:49.160+0000 7fe5db0c0800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7fe5db0c0800 thread_name:radosgw-admin 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe5dd254db0] 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe5dd2a154c] 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe5de580ee0] 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fe5de581044] 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8068edeb1] 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55f806901d74] 2024-03-04T12:46:49.229 INFO:tasks.workunit.client.0.smithi090.stderr: 9: main() 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fe5dd23feb0] 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 11: __libc_start_main() 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 12: _start() 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr:--- logging levels --- 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 none 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 lockdep 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 context 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 crush 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_balancer 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_locker 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log_expire 2024-03-04T12:46:49.230 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_migrator 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 buffer 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 timer 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 filer 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 striper 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 objecter 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rados 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_mirror 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_replay 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_pwl 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 journaler 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objectcacher 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 client 2024-03-04T12:46:49.231 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 osd 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 optracker 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objclass 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 filestore 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 journal 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 ms 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mon 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 0/10 monc 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 paxos 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 tp 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 auth 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 crypto 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 finisher 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 reserver 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 heartbeatmap 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 perfcounter 2024-03-04T12:46:49.232 INFO:tasks.workunit.client.0.smithi090.stderr: 20/20 rgw 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_sync 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_datacache 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_access 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_flight 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 javaclient 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 asok 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 throttle 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 refs 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 compressor 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluestore 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluefs 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 bdev 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 kstore 2024-03-04T12:46:49.233 INFO:tasks.workunit.client.0.smithi090.stderr: 4/ 5 rocksdb 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 fuse 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 2/ 5 mgr 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mgrc 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 dpdk 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 eventtrace 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 prioritycache 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 test 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephsqlite 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_onode 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_odata 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_omap 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_tm 2024-03-04T12:46:49.234 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_t 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_epm 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_lba 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cache 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_journal 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_device 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_backref 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 alienstore 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mclock 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cyanstore 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 ceph_exporter 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 memstore 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 trace 2024-03-04T12:46:49.235 INFO:tasks.workunit.client.0.smithi090.stderr: -2/-2 (syslog threshold) 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 99/99 (stderr threshold) 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe3ff7fe640 / http_manager 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe48dfe3640 / http_manager 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe48efe5640 / rgw_dt_lg_renew 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe4ae7fc640 / ms_dispatch 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe4af7fe640 / io_context_pool 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe4affff640 / io_context_pool 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe4be7fc640 / ms_dispatch 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe4c560a640 / ms_dispatch 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe4c6e0d640 / io_context_pool 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe5d03c2640 / msgr-worker-2 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe5d8bc3640 / msgr-worker-1 2024-03-04T12:46:49.236 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe5d93c4640 / msgr-worker-0 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe5d9bc5640 / io_context_pool 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe5db0c0800 / radosgw-admin 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr: max_recent 500 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr: max_new 1000 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr: log_file /var/log/ceph/ceph-client.admin.97693.log 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr:--- end dump of recent events --- 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr:--- begin dump of recent events --- 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr: -499> 2024-03-04T12:46:48.909+0000 7fe4c6e0d640 10 monclient: _check_auth_tickets 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr: -498> 2024-03-04T12:46:48.909+0000 7fe4c6e0d640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr: -497> 2024-03-04T12:46:48.909+0000 7fe4c6e0d640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr: -496> 2024-03-04T12:46:48.909+0000 7fe4c6e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr: -495> 2024-03-04T12:46:48.909+0000 7fe4c6e0d640 10 monclient: dump: 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.237 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr: -494> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 monclient: authenticate success, global_id 6546 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr: -493> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 10 monclient: get_monmap_and_config success 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr: -492> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 4 set_mon_vals no callback set 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr: -491> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 10 monclient: shutdown 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr: -490> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) unregister_commands rotate-key 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr: -489> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 10 monclient: build_initial_monmap 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr: -488> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 1 build_initial for_mkfs: 0 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr: -487> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 10 monclient: monmap: 2024-03-04T12:46:49.238 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr: -486> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding auth protocol: cephx 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr: -485> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding auth protocol: cephx 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr: -484> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding auth protocol: cephx 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr: -483> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: secure 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr: -482> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: crc 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr: -481> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: secure 2024-03-04T12:46:49.239 INFO:tasks.workunit.client.0.smithi090.stderr: -480> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: crc 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -479> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: secure 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -478> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: crc 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -477> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: crc 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -476> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: secure 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -475> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: crc 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -474> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: secure 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -473> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: crc 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -472> 2024-03-04T12:46:48.909+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074b1b00) adding con mode: secure 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -471> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -470> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 1 librados: starting msgr at 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -469> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 1 librados: starting objecter 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -468> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command objecter_requests hook 0x55f8074b08c0 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -467> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 1 librados: setting wanted keys 2024-03-04T12:46:49.240 INFO:tasks.workunit.client.0.smithi090.stderr: -466> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 1 librados: calling monclient init 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -465> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient: init 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -464> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding auth protocol: cephx 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -463> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding auth protocol: cephx 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -462> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding auth protocol: cephx 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -461> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: secure 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -460> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: crc 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -459> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: secure 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -458> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: crc 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -457> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: secure 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -456> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: crc 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -455> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: crc 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -454> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: secure 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -453> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: crc 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -452> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: secure 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -451> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: crc 2024-03-04T12:46:49.241 INFO:tasks.workunit.client.0.smithi090.stderr: -450> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074aad90) adding con mode: secure 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -449> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -448> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -447> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command rotate-key hook 0x55f8074aaed8 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -446> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -445> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -444> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-b con 0x55f807330f70 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -443> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-c con 0x55f807352d30 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -442> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-a con 0x55f807353660 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -441> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -440> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -439> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -438> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -437> 2024-03-04T12:46:48.910+0000 7fe5db0c0800 10 monclient(hunting): authenticate will time out at 1441.242075s 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -436> 2024-03-04T12:46:48.910+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request con 0x55f807352d30 auth_method 0 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -435> 2024-03-04T12:46:48.910+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -434> 2024-03-04T12:46:48.910+0000 7fe5d03c2640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.242 INFO:tasks.workunit.client.0.smithi090.stderr: -433> 2024-03-04T12:46:48.910+0000 7fe5d03c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -432> 2024-03-04T12:46:48.910+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request con 0x55f807353660 auth_method 0 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -431> 2024-03-04T12:46:48.910+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -430> 2024-03-04T12:46:48.910+0000 7fe5d93c4640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -429> 2024-03-04T12:46:48.910+0000 7fe5d93c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -428> 2024-03-04T12:46:48.910+0000 7fe5d8bc3640 10 monclient(hunting): get_auth_request con 0x55f807330f70 auth_method 0 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -427> 2024-03-04T12:46:48.910+0000 7fe5d8bc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -426> 2024-03-04T12:46:48.910+0000 7fe5d8bc3640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -425> 2024-03-04T12:46:48.910+0000 7fe5d8bc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -424> 2024-03-04T12:46:48.910+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -423> 2024-03-04T12:46:48.910+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -422> 2024-03-04T12:46:48.911+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -421> 2024-03-04T12:46:48.911+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -420> 2024-03-04T12:46:48.911+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -419> 2024-03-04T12:46:48.911+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -418> 2024-03-04T12:46:48.911+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.243 INFO:tasks.workunit.client.0.smithi090.stderr: -417> 2024-03-04T12:46:48.911+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr: -416> 2024-03-04T12:46:48.911+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr: -415> 2024-03-04T12:46:48.911+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_done global_id 6200 payload 824 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr: -414> 2024-03-04T12:46:48.911+0000 7fe5d03c2640 10 monclient: _finish_hunting 0 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr: -413> 2024-03-04T12:46:48.911+0000 7fe5d03c2640 1 monclient: found mon.noname-c 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr: -412> 2024-03-04T12:46:48.911+0000 7fe5d03c2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr: -411> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr: -410> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr: -409> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: dump: 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.244 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr: -408> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: _finish_auth 0 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr: -407> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: _check_auth_tickets 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr: -406> 2024-03-04T12:46:48.911+0000 7fe5db0c0800 5 monclient: authenticate success, global_id 6200 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr: -405> 2024-03-04T12:46:48.911+0000 7fe5db0c0800 10 monclient: _renew_subs 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr: -404> 2024-03-04T12:46:48.911+0000 7fe5db0c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr: -403> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr: -402> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr: -401> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr: -400> 2024-03-04T12:46:48.911+0000 7fe4c560a640 10 monclient: dump: 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.245 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -399> 2024-03-04T12:46:48.911+0000 7fe4c6e0d640 4 set_mon_vals no callback set 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -398> 2024-03-04T12:46:48.911+0000 7fe5db0c0800 10 monclient: _renew_subs 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -397> 2024-03-04T12:46:48.911+0000 7fe5db0c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -396> 2024-03-04T12:46:48.911+0000 7fe5db0c0800 1 librados: init done 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -395> 2024-03-04T12:46:48.913+0000 7fe4c560a640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -394> 2024-03-04T12:46:48.913+0000 7fe4c560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -393> 2024-03-04T12:46:48.913+0000 7fe4c560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -392> 2024-03-04T12:46:48.913+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x7fe4c0069eb0 auth_method 0 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -391> 2024-03-04T12:46:48.913+0000 7fe5d93c4640 10 monclient: get_auth_request con 0x55f8074e94e0 auth_method 0 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -390> 2024-03-04T12:46:48.914+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x55f8074f5d90 auth_method 0 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -389> 2024-03-04T12:46:48.914+0000 7fe5d03c2640 10 monclient: get_auth_request con 0x55f8074fa220 auth_method 0 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -388> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 10 monclient: build_initial_monmap 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -387> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 1 build_initial for_mkfs: 0 2024-03-04T12:46:49.246 INFO:tasks.workunit.client.0.smithi090.stderr: -386> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 10 monclient: monmap: 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr: -385> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding auth protocol: cephx 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr: -384> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding auth protocol: cephx 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr: -383> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding auth protocol: cephx 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr: -382> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: secure 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr: -381> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: crc 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr: -380> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: secure 2024-03-04T12:46:49.247 INFO:tasks.workunit.client.0.smithi090.stderr: -379> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: crc 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -378> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: secure 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -377> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: crc 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -376> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: crc 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -375> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: secure 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -374> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: crc 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -373> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: secure 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -372> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: crc 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -371> 2024-03-04T12:46:48.915+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074ff010) adding con mode: secure 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -370> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -369> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command objecter_requests cmddesc objecter_requests hook 0x55f807502d80 EEXIST 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -368> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient: init 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -367> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding auth protocol: cephx 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -366> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding auth protocol: cephx 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -365> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding auth protocol: cephx 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -364> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: secure 2024-03-04T12:46:49.248 INFO:tasks.workunit.client.0.smithi090.stderr: -363> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: crc 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -362> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: secure 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -361> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: crc 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -360> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: secure 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -359> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: crc 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -358> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: crc 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -357> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: secure 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -356> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: crc 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -355> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: secure 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -354> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: crc 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -353> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 AuthRegistry(0x55f8074fd718) adding con mode: secure 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -352> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -351> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -350> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command rotate-key cmddesc rotate-key hook 0x55f8074fd860 EEXIST 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -349> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:49.249 INFO:tasks.workunit.client.0.smithi090.stderr: -348> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -347> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-c con 0x55f8075295b0 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -346> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-a con 0x55f807529990 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -345> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-b con 0x55f80753c340 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -344> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -343> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -342> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -341> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -340> 2024-03-04T12:46:48.916+0000 7fe5db0c0800 10 monclient(hunting): authenticate will time out at 1441.248165s 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -339> 2024-03-04T12:46:48.916+0000 7fe5d8bc3640 10 monclient(hunting): get_auth_request con 0x55f8075295b0 auth_method 0 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -338> 2024-03-04T12:46:48.916+0000 7fe5d8bc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -337> 2024-03-04T12:46:48.916+0000 7fe5d8bc3640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -336> 2024-03-04T12:46:48.916+0000 7fe5d8bc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -335> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request con 0x55f807529990 auth_method 0 2024-03-04T12:46:49.250 INFO:tasks.workunit.client.0.smithi090.stderr: -334> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -333> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -332> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -331> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -330> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -329> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -328> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -327> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -326> 2024-03-04T12:46:48.917+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -325> 2024-03-04T12:46:48.917+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request con 0x55f80753c340 auth_method 0 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -324> 2024-03-04T12:46:48.917+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -323> 2024-03-04T12:46:48.917+0000 7fe5d93c4640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -322> 2024-03-04T12:46:48.917+0000 7fe5d93c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -321> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_done global_id 6203 payload 824 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -320> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 10 monclient: _finish_hunting 0 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -319> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 1 monclient: found mon.noname-c 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -318> 2024-03-04T12:46:48.917+0000 7fe5d8bc3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:46:49.251 INFO:tasks.workunit.client.0.smithi090.stderr: -317> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr: -316> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr: -315> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: dump: 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr: -314> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: _finish_auth 0 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr: -313> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: _check_auth_tickets 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr: -312> 2024-03-04T12:46:48.917+0000 7fe5db0c0800 5 monclient: authenticate success, global_id 6203 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr: -311> 2024-03-04T12:46:48.917+0000 7fe5db0c0800 10 monclient: _renew_subs 2024-03-04T12:46:49.252 INFO:tasks.workunit.client.0.smithi090.stderr: -310> 2024-03-04T12:46:48.917+0000 7fe5db0c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr: -309> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr: -308> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr: -307> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr: -306> 2024-03-04T12:46:48.917+0000 7fe4be7fc640 10 monclient: dump: 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr: -305> 2024-03-04T12:46:48.917+0000 7fe5d9bc5640 4 set_mon_vals no callback set 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr: -304> 2024-03-04T12:46:48.917+0000 7fe5db0c0800 10 monclient: _renew_subs 2024-03-04T12:46:49.253 INFO:tasks.workunit.client.0.smithi090.stderr: -303> 2024-03-04T12:46:48.917+0000 7fe5db0c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr: -302> 2024-03-04T12:46:48.919+0000 7fe4be7fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr: -301> 2024-03-04T12:46:48.919+0000 7fe4be7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr: -300> 2024-03-04T12:46:48.919+0000 7fe4be7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr: -299> 2024-03-04T12:46:48.919+0000 7fe5d03c2640 10 monclient: get_auth_request con 0x7fe4b0069de0 auth_method 0 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr: -298> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 10 monclient: get_monmap_and_config 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr: -297> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 10 monclient: build_initial_monmap 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr: -296> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 1 build_initial for_mkfs: 0 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr: -295> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 10 monclient: monmap: 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:49.254 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -294> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding auth protocol: cephx 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -293> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding auth protocol: cephx 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -292> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding auth protocol: cephx 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -291> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: secure 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -290> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: crc 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -289> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: secure 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -288> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: crc 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -287> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: secure 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -286> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: crc 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -285> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: crc 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -284> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: secure 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -283> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: crc 2024-03-04T12:46:49.255 INFO:tasks.workunit.client.0.smithi090.stderr: -282> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: secure 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -281> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: crc 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -280> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546fc0) adding con mode: secure 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -279> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -278> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 10 monclient: init 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -277> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding auth protocol: cephx 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -276> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding auth protocol: cephx 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -275> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding auth protocol: cephx 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -274> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: secure 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -273> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: crc 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -272> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: secure 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -271> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: crc 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -270> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: secure 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -269> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: crc 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -268> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: crc 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -267> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: secure 2024-03-04T12:46:49.256 INFO:tasks.workunit.client.0.smithi090.stderr: -266> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: crc 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -265> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: secure 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -264> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: crc 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -263> 2024-03-04T12:46:48.919+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287afa0) adding con mode: secure 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -262> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -261> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -260> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command rotate-key cmddesc rotate-key hook 0x7ffd1287b0e8 EEXIST 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -259> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -258> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -257> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-c con 0x55f80757b930 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -256> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-b con 0x55f80757bd10 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -255> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-a con 0x55f80756da90 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -254> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -253> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -252> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -251> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -250> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient(hunting): authenticate will time out at 1441.251600s 2024-03-04T12:46:49.257 INFO:tasks.workunit.client.0.smithi090.stderr: -249> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): get_auth_request con 0x55f80757b930 auth_method 0 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -248> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -247> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -246> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -245> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request con 0x55f80756da90 auth_method 0 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -244> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -243> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -242> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -241> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -240> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -239> 2024-03-04T12:46:48.920+0000 7fe5d8bc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -238> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -237> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -236> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -235> 2024-03-04T12:46:48.920+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request con 0x55f80757bd10 auth_method 0 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -234> 2024-03-04T12:46:48.920+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.258 INFO:tasks.workunit.client.0.smithi090.stderr: -233> 2024-03-04T12:46:48.920+0000 7fe5d03c2640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: -232> 2024-03-04T12:46:48.920+0000 7fe5d03c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: -231> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_done global_id 6555 payload 274 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: -230> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient: _finish_hunting 0 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: -229> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 1 monclient: found mon.noname-a 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: -228> 2024-03-04T12:46:48.920+0000 7fe5d93c4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: -227> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: -226> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: -225> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: dump: 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr: -224> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: _finish_auth 0 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr: -223> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: _check_auth_tickets 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr: -222> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr: -221> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr: -220> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr: -219> 2024-03-04T12:46:48.920+0000 7fe4affff640 10 monclient: dump: 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.260 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr: -218> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 5 monclient: authenticate success, global_id 6555 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr: -217> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 10 monclient: get_monmap_and_config success 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr: -216> 2024-03-04T12:46:48.920+0000 7fe5db0c0800 4 set_mon_vals no callback set 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr: -215> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 10 monclient: shutdown 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr: -214> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 10 monclient: build_initial_monmap 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr: -213> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 1 build_initial for_mkfs: 0 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr: -212> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 10 monclient: monmap: 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:46:49.261 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr: -211> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding auth protocol: cephx 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr: -210> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding auth protocol: cephx 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr: -209> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding auth protocol: cephx 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr: -208> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: secure 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr: -207> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: crc 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr: -206> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: secure 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr: -205> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: crc 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr: -204> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: secure 2024-03-04T12:46:49.262 INFO:tasks.workunit.client.0.smithi090.stderr: -203> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: crc 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -202> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: crc 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -201> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: secure 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -200> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: crc 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -199> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: secure 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -198> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: crc 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -197> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f807546f70) adding con mode: secure 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -196> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -195> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 1 librados: starting msgr at 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -194> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 1 librados: starting objecter 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -193> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command objecter_requests cmddesc objecter_requests hook 0x55f807549d50 EEXIST 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -192> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 1 librados: setting wanted keys 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -191> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 1 librados: calling monclient init 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -190> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 10 monclient: init 2024-03-04T12:46:49.263 INFO:tasks.workunit.client.0.smithi090.stderr: -189> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding auth protocol: cephx 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -188> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding auth protocol: cephx 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -187> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding auth protocol: cephx 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -186> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: secure 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -185> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: crc 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -184> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: secure 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -183> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: crc 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -182> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: secure 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -181> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: crc 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -180> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: crc 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -179> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: secure 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -178> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: crc 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -177> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: secure 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -176> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: crc 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -175> 2024-03-04T12:46:48.921+0000 7fe5db0c0800 5 AuthRegistry(0x55f80753ef50) adding con mode: secure 2024-03-04T12:46:49.264 INFO:tasks.workunit.client.0.smithi090.stderr: -174> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -173> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -172> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command rotate-key cmddesc rotate-key hook 0x55f80753f098 EEXIST 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -171> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient: _reopen_session rank -1 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -170> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -169> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-b con 0x55f80756da90 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -168> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-c con 0x55f80757b930 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -167> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): picked mon.noname-a con 0x55f80756fa50 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -166> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -165> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -164> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): start opening mon connection 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -163> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): _renew_subs 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -162> 2024-03-04T12:46:48.922+0000 7fe5db0c0800 10 monclient(hunting): authenticate will time out at 1441.253709s 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -161> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request con 0x55f80756fa50 auth_method 0 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -160> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.265 INFO:tasks.workunit.client.0.smithi090.stderr: -159> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -158> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -157> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request con 0x55f80757b930 auth_method 0 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -156> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -155> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -154> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -153> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -152> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -151> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -150> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -149> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -148> 2024-03-04T12:46:48.922+0000 7fe5d03c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -147> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient(hunting): handle_auth_done global_id 6558 payload 824 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -146> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient: _finish_hunting 0 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -145> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 1 monclient: found mon.noname-a 2024-03-04T12:46:49.266 INFO:tasks.workunit.client.0.smithi090.stderr: -144> 2024-03-04T12:46:48.922+0000 7fe5d93c4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr: -143> 2024-03-04T12:46:48.922+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x55f80756da90 auth_method 0 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr: -142> 2024-03-04T12:46:48.922+0000 7fe4ae7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr: -141> 2024-03-04T12:46:48.922+0000 7fe4ae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr: -140> 2024-03-04T12:46:48.922+0000 7fe4ae7fc640 10 monclient: dump: 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr: -139> 2024-03-04T12:46:48.923+0000 7fe4ae7fc640 10 monclient: _finish_auth 0 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr: -138> 2024-03-04T12:46:48.923+0000 7fe4ae7fc640 10 monclient: _check_auth_tickets 2024-03-04T12:46:49.267 INFO:tasks.workunit.client.0.smithi090.stderr: -137> 2024-03-04T12:46:48.923+0000 7fe4ae7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr: -136> 2024-03-04T12:46:48.923+0000 7fe4ae7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr: -135> 2024-03-04T12:46:48.923+0000 7fe4ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr: -134> 2024-03-04T12:46:48.923+0000 7fe4ae7fc640 10 monclient: dump: 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.268 INFO:tasks.workunit.client.0.smithi090.stderr: -133> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 5 monclient: authenticate success, global_id 6558 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -132> 2024-03-04T12:46:48.923+0000 7fe4affff640 4 set_mon_vals no callback set 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -131> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 10 monclient: _renew_subs 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -130> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -129> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 10 monclient: _renew_subs 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -128> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -127> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 1 librados: init done 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -126> 2024-03-04T12:46:48.923+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command cr dump hook 0x55f80756c618 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -125> 2024-03-04T12:46:48.924+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -124> 2024-03-04T12:46:48.925+0000 7fe4ae7fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -123> 2024-03-04T12:46:48.925+0000 7fe4ae7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -122> 2024-03-04T12:46:48.925+0000 7fe4ae7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -121> 2024-03-04T12:46:48.925+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x7fe4a4069eb0 auth_method 0 2024-03-04T12:46:49.269 INFO:tasks.workunit.client.0.smithi090.stderr: -120> 2024-03-04T12:46:48.925+0000 7fe5d03c2640 10 monclient: get_auth_request con 0x55f807596b90 auth_method 0 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -119> 2024-03-04T12:46:48.925+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -118> 2024-03-04T12:46:48.925+0000 7fe5db0c0800 20 realm 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -117> 2024-03-04T12:46:48.925+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -116> 2024-03-04T12:46:48.926+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -115> 2024-03-04T12:46:48.926+0000 7fe5db0c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -114> 2024-03-04T12:46:48.926+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -113> 2024-03-04T12:46:48.926+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -112> 2024-03-04T12:46:48.926+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -111> 2024-03-04T12:46:48.926+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x55f80759ad20 auth_method 0 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -110> 2024-03-04T12:46:48.927+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -109> 2024-03-04T12:46:48.927+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -108> 2024-03-04T12:46:48.927+0000 7fe5d03c2640 10 monclient: get_auth_request con 0x55f80759e5a0 auth_method 0 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -107> 2024-03-04T12:46:48.927+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:49.270 INFO:tasks.workunit.client.0.smithi090.stderr: -106> 2024-03-04T12:46:48.927+0000 7fe5db0c0800 20 searching for the correct realm 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -105> 2024-03-04T12:46:48.927+0000 7fe5d93c4640 10 monclient: get_auth_request con 0x55f8075a3250 auth_method 0 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -104> 2024-03-04T12:46:48.928+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x7fe5d401f050 auth_method 0 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -103> 2024-03-04T12:46:48.929+0000 7fe5d03c2640 10 monclient: get_auth_request con 0x7fe5c0053030 auth_method 0 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -102> 2024-03-04T12:46:48.930+0000 7fe5d03c2640 0 -- 172.21.15.90:0/91571499 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fe5c0053030 msgr2=0x7fe5c00997a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -101> 2024-03-04T12:46:48.930+0000 7fe4ae7fc640 1 client.6558.objecter ms_handle_reset 0x7fe5c0053030 session 0x7fe5c00c0040 osd.4 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -100> 2024-03-04T12:46:48.930+0000 7fe4ae7fc640 10 monclient: _renew_subs 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -99> 2024-03-04T12:46:48.930+0000 7fe4ae7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -98> 2024-03-04T12:46:48.930+0000 7fe5d03c2640 10 monclient: get_auth_request con 0x7fe4a4079cd0 auth_method 0 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -97> 2024-03-04T12:46:48.931+0000 7fe5d93c4640 10 monclient: get_auth_request con 0x7fe5c00997a0 auth_method 0 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -96> 2024-03-04T12:46:48.933+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x7fe5c009f8a0 auth_method 0 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -95> 2024-03-04T12:46:48.933+0000 7fe5d8bc3640 0 -- 172.21.15.90:0/91571499 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fe5c009f8a0 msgr2=0x7fe5c00ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -94> 2024-03-04T12:46:49.134+0000 7fe5d8bc3640 10 monclient: get_auth_request con 0x7fe5c009f8a0 auth_method 0 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -93> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:49.271 INFO:tasks.workunit.client.0.smithi090.stderr: -92> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:49.272 INFO:tasks.workunit.client.0.smithi090.stderr: -91> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:49.272 INFO:tasks.workunit.client.0.smithi090.stderr: -90> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:49.272 INFO:tasks.workunit.client.0.smithi090.stderr: -89> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:49.272 INFO:tasks.workunit.client.0.smithi090.stderr: -88> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:49.272 INFO:tasks.workunit.client.0.smithi090.stderr: -87> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.272 INFO:tasks.workunit.client.0.smithi090.stderr: -86> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.272 INFO:tasks.workunit.client.0.smithi090.stderr: -85> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.272 INFO:tasks.workunit.client.0.smithi090.stderr: -84> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:49.272 INFO:tasks.workunit.client.0.smithi090.stderr: -83> 2024-03-04T12:46:49.139+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.272 INFO:tasks.workunit.client.0.smithi090.stderr: -82> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:49.272 INFO:tasks.workunit.client.0.smithi090.stderr: -81> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 zone default found 2024-03-04T12:46:49.272 INFO:tasks.workunit.client.0.smithi090.stderr: -80> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 4 Realm: () 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -79> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -78> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -77> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -76> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 zonegroup default 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -75> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -74> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -73> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -72> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -71> 2024-03-04T12:46:49.140+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -70> 2024-03-04T12:46:49.141+0000 7fe5db0c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -69> 2024-03-04T12:46:49.141+0000 7fe5db0c0800 20 started sync module instance, tier type = 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -68> 2024-03-04T12:46:49.141+0000 7fe5db0c0800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -67> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=0 2024-03-04T12:46:49.273 INFO:tasks.workunit.client.0.smithi090.stderr: -66> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=1 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -65> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=2 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -64> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=3 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -63> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=4 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -62> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=5 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -61> 2024-03-04T12:46:49.149+0000 7fe5db0c0800 20 add_watcher() i=6 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -60> 2024-03-04T12:46:49.150+0000 7fe5db0c0800 20 add_watcher() i=7 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -59> 2024-03-04T12:46:49.150+0000 7fe5db0c0800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -58> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding auth protocol: cephx 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -57> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding auth protocol: cephx 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -56> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding auth protocol: cephx 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -55> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: secure 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -54> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: crc 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -53> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: secure 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -52> 2024-03-04T12:46:49.152+0000 7fe48efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:49.274 INFO:tasks.workunit.client.0.smithi090.stderr: -51> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: crc 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -50> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: secure 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -49> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: crc 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -48> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: crc 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -47> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: secure 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -46> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: crc 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -45> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: secure 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -44> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: crc 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -43> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 AuthRegistry(0x7ffd1287b430) adding con mode: secure 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -42> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -41> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -40> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -39> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command cache list hook 0x55f807572b50 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -38> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command cache inspect hook 0x55f807572b50 2024-03-04T12:46:49.275 INFO:tasks.workunit.client.0.smithi090.stderr: -37> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command cache erase hook 0x55f807572b50 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -36> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command cache zap hook 0x55f807572b50 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -35> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 note: GC not initialized 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -34> 2024-03-04T12:46:49.152+0000 7fe48dfe3640 20 reqs_thread_entry: start 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -33> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command sync trace show hook 0x7fe5d400c4f0 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -32> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command sync trace history hook 0x7fe5d400c4f0 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -31> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command sync trace active hook 0x7fe5d400c4f0 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -30> 2024-03-04T12:46:49.152+0000 7fe5db0c0800 5 asok(0x55f80728b0c0) register_command sync trace active_short hook 0x7fe5d400c4f0 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -29> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -28> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 Filter name: none 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -27> 2024-03-04T12:46:49.153+0000 7fe3ff7fe640 20 reqs_thread_entry: start 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -26> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -25> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -24> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -23> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-04T12:46:49.276 INFO:tasks.workunit.client.0.smithi090.stderr: -22> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -21> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 : miss 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -20> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -19> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -18> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -17> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -16> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -15> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -14> 2024-03-04T12:46:49.153+0000 7fe5db0c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -13> 2024-03-04T12:46:49.158+0000 7fe5db0c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -12> 2024-03-04T12:46:49.158+0000 7fe5db0c0800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -11> 2024-03-04T12:46:49.158+0000 7fe5db0c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -10> 2024-03-04T12:46:49.158+0000 7fe5db0c0800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23, ofs0, ns] 2024-03-04T12:46:49.277 INFO:tasks.workunit.client.0.smithi090.stderr: -9> 2024-03-04T12:46:49.158+0000 7fe4af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824071 cookie 94523763640800 notifier 6558 bl.length()=877 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: -8> 2024-03-04T12:46:49.158+0000 7fe4af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: -7> 2024-03-04T12:46:49.158+0000 7fe4af7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: -6> 2024-03-04T12:46:49.158+0000 7fe4af7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: -5> 2024-03-04T12:46:49.159+0000 7fe5db0c0800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): orig_sources= new_sources= 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: -4> 2024-03-04T12:46:49.159+0000 7fe5db0c0800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): potential sources added=[] removed=[] 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: -3> 2024-03-04T12:46:49.159+0000 7fe5db0c0800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): orig_dests= new_dests= 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: -2> 2024-03-04T12:46:49.159+0000 7fe5db0c0800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): potential dests added=[] removed=[] 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: -1> 2024-03-04T12:46:49.159+0000 7fe5db0c0800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe5db0c0800 time 2024-03-04T12:46:49.160037+0000 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe5de580e86] 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fe5de581044] 2024-03-04T12:46:49.278 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8068edeb1] 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55f806901d74] 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: 5: main() 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fe5dd23feb0] 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: 7: __libc_start_main() 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: 8: _start() 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: 0> 2024-03-04T12:46:49.160+0000 7fe5db0c0800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7fe5db0c0800 thread_name:radosgw-admin 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe5dd254db0] 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe5dd2a154c] 2024-03-04T12:46:49.279 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe5de580ee0] 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fe5de581044] 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8068edeb1] 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55f806901d74] 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr: 9: main() 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fe5dd23feb0] 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr: 11: __libc_start_main() 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr: 12: _start() 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr:--- logging levels --- 2024-03-04T12:46:49.280 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 none 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 lockdep 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 context 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 crush 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_balancer 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_locker 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log_expire 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_migrator 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 buffer 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 timer 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 filer 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 striper 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 objecter 2024-03-04T12:46:49.281 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rados 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_mirror 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_replay 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_pwl 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 journaler 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objectcacher 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 client 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 osd 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 optracker 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objclass 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 filestore 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 journal 2024-03-04T12:46:49.282 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 ms 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mon 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 0/10 monc 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 paxos 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 tp 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 auth 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 crypto 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 finisher 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 reserver 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 heartbeatmap 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 perfcounter 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 20/20 rgw 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_sync 2024-03-04T12:46:49.283 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_datacache 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_access 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_flight 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 javaclient 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 asok 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 throttle 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 refs 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 compressor 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluestore 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluefs 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 bdev 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 kstore 2024-03-04T12:46:49.284 INFO:tasks.workunit.client.0.smithi090.stderr: 4/ 5 rocksdb 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 fuse 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 2/ 5 mgr 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mgrc 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 dpdk 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 eventtrace 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 prioritycache 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 test 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephsqlite 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_onode 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_odata 2024-03-04T12:46:49.285 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_omap 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_tm 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_t 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_epm 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_lba 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cache 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_journal 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_device 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_backref 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 alienstore 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mclock 2024-03-04T12:46:49.286 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cyanstore 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 ceph_exporter 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 memstore 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 trace 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr: -2/-2 (syslog threshold) 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr: 99/99 (stderr threshold) 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe3ff7fe640 / http_manager 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe48dfe3640 / http_manager 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe48efe5640 / rgw_dt_lg_renew 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe4ae7fc640 / ms_dispatch 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe4af7fe640 / io_context_pool 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe4affff640 / io_context_pool 2024-03-04T12:46:49.287 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe4be7fc640 / ms_dispatch 2024-03-04T12:46:49.288 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe4c560a640 / ms_dispatch 2024-03-04T12:46:49.288 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe4c6e0d640 / io_context_pool 2024-03-04T12:46:49.288 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe5d03c2640 / msgr-worker-2 2024-03-04T12:46:49.288 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe5d8bc3640 / msgr-worker-1 2024-03-04T12:46:49.288 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe5d93c4640 / msgr-worker-0 2024-03-04T12:46:49.288 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe5d9bc5640 / io_context_pool 2024-03-04T12:46:49.288 INFO:tasks.workunit.client.0.smithi090.stderr: 7fe5db0c0800 / radosgw-admin 2024-03-04T12:46:49.288 INFO:tasks.workunit.client.0.smithi090.stderr: max_recent 500 2024-03-04T12:46:49.288 INFO:tasks.workunit.client.0.smithi090.stderr: max_new 1000 2024-03-04T12:46:49.288 INFO:tasks.workunit.client.0.smithi090.stderr: log_file /var/lib/ceph/crash/2024-03-04T12:46:49.161380Z_edae9b55-a987-407f-b520-94e3f04f7cc9/log 2024-03-04T12:46:49.288 INFO:tasks.workunit.client.0.smithi090.stderr:--- end dump of recent events --- 2024-03-04T12:46:49.288 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.229+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.231+0000 7f0ed4467800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.231+0000 7f0ed4467800 20 realm 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.231+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.231+0000 7f0ed4467800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.231+0000 7f0ed4467800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.231+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.231+0000 7f0ed4467800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.231+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.232+0000 7f0ed4467800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:49.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.232+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.232+0000 7f0ed4467800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:49.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.232+0000 7f0ed4467800 20 searching for the correct realm 2024-03-04T12:46:49.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.235+0000 7f0ed276b640 0 -- 172.21.15.90:0/1219537976 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x5653a7ab5260 msgr2=0x5653a7ab7650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:49.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.239+0000 7f0ed1f6a640 0 -- 172.21.15.90:0/1219537976 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f0ebc067420 msgr2=0x7f0ebc0678a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:49.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.243+0000 7f0ed4467800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:49.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.243+0000 7f0ed4467800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:49.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.243+0000 7f0ed4467800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:49.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.243+0000 7f0ed4467800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:49.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.243+0000 7f0ed4467800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:49.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.243+0000 7f0ed4467800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:49.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.243+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 20 zone default found 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 4 Realm: () 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 20 zonegroup default 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.244+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.297 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.245+0000 7f0ed4467800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.245+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.245+0000 7f0ed4467800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.245+0000 7f0ed4467800 20 started sync module instance, tier type = 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.245+0000 7f0ed4467800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.254+0000 7f0ed4467800 20 add_watcher() i=0 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.254+0000 7f0ed4467800 20 add_watcher() i=1 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.254+0000 7f0ed4467800 20 add_watcher() i=2 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.254+0000 7f0ed4467800 20 add_watcher() i=3 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.254+0000 7f0ed4467800 20 add_watcher() i=4 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.254+0000 7f0ed4467800 20 add_watcher() i=5 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.254+0000 7f0ed4467800 20 add_watcher() i=6 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.255+0000 7f0ed4467800 20 add_watcher() i=7 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.255+0000 7f0ed4467800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:49.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.256+0000 7f0d837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.257+0000 7f0ed4467800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.257+0000 7f0ed4467800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.257+0000 7f0ed4467800 5 note: GC not initialized 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.257+0000 7f0d827fc640 20 reqs_thread_entry: start 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.257+0000 7f0ed4467800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.257+0000 7f0ed4467800 20 Filter name: none 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.257+0000 7f0cf3fff640 20 reqs_thread_entry: start 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.257+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.257+0000 7f0ed4467800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.257+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.258+0000 7f0ed4467800 20 rados_obj.operate() r=0 bl.length=405 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.258+0000 7f0ed4467800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.258+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.258+0000 7f0ed4467800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.258+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.258+0000 7f0ed4467800 20 rados_obj.operate() r=0 bl.length=405 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.258+0000 7f0ed4467800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.259+0000 7f0ed4467800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.260+0000 7f0ed4467800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.260+0000 7f0d837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.262+0000 7f0ed4467800 20 remove_watcher() i=0 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.262+0000 7f0ed4467800 2 removed watcher, disabling cache 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.263+0000 7f0ed4467800 20 remove_watcher() i=1 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.264+0000 7f0ed4467800 20 remove_watcher() i=2 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.265+0000 7f0ed4467800 20 remove_watcher() i=3 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.266+0000 7f0ed4467800 20 remove_watcher() i=4 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.267+0000 7f0ed4467800 20 remove_watcher() i=5 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.268+0000 7f0ed4467800 20 remove_watcher() i=6 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.269+0000 7f0ed4467800 20 remove_watcher() i=7 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.300 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:46:49.301 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: abort-at-block-writes id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:46:49.301 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:46:49.301 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:49.301 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:49.301 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:46:49.301 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:46:49.335 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:46:49.365 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:49.365 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:49.397 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.392+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.393+0000 7f54a4030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.393+0000 7f54a4030800 20 realm 2024-03-04T12:46:49.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.393+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.393+0000 7f54a4030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.393+0000 7f54a4030800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:49.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.393+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.393+0000 7f54a4030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.393+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.394+0000 7f54a4030800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:49.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.394+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.395+0000 7f54a4030800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:49.401 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.395+0000 7f54a4030800 20 searching for the correct realm 2024-03-04T12:46:49.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.397+0000 7f549f28f640 0 -- 172.21.15.90:0/685781247 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f5490088040 msgr2=0x7f5490088420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:49.406 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.400+0000 7f549f28f640 0 -- 172.21.15.90:0/685781247 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f5488016400 msgr2=0x7f5488016880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:49.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 zone default found 2024-03-04T12:46:49.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 4 Realm: () 2024-03-04T12:46:49.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:46:49.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:46:49.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:49.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 zonegroup default 2024-03-04T12:46:49.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.606+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.607+0000 7f54a4030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.607+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.607+0000 7f54a4030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.607+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.608+0000 7f54a4030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:49.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.608+0000 7f54a4030800 20 started sync module instance, tier type = 2024-03-04T12:46:49.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.608+0000 7f54a4030800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:46:49.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.616+0000 7f54a4030800 20 add_watcher() i=0 2024-03-04T12:46:49.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.616+0000 7f54a4030800 20 add_watcher() i=1 2024-03-04T12:46:49.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.616+0000 7f54a4030800 20 add_watcher() i=2 2024-03-04T12:46:49.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.616+0000 7f54a4030800 20 add_watcher() i=3 2024-03-04T12:46:49.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.616+0000 7f54a4030800 20 add_watcher() i=4 2024-03-04T12:46:49.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.616+0000 7f54a4030800 20 add_watcher() i=5 2024-03-04T12:46:49.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.616+0000 7f54a4030800 20 add_watcher() i=6 2024-03-04T12:46:49.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.617+0000 7f54a4030800 20 add_watcher() i=7 2024-03-04T12:46:49.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.617+0000 7f54a4030800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:49.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.619+0000 7f5355fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:49.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.619+0000 7f54a4030800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:49.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.619+0000 7f54a4030800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:49.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.619+0000 7f54a4030800 5 note: GC not initialized 2024-03-04T12:46:49.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.619+0000 7f5354fe1640 20 reqs_thread_entry: start 2024-03-04T12:46:49.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.619+0000 7f54a4030800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:49.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.619+0000 7f54a4030800 20 Filter name: none 2024-03-04T12:46:49.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.619+0000 7f52ce7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:49.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.619+0000 7f54a4030800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-04T12:46:49.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.619+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.620+0000 7f54a4030800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:46:49.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.620+0000 7f54a4030800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-04T12:46:49.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.620+0000 7f54a4030800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-04T12:46:49.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.620+0000 7f54a4030800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 : miss 2024-03-04T12:46:49.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.620+0000 7f54a4030800 20 rados->read ofs=0 len=0 2024-03-04T12:46:49.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.620+0000 7f54a4030800 20 rados_obj.operate() r=0 bl.length=405 2024-03-04T12:46:49.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.620+0000 7f54a4030800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:46:49.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.620+0000 7f54a4030800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:46:49.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.620+0000 7f54a4030800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:49.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.620+0000 7f54a4030800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:46:49.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.620+0000 7f54a4030800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 2024-03-04T12:46:49.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.622+0000 7f54a4030800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to be held by another RGW process; skipping for now 2024-03-04T12:46:49.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.622+0000 7f5355fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:49.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.624+0000 7f54a4030800 20 remove_watcher() i=0 2024-03-04T12:46:49.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.624+0000 7f54a4030800 2 removed watcher, disabling cache 2024-03-04T12:46:49.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.625+0000 7f54a4030800 20 remove_watcher() i=1 2024-03-04T12:46:49.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.626+0000 7f54a4030800 20 remove_watcher() i=2 2024-03-04T12:46:49.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.627+0000 7f54a4030800 20 remove_watcher() i=3 2024-03-04T12:46:49.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.628+0000 7f54a4030800 20 remove_watcher() i=4 2024-03-04T12:46:49.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.629+0000 7f54a4030800 20 remove_watcher() i=5 2024-03-04T12:46:49.636 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.630+0000 7f54a4030800 20 remove_watcher() i=6 2024-03-04T12:46:49.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:46:49.631+0000 7f54a4030800 20 remove_watcher() i=7 2024-03-04T12:46:49.646 INFO:tasks.workunit.client.0.smithi090.stderr:waiting 30 seconds for reshard lock to expire... 2024-03-04T12:47:19.676 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:47:19.710 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:19.711 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:19.748 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.742+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.744+0000 7fd8cb131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.744+0000 7fd8cb131800 20 realm 2024-03-04T12:47:19.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.744+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.744+0000 7fd8cb131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.744+0000 7fd8cb131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:19.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.744+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.744+0000 7fd8cb131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.744+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.751 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.745+0000 7fd8cb131800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:19.751 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.745+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.746+0000 7fd8cb131800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:19.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.746+0000 7fd8cb131800 20 searching for the correct realm 2024-03-04T12:47:19.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.750+0000 7fd8c7632640 0 -- 172.21.15.90:0/896560944 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x5559897d2010 msgr2=0x5559897d4490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:19.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.753+0000 7fd8be630640 0 -- 172.21.15.90:0/896560944 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fd8b001b040 msgr2=0x7fd8b005f3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:19.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.758+0000 7fd8cb131800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:19.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.758+0000 7fd8cb131800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:19.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.758+0000 7fd8cb131800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:19.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.758+0000 7fd8cb131800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:19.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.758+0000 7fd8cb131800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:19.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.758+0000 7fd8cb131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:19.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.758+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.758+0000 7fd8cb131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.758+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.758+0000 7fd8cb131800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:19.765 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.758+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.759+0000 7fd8cb131800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:19.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.759+0000 7fd8cb131800 20 zone default found 2024-03-04T12:47:19.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.759+0000 7fd8cb131800 4 Realm: () 2024-03-04T12:47:19.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.759+0000 7fd8cb131800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:19.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.759+0000 7fd8cb131800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:19.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.759+0000 7fd8cb131800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:19.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.759+0000 7fd8cb131800 20 zonegroup default 2024-03-04T12:47:19.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.759+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.759+0000 7fd8cb131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.766 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.759+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.759+0000 7fd8cb131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.759+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.760+0000 7fd8cb131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.760+0000 7fd8cb131800 20 started sync module instance, tier type = 2024-03-04T12:47:19.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.760+0000 7fd8cb131800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:19.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.769+0000 7fd8cb131800 20 add_watcher() i=0 2024-03-04T12:47:19.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.769+0000 7fd8cb131800 20 add_watcher() i=1 2024-03-04T12:47:19.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.769+0000 7fd8cb131800 20 add_watcher() i=2 2024-03-04T12:47:19.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.769+0000 7fd8cb131800 20 add_watcher() i=3 2024-03-04T12:47:19.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.769+0000 7fd8cb131800 20 add_watcher() i=4 2024-03-04T12:47:19.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.769+0000 7fd8cb131800 20 add_watcher() i=5 2024-03-04T12:47:19.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.769+0000 7fd8cb131800 20 add_watcher() i=6 2024-03-04T12:47:19.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.770+0000 7fd8cb131800 20 add_watcher() i=7 2024-03-04T12:47:19.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.770+0000 7fd8cb131800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:19.778 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.772+0000 7fd77d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:19.779 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.772+0000 7fd8cb131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.772+0000 7fd8cb131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.772+0000 7fd8cb131800 5 note: GC not initialized 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.773+0000 7fd6f7fff640 20 reqs_thread_entry: start 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.773+0000 7fd8cb131800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.773+0000 7fd8cb131800 20 Filter name: none 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.773+0000 7fd6f5ffb640 20 reqs_thread_entry: start 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.773+0000 7fd8cb131800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.773+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.773+0000 7fd8cb131800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.773+0000 7fd8cb131800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.773+0000 7fd8cb131800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.773+0000 7fd8cb131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 : miss 2024-03-04T12:47:19.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.773+0000 7fd8cb131800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.774+0000 7fd8cb131800 20 rados_obj.operate() r=0 bl.length=405 2024-03-04T12:47:19.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.774+0000 7fd8cb131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:47:19.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.774+0000 7fd8cb131800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:47:19.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.774+0000 7fd8cb131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:19.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.774+0000 7fd8cb131800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:19.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.774+0000 7fd8cb131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 2024-03-04T12:47:19.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.775+0000 7fd8cb131800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-03-04T12:47:19.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.784+0000 7fd8cb131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:47:19.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.784+0000 7fd8cb131800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:47:19.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.784+0000 7fd8cb131800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:19.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.784+0000 7fd8cb131800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23, ofs0, ns] 2024-03-04T12:47:19.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.784+0000 7fd7aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824072 cookie 93843047209376 notifier 6615 bl.length()=877 2024-03-04T12:47:19.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.784+0000 7fd7aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:47:19.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.784+0000 7fd7aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:47:19.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.784+0000 7fd7aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:19.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.785+0000 7fd8cb131800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): orig_sources= new_sources= 2024-03-04T12:47:19.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.785+0000 7fd8cb131800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): potential sources added=[] removed=[] 2024-03-04T12:47:19.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.785+0000 7fd8cb131800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): orig_dests= new_dests= 2024-03-04T12:47:19.791 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.785+0000 7fd8cb131800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): potential dests added=[] removed=[] 2024-03-04T12:47:19.793 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.0 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.0 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.1 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.1 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.2 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.2 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.3 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.3 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.4 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.4 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.5 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.5 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.6 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.6 2024-03-04T12:47:19.794 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.7 2024-03-04T12:47:19.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.7 2024-03-04T12:47:19.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.8 2024-03-04T12:47:19.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.8 2024-03-04T12:47:19.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.9 2024-03-04T12:47:19.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.9 2024-03-04T12:47:19.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.787+0000 7fd8cb131800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.10 2024-03-04T12:47:19.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.788+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.10 2024-03-04T12:47:19.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.788+0000 7fd8cb131800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.11 2024-03-04T12:47:19.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.788+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2.11 2024-03-04T12:47:19.795 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.788+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.0 2024-03-04T12:47:19.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.788+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.1 2024-03-04T12:47:19.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.789+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.2 2024-03-04T12:47:19.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.789+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.3 2024-03-04T12:47:19.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.789+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.4 2024-03-04T12:47:19.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.790+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.5 2024-03-04T12:47:19.797 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.791+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.6 2024-03-04T12:47:19.797 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.791+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.7 2024-03-04T12:47:19.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.792+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.8 2024-03-04T12:47:19.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.792+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.9 2024-03-04T12:47:19.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.793+0000 7fd8cb131800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23.10 2024-03-04T12:47:19.802 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.796+0000 7fd8cb131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 : hit (requested=0x17, cached=0x17) 2024-03-04T12:47:19.802 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.796+0000 7fd8cb131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 2024-03-04T12:47:19.803 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.797+0000 7fd8cb131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:47:19.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.797+0000 7fd8cb131800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:47:19.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.797+0000 7fd8cb131800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:19.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.797+0000 7fd8cb131800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23, ofs0, ns] 2024-03-04T12:47:19.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.798+0000 7fd7a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824073 cookie 93843047209376 notifier 6615 bl.length()=845 2024-03-04T12:47:19.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.798+0000 7fd7a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 info.flags=0x17 2024-03-04T12:47:19.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.798+0000 7fd7a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 to cache LRU end 2024-03-04T12:47:19.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.798+0000 7fd7a9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:19.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.798+0000 7fd8cb131800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): orig_sources= new_sources= 2024-03-04T12:47:19.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.798+0000 7fd8cb131800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): potential sources added=[] removed=[] 2024-03-04T12:47:19.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.798+0000 7fd8cb131800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): orig_dests= new_dests= 2024-03-04T12:47:19.805 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.798+0000 7fd8cb131800 20 handle_bi_update(): bucket=:abort-at-block-writes[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23]): potential dests added=[] removed=[] 2024-03-04T12:47:19.806 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.800+0000 7fd8cb131800 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2024-03-04T12:47:19.808 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.802+0000 7fd77d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:19.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.804+0000 7fd8cb131800 20 remove_watcher() i=0 2024-03-04T12:47:19.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.804+0000 7fd8cb131800 2 removed watcher, disabling cache 2024-03-04T12:47:19.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.805+0000 7fd8cb131800 20 remove_watcher() i=1 2024-03-04T12:47:19.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.806+0000 7fd8cb131800 20 remove_watcher() i=2 2024-03-04T12:47:19.813 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.807+0000 7fd8cb131800 20 remove_watcher() i=3 2024-03-04T12:47:19.814 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.808+0000 7fd8cb131800 20 remove_watcher() i=4 2024-03-04T12:47:19.815 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.809+0000 7fd8cb131800 20 remove_watcher() i=5 2024-03-04T12:47:19.816 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.810+0000 7fd8cb131800 20 remove_watcher() i=6 2024-03-04T12:47:19.817 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.811+0000 7fd8cb131800 20 remove_watcher() i=7 2024-03-04T12:47:19.828 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-04T12:47:19.856 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:19.856 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:19.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.883+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.884+0000 7fa50fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.884+0000 7fa50fa10800 20 realm 2024-03-04T12:47:19.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.884+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.884+0000 7fa50fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.884+0000 7fa50fa10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:19.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.884+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.884+0000 7fa50fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.891 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.884+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.891 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.885+0000 7fa50fa10800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:19.891 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.885+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.891 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.886+0000 7fa50fa10800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:19.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.886+0000 7fa50fa10800 20 searching for the correct realm 2024-03-04T12:47:19.895 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.889+0000 7fa50b7f1640 0 -- 172.21.15.90:0/1337327361 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x55cd59e44200 msgr2=0x55cd59e46620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:47:19.898 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.893+0000 7fa50aff0640 0 -- 172.21.15.90:0/1337327361 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fa4f4060830 msgr2=0x7fa4f407f2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:19.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:19.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:19.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:19.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:19.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:19.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:19.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.903 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 zone default found 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 4 Realm: () 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 zonegroup default 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.897+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.898+0000 7fa50fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.898+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.898+0000 7fa50fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.898+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.898+0000 7fa50fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.898+0000 7fa50fa10800 20 started sync module instance, tier type = 2024-03-04T12:47:19.906 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.898+0000 7fa50fa10800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:19.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.907+0000 7fa50fa10800 20 add_watcher() i=0 2024-03-04T12:47:19.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.907+0000 7fa50fa10800 20 add_watcher() i=1 2024-03-04T12:47:19.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.907+0000 7fa50fa10800 20 add_watcher() i=2 2024-03-04T12:47:19.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.907+0000 7fa50fa10800 20 add_watcher() i=3 2024-03-04T12:47:19.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.907+0000 7fa50fa10800 20 add_watcher() i=4 2024-03-04T12:47:19.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.907+0000 7fa50fa10800 20 add_watcher() i=5 2024-03-04T12:47:19.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.907+0000 7fa50fa10800 20 add_watcher() i=6 2024-03-04T12:47:19.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.908+0000 7fa50fa10800 20 add_watcher() i=7 2024-03-04T12:47:19.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.908+0000 7fa50fa10800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:19.916 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.910+0000 7fa3c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:19.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.910+0000 7fa50fa10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:19.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.910+0000 7fa50fa10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:19.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.910+0000 7fa50fa10800 5 note: GC not initialized 2024-03-04T12:47:19.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.910+0000 7fa33bfff640 20 reqs_thread_entry: start 2024-03-04T12:47:19.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.910+0000 7fa50fa10800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:19.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.911+0000 7fa50fa10800 20 Filter name: none 2024-03-04T12:47:19.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.911+0000 7fa339ffb640 20 reqs_thread_entry: start 2024-03-04T12:47:19.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.911+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.911+0000 7fa50fa10800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:47:19.917 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.911+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.918 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.912+0000 7fa50fa10800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:47:19.918 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.912+0000 7fa50fa10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:19.918 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.912+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.918 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.912+0000 7fa50fa10800 20 rados_obj.operate() r=0 bl.length=189 2024-03-04T12:47:19.918 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.912+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.919 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.912+0000 7fa50fa10800 20 rados_obj.operate() r=0 bl.length=373 2024-03-04T12:47:19.919 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.912+0000 7fa50fa10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:19.919 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.913+0000 7fa50fa10800 20 rados->read ofs=0 len=0 2024-03-04T12:47:19.919 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.913+0000 7fa50fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:19.919 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.914+0000 7fa3c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:19.921 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.916+0000 7fa50fa10800 20 remove_watcher() i=0 2024-03-04T12:47:19.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.916+0000 7fa50fa10800 2 removed watcher, disabling cache 2024-03-04T12:47:19.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.917+0000 7fa50fa10800 20 remove_watcher() i=1 2024-03-04T12:47:19.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.918+0000 7fa50fa10800 20 remove_watcher() i=2 2024-03-04T12:47:19.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.919+0000 7fa50fa10800 20 remove_watcher() i=3 2024-03-04T12:47:19.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.920+0000 7fa50fa10800 20 remove_watcher() i=4 2024-03-04T12:47:19.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.921+0000 7fa50fa10800 20 remove_watcher() i=5 2024-03-04T12:47:19.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.922+0000 7fa50fa10800 20 remove_watcher() i=6 2024-03-04T12:47:19.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:19.922+0000 7fa50fa10800 20 remove_watcher() i=7 2024-03-04T12:47:19.938 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:19.938 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:19.938 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: abort-at-block-writes id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:47:19.938 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:19.940 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:19.940 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:19.943 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:19.943 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:19.986 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:19.986 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.012 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-03-04T12:47:20.012 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:20.014 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.014 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.025 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.025 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.068 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.068 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.075 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.075 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.082 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.083 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.090 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.090 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.097 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.097 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.104 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.105 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.112 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.112 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.119 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.119 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.127 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.127 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.135 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.135 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.143 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.143 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.150 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.150 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.157 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.157 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.163 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.164 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.170 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.170 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.178 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.178 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.185 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.185 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.192 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.192 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.199 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.200 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.207 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.207 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.215 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-04T12:47:20.242 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:20.242 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:20.275 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.269+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.270+0000 7f433812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.270+0000 7f433812d800 20 realm 2024-03-04T12:47:20.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.270+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.270+0000 7f433812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.270+0000 7f433812d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:20.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.270+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.271+0000 7f433812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.271+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.271+0000 7f433812d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:20.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.271+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.272+0000 7f433812d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:20.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.272+0000 7f433812d800 20 searching for the correct realm 2024-03-04T12:47:20.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.274+0000 7f432bfff640 0 -- 172.21.15.90:0/944709470 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f431c068070 msgr2=0x7f431c099000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:20.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.479+0000 7f4333e64640 0 -- 172.21.15.90:0/944709470 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f431c0d3b70 msgr2=0x7f431c0c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:47:20.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:20.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:20.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:20.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:20.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:20.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:20.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:20.693 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 zone default found 2024-03-04T12:47:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 4 Realm: () 2024-03-04T12:47:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 zonegroup default 2024-03-04T12:47:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.686+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.687+0000 7f433812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.687+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.687+0000 7f433812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.694 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.687+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.687+0000 7f433812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.687+0000 7f433812d800 20 started sync module instance, tier type = 2024-03-04T12:47:20.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.687+0000 7f433812d800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:20.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.696+0000 7f433812d800 20 add_watcher() i=0 2024-03-04T12:47:20.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.696+0000 7f433812d800 20 add_watcher() i=1 2024-03-04T12:47:20.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.696+0000 7f433812d800 20 add_watcher() i=2 2024-03-04T12:47:20.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.696+0000 7f433812d800 20 add_watcher() i=3 2024-03-04T12:47:20.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.696+0000 7f433812d800 20 add_watcher() i=4 2024-03-04T12:47:20.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.696+0000 7f433812d800 20 add_watcher() i=5 2024-03-04T12:47:20.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.696+0000 7f433812d800 20 add_watcher() i=6 2024-03-04T12:47:20.702 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.697+0000 7f433812d800 20 add_watcher() i=7 2024-03-04T12:47:20.703 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.697+0000 7f433812d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:20.704 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.698+0000 7f41e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:20.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.699+0000 7f433812d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:20.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.699+0000 7f433812d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:20.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.699+0000 7f433812d800 5 note: GC not initialized 2024-03-04T12:47:20.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.699+0000 7f41e8fe1640 20 reqs_thread_entry: start 2024-03-04T12:47:20.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.699+0000 7f433812d800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:20.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.699+0000 7f433812d800 20 Filter name: none 2024-03-04T12:47:20.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.699+0000 7f41627fc640 20 reqs_thread_entry: start 2024-03-04T12:47:20.705 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.699+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.706 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.700+0000 7f433812d800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:20.706 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.700+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.701+0000 7f433812d800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:20.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.701+0000 7f433812d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:20.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.701+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.701+0000 7f433812d800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:20.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.701+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.701+0000 7f433812d800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:20.707 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.701+0000 7f433812d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:20.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.702+0000 7f433812d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.703+0000 7f433812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.709 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.703+0000 7f41e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:20.712 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.706+0000 7f433812d800 20 remove_watcher() i=0 2024-03-04T12:47:20.712 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.706+0000 7f433812d800 2 removed watcher, disabling cache 2024-03-04T12:47:20.712 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.707+0000 7f433812d800 20 remove_watcher() i=1 2024-03-04T12:47:20.714 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.708+0000 7f433812d800 20 remove_watcher() i=2 2024-03-04T12:47:20.715 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.709+0000 7f433812d800 20 remove_watcher() i=3 2024-03-04T12:47:20.716 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.711+0000 7f433812d800 20 remove_watcher() i=4 2024-03-04T12:47:20.717 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.712+0000 7f433812d800 20 remove_watcher() i=5 2024-03-04T12:47:20.718 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.713+0000 7f433812d800 20 remove_watcher() i=6 2024-03-04T12:47:20.719 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.713+0000 7f433812d800 20 remove_watcher() i=7 2024-03-04T12:47:20.729 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:20.729 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:20.729 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-commit-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:47:20.729 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:20.730 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-03-04T12:47:20.762 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:20.763 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:20.796 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.790+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.792+0000 7ff68612d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.792+0000 7ff68612d800 20 realm 2024-03-04T12:47:20.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.792+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.792+0000 7ff68612d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.792+0000 7ff68612d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:20.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.792+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.792+0000 7ff68612d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.798 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.792+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.793+0000 7ff68612d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:20.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.793+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.793+0000 7ff68612d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:20.799 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.793+0000 7ff68612d800 20 searching for the correct realm 2024-03-04T12:47:20.801 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.795+0000 7ff679579640 0 -- 172.21.15.90:0/1760274470 >> [v2:172.21.15.90:6817/137526376,v1:172.21.15.90:6819/137526376] conn(0x55ecda029ca0 msgr2=0x55ecda02c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:20.804 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.798+0000 7ff681d7a640 0 -- 172.21.15.90:0/1760274470 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7ff67c037030 msgr2=0x7ff67c05c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:20.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.803+0000 7ff68612d800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:20.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.803+0000 7ff68612d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:20.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.803+0000 7ff68612d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:20.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.803+0000 7ff68612d800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:20.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.803+0000 7ff68612d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:20.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.803+0000 7ff68612d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:20.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.803+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.803+0000 7ff68612d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.803+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.810 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:20.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:20.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 20 zone default found 2024-03-04T12:47:20.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 4 Realm: () 2024-03-04T12:47:20.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:20.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:20.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:20.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 20 zonegroup default 2024-03-04T12:47:20.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.811 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.804+0000 7ff68612d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.805+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.805+0000 7ff68612d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.805+0000 7ff68612d800 20 started sync module instance, tier type = 2024-03-04T12:47:20.812 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.805+0000 7ff68612d800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:20.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.813+0000 7ff68612d800 20 add_watcher() i=0 2024-03-04T12:47:20.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.813+0000 7ff68612d800 20 add_watcher() i=1 2024-03-04T12:47:20.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.813+0000 7ff68612d800 20 add_watcher() i=2 2024-03-04T12:47:20.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.813+0000 7ff68612d800 20 add_watcher() i=3 2024-03-04T12:47:20.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.813+0000 7ff68612d800 20 add_watcher() i=4 2024-03-04T12:47:20.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.813+0000 7ff68612d800 20 add_watcher() i=5 2024-03-04T12:47:20.819 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.813+0000 7ff68612d800 20 add_watcher() i=6 2024-03-04T12:47:20.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.814+0000 7ff68612d800 20 add_watcher() i=7 2024-03-04T12:47:20.820 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.814+0000 7ff68612d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:20.822 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.816+0000 7ff5337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:20.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.816+0000 7ff68612d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:20.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.816+0000 7ff68612d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:20.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.816+0000 7ff68612d800 5 note: GC not initialized 2024-03-04T12:47:20.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.817+0000 7ff5327fc640 20 reqs_thread_entry: start 2024-03-04T12:47:20.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.817+0000 7ff68612d800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:20.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.817+0000 7ff68612d800 20 Filter name: none 2024-03-04T12:47:20.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.817+0000 7ff4a3fff640 20 reqs_thread_entry: start 2024-03-04T12:47:20.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.817+0000 7ff68612d800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-04T12:47:20.823 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.817+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.817+0000 7ff68612d800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:20.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.817+0000 7ff68612d800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-04T12:47:20.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.817+0000 7ff68612d800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-04T12:47:20.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.817+0000 7ff68612d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 : miss 2024-03-04T12:47:20.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.817+0000 7ff68612d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.818+0000 7ff68612d800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:20.824 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.818+0000 7ff68612d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 info.flags=0x17 2024-03-04T12:47:20.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.818+0000 7ff68612d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 to cache LRU end 2024-03-04T12:47:20.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.818+0000 7ff68612d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:20.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.818+0000 7ff68612d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:20.825 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.818+0000 7ff68612d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 2024-03-04T12:47:20.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.823+0000 7ff68612d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 info.flags=0x17 2024-03-04T12:47:20.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.823+0000 7ff68612d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 to cache LRU end 2024-03-04T12:47:20.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.823+0000 7ff68612d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:20.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.823+0000 7ff68612d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24, ofs0, ns] 2024-03-04T12:47:20.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.823+0000 7ff5657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824028 cookie 94475758284464 notifier 6675 bl.length()=893 2024-03-04T12:47:20.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.823+0000 7ff5657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 info.flags=0x17 2024-03-04T12:47:20.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.823+0000 7ff5657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 to cache LRU end 2024-03-04T12:47:20.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.823+0000 7ff5657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:20.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.823+0000 7ff68612d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24]): orig_sources= new_sources= 2024-03-04T12:47:20.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.823+0000 7ff68612d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24]): potential sources added=[] removed=[] 2024-03-04T12:47:20.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.823+0000 7ff68612d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24]): orig_dests= new_dests= 2024-03-04T12:47:20.830 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.823+0000 7ff68612d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24]): potential dests added=[] removed=[] 2024-03-04T12:47:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.0 2024-03-04T12:47:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.0 2024-03-04T12:47:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.1 2024-03-04T12:47:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.1 2024-03-04T12:47:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.2 2024-03-04T12:47:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.2 2024-03-04T12:47:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.3 2024-03-04T12:47:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.3 2024-03-04T12:47:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.4 2024-03-04T12:47:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.4 2024-03-04T12:47:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.5 2024-03-04T12:47:20.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.5 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.6 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.6 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.7 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.7 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.8 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.8 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.9 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.9 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.10 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.10 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.11 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1.11 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.825+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.0 2024-03-04T12:47:20.833 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.826+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1 2024-03-04T12:47:20.834 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.826+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2 2024-03-04T12:47:20.834 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.827+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.3 2024-03-04T12:47:20.834 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.828+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.4 2024-03-04T12:47:20.834 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.828+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.5 2024-03-04T12:47:20.834 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.828+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.6 2024-03-04T12:47:20.835 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.829+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.7 2024-03-04T12:47:20.835 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.829+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.8 2024-03-04T12:47:20.835 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.830+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.9 2024-03-04T12:47:20.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.830+0000 7ff68612d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.10 2024-03-04T12:47:20.839 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.833+0000 7ff68612d800 -1 Injecting error=-5 at location=commit_target_layout 2024-03-04T12:47:20.839 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.833+0000 7ff68612d800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-03-04T12:47:20.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.837+0000 7ff5337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:20.845 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.839+0000 7ff68612d800 20 remove_watcher() i=0 2024-03-04T12:47:20.845 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.839+0000 7ff68612d800 2 removed watcher, disabling cache 2024-03-04T12:47:20.846 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.840+0000 7ff68612d800 20 remove_watcher() i=1 2024-03-04T12:47:20.847 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.841+0000 7ff68612d800 20 remove_watcher() i=2 2024-03-04T12:47:20.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.842+0000 7ff68612d800 20 remove_watcher() i=3 2024-03-04T12:47:20.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.843+0000 7ff68612d800 20 remove_watcher() i=4 2024-03-04T12:47:20.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.844+0000 7ff68612d800 20 remove_watcher() i=5 2024-03-04T12:47:20.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.845+0000 7ff68612d800 20 remove_watcher() i=6 2024-03-04T12:47:20.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.846+0000 7ff68612d800 20 remove_watcher() i=7 2024-03-04T12:47:20.863 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-04T12:47:20.890 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:20.890 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:20.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.917+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.919+0000 7f18d891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.919+0000 7f18d891f800 20 realm 2024-03-04T12:47:20.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.919+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.919+0000 7f18d891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.919+0000 7f18d891f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:20.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.919+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.919+0000 7f18d891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.919+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.920+0000 7f18d891f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:20.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.920+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.920+0000 7f18d891f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:20.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.920+0000 7f18d891f800 20 searching for the correct realm 2024-03-04T12:47:20.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.923+0000 7f18d467a640 0 -- 172.21.15.90:0/2938556126 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f18cc076040 msgr2=0x7f18cc05f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:20.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.926+0000 7f18d467a640 0 -- 172.21.15.90:0/2938556126 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f18bc003c30 msgr2=0x7f18bc00c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:20.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:20.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:20.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:20.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:20.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:20.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:20.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:20.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 zone default found 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 4 Realm: () 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.931+0000 7f18d891f800 20 zonegroup default 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.932+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.932+0000 7f18d891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.932+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.932+0000 7f18d891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.932+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.932+0000 7f18d891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.932+0000 7f18d891f800 20 started sync module instance, tier type = 2024-03-04T12:47:20.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.932+0000 7f18d891f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:20.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.941+0000 7f18d891f800 20 add_watcher() i=0 2024-03-04T12:47:20.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.941+0000 7f18d891f800 20 add_watcher() i=1 2024-03-04T12:47:20.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.941+0000 7f18d891f800 20 add_watcher() i=2 2024-03-04T12:47:20.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.941+0000 7f18d891f800 20 add_watcher() i=3 2024-03-04T12:47:20.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.941+0000 7f18d891f800 20 add_watcher() i=4 2024-03-04T12:47:20.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.941+0000 7f18d891f800 20 add_watcher() i=5 2024-03-04T12:47:20.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.941+0000 7f18d891f800 20 add_watcher() i=6 2024-03-04T12:47:20.948 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.942+0000 7f18d891f800 20 add_watcher() i=7 2024-03-04T12:47:20.948 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.942+0000 7f18d891f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:20.949 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.944+0000 7f178afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:20.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.944+0000 7f18d891f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:20.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.944+0000 7f18d891f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:20.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.944+0000 7f18d891f800 5 note: GC not initialized 2024-03-04T12:47:20.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.944+0000 7f1789fdb640 20 reqs_thread_entry: start 2024-03-04T12:47:20.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.944+0000 7f18d891f800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:20.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.944+0000 7f18d891f800 20 Filter name: none 2024-03-04T12:47:20.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.944+0000 7f16fb7fe640 20 reqs_thread_entry: start 2024-03-04T12:47:20.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.944+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.945+0000 7f18d891f800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:20.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.945+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.945+0000 7f18d891f800 20 rados_obj.operate() r=0 bl.length=413 2024-03-04T12:47:20.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.945+0000 7f18d891f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:20.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.945+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.946+0000 7f18d891f800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:20.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.946+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.952 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.946+0000 7f18d891f800 20 rados_obj.operate() r=0 bl.length=413 2024-03-04T12:47:20.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.946+0000 7f18d891f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:20.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.947+0000 7f18d891f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:20.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.948+0000 7f18d891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:20.954 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.948+0000 7f178afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:20.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.950+0000 7f18d891f800 20 remove_watcher() i=0 2024-03-04T12:47:20.956 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.950+0000 7f18d891f800 2 removed watcher, disabling cache 2024-03-04T12:47:20.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.952+0000 7f18d891f800 20 remove_watcher() i=1 2024-03-04T12:47:20.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.953+0000 7f18d891f800 20 remove_watcher() i=2 2024-03-04T12:47:20.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.954+0000 7f18d891f800 20 remove_watcher() i=3 2024-03-04T12:47:20.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.955+0000 7f18d891f800 20 remove_watcher() i=4 2024-03-04T12:47:20.961 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.956+0000 7f18d891f800 20 remove_watcher() i=5 2024-03-04T12:47:20.962 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.956+0000 7f18d891f800 20 remove_watcher() i=6 2024-03-04T12:47:20.963 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:20.957+0000 7f18d891f800 20 remove_watcher() i=7 2024-03-04T12:47:20.973 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:20.973 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:20.973 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-commit-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:47:20.973 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:20.974 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.975 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:20.982 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:20.982 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.024 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:47:21.057 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:21.057 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:21.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.082+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.083+0000 7fa8fdd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.083+0000 7fa8fdd30800 20 realm 2024-03-04T12:47:21.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.083+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.083+0000 7fa8fdd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.083+0000 7fa8fdd30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:21.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.083+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.083+0000 7fa8fdd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.083+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.084+0000 7fa8fdd30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:21.090 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.084+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.085+0000 7fa8fdd30800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:21.091 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.085+0000 7fa8fdd30800 20 searching for the correct realm 2024-03-04T12:47:21.093 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.088+0000 7fa8f9aef640 0 -- 172.21.15.90:0/671099114 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7fa8ec0735b0 msgr2=0x7fa8ec065f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:21.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.091+0000 7fa8f9aef640 0 -- 172.21.15.90:0/671099114 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fa8f0052020 msgr2=0x7fa8f0098c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:21.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.095+0000 7fa8fdd30800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:21.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.095+0000 7fa8fdd30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:21.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.095+0000 7fa8fdd30800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:21.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.095+0000 7fa8fdd30800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:21.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.095+0000 7fa8fdd30800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.095+0000 7fa8fdd30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 20 zone default found 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 4 Realm: () 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:21.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 20 zonegroup default 2024-03-04T12:47:21.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.096+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.097+0000 7fa8fdd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.097+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.097+0000 7fa8fdd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.097+0000 7fa8fdd30800 20 started sync module instance, tier type = 2024-03-04T12:47:21.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.097+0000 7fa8fdd30800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:21.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.106+0000 7fa8fdd30800 20 add_watcher() i=0 2024-03-04T12:47:21.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.106+0000 7fa8fdd30800 20 add_watcher() i=1 2024-03-04T12:47:21.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.106+0000 7fa8fdd30800 20 add_watcher() i=2 2024-03-04T12:47:21.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.106+0000 7fa8fdd30800 20 add_watcher() i=3 2024-03-04T12:47:21.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.106+0000 7fa8fdd30800 20 add_watcher() i=4 2024-03-04T12:47:21.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.106+0000 7fa8fdd30800 20 add_watcher() i=5 2024-03-04T12:47:21.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.106+0000 7fa8fdd30800 20 add_watcher() i=6 2024-03-04T12:47:21.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.107+0000 7fa8fdd30800 20 add_watcher() i=7 2024-03-04T12:47:21.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.107+0000 7fa8fdd30800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:21.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.108+0000 7fa7a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:21.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.109+0000 7fa8fdd30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:21.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.109+0000 7fa8fdd30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:21.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.109+0000 7fa8fdd30800 5 note: GC not initialized 2024-03-04T12:47:21.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.109+0000 7fa7a27fc640 20 reqs_thread_entry: start 2024-03-04T12:47:21.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.109+0000 7fa8fdd30800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:21.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.109+0000 7fa8fdd30800 20 Filter name: none 2024-03-04T12:47:21.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.109+0000 7fa71bfff640 20 reqs_thread_entry: start 2024-03-04T12:47:21.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.109+0000 7fa8fdd30800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-04T12:47:21.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.109+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.110+0000 7fa8fdd30800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:21.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.110+0000 7fa8fdd30800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-04T12:47:21.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.110+0000 7fa8fdd30800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-04T12:47:21.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.110+0000 7fa8fdd30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 : miss 2024-03-04T12:47:21.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.110+0000 7fa8fdd30800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.110+0000 7fa8fdd30800 20 rados_obj.operate() r=0 bl.length=413 2024-03-04T12:47:21.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.110+0000 7fa8fdd30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 info.flags=0x17 2024-03-04T12:47:21.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.110+0000 7fa8fdd30800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 to cache LRU end 2024-03-04T12:47:21.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.110+0000 7fa8fdd30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:21.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.110+0000 7fa8fdd30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:21.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.110+0000 7fa8fdd30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 2024-03-04T12:47:21.117 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.111+0000 7fa8fdd30800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-03-04T12:47:21.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.117+0000 7fa8fdd30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 info.flags=0x17 2024-03-04T12:47:21.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.117+0000 7fa8fdd30800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 to cache LRU end 2024-03-04T12:47:21.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.117+0000 7fa8fdd30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:21.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.117+0000 7fa8fdd30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24, ofs0, ns] 2024-03-04T12:47:21.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.117+0000 7fa7dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824029 cookie 94121146344368 notifier 6708 bl.length()=893 2024-03-04T12:47:21.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.117+0000 7fa7dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 info.flags=0x17 2024-03-04T12:47:21.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.117+0000 7fa7dcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 to cache LRU end 2024-03-04T12:47:21.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.117+0000 7fa7dcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:21.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.117+0000 7fa8fdd30800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24]): orig_sources= new_sources= 2024-03-04T12:47:21.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.117+0000 7fa8fdd30800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24]): potential sources added=[] removed=[] 2024-03-04T12:47:21.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.117+0000 7fa8fdd30800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24]): orig_dests= new_dests= 2024-03-04T12:47:21.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.117+0000 7fa8fdd30800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24]): potential dests added=[] removed=[] 2024-03-04T12:47:21.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.119+0000 7fa8fdd30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.0 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.0 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.1 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.1 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.2 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.2 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.3 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.3 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.4 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.4 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.5 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.5 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.6 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.6 2024-03-04T12:47:21.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.7 2024-03-04T12:47:21.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.7 2024-03-04T12:47:21.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.8 2024-03-04T12:47:21.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.8 2024-03-04T12:47:21.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.9 2024-03-04T12:47:21.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.9 2024-03-04T12:47:21.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.10 2024-03-04T12:47:21.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.10 2024-03-04T12:47:21.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.11 2024-03-04T12:47:21.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2.11 2024-03-04T12:47:21.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.0 2024-03-04T12:47:21.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.1 2024-03-04T12:47:21.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.120+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.2 2024-03-04T12:47:21.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.121+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.3 2024-03-04T12:47:21.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.121+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.4 2024-03-04T12:47:21.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.122+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.5 2024-03-04T12:47:21.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.122+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.6 2024-03-04T12:47:21.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.123+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.7 2024-03-04T12:47:21.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.123+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.8 2024-03-04T12:47:21.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.123+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.9 2024-03-04T12:47:21.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.124+0000 7fa8fdd30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24.10 2024-03-04T12:47:21.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.126+0000 7fa8fdd30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 : hit (requested=0x17, cached=0x17) 2024-03-04T12:47:21.132 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.127+0000 7fa8fdd30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 2024-03-04T12:47:21.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.128+0000 7fa8fdd30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 info.flags=0x17 2024-03-04T12:47:21.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.128+0000 7fa8fdd30800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 to cache LRU end 2024-03-04T12:47:21.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.128+0000 7fa8fdd30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:21.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.128+0000 7fa8fdd30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24, ofs0, ns] 2024-03-04T12:47:21.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.128+0000 7fa7dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824030 cookie 94121146344368 notifier 6708 bl.length()=861 2024-03-04T12:47:21.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.128+0000 7fa7dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 info.flags=0x17 2024-03-04T12:47:21.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.128+0000 7fa7dcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 to cache LRU end 2024-03-04T12:47:21.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.128+0000 7fa7dcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:21.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.128+0000 7fa8fdd30800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24]): orig_sources= new_sources= 2024-03-04T12:47:21.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.128+0000 7fa8fdd30800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24]): potential sources added=[] removed=[] 2024-03-04T12:47:21.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.128+0000 7fa8fdd30800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24]): orig_dests= new_dests= 2024-03-04T12:47:21.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.128+0000 7fa8fdd30800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24]): potential dests added=[] removed=[] 2024-03-04T12:47:21.136 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.131+0000 7fa8fdd30800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-03-04T12:47:21.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.132+0000 7fa7a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:21.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.134+0000 7fa8fdd30800 20 remove_watcher() i=0 2024-03-04T12:47:21.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.134+0000 7fa8fdd30800 2 removed watcher, disabling cache 2024-03-04T12:47:21.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.135+0000 7fa8fdd30800 20 remove_watcher() i=1 2024-03-04T12:47:21.142 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.136+0000 7fa8fdd30800 20 remove_watcher() i=2 2024-03-04T12:47:21.143 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.137+0000 7fa8fdd30800 20 remove_watcher() i=3 2024-03-04T12:47:21.144 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.138+0000 7fa8fdd30800 20 remove_watcher() i=4 2024-03-04T12:47:21.145 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.139+0000 7fa8fdd30800 20 remove_watcher() i=5 2024-03-04T12:47:21.146 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.140+0000 7fa8fdd30800 20 remove_watcher() i=6 2024-03-04T12:47:21.147 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.141+0000 7fa8fdd30800 20 remove_watcher() i=7 2024-03-04T12:47:21.158 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-04T12:47:21.185 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:21.185 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:21.217 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.211+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.213+0000 7f68c3533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.213+0000 7f68c3533800 20 realm 2024-03-04T12:47:21.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.213+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.213+0000 7f68c3533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.213+0000 7f68c3533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:21.219 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.213+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.220 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.213+0000 7f68c3533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.220 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.213+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.220 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.214+0000 7f68c3533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:21.220 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.214+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.221 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.215+0000 7f68c3533800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:21.221 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.215+0000 7f68c3533800 20 searching for the correct realm 2024-03-04T12:47:21.223 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.217+0000 7f68be9d2640 0 -- 172.21.15.90:0/2828416425 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f68b40a4850 msgr2=0x7f68b40011c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:21.226 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.220+0000 7f68bf1d3640 0 -- 172.21.15.90:0/2828416425 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f68b4098ad0 msgr2=0x7f68b409b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:21.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.425+0000 7f68c3533800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:21.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:21.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:21.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:21.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:21.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:21.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 zone default found 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 4 Realm: () 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 zonegroup default 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.426+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.427+0000 7f68c3533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.427+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.427+0000 7f68c3533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.427+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.427+0000 7f68c3533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.427+0000 7f68c3533800 20 started sync module instance, tier type = 2024-03-04T12:47:21.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.427+0000 7f68c3533800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:21.442 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.436+0000 7f68c3533800 20 add_watcher() i=0 2024-03-04T12:47:21.442 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.436+0000 7f68c3533800 20 add_watcher() i=1 2024-03-04T12:47:21.442 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.436+0000 7f68c3533800 20 add_watcher() i=2 2024-03-04T12:47:21.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.436+0000 7f68c3533800 20 add_watcher() i=3 2024-03-04T12:47:21.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.436+0000 7f68c3533800 20 add_watcher() i=4 2024-03-04T12:47:21.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.436+0000 7f68c3533800 20 add_watcher() i=5 2024-03-04T12:47:21.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.436+0000 7f68c3533800 20 add_watcher() i=6 2024-03-04T12:47:21.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.437+0000 7f68c3533800 20 add_watcher() i=7 2024-03-04T12:47:21.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.437+0000 7f68c3533800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:21.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.439+0000 7f6775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:21.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.439+0000 7f68c3533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:21.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.439+0000 7f68c3533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:21.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.439+0000 7f68c3533800 5 note: GC not initialized 2024-03-04T12:47:21.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.439+0000 7f6774fe1640 20 reqs_thread_entry: start 2024-03-04T12:47:21.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.440+0000 7f68c3533800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:21.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.440+0000 7f68c3533800 20 Filter name: none 2024-03-04T12:47:21.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.440+0000 7f66ee7fc640 20 reqs_thread_entry: start 2024-03-04T12:47:21.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.440+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.440+0000 7f68c3533800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:21.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.440+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.441+0000 7f68c3533800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:21.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.441+0000 7f68c3533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:21.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.441+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.441+0000 7f68c3533800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:21.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.441+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.442+0000 7f68c3533800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:21.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.442+0000 7f68c3533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:21.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.443+0000 7f68c3533800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.443+0000 7f68c3533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.444+0000 7f6775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:21.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.446+0000 7f68c3533800 20 remove_watcher() i=0 2024-03-04T12:47:21.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.446+0000 7f68c3533800 2 removed watcher, disabling cache 2024-03-04T12:47:21.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.446+0000 7f68c3533800 20 remove_watcher() i=1 2024-03-04T12:47:21.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.447+0000 7f68c3533800 20 remove_watcher() i=2 2024-03-04T12:47:21.454 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.448+0000 7f68c3533800 20 remove_watcher() i=3 2024-03-04T12:47:21.455 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.449+0000 7f68c3533800 20 remove_watcher() i=4 2024-03-04T12:47:21.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.450+0000 7f68c3533800 20 remove_watcher() i=5 2024-03-04T12:47:21.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.451+0000 7f68c3533800 20 remove_watcher() i=6 2024-03-04T12:47:21.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.452+0000 7f68c3533800 20 remove_watcher() i=7 2024-03-04T12:47:21.467 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:21.468 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:21.468 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-commit-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:47:21.468 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:21.469 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.469 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.473 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.473 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.515 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.515 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.542 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-03-04T12:47:21.542 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:21.543 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.543 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.554 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.554 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.596 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.596 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.604 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.604 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.611 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.612 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.618 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.618 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.626 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.626 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.633 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.633 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.640 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.640 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.647 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.647 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.654 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.654 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.660 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.660 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.667 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.667 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.673 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.673 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.682 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.682 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.689 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.689 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.696 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.696 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.702 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.703 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.709 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.709 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.715 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.716 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.722 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.722 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.730 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:21.730 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:21.767 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-04T12:47:21.794 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:21.794 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:21.826 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.820+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.827 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.822+0000 7f1627d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.822+0000 7f1627d42800 20 realm 2024-03-04T12:47:21.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.822+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.822+0000 7f1627d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.822+0000 7f1627d42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:21.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.822+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.822+0000 7f1627d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.822+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.828 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.823+0000 7f1627d42800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:21.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.823+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.829 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.823+0000 7f1627d42800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:21.831 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.823+0000 7f1627d42800 20 searching for the correct realm 2024-03-04T12:47:21.832 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.826+0000 7f1624242640 0 -- 172.21.15.90:0/3376449775 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x7f14ec079c50 msgr2=0x7f14ec07c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:21.836 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.830+0000 7f1623a41640 0 -- 172.21.15.90:0/3376449775 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f16180a5420 msgr2=0x7f16180a58a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:21.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.834+0000 7f1627d42800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:21.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.834+0000 7f1627d42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:21.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.834+0000 7f1627d42800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:21.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.834+0000 7f1627d42800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:21.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.834+0000 7f1627d42800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:21.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.834+0000 7f1627d42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:21.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.834+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:21.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:21.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 20 zone default found 2024-03-04T12:47:21.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 4 Realm: () 2024-03-04T12:47:21.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:21.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:21.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:21.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 20 zonegroup default 2024-03-04T12:47:21.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.835+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.836+0000 7f1627d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.836+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.836+0000 7f1627d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.836+0000 7f1627d42800 20 started sync module instance, tier type = 2024-03-04T12:47:21.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.836+0000 7f1627d42800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:21.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.844+0000 7f1627d42800 20 add_watcher() i=0 2024-03-04T12:47:21.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.844+0000 7f1627d42800 20 add_watcher() i=1 2024-03-04T12:47:21.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.844+0000 7f1627d42800 20 add_watcher() i=2 2024-03-04T12:47:21.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.844+0000 7f1627d42800 20 add_watcher() i=3 2024-03-04T12:47:21.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.844+0000 7f1627d42800 20 add_watcher() i=4 2024-03-04T12:47:21.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.844+0000 7f1627d42800 20 add_watcher() i=5 2024-03-04T12:47:21.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.844+0000 7f1627d42800 20 add_watcher() i=6 2024-03-04T12:47:21.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.845+0000 7f1627d42800 20 add_watcher() i=7 2024-03-04T12:47:21.851 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.845+0000 7f1627d42800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:21.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.847+0000 7f14d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:21.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.847+0000 7f1627d42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:21.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.847+0000 7f1627d42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:21.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.847+0000 7f1627d42800 5 note: GC not initialized 2024-03-04T12:47:21.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.847+0000 7f14d8fe1640 20 reqs_thread_entry: start 2024-03-04T12:47:21.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.847+0000 7f1627d42800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:21.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.847+0000 7f1627d42800 20 Filter name: none 2024-03-04T12:47:21.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.847+0000 7f14527fc640 20 reqs_thread_entry: start 2024-03-04T12:47:21.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.847+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.848+0000 7f1627d42800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:21.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.848+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.849+0000 7f1627d42800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:21.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.849+0000 7f1627d42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:21.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.849+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.849+0000 7f1627d42800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:21.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.849+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.850+0000 7f1627d42800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:21.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.850+0000 7f1627d42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:21.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.851+0000 7f1627d42800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.851+0000 7f1627d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.857 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.852+0000 7f14d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:21.860 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.853+0000 7f1627d42800 20 remove_watcher() i=0 2024-03-04T12:47:21.860 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.853+0000 7f1627d42800 2 removed watcher, disabling cache 2024-03-04T12:47:21.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.854+0000 7f1627d42800 20 remove_watcher() i=1 2024-03-04T12:47:21.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.855+0000 7f1627d42800 20 remove_watcher() i=2 2024-03-04T12:47:21.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.856+0000 7f1627d42800 20 remove_watcher() i=3 2024-03-04T12:47:21.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.857+0000 7f1627d42800 20 remove_watcher() i=4 2024-03-04T12:47:21.864 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.858+0000 7f1627d42800 20 remove_watcher() i=5 2024-03-04T12:47:21.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.859+0000 7f1627d42800 20 remove_watcher() i=6 2024-03-04T12:47:21.866 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.860+0000 7f1627d42800 20 remove_watcher() i=7 2024-03-04T12:47:21.875 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:21.875 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:21.875 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-commit-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:47:21.875 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:21.877 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-03-04T12:47:21.911 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:21.911 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:21.944 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.938+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.939+0000 7f926f5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.939+0000 7f926f5a2800 20 realm 2024-03-04T12:47:21.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.939+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.940+0000 7f926f5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.940+0000 7f926f5a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:21.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.940+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.940+0000 7f926f5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.946 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.940+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.941+0000 7f926f5a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:21.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.941+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.941+0000 7f926f5a2800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:21.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.941+0000 7f926f5a2800 20 searching for the correct realm 2024-03-04T12:47:21.950 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.944+0000 7f926d8a6640 0 -- 172.21.15.90:0/3265066263 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x55ad81a31c40 msgr2=0x55ad81a34100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:21.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.947+0000 7f926d0a5640 0 -- 172.21.15.90:0/3265066263 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f9258038030 msgr2=0x7f9258014040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:21.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.951+0000 7f926f5a2800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:21.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.951+0000 7f926f5a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:21.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.951+0000 7f926f5a2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:21.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.951+0000 7f926f5a2800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:21.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.951+0000 7f926f5a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:21.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.951+0000 7f926f5a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:21.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.951+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.951+0000 7f926f5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.951+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:21.958 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:21.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 20 zone default found 2024-03-04T12:47:21.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 4 Realm: () 2024-03-04T12:47:21.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:21.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:21.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:21.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 20 zonegroup default 2024-03-04T12:47:21.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.959 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.952+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.953+0000 7f926f5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.953+0000 7f926f5a2800 20 started sync module instance, tier type = 2024-03-04T12:47:21.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.953+0000 7f926f5a2800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:21.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.961+0000 7f926f5a2800 20 add_watcher() i=0 2024-03-04T12:47:21.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.961+0000 7f926f5a2800 20 add_watcher() i=1 2024-03-04T12:47:21.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.961+0000 7f926f5a2800 20 add_watcher() i=2 2024-03-04T12:47:21.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.961+0000 7f926f5a2800 20 add_watcher() i=3 2024-03-04T12:47:21.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.961+0000 7f926f5a2800 20 add_watcher() i=4 2024-03-04T12:47:21.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.961+0000 7f926f5a2800 20 add_watcher() i=5 2024-03-04T12:47:21.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.961+0000 7f926f5a2800 20 add_watcher() i=6 2024-03-04T12:47:21.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.962+0000 7f926f5a2800 20 add_watcher() i=7 2024-03-04T12:47:21.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.962+0000 7f926f5a2800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:21.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.963+0000 7f91237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:21.970 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.964+0000 7f926f5a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:21.970 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.964+0000 7f926f5a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:21.970 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.964+0000 7f926f5a2800 5 note: GC not initialized 2024-03-04T12:47:21.970 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.964+0000 7f91227e4640 20 reqs_thread_entry: start 2024-03-04T12:47:21.971 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.964+0000 7f926f5a2800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:21.971 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.964+0000 7f926f5a2800 20 Filter name: none 2024-03-04T12:47:21.971 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.964+0000 7f9093fff640 20 reqs_thread_entry: start 2024-03-04T12:47:21.971 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.964+0000 7f926f5a2800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-04T12:47:21.971 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.964+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.965+0000 7f926f5a2800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:21.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.965+0000 7f926f5a2800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-04T12:47:21.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.965+0000 7f926f5a2800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-04T12:47:21.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.965+0000 7f926f5a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 : miss 2024-03-04T12:47:21.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.965+0000 7f926f5a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:21.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.965+0000 7f926f5a2800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:21.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.965+0000 7f926f5a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 info.flags=0x17 2024-03-04T12:47:21.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.965+0000 7f926f5a2800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 to cache LRU end 2024-03-04T12:47:21.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.965+0000 7f926f5a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:21.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.965+0000 7f926f5a2800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:21.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.965+0000 7f926f5a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 2024-03-04T12:47:21.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.970+0000 7f926f5a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 info.flags=0x17 2024-03-04T12:47:21.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.970+0000 7f926f5a2800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 to cache LRU end 2024-03-04T12:47:21.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.970+0000 7f926f5a2800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:21.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.970+0000 7f926f5a2800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25, ofs0, ns] 2024-03-04T12:47:21.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.970+0000 7f913ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824033 cookie 94203692668320 notifier 6762 bl.length()=893 2024-03-04T12:47:21.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.970+0000 7f913ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 info.flags=0x17 2024-03-04T12:47:21.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.970+0000 7f913ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 to cache LRU end 2024-03-04T12:47:21.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.970+0000 7f913ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:21.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.971+0000 7f926f5a2800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25]): orig_sources= new_sources= 2024-03-04T12:47:21.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.971+0000 7f926f5a2800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25]): potential sources added=[] removed=[] 2024-03-04T12:47:21.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.971+0000 7f926f5a2800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25]): orig_dests= new_dests= 2024-03-04T12:47:21.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.971+0000 7f926f5a2800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25]): potential dests added=[] removed=[] 2024-03-04T12:47:21.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.0 2024-03-04T12:47:21.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.0 2024-03-04T12:47:21.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.1 2024-03-04T12:47:21.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.1 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.2 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.2 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.3 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.3 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.4 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.4 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.5 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.5 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.6 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.6 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.7 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.7 2024-03-04T12:47:21.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.8 2024-03-04T12:47:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.8 2024-03-04T12:47:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.9 2024-03-04T12:47:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.9 2024-03-04T12:47:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.10 2024-03-04T12:47:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.10 2024-03-04T12:47:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.11 2024-03-04T12:47:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1.11 2024-03-04T12:47:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.0 2024-03-04T12:47:21.981 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.973+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.1 2024-03-04T12:47:21.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.974+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.2 2024-03-04T12:47:21.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.974+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.3 2024-03-04T12:47:21.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.975+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.4 2024-03-04T12:47:21.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.975+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.5 2024-03-04T12:47:21.982 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.976+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.6 2024-03-04T12:47:21.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.977+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.7 2024-03-04T12:47:21.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.977+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.8 2024-03-04T12:47:21.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.977+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.9 2024-03-04T12:47:21.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.978+0000 7f926f5a2800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25.10 2024-03-04T12:47:21.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.980+0000 7f926f5a2800 -1 Injecting error=-125 at location=commit_target_layout 2024-03-04T12:47:21.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.980+0000 7f926f5a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 : hit (requested=0x17, cached=0x17) 2024-03-04T12:47:21.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.980+0000 7f926f5a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 2024-03-04T12:47:21.987 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.981+0000 7f926f5a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 info.flags=0x17 2024-03-04T12:47:21.987 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.981+0000 7f926f5a2800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 to cache LRU end 2024-03-04T12:47:21.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.981+0000 7f926f5a2800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:21.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.981+0000 7f926f5a2800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25, ofs0, ns] 2024-03-04T12:47:21.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.982+0000 7f9150ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824034 cookie 94203692668320 notifier 6762 bl.length()=861 2024-03-04T12:47:21.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.982+0000 7f9150ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 info.flags=0x17 2024-03-04T12:47:21.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.982+0000 7f9150ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 to cache LRU end 2024-03-04T12:47:21.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.982+0000 7f9150ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:21.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.982+0000 7f926f5a2800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25]): orig_sources= new_sources= 2024-03-04T12:47:21.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.982+0000 7f926f5a2800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25]): potential sources added=[] removed=[] 2024-03-04T12:47:21.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.982+0000 7f926f5a2800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25]): orig_dests= new_dests= 2024-03-04T12:47:21.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.982+0000 7f926f5a2800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25]): potential dests added=[] removed=[] 2024-03-04T12:47:21.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.984+0000 7f926f5a2800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-03-04T12:47:21.992 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.986+0000 7f91237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:21.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.988+0000 7f926f5a2800 20 remove_watcher() i=0 2024-03-04T12:47:21.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.988+0000 7f926f5a2800 2 removed watcher, disabling cache 2024-03-04T12:47:21.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.989+0000 7f926f5a2800 20 remove_watcher() i=1 2024-03-04T12:47:21.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.991+0000 7f926f5a2800 20 remove_watcher() i=2 2024-03-04T12:47:21.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.992+0000 7f926f5a2800 20 remove_watcher() i=3 2024-03-04T12:47:21.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.993+0000 7f926f5a2800 20 remove_watcher() i=4 2024-03-04T12:47:21.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.994+0000 7f926f5a2800 20 remove_watcher() i=5 2024-03-04T12:47:22.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.995+0000 7f926f5a2800 20 remove_watcher() i=6 2024-03-04T12:47:22.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:21.996+0000 7f926f5a2800 20 remove_watcher() i=7 2024-03-04T12:47:22.012 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-04T12:47:22.040 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:22.040 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:22.073 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.067+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.069+0000 7fcd925a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.069+0000 7fcd925a2800 20 realm 2024-03-04T12:47:22.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.069+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.069+0000 7fcd925a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.069+0000 7fcd925a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:22.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.069+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.069+0000 7fcd925a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.075 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.069+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.070+0000 7fcd925a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:22.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.070+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.070+0000 7fcd925a2800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:22.076 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.070+0000 7fcd925a2800 20 searching for the correct realm 2024-03-04T12:47:22.077 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.072+0000 7fcd9009e640 0 -- 172.21.15.90:0/4259007542 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7fcd8805f040 msgr2=0x7fcd88053950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:22.081 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.075+0000 7fcd9009e640 0 -- 172.21.15.90:0/4259007542 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7fcc58079cd0 msgr2=0x7fcc5807c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:22.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.080+0000 7fcd925a2800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:22.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.080+0000 7fcd925a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:22.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.080+0000 7fcd925a2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:22.086 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.080+0000 7fcd925a2800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:22.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.080+0000 7fcd925a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:22.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.080+0000 7fcd925a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:22.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.080+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.080+0000 7fcd925a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.080+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:22.087 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:22.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 20 zone default found 2024-03-04T12:47:22.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 4 Realm: () 2024-03-04T12:47:22.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:22.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:22.088 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:22.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 20 zonegroup default 2024-03-04T12:47:22.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.081+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.082+0000 7fcd925a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.082+0000 7fcd925a2800 20 started sync module instance, tier type = 2024-03-04T12:47:22.089 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.082+0000 7fcd925a2800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:22.096 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.091+0000 7fcd925a2800 20 add_watcher() i=0 2024-03-04T12:47:22.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.091+0000 7fcd925a2800 20 add_watcher() i=1 2024-03-04T12:47:22.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.091+0000 7fcd925a2800 20 add_watcher() i=2 2024-03-04T12:47:22.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.091+0000 7fcd925a2800 20 add_watcher() i=3 2024-03-04T12:47:22.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.091+0000 7fcd925a2800 20 add_watcher() i=4 2024-03-04T12:47:22.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.091+0000 7fcd925a2800 20 add_watcher() i=5 2024-03-04T12:47:22.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.091+0000 7fcd925a2800 20 add_watcher() i=6 2024-03-04T12:47:22.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.092+0000 7fcd925a2800 20 add_watcher() i=7 2024-03-04T12:47:22.097 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.092+0000 7fcd925a2800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:22.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.093+0000 7fcc46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:22.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.093+0000 7fcd925a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:22.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.093+0000 7fcd925a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:22.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.093+0000 7fcd925a2800 5 note: GC not initialized 2024-03-04T12:47:22.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.094+0000 7fcc45fdb640 20 reqs_thread_entry: start 2024-03-04T12:47:22.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.094+0000 7fcd925a2800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:22.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.094+0000 7fcd925a2800 20 Filter name: none 2024-03-04T12:47:22.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.094+0000 7fcbb77fe640 20 reqs_thread_entry: start 2024-03-04T12:47:22.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.094+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.094+0000 7fcd925a2800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:22.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.094+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.095+0000 7fcd925a2800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:22.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.095+0000 7fcd925a2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:22.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.095+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.095+0000 7fcd925a2800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:22.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.095+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.096+0000 7fcd925a2800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:22.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.096+0000 7fcd925a2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:22.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.097+0000 7fcd925a2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.098+0000 7fcd925a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.104 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.098+0000 7fcc46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:22.106 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.100+0000 7fcd925a2800 20 remove_watcher() i=0 2024-03-04T12:47:22.106 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.100+0000 7fcd925a2800 2 removed watcher, disabling cache 2024-03-04T12:47:22.107 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.101+0000 7fcd925a2800 20 remove_watcher() i=1 2024-03-04T12:47:22.108 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.102+0000 7fcd925a2800 20 remove_watcher() i=2 2024-03-04T12:47:22.109 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.103+0000 7fcd925a2800 20 remove_watcher() i=3 2024-03-04T12:47:22.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.104+0000 7fcd925a2800 20 remove_watcher() i=4 2024-03-04T12:47:22.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.105+0000 7fcd925a2800 20 remove_watcher() i=5 2024-03-04T12:47:22.112 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.106+0000 7fcd925a2800 20 remove_watcher() i=6 2024-03-04T12:47:22.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.107+0000 7fcd925a2800 20 remove_watcher() i=7 2024-03-04T12:47:22.122 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:22.122 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:22.122 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-commit-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25 num_objects: 20 size_kb: 1 num_shards: 12 2024-03-04T12:47:22.123 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:22.124 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.124 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.127 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.127 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.170 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.170 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.196 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-03-04T12:47:22.196 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:22.197 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.197 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.208 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.208 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.251 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.251 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.259 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.259 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.266 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.266 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.273 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.273 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.281 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.281 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.288 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.288 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.295 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.295 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.302 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.302 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.309 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.309 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.316 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.316 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.322 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.323 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.330 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.330 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.337 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.337 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.344 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.344 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.352 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.352 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.359 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.359 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.366 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.366 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.373 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.373 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.380 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.380 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.387 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:22.387 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:22.394 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-04T12:47:22.421 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:22.421 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:22.454 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.448+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.455 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.449+0000 7f937171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.455 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.449+0000 7f937171f800 20 realm 2024-03-04T12:47:22.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.449+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.450+0000 7f937171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.450+0000 7f937171f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:22.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.450+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.450+0000 7f937171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.456 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.450+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.451+0000 7f937171f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:22.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.451+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.452+0000 7f937171f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:22.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.452+0000 7f937171f800 20 searching for the correct realm 2024-03-04T12:47:22.459 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.454+0000 7f936cbe8640 0 -- 172.21.15.90:0/3421313392 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f9358065040 msgr2=0x7f9358093450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:22.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.659+0000 7f936cbe8640 0 -- 172.21.15.90:0/3421313392 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x55888044dcc0 msgr2=0x7f923807ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:22.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:22.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:22.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:22.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:22.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:22.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:22.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:22.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:22.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 zone default found 2024-03-04T12:47:22.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 4 Realm: () 2024-03-04T12:47:22.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:22.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:22.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:22.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 zonegroup default 2024-03-04T12:47:22.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.866+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.867+0000 7f937171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.867+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.867+0000 7f937171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.867+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.867+0000 7f937171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.867+0000 7f937171f800 20 started sync module instance, tier type = 2024-03-04T12:47:22.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.867+0000 7f937171f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:22.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.877+0000 7f937171f800 20 add_watcher() i=0 2024-03-04T12:47:22.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.877+0000 7f937171f800 20 add_watcher() i=1 2024-03-04T12:47:22.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.877+0000 7f937171f800 20 add_watcher() i=2 2024-03-04T12:47:22.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.877+0000 7f937171f800 20 add_watcher() i=3 2024-03-04T12:47:22.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.877+0000 7f937171f800 20 add_watcher() i=4 2024-03-04T12:47:22.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.877+0000 7f937171f800 20 add_watcher() i=5 2024-03-04T12:47:22.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.877+0000 7f937171f800 20 add_watcher() i=6 2024-03-04T12:47:22.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.878+0000 7f937171f800 20 add_watcher() i=7 2024-03-04T12:47:22.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.878+0000 7f937171f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:22.885 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.879+0000 7f92237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:22.886 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.879+0000 7f937171f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:22.886 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.879+0000 7f937171f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:22.886 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.880+0000 7f937171f800 5 note: GC not initialized 2024-03-04T12:47:22.886 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.880+0000 7f92227e4640 20 reqs_thread_entry: start 2024-03-04T12:47:22.886 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.880+0000 7f937171f800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:22.886 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.880+0000 7f937171f800 20 Filter name: none 2024-03-04T12:47:22.886 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.880+0000 7f9193fff640 20 reqs_thread_entry: start 2024-03-04T12:47:22.886 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.880+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.887 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.880+0000 7f937171f800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:22.887 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.880+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.881+0000 7f937171f800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:22.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.881+0000 7f937171f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:22.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.881+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.881+0000 7f937171f800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:22.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.881+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.882+0000 7f937171f800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:22.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.882+0000 7f937171f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:22.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.883+0000 7f937171f800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.889 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.883+0000 7f937171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.889 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.883+0000 7f92237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:22.891 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.886+0000 7f937171f800 20 remove_watcher() i=0 2024-03-04T12:47:22.891 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.886+0000 7f937171f800 2 removed watcher, disabling cache 2024-03-04T12:47:22.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.887+0000 7f937171f800 20 remove_watcher() i=1 2024-03-04T12:47:22.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.888+0000 7f937171f800 20 remove_watcher() i=2 2024-03-04T12:47:22.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.889+0000 7f937171f800 20 remove_watcher() i=3 2024-03-04T12:47:22.895 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.890+0000 7f937171f800 20 remove_watcher() i=4 2024-03-04T12:47:22.896 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.890+0000 7f937171f800 20 remove_watcher() i=5 2024-03-04T12:47:22.897 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.891+0000 7f937171f800 20 remove_watcher() i=6 2024-03-04T12:47:22.898 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.892+0000 7f937171f800 20 remove_watcher() i=7 2024-03-04T12:47:22.907 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:22.907 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:22.907 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: abort-at-commit-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:47:22.908 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:22.909 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-03-04T12:47:22.941 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:22.942 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:22.974 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.968+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.969+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.969+0000 7f1a4b48c800 20 realm 2024-03-04T12:47:22.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.969+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.970+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.970+0000 7f1a4b48c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:22.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.970+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.970+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:22.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.970+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.971+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:22.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.971+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:22.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.971+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:22.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.971+0000 7f1a4b48c800 20 searching for the correct realm 2024-03-04T12:47:22.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:22.974+0000 7f1a43fff640 0 -- 172.21.15.90:0/95435693 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f1a340c8070 msgr2=0x7f1a34061820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:47:23.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.180+0000 7f1a48f88640 0 -- 172.21.15.90:0/95435693 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f1a340034b0 msgr2=0x7f1a34009e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:23.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:23.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:23.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:23.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:23.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:23.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:23.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.394 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 zone default found 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 4 Realm: () 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 zonegroup default 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.395 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 started sync module instance, tier type = 2024-03-04T12:47:23.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:23.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=0 2024-03-04T12:47:23.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=1 2024-03-04T12:47:23.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=2 2024-03-04T12:47:23.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=3 2024-03-04T12:47:23.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=4 2024-03-04T12:47:23.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=5 2024-03-04T12:47:23.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=6 2024-03-04T12:47:23.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.397+0000 7f1a4b48c800 20 add_watcher() i=7 2024-03-04T12:47:23.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.397+0000 7f1a4b48c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:23.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.399+0000 7f18fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:23.406 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.399+0000 7f1a4b48c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:23.406 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.399+0000 7f1a4b48c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:23.406 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 note: GC not initialized 2024-03-04T12:47:23.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.400+0000 7f18fdfe3640 20 reqs_thread_entry: start 2024-03-04T12:47:23.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:23.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 Filter name: none 2024-03-04T12:47:23.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.400+0000 7f186f7fe640 20 reqs_thread_entry: start 2024-03-04T12:47:23.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.400+0000 7f1a4b48c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-04T12:47:23.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:23.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.400+0000 7f1a4b48c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-04T12:47:23.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.400+0000 7f1a4b48c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-04T12:47:23.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.400+0000 7f1a4b48c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 : miss 2024-03-04T12:47:23.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.401+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:23.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:23.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:23.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:23.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:23.408 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 2024-03-04T12:47:23.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.406+0000 7f1a4b48c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:23.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.406+0000 7f1a4b48c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:23.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.406+0000 7f1a4b48c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:23.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.406+0000 7f1a4b48c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26, ofs0, ns] 2024-03-04T12:47:23.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.406+0000 7f191f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824070 cookie 94038066006560 notifier 6822 bl.length()=893 2024-03-04T12:47:23.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.406+0000 7f191f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:23.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.406+0000 7f191f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:23.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.406+0000 7f191f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:23.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.406+0000 7f1a4b48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): orig_sources= new_sources= 2024-03-04T12:47:23.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.406+0000 7f1a4b48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): potential sources added=[] removed=[] 2024-03-04T12:47:23.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.406+0000 7f1a4b48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): orig_dests= new_dests= 2024-03-04T12:47:23.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.406+0000 7f1a4b48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): potential dests added=[] removed=[] 2024-03-04T12:47:23.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.0 2024-03-04T12:47:23.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.0 2024-03-04T12:47:23.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.1 2024-03-04T12:47:23.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.1 2024-03-04T12:47:23.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.2 2024-03-04T12:47:23.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.2 2024-03-04T12:47:23.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.3 2024-03-04T12:47:23.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.3 2024-03-04T12:47:23.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.4 2024-03-04T12:47:23.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.4 2024-03-04T12:47:23.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.5 2024-03-04T12:47:23.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.5 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.6 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.6 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.7 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.7 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.8 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.8 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.9 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.9 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.10 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.10 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.11 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.11 2024-03-04T12:47:23.416 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.0 2024-03-04T12:47:23.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1 2024-03-04T12:47:23.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.410+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.2 2024-03-04T12:47:23.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.410+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.3 2024-03-04T12:47:23.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.410+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.4 2024-03-04T12:47:23.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.411+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.5 2024-03-04T12:47:23.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.411+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.6 2024-03-04T12:47:23.418 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.412+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.7 2024-03-04T12:47:23.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.412+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.8 2024-03-04T12:47:23.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.413+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.9 2024-03-04T12:47:23.419 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.413+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.10 2024-03-04T12:47:23.422 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a4b48c800 time 2024-03-04T12:47:23.417560+0000 2024-03-04T12:47:23.422 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:47:23.423 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:23.423 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1a4e780e86] 2024-03-04T12:47:23.423 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1a4e781044] 2024-03-04T12:47:23.423 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586ef683eb1] 2024-03-04T12:47:23.423 INFO:tasks.workunit.client.0.smithi090.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5586ef698088] 2024-03-04T12:47:23.424 INFO:tasks.workunit.client.0.smithi090.stderr: 5: main() 2024-03-04T12:47:23.424 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f1a4d63feb0] 2024-03-04T12:47:23.424 INFO:tasks.workunit.client.0.smithi090.stderr: 7: __libc_start_main() 2024-03-04T12:47:23.425 INFO:tasks.workunit.client.0.smithi090.stderr: 8: _start() 2024-03-04T12:47:23.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.417+0000 7f1a4b48c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a4b48c800 time 2024-03-04T12:47:23.417560+0000 2024-03-04T12:47:23.425 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:47:23.425 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.425 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:23.425 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1a4e780e86] 2024-03-04T12:47:23.425 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1a4e781044] 2024-03-04T12:47:23.426 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586ef683eb1] 2024-03-04T12:47:23.426 INFO:tasks.workunit.client.0.smithi090.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5586ef698088] 2024-03-04T12:47:23.426 INFO:tasks.workunit.client.0.smithi090.stderr: 5: main() 2024-03-04T12:47:23.426 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f1a4d63feb0] 2024-03-04T12:47:23.426 INFO:tasks.workunit.client.0.smithi090.stderr: 7: __libc_start_main() 2024-03-04T12:47:23.426 INFO:tasks.workunit.client.0.smithi090.stderr: 8: _start() 2024-03-04T12:47:23.426 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.426 INFO:tasks.workunit.client.0.smithi090.stderr:*** Caught signal (Aborted) ** 2024-03-04T12:47:23.426 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7f1a4b48c800 thread_name:radosgw-admin 2024-03-04T12:47:23.441 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:23.441 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1a4d654db0] 2024-03-04T12:47:23.441 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1a4d6a154c] 2024-03-04T12:47:23.441 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:47:23.441 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:47:23.441 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1a4e780ee0] 2024-03-04T12:47:23.442 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1a4e781044] 2024-03-04T12:47:23.442 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586ef683eb1] 2024-03-04T12:47:23.442 INFO:tasks.workunit.client.0.smithi090.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5586ef698088] 2024-03-04T12:47:23.442 INFO:tasks.workunit.client.0.smithi090.stderr: 9: main() 2024-03-04T12:47:23.442 INFO:tasks.workunit.client.0.smithi090.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f1a4d63feb0] 2024-03-04T12:47:23.442 INFO:tasks.workunit.client.0.smithi090.stderr: 11: __libc_start_main() 2024-03-04T12:47:23.442 INFO:tasks.workunit.client.0.smithi090.stderr: 12: _start() 2024-03-04T12:47:23.442 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.418+0000 7f1a4b48c800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:47:23.442 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7f1a4b48c800 thread_name:radosgw-admin 2024-03-04T12:47:23.442 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.442 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1a4d654db0] 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1a4d6a154c] 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1a4e780ee0] 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1a4e781044] 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586ef683eb1] 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5586ef698088] 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: 9: main() 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f1a4d63feb0] 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: 11: __libc_start_main() 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: 12: _start() 2024-03-04T12:47:23.443 INFO:tasks.workunit.client.0.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr:--- begin dump of recent events --- 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: -499> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: crc 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: -498> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: secure 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: -497> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: crc 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: -496> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: crc 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: -495> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: secure 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: -494> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: crc 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: -493> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: secure 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: -492> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: crc 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: -491> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: secure 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: -490> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: -489> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.444 INFO:tasks.workunit.client.0.smithi090.stderr: -488> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command rotate-key hook 0x5586f17546d8 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -487> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -486> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -485> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-c con 0x5586f1600370 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -484> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-a con 0x5586f16937c0 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -483> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-b con 0x5586f1693c20 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -482> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -481> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -480> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -479> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -478> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): authenticate will time out at 1475.286708s 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -477> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): get_auth_request con 0x5586f16937c0 auth_method 0 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -476> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -475> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -474> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -473> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): get_auth_request con 0x5586f1600370 auth_method 0 2024-03-04T12:47:23.445 INFO:tasks.workunit.client.0.smithi090.stderr: -472> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -471> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -470> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -469> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -468> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -467> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -466> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): get_auth_request con 0x5586f1693c20 auth_method 0 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -465> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -464> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -463> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -462> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -461> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -460> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -459> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -458> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -457> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -456> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): handle_auth_done global_id 6813 payload 824 2024-03-04T12:47:23.446 INFO:tasks.workunit.client.0.smithi090.stderr: -455> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient: _finish_hunting 0 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr: -454> 2024-03-04T12:47:22.955+0000 7f1a43fff640 1 monclient: found mon.noname-a 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr: -453> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr: -452> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr: -451> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr: -450> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: dump: 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.447 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr: -449> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: _finish_auth 0 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr: -448> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: _check_auth_tickets 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr: -447> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr: -446> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr: -445> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr: -444> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: dump: 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.448 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -443> 2024-03-04T12:47:22.956+0000 7f1a4b48c800 5 monclient: authenticate success, global_id 6813 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -442> 2024-03-04T12:47:22.956+0000 7f1936e05640 4 set_mon_vals no callback set 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -441> 2024-03-04T12:47:22.956+0000 7f1a4b48c800 10 monclient: _renew_subs 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -440> 2024-03-04T12:47:22.956+0000 7f1a4b48c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -439> 2024-03-04T12:47:22.956+0000 7f1a4b48c800 10 monclient: _renew_subs 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -438> 2024-03-04T12:47:22.956+0000 7f1a4b48c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -437> 2024-03-04T12:47:22.956+0000 7f1a4b48c800 1 librados: init done 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -436> 2024-03-04T12:47:22.957+0000 7f1935602640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -435> 2024-03-04T12:47:22.957+0000 7f1935602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -434> 2024-03-04T12:47:22.957+0000 7f1935602640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -433> 2024-03-04T12:47:22.957+0000 7f1a48f88640 10 monclient: get_auth_request con 0x7f1930069eb0 auth_method 0 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -432> 2024-03-04T12:47:22.958+0000 7f1a49789640 10 monclient: get_auth_request con 0x5586f17967d0 auth_method 0 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -431> 2024-03-04T12:47:22.958+0000 7f1a48f88640 10 monclient: get_auth_request con 0x5586f179ff40 auth_method 0 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -430> 2024-03-04T12:47:22.959+0000 7f1a43fff640 10 monclient: get_auth_request con 0x5586f17a4130 auth_method 0 2024-03-04T12:47:23.449 INFO:tasks.workunit.client.0.smithi090.stderr: -429> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 10 monclient: build_initial_monmap 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr: -428> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 1 build_initial for_mkfs: 0 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr: -427> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 10 monclient: monmap: 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr: -426> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding auth protocol: cephx 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr: -425> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding auth protocol: cephx 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr: -424> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding auth protocol: cephx 2024-03-04T12:47:23.450 INFO:tasks.workunit.client.0.smithi090.stderr: -423> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: secure 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -422> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: crc 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -421> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: secure 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -420> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: crc 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -419> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: secure 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -418> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: crc 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -417> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: crc 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -416> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: secure 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -415> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: crc 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -414> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: secure 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -413> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: crc 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -412> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: secure 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -411> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -410> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command objecter_requests cmddesc objecter_requests hook 0x5586f17adc30 EEXIST 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -409> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient: init 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -408> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding auth protocol: cephx 2024-03-04T12:47:23.451 INFO:tasks.workunit.client.0.smithi090.stderr: -407> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding auth protocol: cephx 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -406> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding auth protocol: cephx 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -405> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: secure 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -404> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: crc 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -403> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: secure 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -402> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: crc 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -401> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: secure 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -400> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: crc 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -399> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: crc 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -398> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: secure 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -397> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: crc 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -396> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: secure 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -395> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: crc 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -394> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: secure 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -393> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.452 INFO:tasks.workunit.client.0.smithi090.stderr: -392> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -391> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command rotate-key cmddesc rotate-key hook 0x5586f17a7720 EEXIST 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -390> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -389> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -388> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-c con 0x5586f17d4460 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -387> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-a con 0x5586f17d4840 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -386> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-b con 0x5586f17e7040 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -385> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -384> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -383> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -382> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -381> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): authenticate will time out at 1475.292806s 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -380> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): get_auth_request con 0x5586f17d4840 auth_method 0 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -379> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -378> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.453 INFO:tasks.workunit.client.0.smithi090.stderr: -377> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -376> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): get_auth_request con 0x5586f17d4460 auth_method 0 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -375> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -374> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -373> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -372> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -371> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -370> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -369> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -368> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -367> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -366> 2024-03-04T12:47:22.961+0000 7f1a49789640 10 monclient(hunting): get_auth_request con 0x5586f17e7040 auth_method 0 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -365> 2024-03-04T12:47:22.961+0000 7f1a49789640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -364> 2024-03-04T12:47:22.961+0000 7f1a49789640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -363> 2024-03-04T12:47:22.961+0000 7f1a49789640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -362> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): handle_auth_done global_id 6816 payload 824 2024-03-04T12:47:23.454 INFO:tasks.workunit.client.0.smithi090.stderr: -361> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient: _finish_hunting 0 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr: -360> 2024-03-04T12:47:22.961+0000 7f1a43fff640 1 monclient: found mon.noname-a 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr: -359> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr: -358> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr: -357> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr: -356> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: dump: 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.455 INFO:tasks.workunit.client.0.smithi090.stderr: -355> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: _finish_auth 0 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr: -354> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: _check_auth_tickets 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr: -353> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr: -352> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr: -351> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr: -350> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: dump: 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.456 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -349> 2024-03-04T12:47:22.962+0000 7f1a4b48c800 5 monclient: authenticate success, global_id 6816 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -348> 2024-03-04T12:47:22.962+0000 7f1a4b48c800 10 monclient: _renew_subs 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -347> 2024-03-04T12:47:22.962+0000 7f1a49f8a640 4 set_mon_vals no callback set 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -346> 2024-03-04T12:47:22.962+0000 7f1a4b48c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -345> 2024-03-04T12:47:22.962+0000 7f1a4b48c800 10 monclient: _renew_subs 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -344> 2024-03-04T12:47:22.962+0000 7f1a4b48c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -343> 2024-03-04T12:47:22.963+0000 7f192e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -342> 2024-03-04T12:47:22.963+0000 7f192e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -341> 2024-03-04T12:47:22.963+0000 7f192e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -340> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 10 monclient: get_monmap_and_config 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -339> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 10 monclient: build_initial_monmap 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -338> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 1 build_initial for_mkfs: 0 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr: -337> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 10 monclient: monmap: 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:23.457 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr: -336> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding auth protocol: cephx 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr: -335> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding auth protocol: cephx 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr: -334> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding auth protocol: cephx 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr: -333> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: secure 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr: -332> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: crc 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr: -331> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: secure 2024-03-04T12:47:23.458 INFO:tasks.workunit.client.0.smithi090.stderr: -330> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: crc 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -329> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: secure 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -328> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: crc 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -327> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: crc 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -326> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: secure 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -325> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: crc 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -324> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: secure 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -323> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: crc 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -322> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: secure 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -321> 2024-03-04T12:47:22.963+0000 7f1a48f88640 10 monclient: get_auth_request con 0x7f1920069dc0 auth_method 0 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -320> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -319> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient: init 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -318> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding auth protocol: cephx 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -317> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding auth protocol: cephx 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -316> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding auth protocol: cephx 2024-03-04T12:47:23.459 INFO:tasks.workunit.client.0.smithi090.stderr: -315> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: secure 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -314> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: crc 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -313> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: secure 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -312> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: crc 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -311> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: secure 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -310> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: crc 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -309> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: crc 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -308> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: secure 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -307> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: crc 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -306> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: secure 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -305> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: crc 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -304> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: secure 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -303> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -302> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.460 INFO:tasks.workunit.client.0.smithi090.stderr: -301> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command rotate-key cmddesc rotate-key hook 0x7ffcf18654e8 EEXIST 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -300> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -299> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -298> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-b con 0x5586f1826850 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -297> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-a con 0x5586f1826c30 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -296> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-c con 0x5586f18189b0 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -295> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -294> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -293> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -292> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -291> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): authenticate will time out at 1475.295997s 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -290> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): get_auth_request con 0x5586f18189b0 auth_method 0 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -289> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -288> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.461 INFO:tasks.workunit.client.0.smithi090.stderr: -287> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -286> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): get_auth_request con 0x5586f1826c30 auth_method 0 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -285> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -284> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -283> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -282> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): get_auth_request con 0x5586f1826850 auth_method 0 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -281> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -280> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -279> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -278> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -277> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -276> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -275> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -274> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -273> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.462 INFO:tasks.workunit.client.0.smithi090.stderr: -272> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr: -271> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr: -270> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr: -269> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): handle_auth_done global_id 6819 payload 274 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr: -268> 2024-03-04T12:47:22.965+0000 7f1a43fff640 10 monclient: _finish_hunting 0 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr: -267> 2024-03-04T12:47:22.965+0000 7f1a43fff640 1 monclient: found mon.noname-a 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr: -266> 2024-03-04T12:47:22.965+0000 7f1a43fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr: -265> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr: -264> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr: -263> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: dump: 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.463 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr: -262> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: _finish_auth 0 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr: -261> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: _check_auth_tickets 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr: -260> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr: -259> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr: -258> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr: -257> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: dump: 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.464 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr: -256> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 monclient: authenticate success, global_id 6819 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr: -255> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 10 monclient: get_monmap_and_config success 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr: -254> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 4 set_mon_vals no callback set 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr: -253> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 10 monclient: shutdown 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr: -252> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 10 monclient: build_initial_monmap 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr: -251> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 1 build_initial for_mkfs: 0 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr: -250> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 10 monclient: monmap: 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:23.465 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr: -249> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding auth protocol: cephx 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr: -248> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding auth protocol: cephx 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr: -247> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding auth protocol: cephx 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr: -246> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: secure 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr: -245> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: crc 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr: -244> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: secure 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr: -243> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: crc 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr: -242> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: secure 2024-03-04T12:47:23.466 INFO:tasks.workunit.client.0.smithi090.stderr: -241> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: crc 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -240> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: crc 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -239> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: secure 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -238> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: crc 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -237> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: secure 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -236> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: crc 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -235> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: secure 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -234> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -233> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 1 librados: starting msgr at 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -232> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 1 librados: starting objecter 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -231> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command objecter_requests cmddesc objecter_requests hook 0x5586f1822960 EEXIST 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -230> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 1 librados: setting wanted keys 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -229> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 1 librados: calling monclient init 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -228> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient: init 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -227> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding auth protocol: cephx 2024-03-04T12:47:23.467 INFO:tasks.workunit.client.0.smithi090.stderr: -226> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding auth protocol: cephx 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -225> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding auth protocol: cephx 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -224> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: secure 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -223> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: crc 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -222> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: secure 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -221> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: crc 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -220> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: secure 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -219> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: crc 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -218> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: crc 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -217> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: secure 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -216> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: crc 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -215> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: secure 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -214> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: crc 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -213> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: secure 2024-03-04T12:47:23.468 INFO:tasks.workunit.client.0.smithi090.stderr: -212> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -211> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -210> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command rotate-key cmddesc rotate-key hook 0x5586f17cf2d8 EEXIST 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -209> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -208> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -207> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-b con 0x5586f18189b0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -206> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-a con 0x5586f1826850 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -205> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-c con 0x5586f1825080 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -204> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -203> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -202> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -201> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -200> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): authenticate will time out at 1475.298081s 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -199> 2024-03-04T12:47:22.966+0000 7f1a43fff640 10 monclient(hunting): get_auth_request con 0x5586f1826850 auth_method 0 2024-03-04T12:47:23.469 INFO:tasks.workunit.client.0.smithi090.stderr: -198> 2024-03-04T12:47:22.966+0000 7f1a43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -197> 2024-03-04T12:47:22.966+0000 7f1a43fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -196> 2024-03-04T12:47:22.966+0000 7f1a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -195> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): get_auth_request con 0x5586f1825080 auth_method 0 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -194> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -193> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -192> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -191> 2024-03-04T12:47:22.966+0000 7f1a48f88640 10 monclient(hunting): get_auth_request con 0x5586f18189b0 auth_method 0 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -190> 2024-03-04T12:47:22.966+0000 7f1a48f88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -189> 2024-03-04T12:47:22.966+0000 7f1a48f88640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -188> 2024-03-04T12:47:22.966+0000 7f1a48f88640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -187> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -186> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -185> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -184> 2024-03-04T12:47:22.967+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -183> 2024-03-04T12:47:22.967+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -182> 2024-03-04T12:47:22.967+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.470 INFO:tasks.workunit.client.0.smithi090.stderr: -181> 2024-03-04T12:47:22.967+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.471 INFO:tasks.workunit.client.0.smithi090.stderr: -180> 2024-03-04T12:47:22.967+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.471 INFO:tasks.workunit.client.0.smithi090.stderr: -179> 2024-03-04T12:47:22.967+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.471 INFO:tasks.workunit.client.0.smithi090.stderr: -178> 2024-03-04T12:47:22.967+0000 7f1a43fff640 10 monclient(hunting): handle_auth_done global_id 6822 payload 824 2024-03-04T12:47:23.471 INFO:tasks.workunit.client.0.smithi090.stderr: -177> 2024-03-04T12:47:22.967+0000 7f1a43fff640 10 monclient: _finish_hunting 0 2024-03-04T12:47:23.471 INFO:tasks.workunit.client.0.smithi090.stderr: -176> 2024-03-04T12:47:22.967+0000 7f1a43fff640 1 monclient: found mon.noname-a 2024-03-04T12:47:23.471 INFO:tasks.workunit.client.0.smithi090.stderr: -175> 2024-03-04T12:47:22.967+0000 7f1a43fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.471 INFO:tasks.workunit.client.0.smithi090.stderr: -174> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.471 INFO:tasks.workunit.client.0.smithi090.stderr: -173> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:23.471 INFO:tasks.workunit.client.0.smithi090.stderr: -172> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: dump: 2024-03-04T12:47:23.471 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.471 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.471 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr: -171> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: _finish_auth 0 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr: -170> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: _check_auth_tickets 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr: -169> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr: -168> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr: -167> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:23.472 INFO:tasks.workunit.client.0.smithi090.stderr: -166> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: dump: 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr: -165> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 5 monclient: authenticate success, global_id 6822 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr: -164> 2024-03-04T12:47:22.967+0000 7f191ffff640 4 set_mon_vals no callback set 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr: -163> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 10 monclient: _renew_subs 2024-03-04T12:47:23.473 INFO:tasks.workunit.client.0.smithi090.stderr: -162> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -161> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 10 monclient: _renew_subs 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -160> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -159> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 1 librados: init done 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -158> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command cr dump hook 0x5586f1821f78 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -157> 2024-03-04T12:47:22.968+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -156> 2024-03-04T12:47:22.969+0000 7f191e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -155> 2024-03-04T12:47:22.969+0000 7f191e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -154> 2024-03-04T12:47:22.969+0000 7f191e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -153> 2024-03-04T12:47:22.969+0000 7f1a48f88640 10 monclient: get_auth_request con 0x7f1914069eb0 auth_method 0 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -152> 2024-03-04T12:47:22.969+0000 7f1a49789640 10 monclient: get_auth_request con 0x5586f1840460 auth_method 0 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -151> 2024-03-04T12:47:22.969+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -150> 2024-03-04T12:47:22.969+0000 7f1a4b48c800 20 realm 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -149> 2024-03-04T12:47:22.969+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.474 INFO:tasks.workunit.client.0.smithi090.stderr: -148> 2024-03-04T12:47:22.970+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -147> 2024-03-04T12:47:22.970+0000 7f1a4b48c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -146> 2024-03-04T12:47:22.970+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -145> 2024-03-04T12:47:22.970+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -144> 2024-03-04T12:47:22.970+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -143> 2024-03-04T12:47:22.970+0000 7f1a48f88640 10 monclient: get_auth_request con 0x5586f18446b0 auth_method 0 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -142> 2024-03-04T12:47:22.971+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -141> 2024-03-04T12:47:22.971+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -140> 2024-03-04T12:47:22.971+0000 7f1a43fff640 10 monclient: get_auth_request con 0x5586f1847f10 auth_method 0 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -139> 2024-03-04T12:47:22.971+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -138> 2024-03-04T12:47:22.971+0000 7f1a4b48c800 20 searching for the correct realm 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -137> 2024-03-04T12:47:22.971+0000 7f1a49789640 10 monclient: get_auth_request con 0x5586f184cc30 auth_method 0 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -136> 2024-03-04T12:47:22.972+0000 7f1a48f88640 10 monclient: get_auth_request con 0x7f1a4402d040 auth_method 0 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -135> 2024-03-04T12:47:22.973+0000 7f1a43fff640 10 monclient: get_auth_request con 0x7f1a340c8070 auth_method 0 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -134> 2024-03-04T12:47:22.974+0000 7f1a43fff640 0 -- 172.21.15.90:0/95435693 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f1a340c8070 msgr2=0x7f1a34061820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:47:23.475 INFO:tasks.workunit.client.0.smithi090.stderr: -133> 2024-03-04T12:47:23.175+0000 7f1a43fff640 10 monclient: get_auth_request con 0x7f1a340c8070 auth_method 0 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -132> 2024-03-04T12:47:23.177+0000 7f1a49789640 10 monclient: get_auth_request con 0x7f1a34091c80 auth_method 0 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -131> 2024-03-04T12:47:23.180+0000 7f1a48f88640 10 monclient: get_auth_request con 0x7f1a340034b0 auth_method 0 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -130> 2024-03-04T12:47:23.180+0000 7f1a48f88640 0 -- 172.21.15.90:0/95435693 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f1a340034b0 msgr2=0x7f1a34009e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -129> 2024-03-04T12:47:23.381+0000 7f1a48f88640 10 monclient: get_auth_request con 0x7f1a340034b0 auth_method 0 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -128> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -127> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -126> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -125> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -124> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -123> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -122> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -121> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.476 INFO:tasks.workunit.client.0.smithi090.stderr: -120> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -119> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -118> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -117> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -116> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 zone default found 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -115> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 4 Realm: () 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -114> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -113> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -112> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -111> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 zonegroup default 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -110> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -109> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -108> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -107> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -106> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.477 INFO:tasks.workunit.client.0.smithi090.stderr: -105> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -104> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 started sync module instance, tier type = 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -103> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -102> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=0 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -101> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=1 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -100> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=2 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -99> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=3 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -98> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=4 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -97> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=5 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -96> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=6 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -95> 2024-03-04T12:47:23.397+0000 7f1a4b48c800 20 add_watcher() i=7 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -94> 2024-03-04T12:47:23.397+0000 7f1a4b48c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -93> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding auth protocol: cephx 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -92> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding auth protocol: cephx 2024-03-04T12:47:23.478 INFO:tasks.workunit.client.0.smithi090.stderr: -91> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding auth protocol: cephx 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -90> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: secure 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -89> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: crc 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -88> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: secure 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -87> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: crc 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -86> 2024-03-04T12:47:23.399+0000 7f18fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -85> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: secure 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -84> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: crc 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -83> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: crc 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -82> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: secure 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -81> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: crc 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -80> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: secure 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -79> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: crc 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -78> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: secure 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -77> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.479 INFO:tasks.workunit.client.0.smithi090.stderr: -76> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -75> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -74> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command cache list hook 0x5586f1825480 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -73> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command cache inspect hook 0x5586f1825480 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -72> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command cache erase hook 0x5586f1825480 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -71> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command cache zap hook 0x5586f1825480 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -70> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 note: GC not initialized 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -69> 2024-03-04T12:47:23.400+0000 7f18fdfe3640 20 reqs_thread_entry: start 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -68> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command sync trace show hook 0x7f1a34004020 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -67> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command sync trace history hook 0x7f1a34004020 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -66> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command sync trace active hook 0x7f1a34004020 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -65> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command sync trace active_short hook 0x7f1a34004020 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -64> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -63> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 Filter name: none 2024-03-04T12:47:23.480 INFO:tasks.workunit.client.0.smithi090.stderr: -62> 2024-03-04T12:47:23.400+0000 7f186f7fe640 20 reqs_thread_entry: start 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -61> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -60> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -59> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -58> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -57> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -56> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 : miss 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -55> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -54> 2024-03-04T12:47:23.401+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -53> 2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -52> 2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -51> 2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -50> 2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -49> 2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -48> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -47> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:23.481 INFO:tasks.workunit.client.0.smithi090.stderr: -46> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -45> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26, ofs0, ns] 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -44> 2024-03-04T12:47:23.406+0000 7f191f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824070 cookie 94038066006560 notifier 6822 bl.length()=893 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -43> 2024-03-04T12:47:23.406+0000 7f191f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -42> 2024-03-04T12:47:23.406+0000 7f191f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -41> 2024-03-04T12:47:23.406+0000 7f191f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -40> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): orig_sources= new_sources= 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -39> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): potential sources added=[] removed=[] 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -38> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): orig_dests= new_dests= 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -37> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): potential dests added=[] removed=[] 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -36> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.0 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -35> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.0 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -34> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.1 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -33> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.1 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -32> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.2 2024-03-04T12:47:23.482 INFO:tasks.workunit.client.0.smithi090.stderr: -31> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.2 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -30> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.3 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -29> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.3 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -28> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.4 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -27> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.4 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -26> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.5 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -25> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.5 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -24> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.6 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -23> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.6 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -22> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.7 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -21> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.7 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -20> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.8 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -19> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.8 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -18> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.9 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -17> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.9 2024-03-04T12:47:23.483 INFO:tasks.workunit.client.0.smithi090.stderr: -16> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.10 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -15> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.10 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -14> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.11 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -13> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.11 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -12> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.0 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -11> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -10> 2024-03-04T12:47:23.410+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.2 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -9> 2024-03-04T12:47:23.410+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.3 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -8> 2024-03-04T12:47:23.410+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.4 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -7> 2024-03-04T12:47:23.411+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.5 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -6> 2024-03-04T12:47:23.411+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.6 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -5> 2024-03-04T12:47:23.412+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.7 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -4> 2024-03-04T12:47:23.412+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.8 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -3> 2024-03-04T12:47:23.413+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.9 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -2> 2024-03-04T12:47:23.413+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.10 2024-03-04T12:47:23.484 INFO:tasks.workunit.client.0.smithi090.stderr: -1> 2024-03-04T12:47:23.417+0000 7f1a4b48c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a4b48c800 time 2024-03-04T12:47:23.417560+0000 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1a4e780e86] 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1a4e781044] 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586ef683eb1] 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5586ef698088] 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: 5: main() 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f1a4d63feb0] 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: 7: __libc_start_main() 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: 8: _start() 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: 0> 2024-03-04T12:47:23.418+0000 7f1a4b48c800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7f1a4b48c800 thread_name:radosgw-admin 2024-03-04T12:47:23.485 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1a4d654db0] 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1a4d6a154c] 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1a4e780ee0] 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1a4e781044] 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586ef683eb1] 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5586ef698088] 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 9: main() 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f1a4d63feb0] 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 11: __libc_start_main() 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 12: _start() 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:47:23.486 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr:--- logging levels --- 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 none 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 lockdep 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 context 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 crush 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_balancer 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_locker 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log_expire 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_migrator 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 buffer 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 timer 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 filer 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 striper 2024-03-04T12:47:23.487 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 objecter 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rados 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_mirror 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_replay 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_pwl 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 journaler 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objectcacher 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 client 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 osd 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 optracker 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objclass 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 filestore 2024-03-04T12:47:23.488 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 journal 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 ms 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mon 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 0/10 monc 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 paxos 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 tp 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 auth 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 crypto 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 finisher 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 reserver 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 heartbeatmap 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 perfcounter 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 20/20 rgw 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_sync 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_datacache 2024-03-04T12:47:23.489 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_access 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_flight 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 javaclient 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 asok 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 throttle 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 refs 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 compressor 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluestore 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluefs 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 bdev 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 kstore 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 4/ 5 rocksdb 2024-03-04T12:47:23.490 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 fuse 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 2/ 5 mgr 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mgrc 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 dpdk 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 eventtrace 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 prioritycache 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 test 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephsqlite 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_onode 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_odata 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_omap 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_tm 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_t 2024-03-04T12:47:23.491 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_epm 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_lba 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cache 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_journal 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_device 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_backref 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 alienstore 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mclock 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cyanstore 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 ceph_exporter 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 memstore 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 trace 2024-03-04T12:47:23.492 INFO:tasks.workunit.client.0.smithi090.stderr: -2/-2 (syslog threshold) 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 99/99 (stderr threshold) 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 7f186f7fe640 / http_manager 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 7f18fdfe3640 / http_manager 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 7f18fefe5640 / rgw_dt_lg_renew 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 7f191e7fc640 / ms_dispatch 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 7f191f7fe640 / io_context_pool 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 7f191ffff640 / io_context_pool 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 7f192e7fc640 / ms_dispatch 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1935602640 / ms_dispatch 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1936e05640 / io_context_pool 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1a43fff640 / msgr-worker-2 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1a48f88640 / msgr-worker-1 2024-03-04T12:47:23.493 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1a49789640 / msgr-worker-0 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1a49f8a640 / io_context_pool 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1a4b48c800 / radosgw-admin 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: max_recent 500 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: max_new 1000 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: log_file /var/log/ceph/ceph-client.admin.105940.log 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr:--- end dump of recent events --- 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr:--- begin dump of recent events --- 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: -499> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: crc 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: -498> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: secure 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: -497> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: crc 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: -496> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: crc 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: -495> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: secure 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: -494> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: crc 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: -493> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: secure 2024-03-04T12:47:23.494 INFO:tasks.workunit.client.0.smithi090.stderr: -492> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: crc 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -491> 2024-03-04T12:47:22.954+0000 7f1a4b48c800 5 AuthRegistry(0x5586f1754590) adding con mode: secure 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -490> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -489> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -488> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command rotate-key hook 0x5586f17546d8 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -487> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -486> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -485> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-c con 0x5586f1600370 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -484> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-a con 0x5586f16937c0 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -483> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-b con 0x5586f1693c20 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -482> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -481> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -480> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -479> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -478> 2024-03-04T12:47:22.955+0000 7f1a4b48c800 10 monclient(hunting): authenticate will time out at 1475.286708s 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -477> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): get_auth_request con 0x5586f16937c0 auth_method 0 2024-03-04T12:47:23.495 INFO:tasks.workunit.client.0.smithi090.stderr: -476> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -475> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -474> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -473> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): get_auth_request con 0x5586f1600370 auth_method 0 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -472> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -471> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -470> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -469> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -468> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -467> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -466> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): get_auth_request con 0x5586f1693c20 auth_method 0 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -465> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -464> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -463> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.496 INFO:tasks.workunit.client.0.smithi090.stderr: -462> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr: -461> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr: -460> 2024-03-04T12:47:22.955+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr: -459> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr: -458> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr: -457> 2024-03-04T12:47:22.955+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr: -456> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient(hunting): handle_auth_done global_id 6813 payload 824 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr: -455> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient: _finish_hunting 0 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr: -454> 2024-03-04T12:47:22.955+0000 7f1a43fff640 1 monclient: found mon.noname-a 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr: -453> 2024-03-04T12:47:22.955+0000 7f1a43fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr: -452> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr: -451> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr: -450> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: dump: 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.497 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr: -449> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: _finish_auth 0 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr: -448> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: _check_auth_tickets 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr: -447> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr: -446> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr: -445> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:23.498 INFO:tasks.workunit.client.0.smithi090.stderr: -444> 2024-03-04T12:47:22.956+0000 7f1935602640 10 monclient: dump: 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr: -443> 2024-03-04T12:47:22.956+0000 7f1a4b48c800 5 monclient: authenticate success, global_id 6813 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr: -442> 2024-03-04T12:47:22.956+0000 7f1936e05640 4 set_mon_vals no callback set 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr: -441> 2024-03-04T12:47:22.956+0000 7f1a4b48c800 10 monclient: _renew_subs 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr: -440> 2024-03-04T12:47:22.956+0000 7f1a4b48c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.499 INFO:tasks.workunit.client.0.smithi090.stderr: -439> 2024-03-04T12:47:22.956+0000 7f1a4b48c800 10 monclient: _renew_subs 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr: -438> 2024-03-04T12:47:22.956+0000 7f1a4b48c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr: -437> 2024-03-04T12:47:22.956+0000 7f1a4b48c800 1 librados: init done 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr: -436> 2024-03-04T12:47:22.957+0000 7f1935602640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr: -435> 2024-03-04T12:47:22.957+0000 7f1935602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr: -434> 2024-03-04T12:47:22.957+0000 7f1935602640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr: -433> 2024-03-04T12:47:22.957+0000 7f1a48f88640 10 monclient: get_auth_request con 0x7f1930069eb0 auth_method 0 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr: -432> 2024-03-04T12:47:22.958+0000 7f1a49789640 10 monclient: get_auth_request con 0x5586f17967d0 auth_method 0 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr: -431> 2024-03-04T12:47:22.958+0000 7f1a48f88640 10 monclient: get_auth_request con 0x5586f179ff40 auth_method 0 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr: -430> 2024-03-04T12:47:22.959+0000 7f1a43fff640 10 monclient: get_auth_request con 0x5586f17a4130 auth_method 0 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr: -429> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 10 monclient: build_initial_monmap 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr: -428> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 1 build_initial for_mkfs: 0 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr: -427> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 10 monclient: monmap: 2024-03-04T12:47:23.500 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr: -426> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding auth protocol: cephx 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr: -425> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding auth protocol: cephx 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr: -424> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding auth protocol: cephx 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr: -423> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: secure 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr: -422> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: crc 2024-03-04T12:47:23.501 INFO:tasks.workunit.client.0.smithi090.stderr: -421> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: secure 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -420> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: crc 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -419> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: secure 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -418> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: crc 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -417> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: crc 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -416> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: secure 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -415> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: crc 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -414> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: secure 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -413> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: crc 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -412> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a8e40) adding con mode: secure 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -411> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -410> 2024-03-04T12:47:22.960+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command objecter_requests cmddesc objecter_requests hook 0x5586f17adc30 EEXIST 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -409> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient: init 2024-03-04T12:47:23.502 INFO:tasks.workunit.client.0.smithi090.stderr: -408> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding auth protocol: cephx 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -407> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding auth protocol: cephx 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -406> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding auth protocol: cephx 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -405> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: secure 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -404> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: crc 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -403> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: secure 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -402> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: crc 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -401> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: secure 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -400> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: crc 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -399> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: crc 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -398> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: secure 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -397> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: crc 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -396> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: secure 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -395> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: crc 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -394> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17a75d8) adding con mode: secure 2024-03-04T12:47:23.503 INFO:tasks.workunit.client.0.smithi090.stderr: -393> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -392> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -391> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command rotate-key cmddesc rotate-key hook 0x5586f17a7720 EEXIST 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -390> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -389> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -388> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-c con 0x5586f17d4460 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -387> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-a con 0x5586f17d4840 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -386> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-b con 0x5586f17e7040 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -385> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -384> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -383> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -382> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -381> 2024-03-04T12:47:22.961+0000 7f1a4b48c800 10 monclient(hunting): authenticate will time out at 1475.292806s 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -380> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): get_auth_request con 0x5586f17d4840 auth_method 0 2024-03-04T12:47:23.504 INFO:tasks.workunit.client.0.smithi090.stderr: -379> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -378> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -377> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -376> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): get_auth_request con 0x5586f17d4460 auth_method 0 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -375> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -374> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -373> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -372> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -371> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -370> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -369> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -368> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -367> 2024-03-04T12:47:22.961+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -366> 2024-03-04T12:47:22.961+0000 7f1a49789640 10 monclient(hunting): get_auth_request con 0x5586f17e7040 auth_method 0 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -365> 2024-03-04T12:47:22.961+0000 7f1a49789640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -364> 2024-03-04T12:47:22.961+0000 7f1a49789640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.505 INFO:tasks.workunit.client.0.smithi090.stderr: -363> 2024-03-04T12:47:22.961+0000 7f1a49789640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr: -362> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient(hunting): handle_auth_done global_id 6816 payload 824 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr: -361> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient: _finish_hunting 0 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr: -360> 2024-03-04T12:47:22.961+0000 7f1a43fff640 1 monclient: found mon.noname-a 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr: -359> 2024-03-04T12:47:22.961+0000 7f1a43fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr: -358> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr: -357> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr: -356> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: dump: 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.506 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr: -355> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: _finish_auth 0 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr: -354> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: _check_auth_tickets 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr: -353> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr: -352> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr: -351> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr: -350> 2024-03-04T12:47:22.962+0000 7f192e7fc640 10 monclient: dump: 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.507 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -349> 2024-03-04T12:47:22.962+0000 7f1a4b48c800 5 monclient: authenticate success, global_id 6816 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -348> 2024-03-04T12:47:22.962+0000 7f1a4b48c800 10 monclient: _renew_subs 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -347> 2024-03-04T12:47:22.962+0000 7f1a49f8a640 4 set_mon_vals no callback set 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -346> 2024-03-04T12:47:22.962+0000 7f1a4b48c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -345> 2024-03-04T12:47:22.962+0000 7f1a4b48c800 10 monclient: _renew_subs 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -344> 2024-03-04T12:47:22.962+0000 7f1a4b48c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -343> 2024-03-04T12:47:22.963+0000 7f192e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -342> 2024-03-04T12:47:22.963+0000 7f192e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -341> 2024-03-04T12:47:22.963+0000 7f192e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -340> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 10 monclient: get_monmap_and_config 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -339> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 10 monclient: build_initial_monmap 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -338> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 1 build_initial for_mkfs: 0 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr: -337> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 10 monclient: monmap: 2024-03-04T12:47:23.508 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr: -336> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding auth protocol: cephx 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr: -335> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding auth protocol: cephx 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr: -334> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding auth protocol: cephx 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr: -333> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: secure 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr: -332> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: crc 2024-03-04T12:47:23.509 INFO:tasks.workunit.client.0.smithi090.stderr: -331> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: secure 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -330> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: crc 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -329> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: secure 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -328> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: crc 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -327> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: crc 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -326> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: secure 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -325> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: crc 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -324> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: secure 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -323> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: crc 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -322> 2024-03-04T12:47:22.963+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1f00) adding con mode: secure 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -321> 2024-03-04T12:47:22.963+0000 7f1a48f88640 10 monclient: get_auth_request con 0x7f1920069dc0 auth_method 0 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -320> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -319> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient: init 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -318> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding auth protocol: cephx 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -317> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding auth protocol: cephx 2024-03-04T12:47:23.510 INFO:tasks.workunit.client.0.smithi090.stderr: -316> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding auth protocol: cephx 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -315> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: secure 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -314> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: crc 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -313> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: secure 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -312> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: crc 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -311> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: secure 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -310> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: crc 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -309> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: crc 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -308> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: secure 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -307> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: crc 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -306> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: secure 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -305> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: crc 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -304> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf18653a0) adding con mode: secure 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -303> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -302> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.511 INFO:tasks.workunit.client.0.smithi090.stderr: -301> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command rotate-key cmddesc rotate-key hook 0x7ffcf18654e8 EEXIST 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -300> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -299> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -298> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-b con 0x5586f1826850 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -297> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-a con 0x5586f1826c30 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -296> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-c con 0x5586f18189b0 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -295> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -294> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -293> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -292> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -291> 2024-03-04T12:47:22.964+0000 7f1a4b48c800 10 monclient(hunting): authenticate will time out at 1475.295997s 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -290> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): get_auth_request con 0x5586f18189b0 auth_method 0 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -289> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.512 INFO:tasks.workunit.client.0.smithi090.stderr: -288> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -287> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -286> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): get_auth_request con 0x5586f1826c30 auth_method 0 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -285> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -284> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -283> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -282> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): get_auth_request con 0x5586f1826850 auth_method 0 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -281> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -280> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -279> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -278> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -277> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -276> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -275> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -274> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -273> 2024-03-04T12:47:22.964+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.513 INFO:tasks.workunit.client.0.smithi090.stderr: -272> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr: -271> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr: -270> 2024-03-04T12:47:22.964+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr: -269> 2024-03-04T12:47:22.964+0000 7f1a43fff640 10 monclient(hunting): handle_auth_done global_id 6819 payload 274 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr: -268> 2024-03-04T12:47:22.965+0000 7f1a43fff640 10 monclient: _finish_hunting 0 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr: -267> 2024-03-04T12:47:22.965+0000 7f1a43fff640 1 monclient: found mon.noname-a 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr: -266> 2024-03-04T12:47:22.965+0000 7f1a43fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr: -265> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr: -264> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr: -263> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: dump: 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.514 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr: -262> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: _finish_auth 0 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr: -261> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: _check_auth_tickets 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr: -260> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr: -259> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr: -258> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr: -257> 2024-03-04T12:47:22.965+0000 7f191ffff640 10 monclient: dump: 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.515 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr: -256> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 monclient: authenticate success, global_id 6819 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr: -255> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 10 monclient: get_monmap_and_config success 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr: -254> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 4 set_mon_vals no callback set 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr: -253> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 10 monclient: shutdown 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr: -252> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 10 monclient: build_initial_monmap 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr: -251> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 1 build_initial for_mkfs: 0 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr: -250> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 10 monclient: monmap: 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.516 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -249> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding auth protocol: cephx 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -248> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding auth protocol: cephx 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -247> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding auth protocol: cephx 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -246> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: secure 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -245> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: crc 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -244> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: secure 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -243> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: crc 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -242> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: secure 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -241> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: crc 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -240> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: crc 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -239> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: secure 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -238> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: crc 2024-03-04T12:47:23.517 INFO:tasks.workunit.client.0.smithi090.stderr: -237> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: secure 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -236> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: crc 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -235> 2024-03-04T12:47:22.965+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17f1eb0) adding con mode: secure 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -234> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -233> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 1 librados: starting msgr at 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -232> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 1 librados: starting objecter 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -231> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command objecter_requests cmddesc objecter_requests hook 0x5586f1822960 EEXIST 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -230> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 1 librados: setting wanted keys 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -229> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 1 librados: calling monclient init 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -228> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient: init 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -227> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding auth protocol: cephx 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -226> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding auth protocol: cephx 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -225> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding auth protocol: cephx 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -224> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: secure 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -223> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: crc 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -222> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: secure 2024-03-04T12:47:23.518 INFO:tasks.workunit.client.0.smithi090.stderr: -221> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: crc 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -220> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: secure 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -219> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: crc 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -218> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: crc 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -217> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: secure 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -216> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: crc 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -215> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: secure 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -214> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: crc 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -213> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 AuthRegistry(0x5586f17cf190) adding con mode: secure 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -212> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -211> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -210> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command rotate-key cmddesc rotate-key hook 0x5586f17cf2d8 EEXIST 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -209> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -208> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -207> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-b con 0x5586f18189b0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:23.519 INFO:tasks.workunit.client.0.smithi090.stderr: -206> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-a con 0x5586f1826850 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -205> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): picked mon.noname-c con 0x5586f1825080 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -204> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -203> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -202> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -201> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -200> 2024-03-04T12:47:22.966+0000 7f1a4b48c800 10 monclient(hunting): authenticate will time out at 1475.298081s 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -199> 2024-03-04T12:47:22.966+0000 7f1a43fff640 10 monclient(hunting): get_auth_request con 0x5586f1826850 auth_method 0 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -198> 2024-03-04T12:47:22.966+0000 7f1a43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -197> 2024-03-04T12:47:22.966+0000 7f1a43fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -196> 2024-03-04T12:47:22.966+0000 7f1a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -195> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): get_auth_request con 0x5586f1825080 auth_method 0 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -194> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -193> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -192> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.520 INFO:tasks.workunit.client.0.smithi090.stderr: -191> 2024-03-04T12:47:22.966+0000 7f1a48f88640 10 monclient(hunting): get_auth_request con 0x5586f18189b0 auth_method 0 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -190> 2024-03-04T12:47:22.966+0000 7f1a48f88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -189> 2024-03-04T12:47:22.966+0000 7f1a48f88640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -188> 2024-03-04T12:47:22.966+0000 7f1a48f88640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -187> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -186> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -185> 2024-03-04T12:47:22.966+0000 7f1a49789640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -184> 2024-03-04T12:47:22.967+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -183> 2024-03-04T12:47:22.967+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -182> 2024-03-04T12:47:22.967+0000 7f1a43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -181> 2024-03-04T12:47:22.967+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -180> 2024-03-04T12:47:22.967+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -179> 2024-03-04T12:47:22.967+0000 7f1a48f88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -178> 2024-03-04T12:47:22.967+0000 7f1a43fff640 10 monclient(hunting): handle_auth_done global_id 6822 payload 824 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -177> 2024-03-04T12:47:22.967+0000 7f1a43fff640 10 monclient: _finish_hunting 0 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -176> 2024-03-04T12:47:22.967+0000 7f1a43fff640 1 monclient: found mon.noname-a 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -175> 2024-03-04T12:47:22.967+0000 7f1a43fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.521 INFO:tasks.workunit.client.0.smithi090.stderr: -174> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr: -173> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr: -172> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: dump: 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr: -171> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: _finish_auth 0 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr: -170> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: _check_auth_tickets 2024-03-04T12:47:23.522 INFO:tasks.workunit.client.0.smithi090.stderr: -169> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr: -168> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr: -167> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr: -166> 2024-03-04T12:47:22.967+0000 7f191e7fc640 10 monclient: dump: 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr: -165> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 5 monclient: authenticate success, global_id 6822 2024-03-04T12:47:23.523 INFO:tasks.workunit.client.0.smithi090.stderr: -164> 2024-03-04T12:47:22.967+0000 7f191ffff640 4 set_mon_vals no callback set 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -163> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 10 monclient: _renew_subs 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -162> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -161> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 10 monclient: _renew_subs 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -160> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -159> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 1 librados: init done 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -158> 2024-03-04T12:47:22.967+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command cr dump hook 0x5586f1821f78 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -157> 2024-03-04T12:47:22.968+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -156> 2024-03-04T12:47:22.969+0000 7f191e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -155> 2024-03-04T12:47:22.969+0000 7f191e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -154> 2024-03-04T12:47:22.969+0000 7f191e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -153> 2024-03-04T12:47:22.969+0000 7f1a48f88640 10 monclient: get_auth_request con 0x7f1914069eb0 auth_method 0 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -152> 2024-03-04T12:47:22.969+0000 7f1a49789640 10 monclient: get_auth_request con 0x5586f1840460 auth_method 0 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -151> 2024-03-04T12:47:22.969+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -150> 2024-03-04T12:47:22.969+0000 7f1a4b48c800 20 realm 2024-03-04T12:47:23.524 INFO:tasks.workunit.client.0.smithi090.stderr: -149> 2024-03-04T12:47:22.969+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -148> 2024-03-04T12:47:22.970+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -147> 2024-03-04T12:47:22.970+0000 7f1a4b48c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -146> 2024-03-04T12:47:22.970+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -145> 2024-03-04T12:47:22.970+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -144> 2024-03-04T12:47:22.970+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -143> 2024-03-04T12:47:22.970+0000 7f1a48f88640 10 monclient: get_auth_request con 0x5586f18446b0 auth_method 0 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -142> 2024-03-04T12:47:22.971+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -141> 2024-03-04T12:47:22.971+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -140> 2024-03-04T12:47:22.971+0000 7f1a43fff640 10 monclient: get_auth_request con 0x5586f1847f10 auth_method 0 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -139> 2024-03-04T12:47:22.971+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -138> 2024-03-04T12:47:22.971+0000 7f1a4b48c800 20 searching for the correct realm 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -137> 2024-03-04T12:47:22.971+0000 7f1a49789640 10 monclient: get_auth_request con 0x5586f184cc30 auth_method 0 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -136> 2024-03-04T12:47:22.972+0000 7f1a48f88640 10 monclient: get_auth_request con 0x7f1a4402d040 auth_method 0 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -135> 2024-03-04T12:47:22.973+0000 7f1a43fff640 10 monclient: get_auth_request con 0x7f1a340c8070 auth_method 0 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -134> 2024-03-04T12:47:22.974+0000 7f1a43fff640 0 -- 172.21.15.90:0/95435693 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f1a340c8070 msgr2=0x7f1a34061820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -133> 2024-03-04T12:47:23.175+0000 7f1a43fff640 10 monclient: get_auth_request con 0x7f1a340c8070 auth_method 0 2024-03-04T12:47:23.525 INFO:tasks.workunit.client.0.smithi090.stderr: -132> 2024-03-04T12:47:23.177+0000 7f1a49789640 10 monclient: get_auth_request con 0x7f1a34091c80 auth_method 0 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -131> 2024-03-04T12:47:23.180+0000 7f1a48f88640 10 monclient: get_auth_request con 0x7f1a340034b0 auth_method 0 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -130> 2024-03-04T12:47:23.180+0000 7f1a48f88640 0 -- 172.21.15.90:0/95435693 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f1a340034b0 msgr2=0x7f1a34009e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -129> 2024-03-04T12:47:23.381+0000 7f1a48f88640 10 monclient: get_auth_request con 0x7f1a340034b0 auth_method 0 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -128> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -127> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -126> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -125> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -124> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -123> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -122> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -121> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -120> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -119> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -118> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -117> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:23.526 INFO:tasks.workunit.client.0.smithi090.stderr: -116> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 zone default found 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -115> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 4 Realm: () 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -114> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -113> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -112> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -111> 2024-03-04T12:47:23.386+0000 7f1a4b48c800 20 zonegroup default 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -110> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -109> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -108> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -107> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -106> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -105> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -104> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 started sync module instance, tier type = 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -103> 2024-03-04T12:47:23.387+0000 7f1a4b48c800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -102> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=0 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -101> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=1 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -100> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=2 2024-03-04T12:47:23.527 INFO:tasks.workunit.client.0.smithi090.stderr: -99> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=3 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -98> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=4 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -97> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=5 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -96> 2024-03-04T12:47:23.396+0000 7f1a4b48c800 20 add_watcher() i=6 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -95> 2024-03-04T12:47:23.397+0000 7f1a4b48c800 20 add_watcher() i=7 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -94> 2024-03-04T12:47:23.397+0000 7f1a4b48c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -93> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding auth protocol: cephx 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -92> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding auth protocol: cephx 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -91> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding auth protocol: cephx 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -90> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: secure 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -89> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: crc 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -88> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: secure 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -87> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: crc 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -86> 2024-03-04T12:47:23.399+0000 7f18fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:23.528 INFO:tasks.workunit.client.0.smithi090.stderr: -85> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: secure 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -84> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: crc 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -83> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: crc 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -82> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: secure 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -81> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: crc 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -80> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: secure 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -79> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: crc 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -78> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 5 AuthRegistry(0x7ffcf1865830) adding con mode: secure 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -77> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -76> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -75> 2024-03-04T12:47:23.399+0000 7f1a4b48c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -74> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command cache list hook 0x5586f1825480 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -73> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command cache inspect hook 0x5586f1825480 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -72> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command cache erase hook 0x5586f1825480 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -71> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command cache zap hook 0x5586f1825480 2024-03-04T12:47:23.529 INFO:tasks.workunit.client.0.smithi090.stderr: -70> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 note: GC not initialized 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -69> 2024-03-04T12:47:23.400+0000 7f18fdfe3640 20 reqs_thread_entry: start 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -68> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command sync trace show hook 0x7f1a34004020 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -67> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command sync trace history hook 0x7f1a34004020 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -66> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command sync trace active hook 0x7f1a34004020 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -65> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 5 asok(0x5586f15380c0) register_command sync trace active_short hook 0x7f1a34004020 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -64> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -63> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 Filter name: none 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -62> 2024-03-04T12:47:23.400+0000 7f186f7fe640 20 reqs_thread_entry: start 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -61> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -60> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -59> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -58> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -57> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -56> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 : miss 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -55> 2024-03-04T12:47:23.400+0000 7f1a4b48c800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.530 INFO:tasks.workunit.client.0.smithi090.stderr: -54> 2024-03-04T12:47:23.401+0000 7f1a4b48c800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -53> 2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -52> 2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -51> 2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -50> 2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -49> 2024-03-04T12:47:23.401+0000 7f1a4b48c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -48> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -47> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -46> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -45> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26, ofs0, ns] 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -44> 2024-03-04T12:47:23.406+0000 7f191f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824070 cookie 94038066006560 notifier 6822 bl.length()=893 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -43> 2024-03-04T12:47:23.406+0000 7f191f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -42> 2024-03-04T12:47:23.406+0000 7f191f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -41> 2024-03-04T12:47:23.406+0000 7f191f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -40> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): orig_sources= new_sources= 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -39> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): potential sources added=[] removed=[] 2024-03-04T12:47:23.531 INFO:tasks.workunit.client.0.smithi090.stderr: -38> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): orig_dests= new_dests= 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -37> 2024-03-04T12:47:23.406+0000 7f1a4b48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): potential dests added=[] removed=[] 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -36> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.0 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -35> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.0 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -34> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.1 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -33> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.1 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -32> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.2 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -31> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.2 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -30> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.3 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -29> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.3 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -28> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.4 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -27> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.4 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -26> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.5 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -25> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.5 2024-03-04T12:47:23.532 INFO:tasks.workunit.client.0.smithi090.stderr: -24> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.6 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -23> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.6 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -22> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.7 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -21> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.7 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -20> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.8 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -19> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.8 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -18> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.9 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -17> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.9 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -16> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.10 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -15> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.10 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -14> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.11 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -13> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.11 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -12> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.0 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -11> 2024-03-04T12:47:23.409+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -10> 2024-03-04T12:47:23.410+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.2 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -9> 2024-03-04T12:47:23.410+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.3 2024-03-04T12:47:23.533 INFO:tasks.workunit.client.0.smithi090.stderr: -8> 2024-03-04T12:47:23.410+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.4 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: -7> 2024-03-04T12:47:23.411+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.5 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: -6> 2024-03-04T12:47:23.411+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.6 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: -5> 2024-03-04T12:47:23.412+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.7 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: -4> 2024-03-04T12:47:23.412+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.8 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: -3> 2024-03-04T12:47:23.413+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.9 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: -2> 2024-03-04T12:47:23.413+0000 7f1a4b48c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.10 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: -1> 2024-03-04T12:47:23.417+0000 7f1a4b48c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a4b48c800 time 2024-03-04T12:47:23.417560+0000 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1a4e780e86] 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1a4e781044] 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586ef683eb1] 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5586ef698088] 2024-03-04T12:47:23.534 INFO:tasks.workunit.client.0.smithi090.stderr: 5: main() 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f1a4d63feb0] 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 7: __libc_start_main() 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 8: _start() 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 0> 2024-03-04T12:47:23.418+0000 7f1a4b48c800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7f1a4b48c800 thread_name:radosgw-admin 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1a4d654db0] 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1a4d6a154c] 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1a4e780ee0] 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1a4e781044] 2024-03-04T12:47:23.535 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5586ef683eb1] 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5586ef698088] 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 9: main() 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f1a4d63feb0] 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 11: __libc_start_main() 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 12: _start() 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr:--- logging levels --- 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 none 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 lockdep 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 context 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 crush 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_balancer 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_locker 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log 2024-03-04T12:47:23.536 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log_expire 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_migrator 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 buffer 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 timer 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 filer 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 striper 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 objecter 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rados 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_mirror 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_replay 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_pwl 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 journaler 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objectcacher 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 client 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 osd 2024-03-04T12:47:23.537 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 optracker 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objclass 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 filestore 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 journal 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 ms 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mon 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 0/10 monc 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 paxos 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 tp 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 auth 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 crypto 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 finisher 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 reserver 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 heartbeatmap 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 perfcounter 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 20/20 rgw 2024-03-04T12:47:23.538 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_sync 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_datacache 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_access 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_flight 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 javaclient 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 asok 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 throttle 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 refs 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 compressor 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluestore 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluefs 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 bdev 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 kstore 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 4/ 5 rocksdb 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 fuse 2024-03-04T12:47:23.539 INFO:tasks.workunit.client.0.smithi090.stderr: 2/ 5 mgr 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mgrc 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 dpdk 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 eventtrace 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 prioritycache 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 test 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephsqlite 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_onode 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_odata 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_omap 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_tm 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_t 2024-03-04T12:47:23.540 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:47:23.541 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_epm 2024-03-04T12:47:23.541 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_lba 2024-03-04T12:47:23.541 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:47:23.541 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cache 2024-03-04T12:47:23.541 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_journal 2024-03-04T12:47:23.541 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_device 2024-03-04T12:47:23.541 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_backref 2024-03-04T12:47:23.541 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 alienstore 2024-03-04T12:47:23.541 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mclock 2024-03-04T12:47:23.541 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cyanstore 2024-03-04T12:47:23.541 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 ceph_exporter 2024-03-04T12:47:23.541 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 memstore 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 trace 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: -2/-2 (syslog threshold) 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 99/99 (stderr threshold) 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 7f186f7fe640 / http_manager 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 7f18fdfe3640 / http_manager 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 7f18fefe5640 / rgw_dt_lg_renew 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 7f191e7fc640 / ms_dispatch 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 7f191f7fe640 / io_context_pool 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 7f191ffff640 / io_context_pool 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 7f192e7fc640 / ms_dispatch 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1935602640 / ms_dispatch 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1936e05640 / io_context_pool 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1a43fff640 / msgr-worker-2 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1a48f88640 / msgr-worker-1 2024-03-04T12:47:23.542 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1a49789640 / msgr-worker-0 2024-03-04T12:47:23.543 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1a49f8a640 / io_context_pool 2024-03-04T12:47:23.543 INFO:tasks.workunit.client.0.smithi090.stderr: 7f1a4b48c800 / radosgw-admin 2024-03-04T12:47:23.543 INFO:tasks.workunit.client.0.smithi090.stderr: max_recent 500 2024-03-04T12:47:23.543 INFO:tasks.workunit.client.0.smithi090.stderr: max_new 1000 2024-03-04T12:47:23.543 INFO:tasks.workunit.client.0.smithi090.stderr: log_file /var/lib/ceph/crash/2024-03-04T12:47:23.418932Z_a1f5f394-9565-4838-ac1e-4c0a8a037b2f/log 2024-03-04T12:47:23.543 INFO:tasks.workunit.client.0.smithi090.stderr:--- end dump of recent events --- 2024-03-04T12:47:23.543 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-04T12:47:23.543 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:23.544 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:23.691 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.685+0000 7f609b86f640 0 --2- 172.21.15.90:0/4110868459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f3c6290dc0 0x55f3c628c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-04T12:47:23.695 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.689+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.691+0000 7f60a0c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.691+0000 7f60a0c39800 20 realm 2024-03-04T12:47:23.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.691+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.691+0000 7f60a0c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.691+0000 7f60a0c39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:23.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.691+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.691+0000 7f60a0c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.697 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.691+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.692+0000 7f60a0c39800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:23.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.692+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.693+0000 7f60a0c39800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:23.698 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.693+0000 7f60a0c39800 20 searching for the correct realm 2024-03-04T12:47:23.700 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.694+0000 7f609b86f640 0 -- 172.21.15.90:0/900337172 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f6094070be0 msgr2=0x7f6094057dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:23.905 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.899+0000 7f609b06e640 0 -- 172.21.15.90:0/900337172 >> [v2:172.21.15.90:6817/137526376,v1:172.21.15.90:6819/137526376] conn(0x55f3c62b2690 msgr2=0x55f3c62b4a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:23.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.905+0000 7f60a0c39800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:23.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.905+0000 7f60a0c39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:23.911 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.905+0000 7f60a0c39800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:23.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.905+0000 7f60a0c39800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:23.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.905+0000 7f60a0c39800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:23.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.905+0000 7f60a0c39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:23.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.905+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.905+0000 7f60a0c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.905+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.906+0000 7f60a0c39800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:23.912 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.906+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.906+0000 7f60a0c39800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:23.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.906+0000 7f60a0c39800 20 zone default found 2024-03-04T12:47:23.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.906+0000 7f60a0c39800 4 Realm: () 2024-03-04T12:47:23.913 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.906+0000 7f60a0c39800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:23.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.906+0000 7f60a0c39800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:23.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.906+0000 7f60a0c39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:23.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.906+0000 7f60a0c39800 20 zonegroup default 2024-03-04T12:47:23.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.906+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.906+0000 7f60a0c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.906+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.907+0000 7f60a0c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.907+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.907+0000 7f60a0c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.907+0000 7f60a0c39800 20 started sync module instance, tier type = 2024-03-04T12:47:23.914 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.907+0000 7f60a0c39800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:23.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.917+0000 7f60a0c39800 20 add_watcher() i=0 2024-03-04T12:47:23.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.917+0000 7f60a0c39800 20 add_watcher() i=1 2024-03-04T12:47:23.922 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.917+0000 7f60a0c39800 20 add_watcher() i=2 2024-03-04T12:47:23.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.917+0000 7f60a0c39800 20 add_watcher() i=3 2024-03-04T12:47:23.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.917+0000 7f60a0c39800 20 add_watcher() i=4 2024-03-04T12:47:23.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.917+0000 7f60a0c39800 20 add_watcher() i=5 2024-03-04T12:47:23.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.917+0000 7f60a0c39800 20 add_watcher() i=6 2024-03-04T12:47:23.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.917+0000 7f60a0c39800 20 add_watcher() i=7 2024-03-04T12:47:23.923 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.917+0000 7f60a0c39800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:23.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.919+0000 7f5f51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:23.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.919+0000 7f60a0c39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:23.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.919+0000 7f60a0c39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:23.925 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.919+0000 7f60a0c39800 5 note: GC not initialized 2024-03-04T12:47:23.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.920+0000 7f5f50fe1640 20 reqs_thread_entry: start 2024-03-04T12:47:23.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.920+0000 7f60a0c39800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:23.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.920+0000 7f60a0c39800 20 Filter name: none 2024-03-04T12:47:23.926 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.920+0000 7f5eca7fc640 20 reqs_thread_entry: start 2024-03-04T12:47:23.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.920+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.920+0000 7f60a0c39800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:23.927 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.920+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.921+0000 7f60a0c39800 20 rados_obj.operate() r=0 bl.length=413 2024-03-04T12:47:23.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.921+0000 7f60a0c39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:23.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.921+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.921+0000 7f60a0c39800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:23.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.921+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.921+0000 7f60a0c39800 20 rados_obj.operate() r=0 bl.length=413 2024-03-04T12:47:23.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.921+0000 7f60a0c39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:23.928 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.922+0000 7f60a0c39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:23.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.923+0000 7f60a0c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:23.929 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.923+0000 7f5f51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:23.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.925+0000 7f60a0c39800 20 remove_watcher() i=0 2024-03-04T12:47:23.931 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.925+0000 7f60a0c39800 2 removed watcher, disabling cache 2024-03-04T12:47:23.932 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.926+0000 7f60a0c39800 20 remove_watcher() i=1 2024-03-04T12:47:23.933 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.927+0000 7f60a0c39800 20 remove_watcher() i=2 2024-03-04T12:47:23.934 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.929+0000 7f60a0c39800 20 remove_watcher() i=3 2024-03-04T12:47:23.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.930+0000 7f60a0c39800 20 remove_watcher() i=4 2024-03-04T12:47:23.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.931+0000 7f60a0c39800 20 remove_watcher() i=5 2024-03-04T12:47:23.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.932+0000 7f60a0c39800 20 remove_watcher() i=6 2024-03-04T12:47:23.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:23.932+0000 7f60a0c39800 20 remove_watcher() i=7 2024-03-04T12:47:23.948 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.948 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:23.948 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: abort-at-commit-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:47:23.948 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:23.950 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:23.950 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:53.990 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:53.991 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:54.034 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:47:54.070 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:54.070 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:54.108 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.101+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.102+0000 7f247df0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.102+0000 7f247df0d800 20 realm 2024-03-04T12:47:54.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.102+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.103+0000 7f247df0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.103+0000 7f247df0d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:54.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.103+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.103+0000 7f247df0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.110 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.103+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.104+0000 7f247df0d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:54.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.104+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.104+0000 7f247df0d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:54.111 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.104+0000 7f247df0d800 20 searching for the correct realm 2024-03-04T12:47:54.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.107+0000 7f247b208640 0 -- 172.21.15.90:0/3322266530 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f2470018070 msgr2=0x7f247005aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:54.118 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.112+0000 7f247b208640 0 -- 172.21.15.90:0/3322266530 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f2470018070 msgr2=0x7f234407ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:54.328 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.319+0000 7f247df0d800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:54.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.319+0000 7f247df0d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:54.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.319+0000 7f247df0d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:54.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.319+0000 7f247df0d800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:54.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.319+0000 7f247df0d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:54.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.319+0000 7f247df0d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:54.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.319+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.320+0000 7f247df0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.320+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.320+0000 7f247df0d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:54.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.320+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.329 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.320+0000 7f247df0d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:54.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.320+0000 7f247df0d800 20 zone default found 2024-03-04T12:47:54.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.320+0000 7f247df0d800 4 Realm: () 2024-03-04T12:47:54.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.320+0000 7f247df0d800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:54.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.320+0000 7f247df0d800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:54.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.320+0000 7f247df0d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:54.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.320+0000 7f247df0d800 20 zonegroup default 2024-03-04T12:47:54.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.320+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.321+0000 7f247df0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.321+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.321+0000 7f247df0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.330 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.321+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.321+0000 7f247df0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.321+0000 7f247df0d800 20 started sync module instance, tier type = 2024-03-04T12:47:54.331 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.321+0000 7f247df0d800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:54.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.331+0000 7f247df0d800 20 add_watcher() i=0 2024-03-04T12:47:54.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.331+0000 7f247df0d800 20 add_watcher() i=1 2024-03-04T12:47:54.338 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.331+0000 7f247df0d800 20 add_watcher() i=2 2024-03-04T12:47:54.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.331+0000 7f247df0d800 20 add_watcher() i=3 2024-03-04T12:47:54.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.331+0000 7f247df0d800 20 add_watcher() i=4 2024-03-04T12:47:54.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.331+0000 7f247df0d800 20 add_watcher() i=5 2024-03-04T12:47:54.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.331+0000 7f247df0d800 20 add_watcher() i=6 2024-03-04T12:47:54.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.332+0000 7f247df0d800 20 add_watcher() i=7 2024-03-04T12:47:54.339 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.332+0000 7f247df0d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:54.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.334+0000 7f2331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:54.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.335+0000 7f247df0d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:54.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.335+0000 7f247df0d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:54.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.335+0000 7f247df0d800 5 note: GC not initialized 2024-03-04T12:47:54.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.335+0000 7f2330fe1640 20 reqs_thread_entry: start 2024-03-04T12:47:54.342 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.335+0000 7f247df0d800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:54.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.335+0000 7f247df0d800 20 Filter name: none 2024-03-04T12:47:54.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.335+0000 7f22aa7fc640 20 reqs_thread_entry: start 2024-03-04T12:47:54.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.335+0000 7f247df0d800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-04T12:47:54.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.335+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.336+0000 7f247df0d800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:54.343 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.336+0000 7f247df0d800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-04T12:47:54.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.336+0000 7f247df0d800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-04T12:47:54.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.336+0000 7f247df0d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 : miss 2024-03-04T12:47:54.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.336+0000 7f247df0d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.336+0000 7f247df0d800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:54.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.336+0000 7f247df0d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:54.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.336+0000 7f247df0d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:54.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.336+0000 7f247df0d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:54.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.336+0000 7f247df0d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:54.344 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.336+0000 7f247df0d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 2024-03-04T12:47:54.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.341+0000 7f247df0d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:54.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.341+0000 7f247df0d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:54.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.341+0000 7f247df0d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:54.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.341+0000 7f247df0d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26, ofs0, ns] 2024-03-04T12:47:54.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.342+0000 7f235affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824072 cookie 94200384991216 notifier 6479 bl.length()=893 2024-03-04T12:47:54.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.342+0000 7f235affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:54.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.342+0000 7f235affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:54.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.342+0000 7f235affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:54.349 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.342+0000 7f247df0d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): orig_sources= new_sources= 2024-03-04T12:47:54.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.342+0000 7f247df0d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): potential sources added=[] removed=[] 2024-03-04T12:47:54.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.342+0000 7f247df0d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): orig_dests= new_dests= 2024-03-04T12:47:54.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.342+0000 7f247df0d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): potential dests added=[] removed=[] 2024-03-04T12:47:54.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.0 2024-03-04T12:47:54.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.0 2024-03-04T12:47:54.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.1 2024-03-04T12:47:54.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.1 2024-03-04T12:47:54.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.2 2024-03-04T12:47:54.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.2 2024-03-04T12:47:54.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.3 2024-03-04T12:47:54.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.3 2024-03-04T12:47:54.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.4 2024-03-04T12:47:54.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.4 2024-03-04T12:47:54.353 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.5 2024-03-04T12:47:54.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.5 2024-03-04T12:47:54.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.6 2024-03-04T12:47:54.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.6 2024-03-04T12:47:54.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.7 2024-03-04T12:47:54.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.7 2024-03-04T12:47:54.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.8 2024-03-04T12:47:54.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.8 2024-03-04T12:47:54.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.9 2024-03-04T12:47:54.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.9 2024-03-04T12:47:54.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.10 2024-03-04T12:47:54.354 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.10 2024-03-04T12:47:54.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.11 2024-03-04T12:47:54.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1.11 2024-03-04T12:47:54.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.345+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.0 2024-03-04T12:47:54.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.346+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.1 2024-03-04T12:47:54.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.346+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.2 2024-03-04T12:47:54.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.347+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.3 2024-03-04T12:47:54.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.347+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.4 2024-03-04T12:47:54.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.348+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.5 2024-03-04T12:47:54.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.348+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.6 2024-03-04T12:47:54.356 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.349+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.7 2024-03-04T12:47:54.357 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.349+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.8 2024-03-04T12:47:54.357 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.350+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.9 2024-03-04T12:47:54.357 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.351+0000 7f247df0d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26.10 2024-03-04T12:47:54.360 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.354+0000 7f247df0d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 : hit (requested=0x17, cached=0x17) 2024-03-04T12:47:54.360 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.354+0000 7f247df0d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 2024-03-04T12:47:54.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.355+0000 7f247df0d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:54.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.355+0000 7f247df0d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:54.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.355+0000 7f247df0d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:54.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.355+0000 7f247df0d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26, ofs0, ns] 2024-03-04T12:47:54.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.355+0000 7f235a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824073 cookie 94200384991216 notifier 6479 bl.length()=861 2024-03-04T12:47:54.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.355+0000 7f235a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 info.flags=0x17 2024-03-04T12:47:54.362 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.355+0000 7f235a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 to cache LRU end 2024-03-04T12:47:54.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.355+0000 7f235a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:54.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.356+0000 7f247df0d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): orig_sources= new_sources= 2024-03-04T12:47:54.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.356+0000 7f247df0d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): potential sources added=[] removed=[] 2024-03-04T12:47:54.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.356+0000 7f247df0d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): orig_dests= new_dests= 2024-03-04T12:47:54.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.356+0000 7f247df0d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26]): potential dests added=[] removed=[] 2024-03-04T12:47:54.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.358+0000 7f247df0d800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2024-03-04T12:47:54.367 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.360+0000 7f2331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:54.369 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.362+0000 7f247df0d800 20 remove_watcher() i=0 2024-03-04T12:47:54.369 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.362+0000 7f247df0d800 2 removed watcher, disabling cache 2024-03-04T12:47:54.370 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.363+0000 7f247df0d800 20 remove_watcher() i=1 2024-03-04T12:47:54.371 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.364+0000 7f247df0d800 20 remove_watcher() i=2 2024-03-04T12:47:54.372 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.366+0000 7f247df0d800 20 remove_watcher() i=3 2024-03-04T12:47:54.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.367+0000 7f247df0d800 20 remove_watcher() i=4 2024-03-04T12:47:54.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.368+0000 7f247df0d800 20 remove_watcher() i=5 2024-03-04T12:47:54.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.368+0000 7f247df0d800 20 remove_watcher() i=6 2024-03-04T12:47:54.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.370+0000 7f247df0d800 20 remove_watcher() i=7 2024-03-04T12:47:54.388 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-04T12:47:54.416 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:54.416 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:54.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.643+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.645+0000 7f2b56ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.645+0000 7f2b56ba2800 20 realm 2024-03-04T12:47:54.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.645+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.645+0000 7f2b56ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.645+0000 7f2b56ba2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:54.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.645+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.646+0000 7f2b56ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.646+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.646+0000 7f2b56ba2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:54.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.646+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.647+0000 7f2b56ba2800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:54.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.647+0000 7f2b56ba2800 20 searching for the correct realm 2024-03-04T12:47:54.657 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.650+0000 7f2b546a5640 0 -- 172.21.15.90:0/759444544 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f2b4c001b60 msgr2=0x7f2b4c020410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:54.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.654+0000 7f2b546a5640 0 -- 172.21.15.90:0/759444544 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f2b3c057050 msgr2=0x7f2b3c04b790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:54.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.860+0000 7f2b56ba2800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:54.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.860+0000 7f2b56ba2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:54.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.860+0000 7f2b56ba2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:54.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.860+0000 7f2b56ba2800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:54.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.860+0000 7f2b56ba2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:54.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.860+0000 7f2b56ba2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:54.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.860+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.860+0000 7f2b56ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.860+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.861+0000 7f2b56ba2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:54.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.861+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.861+0000 7f2b56ba2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:54.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.861+0000 7f2b56ba2800 20 zone default found 2024-03-04T12:47:54.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.861+0000 7f2b56ba2800 4 Realm: () 2024-03-04T12:47:54.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.861+0000 7f2b56ba2800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:54.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.861+0000 7f2b56ba2800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:54.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.861+0000 7f2b56ba2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:54.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.861+0000 7f2b56ba2800 20 zonegroup default 2024-03-04T12:47:54.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.861+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.861+0000 7f2b56ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.861+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.862+0000 7f2b56ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.862+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.862+0000 7f2b56ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.862+0000 7f2b56ba2800 20 started sync module instance, tier type = 2024-03-04T12:47:54.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.862+0000 7f2b56ba2800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:54.878 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.871+0000 7f2b56ba2800 20 add_watcher() i=0 2024-03-04T12:47:54.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.871+0000 7f2b56ba2800 20 add_watcher() i=1 2024-03-04T12:47:54.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.872+0000 7f2b56ba2800 20 add_watcher() i=2 2024-03-04T12:47:54.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.872+0000 7f2b56ba2800 20 add_watcher() i=3 2024-03-04T12:47:54.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.872+0000 7f2b56ba2800 20 add_watcher() i=4 2024-03-04T12:47:54.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.872+0000 7f2b56ba2800 20 add_watcher() i=5 2024-03-04T12:47:54.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.872+0000 7f2b56ba2800 20 add_watcher() i=6 2024-03-04T12:47:54.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.872+0000 7f2b56ba2800 20 add_watcher() i=7 2024-03-04T12:47:54.879 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.872+0000 7f2b56ba2800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:54.881 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.874+0000 7f2a0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:54.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.875+0000 7f2b56ba2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:54.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.875+0000 7f2b56ba2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:54.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.875+0000 7f2b56ba2800 5 note: GC not initialized 2024-03-04T12:47:54.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.875+0000 7f2a09fdb640 20 reqs_thread_entry: start 2024-03-04T12:47:54.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.875+0000 7f2b56ba2800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:54.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.875+0000 7f2b56ba2800 20 Filter name: none 2024-03-04T12:47:54.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.875+0000 7f297b7fe640 20 reqs_thread_entry: start 2024-03-04T12:47:54.882 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.875+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.875+0000 7f2b56ba2800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:54.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.875+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.876+0000 7f2b56ba2800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:54.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.876+0000 7f2b56ba2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:54.883 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.876+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.884 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.876+0000 7f2b56ba2800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:47:54.884 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.876+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.884 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.877+0000 7f2b56ba2800 20 rados_obj.operate() r=0 bl.length=381 2024-03-04T12:47:54.884 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.877+0000 7f2b56ba2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:54.884 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.878+0000 7f2b56ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:47:54.884 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.878+0000 7f2b56ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:54.885 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.878+0000 7f2a0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:54.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.881+0000 7f2b56ba2800 20 remove_watcher() i=0 2024-03-04T12:47:54.888 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.881+0000 7f2b56ba2800 2 removed watcher, disabling cache 2024-03-04T12:47:54.889 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.882+0000 7f2b56ba2800 20 remove_watcher() i=1 2024-03-04T12:47:54.890 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.883+0000 7f2b56ba2800 20 remove_watcher() i=2 2024-03-04T12:47:54.891 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.884+0000 7f2b56ba2800 20 remove_watcher() i=3 2024-03-04T12:47:54.892 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.885+0000 7f2b56ba2800 20 remove_watcher() i=4 2024-03-04T12:47:54.893 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.886+0000 7f2b56ba2800 20 remove_watcher() i=5 2024-03-04T12:47:54.894 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.887+0000 7f2b56ba2800 20 remove_watcher() i=6 2024-03-04T12:47:54.895 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:54.888+0000 7f2b56ba2800 20 remove_watcher() i=7 2024-03-04T12:47:54.904 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:54.905 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:54.905 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: abort-at-commit-target-layout id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:47:54.905 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:54.907 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:54.907 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:54.910 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:54.910 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:54.953 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:54.954 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:54.979 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-03-04T12:47:54.979 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:54.980 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:54.981 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:54.991 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:54.991 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.034 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.034 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.043 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.043 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.051 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.051 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.058 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.058 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.066 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.066 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.074 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.074 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.082 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.082 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.090 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.090 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.097 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.097 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.104 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.104 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.111 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.111 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.119 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.119 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.126 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.126 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.134 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.134 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.141 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.141 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.149 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.149 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.156 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.156 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.163 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.163 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.171 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.171 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.178 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:55.178 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:55.185 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-04T12:47:55.212 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:55.212 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:55.245 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.238+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.246 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.239+0000 7f8d57530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.239+0000 7f8d57530800 20 realm 2024-03-04T12:47:55.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.239+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.240+0000 7f8d57530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.240+0000 7f8d57530800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:55.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.240+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.240+0000 7f8d57530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.240+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.241+0000 7f8d57530800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:55.247 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.241+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.241+0000 7f8d57530800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:55.248 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.241+0000 7f8d57530800 20 searching for the correct realm 2024-03-04T12:47:55.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.244+0000 7f8d4aaee640 0 -- 172.21.15.90:0/4133037225 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f8d3c066170 msgr2=0x7f8d3c05f000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:55.254 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.248+0000 7f8d532ef640 0 -- 172.21.15.90:0/4133037225 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f8d3c05d790 msgr2=0x7f8d3c05dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:55.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.454+0000 7f8d57530800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:55.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.454+0000 7f8d57530800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:55.461 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.454+0000 7f8d57530800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:55.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.454+0000 7f8d57530800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:55.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.454+0000 7f8d57530800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:55.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.454+0000 7f8d57530800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:55.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.454+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.454+0000 7f8d57530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.454+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.455+0000 7f8d57530800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:55.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.455+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.455+0000 7f8d57530800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:55.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.455+0000 7f8d57530800 20 zone default found 2024-03-04T12:47:55.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.455+0000 7f8d57530800 4 Realm: () 2024-03-04T12:47:55.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.455+0000 7f8d57530800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:55.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.455+0000 7f8d57530800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:55.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.455+0000 7f8d57530800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:55.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.455+0000 7f8d57530800 20 zonegroup default 2024-03-04T12:47:55.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.455+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.455+0000 7f8d57530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.455+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.456+0000 7f8d57530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.456+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.456+0000 7f8d57530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.456+0000 7f8d57530800 20 started sync module instance, tier type = 2024-03-04T12:47:55.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.456+0000 7f8d57530800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:55.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.465+0000 7f8d57530800 20 add_watcher() i=0 2024-03-04T12:47:55.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.465+0000 7f8d57530800 20 add_watcher() i=1 2024-03-04T12:47:55.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.465+0000 7f8d57530800 20 add_watcher() i=2 2024-03-04T12:47:55.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.465+0000 7f8d57530800 20 add_watcher() i=3 2024-03-04T12:47:55.472 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.465+0000 7f8d57530800 20 add_watcher() i=4 2024-03-04T12:47:55.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.465+0000 7f8d57530800 20 add_watcher() i=5 2024-03-04T12:47:55.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.465+0000 7f8d57530800 20 add_watcher() i=6 2024-03-04T12:47:55.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.466+0000 7f8d57530800 20 add_watcher() i=7 2024-03-04T12:47:55.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.466+0000 7f8d57530800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:55.474 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.468+0000 7f8c09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:55.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.468+0000 7f8d57530800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:55.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.468+0000 7f8d57530800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:55.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.468+0000 7f8d57530800 5 note: GC not initialized 2024-03-04T12:47:55.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.468+0000 7f8c08fe1640 20 reqs_thread_entry: start 2024-03-04T12:47:55.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.468+0000 7f8d57530800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:55.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.468+0000 7f8d57530800 20 Filter name: none 2024-03-04T12:47:55.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.469+0000 7f8b827fc640 20 reqs_thread_entry: start 2024-03-04T12:47:55.476 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.469+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.469+0000 7f8d57530800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:55.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.469+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.470+0000 7f8d57530800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:55.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.470+0000 7f8d57530800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:55.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.470+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.470+0000 7f8d57530800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:55.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.470+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.470+0000 7f8d57530800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:55.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.470+0000 7f8d57530800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:55.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.471+0000 7f8d57530800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.471+0000 7f8d57530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.472+0000 7f8c09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:55.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.474+0000 7f8d57530800 20 remove_watcher() i=0 2024-03-04T12:47:55.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.474+0000 7f8d57530800 2 removed watcher, disabling cache 2024-03-04T12:47:55.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.475+0000 7f8d57530800 20 remove_watcher() i=1 2024-03-04T12:47:55.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.477+0000 7f8d57530800 20 remove_watcher() i=2 2024-03-04T12:47:55.485 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.478+0000 7f8d57530800 20 remove_watcher() i=3 2024-03-04T12:47:55.486 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.479+0000 7f8d57530800 20 remove_watcher() i=4 2024-03-04T12:47:55.487 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.480+0000 7f8d57530800 20 remove_watcher() i=5 2024-03-04T12:47:55.488 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.481+0000 7f8d57530800 20 remove_watcher() i=6 2024-03-04T12:47:55.489 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.482+0000 7f8d57530800 20 remove_watcher() i=7 2024-03-04T12:47:55.498 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:55.498 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:55.498 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-do-reshard id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:47:55.498 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:55.500 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-03-04T12:47:55.532 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:55.533 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:55.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.558+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.559+0000 7f6d4b03d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.559+0000 7f6d4b03d800 20 realm 2024-03-04T12:47:55.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.559+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.560+0000 7f6d4b03d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.560+0000 7f6d4b03d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:55.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.560+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.560+0000 7f6d4b03d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.560+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.561+0000 7f6d4b03d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:55.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.561+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.561+0000 7f6d4b03d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:55.568 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.561+0000 7f6d4b03d800 20 searching for the correct realm 2024-03-04T12:47:55.570 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.564+0000 7f6d48338640 0 -- 172.21.15.90:0/1374462322 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f6d3c06e070 msgr2=0x7f6d3c0d2040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:47:55.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.769+0000 7f6d48b39640 0 -- 172.21.15.90:0/1374462322 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f6d3c0b3720 msgr2=0x7f6d3c0a2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:55.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.975+0000 7f6d4b03d800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:55.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.975+0000 7f6d4b03d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:55.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.975+0000 7f6d4b03d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:55.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.975+0000 7f6d4b03d800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:55.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.975+0000 7f6d4b03d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:55.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.975+0000 7f6d4b03d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:55.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.975+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.975+0000 7f6d4b03d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.975+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.976+0000 7f6d4b03d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:55.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.976+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.976+0000 7f6d4b03d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.976+0000 7f6d4b03d800 20 zone default found 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.976+0000 7f6d4b03d800 4 Realm: () 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.976+0000 7f6d4b03d800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.976+0000 7f6d4b03d800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.976+0000 7f6d4b03d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.976+0000 7f6d4b03d800 20 zonegroup default 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.976+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.976+0000 7f6d4b03d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.976+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.977+0000 7f6d4b03d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.977+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.977+0000 7f6d4b03d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.977+0000 7f6d4b03d800 20 started sync module instance, tier type = 2024-03-04T12:47:55.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.977+0000 7f6d4b03d800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:55.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.989+0000 7f6d4b03d800 20 add_watcher() i=0 2024-03-04T12:47:55.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.989+0000 7f6d4b03d800 20 add_watcher() i=1 2024-03-04T12:47:55.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.989+0000 7f6d4b03d800 20 add_watcher() i=2 2024-03-04T12:47:55.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.989+0000 7f6d4b03d800 20 add_watcher() i=3 2024-03-04T12:47:55.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.989+0000 7f6d4b03d800 20 add_watcher() i=4 2024-03-04T12:47:55.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.989+0000 7f6d4b03d800 20 add_watcher() i=5 2024-03-04T12:47:55.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.989+0000 7f6d4b03d800 20 add_watcher() i=6 2024-03-04T12:47:55.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.990+0000 7f6d4b03d800 20 add_watcher() i=7 2024-03-04T12:47:55.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.990+0000 7f6d4b03d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:55.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.992+0000 7f6bfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:55.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.992+0000 7f6d4b03d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:55.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.992+0000 7f6d4b03d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:55.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.992+0000 7f6d4b03d800 5 note: GC not initialized 2024-03-04T12:47:56.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.992+0000 7f6bfdfe3640 20 reqs_thread_entry: start 2024-03-04T12:47:56.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.992+0000 7f6d4b03d800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:56.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.992+0000 7f6d4b03d800 20 Filter name: none 2024-03-04T12:47:56.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6b6f7fe640 20 reqs_thread_entry: start 2024-03-04T12:47:56.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-03-04T12:47:56.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:56.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-03-04T12:47:56.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-03-04T12:47:56.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 : miss 2024-03-04T12:47:56.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:56.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 info.flags=0x17 2024-03-04T12:47:56.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 to cache LRU end 2024-03-04T12:47:56.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:56.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:56.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.993+0000 7f6d4b03d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 2024-03-04T12:47:56.005 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.999+0000 7f6d4b03d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 info.flags=0x17 2024-03-04T12:47:56.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.999+0000 7f6d4b03d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 to cache LRU end 2024-03-04T12:47:56.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.999+0000 7f6d4b03d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:56.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.999+0000 7f6d4b03d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27, ofs0, ns] 2024-03-04T12:47:56.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.999+0000 7f6c1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824076 cookie 94711558826272 notifier 6533 bl.length()=873 2024-03-04T12:47:56.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.999+0000 7f6c1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 info.flags=0x17 2024-03-04T12:47:56.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.999+0000 7f6c1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 to cache LRU end 2024-03-04T12:47:56.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.999+0000 7f6c1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:56.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.999+0000 7f6d4b03d800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): orig_sources= new_sources= 2024-03-04T12:47:56.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.999+0000 7f6d4b03d800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): potential sources added=[] removed=[] 2024-03-04T12:47:56.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.999+0000 7f6d4b03d800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): orig_dests= new_dests= 2024-03-04T12:47:56.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:55.999+0000 7f6d4b03d800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): potential dests added=[] removed=[] 2024-03-04T12:47:56.009 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.002+0000 7f6d4b03d800 -1 Injecting error=-5 at location=do_reshard 2024-03-04T12:47:56.013 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.007+0000 7f6d4b03d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 : hit (requested=0x17, cached=0x17) 2024-03-04T12:47:56.013 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.007+0000 7f6d4b03d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 2024-03-04T12:47:56.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.008+0000 7f6d4b03d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 info.flags=0x17 2024-03-04T12:47:56.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.008+0000 7f6d4b03d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 to cache LRU end 2024-03-04T12:47:56.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.008+0000 7f6d4b03d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:56.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.008+0000 7f6d4b03d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27, ofs0, ns] 2024-03-04T12:47:56.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.008+0000 7f6c1ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824077 cookie 94711558826272 notifier 6533 bl.length()=841 2024-03-04T12:47:56.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.008+0000 7f6c1ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 info.flags=0x17 2024-03-04T12:47:56.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.008+0000 7f6c1ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 to cache LRU end 2024-03-04T12:47:56.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.008+0000 7f6c1ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:56.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.009+0000 7f6d4b03d800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): orig_sources= new_sources= 2024-03-04T12:47:56.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.009+0000 7f6d4b03d800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): potential sources added=[] removed=[] 2024-03-04T12:47:56.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.009+0000 7f6d4b03d800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): orig_dests= new_dests= 2024-03-04T12:47:56.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.009+0000 7f6d4b03d800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): potential dests added=[] removed=[] 2024-03-04T12:47:56.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.009+0000 7f6d4b03d800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-03-04T12:47:56.018 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.011+0000 7f6bfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:56.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.013+0000 7f6d4b03d800 20 remove_watcher() i=0 2024-03-04T12:47:56.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.013+0000 7f6d4b03d800 2 removed watcher, disabling cache 2024-03-04T12:47:56.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.014+0000 7f6d4b03d800 20 remove_watcher() i=1 2024-03-04T12:47:56.023 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.016+0000 7f6d4b03d800 20 remove_watcher() i=2 2024-03-04T12:47:56.024 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.017+0000 7f6d4b03d800 20 remove_watcher() i=3 2024-03-04T12:47:56.025 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.018+0000 7f6d4b03d800 20 remove_watcher() i=4 2024-03-04T12:47:56.026 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.019+0000 7f6d4b03d800 20 remove_watcher() i=5 2024-03-04T12:47:56.027 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.020+0000 7f6d4b03d800 20 remove_watcher() i=6 2024-03-04T12:47:56.028 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.021+0000 7f6d4b03d800 20 remove_watcher() i=7 2024-03-04T12:47:56.039 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-04T12:47:56.066 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:56.066 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:56.098 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.091+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.093+0000 7fea2ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.093+0000 7fea2ae15800 20 realm 2024-03-04T12:47:56.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.093+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.093+0000 7fea2ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.093+0000 7fea2ae15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:56.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.093+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.093+0000 7fea2ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.100 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.093+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.094+0000 7fea2ae15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:56.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.094+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.095+0000 7fea2ae15800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:56.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.095+0000 7fea2ae15800 20 searching for the correct realm 2024-03-04T12:47:56.105 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.098+0000 7fea1ffff640 0 -- 172.21.15.90:0/4013730950 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x5591ae9a9970 msgr2=0x5591ae9abd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:47:56.109 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.102+0000 7fea263de640 0 -- 172.21.15.90:0/4013730950 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fea10017040 msgr2=0x7fea10048900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:56.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.106+0000 7fea2ae15800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:56.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.106+0000 7fea2ae15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:56.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.106+0000 7fea2ae15800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:56.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.106+0000 7fea2ae15800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:56.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.106+0000 7fea2ae15800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:56.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.106+0000 7fea2ae15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:56.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.106+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.106+0000 7fea2ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.113 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.106+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.106+0000 7fea2ae15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.106+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 20 zone default found 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 4 Realm: () 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 20 zonegroup default 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 20 started sync module instance, tier type = 2024-03-04T12:47:56.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.107+0000 7fea2ae15800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:56.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.116+0000 7fea2ae15800 20 add_watcher() i=0 2024-03-04T12:47:56.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.116+0000 7fea2ae15800 20 add_watcher() i=1 2024-03-04T12:47:56.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.116+0000 7fea2ae15800 20 add_watcher() i=2 2024-03-04T12:47:56.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.116+0000 7fea2ae15800 20 add_watcher() i=3 2024-03-04T12:47:56.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.116+0000 7fea2ae15800 20 add_watcher() i=4 2024-03-04T12:47:56.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.116+0000 7fea2ae15800 20 add_watcher() i=5 2024-03-04T12:47:56.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.116+0000 7fea2ae15800 20 add_watcher() i=6 2024-03-04T12:47:56.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.118+0000 7fea2ae15800 20 add_watcher() i=7 2024-03-04T12:47:56.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.118+0000 7fea2ae15800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:56.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.119+0000 7fe8dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:56.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.120+0000 7fea2ae15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:56.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.120+0000 7fea2ae15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:56.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.120+0000 7fea2ae15800 5 note: GC not initialized 2024-03-04T12:47:56.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.120+0000 7fe8577fe640 20 reqs_thread_entry: start 2024-03-04T12:47:56.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.120+0000 7fea2ae15800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:56.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.120+0000 7fea2ae15800 20 Filter name: none 2024-03-04T12:47:56.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.120+0000 7fe8557fa640 20 reqs_thread_entry: start 2024-03-04T12:47:56.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.120+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.120+0000 7fea2ae15800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:56.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.120+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.121+0000 7fea2ae15800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:56.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.121+0000 7fea2ae15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:56.128 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.121+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.121+0000 7fea2ae15800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:56.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.121+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.121+0000 7fea2ae15800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:56.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.121+0000 7fea2ae15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:56.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.122+0000 7fea2ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.129 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.122+0000 7fea2ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.130 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.123+0000 7fe8dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:56.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.126+0000 7fea2ae15800 20 remove_watcher() i=0 2024-03-04T12:47:56.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.126+0000 7fea2ae15800 2 removed watcher, disabling cache 2024-03-04T12:47:56.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.127+0000 7fea2ae15800 20 remove_watcher() i=1 2024-03-04T12:47:56.135 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.128+0000 7fea2ae15800 20 remove_watcher() i=2 2024-03-04T12:47:56.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.130+0000 7fea2ae15800 20 remove_watcher() i=3 2024-03-04T12:47:56.138 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.131+0000 7fea2ae15800 20 remove_watcher() i=4 2024-03-04T12:47:56.139 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.132+0000 7fea2ae15800 20 remove_watcher() i=5 2024-03-04T12:47:56.140 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.133+0000 7fea2ae15800 20 remove_watcher() i=6 2024-03-04T12:47:56.141 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.134+0000 7fea2ae15800 20 remove_watcher() i=7 2024-03-04T12:47:56.150 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:56.150 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:56.150 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-do-reshard id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:47:56.150 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:56.152 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.152 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.159 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.159 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.202 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:47:56.232 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:56.232 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:56.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.258+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.260+0000 7f57c5528800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.260+0000 7f57c5528800 20 realm 2024-03-04T12:47:56.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.260+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.260+0000 7f57c5528800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.260+0000 7f57c5528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:56.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.260+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.260+0000 7f57c5528800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.267 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.260+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.261+0000 7f57c5528800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:56.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.261+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.268 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.262+0000 7f57c5528800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:56.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.262+0000 7f57c5528800 20 searching for the correct realm 2024-03-04T12:47:56.272 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.265+0000 7f57c1a2b640 0 -- 172.21.15.90:0/3545311032 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x563e1a2378b0 msgr2=0x563e1a239d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:56.275 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.268+0000 7f57b8a29640 0 -- 172.21.15.90:0/3545311032 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f57ac059350 msgr2=0x7f57ac057fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:56.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.272+0000 7f57c5528800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:56.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.272+0000 7f57c5528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:56.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.272+0000 7f57c5528800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:56.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.272+0000 7f57c5528800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:56.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.272+0000 7f57c5528800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:56.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.272+0000 7f57c5528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:56.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.272+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:56.280 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:56.281 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 20 zone default found 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 4 Realm: () 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 20 zonegroup default 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.273+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.274+0000 7f57c5528800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.274+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.274+0000 7f57c5528800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.274+0000 7f57c5528800 20 started sync module instance, tier type = 2024-03-04T12:47:56.282 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.274+0000 7f57c5528800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:56.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.283+0000 7f57c5528800 20 add_watcher() i=0 2024-03-04T12:47:56.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.283+0000 7f57c5528800 20 add_watcher() i=1 2024-03-04T12:47:56.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.283+0000 7f57c5528800 20 add_watcher() i=2 2024-03-04T12:47:56.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.283+0000 7f57c5528800 20 add_watcher() i=3 2024-03-04T12:47:56.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.283+0000 7f57c5528800 20 add_watcher() i=4 2024-03-04T12:47:56.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.283+0000 7f57c5528800 20 add_watcher() i=5 2024-03-04T12:47:56.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.283+0000 7f57c5528800 20 add_watcher() i=6 2024-03-04T12:47:56.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.284+0000 7f57c5528800 20 add_watcher() i=7 2024-03-04T12:47:56.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.284+0000 7f57c5528800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:56.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.285+0000 7f56777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:56.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f57c5528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:56.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f57c5528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:56.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f57c5528800 5 note: GC not initialized 2024-03-04T12:47:56.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f56767e4640 20 reqs_thread_entry: start 2024-03-04T12:47:56.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f57c5528800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:56.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f57c5528800 20 Filter name: none 2024-03-04T12:47:56.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f55e7fff640 20 reqs_thread_entry: start 2024-03-04T12:47:56.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f57c5528800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-03-04T12:47:56.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f57c5528800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:56.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f57c5528800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-03-04T12:47:56.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f57c5528800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-03-04T12:47:56.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.286+0000 7f57c5528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 : miss 2024-03-04T12:47:56.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.287+0000 7f57c5528800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.287+0000 7f57c5528800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:56.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.287+0000 7f57c5528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 info.flags=0x17 2024-03-04T12:47:56.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.287+0000 7f57c5528800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 to cache LRU end 2024-03-04T12:47:56.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.287+0000 7f57c5528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:56.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.287+0000 7f57c5528800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:56.295 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.287+0000 7f57c5528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 2024-03-04T12:47:56.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.292+0000 7f57c5528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 info.flags=0x17 2024-03-04T12:47:56.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.292+0000 7f57c5528800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 to cache LRU end 2024-03-04T12:47:56.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.292+0000 7f57c5528800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:56.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.292+0000 7f57c5528800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27, ofs0, ns] 2024-03-04T12:47:56.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.292+0000 7f56a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824078 cookie 94824726567008 notifier 6954 bl.length()=873 2024-03-04T12:47:56.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.292+0000 7f56a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 info.flags=0x17 2024-03-04T12:47:56.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.292+0000 7f56a4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 to cache LRU end 2024-03-04T12:47:56.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.292+0000 7f56a4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:56.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.292+0000 7f57c5528800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): orig_sources= new_sources= 2024-03-04T12:47:56.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.292+0000 7f57c5528800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): potential sources added=[] removed=[] 2024-03-04T12:47:56.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.292+0000 7f57c5528800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): orig_dests= new_dests= 2024-03-04T12:47:56.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.292+0000 7f57c5528800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): potential dests added=[] removed=[] 2024-03-04T12:47:56.302 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.0 2024-03-04T12:47:56.302 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.0 2024-03-04T12:47:56.302 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.1 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.1 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.2 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.2 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.3 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.3 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.4 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.4 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.5 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.5 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.6 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.6 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.7 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.7 2024-03-04T12:47:56.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.8 2024-03-04T12:47:56.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.8 2024-03-04T12:47:56.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.9 2024-03-04T12:47:56.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.9 2024-03-04T12:47:56.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.10 2024-03-04T12:47:56.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.10 2024-03-04T12:47:56.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.11 2024-03-04T12:47:56.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1.11 2024-03-04T12:47:56.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.295+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.0 2024-03-04T12:47:56.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.296+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.1 2024-03-04T12:47:56.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.296+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.2 2024-03-04T12:47:56.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.297+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.3 2024-03-04T12:47:56.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.297+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.4 2024-03-04T12:47:56.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.297+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.5 2024-03-04T12:47:56.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.298+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.6 2024-03-04T12:47:56.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.298+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.7 2024-03-04T12:47:56.306 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.299+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.8 2024-03-04T12:47:56.306 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.299+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.9 2024-03-04T12:47:56.307 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.300+0000 7f57c5528800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27.10 2024-03-04T12:47:56.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.303+0000 7f57c5528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 : hit (requested=0x17, cached=0x17) 2024-03-04T12:47:56.309 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.303+0000 7f57c5528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 2024-03-04T12:47:56.311 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.304+0000 7f57c5528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 info.flags=0x17 2024-03-04T12:47:56.311 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.304+0000 7f57c5528800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 to cache LRU end 2024-03-04T12:47:56.311 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.304+0000 7f57c5528800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:56.311 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.304+0000 7f57c5528800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27, ofs0, ns] 2024-03-04T12:47:56.311 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.304+0000 7f56a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824079 cookie 94824726567008 notifier 6954 bl.length()=841 2024-03-04T12:47:56.311 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.304+0000 7f56a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 info.flags=0x17 2024-03-04T12:47:56.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.304+0000 7f56a4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 to cache LRU end 2024-03-04T12:47:56.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.304+0000 7f56a4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:56.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.304+0000 7f57c5528800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): orig_sources= new_sources= 2024-03-04T12:47:56.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.304+0000 7f57c5528800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): potential sources added=[] removed=[] 2024-03-04T12:47:56.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.304+0000 7f57c5528800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): orig_dests= new_dests= 2024-03-04T12:47:56.312 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.304+0000 7f57c5528800 20 handle_bi_update(): bucket=:error-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27]): potential dests added=[] removed=[] 2024-03-04T12:47:56.313 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.306+0000 7f57c5528800 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2024-03-04T12:47:56.316 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.309+0000 7f56777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:56.318 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.311+0000 7f57c5528800 20 remove_watcher() i=0 2024-03-04T12:47:56.318 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.311+0000 7f57c5528800 2 removed watcher, disabling cache 2024-03-04T12:47:56.319 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.312+0000 7f57c5528800 20 remove_watcher() i=1 2024-03-04T12:47:56.320 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.313+0000 7f57c5528800 20 remove_watcher() i=2 2024-03-04T12:47:56.321 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.314+0000 7f57c5528800 20 remove_watcher() i=3 2024-03-04T12:47:56.322 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.316+0000 7f57c5528800 20 remove_watcher() i=4 2024-03-04T12:47:56.323 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.316+0000 7f57c5528800 20 remove_watcher() i=5 2024-03-04T12:47:56.324 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.317+0000 7f57c5528800 20 remove_watcher() i=6 2024-03-04T12:47:56.325 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.318+0000 7f57c5528800 20 remove_watcher() i=7 2024-03-04T12:47:56.336 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-04T12:47:56.363 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:56.363 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:56.396 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.389+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.391+0000 7fb588331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.391+0000 7fb588331800 20 realm 2024-03-04T12:47:56.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.391+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.391+0000 7fb588331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.391+0000 7fb588331800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:56.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.391+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.391+0000 7fb588331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.398 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.391+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.392+0000 7fb588331800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:56.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.392+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.393+0000 7fb588331800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:56.399 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.393+0000 7fb588331800 20 searching for the correct realm 2024-03-04T12:47:56.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.396+0000 7fb57bfff640 0 -- 172.21.15.90:0/4071747325 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fb56c00b040 msgr2=0x7fb56c03c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:47:56.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.400+0000 7fb57bfff640 0 -- 172.21.15.90:0/4071747325 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fb44c079cd0 msgr2=0x7fb44c07c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:56.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.404+0000 7fb588331800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:56.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.404+0000 7fb588331800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:56.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.404+0000 7fb588331800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:56.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.404+0000 7fb588331800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:56.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.404+0000 7fb588331800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:56.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.404+0000 7fb588331800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:56.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.404+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.404+0000 7fb588331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.404+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.404+0000 7fb588331800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:56.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.404+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:56.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 20 zone default found 2024-03-04T12:47:56.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 4 Realm: () 2024-03-04T12:47:56.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:56.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:56.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:56.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 20 zonegroup default 2024-03-04T12:47:56.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.405+0000 7fb588331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.406+0000 7fb588331800 20 started sync module instance, tier type = 2024-03-04T12:47:56.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.406+0000 7fb588331800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:56.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.414+0000 7fb588331800 20 add_watcher() i=0 2024-03-04T12:47:56.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.414+0000 7fb588331800 20 add_watcher() i=1 2024-03-04T12:47:56.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.414+0000 7fb588331800 20 add_watcher() i=2 2024-03-04T12:47:56.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.414+0000 7fb588331800 20 add_watcher() i=3 2024-03-04T12:47:56.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.414+0000 7fb588331800 20 add_watcher() i=4 2024-03-04T12:47:56.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.414+0000 7fb588331800 20 add_watcher() i=5 2024-03-04T12:47:56.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.414+0000 7fb588331800 20 add_watcher() i=6 2024-03-04T12:47:56.421 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.415+0000 7fb588331800 20 add_watcher() i=7 2024-03-04T12:47:56.422 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.415+0000 7fb588331800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:56.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.416+0000 7fb439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:56.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.417+0000 7fb588331800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:56.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.417+0000 7fb588331800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:56.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.417+0000 7fb588331800 5 note: GC not initialized 2024-03-04T12:47:56.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.417+0000 7fb438fe1640 20 reqs_thread_entry: start 2024-03-04T12:47:56.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.417+0000 7fb588331800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:56.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.417+0000 7fb588331800 20 Filter name: none 2024-03-04T12:47:56.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.417+0000 7fb3b27fc640 20 reqs_thread_entry: start 2024-03-04T12:47:56.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.417+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.417+0000 7fb588331800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:56.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.417+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.418+0000 7fb588331800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:56.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.418+0000 7fb588331800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:56.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.418+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.418+0000 7fb588331800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:56.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.418+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.418+0000 7fb588331800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:56.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.418+0000 7fb588331800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:56.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.419+0000 7fb588331800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.420+0000 7fb588331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.427 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.420+0000 7fb439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:56.429 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.422+0000 7fb588331800 20 remove_watcher() i=0 2024-03-04T12:47:56.429 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.422+0000 7fb588331800 2 removed watcher, disabling cache 2024-03-04T12:47:56.430 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.423+0000 7fb588331800 20 remove_watcher() i=1 2024-03-04T12:47:56.431 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.424+0000 7fb588331800 20 remove_watcher() i=2 2024-03-04T12:47:56.432 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.426+0000 7fb588331800 20 remove_watcher() i=3 2024-03-04T12:47:56.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.427+0000 7fb588331800 20 remove_watcher() i=4 2024-03-04T12:47:56.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.428+0000 7fb588331800 20 remove_watcher() i=5 2024-03-04T12:47:56.436 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.429+0000 7fb588331800 20 remove_watcher() i=6 2024-03-04T12:47:56.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.430+0000 7fb588331800 20 remove_watcher() i=7 2024-03-04T12:47:56.446 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:56.446 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:56.446 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: error-at-do-reshard id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:47:56.446 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:56.448 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.448 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.451 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.451 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.494 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.494 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.520 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: reshard bucket with abort at do_reshard 2024-03-04T12:47:56.520 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:56.521 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.521 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.533 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.533 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.576 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.576 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.584 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.584 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.591 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.591 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.598 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.598 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.606 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.606 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.614 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.614 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.620 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.620 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.627 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.627 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.635 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.635 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.642 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.642 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.649 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.649 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.656 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.656 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.663 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.663 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.670 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.670 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.678 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.678 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.685 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.685 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.693 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.693 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.700 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.700 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.707 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.707 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.715 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:56.715 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:47:56.722 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-04T12:47:56.748 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:56.749 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:56.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.774+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.775+0000 7f5654142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.775+0000 7f5654142800 20 realm 2024-03-04T12:47:56.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.775+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.776+0000 7f5654142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.776+0000 7f5654142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:56.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.776+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.776+0000 7f5654142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.776+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.776+0000 7f5654142800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:56.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.776+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.777+0000 7f5654142800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:56.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.777+0000 7f5654142800 20 searching for the correct realm 2024-03-04T12:47:56.786 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.779+0000 7f5647fff640 0 -- 172.21.15.90:0/3580547874 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f5638057f60 msgr2=0x7f5638062960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:56.790 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.783+0000 7f564fe41640 0 -- 172.21.15.90:0/3580547874 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f5638082c10 msgr2=0x7f56380695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:56.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.989+0000 7f5654142800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:56.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.989+0000 7f5654142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:56.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.989+0000 7f5654142800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:56.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.989+0000 7f5654142800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:56.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.989+0000 7f5654142800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:56.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.989+0000 7f5654142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:56.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.989+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.990+0000 7f5654142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.990+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.990+0000 7f5654142800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:56.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.990+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.990+0000 7f5654142800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.990+0000 7f5654142800 20 zone default found 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.990+0000 7f5654142800 4 Realm: () 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.990+0000 7f5654142800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.990+0000 7f5654142800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.990+0000 7f5654142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.990+0000 7f5654142800 20 zonegroup default 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.990+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.991+0000 7f5654142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.991+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.991+0000 7f5654142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.991+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.991+0000 7f5654142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.991+0000 7f5654142800 20 started sync module instance, tier type = 2024-03-04T12:47:56.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:56.991+0000 7f5654142800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:57.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.000+0000 7f5654142800 20 add_watcher() i=0 2024-03-04T12:47:57.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.000+0000 7f5654142800 20 add_watcher() i=1 2024-03-04T12:47:57.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.000+0000 7f5654142800 20 add_watcher() i=2 2024-03-04T12:47:57.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.000+0000 7f5654142800 20 add_watcher() i=3 2024-03-04T12:47:57.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.000+0000 7f5654142800 20 add_watcher() i=4 2024-03-04T12:47:57.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.000+0000 7f5654142800 20 add_watcher() i=5 2024-03-04T12:47:57.007 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.000+0000 7f5654142800 20 add_watcher() i=6 2024-03-04T12:47:57.008 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.001+0000 7f5654142800 20 add_watcher() i=7 2024-03-04T12:47:57.008 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.001+0000 7f5654142800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:57.009 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.002+0000 7f5505fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:57.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.003+0000 7f5654142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:57.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.003+0000 7f5654142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:57.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.003+0000 7f5654142800 5 note: GC not initialized 2024-03-04T12:47:57.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.003+0000 7f5504fe1640 20 reqs_thread_entry: start 2024-03-04T12:47:57.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.003+0000 7f5654142800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:57.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.003+0000 7f5654142800 20 Filter name: none 2024-03-04T12:47:57.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.003+0000 7f547e7fc640 20 reqs_thread_entry: start 2024-03-04T12:47:57.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.003+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.011 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.004+0000 7f5654142800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:57.011 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.004+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.005+0000 7f5654142800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:57.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.005+0000 7f5654142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:57.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.005+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.005+0000 7f5654142800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:57.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.005+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.013 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.006+0000 7f5654142800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:57.013 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.006+0000 7f5654142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:57.013 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.006+0000 7f5654142800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.013 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.007+0000 7f5654142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.007+0000 7f5505fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:57.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.009+0000 7f5654142800 20 remove_watcher() i=0 2024-03-04T12:47:57.016 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.009+0000 7f5654142800 2 removed watcher, disabling cache 2024-03-04T12:47:57.017 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.010+0000 7f5654142800 20 remove_watcher() i=1 2024-03-04T12:47:57.018 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.011+0000 7f5654142800 20 remove_watcher() i=2 2024-03-04T12:47:57.019 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.012+0000 7f5654142800 20 remove_watcher() i=3 2024-03-04T12:47:57.020 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.013+0000 7f5654142800 20 remove_watcher() i=4 2024-03-04T12:47:57.021 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.014+0000 7f5654142800 20 remove_watcher() i=5 2024-03-04T12:47:57.022 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.015+0000 7f5654142800 20 remove_watcher() i=6 2024-03-04T12:47:57.023 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.016+0000 7f5654142800 20 remove_watcher() i=7 2024-03-04T12:47:57.032 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.032 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:57.032 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: abort-at-do-reshard id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:47:57.033 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.034 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-03-04T12:47:57.066 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:57.066 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:57.099 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.092+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.093+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.093+0000 7fb7cf526800 20 realm 2024-03-04T12:47:57.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.093+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.094+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.094+0000 7fb7cf526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:57.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.094+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.094+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.101 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.094+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.095+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:57.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.095+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.102 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.095+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:57.103 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.095+0000 7fb7cf526800 20 searching for the correct realm 2024-03-04T12:47:57.106 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.099+0000 7fb7caaba640 0 -- 172.21.15.90:0/2250861927 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fb7bc03a040 msgr2=0x7fb7bc01f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:57.109 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.102+0000 7fb7cbabc640 0 -- 172.21.15.90:0/2250861927 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7fb7bc02d040 msgr2=0x7fb7bc03d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:57.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.105+0000 7fb7cf526800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:57.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.105+0000 7fb7cf526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:57.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.105+0000 7fb7cf526800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:57.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.105+0000 7fb7cf526800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:57.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:57.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:57.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.114 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 20 zone default found 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 4 Realm: () 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 20 zonegroup default 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.107+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.107+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.107+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.115 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.107+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.107+0000 7fb7cf526800 20 started sync module instance, tier type = 2024-03-04T12:47:57.116 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.107+0000 7fb7cf526800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:57.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=0 2024-03-04T12:47:57.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=1 2024-03-04T12:47:57.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=2 2024-03-04T12:47:57.122 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=3 2024-03-04T12:47:57.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=4 2024-03-04T12:47:57.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=5 2024-03-04T12:47:57.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=6 2024-03-04T12:47:57.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.116+0000 7fb7cf526800 20 add_watcher() i=7 2024-03-04T12:47:57.123 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.116+0000 7fb7cf526800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:57.124 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.118+0000 7fb681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:57.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.118+0000 7fb7cf526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:57.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.118+0000 7fb7cf526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:57.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.118+0000 7fb7cf526800 5 note: GC not initialized 2024-03-04T12:47:57.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.118+0000 7fb680fe1640 20 reqs_thread_entry: start 2024-03-04T12:47:57.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.118+0000 7fb7cf526800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:57.125 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.118+0000 7fb7cf526800 20 Filter name: none 2024-03-04T12:47:57.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.118+0000 7fb5fa7fc640 20 reqs_thread_entry: start 2024-03-04T12:47:57.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.118+0000 7fb7cf526800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-04T12:47:57.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.118+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.126 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.119+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:57.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.119+0000 7fb7cf526800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-04T12:47:57.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.119+0000 7fb7cf526800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-04T12:47:57.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.119+0000 7fb7cf526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 : miss 2024-03-04T12:47:57.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.119+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.119+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:57.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.119+0000 7fb7cf526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:47:57.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.119+0000 7fb7cf526800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:47:57.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.119+0000 7fb7cf526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:57.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.119+0000 7fb7cf526800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:57.127 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.119+0000 7fb7cf526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 2024-03-04T12:47:57.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.126+0000 7fb7cf526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:47:57.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.126+0000 7fb7cf526800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:47:57.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.126+0000 7fb7cf526800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:57.133 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.126+0000 7fb7cf526800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28, ofs0, ns] 2024-03-04T12:47:57.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.127+0000 7fb6aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824083 cookie 94630978166512 notifier 7011 bl.length()=873 2024-03-04T12:47:57.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.127+0000 7fb6aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:47:57.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.127+0000 7fb6aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:47:57.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.127+0000 7fb6aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:57.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.127+0000 7fb7cf526800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): orig_sources= new_sources= 2024-03-04T12:47:57.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.127+0000 7fb7cf526800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): potential sources added=[] removed=[] 2024-03-04T12:47:57.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.127+0000 7fb7cf526800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): orig_dests= new_dests= 2024-03-04T12:47:57.134 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.127+0000 7fb7cf526800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): potential dests added=[] removed=[] 2024-03-04T12:47:57.136 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb7cf526800 time 2024-03-04T12:47:57.131435+0000 2024-03-04T12:47:57.136 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb7d0b80e86] 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fb7d0b81044] 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610fb8c0eb1] 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5610fb8d4de4] 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr: 5: main() 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fb7cfa3feb0] 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr: 7: __libc_start_main() 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr: 8: _start() 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.130+0000 7fb7cf526800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb7cf526800 time 2024-03-04T12:47:57.131435+0000 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.137 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:57.138 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb7d0b80e86] 2024-03-04T12:47:57.138 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fb7d0b81044] 2024-03-04T12:47:57.138 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610fb8c0eb1] 2024-03-04T12:47:57.138 INFO:tasks.workunit.client.0.smithi090.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5610fb8d4de4] 2024-03-04T12:47:57.138 INFO:tasks.workunit.client.0.smithi090.stderr: 5: main() 2024-03-04T12:47:57.138 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fb7cfa3feb0] 2024-03-04T12:47:57.138 INFO:tasks.workunit.client.0.smithi090.stderr: 7: __libc_start_main() 2024-03-04T12:47:57.138 INFO:tasks.workunit.client.0.smithi090.stderr: 8: _start() 2024-03-04T12:47:57.138 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.138 INFO:tasks.workunit.client.0.smithi090.stderr:*** Caught signal (Aborted) ** 2024-03-04T12:47:57.138 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7fb7cf526800 thread_name:radosgw-admin 2024-03-04T12:47:57.157 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:57.157 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fb7cfa54db0] 2024-03-04T12:47:57.157 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fb7cfaa154c] 2024-03-04T12:47:57.157 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:47:57.157 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb7d0b80ee0] 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fb7d0b81044] 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610fb8c0eb1] 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5610fb8d4de4] 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: 9: main() 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fb7cfa3feb0] 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: 11: __libc_start_main() 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: 12: _start() 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.131+0000 7fb7cf526800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7fb7cf526800 thread_name:radosgw-admin 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fb7cfa54db0] 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fb7cfaa154c] 2024-03-04T12:47:57.158 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb7d0b80ee0] 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fb7d0b81044] 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610fb8c0eb1] 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5610fb8d4de4] 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: 9: main() 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fb7cfa3feb0] 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: 11: __libc_start_main() 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: 12: _start() 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr:--- begin dump of recent events --- 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: -499> 2024-03-04T12:47:57.077+0000 7fb6b960a640 10 monclient: _check_auth_tickets 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: -498> 2024-03-04T12:47:57.077+0000 7fb6b960a640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:57.159 INFO:tasks.workunit.client.0.smithi090.stderr: -497> 2024-03-04T12:47:57.077+0000 7fb6b960a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr: -496> 2024-03-04T12:47:57.077+0000 7fb6b960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr: -495> 2024-03-04T12:47:57.077+0000 7fb6b960a640 10 monclient: dump: 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr: -494> 2024-03-04T12:47:57.077+0000 7fb7cf526800 5 monclient: authenticate success, global_id 6608 2024-03-04T12:47:57.160 INFO:tasks.workunit.client.0.smithi090.stderr: -493> 2024-03-04T12:47:57.077+0000 7fb7cf526800 10 monclient: get_monmap_and_config success 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr: -492> 2024-03-04T12:47:57.077+0000 7fb7cf526800 4 set_mon_vals no callback set 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr: -491> 2024-03-04T12:47:57.077+0000 7fb7cf526800 10 monclient: shutdown 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr: -490> 2024-03-04T12:47:57.077+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) unregister_commands rotate-key 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr: -489> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient: build_initial_monmap 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr: -488> 2024-03-04T12:47:57.078+0000 7fb7cf526800 1 build_initial for_mkfs: 0 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr: -487> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient: monmap: 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:57.161 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: -486> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding auth protocol: cephx 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: -485> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding auth protocol: cephx 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: -484> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding auth protocol: cephx 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: -483> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: secure 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: -482> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: crc 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: -481> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: secure 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: -480> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: crc 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: -479> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: secure 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: -478> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: crc 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: -477> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: crc 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: -476> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: secure 2024-03-04T12:47:57.162 INFO:tasks.workunit.client.0.smithi090.stderr: -475> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: crc 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -474> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: secure 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -473> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: crc 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -472> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: secure 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -471> 2024-03-04T12:47:57.078+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -470> 2024-03-04T12:47:57.078+0000 7fb7cf526800 1 librados: starting msgr at 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -469> 2024-03-04T12:47:57.078+0000 7fb7cf526800 1 librados: starting objecter 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -468> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command objecter_requests hook 0x5610fdc6e2f0 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -467> 2024-03-04T12:47:57.078+0000 7fb7cf526800 1 librados: setting wanted keys 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -466> 2024-03-04T12:47:57.078+0000 7fb7cf526800 1 librados: calling monclient init 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -465> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient: init 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -464> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding auth protocol: cephx 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -463> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding auth protocol: cephx 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -462> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding auth protocol: cephx 2024-03-04T12:47:57.163 INFO:tasks.workunit.client.0.smithi090.stderr: -461> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: secure 2024-03-04T12:47:57.164 INFO:tasks.workunit.client.0.smithi090.stderr: -460> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: crc 2024-03-04T12:47:57.164 INFO:tasks.workunit.client.0.smithi090.stderr: -459> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: secure 2024-03-04T12:47:57.164 INFO:tasks.workunit.client.0.smithi090.stderr: -458> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: crc 2024-03-04T12:47:57.164 INFO:tasks.workunit.client.0.smithi090.stderr: -457> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: secure 2024-03-04T12:47:57.164 INFO:tasks.workunit.client.0.smithi090.stderr: -456> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: crc 2024-03-04T12:47:57.164 INFO:tasks.workunit.client.0.smithi090.stderr: -455> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: crc 2024-03-04T12:47:57.164 INFO:tasks.workunit.client.0.smithi090.stderr: -454> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: secure 2024-03-04T12:47:57.164 INFO:tasks.workunit.client.0.smithi090.stderr: -453> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: crc 2024-03-04T12:47:57.164 INFO:tasks.workunit.client.0.smithi090.stderr: -452> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: secure 2024-03-04T12:47:57.164 INFO:tasks.workunit.client.0.smithi090.stderr: -451> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: crc 2024-03-04T12:47:57.164 INFO:tasks.workunit.client.0.smithi090.stderr: -450> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: secure 2024-03-04T12:47:57.164 INFO:tasks.workunit.client.0.smithi090.stderr: -449> 2024-03-04T12:47:57.078+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -448> 2024-03-04T12:47:57.078+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -447> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command rotate-key hook 0x5610fdc69448 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -446> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -445> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -444> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-b con 0x5610fdb155c0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -443> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-c con 0x5610fdb159a0 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -442> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-a con 0x5610fdb167f0 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -441> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -440> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -439> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -438> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -437> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): authenticate will time out at 1509.411211s 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -436> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request con 0x5610fdb167f0 auth_method 0 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -435> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.165 INFO:tasks.workunit.client.0.smithi090.stderr: -434> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -433> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -432> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): get_auth_request con 0x5610fdb159a0 auth_method 0 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -431> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -430> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -429> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -428> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -427> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -426> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -425> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request con 0x5610fdb155c0 auth_method 0 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -424> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -423> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -422> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -421> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -420> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.166 INFO:tasks.workunit.client.0.smithi090.stderr: -419> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr: -418> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr: -417> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr: -416> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr: -415> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_done global_id 7002 payload 824 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr: -414> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient: _finish_hunting 0 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr: -413> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 1 monclient: found mon.noname-a 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr: -412> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr: -411> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr: -410> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr: -409> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: dump: 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.167 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr: -408> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: _finish_auth 0 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr: -407> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: _check_auth_tickets 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr: -406> 2024-03-04T12:47:57.079+0000 7fb7cf526800 5 monclient: authenticate success, global_id 7002 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr: -405> 2024-03-04T12:47:57.079+0000 7fb7cf526800 10 monclient: _renew_subs 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr: -404> 2024-03-04T12:47:57.079+0000 7fb7cf526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr: -403> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr: -402> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr: -401> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:57.168 INFO:tasks.workunit.client.0.smithi090.stderr: -400> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: dump: 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr: -399> 2024-03-04T12:47:57.079+0000 7fb6b960a640 4 set_mon_vals no callback set 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr: -398> 2024-03-04T12:47:57.079+0000 7fb7cf526800 10 monclient: _renew_subs 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr: -397> 2024-03-04T12:47:57.079+0000 7fb7cf526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr: -396> 2024-03-04T12:47:57.079+0000 7fb7cf526800 1 librados: init done 2024-03-04T12:47:57.169 INFO:tasks.workunit.client.0.smithi090.stderr: -395> 2024-03-04T12:47:57.081+0000 7fb6b7e07640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr: -394> 2024-03-04T12:47:57.081+0000 7fb6b7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr: -393> 2024-03-04T12:47:57.081+0000 7fb6b7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr: -392> 2024-03-04T12:47:57.081+0000 7fb7cb2bb640 10 monclient: get_auth_request con 0x7fb6b0069ee0 auth_method 0 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr: -391> 2024-03-04T12:47:57.081+0000 7fb7caaba640 10 monclient: get_auth_request con 0x5610fdca79a0 auth_method 0 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr: -390> 2024-03-04T12:47:57.082+0000 7fb7cb2bb640 10 monclient: get_auth_request con 0x5610fdcb47d0 auth_method 0 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr: -389> 2024-03-04T12:47:57.082+0000 7fb7caaba640 10 monclient: get_auth_request con 0x5610fdcb8e70 auth_method 0 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr: -388> 2024-03-04T12:47:57.084+0000 7fb7cf526800 10 monclient: build_initial_monmap 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr: -387> 2024-03-04T12:47:57.084+0000 7fb7cf526800 1 build_initial for_mkfs: 0 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr: -386> 2024-03-04T12:47:57.084+0000 7fb7cf526800 10 monclient: monmap: 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:57.170 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr: -385> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding auth protocol: cephx 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr: -384> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding auth protocol: cephx 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr: -383> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding auth protocol: cephx 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr: -382> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: secure 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr: -381> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: crc 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr: -380> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: secure 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr: -379> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: crc 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr: -378> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: secure 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr: -377> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: crc 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr: -376> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: crc 2024-03-04T12:47:57.171 INFO:tasks.workunit.client.0.smithi090.stderr: -375> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: secure 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -374> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: crc 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -373> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: secure 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -372> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: crc 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -371> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: secure 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -370> 2024-03-04T12:47:57.084+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -369> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command objecter_requests cmddesc objecter_requests hook 0x5610fdcc31c0 EEXIST 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -368> 2024-03-04T12:47:57.084+0000 7fb7cf526800 10 monclient: init 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -367> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding auth protocol: cephx 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -366> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding auth protocol: cephx 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -365> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding auth protocol: cephx 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -364> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: secure 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -363> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: crc 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -362> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: secure 2024-03-04T12:47:57.172 INFO:tasks.workunit.client.0.smithi090.stderr: -361> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: crc 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -360> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: secure 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -359> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: crc 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -358> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: crc 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -357> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: secure 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -356> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: crc 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -355> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: secure 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -354> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: crc 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -353> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: secure 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -352> 2024-03-04T12:47:57.085+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -351> 2024-03-04T12:47:57.085+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -350> 2024-03-04T12:47:57.085+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command rotate-key cmddesc rotate-key hook 0x5610fdcbc2b0 EEXIST 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -349> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:57.173 INFO:tasks.workunit.client.0.smithi090.stderr: -348> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -347> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-c con 0x5610fdce7f20 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -346> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-a con 0x5610fdce8300 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -345> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-b con 0x5610fdce33c0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -344> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -343> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -342> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -341> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -340> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): authenticate will time out at 1509.417597s 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -339> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): get_auth_request con 0x5610fdce8300 auth_method 0 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -338> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -337> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -336> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -335> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request con 0x5610fdce7f20 auth_method 0 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -334> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.174 INFO:tasks.workunit.client.0.smithi090.stderr: -333> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -332> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -331> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -330> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -329> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -328> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -327> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -326> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -325> 2024-03-04T12:47:57.085+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request con 0x5610fdce33c0 auth_method 0 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -324> 2024-03-04T12:47:57.085+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -323> 2024-03-04T12:47:57.085+0000 7fb7cbabc640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -322> 2024-03-04T12:47:57.085+0000 7fb7cbabc640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -321> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_done global_id 6614 payload 824 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -320> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient: _finish_hunting 0 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -319> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 1 monclient: found mon.noname-c 2024-03-04T12:47:57.175 INFO:tasks.workunit.client.0.smithi090.stderr: -318> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr: -317> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr: -316> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr: -315> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: dump: 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr: -314> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: _finish_auth 0 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr: -313> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: _check_auth_tickets 2024-03-04T12:47:57.176 INFO:tasks.workunit.client.0.smithi090.stderr: -312> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr: -311> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr: -310> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr: -309> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: dump: 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.177 INFO:tasks.workunit.client.0.smithi090.stderr: -308> 2024-03-04T12:47:57.085+0000 7fb7cf526800 5 monclient: authenticate success, global_id 6614 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr: -307> 2024-03-04T12:47:57.085+0000 7fb7cc2bd640 4 set_mon_vals no callback set 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr: -306> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient: _renew_subs 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr: -305> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr: -304> 2024-03-04T12:47:57.086+0000 7fb7cf526800 10 monclient: _renew_subs 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr: -303> 2024-03-04T12:47:57.086+0000 7fb7cf526800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr: -302> 2024-03-04T12:47:57.087+0000 7fb6b5602640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr: -301> 2024-03-04T12:47:57.087+0000 7fb6b5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr: -300> 2024-03-04T12:47:57.087+0000 7fb6b5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr: -299> 2024-03-04T12:47:57.087+0000 7fb7cf526800 10 monclient: get_monmap_and_config 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr: -298> 2024-03-04T12:47:57.087+0000 7fb7cf526800 10 monclient: build_initial_monmap 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr: -297> 2024-03-04T12:47:57.087+0000 7fb7cf526800 1 build_initial for_mkfs: 0 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr: -296> 2024-03-04T12:47:57.087+0000 7fb7cf526800 10 monclient: monmap: 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:57.178 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr: -295> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding auth protocol: cephx 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr: -294> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding auth protocol: cephx 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr: -293> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding auth protocol: cephx 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr: -292> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: secure 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr: -291> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: crc 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr: -290> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: secure 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr: -289> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: crc 2024-03-04T12:47:57.179 INFO:tasks.workunit.client.0.smithi090.stderr: -288> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: secure 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -287> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: crc 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -286> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: crc 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -285> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: secure 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -284> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: crc 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -283> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: secure 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -282> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: crc 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -281> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: secure 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -280> 2024-03-04T12:47:57.087+0000 7fb7caaba640 10 monclient: get_auth_request con 0x7fb6a4069dc0 auth_method 0 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -279> 2024-03-04T12:47:57.088+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -278> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient: init 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -277> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding auth protocol: cephx 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -276> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding auth protocol: cephx 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -275> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding auth protocol: cephx 2024-03-04T12:47:57.180 INFO:tasks.workunit.client.0.smithi090.stderr: -274> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: secure 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -273> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: crc 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -272> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: secure 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -271> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: crc 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -270> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: secure 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -269> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: crc 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -268> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: crc 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -267> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: secure 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -266> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: crc 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -265> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: secure 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -264> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: crc 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -263> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: secure 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -262> 2024-03-04T12:47:57.088+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -261> 2024-03-04T12:47:57.088+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -260> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command rotate-key cmddesc rotate-key hook 0x7ffdf0088c98 EEXIST 2024-03-04T12:47:57.181 INFO:tasks.workunit.client.0.smithi090.stderr: -259> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -258> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -257> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-a con 0x5610fdd344a0 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -256> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-b con 0x5610fdd07fb0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -255> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-c con 0x5610fdd36d80 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -254> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -253> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -252> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -251> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -250> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): authenticate will time out at 1509.420965s 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -249> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request con 0x5610fdd344a0 auth_method 0 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -248> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -247> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.182 INFO:tasks.workunit.client.0.smithi090.stderr: -246> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -245> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request con 0x5610fdd36d80 auth_method 0 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -244> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -243> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -242> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -241> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -240> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -239> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -238> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -237> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -236> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -235> 2024-03-04T12:47:57.088+0000 7fb7caaba640 10 monclient(hunting): get_auth_request con 0x5610fdd07fb0 auth_method 0 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -234> 2024-03-04T12:47:57.088+0000 7fb7caaba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -233> 2024-03-04T12:47:57.088+0000 7fb7caaba640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -232> 2024-03-04T12:47:57.088+0000 7fb7caaba640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.183 INFO:tasks.workunit.client.0.smithi090.stderr: -231> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_done global_id 7008 payload 274 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr: -230> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient: _finish_hunting 0 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr: -229> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 1 monclient: found mon.noname-a 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr: -228> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr: -227> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr: -226> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr: -225> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: dump: 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.184 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr: -224> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: _finish_auth 0 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr: -223> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: _check_auth_tickets 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr: -222> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr: -221> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr: -220> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr: -219> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: dump: 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.185 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr: -218> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 monclient: authenticate success, global_id 7008 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr: -217> 2024-03-04T12:47:57.089+0000 7fb7cf526800 10 monclient: get_monmap_and_config success 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr: -216> 2024-03-04T12:47:57.089+0000 7fb7cf526800 4 set_mon_vals no callback set 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr: -215> 2024-03-04T12:47:57.089+0000 7fb7cf526800 10 monclient: shutdown 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr: -214> 2024-03-04T12:47:57.089+0000 7fb7cf526800 10 monclient: build_initial_monmap 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr: -213> 2024-03-04T12:47:57.089+0000 7fb7cf526800 1 build_initial for_mkfs: 0 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr: -212> 2024-03-04T12:47:57.089+0000 7fb7cf526800 10 monclient: monmap: 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:57.186 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr: -211> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding auth protocol: cephx 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr: -210> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding auth protocol: cephx 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr: -209> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding auth protocol: cephx 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr: -208> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: secure 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr: -207> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: crc 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr: -206> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: secure 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr: -205> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: crc 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr: -204> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: secure 2024-03-04T12:47:57.187 INFO:tasks.workunit.client.0.smithi090.stderr: -203> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: crc 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -202> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: crc 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -201> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: secure 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -200> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: crc 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -199> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: secure 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -198> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: crc 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -197> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: secure 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -196> 2024-03-04T12:47:57.090+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -195> 2024-03-04T12:47:57.090+0000 7fb7cf526800 1 librados: starting msgr at 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -194> 2024-03-04T12:47:57.090+0000 7fb7cf526800 1 librados: starting objecter 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -193> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command objecter_requests cmddesc objecter_requests hook 0x5610fdd35640 EEXIST 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -192> 2024-03-04T12:47:57.090+0000 7fb7cf526800 1 librados: setting wanted keys 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -191> 2024-03-04T12:47:57.090+0000 7fb7cf526800 1 librados: calling monclient init 2024-03-04T12:47:57.188 INFO:tasks.workunit.client.0.smithi090.stderr: -190> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient: init 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -189> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding auth protocol: cephx 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -188> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding auth protocol: cephx 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -187> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding auth protocol: cephx 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -186> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: secure 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -185> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: crc 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -184> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: secure 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -183> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: crc 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -182> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: secure 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -181> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: crc 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -180> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: crc 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -179> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: secure 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -178> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: crc 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -177> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: secure 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -176> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: crc 2024-03-04T12:47:57.189 INFO:tasks.workunit.client.0.smithi090.stderr: -175> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: secure 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -174> 2024-03-04T12:47:57.090+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -173> 2024-03-04T12:47:57.090+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -172> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command rotate-key cmddesc rotate-key hook 0x5610fdcfda58 EEXIST 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -171> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -170> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -169> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-a con 0x5610fdd07fb0 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -168> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-b con 0x5610fdd36d80 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -167> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-c con 0x5610fdd332b0 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -166> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -165> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -164> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -163> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -162> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): authenticate will time out at 1509.423062s 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -161> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request con 0x5610fdd07fb0 auth_method 0 2024-03-04T12:47:57.190 INFO:tasks.workunit.client.0.smithi090.stderr: -160> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -159> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -158> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -157> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -156> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -155> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -154> 2024-03-04T12:47:57.090+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request con 0x5610fdd332b0 auth_method 0 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -153> 2024-03-04T12:47:57.090+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -152> 2024-03-04T12:47:57.090+0000 7fb7cbabc640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -151> 2024-03-04T12:47:57.090+0000 7fb7cbabc640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -150> 2024-03-04T12:47:57.091+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -149> 2024-03-04T12:47:57.091+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -148> 2024-03-04T12:47:57.091+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -147> 2024-03-04T12:47:57.091+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_done global_id 7011 payload 824 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -146> 2024-03-04T12:47:57.091+0000 7fb7cb2bb640 10 monclient: _finish_hunting 0 2024-03-04T12:47:57.191 INFO:tasks.workunit.client.0.smithi090.stderr: -145> 2024-03-04T12:47:57.091+0000 7fb7cb2bb640 1 monclient: found mon.noname-a 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr: -144> 2024-03-04T12:47:57.091+0000 7fb7cb2bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr: -143> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr: -142> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr: -141> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: dump: 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.192 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr: -140> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: _finish_auth 0 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr: -139> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: _check_auth_tickets 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr: -138> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr: -137> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr: -136> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr: -135> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: dump: 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.193 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -134> 2024-03-04T12:47:57.091+0000 7fb6aeffd640 4 set_mon_vals no callback set 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -133> 2024-03-04T12:47:57.091+0000 7fb7cf526800 5 monclient: authenticate success, global_id 7011 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -132> 2024-03-04T12:47:57.091+0000 7fb7cf526800 10 monclient: _renew_subs 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -131> 2024-03-04T12:47:57.091+0000 7fb7cf526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -130> 2024-03-04T12:47:57.091+0000 7fb7cf526800 10 monclient: _renew_subs 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -129> 2024-03-04T12:47:57.091+0000 7fb7cf526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -128> 2024-03-04T12:47:57.091+0000 7fb7cf526800 1 librados: init done 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -127> 2024-03-04T12:47:57.091+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command cr dump hook 0x5610fdd481c8 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -126> 2024-03-04T12:47:57.092+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -125> 2024-03-04T12:47:57.092+0000 7fb6ad7fa640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -124> 2024-03-04T12:47:57.092+0000 7fb6ad7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -123> 2024-03-04T12:47:57.092+0000 7fb6ad7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:57.194 INFO:tasks.workunit.client.0.smithi090.stderr: -122> 2024-03-04T12:47:57.093+0000 7fb7caaba640 10 monclient: get_auth_request con 0x7fb694069eb0 auth_method 0 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -121> 2024-03-04T12:47:57.093+0000 7fb7cbabc640 10 monclient: get_auth_request con 0x5610fdd54710 auth_method 0 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -120> 2024-03-04T12:47:57.093+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -119> 2024-03-04T12:47:57.093+0000 7fb7cf526800 20 realm 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -118> 2024-03-04T12:47:57.093+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -117> 2024-03-04T12:47:57.094+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -116> 2024-03-04T12:47:57.094+0000 7fb7cf526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -115> 2024-03-04T12:47:57.094+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -114> 2024-03-04T12:47:57.094+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -113> 2024-03-04T12:47:57.094+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -112> 2024-03-04T12:47:57.094+0000 7fb7cb2bb640 10 monclient: get_auth_request con 0x5610fdd58980 auth_method 0 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -111> 2024-03-04T12:47:57.095+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -110> 2024-03-04T12:47:57.095+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -109> 2024-03-04T12:47:57.095+0000 7fb7caaba640 10 monclient: get_auth_request con 0x5610fdd5c1e0 auth_method 0 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -108> 2024-03-04T12:47:57.095+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:57.195 INFO:tasks.workunit.client.0.smithi090.stderr: -107> 2024-03-04T12:47:57.095+0000 7fb7cf526800 20 searching for the correct realm 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -106> 2024-03-04T12:47:57.096+0000 7fb7cbabc640 10 monclient: get_auth_request con 0x5610fdd60f20 auth_method 0 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -105> 2024-03-04T12:47:57.096+0000 7fb7cb2bb640 10 monclient: get_auth_request con 0x7fb7c405e070 auth_method 0 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -104> 2024-03-04T12:47:57.097+0000 7fb7caaba640 10 monclient: get_auth_request con 0x7fb7bc03a040 auth_method 0 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -103> 2024-03-04T12:47:57.099+0000 7fb7caaba640 0 -- 172.21.15.90:0/2250861927 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fb7bc03a040 msgr2=0x7fb7bc01f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -102> 2024-03-04T12:47:57.099+0000 7fb6ad7fa640 1 client.7011.objecter ms_handle_reset 0x7fb7bc03a040 session 0x7fb7bc015040 osd.4 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -101> 2024-03-04T12:47:57.099+0000 7fb6ad7fa640 10 monclient: _renew_subs 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -100> 2024-03-04T12:47:57.099+0000 7fb6ad7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -99> 2024-03-04T12:47:57.099+0000 7fb7cbabc640 10 monclient: get_auth_request con 0x7fb7bc02d040 auth_method 0 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -98> 2024-03-04T12:47:57.099+0000 7fb7caaba640 10 monclient: get_auth_request con 0x7fb694079cd0 auth_method 0 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -97> 2024-03-04T12:47:57.101+0000 7fb7cb2bb640 10 monclient: get_auth_request con 0x7fb7bc050440 auth_method 0 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -96> 2024-03-04T12:47:57.102+0000 7fb7cbabc640 0 -- 172.21.15.90:0/2250861927 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7fb7bc02d040 msgr2=0x7fb7bc03d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -95> 2024-03-04T12:47:57.102+0000 7fb6ad7fa640 1 client.7011.objecter ms_handle_reset 0x7fb7bc02d040 session 0x7fb7bc01faf0 osd.6 2024-03-04T12:47:57.196 INFO:tasks.workunit.client.0.smithi090.stderr: -94> 2024-03-04T12:47:57.102+0000 7fb7cbabc640 10 monclient: get_auth_request con 0x7fb7bc03a040 auth_method 0 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -93> 2024-03-04T12:47:57.105+0000 7fb7cf526800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -92> 2024-03-04T12:47:57.105+0000 7fb7cf526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -91> 2024-03-04T12:47:57.105+0000 7fb7cf526800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -90> 2024-03-04T12:47:57.105+0000 7fb7cf526800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -89> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -88> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -87> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -86> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -85> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -84> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -83> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -82> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -81> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 zone default found 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -80> 2024-03-04T12:47:57.106+0000 7fb7cf526800 4 Realm: () 2024-03-04T12:47:57.197 INFO:tasks.workunit.client.0.smithi090.stderr: -79> 2024-03-04T12:47:57.106+0000 7fb7cf526800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -78> 2024-03-04T12:47:57.106+0000 7fb7cf526800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -77> 2024-03-04T12:47:57.106+0000 7fb7cf526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -76> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 zonegroup default 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -75> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -74> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -73> 2024-03-04T12:47:57.107+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -72> 2024-03-04T12:47:57.107+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -71> 2024-03-04T12:47:57.107+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -70> 2024-03-04T12:47:57.107+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -69> 2024-03-04T12:47:57.107+0000 7fb7cf526800 20 started sync module instance, tier type = 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -68> 2024-03-04T12:47:57.107+0000 7fb7cf526800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -67> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=0 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -66> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=1 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -65> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=2 2024-03-04T12:47:57.198 INFO:tasks.workunit.client.0.smithi090.stderr: -64> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=3 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -63> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=4 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -62> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=5 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -61> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=6 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -60> 2024-03-04T12:47:57.116+0000 7fb7cf526800 20 add_watcher() i=7 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -59> 2024-03-04T12:47:57.116+0000 7fb7cf526800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -58> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding auth protocol: cephx 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -57> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding auth protocol: cephx 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -56> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding auth protocol: cephx 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -55> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: secure 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -54> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: crc 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -53> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: secure 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -52> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: crc 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -51> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: secure 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -50> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: crc 2024-03-04T12:47:57.199 INFO:tasks.workunit.client.0.smithi090.stderr: -49> 2024-03-04T12:47:57.118+0000 7fb681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -48> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: crc 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -47> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: secure 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -46> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: crc 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -45> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: secure 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -44> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: crc 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -43> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: secure 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -42> 2024-03-04T12:47:57.118+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -41> 2024-03-04T12:47:57.118+0000 7fb7cf526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -40> 2024-03-04T12:47:57.118+0000 7fb7cf526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -39> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command cache list hook 0x5610fdd33710 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -38> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command cache inspect hook 0x5610fdd33710 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -37> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command cache erase hook 0x5610fdd33710 2024-03-04T12:47:57.200 INFO:tasks.workunit.client.0.smithi090.stderr: -36> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command cache zap hook 0x5610fdd33710 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -35> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 note: GC not initialized 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -34> 2024-03-04T12:47:57.118+0000 7fb680fe1640 20 reqs_thread_entry: start 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -33> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command sync trace show hook 0x7fb7bc012040 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -32> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command sync trace history hook 0x7fb7bc012040 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -31> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command sync trace active hook 0x7fb7bc012040 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -30> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command sync trace active_short hook 0x7fb7bc012040 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -29> 2024-03-04T12:47:57.118+0000 7fb7cf526800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -28> 2024-03-04T12:47:57.118+0000 7fb7cf526800 20 Filter name: none 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -27> 2024-03-04T12:47:57.118+0000 7fb5fa7fc640 20 reqs_thread_entry: start 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -26> 2024-03-04T12:47:57.118+0000 7fb7cf526800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -25> 2024-03-04T12:47:57.118+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -24> 2024-03-04T12:47:57.119+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -23> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-04T12:47:57.201 INFO:tasks.workunit.client.0.smithi090.stderr: -22> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -21> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 : miss 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -20> 2024-03-04T12:47:57.119+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -19> 2024-03-04T12:47:57.119+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -18> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -17> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -16> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -15> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -14> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -13> 2024-03-04T12:47:57.126+0000 7fb7cf526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -12> 2024-03-04T12:47:57.126+0000 7fb7cf526800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -11> 2024-03-04T12:47:57.126+0000 7fb7cf526800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -10> 2024-03-04T12:47:57.126+0000 7fb7cf526800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28, ofs0, ns] 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -9> 2024-03-04T12:47:57.127+0000 7fb6aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824083 cookie 94630978166512 notifier 7011 bl.length()=873 2024-03-04T12:47:57.202 INFO:tasks.workunit.client.0.smithi090.stderr: -8> 2024-03-04T12:47:57.127+0000 7fb6aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr: -7> 2024-03-04T12:47:57.127+0000 7fb6aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr: -6> 2024-03-04T12:47:57.127+0000 7fb6aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr: -5> 2024-03-04T12:47:57.127+0000 7fb7cf526800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): orig_sources= new_sources= 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr: -4> 2024-03-04T12:47:57.127+0000 7fb7cf526800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): potential sources added=[] removed=[] 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr: -3> 2024-03-04T12:47:57.127+0000 7fb7cf526800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): orig_dests= new_dests= 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr: -2> 2024-03-04T12:47:57.127+0000 7fb7cf526800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): potential dests added=[] removed=[] 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr: -1> 2024-03-04T12:47:57.130+0000 7fb7cf526800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb7cf526800 time 2024-03-04T12:47:57.131435+0000 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb7d0b80e86] 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fb7d0b81044] 2024-03-04T12:47:57.203 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610fb8c0eb1] 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5610fb8d4de4] 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: 5: main() 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fb7cfa3feb0] 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: 7: __libc_start_main() 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: 8: _start() 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: 0> 2024-03-04T12:47:57.131+0000 7fb7cf526800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7fb7cf526800 thread_name:radosgw-admin 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fb7cfa54db0] 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fb7cfaa154c] 2024-03-04T12:47:57.204 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb7d0b80ee0] 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fb7d0b81044] 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610fb8c0eb1] 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5610fb8d4de4] 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: 9: main() 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fb7cfa3feb0] 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: 11: __libc_start_main() 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: 12: _start() 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr:--- logging levels --- 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 none 2024-03-04T12:47:57.205 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 lockdep 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 context 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 crush 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_balancer 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_locker 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log_expire 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_migrator 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 buffer 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 timer 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 filer 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 striper 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 objecter 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rados 2024-03-04T12:47:57.206 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_mirror 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_replay 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_pwl 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 journaler 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objectcacher 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 client 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 osd 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 optracker 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objclass 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 filestore 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 journal 2024-03-04T12:47:57.207 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 ms 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mon 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 0/10 monc 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 paxos 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 tp 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 auth 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 crypto 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 finisher 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 reserver 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 heartbeatmap 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 perfcounter 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 20/20 rgw 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_sync 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_datacache 2024-03-04T12:47:57.208 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_access 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_flight 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 javaclient 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 asok 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 throttle 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 refs 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 compressor 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluestore 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluefs 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 bdev 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 kstore 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 4/ 5 rocksdb 2024-03-04T12:47:57.209 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 fuse 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 2/ 5 mgr 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mgrc 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 dpdk 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 eventtrace 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 prioritycache 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 test 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephsqlite 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_onode 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_odata 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_omap 2024-03-04T12:47:57.210 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_tm 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_t 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_epm 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_lba 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cache 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_journal 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_device 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_backref 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 alienstore 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mclock 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cyanstore 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 ceph_exporter 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 memstore 2024-03-04T12:47:57.211 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 trace 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: -2/-2 (syslog threshold) 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: 99/99 (stderr threshold) 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb5fa7fc640 / http_manager 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb680fe1640 / http_manager 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb681fe3640 / rgw_dt_lg_renew 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb6ad7fa640 / ms_dispatch 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb6aeffd640 / io_context_pool 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb6b5602640 / ms_dispatch 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb6b7e07640 / ms_dispatch 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb6b960a640 / io_context_pool 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb7caaba640 / msgr-worker-2 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb7cb2bb640 / msgr-worker-1 2024-03-04T12:47:57.212 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb7cbabc640 / msgr-worker-0 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb7cc2bd640 / io_context_pool 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb7cf526800 / radosgw-admin 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr: max_recent 500 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr: max_new 1000 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr: log_file /var/log/ceph/ceph-client.admin.111830.log 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr:--- end dump of recent events --- 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr:--- begin dump of recent events --- 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr: -499> 2024-03-04T12:47:57.077+0000 7fb6b960a640 10 monclient: _check_auth_tickets 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr: -498> 2024-03-04T12:47:57.077+0000 7fb6b960a640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr: -497> 2024-03-04T12:47:57.077+0000 7fb6b960a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr: -496> 2024-03-04T12:47:57.077+0000 7fb6b960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr: -495> 2024-03-04T12:47:57.077+0000 7fb6b960a640 10 monclient: dump: 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.213 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr: -494> 2024-03-04T12:47:57.077+0000 7fb7cf526800 5 monclient: authenticate success, global_id 6608 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr: -493> 2024-03-04T12:47:57.077+0000 7fb7cf526800 10 monclient: get_monmap_and_config success 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr: -492> 2024-03-04T12:47:57.077+0000 7fb7cf526800 4 set_mon_vals no callback set 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr: -491> 2024-03-04T12:47:57.077+0000 7fb7cf526800 10 monclient: shutdown 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr: -490> 2024-03-04T12:47:57.077+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) unregister_commands rotate-key 2024-03-04T12:47:57.214 INFO:tasks.workunit.client.0.smithi090.stderr: -489> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient: build_initial_monmap 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr: -488> 2024-03-04T12:47:57.078+0000 7fb7cf526800 1 build_initial for_mkfs: 0 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr: -487> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient: monmap: 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr: -486> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding auth protocol: cephx 2024-03-04T12:47:57.215 INFO:tasks.workunit.client.0.smithi090.stderr: -485> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding auth protocol: cephx 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -484> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding auth protocol: cephx 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -483> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: secure 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -482> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: crc 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -481> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: secure 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -480> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: crc 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -479> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: secure 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -478> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: crc 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -477> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: crc 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -476> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: secure 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -475> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: crc 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -474> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: secure 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -473> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: crc 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -472> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc97130) adding con mode: secure 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -471> 2024-03-04T12:47:57.078+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.216 INFO:tasks.workunit.client.0.smithi090.stderr: -470> 2024-03-04T12:47:57.078+0000 7fb7cf526800 1 librados: starting msgr at 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -469> 2024-03-04T12:47:57.078+0000 7fb7cf526800 1 librados: starting objecter 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -468> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command objecter_requests hook 0x5610fdc6e2f0 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -467> 2024-03-04T12:47:57.078+0000 7fb7cf526800 1 librados: setting wanted keys 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -466> 2024-03-04T12:47:57.078+0000 7fb7cf526800 1 librados: calling monclient init 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -465> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient: init 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -464> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding auth protocol: cephx 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -463> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding auth protocol: cephx 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -462> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding auth protocol: cephx 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -461> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: secure 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -460> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: crc 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -459> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: secure 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -458> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: crc 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -457> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: secure 2024-03-04T12:47:57.217 INFO:tasks.workunit.client.0.smithi090.stderr: -456> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: crc 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -455> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: crc 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -454> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: secure 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -453> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: crc 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -452> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: secure 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -451> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: crc 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -450> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 AuthRegistry(0x5610fdc69300) adding con mode: secure 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -449> 2024-03-04T12:47:57.078+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -448> 2024-03-04T12:47:57.078+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -447> 2024-03-04T12:47:57.078+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command rotate-key hook 0x5610fdc69448 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -446> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -445> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -444> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-b con 0x5610fdb155c0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -443> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-c con 0x5610fdb159a0 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:57.218 INFO:tasks.workunit.client.0.smithi090.stderr: -442> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-a con 0x5610fdb167f0 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -441> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -440> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -439> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -438> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -437> 2024-03-04T12:47:57.078+0000 7fb7cf526800 10 monclient(hunting): authenticate will time out at 1509.411211s 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -436> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request con 0x5610fdb167f0 auth_method 0 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -435> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -434> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -433> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -432> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): get_auth_request con 0x5610fdb159a0 auth_method 0 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -431> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -430> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -429> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.219 INFO:tasks.workunit.client.0.smithi090.stderr: -428> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -427> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -426> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -425> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request con 0x5610fdb155c0 auth_method 0 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -424> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -423> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -422> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -421> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -420> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -419> 2024-03-04T12:47:57.079+0000 7fb7caaba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -418> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -417> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -416> 2024-03-04T12:47:57.079+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -415> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_done global_id 7002 payload 824 2024-03-04T12:47:57.220 INFO:tasks.workunit.client.0.smithi090.stderr: -414> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient: _finish_hunting 0 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr: -413> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 1 monclient: found mon.noname-a 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr: -412> 2024-03-04T12:47:57.079+0000 7fb7cbabc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr: -411> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr: -410> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr: -409> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: dump: 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.221 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr: -408> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: _finish_auth 0 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr: -407> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: _check_auth_tickets 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr: -406> 2024-03-04T12:47:57.079+0000 7fb7cf526800 5 monclient: authenticate success, global_id 7002 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr: -405> 2024-03-04T12:47:57.079+0000 7fb7cf526800 10 monclient: _renew_subs 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr: -404> 2024-03-04T12:47:57.079+0000 7fb7cf526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr: -403> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr: -402> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr: -401> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr: -400> 2024-03-04T12:47:57.079+0000 7fb6b7e07640 10 monclient: dump: 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.222 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr: -399> 2024-03-04T12:47:57.079+0000 7fb6b960a640 4 set_mon_vals no callback set 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr: -398> 2024-03-04T12:47:57.079+0000 7fb7cf526800 10 monclient: _renew_subs 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr: -397> 2024-03-04T12:47:57.079+0000 7fb7cf526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr: -396> 2024-03-04T12:47:57.079+0000 7fb7cf526800 1 librados: init done 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr: -395> 2024-03-04T12:47:57.081+0000 7fb6b7e07640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr: -394> 2024-03-04T12:47:57.081+0000 7fb6b7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr: -393> 2024-03-04T12:47:57.081+0000 7fb6b7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr: -392> 2024-03-04T12:47:57.081+0000 7fb7cb2bb640 10 monclient: get_auth_request con 0x7fb6b0069ee0 auth_method 0 2024-03-04T12:47:57.223 INFO:tasks.workunit.client.0.smithi090.stderr: -391> 2024-03-04T12:47:57.081+0000 7fb7caaba640 10 monclient: get_auth_request con 0x5610fdca79a0 auth_method 0 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr: -390> 2024-03-04T12:47:57.082+0000 7fb7cb2bb640 10 monclient: get_auth_request con 0x5610fdcb47d0 auth_method 0 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr: -389> 2024-03-04T12:47:57.082+0000 7fb7caaba640 10 monclient: get_auth_request con 0x5610fdcb8e70 auth_method 0 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr: -388> 2024-03-04T12:47:57.084+0000 7fb7cf526800 10 monclient: build_initial_monmap 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr: -387> 2024-03-04T12:47:57.084+0000 7fb7cf526800 1 build_initial for_mkfs: 0 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr: -386> 2024-03-04T12:47:57.084+0000 7fb7cf526800 10 monclient: monmap: 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:57.224 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -385> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding auth protocol: cephx 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -384> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding auth protocol: cephx 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -383> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding auth protocol: cephx 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -382> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: secure 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -381> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: crc 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -380> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: secure 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -379> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: crc 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -378> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: secure 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -377> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: crc 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -376> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: crc 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -375> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: secure 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -374> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: crc 2024-03-04T12:47:57.225 INFO:tasks.workunit.client.0.smithi090.stderr: -373> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: secure 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -372> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: crc 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -371> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbdb00) adding con mode: secure 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -370> 2024-03-04T12:47:57.084+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -369> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command objecter_requests cmddesc objecter_requests hook 0x5610fdcc31c0 EEXIST 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -368> 2024-03-04T12:47:57.084+0000 7fb7cf526800 10 monclient: init 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -367> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding auth protocol: cephx 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -366> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding auth protocol: cephx 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -365> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding auth protocol: cephx 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -364> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: secure 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -363> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: crc 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -362> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: secure 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -361> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: crc 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -360> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: secure 2024-03-04T12:47:57.226 INFO:tasks.workunit.client.0.smithi090.stderr: -359> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: crc 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -358> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: crc 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -357> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: secure 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -356> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: crc 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -355> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: secure 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -354> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: crc 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -353> 2024-03-04T12:47:57.084+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcbc168) adding con mode: secure 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -352> 2024-03-04T12:47:57.085+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -351> 2024-03-04T12:47:57.085+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -350> 2024-03-04T12:47:57.085+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command rotate-key cmddesc rotate-key hook 0x5610fdcbc2b0 EEXIST 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -349> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -348> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -347> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-c con 0x5610fdce7f20 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -346> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-a con 0x5610fdce8300 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -345> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-b con 0x5610fdce33c0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -344> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.227 INFO:tasks.workunit.client.0.smithi090.stderr: -343> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -342> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -341> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -340> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient(hunting): authenticate will time out at 1509.417597s 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -339> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): get_auth_request con 0x5610fdce8300 auth_method 0 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -338> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -337> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -336> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -335> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request con 0x5610fdce7f20 auth_method 0 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -334> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -333> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -332> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -331> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.228 INFO:tasks.workunit.client.0.smithi090.stderr: -330> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -329> 2024-03-04T12:47:57.085+0000 7fb7caaba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -328> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -327> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -326> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -325> 2024-03-04T12:47:57.085+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request con 0x5610fdce33c0 auth_method 0 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -324> 2024-03-04T12:47:57.085+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -323> 2024-03-04T12:47:57.085+0000 7fb7cbabc640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -322> 2024-03-04T12:47:57.085+0000 7fb7cbabc640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -321> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_done global_id 6614 payload 824 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -320> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient: _finish_hunting 0 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -319> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 1 monclient: found mon.noname-c 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -318> 2024-03-04T12:47:57.085+0000 7fb7cb2bb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.90:3301/0 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -317> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -316> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:47:57.229 INFO:tasks.workunit.client.0.smithi090.stderr: -315> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: dump: 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr: -314> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: _finish_auth 0 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr: -313> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: _check_auth_tickets 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr: -312> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr: -311> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.230 INFO:tasks.workunit.client.0.smithi090.stderr: -310> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr: -309> 2024-03-04T12:47:57.085+0000 7fb6b5602640 10 monclient: dump: 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr: -308> 2024-03-04T12:47:57.085+0000 7fb7cf526800 5 monclient: authenticate success, global_id 6614 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr: -307> 2024-03-04T12:47:57.085+0000 7fb7cc2bd640 4 set_mon_vals no callback set 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr: -306> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient: _renew_subs 2024-03-04T12:47:57.231 INFO:tasks.workunit.client.0.smithi090.stderr: -305> 2024-03-04T12:47:57.085+0000 7fb7cf526800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:47:57.232 INFO:tasks.workunit.client.0.smithi090.stderr: -304> 2024-03-04T12:47:57.086+0000 7fb7cf526800 10 monclient: _renew_subs 2024-03-04T12:47:57.232 INFO:tasks.workunit.client.0.smithi090.stderr: -303> 2024-03-04T12:47:57.086+0000 7fb7cf526800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.90:3301/0 2024-03-04T12:47:57.232 INFO:tasks.workunit.client.0.smithi090.stderr: -302> 2024-03-04T12:47:57.087+0000 7fb6b5602640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:47:57.232 INFO:tasks.workunit.client.0.smithi090.stderr: -301> 2024-03-04T12:47:57.087+0000 7fb6b5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:57.232 INFO:tasks.workunit.client.0.smithi090.stderr: -300> 2024-03-04T12:47:57.087+0000 7fb6b5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:57.232 INFO:tasks.workunit.client.0.smithi090.stderr: -299> 2024-03-04T12:47:57.087+0000 7fb7cf526800 10 monclient: get_monmap_and_config 2024-03-04T12:47:57.232 INFO:tasks.workunit.client.0.smithi090.stderr: -298> 2024-03-04T12:47:57.087+0000 7fb7cf526800 10 monclient: build_initial_monmap 2024-03-04T12:47:57.232 INFO:tasks.workunit.client.0.smithi090.stderr: -297> 2024-03-04T12:47:57.087+0000 7fb7cf526800 1 build_initial for_mkfs: 0 2024-03-04T12:47:57.232 INFO:tasks.workunit.client.0.smithi090.stderr: -296> 2024-03-04T12:47:57.087+0000 7fb7cf526800 10 monclient: monmap: 2024-03-04T12:47:57.232 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:57.232 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:57.232 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr: -295> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding auth protocol: cephx 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr: -294> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding auth protocol: cephx 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr: -293> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding auth protocol: cephx 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr: -292> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: secure 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr: -291> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: crc 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr: -290> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: secure 2024-03-04T12:47:57.233 INFO:tasks.workunit.client.0.smithi090.stderr: -289> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: crc 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -288> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: secure 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -287> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: crc 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -286> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: crc 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -285> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: secure 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -284> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: crc 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -283> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: secure 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -282> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: crc 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -281> 2024-03-04T12:47:57.087+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd057c0) adding con mode: secure 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -280> 2024-03-04T12:47:57.087+0000 7fb7caaba640 10 monclient: get_auth_request con 0x7fb6a4069dc0 auth_method 0 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -279> 2024-03-04T12:47:57.088+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -278> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient: init 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -277> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding auth protocol: cephx 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -276> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding auth protocol: cephx 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -275> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding auth protocol: cephx 2024-03-04T12:47:57.234 INFO:tasks.workunit.client.0.smithi090.stderr: -274> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: secure 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -273> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: crc 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -272> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: secure 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -271> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: crc 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -270> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: secure 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -269> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: crc 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -268> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: crc 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -267> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: secure 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -266> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: crc 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -265> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: secure 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -264> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: crc 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -263> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088b50) adding con mode: secure 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -262> 2024-03-04T12:47:57.088+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -261> 2024-03-04T12:47:57.088+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.235 INFO:tasks.workunit.client.0.smithi090.stderr: -260> 2024-03-04T12:47:57.088+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command rotate-key cmddesc rotate-key hook 0x7ffdf0088c98 EEXIST 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -259> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -258> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -257> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-a con 0x5610fdd344a0 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -256> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-b con 0x5610fdd07fb0 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -255> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-c con 0x5610fdd36d80 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -254> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -253> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -252> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -251> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -250> 2024-03-04T12:47:57.088+0000 7fb7cf526800 10 monclient(hunting): authenticate will time out at 1509.420965s 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -249> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request con 0x5610fdd344a0 auth_method 0 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -248> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -247> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.236 INFO:tasks.workunit.client.0.smithi090.stderr: -246> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -245> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request con 0x5610fdd36d80 auth_method 0 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -244> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -243> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -242> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -241> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -240> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -239> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -238> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -237> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -236> 2024-03-04T12:47:57.088+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -235> 2024-03-04T12:47:57.088+0000 7fb7caaba640 10 monclient(hunting): get_auth_request con 0x5610fdd07fb0 auth_method 0 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -234> 2024-03-04T12:47:57.088+0000 7fb7caaba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -233> 2024-03-04T12:47:57.088+0000 7fb7caaba640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -232> 2024-03-04T12:47:57.088+0000 7fb7caaba640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.237 INFO:tasks.workunit.client.0.smithi090.stderr: -231> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_done global_id 7008 payload 274 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr: -230> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient: _finish_hunting 0 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr: -229> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 1 monclient: found mon.noname-a 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr: -228> 2024-03-04T12:47:57.088+0000 7fb7cb2bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr: -227> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr: -226> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr: -225> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: dump: 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.238 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr: -224> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: _finish_auth 0 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr: -223> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: _check_auth_tickets 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr: -222> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr: -221> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr: -220> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr: -219> 2024-03-04T12:47:57.089+0000 7fb6aeffd640 10 monclient: dump: 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.239 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr: -218> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 monclient: authenticate success, global_id 7008 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr: -217> 2024-03-04T12:47:57.089+0000 7fb7cf526800 10 monclient: get_monmap_and_config success 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr: -216> 2024-03-04T12:47:57.089+0000 7fb7cf526800 4 set_mon_vals no callback set 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr: -215> 2024-03-04T12:47:57.089+0000 7fb7cf526800 10 monclient: shutdown 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr: -214> 2024-03-04T12:47:57.089+0000 7fb7cf526800 10 monclient: build_initial_monmap 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr: -213> 2024-03-04T12:47:57.089+0000 7fb7cf526800 1 build_initial for_mkfs: 0 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr: -212> 2024-03-04T12:47:57.089+0000 7fb7cf526800 10 monclient: monmap: 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 0 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:47:57.240 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 0.000000 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr:created 0.000000 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 0 (unknown) 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.noname-a 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.noname-b 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.noname-c 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr: -211> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding auth protocol: cephx 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr: -210> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding auth protocol: cephx 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr: -209> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding auth protocol: cephx 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr: -208> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: secure 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr: -207> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: crc 2024-03-04T12:47:57.241 INFO:tasks.workunit.client.0.smithi090.stderr: -206> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: secure 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -205> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: crc 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -204> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: secure 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -203> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: crc 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -202> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: crc 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -201> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: secure 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -200> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: crc 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -199> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: secure 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -198> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: crc 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -197> 2024-03-04T12:47:57.089+0000 7fb7cf526800 5 AuthRegistry(0x5610fdd05770) adding con mode: secure 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -196> 2024-03-04T12:47:57.090+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -195> 2024-03-04T12:47:57.090+0000 7fb7cf526800 1 librados: starting msgr at 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -194> 2024-03-04T12:47:57.090+0000 7fb7cf526800 1 librados: starting objecter 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -193> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command objecter_requests cmddesc objecter_requests hook 0x5610fdd35640 EEXIST 2024-03-04T12:47:57.242 INFO:tasks.workunit.client.0.smithi090.stderr: -192> 2024-03-04T12:47:57.090+0000 7fb7cf526800 1 librados: setting wanted keys 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -191> 2024-03-04T12:47:57.090+0000 7fb7cf526800 1 librados: calling monclient init 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -190> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient: init 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -189> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding auth protocol: cephx 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -188> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding auth protocol: cephx 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -187> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding auth protocol: cephx 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -186> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: secure 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -185> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: crc 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -184> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: secure 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -183> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: crc 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -182> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: secure 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -181> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: crc 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -180> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: crc 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -179> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: secure 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -178> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: crc 2024-03-04T12:47:57.243 INFO:tasks.workunit.client.0.smithi090.stderr: -177> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: secure 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -176> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: crc 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -175> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 AuthRegistry(0x5610fdcfd910) adding con mode: secure 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -174> 2024-03-04T12:47:57.090+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -173> 2024-03-04T12:47:57.090+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -172> 2024-03-04T12:47:57.090+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command rotate-key cmddesc rotate-key hook 0x5610fdcfda58 EEXIST 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -171> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient: _reopen_session rank -1 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -170> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -169> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-a con 0x5610fdd07fb0 addr [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -168> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-b con 0x5610fdd36d80 addr [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -167> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): picked mon.noname-c con 0x5610fdd332b0 addr [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -166> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -165> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -164> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): start opening mon connection 2024-03-04T12:47:57.244 INFO:tasks.workunit.client.0.smithi090.stderr: -163> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): _renew_subs 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -162> 2024-03-04T12:47:57.090+0000 7fb7cf526800 10 monclient(hunting): authenticate will time out at 1509.423062s 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -161> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request con 0x5610fdd07fb0 auth_method 0 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -160> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -159> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -158> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -157> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -156> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -155> 2024-03-04T12:47:57.090+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -154> 2024-03-04T12:47:57.090+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request con 0x5610fdd332b0 auth_method 0 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -153> 2024-03-04T12:47:57.090+0000 7fb7cbabc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -152> 2024-03-04T12:47:57.090+0000 7fb7cbabc640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -151> 2024-03-04T12:47:57.090+0000 7fb7cbabc640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -150> 2024-03-04T12:47:57.091+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:47:57.245 INFO:tasks.workunit.client.0.smithi090.stderr: -149> 2024-03-04T12:47:57.091+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr: -148> 2024-03-04T12:47:57.091+0000 7fb7cbabc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr: -147> 2024-03-04T12:47:57.091+0000 7fb7cb2bb640 10 monclient(hunting): handle_auth_done global_id 7011 payload 824 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr: -146> 2024-03-04T12:47:57.091+0000 7fb7cb2bb640 10 monclient: _finish_hunting 0 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr: -145> 2024-03-04T12:47:57.091+0000 7fb7cb2bb640 1 monclient: found mon.noname-a 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr: -144> 2024-03-04T12:47:57.091+0000 7fb7cb2bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr: -143> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr: -142> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr: -141> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: dump: 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.246 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr: -140> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: _finish_auth 0 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr: -139> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: _check_auth_tickets 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr: -138> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr: -137> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr: -136> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr: -135> 2024-03-04T12:47:57.091+0000 7fb6ad7fa640 10 monclient: dump: 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr:epoch 1 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr:fsid 0f6a7118-f776-445e-bdfb-0ec0be103287 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr:last_changed 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr:created 2024-03-04T12:34:55.933413+0000 2024-03-04T12:47:57.247 INFO:tasks.workunit.client.0.smithi090.stderr:min_mon_release 19 (squid) 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr:election_strategy: 1 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr: -134> 2024-03-04T12:47:57.091+0000 7fb6aeffd640 4 set_mon_vals no callback set 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr: -133> 2024-03-04T12:47:57.091+0000 7fb7cf526800 5 monclient: authenticate success, global_id 7011 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr: -132> 2024-03-04T12:47:57.091+0000 7fb7cf526800 10 monclient: _renew_subs 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr: -131> 2024-03-04T12:47:57.091+0000 7fb7cf526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr: -130> 2024-03-04T12:47:57.091+0000 7fb7cf526800 10 monclient: _renew_subs 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr: -129> 2024-03-04T12:47:57.091+0000 7fb7cf526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr: -128> 2024-03-04T12:47:57.091+0000 7fb7cf526800 1 librados: init done 2024-03-04T12:47:57.248 INFO:tasks.workunit.client.0.smithi090.stderr: -127> 2024-03-04T12:47:57.091+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command cr dump hook 0x5610fdd481c8 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -126> 2024-03-04T12:47:57.092+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -125> 2024-03-04T12:47:57.092+0000 7fb6ad7fa640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -124> 2024-03-04T12:47:57.092+0000 7fb6ad7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -123> 2024-03-04T12:47:57.092+0000 7fb6ad7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.184:6832/1920793997,v1:172.21.15.184:6833/1920793997] 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -122> 2024-03-04T12:47:57.093+0000 7fb7caaba640 10 monclient: get_auth_request con 0x7fb694069eb0 auth_method 0 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -121> 2024-03-04T12:47:57.093+0000 7fb7cbabc640 10 monclient: get_auth_request con 0x5610fdd54710 auth_method 0 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -120> 2024-03-04T12:47:57.093+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -119> 2024-03-04T12:47:57.093+0000 7fb7cf526800 20 realm 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -118> 2024-03-04T12:47:57.093+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -117> 2024-03-04T12:47:57.094+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -116> 2024-03-04T12:47:57.094+0000 7fb7cf526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -115> 2024-03-04T12:47:57.094+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -114> 2024-03-04T12:47:57.094+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.249 INFO:tasks.workunit.client.0.smithi090.stderr: -113> 2024-03-04T12:47:57.094+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -112> 2024-03-04T12:47:57.094+0000 7fb7cb2bb640 10 monclient: get_auth_request con 0x5610fdd58980 auth_method 0 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -111> 2024-03-04T12:47:57.095+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -110> 2024-03-04T12:47:57.095+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -109> 2024-03-04T12:47:57.095+0000 7fb7caaba640 10 monclient: get_auth_request con 0x5610fdd5c1e0 auth_method 0 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -108> 2024-03-04T12:47:57.095+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -107> 2024-03-04T12:47:57.095+0000 7fb7cf526800 20 searching for the correct realm 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -106> 2024-03-04T12:47:57.096+0000 7fb7cbabc640 10 monclient: get_auth_request con 0x5610fdd60f20 auth_method 0 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -105> 2024-03-04T12:47:57.096+0000 7fb7cb2bb640 10 monclient: get_auth_request con 0x7fb7c405e070 auth_method 0 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -104> 2024-03-04T12:47:57.097+0000 7fb7caaba640 10 monclient: get_auth_request con 0x7fb7bc03a040 auth_method 0 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -103> 2024-03-04T12:47:57.099+0000 7fb7caaba640 0 -- 172.21.15.90:0/2250861927 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fb7bc03a040 msgr2=0x7fb7bc01f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -102> 2024-03-04T12:47:57.099+0000 7fb6ad7fa640 1 client.7011.objecter ms_handle_reset 0x7fb7bc03a040 session 0x7fb7bc015040 osd.4 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -101> 2024-03-04T12:47:57.099+0000 7fb6ad7fa640 10 monclient: _renew_subs 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -100> 2024-03-04T12:47:57.099+0000 7fb6ad7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.90:3300/0 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -99> 2024-03-04T12:47:57.099+0000 7fb7cbabc640 10 monclient: get_auth_request con 0x7fb7bc02d040 auth_method 0 2024-03-04T12:47:57.250 INFO:tasks.workunit.client.0.smithi090.stderr: -98> 2024-03-04T12:47:57.099+0000 7fb7caaba640 10 monclient: get_auth_request con 0x7fb694079cd0 auth_method 0 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -97> 2024-03-04T12:47:57.101+0000 7fb7cb2bb640 10 monclient: get_auth_request con 0x7fb7bc050440 auth_method 0 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -96> 2024-03-04T12:47:57.102+0000 7fb7cbabc640 0 -- 172.21.15.90:0/2250861927 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7fb7bc02d040 msgr2=0x7fb7bc03d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -95> 2024-03-04T12:47:57.102+0000 7fb6ad7fa640 1 client.7011.objecter ms_handle_reset 0x7fb7bc02d040 session 0x7fb7bc01faf0 osd.6 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -94> 2024-03-04T12:47:57.102+0000 7fb7cbabc640 10 monclient: get_auth_request con 0x7fb7bc03a040 auth_method 0 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -93> 2024-03-04T12:47:57.105+0000 7fb7cf526800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -92> 2024-03-04T12:47:57.105+0000 7fb7cf526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -91> 2024-03-04T12:47:57.105+0000 7fb7cf526800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -90> 2024-03-04T12:47:57.105+0000 7fb7cf526800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -89> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -88> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -87> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -86> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -85> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.251 INFO:tasks.workunit.client.0.smithi090.stderr: -84> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -83> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -82> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -81> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 zone default found 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -80> 2024-03-04T12:47:57.106+0000 7fb7cf526800 4 Realm: () 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -79> 2024-03-04T12:47:57.106+0000 7fb7cf526800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -78> 2024-03-04T12:47:57.106+0000 7fb7cf526800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -77> 2024-03-04T12:47:57.106+0000 7fb7cf526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -76> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 zonegroup default 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -75> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -74> 2024-03-04T12:47:57.106+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -73> 2024-03-04T12:47:57.107+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -72> 2024-03-04T12:47:57.107+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -71> 2024-03-04T12:47:57.107+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.252 INFO:tasks.workunit.client.0.smithi090.stderr: -70> 2024-03-04T12:47:57.107+0000 7fb7cf526800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -69> 2024-03-04T12:47:57.107+0000 7fb7cf526800 20 started sync module instance, tier type = 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -68> 2024-03-04T12:47:57.107+0000 7fb7cf526800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -67> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=0 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -66> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=1 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -65> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=2 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -64> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=3 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -63> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=4 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -62> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=5 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -61> 2024-03-04T12:47:57.115+0000 7fb7cf526800 20 add_watcher() i=6 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -60> 2024-03-04T12:47:57.116+0000 7fb7cf526800 20 add_watcher() i=7 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -59> 2024-03-04T12:47:57.116+0000 7fb7cf526800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -58> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding auth protocol: cephx 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -57> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding auth protocol: cephx 2024-03-04T12:47:57.253 INFO:tasks.workunit.client.0.smithi090.stderr: -56> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding auth protocol: cephx 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -55> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: secure 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -54> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: crc 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -53> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: secure 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -52> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: crc 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -51> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: secure 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -50> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: crc 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -49> 2024-03-04T12:47:57.118+0000 7fb681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -48> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: crc 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -47> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: secure 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -46> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: crc 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -45> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: secure 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -44> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: crc 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -43> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 AuthRegistry(0x7ffdf0088fe0) adding con mode: secure 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -42> 2024-03-04T12:47:57.118+0000 7fb7cf526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:47:57.254 INFO:tasks.workunit.client.0.smithi090.stderr: -41> 2024-03-04T12:47:57.118+0000 7fb7cf526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -40> 2024-03-04T12:47:57.118+0000 7fb7cf526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -39> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command cache list hook 0x5610fdd33710 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -38> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command cache inspect hook 0x5610fdd33710 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -37> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command cache erase hook 0x5610fdd33710 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -36> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command cache zap hook 0x5610fdd33710 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -35> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 note: GC not initialized 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -34> 2024-03-04T12:47:57.118+0000 7fb680fe1640 20 reqs_thread_entry: start 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -33> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command sync trace show hook 0x7fb7bc012040 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -32> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command sync trace history hook 0x7fb7bc012040 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -31> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command sync trace active hook 0x7fb7bc012040 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -30> 2024-03-04T12:47:57.118+0000 7fb7cf526800 5 asok(0x5610fda4d0c0) register_command sync trace active_short hook 0x7fb7bc012040 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -29> 2024-03-04T12:47:57.118+0000 7fb7cf526800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -28> 2024-03-04T12:47:57.118+0000 7fb7cf526800 20 Filter name: none 2024-03-04T12:47:57.255 INFO:tasks.workunit.client.0.smithi090.stderr: -27> 2024-03-04T12:47:57.118+0000 7fb5fa7fc640 20 reqs_thread_entry: start 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -26> 2024-03-04T12:47:57.118+0000 7fb7cf526800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -25> 2024-03-04T12:47:57.118+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -24> 2024-03-04T12:47:57.119+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -23> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -22> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -21> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 : miss 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -20> 2024-03-04T12:47:57.119+0000 7fb7cf526800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -19> 2024-03-04T12:47:57.119+0000 7fb7cf526800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -18> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -17> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -16> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -15> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -14> 2024-03-04T12:47:57.119+0000 7fb7cf526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 2024-03-04T12:47:57.256 INFO:tasks.workunit.client.0.smithi090.stderr: -13> 2024-03-04T12:47:57.126+0000 7fb7cf526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: -12> 2024-03-04T12:47:57.126+0000 7fb7cf526800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: -11> 2024-03-04T12:47:57.126+0000 7fb7cf526800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: -10> 2024-03-04T12:47:57.126+0000 7fb7cf526800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28, ofs0, ns] 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: -9> 2024-03-04T12:47:57.127+0000 7fb6aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824083 cookie 94630978166512 notifier 7011 bl.length()=873 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: -8> 2024-03-04T12:47:57.127+0000 7fb6aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: -7> 2024-03-04T12:47:57.127+0000 7fb6aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: -6> 2024-03-04T12:47:57.127+0000 7fb6aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: -5> 2024-03-04T12:47:57.127+0000 7fb7cf526800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): orig_sources= new_sources= 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: -4> 2024-03-04T12:47:57.127+0000 7fb7cf526800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): potential sources added=[] removed=[] 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: -3> 2024-03-04T12:47:57.127+0000 7fb7cf526800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): orig_dests= new_dests= 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: -2> 2024-03-04T12:47:57.127+0000 7fb7cf526800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): potential dests added=[] removed=[] 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: -1> 2024-03-04T12:47:57.130+0000 7fb7cf526800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb7cf526800 time 2024-03-04T12:47:57.131435+0000 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:47:57.257 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb7d0b80e86] 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fb7d0b81044] 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610fb8c0eb1] 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5610fb8d4de4] 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: 5: main() 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fb7cfa3feb0] 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: 7: __libc_start_main() 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: 8: _start() 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: 0> 2024-03-04T12:47:57.131+0000 7fb7cf526800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: in thread 7fb7cf526800 thread_name:radosgw-admin 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.258 INFO:tasks.workunit.client.0.smithi090.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fb7cfa54db0] 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fb7cfaa154c] 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 3: raise() 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 4: abort() 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb7d0b80ee0] 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fb7d0b81044] 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5610fb8c0eb1] 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5610fb8d4de4] 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 9: main() 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fb7cfa3feb0] 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 11: __libc_start_main() 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 12: _start() 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:47:57.259 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr:--- logging levels --- 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 none 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 lockdep 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 context 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 crush 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_balancer 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_locker 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_log_expire 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mds_migrator 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 buffer 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 timer 2024-03-04T12:47:57.260 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 filer 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 striper 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 1 objecter 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rados 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_mirror 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_replay 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 rbd_pwl 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 journaler 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objectcacher 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 client 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 osd 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 optracker 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 objclass 2024-03-04T12:47:57.261 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 filestore 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 journal 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 ms 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mon 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 0/10 monc 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 paxos 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 tp 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 auth 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 crypto 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 finisher 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 reserver 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 heartbeatmap 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 perfcounter 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 20/20 rgw 2024-03-04T12:47:57.262 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_sync 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_datacache 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_access 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_flight 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 javaclient 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 asok 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 1 throttle 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 0 refs 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 compressor 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluestore 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 bluefs 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 3 bdev 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 kstore 2024-03-04T12:47:57.263 INFO:tasks.workunit.client.0.smithi090.stderr: 4/ 5 rocksdb 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 fuse 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 2/ 5 mgr 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mgrc 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 dpdk 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 eventtrace 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 prioritycache 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 test 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cephsqlite 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_onode 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_odata 2024-03-04T12:47:57.264 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_omap 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_tm 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_t 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_epm 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_lba 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_cache 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_journal 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_device 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 seastore_backref 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 alienstore 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 mclock 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 0/ 5 cyanstore 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 ceph_exporter 2024-03-04T12:47:57.265 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 memstore 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: 1/ 5 trace 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: -2/-2 (syslog threshold) 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: 99/99 (stderr threshold) 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb5fa7fc640 / http_manager 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb680fe1640 / http_manager 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb681fe3640 / rgw_dt_lg_renew 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb6ad7fa640 / ms_dispatch 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb6aeffd640 / io_context_pool 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb6b5602640 / ms_dispatch 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb6b7e07640 / ms_dispatch 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb6b960a640 / io_context_pool 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb7caaba640 / msgr-worker-2 2024-03-04T12:47:57.266 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb7cb2bb640 / msgr-worker-1 2024-03-04T12:47:57.267 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb7cbabc640 / msgr-worker-0 2024-03-04T12:47:57.267 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb7cc2bd640 / io_context_pool 2024-03-04T12:47:57.267 INFO:tasks.workunit.client.0.smithi090.stderr: 7fb7cf526800 / radosgw-admin 2024-03-04T12:47:57.267 INFO:tasks.workunit.client.0.smithi090.stderr: max_recent 500 2024-03-04T12:47:57.267 INFO:tasks.workunit.client.0.smithi090.stderr: max_new 1000 2024-03-04T12:47:57.267 INFO:tasks.workunit.client.0.smithi090.stderr: log_file /var/lib/ceph/crash/2024-03-04T12:47:57.132836Z_f67623e6-592a-4457-9a3d-78eeb0dab1bd/log 2024-03-04T12:47:57.267 INFO:tasks.workunit.client.0.smithi090.stderr:--- end dump of recent events --- 2024-03-04T12:47:57.267 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-04T12:47:57.269 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:47:57.269 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:47:57.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.201+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.202+0000 7f7edcc39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.202+0000 7f7edcc39800 20 realm 2024-03-04T12:47:57.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.202+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.202+0000 7f7edcc39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.202+0000 7f7edcc39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:47:57.269 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.202+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.202+0000 7f7edcc39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.202+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.203+0000 7f7edcc39800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:57.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.203+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.204+0000 7f7edcc39800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:47:57.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.204+0000 7f7edcc39800 20 searching for the correct realm 2024-03-04T12:47:57.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.206+0000 7f7ed786f640 0 -- 172.21.15.90:0/3874396932 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f7ed000f430 msgr2=0x7f7ed000f8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:47:57.270 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.210+0000 7f7ed786f640 0 -- 172.21.15.90:0/3874396932 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f7ec00b17f0 msgr2=0x7f7ec00ac790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:47:57.423 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.416+0000 7f7edcc39800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:47:57.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.416+0000 7f7edcc39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:47:57.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.416+0000 7f7edcc39800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:47:57.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.416+0000 7f7edcc39800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:47:57.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.416+0000 7f7edcc39800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:47:57.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.416+0000 7f7edcc39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:47:57.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.416+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.416+0000 7f7edcc39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.416+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.417+0000 7f7edcc39800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.417+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.417+0000 7f7edcc39800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.417+0000 7f7edcc39800 20 zone default found 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.417+0000 7f7edcc39800 4 Realm: () 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.417+0000 7f7edcc39800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.417+0000 7f7edcc39800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.417+0000 7f7edcc39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.417+0000 7f7edcc39800 20 zonegroup default 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.417+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.417+0000 7f7edcc39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.417+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.418+0000 7f7edcc39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.418+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.418+0000 7f7edcc39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.418+0000 7f7edcc39800 20 started sync module instance, tier type = 2024-03-04T12:47:57.426 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.418+0000 7f7edcc39800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:47:57.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.427+0000 7f7edcc39800 20 add_watcher() i=0 2024-03-04T12:47:57.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.427+0000 7f7edcc39800 20 add_watcher() i=1 2024-03-04T12:47:57.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.427+0000 7f7edcc39800 20 add_watcher() i=2 2024-03-04T12:47:57.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.427+0000 7f7edcc39800 20 add_watcher() i=3 2024-03-04T12:47:57.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.427+0000 7f7edcc39800 20 add_watcher() i=4 2024-03-04T12:47:57.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.427+0000 7f7edcc39800 20 add_watcher() i=5 2024-03-04T12:47:57.434 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.427+0000 7f7edcc39800 20 add_watcher() i=6 2024-03-04T12:47:57.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.428+0000 7f7edcc39800 20 add_watcher() i=7 2024-03-04T12:47:57.435 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.428+0000 7f7edcc39800 2 all 8 watchers are set, enabling cache 2024-03-04T12:47:57.436 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.429+0000 7f7d8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:57.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.430+0000 7f7edcc39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:47:57.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.430+0000 7f7edcc39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:47:57.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.430+0000 7f7edcc39800 5 note: GC not initialized 2024-03-04T12:47:57.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.430+0000 7f7d8cfe1640 20 reqs_thread_entry: start 2024-03-04T12:47:57.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.430+0000 7f7edcc39800 20 init_complete bucket index max shards: 11 2024-03-04T12:47:57.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.430+0000 7f7edcc39800 20 Filter name: none 2024-03-04T12:47:57.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.430+0000 7f7d067fc640 20 reqs_thread_entry: start 2024-03-04T12:47:57.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.430+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.431+0000 7f7edcc39800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:57.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.431+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.431+0000 7f7edcc39800 20 rados_obj.operate() r=0 bl.length=403 2024-03-04T12:47:57.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.431+0000 7f7edcc39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:57.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.431+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.432+0000 7f7edcc39800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:47:57.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.432+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.432+0000 7f7edcc39800 20 rados_obj.operate() r=0 bl.length=403 2024-03-04T12:47:57.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.432+0000 7f7edcc39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:47:57.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.433+0000 7f7edcc39800 20 rados->read ofs=0 len=0 2024-03-04T12:47:57.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.433+0000 7f7edcc39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:47:57.441 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.434+0000 7f7d8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:47:57.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.436+0000 7f7edcc39800 20 remove_watcher() i=0 2024-03-04T12:47:57.443 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.436+0000 7f7edcc39800 2 removed watcher, disabling cache 2024-03-04T12:47:57.444 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.437+0000 7f7edcc39800 20 remove_watcher() i=1 2024-03-04T12:47:57.445 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.438+0000 7f7edcc39800 20 remove_watcher() i=2 2024-03-04T12:47:57.446 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.439+0000 7f7edcc39800 20 remove_watcher() i=3 2024-03-04T12:47:57.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.440+0000 7f7edcc39800 20 remove_watcher() i=4 2024-03-04T12:47:57.447 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.441+0000 7f7edcc39800 20 remove_watcher() i=5 2024-03-04T12:47:57.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.442+0000 7f7edcc39800 20 remove_watcher() i=6 2024-03-04T12:47:57.449 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:47:57.442+0000 7f7edcc39800 20 remove_watcher() i=7 2024-03-04T12:47:57.459 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.459 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:47:57.459 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: abort-at-do-reshard id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:47:57.459 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:47:57.460 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:47:57.461 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:27.498 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:27.498 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:27.541 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:48:27.574 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:27.574 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:27.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.606+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.607+0000 7f0698924800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.607+0000 7f0698924800 20 realm 2024-03-04T12:48:27.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.607+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.608+0000 7f0698924800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.608+0000 7f0698924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:27.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.608+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.608+0000 7f0698924800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.614 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.608+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.609+0000 7f0698924800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:27.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.609+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.610+0000 7f0698924800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:27.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.610+0000 7f0698924800 20 searching for the correct realm 2024-03-04T12:48:27.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.613+0000 7f0694e24640 0 -- 172.21.15.90:0/2598767673 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x555ad8129250 msgr2=0x555ad812b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:48:27.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.617+0000 7f0694623640 0 -- 172.21.15.90:0/2598767673 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f067c060ba0 msgr2=0x7f067c066710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:27.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.622+0000 7f0698924800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:27.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.622+0000 7f0698924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:27.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.622+0000 7f0698924800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:27.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.622+0000 7f0698924800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:27.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.622+0000 7f0698924800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:27.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.622+0000 7f0698924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:27.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.622+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.622+0000 7f0698924800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.622+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.622+0000 7f0698924800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:27.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.622+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.623+0000 7f0698924800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:27.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.623+0000 7f0698924800 20 zone default found 2024-03-04T12:48:27.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.623+0000 7f0698924800 4 Realm: () 2024-03-04T12:48:27.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.623+0000 7f0698924800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:27.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.623+0000 7f0698924800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:27.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.623+0000 7f0698924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:27.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.623+0000 7f0698924800 20 zonegroup default 2024-03-04T12:48:27.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.623+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.623+0000 7f0698924800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.623+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.623+0000 7f0698924800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.623+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.624+0000 7f0698924800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.624+0000 7f0698924800 20 started sync module instance, tier type = 2024-03-04T12:48:27.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.624+0000 7f0698924800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:27.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.633+0000 7f0698924800 20 add_watcher() i=0 2024-03-04T12:48:27.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.633+0000 7f0698924800 20 add_watcher() i=1 2024-03-04T12:48:27.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.633+0000 7f0698924800 20 add_watcher() i=2 2024-03-04T12:48:27.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.633+0000 7f0698924800 20 add_watcher() i=3 2024-03-04T12:48:27.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.633+0000 7f0698924800 20 add_watcher() i=4 2024-03-04T12:48:27.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.633+0000 7f0698924800 20 add_watcher() i=5 2024-03-04T12:48:27.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.633+0000 7f0698924800 20 add_watcher() i=6 2024-03-04T12:48:27.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.634+0000 7f0698924800 20 add_watcher() i=7 2024-03-04T12:48:27.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.634+0000 7f0698924800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:27.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.635+0000 7f054afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:27.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.636+0000 7f0698924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:27.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.636+0000 7f0698924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:27.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.636+0000 7f0698924800 5 note: GC not initialized 2024-03-04T12:48:27.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.636+0000 7f0549fdb640 20 reqs_thread_entry: start 2024-03-04T12:48:27.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.636+0000 7f0698924800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:27.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.636+0000 7f0698924800 20 Filter name: none 2024-03-04T12:48:27.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.636+0000 7f04bb7fe640 20 reqs_thread_entry: start 2024-03-04T12:48:27.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.636+0000 7f0698924800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-04T12:48:27.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.636+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.637+0000 7f0698924800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:48:27.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.637+0000 7f0698924800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-04T12:48:27.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.637+0000 7f0698924800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-04T12:48:27.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.637+0000 7f0698924800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 : miss 2024-03-04T12:48:27.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.637+0000 7f0698924800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.637+0000 7f0698924800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:48:27.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.637+0000 7f0698924800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:48:27.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.637+0000 7f0698924800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:48:27.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.637+0000 7f0698924800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:48:27.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.637+0000 7f0698924800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:48:27.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.637+0000 7f0698924800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 2024-03-04T12:48:27.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.643+0000 7f0698924800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:48:27.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.643+0000 7f0698924800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:48:27.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.643+0000 7f0698924800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:48:27.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.643+0000 7f0698924800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28, ofs0, ns] 2024-03-04T12:48:27.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.643+0000 7f056b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824085 cookie 93848660588512 notifier 6656 bl.length()=873 2024-03-04T12:48:27.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.643+0000 7f056b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:48:27.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.643+0000 7f056b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:48:27.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.643+0000 7f056b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:48:27.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.643+0000 7f0698924800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): orig_sources= new_sources= 2024-03-04T12:48:27.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.643+0000 7f0698924800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): potential sources added=[] removed=[] 2024-03-04T12:48:27.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.643+0000 7f0698924800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): orig_dests= new_dests= 2024-03-04T12:48:27.650 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.643+0000 7f0698924800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): potential dests added=[] removed=[] 2024-03-04T12:48:27.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.0 2024-03-04T12:48:27.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.0 2024-03-04T12:48:27.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.1 2024-03-04T12:48:27.652 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.1 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.2 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.2 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.3 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.3 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.4 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.4 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.5 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.5 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.6 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.6 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.7 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.7 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.8 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.8 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.9 2024-03-04T12:48:27.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.9 2024-03-04T12:48:27.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.10 2024-03-04T12:48:27.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.10 2024-03-04T12:48:27.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.11 2024-03-04T12:48:27.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1.11 2024-03-04T12:48:27.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.0 2024-03-04T12:48:27.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.646+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.1 2024-03-04T12:48:27.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.647+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.2 2024-03-04T12:48:27.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.647+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.3 2024-03-04T12:48:27.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.648+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.4 2024-03-04T12:48:27.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.648+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.5 2024-03-04T12:48:27.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.648+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.6 2024-03-04T12:48:27.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.650+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.7 2024-03-04T12:48:27.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.650+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.8 2024-03-04T12:48:27.657 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.651+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.9 2024-03-04T12:48:27.657 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.651+0000 7f0698924800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28.10 2024-03-04T12:48:27.660 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.654+0000 7f0698924800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 : hit (requested=0x17, cached=0x17) 2024-03-04T12:48:27.661 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.654+0000 7f0698924800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 2024-03-04T12:48:27.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.656+0000 7f0698924800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:48:27.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.656+0000 7f0698924800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:48:27.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.656+0000 7f0698924800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:48:27.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.656+0000 7f0698924800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28, ofs0, ns] 2024-03-04T12:48:27.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.656+0000 7f056b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824086 cookie 93848660588512 notifier 6656 bl.length()=841 2024-03-04T12:48:27.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.656+0000 7f056b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 info.flags=0x17 2024-03-04T12:48:27.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.656+0000 7f056b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 to cache LRU end 2024-03-04T12:48:27.662 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.656+0000 7f056b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-04T12:48:27.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.656+0000 7f0698924800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): orig_sources= new_sources= 2024-03-04T12:48:27.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.656+0000 7f0698924800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): potential sources added=[] removed=[] 2024-03-04T12:48:27.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.656+0000 7f0698924800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): orig_dests= new_dests= 2024-03-04T12:48:27.663 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.656+0000 7f0698924800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28]): potential dests added=[] removed=[] 2024-03-04T12:48:27.665 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.659+0000 7f0698924800 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2024-03-04T12:48:27.667 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.661+0000 7f054afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:27.669 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.663+0000 7f0698924800 20 remove_watcher() i=0 2024-03-04T12:48:27.669 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.663+0000 7f0698924800 2 removed watcher, disabling cache 2024-03-04T12:48:27.670 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.664+0000 7f0698924800 20 remove_watcher() i=1 2024-03-04T12:48:27.671 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.665+0000 7f0698924800 20 remove_watcher() i=2 2024-03-04T12:48:27.672 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.666+0000 7f0698924800 20 remove_watcher() i=3 2024-03-04T12:48:27.673 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.667+0000 7f0698924800 20 remove_watcher() i=4 2024-03-04T12:48:27.674 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.668+0000 7f0698924800 20 remove_watcher() i=5 2024-03-04T12:48:27.675 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.669+0000 7f0698924800 20 remove_watcher() i=6 2024-03-04T12:48:27.676 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.670+0000 7f0698924800 20 remove_watcher() i=7 2024-03-04T12:48:27.687 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-04T12:48:27.714 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:27.714 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:27.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.741+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.743+0000 7fe98a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.743+0000 7fe98a933800 20 realm 2024-03-04T12:48:27.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.743+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.743+0000 7fe98a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.743+0000 7fe98a933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:27.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.743+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.743+0000 7fe98a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.749 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.743+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.744+0000 7fe98a933800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:27.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.744+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.744+0000 7fe98a933800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:27.750 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.744+0000 7fe98a933800 20 searching for the correct realm 2024-03-04T12:48:27.752 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.746+0000 7fe97ddd2640 0 -- 172.21.15.90:0/131177117 >> [v2:172.21.15.90:6817/137526376,v1:172.21.15.90:6819/137526376] conn(0x5640994ee520 msgr2=0x5640994f0910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:27.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.750+0000 7fe9865d3640 0 -- 172.21.15.90:0/131177117 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7fe98005f070 msgr2=0x7fe980007580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:27.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.755+0000 7fe98a933800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:27.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.755+0000 7fe98a933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:27.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.755+0000 7fe98a933800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:27.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.755+0000 7fe98a933800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:27.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.755+0000 7fe98a933800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:27.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.755+0000 7fe98a933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:27.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.755+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.755+0000 7fe98a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.755+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.755+0000 7fe98a933800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:27.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.755+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.756+0000 7fe98a933800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:27.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.756+0000 7fe98a933800 20 zone default found 2024-03-04T12:48:27.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.756+0000 7fe98a933800 4 Realm: () 2024-03-04T12:48:27.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.756+0000 7fe98a933800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:27.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.756+0000 7fe98a933800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:27.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.756+0000 7fe98a933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:27.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.756+0000 7fe98a933800 20 zonegroup default 2024-03-04T12:48:27.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.756+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.756+0000 7fe98a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.756+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.756+0000 7fe98a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.756+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.757+0000 7fe98a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.757+0000 7fe98a933800 20 started sync module instance, tier type = 2024-03-04T12:48:27.764 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.757+0000 7fe98a933800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:27.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.765+0000 7fe98a933800 20 add_watcher() i=0 2024-03-04T12:48:27.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.765+0000 7fe98a933800 20 add_watcher() i=1 2024-03-04T12:48:27.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.765+0000 7fe98a933800 20 add_watcher() i=2 2024-03-04T12:48:27.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.765+0000 7fe98a933800 20 add_watcher() i=3 2024-03-04T12:48:27.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.765+0000 7fe98a933800 20 add_watcher() i=4 2024-03-04T12:48:27.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.765+0000 7fe98a933800 20 add_watcher() i=5 2024-03-04T12:48:27.771 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.765+0000 7fe98a933800 20 add_watcher() i=6 2024-03-04T12:48:27.772 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.766+0000 7fe98a933800 20 add_watcher() i=7 2024-03-04T12:48:27.772 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.766+0000 7fe98a933800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:27.773 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.767+0000 7fe83cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:27.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.768+0000 7fe98a933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:27.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.768+0000 7fe98a933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:27.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.768+0000 7fe98a933800 5 note: GC not initialized 2024-03-04T12:48:27.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.768+0000 7fe7b77fe640 20 reqs_thread_entry: start 2024-03-04T12:48:27.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.768+0000 7fe98a933800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:27.774 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.768+0000 7fe98a933800 20 Filter name: none 2024-03-04T12:48:27.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.768+0000 7fe7b57fa640 20 reqs_thread_entry: start 2024-03-04T12:48:27.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.768+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.775 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.769+0000 7fe98a933800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:48:27.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.769+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.769+0000 7fe98a933800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:48:27.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.769+0000 7fe98a933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:27.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.769+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.770+0000 7fe98a933800 20 rados_obj.operate() r=0 bl.length=187 2024-03-04T12:48:27.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.770+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.770+0000 7fe98a933800 20 rados_obj.operate() r=0 bl.length=371 2024-03-04T12:48:27.776 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.770+0000 7fe98a933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:27.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.771+0000 7fe98a933800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.777 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.771+0000 7fe98a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.778 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.772+0000 7fe83cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:27.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.774+0000 7fe98a933800 20 remove_watcher() i=0 2024-03-04T12:48:27.780 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.774+0000 7fe98a933800 2 removed watcher, disabling cache 2024-03-04T12:48:27.781 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.775+0000 7fe98a933800 20 remove_watcher() i=1 2024-03-04T12:48:27.782 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.776+0000 7fe98a933800 20 remove_watcher() i=2 2024-03-04T12:48:27.783 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.777+0000 7fe98a933800 20 remove_watcher() i=3 2024-03-04T12:48:27.784 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.779+0000 7fe98a933800 20 remove_watcher() i=4 2024-03-04T12:48:27.785 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.780+0000 7fe98a933800 20 remove_watcher() i=5 2024-03-04T12:48:27.786 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.780+0000 7fe98a933800 20 remove_watcher() i=6 2024-03-04T12:48:27.787 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.781+0000 7fe98a933800 20 remove_watcher() i=7 2024-03-04T12:48:27.796 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:48:27.797 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:48:27.797 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: abort-at-do-reshard id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:48:27.797 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:48:27.798 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:27.798 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:27.802 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:27.802 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:27.846 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:27.846 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:27.872 INFO:tasks.workunit.client.0.smithi090.stderr: test: reshard versioned bucket 2024-03-04T12:48:27.874 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket myver 2024-03-04T12:48:27.901 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:27.901 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:27.933 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.927+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.929+0000 7f753fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.929+0000 7f753fc15800 20 realm 2024-03-04T12:48:27.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.929+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.929+0000 7f753fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.929+0000 7f753fc15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:27.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.929+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.935 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.929+0000 7f753fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:27.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.929+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.930+0000 7f753fc15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:27.936 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.930+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:27.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.931+0000 7f753fc15800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:27.937 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.931+0000 7f753fc15800 20 searching for the correct realm 2024-03-04T12:48:27.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.933+0000 7f753b1de640 0 -- 172.21.15.90:0/2618874089 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f753405e040 msgr2=0x7f753407e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:27.942 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:27.937+0000 7f753b1de640 0 -- 172.21.15.90:0/2618874089 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f753007f850 msgr2=0x7f753006a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:28.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.143+0000 7f753fc15800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:28.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.143+0000 7f753fc15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:28.149 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.143+0000 7f753fc15800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:28.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.143+0000 7f753fc15800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:28.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.143+0000 7f753fc15800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:28.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.143+0000 7f753fc15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:28.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.143+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.143+0000 7f753fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.150 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.143+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.144+0000 7f753fc15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:28.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.144+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.144+0000 7f753fc15800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:28.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.144+0000 7f753fc15800 20 zone default found 2024-03-04T12:48:28.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.144+0000 7f753fc15800 4 Realm: () 2024-03-04T12:48:28.151 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.144+0000 7f753fc15800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:28.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.144+0000 7f753fc15800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:28.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.144+0000 7f753fc15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:28.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.144+0000 7f753fc15800 20 zonegroup default 2024-03-04T12:48:28.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.144+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.144+0000 7f753fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.144+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.145+0000 7f753fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.145+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.145+0000 7f753fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.145+0000 7f753fc15800 20 started sync module instance, tier type = 2024-03-04T12:48:28.152 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.145+0000 7f753fc15800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:28.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.154+0000 7f753fc15800 20 add_watcher() i=0 2024-03-04T12:48:28.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.154+0000 7f753fc15800 20 add_watcher() i=1 2024-03-04T12:48:28.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.154+0000 7f753fc15800 20 add_watcher() i=2 2024-03-04T12:48:28.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.154+0000 7f753fc15800 20 add_watcher() i=3 2024-03-04T12:48:28.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.154+0000 7f753fc15800 20 add_watcher() i=4 2024-03-04T12:48:28.160 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.154+0000 7f753fc15800 20 add_watcher() i=5 2024-03-04T12:48:28.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.154+0000 7f753fc15800 20 add_watcher() i=6 2024-03-04T12:48:28.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.155+0000 7f753fc15800 20 add_watcher() i=7 2024-03-04T12:48:28.161 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.155+0000 7f753fc15800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:28.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.157+0000 7f73f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:28.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.157+0000 7f753fc15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:28.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.157+0000 7f753fc15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:28.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.157+0000 7f753fc15800 5 note: GC not initialized 2024-03-04T12:48:28.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.157+0000 7f73f0fe1640 20 reqs_thread_entry: start 2024-03-04T12:48:28.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.157+0000 7f753fc15800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:28.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.157+0000 7f753fc15800 20 Filter name: none 2024-03-04T12:48:28.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.157+0000 7f736a7fc640 20 reqs_thread_entry: start 2024-03-04T12:48:28.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.157+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.158+0000 7f753fc15800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:28.164 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.158+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.159+0000 7f753fc15800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:28.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.159+0000 7f753fc15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:28.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.159+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.159+0000 7f753fc15800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:28.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.159+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.160+0000 7f753fc15800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:28.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.160+0000 7f753fc15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:28.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.160+0000 7f753fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.161+0000 7f753fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.161+0000 7f73f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:28.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.163+0000 7f753fc15800 20 remove_watcher() i=0 2024-03-04T12:48:28.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.163+0000 7f753fc15800 2 removed watcher, disabling cache 2024-03-04T12:48:28.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.164+0000 7f753fc15800 20 remove_watcher() i=1 2024-03-04T12:48:28.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.165+0000 7f753fc15800 20 remove_watcher() i=2 2024-03-04T12:48:28.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.166+0000 7f753fc15800 20 remove_watcher() i=3 2024-03-04T12:48:28.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.167+0000 7f753fc15800 20 remove_watcher() i=4 2024-03-04T12:48:28.174 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.168+0000 7f753fc15800 20 remove_watcher() i=5 2024-03-04T12:48:28.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.169+0000 7f753fc15800 20 remove_watcher() i=6 2024-03-04T12:48:28.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.170+0000 7f753fc15800 20 remove_watcher() i=7 2024-03-04T12:48:28.185 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:48:28.186 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:48:28.186 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: myver id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-03-04T12:48:28.186 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:48:28.187 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-03-04T12:48:28.216 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:28.217 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:28.250 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.244+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.245+0000 7f75c6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.245+0000 7f75c6e24800 20 realm 2024-03-04T12:48:28.251 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.245+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.245+0000 7f75c6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.245+0000 7f75c6e24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:28.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.245+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.245+0000 7f75c6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.252 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.245+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.246+0000 7f75c6e24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:28.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.246+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.247+0000 7f75c6e24800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:28.253 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.247+0000 7f75c6e24800 20 searching for the correct realm 2024-03-04T12:48:28.256 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.250+0000 7f75c5128640 0 -- 172.21.15.90:0/2163696231 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x55f281c0de40 msgr2=0x55f281c10300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:28.259 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.253+0000 7f75c4927640 0 -- 172.21.15.90:0/2163696231 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f75b00c30b0 msgr2=0x7f75b00985f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:28.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.257+0000 7f75c6e24800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:28.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.257+0000 7f75c6e24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:28.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.257+0000 7f75c6e24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:28.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.257+0000 7f75c6e24800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:28.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.257+0000 7f75c6e24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:28.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.257+0000 7f75c6e24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:28.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.257+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.257+0000 7f75c6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.257+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.258+0000 7f75c6e24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:28.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.258+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.265 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.258+0000 7f75c6e24800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.258+0000 7f75c6e24800 20 zone default found 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.258+0000 7f75c6e24800 4 Realm: () 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.258+0000 7f75c6e24800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.258+0000 7f75c6e24800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.258+0000 7f75c6e24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.258+0000 7f75c6e24800 20 zonegroup default 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.258+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.258+0000 7f75c6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.258+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.259+0000 7f75c6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.259+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.259+0000 7f75c6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.259+0000 7f75c6e24800 20 started sync module instance, tier type = 2024-03-04T12:48:28.266 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.259+0000 7f75c6e24800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:28.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.267+0000 7f75c6e24800 20 add_watcher() i=0 2024-03-04T12:48:28.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.267+0000 7f75c6e24800 20 add_watcher() i=1 2024-03-04T12:48:28.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.267+0000 7f75c6e24800 20 add_watcher() i=2 2024-03-04T12:48:28.273 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.267+0000 7f75c6e24800 20 add_watcher() i=3 2024-03-04T12:48:28.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.267+0000 7f75c6e24800 20 add_watcher() i=4 2024-03-04T12:48:28.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.267+0000 7f75c6e24800 20 add_watcher() i=5 2024-03-04T12:48:28.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.267+0000 7f75c6e24800 20 add_watcher() i=6 2024-03-04T12:48:28.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.268+0000 7f75c6e24800 20 add_watcher() i=7 2024-03-04T12:48:28.274 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.268+0000 7f75c6e24800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:28.276 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.270+0000 7f747afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.270+0000 7f75c6e24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.270+0000 7f75c6e24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.270+0000 7f75c6e24800 5 note: GC not initialized 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.270+0000 7f7479fe3640 20 reqs_thread_entry: start 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.270+0000 7f75c6e24800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.270+0000 7f75c6e24800 20 Filter name: none 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.270+0000 7f73eb7fe640 20 reqs_thread_entry: start 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.270+0000 7f75c6e24800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.270+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.271+0000 7f75c6e24800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.271+0000 7f75c6e24800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.271+0000 7f75c6e24800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.271+0000 7f75c6e24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 : miss 2024-03-04T12:48:28.277 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.271+0000 7f75c6e24800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.271+0000 7f75c6e24800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:28.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.271+0000 7f75c6e24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:28.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.271+0000 7f75c6e24800 10 adding default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:28.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.271+0000 7f75c6e24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:48:28.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.271+0000 7f75c6e24800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:28.278 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.271+0000 7f75c6e24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 2024-03-04T12:48:28.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.276+0000 7f75c6e24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:28.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.276+0000 7f75c6e24800 10 moving default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:28.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.276+0000 7f75c6e24800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:28.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.276+0000 7f75c6e24800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18, ofs0, ns] 2024-03-04T12:48:28.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.277+0000 7f749bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824036 cookie 94500047359424 notifier 7101 bl.length()=783 2024-03-04T12:48:28.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.277+0000 7f749bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:28.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.277+0000 7f749bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:28.283 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.277+0000 7f749bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:28.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.277+0000 7f75c6e24800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): orig_sources= new_sources= 2024-03-04T12:48:28.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.277+0000 7f75c6e24800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): potential sources added=[] removed=[] 2024-03-04T12:48:28.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.277+0000 7f75c6e24800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): orig_dests= new_dests= 2024-03-04T12:48:28.284 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.277+0000 7f75c6e24800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): potential dests added=[] removed=[] 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.0 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.0 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.1 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.1 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.2 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.2 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.3 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.3 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.4 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.4 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.5 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.5 2024-03-04T12:48:28.286 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.6 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.6 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.7 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.7 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.8 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.8 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.9 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.279+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.9 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.280+0000 7f75c6e24800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.10 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.280+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.10 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.280+0000 7f75c6e24800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.11 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.280+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.11 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.280+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.0 2024-03-04T12:48:28.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.280+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1 2024-03-04T12:48:28.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.280+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2 2024-03-04T12:48:28.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.281+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3 2024-03-04T12:48:28.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.281+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.4 2024-03-04T12:48:28.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.282+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.5 2024-03-04T12:48:28.288 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.282+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.6 2024-03-04T12:48:28.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.283+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.7 2024-03-04T12:48:28.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.283+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.8 2024-03-04T12:48:28.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.283+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.9 2024-03-04T12:48:28.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.284+0000 7f75c6e24800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.10 2024-03-04T12:48:28.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.284+0000 7f75c6e24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 : hit (requested=0x17, cached=0x17) 2024-03-04T12:48:28.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.284+0000 7f75c6e24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 2024-03-04T12:48:28.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.285+0000 7f75c6e24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:28.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.285+0000 7f75c6e24800 10 moving default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:28.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.285+0000 7f75c6e24800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:28.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.285+0000 7f75c6e24800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18, ofs0, ns] 2024-03-04T12:48:28.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.286+0000 7f749b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824037 cookie 94500047359424 notifier 7101 bl.length()=751 2024-03-04T12:48:28.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.286+0000 7f749b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:28.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.286+0000 7f749b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:28.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.286+0000 7f749b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:28.292 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.286+0000 7f75c6e24800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): orig_sources= new_sources= 2024-03-04T12:48:28.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.286+0000 7f75c6e24800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): potential sources added=[] removed=[] 2024-03-04T12:48:28.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.286+0000 7f75c6e24800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): orig_dests= new_dests= 2024-03-04T12:48:28.293 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.286+0000 7f75c6e24800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): potential dests added=[] removed=[] 2024-03-04T12:48:28.294 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.289+0000 7f75c6e24800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-04T12:48:28.296 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.290+0000 7f747afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:28.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.292+0000 7f75c6e24800 20 remove_watcher() i=0 2024-03-04T12:48:28.298 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.292+0000 7f75c6e24800 2 removed watcher, disabling cache 2024-03-04T12:48:28.299 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.293+0000 7f75c6e24800 20 remove_watcher() i=1 2024-03-04T12:48:28.300 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.294+0000 7f75c6e24800 20 remove_watcher() i=2 2024-03-04T12:48:28.301 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.295+0000 7f75c6e24800 20 remove_watcher() i=3 2024-03-04T12:48:28.302 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.297+0000 7f75c6e24800 20 remove_watcher() i=4 2024-03-04T12:48:28.303 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.298+0000 7f75c6e24800 20 remove_watcher() i=5 2024-03-04T12:48:28.304 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.298+0000 7f75c6e24800 20 remove_watcher() i=6 2024-03-04T12:48:28.305 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.299+0000 7f75c6e24800 20 remove_watcher() i=7 2024-03-04T12:48:28.316 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket myver 2024-03-04T12:48:28.343 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:28.343 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:28.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.370+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.371+0000 7f0350530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.371+0000 7f0350530800 20 realm 2024-03-04T12:48:28.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.371+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.371+0000 7f0350530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.371+0000 7f0350530800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:28.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.371+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.372+0000 7f0350530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.372+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.372+0000 7f0350530800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:28.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.372+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.373+0000 7f0350530800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:28.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.373+0000 7f0350530800 20 searching for the correct realm 2024-03-04T12:48:28.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.377+0000 7f034baf5640 0 -- 172.21.15.90:0/181253889 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f0340043040 msgr2=0x7f0340043930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:28.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.380+0000 7f034caf7640 0 -- 172.21.15.90:0/181253889 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7f0340055040 msgr2=0x7f034001b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:28.389 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.383+0000 7f0350530800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:28.389 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.383+0000 7f0350530800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:28.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.383+0000 7f0350530800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:28.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.383+0000 7f0350530800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:28.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.383+0000 7f0350530800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:28.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.383+0000 7f0350530800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:28.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.383+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:28.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:28.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 20 zone default found 2024-03-04T12:48:28.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 4 Realm: () 2024-03-04T12:48:28.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:28.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:28.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:28.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 20 zonegroup default 2024-03-04T12:48:28.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.384+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.385+0000 7f0350530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.385+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.385+0000 7f0350530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.385+0000 7f0350530800 20 started sync module instance, tier type = 2024-03-04T12:48:28.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.385+0000 7f0350530800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:28.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.394+0000 7f0350530800 20 add_watcher() i=0 2024-03-04T12:48:28.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.394+0000 7f0350530800 20 add_watcher() i=1 2024-03-04T12:48:28.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.394+0000 7f0350530800 20 add_watcher() i=2 2024-03-04T12:48:28.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.394+0000 7f0350530800 20 add_watcher() i=3 2024-03-04T12:48:28.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.394+0000 7f0350530800 20 add_watcher() i=4 2024-03-04T12:48:28.400 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.394+0000 7f0350530800 20 add_watcher() i=5 2024-03-04T12:48:28.401 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.394+0000 7f0350530800 20 add_watcher() i=6 2024-03-04T12:48:28.401 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.395+0000 7f0350530800 20 add_watcher() i=7 2024-03-04T12:48:28.401 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.395+0000 7f0350530800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:28.402 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.396+0000 7f0202fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:28.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.397+0000 7f0350530800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:28.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.397+0000 7f0350530800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:28.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.397+0000 7f0350530800 5 note: GC not initialized 2024-03-04T12:48:28.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.397+0000 7f0201fdb640 20 reqs_thread_entry: start 2024-03-04T12:48:28.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.397+0000 7f0350530800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:28.403 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.397+0000 7f0350530800 20 Filter name: none 2024-03-04T12:48:28.404 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.397+0000 7f01737fe640 20 reqs_thread_entry: start 2024-03-04T12:48:28.404 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.397+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.404 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.398+0000 7f0350530800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:28.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.398+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.398+0000 7f0350530800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:28.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.398+0000 7f0350530800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:28.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.398+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.399+0000 7f0350530800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:28.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.399+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.399+0000 7f0350530800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:28.405 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.399+0000 7f0350530800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:28.406 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.400+0000 7f0350530800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.406 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.400+0000 7f0350530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.407 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.401+0000 7f0202fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:28.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.403+0000 7f0350530800 20 remove_watcher() i=0 2024-03-04T12:48:28.409 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.403+0000 7f0350530800 2 removed watcher, disabling cache 2024-03-04T12:48:28.410 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.404+0000 7f0350530800 20 remove_watcher() i=1 2024-03-04T12:48:28.411 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.405+0000 7f0350530800 20 remove_watcher() i=2 2024-03-04T12:48:28.412 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.406+0000 7f0350530800 20 remove_watcher() i=3 2024-03-04T12:48:28.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.407+0000 7f0350530800 20 remove_watcher() i=4 2024-03-04T12:48:28.413 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.408+0000 7f0350530800 20 remove_watcher() i=5 2024-03-04T12:48:28.414 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.409+0000 7f0350530800 20 remove_watcher() i=6 2024-03-04T12:48:28.415 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.410+0000 7f0350530800 20 remove_watcher() i=7 2024-03-04T12:48:28.425 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:48:28.425 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:48:28.425 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: myver id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-03-04T12:48:28.425 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:48:28.427 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:28.427 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:28.430 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:28.430 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:28.472 INFO:tasks.workunit.client.0.smithi090.stderr: test: reshard removes olh entries with empty name 2024-03-04T12:48:28.475 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:28.475 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:28.521 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:28.521 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:28.565 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-04T12:48:28.591 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:28.591 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:28.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.618+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.619+0000 7f700d73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.619+0000 7f700d73b800 20 realm 2024-03-04T12:48:28.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.619+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.625 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.619+0000 7f700d73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.619+0000 7f700d73b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:28.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.619+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.619+0000 7f700d73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.619+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.620+0000 7f700d73b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:28.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.620+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.621+0000 7f700d73b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:28.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.621+0000 7f700d73b800 20 searching for the correct realm 2024-03-04T12:48:28.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.623+0000 7f7000ccc640 0 -- 172.21.15.90:0/3525999084 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f6ff406abd0 msgr2=0x7f6ff4073960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:28.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.627+0000 7f70094cd640 0 -- 172.21.15.90:0/3525999084 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f6ff4093080 msgr2=0x7f6ff4093460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:28.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.833+0000 7f700d73b800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:28.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.833+0000 7f700d73b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:28.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.833+0000 7f700d73b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:28.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.833+0000 7f700d73b800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:28.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.833+0000 7f700d73b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:28.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.833+0000 7f700d73b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:28.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.833+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:28.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:28.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 20 zone default found 2024-03-04T12:48:28.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 4 Realm: () 2024-03-04T12:48:28.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:28.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:28.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:28.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 20 zonegroup default 2024-03-04T12:48:28.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.834+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.835+0000 7f700d73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.835+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.835+0000 7f700d73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.835+0000 7f700d73b800 20 started sync module instance, tier type = 2024-03-04T12:48:28.843 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.835+0000 7f700d73b800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:28.849 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.844+0000 7f700d73b800 20 add_watcher() i=0 2024-03-04T12:48:28.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.844+0000 7f700d73b800 20 add_watcher() i=1 2024-03-04T12:48:28.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.844+0000 7f700d73b800 20 add_watcher() i=2 2024-03-04T12:48:28.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.844+0000 7f700d73b800 20 add_watcher() i=3 2024-03-04T12:48:28.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.844+0000 7f700d73b800 20 add_watcher() i=4 2024-03-04T12:48:28.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.844+0000 7f700d73b800 20 add_watcher() i=5 2024-03-04T12:48:28.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.844+0000 7f700d73b800 20 add_watcher() i=6 2024-03-04T12:48:28.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.844+0000 7f700d73b800 20 add_watcher() i=7 2024-03-04T12:48:28.850 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.844+0000 7f700d73b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:28.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.846+0000 7f6ebf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:28.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.847+0000 7f700d73b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:28.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.847+0000 7f700d73b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:28.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.847+0000 7f700d73b800 5 note: GC not initialized 2024-03-04T12:48:28.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.847+0000 7f6ebe7e4640 20 reqs_thread_entry: start 2024-03-04T12:48:28.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.847+0000 7f700d73b800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:28.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.847+0000 7f700d73b800 20 Filter name: none 2024-03-04T12:48:28.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.847+0000 7f6e2ffff640 20 reqs_thread_entry: start 2024-03-04T12:48:28.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.847+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.848+0000 7f700d73b800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:48:28.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.848+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.848+0000 7f700d73b800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:48:28.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.848+0000 7f700d73b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:28.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.848+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.849+0000 7f700d73b800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:48:28.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.849+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.850+0000 7f700d73b800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:48:28.856 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.850+0000 7f700d73b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:28.857 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.851+0000 7f700d73b800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.857 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.851+0000 7f700d73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.857 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.852+0000 7f6ebf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:28.859 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.854+0000 7f700d73b800 20 remove_watcher() i=0 2024-03-04T12:48:28.860 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.854+0000 7f700d73b800 2 removed watcher, disabling cache 2024-03-04T12:48:28.861 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.855+0000 7f700d73b800 20 remove_watcher() i=1 2024-03-04T12:48:28.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.856+0000 7f700d73b800 20 remove_watcher() i=2 2024-03-04T12:48:28.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.857+0000 7f700d73b800 20 remove_watcher() i=3 2024-03-04T12:48:28.864 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.858+0000 7f700d73b800 20 remove_watcher() i=4 2024-03-04T12:48:28.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.859+0000 7f700d73b800 20 remove_watcher() i=5 2024-03-04T12:48:28.866 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.860+0000 7f700d73b800 20 remove_watcher() i=6 2024-03-04T12:48:28.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.861+0000 7f700d73b800 20 remove_watcher() i=7 2024-03-04T12:48:28.876 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:48:28.876 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:48:28.876 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: a-bucket id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-03-04T12:48:28.876 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:48:28.877 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-03-04T12:48:28.905 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:28.905 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:28.938 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.932+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.933+0000 7f372cd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.933+0000 7f372cd30800 20 realm 2024-03-04T12:48:28.939 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.933+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.933+0000 7f372cd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.933+0000 7f372cd30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:28.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.933+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.933+0000 7f372cd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:28.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.933+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.934+0000 7f372cd30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:28.940 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.934+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:28.941 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.935+0000 7f372cd30800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:28.941 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.935+0000 7f372cd30800 20 searching for the correct realm 2024-03-04T12:48:28.943 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.938+0000 7f37282c1640 0 -- 172.21.15.90:0/3010898520 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f371c04c990 msgr2=0x7f371c06aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:28.947 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:28.941+0000 7f3728ac2640 0 -- 172.21.15.90:0/3010898520 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f371c0d2040 msgr2=0x7f371c0da040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:48:29.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.146+0000 7f372cd30800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:29.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.146+0000 7f372cd30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:29.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.146+0000 7f372cd30800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:29.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.146+0000 7f372cd30800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:29.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.146+0000 7f372cd30800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:29.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.146+0000 7f372cd30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:29.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.146+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:29.157 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 20 zone default found 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 4 Realm: () 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 20 zonegroup default 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.147+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.148+0000 7f372cd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.148+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.148+0000 7f372cd30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.148+0000 7f372cd30800 20 started sync module instance, tier type = 2024-03-04T12:48:29.158 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.148+0000 7f372cd30800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:29.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.156+0000 7f372cd30800 20 add_watcher() i=0 2024-03-04T12:48:29.162 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.156+0000 7f372cd30800 20 add_watcher() i=1 2024-03-04T12:48:29.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.156+0000 7f372cd30800 20 add_watcher() i=2 2024-03-04T12:48:29.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.156+0000 7f372cd30800 20 add_watcher() i=3 2024-03-04T12:48:29.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.156+0000 7f372cd30800 20 add_watcher() i=4 2024-03-04T12:48:29.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.156+0000 7f372cd30800 20 add_watcher() i=5 2024-03-04T12:48:29.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.156+0000 7f372cd30800 20 add_watcher() i=6 2024-03-04T12:48:29.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.157+0000 7f372cd30800 20 add_watcher() i=7 2024-03-04T12:48:29.163 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.157+0000 7f372cd30800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:29.165 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.159+0000 7f35defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:29.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.159+0000 7f372cd30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:29.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.159+0000 7f372cd30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:29.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.159+0000 7f372cd30800 5 note: GC not initialized 2024-03-04T12:48:29.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.159+0000 7f35ddfe3640 20 reqs_thread_entry: start 2024-03-04T12:48:29.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.159+0000 7f372cd30800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:29.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.160+0000 7f372cd30800 20 Filter name: none 2024-03-04T12:48:29.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.160+0000 7f354f7fe640 20 reqs_thread_entry: start 2024-03-04T12:48:29.166 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.160+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.160+0000 7f372cd30800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:48:29.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.160+0000 7f372cd30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.161+0000 7f372cd30800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:48:29.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.161+0000 7f372cd30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:29.167 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.161+0000 7f35defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:29.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.163+0000 7f372cd30800 20 remove_watcher() i=0 2024-03-04T12:48:29.169 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.163+0000 7f372cd30800 2 removed watcher, disabling cache 2024-03-04T12:48:29.170 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.164+0000 7f372cd30800 20 remove_watcher() i=1 2024-03-04T12:48:29.171 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.165+0000 7f372cd30800 20 remove_watcher() i=2 2024-03-04T12:48:29.172 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.166+0000 7f372cd30800 20 remove_watcher() i=3 2024-03-04T12:48:29.173 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.167+0000 7f372cd30800 20 remove_watcher() i=4 2024-03-04T12:48:29.174 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.168+0000 7f372cd30800 20 remove_watcher() i=5 2024-03-04T12:48:29.175 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.169+0000 7f372cd30800 20 remove_watcher() i=6 2024-03-04T12:48:29.176 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.170+0000 7f372cd30800 20 remove_watcher() i=7 2024-03-04T12:48:29.187 INFO:tasks.workunit.client.0.smithi090.stderr:rados -p default.rgw.buckets.index setomapval .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-03-04T12:48:29.211 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:29.211 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:29.227 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket a-bucket 2024-03-04T12:48:29.254 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:29.254 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:29.287 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.281+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.282+0000 7ff8efa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.282+0000 7ff8efa30800 20 realm 2024-03-04T12:48:29.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.282+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.283+0000 7ff8efa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.283+0000 7ff8efa30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:29.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.283+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.283+0000 7ff8efa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.289 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.283+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.284+0000 7ff8efa30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:29.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.284+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.284+0000 7ff8efa30800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:29.290 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.284+0000 7ff8efa30800 20 searching for the correct realm 2024-03-04T12:48:29.291 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.285+0000 7ff8eac57640 0 -- 172.21.15.90:0/504254995 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7ff8e4028040 msgr2=0x7ff8e4029430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:48:29.496 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.490+0000 7ff8ea456640 0 -- 172.21.15.90:0/504254995 >> [v2:172.21.15.90:6817/137526376,v1:172.21.15.90:6819/137526376] conn(0x55c0a77f0f20 msgr2=0x55c0a77f3310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:29.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:29.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:29.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:29.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:29.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:29.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:29.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.502 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:29.503 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:29.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 zone default found 2024-03-04T12:48:29.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 4 Realm: () 2024-03-04T12:48:29.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:29.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:29.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:29.504 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 zonegroup default 2024-03-04T12:48:29.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.496+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.497+0000 7ff8efa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.497+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.497+0000 7ff8efa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.497+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.497+0000 7ff8efa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.497+0000 7ff8efa30800 20 started sync module instance, tier type = 2024-03-04T12:48:29.505 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.497+0000 7ff8efa30800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:29.511 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.505+0000 7ff8efa30800 20 add_watcher() i=0 2024-03-04T12:48:29.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.505+0000 7ff8efa30800 20 add_watcher() i=1 2024-03-04T12:48:29.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.505+0000 7ff8efa30800 20 add_watcher() i=2 2024-03-04T12:48:29.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.505+0000 7ff8efa30800 20 add_watcher() i=3 2024-03-04T12:48:29.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.505+0000 7ff8efa30800 20 add_watcher() i=4 2024-03-04T12:48:29.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.505+0000 7ff8efa30800 20 add_watcher() i=5 2024-03-04T12:48:29.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.505+0000 7ff8efa30800 20 add_watcher() i=6 2024-03-04T12:48:29.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.506+0000 7ff8efa30800 20 add_watcher() i=7 2024-03-04T12:48:29.512 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.506+0000 7ff8efa30800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:29.514 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.508+0000 7ff7a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:29.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.508+0000 7ff8efa30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:29.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.508+0000 7ff8efa30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:29.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.508+0000 7ff8efa30800 5 note: GC not initialized 2024-03-04T12:48:29.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.509+0000 7ff71bfff640 20 reqs_thread_entry: start 2024-03-04T12:48:29.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.509+0000 7ff8efa30800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:29.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.509+0000 7ff8efa30800 20 Filter name: none 2024-03-04T12:48:29.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.509+0000 7ff719ffb640 20 reqs_thread_entry: start 2024-03-04T12:48:29.515 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.509+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.509+0000 7ff8efa30800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:48:29.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.509+0000 7ff8efa30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.510+0000 7ff8efa30800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:48:29.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.510+0000 7ff8efa30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:29.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.510+0000 7ff8efa30800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-04T12:48:29.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.510+0000 7ff8efa30800 20 INFO: main: starting shard=0 2024-03-04T12:48:29.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.510+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.0 2024-03-04T12:48:29.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.510+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.0 2024-03-04T12:48:29.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.510+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:48:29.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.511+0000 7ff8efa30800 20 INFO: main: starting shard=1 2024-03-04T12:48:29.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.511+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.1 2024-03-04T12:48:29.517 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.511+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.1 2024-03-04T12:48:29.518 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.511+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.518 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.511+0000 7ff8efa30800 20 INFO: main: starting shard=2 2024-03-04T12:48:29.518 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.511+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.2 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.511+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.2 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.511+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.511+0000 7ff8efa30800 20 INFO: main: starting shard=3 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.511+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.3 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.511+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.3 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.512+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.512+0000 7ff8efa30800 20 INFO: main: starting shard=4 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.512+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.4 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.512+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.4 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.512+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.512+0000 7ff8efa30800 20 INFO: main: starting shard=5 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.512+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.5 2024-03-04T12:48:29.519 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.512+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.5 2024-03-04T12:48:29.520 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.513+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.520 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.513+0000 7ff8efa30800 20 INFO: main: starting shard=6 2024-03-04T12:48:29.520 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.513+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.6 2024-03-04T12:48:29.520 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.513+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.6 2024-03-04T12:48:29.520 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.513+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.520 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.513+0000 7ff8efa30800 20 INFO: main: starting shard=7 2024-03-04T12:48:29.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.513+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.7 2024-03-04T12:48:29.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.513+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.7 2024-03-04T12:48:29.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.514+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.514+0000 7ff8efa30800 20 INFO: main: starting shard=8 2024-03-04T12:48:29.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.514+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.8 2024-03-04T12:48:29.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.514+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.8 2024-03-04T12:48:29.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.515+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.515+0000 7ff8efa30800 20 INFO: main: starting shard=9 2024-03-04T12:48:29.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.515+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.9 2024-03-04T12:48:29.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.515+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.9 2024-03-04T12:48:29.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.515+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.515+0000 7ff8efa30800 20 INFO: main: starting shard=10 2024-03-04T12:48:29.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.515+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.10 2024-03-04T12:48:29.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.515+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.10 2024-03-04T12:48:29.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.516+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.522 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.516+0000 7ff8efa30800 20 INFO: main: starting shard=11 2024-03-04T12:48:29.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.516+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.11 2024-03-04T12:48:29.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.516+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.11 2024-03-04T12:48:29.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.516+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.516+0000 7ff8efa30800 20 INFO: main: starting shard=12 2024-03-04T12:48:29.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.516+0000 7ff8efa30800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.12 2024-03-04T12:48:29.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.516+0000 7ff8efa30800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.12 2024-03-04T12:48:29.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.516+0000 7ff8efa30800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.516+0000 7ff8efa30800 20 INFO: main: done 2024-03-04T12:48:29.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.517+0000 7ff7a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:29.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.519+0000 7ff8efa30800 20 remove_watcher() i=0 2024-03-04T12:48:29.525 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.519+0000 7ff8efa30800 2 removed watcher, disabling cache 2024-03-04T12:48:29.526 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.520+0000 7ff8efa30800 20 remove_watcher() i=1 2024-03-04T12:48:29.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.521+0000 7ff8efa30800 20 remove_watcher() i=2 2024-03-04T12:48:29.528 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.522+0000 7ff8efa30800 20 remove_watcher() i=3 2024-03-04T12:48:29.529 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.523+0000 7ff8efa30800 20 remove_watcher() i=4 2024-03-04T12:48:29.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.524+0000 7ff8efa30800 20 remove_watcher() i=5 2024-03-04T12:48:29.531 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.525+0000 7ff8efa30800 20 remove_watcher() i=6 2024-03-04T12:48:29.532 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.526+0000 7ff8efa30800 20 remove_watcher() i=7 2024-03-04T12:48:29.543 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-03-04T12:48:29.573 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:29.573 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:29.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.600+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.607 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.601+0000 7f602552d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.601+0000 7f602552d800 20 realm 2024-03-04T12:48:29.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.601+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.601+0000 7f602552d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.601+0000 7f602552d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:29.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.601+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.602+0000 7f602552d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.602+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.602+0000 7f602552d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:29.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.602+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.603+0000 7f602552d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:29.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.603+0000 7f602552d800 20 searching for the correct realm 2024-03-04T12:48:29.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.606+0000 7f60219b1640 0 -- 172.21.15.90:0/691654226 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x5567bf35f1f0 msgr2=0x5567bf3616b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:29.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.609+0000 7f60211b0640 0 -- 172.21.15.90:0/691654226 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f600c05e8f0 msgr2=0x7f600c077410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:29.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.613+0000 7f602552d800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:29.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.613+0000 7f602552d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:29.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.613+0000 7f602552d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:29.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.613+0000 7f602552d800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:29.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.613+0000 7f602552d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:29.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.613+0000 7f602552d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:29.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.613+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.613+0000 7f602552d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.613+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:29.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:29.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 20 zone default found 2024-03-04T12:48:29.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 4 Realm: () 2024-03-04T12:48:29.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:29.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:29.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:29.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 20 zonegroup default 2024-03-04T12:48:29.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.614+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.615+0000 7f602552d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.615+0000 7f602552d800 20 started sync module instance, tier type = 2024-03-04T12:48:29.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.615+0000 7f602552d800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:29.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.623+0000 7f602552d800 20 add_watcher() i=0 2024-03-04T12:48:29.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.623+0000 7f602552d800 20 add_watcher() i=1 2024-03-04T12:48:29.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.623+0000 7f602552d800 20 add_watcher() i=2 2024-03-04T12:48:29.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.623+0000 7f602552d800 20 add_watcher() i=3 2024-03-04T12:48:29.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.623+0000 7f602552d800 20 add_watcher() i=4 2024-03-04T12:48:29.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.623+0000 7f602552d800 20 add_watcher() i=5 2024-03-04T12:48:29.629 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.623+0000 7f602552d800 20 add_watcher() i=6 2024-03-04T12:48:29.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.624+0000 7f602552d800 20 add_watcher() i=7 2024-03-04T12:48:29.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.624+0000 7f602552d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:29.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.625+0000 7f5ed77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:29.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.626+0000 7f602552d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:29.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.626+0000 7f602552d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:29.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.626+0000 7f602552d800 5 note: GC not initialized 2024-03-04T12:48:29.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.626+0000 7f5ed67e4640 20 reqs_thread_entry: start 2024-03-04T12:48:29.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.626+0000 7f602552d800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:29.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.626+0000 7f602552d800 20 Filter name: none 2024-03-04T12:48:29.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.626+0000 7f5e47fff640 20 reqs_thread_entry: start 2024-03-04T12:48:29.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.626+0000 7f602552d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-04T12:48:29.633 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.626+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.627+0000 7f602552d800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:48:29.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.627+0000 7f602552d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-04T12:48:29.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.627+0000 7f602552d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-04T12:48:29.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.627+0000 7f602552d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 : miss 2024-03-04T12:48:29.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.627+0000 7f602552d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.627+0000 7f602552d800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:48:29.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.627+0000 7f602552d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:48:29.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.627+0000 7f602552d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:48:29.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.627+0000 7f602552d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:48:29.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.627+0000 7f602552d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:29.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.627+0000 7f602552d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 2024-03-04T12:48:29.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.630+0000 7f602552d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:48:29.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.630+0000 7f602552d800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:48:29.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.630+0000 7f602552d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:29.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.630+0000 7f602552d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17, ofs0, ns] 2024-03-04T12:48:29.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.631+0000 7f5ef3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824076 cookie 93904077980768 notifier 6797 bl.length()=789 2024-03-04T12:48:29.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.631+0000 7f5ef3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:48:29.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.631+0000 7f5ef3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:48:29.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.631+0000 7f5ef3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:29.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.631+0000 7f602552d800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): orig_sources= new_sources= 2024-03-04T12:48:29.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.631+0000 7f602552d800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): potential sources added=[] removed=[] 2024-03-04T12:48:29.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.631+0000 7f602552d800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): orig_dests= new_dests= 2024-03-04T12:48:29.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.631+0000 7f602552d800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): potential dests added=[] removed=[] 2024-03-04T12:48:29.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.633+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.3.0 2024-03-04T12:48:29.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.633+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.3.0 2024-03-04T12:48:29.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.633+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.0 2024-03-04T12:48:29.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.633+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.0 2024-03-04T12:48:29.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.634+0000 7f602552d800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-03-04T12:48:29.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.634+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.1 2024-03-04T12:48:29.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.634+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.1 2024-03-04T12:48:29.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.634+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.2 2024-03-04T12:48:29.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.634+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.2 2024-03-04T12:48:29.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.635+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.3 2024-03-04T12:48:29.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.635+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.3 2024-03-04T12:48:29.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.635+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.4 2024-03-04T12:48:29.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.635+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.4 2024-03-04T12:48:29.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.635+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.5 2024-03-04T12:48:29.641 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.635+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.5 2024-03-04T12:48:29.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.636+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.6 2024-03-04T12:48:29.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.636+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.6 2024-03-04T12:48:29.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.636+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.7 2024-03-04T12:48:29.642 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.636+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.7 2024-03-04T12:48:29.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.637+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.8 2024-03-04T12:48:29.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.637+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.8 2024-03-04T12:48:29.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.637+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.9 2024-03-04T12:48:29.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.637+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.9 2024-03-04T12:48:29.643 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.638+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.10 2024-03-04T12:48:29.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.638+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.10 2024-03-04T12:48:29.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.638+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.11 2024-03-04T12:48:29.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.638+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.11 2024-03-04T12:48:29.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.639+0000 7f602552d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.12 2024-03-04T12:48:29.644 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.639+0000 7f602552d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.2.12 2024-03-04T12:48:29.645 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.639+0000 7f602552d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 : hit (requested=0x17, cached=0x17) 2024-03-04T12:48:29.645 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.639+0000 7f602552d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 2024-03-04T12:48:29.646 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.640+0000 7f602552d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:48:29.646 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.640+0000 7f602552d800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:48:29.646 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.640+0000 7f602552d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:29.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.640+0000 7f602552d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17, ofs0, ns] 2024-03-04T12:48:29.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.641+0000 7f5f04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824077 cookie 93904077980768 notifier 6797 bl.length()=757 2024-03-04T12:48:29.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.641+0000 7f5f04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 info.flags=0x17 2024-03-04T12:48:29.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.641+0000 7f5f04ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17 to cache LRU end 2024-03-04T12:48:29.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.641+0000 7f5f04ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:29.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.641+0000 7f602552d800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): orig_sources= new_sources= 2024-03-04T12:48:29.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.641+0000 7f602552d800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): potential sources added=[] removed=[] 2024-03-04T12:48:29.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.641+0000 7f602552d800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): orig_dests= new_dests= 2024-03-04T12:48:29.647 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.641+0000 7f602552d800 20 handle_bi_update(): bucket=:a-bucket[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17]): potential dests added=[] removed=[] 2024-03-04T12:48:29.649 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.643+0000 7f602552d800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-04T12:48:29.651 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.645+0000 7f5ed77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:29.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.647+0000 7f602552d800 20 remove_watcher() i=0 2024-03-04T12:48:29.653 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.647+0000 7f602552d800 2 removed watcher, disabling cache 2024-03-04T12:48:29.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.648+0000 7f602552d800 20 remove_watcher() i=1 2024-03-04T12:48:29.654 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.649+0000 7f602552d800 20 remove_watcher() i=2 2024-03-04T12:48:29.655 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.650+0000 7f602552d800 20 remove_watcher() i=3 2024-03-04T12:48:29.656 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.651+0000 7f602552d800 20 remove_watcher() i=4 2024-03-04T12:48:29.657 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.651+0000 7f602552d800 20 remove_watcher() i=5 2024-03-04T12:48:29.658 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.652+0000 7f602552d800 20 remove_watcher() i=6 2024-03-04T12:48:29.659 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.653+0000 7f602552d800 20 remove_watcher() i=7 2024-03-04T12:48:29.670 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket a-bucket 2024-03-04T12:48:29.698 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:29.698 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:29.730 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.724+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.726+0000 7f34efd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.726+0000 7f34efd33800 20 realm 2024-03-04T12:48:29.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.726+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.732 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.726+0000 7f34efd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.726+0000 7f34efd33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:29.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.726+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.726+0000 7f34efd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.726+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.727+0000 7f34efd33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:29.733 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.727+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.728+0000 7f34efd33800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:29.734 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.728+0000 7f34efd33800 20 searching for the correct realm 2024-03-04T12:48:29.737 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.731+0000 7f34ec265640 0 -- 172.21.15.90:0/3875339994 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x55ccd8a12f80 msgr2=0x55ccd8a15440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:29.740 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.734+0000 7f34eba64640 0 -- 172.21.15.90:0/3875339994 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f34d405d2d0 msgr2=0x7f34d405f6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:29.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.738+0000 7f34efd33800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:29.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.738+0000 7f34efd33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:29.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.738+0000 7f34efd33800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:29.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.738+0000 7f34efd33800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:29.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.738+0000 7f34efd33800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:29.745 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.738+0000 7f34efd33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.738+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 20 zone default found 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 4 Realm: () 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 20 zonegroup default 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.746 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.739+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.740+0000 7f34efd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.740+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.740+0000 7f34efd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.740+0000 7f34efd33800 20 started sync module instance, tier type = 2024-03-04T12:48:29.747 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.740+0000 7f34efd33800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:29.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.748+0000 7f34efd33800 20 add_watcher() i=0 2024-03-04T12:48:29.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.748+0000 7f34efd33800 20 add_watcher() i=1 2024-03-04T12:48:29.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.748+0000 7f34efd33800 20 add_watcher() i=2 2024-03-04T12:48:29.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.748+0000 7f34efd33800 20 add_watcher() i=3 2024-03-04T12:48:29.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.748+0000 7f34efd33800 20 add_watcher() i=4 2024-03-04T12:48:29.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.748+0000 7f34efd33800 20 add_watcher() i=5 2024-03-04T12:48:29.754 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.748+0000 7f34efd33800 20 add_watcher() i=6 2024-03-04T12:48:29.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.749+0000 7f34efd33800 20 add_watcher() i=7 2024-03-04T12:48:29.755 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.749+0000 7f34efd33800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:29.756 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.750+0000 7f33a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:29.757 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.751+0000 7f34efd33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:29.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.751+0000 7f34efd33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:29.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.751+0000 7f34efd33800 5 note: GC not initialized 2024-03-04T12:48:29.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.751+0000 7f33a0fe1640 20 reqs_thread_entry: start 2024-03-04T12:48:29.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.751+0000 7f34efd33800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:29.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.751+0000 7f34efd33800 20 Filter name: none 2024-03-04T12:48:29.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.751+0000 7f331a7fc640 20 reqs_thread_entry: start 2024-03-04T12:48:29.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.751+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.752+0000 7f34efd33800 20 rados_obj.operate() r=0 bl.length=176 2024-03-04T12:48:29.758 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.752+0000 7f34efd33800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.752+0000 7f34efd33800 20 rados_obj.operate() r=0 bl.length=360 2024-03-04T12:48:29.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.752+0000 7f34efd33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:29.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.752+0000 7f34efd33800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-03-04T12:48:29.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.752+0000 7f34efd33800 20 INFO: main: starting shard=0 2024-03-04T12:48:29.759 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.752+0000 7f34efd33800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.3.0 2024-03-04T12:48:29.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.752+0000 7f34efd33800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17.3.0 2024-03-04T12:48:29.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.753+0000 7f34efd33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:29.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.753+0000 7f34efd33800 20 INFO: main: done 2024-03-04T12:48:29.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.753+0000 7f33a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:29.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.756+0000 7f34efd33800 20 remove_watcher() i=0 2024-03-04T12:48:29.761 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.756+0000 7f34efd33800 2 removed watcher, disabling cache 2024-03-04T12:48:29.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.756+0000 7f34efd33800 20 remove_watcher() i=1 2024-03-04T12:48:29.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.757+0000 7f34efd33800 20 remove_watcher() i=2 2024-03-04T12:48:29.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.758+0000 7f34efd33800 20 remove_watcher() i=3 2024-03-04T12:48:29.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.759+0000 7f34efd33800 20 remove_watcher() i=4 2024-03-04T12:48:29.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.760+0000 7f34efd33800 20 remove_watcher() i=5 2024-03-04T12:48:29.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.761+0000 7f34efd33800 20 remove_watcher() i=6 2024-03-04T12:48:29.768 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.762+0000 7f34efd33800 20 remove_watcher() i=7 2024-03-04T12:48:29.777 INFO:tasks.workunit.client.0.smithi090.stderr: test: PUT succeeds during reshard 2024-03-04T12:48:29.779 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket myver 2024-03-04T12:48:29.806 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:29.806 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:29.839 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.833+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.834+0000 7f96c7931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.834+0000 7f96c7931800 20 realm 2024-03-04T12:48:29.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.834+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.840 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.834+0000 7f96c7931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.834+0000 7f96c7931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:29.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.834+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.834+0000 7f96c7931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.834+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.835+0000 7f96c7931800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:29.841 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.835+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.836+0000 7f96c7931800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:29.842 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.836+0000 7f96c7931800 20 searching for the correct realm 2024-03-04T12:48:29.844 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.839+0000 7f96c3df8640 0 -- 172.21.15.90:0/465778632 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x5576451e6720 msgr2=0x5576451e8be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:29.848 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.842+0000 7f96c35f7640 0 -- 172.21.15.90:0/465778632 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f96ac05e040 msgr2=0x7f96ac0d0220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:29.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:29.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:29.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:29.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:29.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:29.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:29.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.852 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:29.853 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 zone default found 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 4 Realm: () 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 zonegroup default 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.846+0000 7f96c7931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.847+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.847+0000 7f96c7931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.847+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.854 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.847+0000 7f96c7931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.847+0000 7f96c7931800 20 started sync module instance, tier type = 2024-03-04T12:48:29.855 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.847+0000 7f96c7931800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:29.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.856+0000 7f96c7931800 20 add_watcher() i=0 2024-03-04T12:48:29.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.856+0000 7f96c7931800 20 add_watcher() i=1 2024-03-04T12:48:29.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.856+0000 7f96c7931800 20 add_watcher() i=2 2024-03-04T12:48:29.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.856+0000 7f96c7931800 20 add_watcher() i=3 2024-03-04T12:48:29.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.856+0000 7f96c7931800 20 add_watcher() i=4 2024-03-04T12:48:29.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.856+0000 7f96c7931800 20 add_watcher() i=5 2024-03-04T12:48:29.862 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.856+0000 7f96c7931800 20 add_watcher() i=6 2024-03-04T12:48:29.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.857+0000 7f96c7931800 20 add_watcher() i=7 2024-03-04T12:48:29.863 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.857+0000 7f96c7931800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:29.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.858+0000 7f9579fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:29.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.858+0000 7f96c7931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:29.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.858+0000 7f96c7931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:29.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.858+0000 7f96c7931800 5 note: GC not initialized 2024-03-04T12:48:29.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.858+0000 7f9578fe1640 20 reqs_thread_entry: start 2024-03-04T12:48:29.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.858+0000 7f96c7931800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:29.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.859+0000 7f96c7931800 20 Filter name: none 2024-03-04T12:48:29.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.859+0000 7f94f27fc640 20 reqs_thread_entry: start 2024-03-04T12:48:29.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.859+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.859+0000 7f96c7931800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:29.865 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.859+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.866 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.859+0000 7f96c7931800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:29.866 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.859+0000 7f96c7931800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:29.866 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.859+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.866 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.860+0000 7f96c7931800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:29.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.860+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.860+0000 7f96c7931800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:29.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.860+0000 7f96c7931800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:29.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.861+0000 7f96c7931800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.867 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.861+0000 7f96c7931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.868 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.862+0000 7f9579fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:29.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.864+0000 7f96c7931800 20 remove_watcher() i=0 2024-03-04T12:48:29.869 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.864+0000 7f96c7931800 2 removed watcher, disabling cache 2024-03-04T12:48:29.870 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.865+0000 7f96c7931800 20 remove_watcher() i=1 2024-03-04T12:48:29.871 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.866+0000 7f96c7931800 20 remove_watcher() i=2 2024-03-04T12:48:29.872 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.866+0000 7f96c7931800 20 remove_watcher() i=3 2024-03-04T12:48:29.873 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.867+0000 7f96c7931800 20 remove_watcher() i=4 2024-03-04T12:48:29.874 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.868+0000 7f96c7931800 20 remove_watcher() i=5 2024-03-04T12:48:29.875 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.869+0000 7f96c7931800 20 remove_watcher() i=6 2024-03-04T12:48:29.876 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.870+0000 7f96c7931800 20 remove_watcher() i=7 2024-03-04T12:48:29.886 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:48:29.886 INFO:tasks.workunit.client.0.smithi090.stderr:BUCKET_STATS: 2024-03-04T12:48:29.886 INFO:tasks.workunit.client.0.smithi090.stderr:bucket: myver id: 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-03-04T12:48:29.886 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:48:29.888 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-03-04T12:48:29.918 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:29.918 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:29.951 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.945+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.947+0000 7f559c08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.947+0000 7f559c08c800 20 realm 2024-03-04T12:48:29.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.947+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.947+0000 7f559c08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.947+0000 7f559c08c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:29.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.947+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.947+0000 7f559c08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.953 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.947+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.954 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.948+0000 7f559c08c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:29.954 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.948+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.954 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.948+0000 7f559c08c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:29.955 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.948+0000 7f559c08c800 20 searching for the correct realm 2024-03-04T12:48:29.957 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.951+0000 7f559a389640 0 -- 172.21.15.90:0/482144552 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x559ad0c0fbe0 msgr2=0x559ad0c120a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:29.960 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.954+0000 7f5599b88640 0 -- 172.21.15.90:0/482144552 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f55840d1c10 msgr2=0x7f55840b5540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:29.966 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 zone default found 2024-03-04T12:48:29.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 4 Realm: () 2024-03-04T12:48:29.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:29.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:29.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:29.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 zonegroup default 2024-03-04T12:48:29.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.959+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.960+0000 7f559c08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.960+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.960+0000 7f559c08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.960+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.960+0000 7f559c08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:29.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.960+0000 7f559c08c800 20 started sync module instance, tier type = 2024-03-04T12:48:29.968 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.960+0000 7f559c08c800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:29.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.969+0000 7f559c08c800 20 add_watcher() i=0 2024-03-04T12:48:29.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.969+0000 7f559c08c800 20 add_watcher() i=1 2024-03-04T12:48:29.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.969+0000 7f559c08c800 20 add_watcher() i=2 2024-03-04T12:48:29.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.969+0000 7f559c08c800 20 add_watcher() i=3 2024-03-04T12:48:29.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.969+0000 7f559c08c800 20 add_watcher() i=4 2024-03-04T12:48:29.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.969+0000 7f559c08c800 20 add_watcher() i=5 2024-03-04T12:48:29.975 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.969+0000 7f559c08c800 20 add_watcher() i=6 2024-03-04T12:48:29.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.970+0000 7f559c08c800 20 add_watcher() i=7 2024-03-04T12:48:29.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.970+0000 7f559c08c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:29.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.971+0000 7f544b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:29.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.971+0000 7f559c08c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:29.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.971+0000 7f559c08c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:29.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.971+0000 7f559c08c800 5 note: GC not initialized 2024-03-04T12:48:29.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.972+0000 7f544a7fc640 20 reqs_thread_entry: start 2024-03-04T12:48:29.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.972+0000 7f559c08c800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:29.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.972+0000 7f559c08c800 20 Filter name: none 2024-03-04T12:48:29.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.972+0000 7f53bbfff640 20 reqs_thread_entry: start 2024-03-04T12:48:29.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.972+0000 7f559c08c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-04T12:48:29.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.972+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.972+0000 7f559c08c800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:29.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.972+0000 7f559c08c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-04T12:48:29.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.972+0000 7f559c08c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-04T12:48:29.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.972+0000 7f559c08c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 : miss 2024-03-04T12:48:29.979 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.972+0000 7f559c08c800 20 rados->read ofs=0 len=0 2024-03-04T12:48:29.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.973+0000 7f559c08c800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:29.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.973+0000 7f559c08c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:29.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.973+0000 7f559c08c800 10 adding default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:29.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.973+0000 7f559c08c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:48:29.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.973+0000 7f559c08c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:29.980 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.973+0000 7f559c08c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 2024-03-04T12:48:29.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.977+0000 7f559c08c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:29.983 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.977+0000 7f559c08c800 10 moving default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:29.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.977+0000 7f559c08c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:29.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.977+0000 7f559c08c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18, ofs0, ns] 2024-03-04T12:48:29.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.978+0000 7f547d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824038 cookie 94123415648272 notifier 7257 bl.length()=783 2024-03-04T12:48:29.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.978+0000 7f547d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:29.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.978+0000 7f547d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:29.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.978+0000 7f547d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:29.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.978+0000 7f559c08c800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): orig_sources= new_sources= 2024-03-04T12:48:29.984 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.978+0000 7f559c08c800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): potential sources added=[] removed=[] 2024-03-04T12:48:29.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.978+0000 7f559c08c800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): orig_dests= new_dests= 2024-03-04T12:48:29.985 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.978+0000 7f559c08c800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): potential dests added=[] removed=[] 2024-03-04T12:48:29.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:29.981+0000 7f559c08c800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-03-04T12:48:30.892 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:30.892 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:34.987 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.0 2024-03-04T12:48:34.987 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.0 2024-03-04T12:48:34.987 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.1 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.1 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.2 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.2 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.3 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.3 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.4 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.4 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.5 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.5 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.6 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.6 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.7 2024-03-04T12:48:34.988 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.7 2024-03-04T12:48:34.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.8 2024-03-04T12:48:34.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.8 2024-03-04T12:48:34.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.9 2024-03-04T12:48:34.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.9 2024-03-04T12:48:34.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.10 2024-03-04T12:48:34.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.10 2024-03-04T12:48:34.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.11 2024-03-04T12:48:34.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.11 2024-03-04T12:48:34.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.12 2024-03-04T12:48:34.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.12 2024-03-04T12:48:34.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.0 2024-03-04T12:48:34.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.981+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.0 2024-03-04T12:48:34.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.982+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.1 2024-03-04T12:48:34.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.982+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.1 2024-03-04T12:48:34.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.983+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.2 2024-03-04T12:48:34.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.983+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.2 2024-03-04T12:48:34.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.983+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.3 2024-03-04T12:48:34.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.983+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.3 2024-03-04T12:48:34.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.984+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.4 2024-03-04T12:48:34.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.984+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.4 2024-03-04T12:48:34.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.985+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.5 2024-03-04T12:48:34.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.985+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.5 2024-03-04T12:48:34.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.986+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.6 2024-03-04T12:48:34.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.986+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.6 2024-03-04T12:48:34.992 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.986+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.7 2024-03-04T12:48:34.992 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.986+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.7 2024-03-04T12:48:34.993 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.987+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.8 2024-03-04T12:48:34.993 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.987+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.8 2024-03-04T12:48:34.993 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.988+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.9 2024-03-04T12:48:34.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.988+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.9 2024-03-04T12:48:34.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.988+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.10 2024-03-04T12:48:34.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.988+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.10 2024-03-04T12:48:34.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.989+0000 7f559c08c800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.11 2024-03-04T12:48:34.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.989+0000 7f559c08c800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.1.11 2024-03-04T12:48:34.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.989+0000 7f559c08c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 : hit (requested=0x17, cached=0x17) 2024-03-04T12:48:34.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.989+0000 7f559c08c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 2024-03-04T12:48:34.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.991+0000 7f559c08c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:34.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.991+0000 7f559c08c800 10 moving default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:34.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.991+0000 7f559c08c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:34.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.991+0000 7f559c08c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18, ofs0, ns] 2024-03-04T12:48:34.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.992+0000 7f547cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824039 cookie 94123415648272 notifier 7257 bl.length()=751 2024-03-04T12:48:34.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.992+0000 7f547cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:34.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.992+0000 7f547cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:34.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.992+0000 7f547cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:34.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.992+0000 7f559c08c800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): orig_sources= new_sources= 2024-03-04T12:48:34.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.992+0000 7f559c08c800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): potential sources added=[] removed=[] 2024-03-04T12:48:34.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.992+0000 7f559c08c800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): orig_dests= new_dests= 2024-03-04T12:48:34.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.992+0000 7f559c08c800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): potential dests added=[] removed=[] 2024-03-04T12:48:35.002 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.996+0000 7f559c08c800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-04T12:48:35.004 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:34.998+0000 7f544b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:35.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:35.000+0000 7f559c08c800 20 remove_watcher() i=0 2024-03-04T12:48:35.006 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:35.000+0000 7f559c08c800 2 removed watcher, disabling cache 2024-03-04T12:48:35.008 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:35.002+0000 7f559c08c800 20 remove_watcher() i=1 2024-03-04T12:48:35.009 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:35.003+0000 7f559c08c800 20 remove_watcher() i=2 2024-03-04T12:48:35.010 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:35.004+0000 7f559c08c800 20 remove_watcher() i=3 2024-03-04T12:48:35.011 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:35.005+0000 7f559c08c800 20 remove_watcher() i=4 2024-03-04T12:48:35.012 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:35.007+0000 7f559c08c800 20 remove_watcher() i=5 2024-03-04T12:48:35.014 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:35.008+0000 7f559c08c800 20 remove_watcher() i=6 2024-03-04T12:48:35.015 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:35.009+0000 7f559c08c800 20 remove_watcher() i=7 2024-03-04T12:48:35.919 INFO:tasks.workunit.client.0.smithi090.stderr:put object successful 2024-03-04T12:48:35.919 INFO:tasks.workunit.client.0.smithi090.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-03-04T12:48:35.920 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-03-04T12:48:35.922 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:35.922 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:35.968 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:35.968 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:36.012 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:36.012 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:36.028 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:36.028 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:36.032 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:36.033 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:36.047 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:36.047 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:36.050 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:36.050 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:36.064 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:36.065 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:36.069 INFO:tasks.workunit.client.0.smithi090.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-04T12:48:36.452 INFO:tasks.workunit.client.0.smithi090.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-04T12:48:37.839 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:37.840 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:37.893 INFO:tasks.workunit.client.0.smithi090.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:48:37.895 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket myver --object x 2024-03-04T12:48:37.930 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:37.930 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:37.967 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.960+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:37.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.962+0000 7f707f3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:37.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.962+0000 7f707f3af800 20 realm 2024-03-04T12:48:37.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.962+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:37.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.962+0000 7f707f3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:37.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.962+0000 7f707f3af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:37.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.962+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:37.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.962+0000 7f707f3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:37.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.962+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:37.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.963+0000 7f707f3af800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:37.969 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.963+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:37.970 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.964+0000 7f707f3af800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:37.970 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.964+0000 7f707f3af800 20 searching for the correct realm 2024-03-04T12:48:37.972 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.967+0000 7f7077fff640 0 -- 172.21.15.90:0/943484675 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f7068036040 msgr2=0x7f706800a540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:37.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:37.971+0000 7f707ceab640 0 -- 172.21.15.90:0/943484675 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f706800a910 msgr2=0x7f7068036930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:48:38.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.178+0000 7f707f3af800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:38.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.178+0000 7f707f3af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:38.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.178+0000 7f707f3af800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:38.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.178+0000 7f707f3af800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:38.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.178+0000 7f707f3af800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:38.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.178+0000 7f707f3af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:38.184 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.178+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.185 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.178+0000 7f707f3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.185 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.178+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.179+0000 7f707f3af800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:38.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.179+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.179+0000 7f707f3af800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:38.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.179+0000 7f707f3af800 20 zone default found 2024-03-04T12:48:38.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.179+0000 7f707f3af800 4 Realm: () 2024-03-04T12:48:38.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.179+0000 7f707f3af800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:38.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.179+0000 7f707f3af800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:38.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.179+0000 7f707f3af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:38.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.179+0000 7f707f3af800 20 zonegroup default 2024-03-04T12:48:38.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.179+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.186 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.179+0000 7f707f3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.179+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.180+0000 7f707f3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.180+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.180+0000 7f707f3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.180+0000 7f707f3af800 20 started sync module instance, tier type = 2024-03-04T12:48:38.187 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.180+0000 7f707f3af800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:38.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.190+0000 7f707f3af800 20 add_watcher() i=0 2024-03-04T12:48:38.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.190+0000 7f707f3af800 20 add_watcher() i=1 2024-03-04T12:48:38.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.190+0000 7f707f3af800 20 add_watcher() i=2 2024-03-04T12:48:38.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.190+0000 7f707f3af800 20 add_watcher() i=3 2024-03-04T12:48:38.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.190+0000 7f707f3af800 20 add_watcher() i=4 2024-03-04T12:48:38.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.190+0000 7f707f3af800 20 add_watcher() i=5 2024-03-04T12:48:38.196 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.190+0000 7f707f3af800 20 add_watcher() i=6 2024-03-04T12:48:38.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.191+0000 7f707f3af800 20 add_watcher() i=7 2024-03-04T12:48:38.197 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.191+0000 7f707f3af800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:38.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.193+0000 7f6f32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:38.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.193+0000 7f707f3af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:38.199 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.193+0000 7f707f3af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:38.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.193+0000 7f707f3af800 5 note: GC not initialized 2024-03-04T12:48:38.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.193+0000 7f6f31fe3640 20 reqs_thread_entry: start 2024-03-04T12:48:38.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.193+0000 7f707f3af800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:38.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.193+0000 7f707f3af800 20 Filter name: none 2024-03-04T12:48:38.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.193+0000 7f6ea37fe640 20 reqs_thread_entry: start 2024-03-04T12:48:38.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.193+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.200 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.194+0000 7f707f3af800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:38.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.194+0000 7f707f3af800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.195+0000 7f707f3af800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:38.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.195+0000 7f707f3af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:38.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.195+0000 7f707f3af800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-04T12:48:38.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.195+0000 7f707f3af800 20 INFO: main: starting shard=0 2024-03-04T12:48:38.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.195+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.0 2024-03-04T12:48:38.201 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.195+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.0 2024-03-04T12:48:38.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.195+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.195+0000 7f707f3af800 20 INFO: main: starting shard=1 2024-03-04T12:48:38.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.195+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.1 2024-03-04T12:48:38.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.195+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.1 2024-03-04T12:48:38.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.196+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.196+0000 7f707f3af800 20 INFO: main: starting shard=2 2024-03-04T12:48:38.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.196+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.2 2024-03-04T12:48:38.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.196+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.2 2024-03-04T12:48:38.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.196+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.202 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.196+0000 7f707f3af800 20 INFO: main: starting shard=3 2024-03-04T12:48:38.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.196+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.3 2024-03-04T12:48:38.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.196+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.3 2024-03-04T12:48:38.203 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.196+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.196+0000 7f707f3af800 20 INFO: main: starting shard=4 2024-03-04T12:48:38.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.196+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.4 2024-03-04T12:48:38.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.196+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.4 2024-03-04T12:48:38.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.197+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.197+0000 7f707f3af800 20 INFO: main: starting shard=5 2024-03-04T12:48:38.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.197+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.5 2024-03-04T12:48:38.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.197+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.5 2024-03-04T12:48:38.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.197+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:48:38.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.198+0000 7f707f3af800 20 INFO: main: starting shard=6 2024-03-04T12:48:38.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.198+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.6 2024-03-04T12:48:38.204 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.198+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.6 2024-03-04T12:48:38.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.198+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.198+0000 7f707f3af800 20 INFO: main: starting shard=7 2024-03-04T12:48:38.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.198+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.7 2024-03-04T12:48:38.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.198+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.7 2024-03-04T12:48:38.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.199+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.199+0000 7f707f3af800 20 INFO: main: starting shard=8 2024-03-04T12:48:38.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.199+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.8 2024-03-04T12:48:38.205 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.199+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.8 2024-03-04T12:48:38.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.199+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.199+0000 7f707f3af800 20 INFO: main: starting shard=9 2024-03-04T12:48:38.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.199+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.9 2024-03-04T12:48:38.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.199+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.9 2024-03-04T12:48:38.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.200+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.200+0000 7f707f3af800 20 INFO: main: starting shard=10 2024-03-04T12:48:38.206 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.200+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.10 2024-03-04T12:48:38.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.200+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.10 2024-03-04T12:48:38.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.200+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.200+0000 7f707f3af800 20 INFO: main: starting shard=11 2024-03-04T12:48:38.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.200+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.11 2024-03-04T12:48:38.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.200+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.11 2024-03-04T12:48:38.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.201+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.207 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.201+0000 7f707f3af800 20 INFO: main: starting shard=12 2024-03-04T12:48:38.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.201+0000 7f707f3af800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.12 2024-03-04T12:48:38.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.201+0000 7f707f3af800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.12 2024-03-04T12:48:38.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.201+0000 7f707f3af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.201+0000 7f707f3af800 20 INFO: main: done 2024-03-04T12:48:38.208 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.202+0000 7f6f32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:38.210 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.205+0000 7f707f3af800 20 remove_watcher() i=0 2024-03-04T12:48:38.211 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.205+0000 7f707f3af800 2 removed watcher, disabling cache 2024-03-04T12:48:38.212 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.206+0000 7f707f3af800 20 remove_watcher() i=1 2024-03-04T12:48:38.213 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.207+0000 7f707f3af800 20 remove_watcher() i=2 2024-03-04T12:48:38.214 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.208+0000 7f707f3af800 20 remove_watcher() i=3 2024-03-04T12:48:38.215 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.209+0000 7f707f3af800 20 remove_watcher() i=4 2024-03-04T12:48:38.216 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.210+0000 7f707f3af800 20 remove_watcher() i=5 2024-03-04T12:48:38.217 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.211+0000 7f707f3af800 20 remove_watcher() i=6 2024-03-04T12:48:38.218 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.212+0000 7f707f3af800 20 remove_watcher() i=7 2024-03-04T12:48:38.231 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:38.231 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:38.234 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:38.234 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:38.284 INFO:tasks.workunit.client.0.smithi090.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:48:38.286 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket myver --object y 2024-03-04T12:48:38.315 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:38.315 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:38.348 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.342+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.344+0000 7f7343731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.344+0000 7f7343731800 20 realm 2024-03-04T12:48:38.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.344+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.344+0000 7f7343731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.344+0000 7f7343731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:38.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.344+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.344+0000 7f7343731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.350 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.344+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.351 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.345+0000 7f7343731800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:38.351 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.345+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.346+0000 7f7343731800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:38.352 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.346+0000 7f7343731800 20 searching for the correct realm 2024-03-04T12:48:38.355 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.349+0000 7f7337fff640 0 -- 172.21.15.90:0/650463932 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f7328035020 msgr2=0x7f7328093960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:38.359 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.353+0000 7f733fc32640 0 -- 172.21.15.90:0/650463932 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7f732802c040 msgr2=0x7f7328083660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:38.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.356+0000 7f7343731800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:38.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.356+0000 7f7343731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:38.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.356+0000 7f7343731800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:38.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.356+0000 7f7343731800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:38.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.356+0000 7f7343731800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:38.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.356+0000 7f7343731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:38.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.363 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 20 zone default found 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 4 Realm: () 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 20 zonegroup default 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.357+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.358+0000 7f7343731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.358+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.358+0000 7f7343731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.358+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.365 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.358+0000 7f7343731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.366 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.358+0000 7f7343731800 20 started sync module instance, tier type = 2024-03-04T12:48:38.366 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.358+0000 7f7343731800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:38.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.367+0000 7f7343731800 20 add_watcher() i=0 2024-03-04T12:48:38.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.367+0000 7f7343731800 20 add_watcher() i=1 2024-03-04T12:48:38.373 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.367+0000 7f7343731800 20 add_watcher() i=2 2024-03-04T12:48:38.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.367+0000 7f7343731800 20 add_watcher() i=3 2024-03-04T12:48:38.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.367+0000 7f7343731800 20 add_watcher() i=4 2024-03-04T12:48:38.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.367+0000 7f7343731800 20 add_watcher() i=5 2024-03-04T12:48:38.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.367+0000 7f7343731800 20 add_watcher() i=6 2024-03-04T12:48:38.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.368+0000 7f7343731800 20 add_watcher() i=7 2024-03-04T12:48:38.374 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.368+0000 7f7343731800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:38.375 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.369+0000 7f71f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:38.376 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.370+0000 7f7343731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:38.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.370+0000 7f7343731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:38.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.370+0000 7f7343731800 5 note: GC not initialized 2024-03-04T12:48:38.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.370+0000 7f71f4fe1640 20 reqs_thread_entry: start 2024-03-04T12:48:38.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.370+0000 7f7343731800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:38.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.370+0000 7f7343731800 20 Filter name: none 2024-03-04T12:48:38.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.370+0000 7f716e7fc640 20 reqs_thread_entry: start 2024-03-04T12:48:38.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.370+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.371+0000 7f7343731800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:38.377 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.371+0000 7f7343731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.371+0000 7f7343731800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:38.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.371+0000 7f7343731800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:38.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.371+0000 7f7343731800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-04T12:48:38.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.371+0000 7f7343731800 20 INFO: main: starting shard=0 2024-03-04T12:48:38.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.371+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.0 2024-03-04T12:48:38.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.371+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.0 2024-03-04T12:48:38.378 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.372+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.372+0000 7f7343731800 20 INFO: main: starting shard=1 2024-03-04T12:48:38.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.372+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.1 2024-03-04T12:48:38.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.372+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.1 2024-03-04T12:48:38.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.372+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.372+0000 7f7343731800 20 INFO: main: starting shard=2 2024-03-04T12:48:38.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.372+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.2 2024-03-04T12:48:38.379 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.372+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.2 2024-03-04T12:48:38.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.373+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.373+0000 7f7343731800 20 INFO: main: starting shard=3 2024-03-04T12:48:38.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.373+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.3 2024-03-04T12:48:38.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.373+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.3 2024-03-04T12:48:38.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.373+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.373+0000 7f7343731800 20 INFO: main: starting shard=4 2024-03-04T12:48:38.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.373+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.4 2024-03-04T12:48:38.380 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.373+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.4 2024-03-04T12:48:38.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.373+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.373+0000 7f7343731800 20 INFO: main: starting shard=5 2024-03-04T12:48:38.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.373+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.5 2024-03-04T12:48:38.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.373+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.5 2024-03-04T12:48:38.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.374+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.374+0000 7f7343731800 20 INFO: main: starting shard=6 2024-03-04T12:48:38.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.374+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.6 2024-03-04T12:48:38.381 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.374+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.6 2024-03-04T12:48:38.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.375+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.375+0000 7f7343731800 20 INFO: main: starting shard=7 2024-03-04T12:48:38.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.375+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.7 2024-03-04T12:48:38.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.375+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.7 2024-03-04T12:48:38.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.375+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.375+0000 7f7343731800 20 INFO: main: starting shard=8 2024-03-04T12:48:38.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.375+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.8 2024-03-04T12:48:38.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.375+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.8 2024-03-04T12:48:38.382 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.375+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.375+0000 7f7343731800 20 INFO: main: starting shard=9 2024-03-04T12:48:38.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.375+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.9 2024-03-04T12:48:38.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.375+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.9 2024-03-04T12:48:38.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.376+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:48:38.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.376+0000 7f7343731800 20 INFO: main: starting shard=10 2024-03-04T12:48:38.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.376+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.10 2024-03-04T12:48:38.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.376+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.10 2024-03-04T12:48:38.383 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.376+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.376+0000 7f7343731800 20 INFO: main: starting shard=11 2024-03-04T12:48:38.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.376+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.11 2024-03-04T12:48:38.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.376+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.11 2024-03-04T12:48:38.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.377+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.377+0000 7f7343731800 20 INFO: main: starting shard=12 2024-03-04T12:48:38.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.377+0000 7f7343731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.12 2024-03-04T12:48:38.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.377+0000 7f7343731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.12 2024-03-04T12:48:38.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.378+0000 7f7343731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.378+0000 7f7343731800 20 INFO: main: done 2024-03-04T12:48:38.384 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.378+0000 7f71f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:38.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.380+0000 7f7343731800 20 remove_watcher() i=0 2024-03-04T12:48:38.386 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.380+0000 7f7343731800 2 removed watcher, disabling cache 2024-03-04T12:48:38.387 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.381+0000 7f7343731800 20 remove_watcher() i=1 2024-03-04T12:48:38.388 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.382+0000 7f7343731800 20 remove_watcher() i=2 2024-03-04T12:48:38.389 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.383+0000 7f7343731800 20 remove_watcher() i=3 2024-03-04T12:48:38.390 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.384+0000 7f7343731800 20 remove_watcher() i=4 2024-03-04T12:48:38.391 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.385+0000 7f7343731800 20 remove_watcher() i=5 2024-03-04T12:48:38.392 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.386+0000 7f7343731800 20 remove_watcher() i=6 2024-03-04T12:48:38.393 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.387+0000 7f7343731800 20 remove_watcher() i=7 2024-03-04T12:48:38.405 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:38.405 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:38.408 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:38.408 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:38.458 INFO:tasks.workunit.client.0.smithi090.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:48:38.460 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bi list --bucket myver --object z 2024-03-04T12:48:38.488 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:38.488 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:38.521 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.515+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.516+0000 7ff419731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.516+0000 7ff419731800 20 realm 2024-03-04T12:48:38.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.516+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.517+0000 7ff419731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.517+0000 7ff419731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:38.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.517+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.517+0000 7ff419731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.517+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.523 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.518+0000 7ff419731800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:38.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.518+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.518+0000 7ff419731800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:38.524 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.518+0000 7ff419731800 20 searching for the correct realm 2024-03-04T12:48:38.527 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.521+0000 7ff415c32640 0 -- 172.21.15.90:0/4165610378 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x55ed06129bd0 msgr2=0x55ed0612c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:38.530 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.524+0000 7ff415431640 0 -- 172.21.15.90:0/4165610378 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7ff40005dbd0 msgr2=0x7ff4000882d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:48:38.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.529+0000 7ff419731800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:38.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.529+0000 7ff419731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:38.535 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.529+0000 7ff419731800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:38.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.529+0000 7ff419731800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:38.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.529+0000 7ff419731800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:38.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.529+0000 7ff419731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:38.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.529+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.529+0000 7ff419731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.536 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.529+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.530+0000 7ff419731800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:38.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.530+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.530+0000 7ff419731800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:38.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.530+0000 7ff419731800 20 zone default found 2024-03-04T12:48:38.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.530+0000 7ff419731800 4 Realm: () 2024-03-04T12:48:38.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.530+0000 7ff419731800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:38.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.530+0000 7ff419731800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:38.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.530+0000 7ff419731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:38.537 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.530+0000 7ff419731800 20 zonegroup default 2024-03-04T12:48:38.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.530+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.530+0000 7ff419731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.530+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.531+0000 7ff419731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.531+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.531+0000 7ff419731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:38.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.531+0000 7ff419731800 20 started sync module instance, tier type = 2024-03-04T12:48:38.538 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.531+0000 7ff419731800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:38.552 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.546+0000 7ff419731800 20 add_watcher() i=0 2024-03-04T12:48:38.552 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.546+0000 7ff419731800 20 add_watcher() i=1 2024-03-04T12:48:38.552 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.546+0000 7ff419731800 20 add_watcher() i=2 2024-03-04T12:48:38.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.546+0000 7ff419731800 20 add_watcher() i=3 2024-03-04T12:48:38.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.546+0000 7ff419731800 20 add_watcher() i=4 2024-03-04T12:48:38.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.546+0000 7ff419731800 20 add_watcher() i=5 2024-03-04T12:48:38.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.546+0000 7ff419731800 20 add_watcher() i=6 2024-03-04T12:48:38.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.547+0000 7ff419731800 20 add_watcher() i=7 2024-03-04T12:48:38.553 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.547+0000 7ff419731800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:38.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.549+0000 7ff2cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:38.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.549+0000 7ff419731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:38.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.549+0000 7ff419731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:38.555 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.549+0000 7ff419731800 5 note: GC not initialized 2024-03-04T12:48:38.556 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.549+0000 7ff2cafe5640 20 reqs_thread_entry: start 2024-03-04T12:48:38.556 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.549+0000 7ff419731800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:38.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.550+0000 7ff419731800 20 Filter name: none 2024-03-04T12:48:38.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.550+0000 7ff2c8fe1640 20 reqs_thread_entry: start 2024-03-04T12:48:38.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.550+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.550+0000 7ff419731800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:38.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.550+0000 7ff419731800 20 rados->read ofs=0 len=0 2024-03-04T12:48:38.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.550+0000 7ff419731800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:38.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.550+0000 7ff419731800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:38.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.550+0000 7ff419731800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-04T12:48:38.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.550+0000 7ff419731800 20 INFO: main: starting shard=0 2024-03-04T12:48:38.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.550+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.0 2024-03-04T12:48:38.557 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.550+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.0 2024-03-04T12:48:38.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.551+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:48:38.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.551+0000 7ff419731800 20 INFO: main: starting shard=1 2024-03-04T12:48:38.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.551+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.1 2024-03-04T12:48:38.558 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.551+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.1 2024-03-04T12:48:38.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.552+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.552+0000 7ff419731800 20 INFO: main: starting shard=2 2024-03-04T12:48:38.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.552+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.2 2024-03-04T12:48:38.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.552+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.2 2024-03-04T12:48:38.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.552+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.552+0000 7ff419731800 20 INFO: main: starting shard=3 2024-03-04T12:48:38.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.552+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.3 2024-03-04T12:48:38.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.552+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.3 2024-03-04T12:48:38.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.552+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.552+0000 7ff419731800 20 INFO: main: starting shard=4 2024-03-04T12:48:38.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.552+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.4 2024-03-04T12:48:38.559 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.552+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.4 2024-03-04T12:48:38.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.553+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.553+0000 7ff419731800 20 INFO: main: starting shard=5 2024-03-04T12:48:38.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.553+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.5 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.553+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.5 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.553+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.553+0000 7ff419731800 20 INFO: main: starting shard=6 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.553+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.6 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.553+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.6 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.554+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.554+0000 7ff419731800 20 INFO: main: starting shard=7 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.554+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.7 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.554+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.7 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.554+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.554+0000 7ff419731800 20 INFO: main: starting shard=8 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.554+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.8 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.554+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.8 2024-03-04T12:48:38.561 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.554+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.554+0000 7ff419731800 20 INFO: main: starting shard=9 2024-03-04T12:48:38.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.554+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.9 2024-03-04T12:48:38.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.554+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.9 2024-03-04T12:48:38.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.555+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.555+0000 7ff419731800 20 INFO: main: starting shard=10 2024-03-04T12:48:38.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.555+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.10 2024-03-04T12:48:38.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.555+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.10 2024-03-04T12:48:38.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.555+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.555+0000 7ff419731800 20 INFO: main: starting shard=11 2024-03-04T12:48:38.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.555+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.11 2024-03-04T12:48:38.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.555+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.11 2024-03-04T12:48:38.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.556+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.556+0000 7ff419731800 20 INFO: main: starting shard=12 2024-03-04T12:48:38.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.556+0000 7ff419731800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.12 2024-03-04T12:48:38.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.556+0000 7ff419731800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.12 2024-03-04T12:48:38.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.556+0000 7ff419731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:48:38.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.556+0000 7ff419731800 20 INFO: main: done 2024-03-04T12:48:38.564 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.557+0000 7ff2cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:38.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.559+0000 7ff419731800 20 remove_watcher() i=0 2024-03-04T12:48:38.565 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.559+0000 7ff419731800 2 removed watcher, disabling cache 2024-03-04T12:48:38.566 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.560+0000 7ff419731800 20 remove_watcher() i=1 2024-03-04T12:48:38.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.562+0000 7ff419731800 20 remove_watcher() i=2 2024-03-04T12:48:38.569 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.563+0000 7ff419731800 20 remove_watcher() i=3 2024-03-04T12:48:38.570 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.564+0000 7ff419731800 20 remove_watcher() i=4 2024-03-04T12:48:38.571 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.565+0000 7ff419731800 20 remove_watcher() i=5 2024-03-04T12:48:38.572 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.566+0000 7ff419731800 20 remove_watcher() i=6 2024-03-04T12:48:38.573 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:38.567+0000 7ff419731800 20 remove_watcher() i=7 2024-03-04T12:48:38.584 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:38.584 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:38.588 INFO:tasks.workunit.client.0.smithi090.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-04T12:48:38.973 INFO:tasks.workunit.client.0.smithi090.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-04T12:48:39.358 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-03-04T12:48:39.389 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:39.389 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:39.422 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.417+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.418+0000 7f9f79b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.418+0000 7f9f79b2d800 20 realm 2024-03-04T12:48:39.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.418+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.418+0000 7f9f79b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.418+0000 7f9f79b2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:39.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.418+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.418+0000 7f9f79b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.424 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.418+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.419+0000 7f9f79b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:39.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.419+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.420+0000 7f9f79b2d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:39.425 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.420+0000 7f9f79b2d800 20 searching for the correct realm 2024-03-04T12:48:39.429 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.423+0000 7f9f75f7b640 0 -- 172.21.15.90:0/3049437396 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x563045370dc0 msgr2=0x563045373280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:39.433 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.427+0000 7f9f7577a640 0 -- 172.21.15.90:0/3049437396 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f9f600ab040 msgr2=0x7f9f600ab420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:39.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.431+0000 7f9f79b2d800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:39.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.431+0000 7f9f79b2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:39.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.431+0000 7f9f79b2d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:39.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.431+0000 7f9f79b2d800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:39.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.431+0000 7f9f79b2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:39.437 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.431+0000 7f9f79b2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:39.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.431+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.431+0000 7f9f79b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.431+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.431+0000 7f9f79b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:39.438 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.431+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.432+0000 7f9f79b2d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:39.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.432+0000 7f9f79b2d800 20 zone default found 2024-03-04T12:48:39.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.432+0000 7f9f79b2d800 4 Realm: () 2024-03-04T12:48:39.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.432+0000 7f9f79b2d800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:39.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.432+0000 7f9f79b2d800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:39.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.432+0000 7f9f79b2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:39.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.432+0000 7f9f79b2d800 20 zonegroup default 2024-03-04T12:48:39.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.432+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.439 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.432+0000 7f9f79b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.432+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.432+0000 7f9f79b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.432+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.433+0000 7f9f79b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.433+0000 7f9f79b2d800 20 started sync module instance, tier type = 2024-03-04T12:48:39.440 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.433+0000 7f9f79b2d800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:39.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.441+0000 7f9f79b2d800 20 add_watcher() i=0 2024-03-04T12:48:39.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.441+0000 7f9f79b2d800 20 add_watcher() i=1 2024-03-04T12:48:39.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.441+0000 7f9f79b2d800 20 add_watcher() i=2 2024-03-04T12:48:39.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.441+0000 7f9f79b2d800 20 add_watcher() i=3 2024-03-04T12:48:39.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.441+0000 7f9f79b2d800 20 add_watcher() i=4 2024-03-04T12:48:39.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.442+0000 7f9f79b2d800 20 add_watcher() i=5 2024-03-04T12:48:39.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.442+0000 7f9f79b2d800 20 add_watcher() i=6 2024-03-04T12:48:39.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.442+0000 7f9f79b2d800 20 add_watcher() i=7 2024-03-04T12:48:39.448 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.442+0000 7f9f79b2d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:39.450 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.444+0000 7f9e2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:39.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.444+0000 7f9f79b2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:39.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.444+0000 7f9f79b2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:39.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.445+0000 7f9f79b2d800 5 note: GC not initialized 2024-03-04T12:48:39.451 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.445+0000 7f9e2a7e4640 20 reqs_thread_entry: start 2024-03-04T12:48:39.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.445+0000 7f9f79b2d800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:39.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.445+0000 7f9f79b2d800 20 Filter name: none 2024-03-04T12:48:39.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.445+0000 7f9d9bfff640 20 reqs_thread_entry: start 2024-03-04T12:48:39.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.445+0000 7f9f79b2d800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-04T12:48:39.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.445+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.445+0000 7f9f79b2d800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:39.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.445+0000 7f9f79b2d800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-04T12:48:39.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.445+0000 7f9f79b2d800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-04T12:48:39.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.445+0000 7f9f79b2d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 : miss 2024-03-04T12:48:39.452 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.445+0000 7f9f79b2d800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.446+0000 7f9f79b2d800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:39.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.446+0000 7f9f79b2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:39.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.446+0000 7f9f79b2d800 10 adding default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:39.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.446+0000 7f9f79b2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:48:39.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.446+0000 7f9f79b2d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:39.453 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.446+0000 7f9f79b2d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 2024-03-04T12:48:39.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.451+0000 7f9f79b2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:39.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.451+0000 7f9f79b2d800 10 moving default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:39.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.451+0000 7f9f79b2d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:39.457 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.451+0000 7f9f79b2d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18, ofs0, ns] 2024-03-04T12:48:39.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.452+0000 7f9e47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824040 cookie 94765319670704 notifier 6935 bl.length()=783 2024-03-04T12:48:39.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.452+0000 7f9e47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:39.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.452+0000 7f9e47fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:39.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.452+0000 7f9e47fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:39.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.452+0000 7f9f79b2d800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): orig_sources= new_sources= 2024-03-04T12:48:39.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.452+0000 7f9f79b2d800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): potential sources added=[] removed=[] 2024-03-04T12:48:39.458 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.452+0000 7f9f79b2d800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): orig_dests= new_dests= 2024-03-04T12:48:39.459 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.452+0000 7f9f79b2d800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): potential dests added=[] removed=[] 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.0 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.0 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.1 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.1 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.2 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.2 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.3 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.3 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.4 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.4 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.5 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.5 2024-03-04T12:48:39.462 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.6 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.6 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.7 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.7 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.8 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.8 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.10 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.10 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.11 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.11 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.12 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.12 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.13 2024-03-04T12:48:39.463 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.13 2024-03-04T12:48:39.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.14 2024-03-04T12:48:39.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.14 2024-03-04T12:48:39.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.15 2024-03-04T12:48:39.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.15 2024-03-04T12:48:39.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.16 2024-03-04T12:48:39.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.16 2024-03-04T12:48:39.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.0 2024-03-04T12:48:39.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.455+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.0 2024-03-04T12:48:39.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.456+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.1 2024-03-04T12:48:39.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.456+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.1 2024-03-04T12:48:39.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.456+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.2 2024-03-04T12:48:39.464 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.456+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.2 2024-03-04T12:48:39.465 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.456+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.3 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.456+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.3 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.457+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.4 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.457+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.4 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.457+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.5 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.457+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.5 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.458+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.6 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.458+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.6 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.458+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.7 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.458+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.7 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.459+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.8 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.459+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.8 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.459+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.9 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.459+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.9 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.460+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.10 2024-03-04T12:48:39.466 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.460+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.10 2024-03-04T12:48:39.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.460+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.11 2024-03-04T12:48:39.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.460+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.11 2024-03-04T12:48:39.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.460+0000 7f9f79b2d800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.12 2024-03-04T12:48:39.467 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.460+0000 7f9f79b2d800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.2.12 2024-03-04T12:48:39.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.463+0000 7f9f79b2d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 : hit (requested=0x17, cached=0x17) 2024-03-04T12:48:39.469 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.463+0000 7f9f79b2d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 2024-03-04T12:48:39.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.464+0000 7f9f79b2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:39.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.464+0000 7f9f79b2d800 10 moving default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:39.470 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.464+0000 7f9f79b2d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:39.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.464+0000 7f9f79b2d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18, ofs0, ns] 2024-03-04T12:48:39.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.464+0000 7f9e47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824041 cookie 94765319670704 notifier 6935 bl.length()=751 2024-03-04T12:48:39.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.464+0000 7f9e47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:39.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.464+0000 7f9e47fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:39.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.464+0000 7f9e47fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:39.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.465+0000 7f9f79b2d800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): orig_sources= new_sources= 2024-03-04T12:48:39.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.465+0000 7f9f79b2d800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): potential sources added=[] removed=[] 2024-03-04T12:48:39.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.465+0000 7f9f79b2d800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): orig_dests= new_dests= 2024-03-04T12:48:39.471 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.465+0000 7f9f79b2d800 20 handle_bi_update(): bucket=:myver[9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18]): potential dests added=[] removed=[] 2024-03-04T12:48:39.473 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.467+0000 7f9f79b2d800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-04T12:48:39.475 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.469+0000 7f9e2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:39.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.471+0000 7f9f79b2d800 20 remove_watcher() i=0 2024-03-04T12:48:39.477 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.471+0000 7f9f79b2d800 2 removed watcher, disabling cache 2024-03-04T12:48:39.478 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.472+0000 7f9f79b2d800 20 remove_watcher() i=1 2024-03-04T12:48:39.479 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.473+0000 7f9f79b2d800 20 remove_watcher() i=2 2024-03-04T12:48:39.480 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.474+0000 7f9f79b2d800 20 remove_watcher() i=3 2024-03-04T12:48:39.481 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.475+0000 7f9f79b2d800 20 remove_watcher() i=4 2024-03-04T12:48:39.482 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.476+0000 7f9f79b2d800 20 remove_watcher() i=5 2024-03-04T12:48:39.483 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.477+0000 7f9f79b2d800 20 remove_watcher() i=6 2024-03-04T12:48:39.484 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.478+0000 7f9f79b2d800 20 remove_watcher() i=7 2024-03-04T12:48:39.495 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-04T12:48:39.528 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:39.528 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:39.560 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.554+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.555+0000 7f19d4015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.555+0000 7f19d4015800 20 realm 2024-03-04T12:48:39.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.555+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.555+0000 7f19d4015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.555+0000 7f19d4015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:39.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.555+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.556+0000 7f19d4015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.562 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.556+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.556+0000 7f19d4015800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:39.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.556+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.557+0000 7f19d4015800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:39.563 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.557+0000 7f19d4015800 20 searching for the correct realm 2024-03-04T12:48:39.567 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.561+0000 7f19c7fff640 0 -- 172.21.15.90:0/82055301 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f19b808a040 msgr2=0x7f19b8089400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:39.570 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.564+0000 7f19cfe17640 0 -- 172.21.15.90:0/82055301 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7f19b8062430 msgr2=0x7f19b8062890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:48:39.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.568+0000 7f19d4015800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:39.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.568+0000 7f19d4015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:39.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.568+0000 7f19d4015800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:39.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.568+0000 7f19d4015800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:39.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.568+0000 7f19d4015800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:39.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.568+0000 7f19d4015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:39.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.568+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:39.575 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.576 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 20 zone default found 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 4 Realm: () 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 20 zonegroup default 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.569+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.570+0000 7f19d4015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.570+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.570+0000 7f19d4015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.570+0000 7f19d4015800 20 started sync module instance, tier type = 2024-03-04T12:48:39.577 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.570+0000 7f19d4015800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:39.584 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.579+0000 7f19d4015800 20 add_watcher() i=0 2024-03-04T12:48:39.584 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.579+0000 7f19d4015800 20 add_watcher() i=1 2024-03-04T12:48:39.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.579+0000 7f19d4015800 20 add_watcher() i=2 2024-03-04T12:48:39.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.579+0000 7f19d4015800 20 add_watcher() i=3 2024-03-04T12:48:39.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.579+0000 7f19d4015800 20 add_watcher() i=4 2024-03-04T12:48:39.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.579+0000 7f19d4015800 20 add_watcher() i=5 2024-03-04T12:48:39.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.579+0000 7f19d4015800 20 add_watcher() i=6 2024-03-04T12:48:39.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.579+0000 7f19d4015800 20 add_watcher() i=7 2024-03-04T12:48:39.585 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.579+0000 7f19d4015800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:39.587 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.581+0000 7f1885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:39.587 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.581+0000 7f19d4015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:39.587 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.581+0000 7f19d4015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:39.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.581+0000 7f19d4015800 5 note: GC not initialized 2024-03-04T12:48:39.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.581+0000 7f1884fe1640 20 reqs_thread_entry: start 2024-03-04T12:48:39.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.581+0000 7f19d4015800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:39.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.581+0000 7f19d4015800 20 Filter name: none 2024-03-04T12:48:39.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.582+0000 7f17fe7fc640 20 reqs_thread_entry: start 2024-03-04T12:48:39.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.582+0000 7f19d4015800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-04T12:48:39.588 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.582+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.582+0000 7f19d4015800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:39.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.582+0000 7f19d4015800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-04T12:48:39.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.582+0000 7f19d4015800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-04T12:48:39.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.582+0000 7f19d4015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 : miss 2024-03-04T12:48:39.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.582+0000 7f19d4015800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.583+0000 7f19d4015800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:39.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.583+0000 7f19d4015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 info.flags=0x17 2024-03-04T12:48:39.589 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.583+0000 7f19d4015800 10 adding default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 to cache LRU end 2024-03-04T12:48:39.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.583+0000 7f19d4015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:48:39.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.583+0000 7f19d4015800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-04T12:48:39.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.583+0000 7f19d4015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18 2024-03-04T12:48:39.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.583+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.0 2024-03-04T12:48:39.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.583+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.0 2024-03-04T12:48:39.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.583+0000 7f19d4015800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-04T12:48:39.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.583+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.1 2024-03-04T12:48:39.590 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.583+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.1 2024-03-04T12:48:39.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.584+0000 7f19d4015800 1 NOTICE: finished shard 1 (0 entries removed) 2024-03-04T12:48:39.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.584+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.2 2024-03-04T12:48:39.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.584+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.2 2024-03-04T12:48:39.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.584+0000 7f19d4015800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-04T12:48:39.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.584+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.3 2024-03-04T12:48:39.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.584+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.3 2024-03-04T12:48:39.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.584+0000 7f19d4015800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-04T12:48:39.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.584+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.4 2024-03-04T12:48:39.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.584+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.4 2024-03-04T12:48:39.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.585+0000 7f19d4015800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-04T12:48:39.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.585+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.5 2024-03-04T12:48:39.591 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.585+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.5 2024-03-04T12:48:39.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.585+0000 7f19d4015800 1 NOTICE: finished shard 5 (0 entries removed) 2024-03-04T12:48:39.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.585+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.6 2024-03-04T12:48:39.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.585+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.6 2024-03-04T12:48:39.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.586+0000 7f19d4015800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-04T12:48:39.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.586+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.7 2024-03-04T12:48:39.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.586+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.7 2024-03-04T12:48:39.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.586+0000 7f19d4015800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-04T12:48:39.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.586+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.8 2024-03-04T12:48:39.592 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.586+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.8 2024-03-04T12:48:39.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.587+0000 7f19d4015800 1 NOTICE: finished shard 8 (0 entries removed) 2024-03-04T12:48:39.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.587+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.587+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.587+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.10 2024-03-04T12:48:39.593 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.587+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.10 2024-03-04T12:48:39.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.588+0000 7f19d4015800 1 NOTICE: finished shard 10 (0 entries removed) 2024-03-04T12:48:39.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.588+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.11 2024-03-04T12:48:39.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.588+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.11 2024-03-04T12:48:39.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.588+0000 7f19d4015800 1 NOTICE: finished shard 11 (0 entries removed) 2024-03-04T12:48:39.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.588+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.12 2024-03-04T12:48:39.594 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.588+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.12 2024-03-04T12:48:39.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.589+0000 7f19d4015800 1 NOTICE: finished shard 12 (0 entries removed) 2024-03-04T12:48:39.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.589+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.13 2024-03-04T12:48:39.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.589+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.13 2024-03-04T12:48:39.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.589+0000 7f19d4015800 1 NOTICE: finished shard 13 (0 entries removed) 2024-03-04T12:48:39.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.589+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.14 2024-03-04T12:48:39.595 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.589+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.14 2024-03-04T12:48:39.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.590+0000 7f19d4015800 1 NOTICE: finished shard 14 (0 entries removed) 2024-03-04T12:48:39.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.590+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.15 2024-03-04T12:48:39.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.590+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.15 2024-03-04T12:48:39.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.591+0000 7f19d4015800 1 NOTICE: finished shard 15 (0 entries removed) 2024-03-04T12:48:39.596 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.591+0000 7f19d4015800 10 bucket_obj is .dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.16 2024-03-04T12:48:39.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.591+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.16 2024-03-04T12:48:39.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.591+0000 7f19d4015800 1 NOTICE: finished shard 16 (0 entries removed) 2024-03-04T12:48:39.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.591+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.597 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.592+0000 7f19d4015800 20 get_obj_state: octx=0x556c2cf95a40 obj=myver:x state=0x556c2d26f8c8 s->prefetch_data=0 2024-03-04T12:48:39.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.592+0000 7f19d4015800 20 get_obj_state: setting s->obj_tag to 19xwbfpc8ol8tt9dokc2eck13y12l7fq 2024-03-04T12:48:39.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.592+0000 7f19d4015800 20 get_obj_state_impl: setting s->olh_tag to v1f5mk6rnfzz37j86w4w2209kz7a284w 2024-03-04T12:48:39.598 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.592+0000 7f19d4015800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=v1f5mk6rnfzz37j86w4w2209kz7a284w 2024-03-04T12:48:39.599 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.593+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.600 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.594+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.595+0000 7f19d4015800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-03-04T12:48:39.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.595+0000 7f19d4015800 20 olh_log_entry: epoch=2 op=3 key=x[iINbgMy4nqJXzAbgjbqy14T7KJEVOpM] 2024-03-04T12:48:39.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.595+0000 7f19d4015800 20 get_obj_state: octx=0x556c2cf95a40 obj=myver:_:iINbgMy4nqJXzAbgjbqy14T7KJEVOpM_x state=0x556c2d279018 s->prefetch_data=0 2024-03-04T12:48:39.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.595+0000 7f19d4015800 10 manifest: total_size = 12 2024-03-04T12:48:39.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.595+0000 7f19d4015800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13252577638821570771 2024-03-04T12:48:39.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.595+0000 7f19d4015800 20 get_obj_state: octx=0x556c2cf95a40 obj=myver:_:iINbgMy4nqJXzAbgjbqy14T7KJEVOpM_x state=0x556c2d279018 s->prefetch_data=0 2024-03-04T12:48:39.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.595+0000 7f19d4015800 20 prepare_atomic_modification: state is not atomic. state=0x556c2d279018 2024-03-04T12:48:39.601 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.595+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.598+0000 7f19d4015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:48:39.603 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.598+0000 7f19d4015800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-03-04T12:48:39.604 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.598+0000 7f19d4015800 0 deleting objects inline since gc isn't initialized 2024-03-04T12:48:39.604 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.598+0000 7f19d4015800 5 delete_objs_inline: removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18__shadow:iINbgMy4nqJXzAbgjbqy14T7KJEVOpM_.R0OnlnB4GB7abvca5T0FJ20VFeQ2J4F_0 2024-03-04T12:48:39.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.599+0000 7f19d4015800 5 delete_objs_inline: refcount put returned error -2 2024-03-04T12:48:39.605 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.599+0000 7f18b2ffd640 20 handle_completion(): completion ok for obj=x[iINbgMy4nqJXzAbgjbqy14T7KJEVOpM] 2024-03-04T12:48:39.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.600+0000 7f19d4015800 20 get_obj_state: octx=0x556c2cf95a40 obj=myver:x state=0x556c2d26f8c8 s->prefetch_data=0 2024-03-04T12:48:39.606 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.600+0000 7f19d4015800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=v1f5mk6rnfzz37j86w4w2209kz7a284w 2024-03-04T12:48:39.607 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.601+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.608 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.603+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.603+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.603+0000 7f19d4015800 20 get_obj_state: octx=0x556c2cf95a40 obj=myver:y state=0x556c2d27ea98 s->prefetch_data=0 2024-03-04T12:48:39.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.604+0000 7f19d4015800 20 get_obj_state: setting s->obj_tag to 1co00luegc3ip4draes0pv7iz2c6lpo1 2024-03-04T12:48:39.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.604+0000 7f19d4015800 20 get_obj_state_impl: setting s->olh_tag to hr0wupuunou1nelpnjs3nvya0ljpg26x 2024-03-04T12:48:39.609 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.604+0000 7f19d4015800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=hr0wupuunou1nelpnjs3nvya0ljpg26x 2024-03-04T12:48:39.610 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.605+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.606+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.606+0000 7f19d4015800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-03-04T12:48:39.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.606+0000 7f19d4015800 20 olh_log_entry: epoch=2 op=3 key=y[C-RGuS38W0ZbI9ygp0HCpEmGouU4xJ0] 2024-03-04T12:48:39.612 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.606+0000 7f19d4015800 20 get_obj_state: octx=0x556c2cf95a40 obj=myver:_:C-RGuS38W0ZbI9ygp0HCpEmGouU4xJ0_y state=0x556c2d278008 s->prefetch_data=0 2024-03-04T12:48:39.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.607+0000 7f19d4015800 10 manifest: total_size = 22 2024-03-04T12:48:39.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.607+0000 7f19d4015800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10247945643366704403 2024-03-04T12:48:39.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.607+0000 7f19d4015800 20 get_obj_state: octx=0x556c2cf95a40 obj=myver:_:C-RGuS38W0ZbI9ygp0HCpEmGouU4xJ0_y state=0x556c2d278008 s->prefetch_data=0 2024-03-04T12:48:39.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.607+0000 7f19d4015800 20 prepare_atomic_modification: state is not atomic. state=0x556c2d278008 2024-03-04T12:48:39.613 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.607+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.609+0000 7f19d4015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:48:39.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.609+0000 7f19d4015800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-03-04T12:48:39.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.609+0000 7f19d4015800 0 deleting objects inline since gc isn't initialized 2024-03-04T12:48:39.615 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.609+0000 7f19d4015800 5 delete_objs_inline: removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18__shadow:C-RGuS38W0ZbI9ygp0HCpEmGouU4xJ0_.P1aM0qwsBdThFonyVnS8NCSjrNnoVmr_0 2024-03-04T12:48:39.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.610+0000 7f19d4015800 5 delete_objs_inline: refcount put returned error -2 2024-03-04T12:48:39.616 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.610+0000 7f18b27fc640 20 handle_completion(): completion ok for obj=y[C-RGuS38W0ZbI9ygp0HCpEmGouU4xJ0] 2024-03-04T12:48:39.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.611+0000 7f19d4015800 20 get_obj_state: octx=0x556c2cf95a40 obj=myver:y state=0x556c2d27ea98 s->prefetch_data=0 2024-03-04T12:48:39.617 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.611+0000 7f19d4015800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=hr0wupuunou1nelpnjs3nvya0ljpg26x 2024-03-04T12:48:39.619 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.613+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.614+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.620 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.615+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.615+0000 7f19d4015800 20 get_obj_state: octx=0x556c2cf95a40 obj=myver:z state=0x556c2d27ea98 s->prefetch_data=0 2024-03-04T12:48:39.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.615+0000 7f19d4015800 20 get_obj_state: setting s->obj_tag to wrf7o1jnskpgl25yayp7e18ah2v8h17a 2024-03-04T12:48:39.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.615+0000 7f19d4015800 20 get_obj_state_impl: setting s->olh_tag to n3b3421hzk7luwq3so48n07ryvrym8vp 2024-03-04T12:48:39.621 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.615+0000 7f19d4015800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=n3b3421hzk7luwq3so48n07ryvrym8vp 2024-03-04T12:48:39.622 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.616+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.623 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.617+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.618+0000 7f19d4015800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-03-04T12:48:39.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.618+0000 7f19d4015800 20 olh_log_entry: epoch=2 op=3 key=z[xYOjhzFAefSSImQdhIUayBLcH7aH7JX] 2024-03-04T12:48:39.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.618+0000 7f19d4015800 20 get_obj_state: octx=0x556c2cf95a40 obj=myver:_:xYOjhzFAefSSImQdhIUayBLcH7aH7JX_z state=0x556c2d278008 s->prefetch_data=0 2024-03-04T12:48:39.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.618+0000 7f19d4015800 10 manifest: total_size = 12 2024-03-04T12:48:39.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.618+0000 7f19d4015800 20 get_obj_state: setting s->obj_tag to 9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11220162639071049442 2024-03-04T12:48:39.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.618+0000 7f19d4015800 20 get_obj_state: octx=0x556c2cf95a40 obj=myver:_:xYOjhzFAefSSImQdhIUayBLcH7aH7JX_z state=0x556c2d278008 s->prefetch_data=0 2024-03-04T12:48:39.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.618+0000 7f19d4015800 20 prepare_atomic_modification: state is not atomic. state=0x556c2d278008 2024-03-04T12:48:39.624 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.618+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.620+0000 7f19d4015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:48:39.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.620+0000 7f19d4015800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-03-04T12:48:39.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.620+0000 7f19d4015800 0 deleting objects inline since gc isn't initialized 2024-03-04T12:48:39.626 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.620+0000 7f19d4015800 5 delete_objs_inline: removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18__shadow:xYOjhzFAefSSImQdhIUayBLcH7aH7JX_.PLYZ9G8kNGx7UUTnhypGNsrXytOrzv__0 2024-03-04T12:48:39.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.621+0000 7f19d4015800 5 delete_objs_inline: refcount put returned error -2 2024-03-04T12:48:39.627 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.621+0000 7f18b2ffd640 20 handle_completion(): completion ok for obj=z[xYOjhzFAefSSImQdhIUayBLcH7aH7JX] 2024-03-04T12:48:39.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.622+0000 7f19d4015800 20 get_obj_state: octx=0x556c2cf95a40 obj=myver:z state=0x556c2d27ea98 s->prefetch_data=0 2024-03-04T12:48:39.628 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.622+0000 7f19d4015800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=n3b3421hzk7luwq3so48n07ryvrym8vp 2024-03-04T12:48:39.630 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.624+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.625+0000 7f19d4015800 20 bucket index object: :.dir.9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18.3.9 2024-03-04T12:48:39.631 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.625+0000 7f19d4015800 1 NOTICE: finished shard 9 (3 entries removed) 2024-03-04T12:48:39.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.625+0000 7f19d4015800 1 NOTICE: finished all shards (3 entries removed) 2024-03-04T12:48:39.632 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.626+0000 7f1885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:39.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.628+0000 7f19d4015800 20 remove_watcher() i=0 2024-03-04T12:48:39.634 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.628+0000 7f19d4015800 2 removed watcher, disabling cache 2024-03-04T12:48:39.635 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.629+0000 7f19d4015800 20 remove_watcher() i=1 2024-03-04T12:48:39.636 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.630+0000 7f19d4015800 20 remove_watcher() i=2 2024-03-04T12:48:39.637 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.631+0000 7f19d4015800 20 remove_watcher() i=3 2024-03-04T12:48:39.638 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.632+0000 7f19d4015800 20 remove_watcher() i=4 2024-03-04T12:48:39.639 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.633+0000 7f19d4015800 20 remove_watcher() i=5 2024-03-04T12:48:39.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.634+0000 7f19d4015800 20 remove_watcher() i=6 2024-03-04T12:48:39.640 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.635+0000 7f19d4015800 20 remove_watcher() i=7 2024-03-04T12:48:39.652 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:39.652 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:39.657 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:39.657 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:39.701 INFO:tasks.workunit.client.0.smithi090.stderr:radosgw-admin bucket stats --bucket myver 2024-03-04T12:48:39.728 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:48:39.728 INFO:tasks.workunit.client.0.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:48:39.760 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.754+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.755+0000 7f5bdea30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.755+0000 7f5bdea30800 20 realm 2024-03-04T12:48:39.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.755+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.755+0000 7f5bdea30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.755+0000 7f5bdea30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:48:39.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.755+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.755+0000 7f5bdea30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.762 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.755+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.756+0000 7f5bdea30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:39.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.756+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.757+0000 7f5bdea30800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:48:39.763 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.757+0000 7f5bdea30800 20 searching for the correct realm 2024-03-04T12:48:39.767 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.761+0000 7f5bda458640 0 -- 172.21.15.90:0/1681834742 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7f5bc4056040 msgr2=0x7f5bc4056930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:39.973 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.967+0000 7f5bd9c57640 0 -- 172.21.15.90:0/1681834742 >> [v2:172.21.15.184:6824/1880219084,v1:172.21.15.184:6825/1880219084] conn(0x5571d363a250 msgr2=0x5571d363c640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:48:39.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.969+0000 7f5bdea30800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:48:39.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.969+0000 7f5bdea30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:48:39.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.969+0000 7f5bdea30800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:48:39.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.969+0000 7f5bdea30800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:48:39.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.969+0000 7f5bdea30800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:48:39.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.969+0000 7f5bdea30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:48:39.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.969+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.976 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:48:39.977 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 20 zone default found 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 4 Realm: () 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 20 zonegroup default 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.970+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.971+0000 7f5bdea30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.971+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.971+0000 7f5bdea30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.971+0000 7f5bdea30800 20 started sync module instance, tier type = 2024-03-04T12:48:39.978 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.971+0000 7f5bdea30800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:48:39.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.980+0000 7f5bdea30800 20 add_watcher() i=0 2024-03-04T12:48:39.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.980+0000 7f5bdea30800 20 add_watcher() i=1 2024-03-04T12:48:39.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.980+0000 7f5bdea30800 20 add_watcher() i=2 2024-03-04T12:48:39.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.980+0000 7f5bdea30800 20 add_watcher() i=3 2024-03-04T12:48:39.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.980+0000 7f5bdea30800 20 add_watcher() i=4 2024-03-04T12:48:39.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.980+0000 7f5bdea30800 20 add_watcher() i=5 2024-03-04T12:48:39.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.980+0000 7f5bdea30800 20 add_watcher() i=6 2024-03-04T12:48:39.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.981+0000 7f5bdea30800 20 add_watcher() i=7 2024-03-04T12:48:39.986 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.981+0000 7f5bdea30800 2 all 8 watchers are set, enabling cache 2024-03-04T12:48:39.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.982+0000 7f5a8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:39.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.982+0000 7f5bdea30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:48:39.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.982+0000 7f5bdea30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:48:39.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.982+0000 7f5bdea30800 5 note: GC not initialized 2024-03-04T12:48:39.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.983+0000 7f5a8a7fc640 20 reqs_thread_entry: start 2024-03-04T12:48:39.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.983+0000 7f5bdea30800 20 init_complete bucket index max shards: 11 2024-03-04T12:48:39.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.983+0000 7f5bdea30800 20 Filter name: none 2024-03-04T12:48:39.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.983+0000 7f59fbfff640 20 reqs_thread_entry: start 2024-03-04T12:48:39.989 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.983+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.983+0000 7f5bdea30800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:39.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.983+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.984+0000 7f5bdea30800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:39.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.984+0000 7f5bdea30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:39.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.984+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.990 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.984+0000 7f5bdea30800 20 rados_obj.operate() r=0 bl.length=173 2024-03-04T12:48:39.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.984+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.984+0000 7f5bdea30800 20 rados_obj.operate() r=0 bl.length=357 2024-03-04T12:48:39.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.984+0000 7f5bdea30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:48:39.991 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.985+0000 7f5bdea30800 20 rados->read ofs=0 len=0 2024-03-04T12:48:39.992 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.986+0000 7f5bdea30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:48:39.992 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.986+0000 7f5a8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:48:39.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.988+0000 7f5bdea30800 20 remove_watcher() i=0 2024-03-04T12:48:39.994 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.988+0000 7f5bdea30800 2 removed watcher, disabling cache 2024-03-04T12:48:39.995 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.989+0000 7f5bdea30800 20 remove_watcher() i=1 2024-03-04T12:48:39.996 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.990+0000 7f5bdea30800 20 remove_watcher() i=2 2024-03-04T12:48:39.997 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.992+0000 7f5bdea30800 20 remove_watcher() i=3 2024-03-04T12:48:39.998 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.992+0000 7f5bdea30800 20 remove_watcher() i=4 2024-03-04T12:48:39.999 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.993+0000 7f5bdea30800 20 remove_watcher() i=5 2024-03-04T12:48:40.000 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.994+0000 7f5bdea30800 20 remove_watcher() i=6 2024-03-04T12:48:40.001 INFO:tasks.workunit.client.0.smithi090.stderr:2024-03-04T12:48:39.995+0000 7f5bdea30800 20 remove_watcher() i=7 2024-03-04T12:48:40.011 INFO:tasks.workunit.client.0.smithi090.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-03-04T12:48:40.011 INFO:tasks.workunit.client.0.smithi090.stderr:Deleting bucket a-bucket 2024-03-04T12:48:40.012 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:40.012 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:40.016 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:40.016 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:40.027 INFO:tasks.workunit.client.0.smithi090.stderr:Deleting bucket myver 2024-03-04T12:48:40.028 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:40.028 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:40.073 INFO:tasks.workunit.client.0.smithi090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:48:40.073 INFO:tasks.workunit.client.0.smithi090.stderr: warnings.warn( 2024-03-04T12:48:40.107 INFO:tasks.workunit.client.0.smithi090.stderr:Completed resharding tests 2024-03-04T12:48:40.107 INFO:tasks.workunit.client.0.smithi090.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-03-04T12:48:40.107 INFO:tasks.workunit.client.0.smithi090.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-03-04T12:48:40.107 INFO:tasks.workunit.client.0.smithi090.stdout:connected to https://localhost:443 2024-03-04T12:48:40.175 INFO:tasks.workunit.client.0.smithi090.stderr:+ deactivate 2024-03-04T12:48:40.176 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-03-04T12:48:40.176 INFO:tasks.workunit.client.0.smithi090.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:48:40.176 INFO:tasks.workunit.client.0.smithi090.stderr:+ export PATH 2024-03-04T12:48:40.176 INFO:tasks.workunit.client.0.smithi090.stderr:+ unset _OLD_VIRTUAL_PATH 2024-03-04T12:48:40.176 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' -n '' ']' 2024-03-04T12:48:40.176 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:48:40.176 INFO:tasks.workunit.client.0.smithi090.stderr:+ hash -r 2024-03-04T12:48:40.176 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' -n '' ']' 2024-03-04T12:48:40.176 INFO:tasks.workunit.client.0.smithi090.stderr:+ unset VIRTUAL_ENV 2024-03-04T12:48:40.176 INFO:tasks.workunit.client.0.smithi090.stderr:+ '[' '!' '' = nondestructive ']' 2024-03-04T12:48:40.176 INFO:tasks.workunit.client.0.smithi090.stderr:+ unset -f deactivate 2024-03-04T12:48:40.176 INFO:tasks.workunit.client.0.smithi090.stderr:+ echo OK. 2024-03-04T12:48:40.177 INFO:tasks.workunit.client.0.smithi090.stdout:OK. 2024-03-04T12:48:40.178 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:48:40.178 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:48:40.258 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-03-04T12:48:40.258 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-04T12:48:40.649 DEBUG:teuthology.parallel:result is None 2024-03-04T12:48:40.650 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:48:40.709 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:48:40.709 DEBUG:teuthology.orchestra.run.smithi090:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:48:40.736 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:48:40.736 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-03-04T12:48:40.750 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-03-04T12:48:40.750 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-03-04T12:48:40.750 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-03-04T12:48:40.751 DEBUG:teuthology.orchestra.run.smithi090:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-03-04T12:48:40.802 INFO:teuthology.orchestra.run.smithi090.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-03-04T12:49:00.582 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-03-04T12:49:00.582 DEBUG:teuthology.orchestra.run.smithi090:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-03-04T12:49:03.578 INFO:teuthology.orchestra.run.smithi090.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-03-04T12:49:04.141 INFO:teuthology.orchestra.run.smithi090.stdout:Last metadata expiration check: 0:16:09 ago on Mon 04 Mar 2024 12:32:55 PM UTC. 2024-03-04T12:49:04.319 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-03-04T12:49:04.320 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-03-04T12:49:04.320 INFO:teuthology.orchestra.run.smithi090.stdout: Package Arch Version Repository Size 2024-03-04T12:49:04.320 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-03-04T12:49:04.320 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2024-03-04T12:49:04.320 INFO:teuthology.orchestra.run.smithi090.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 424 k 2024-03-04T12:49:04.320 INFO:teuthology.orchestra.run.smithi090.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 9.3 M 2024-03-04T12:49:04.321 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2024-03-04T12:49:04.321 INFO:teuthology.orchestra.run.smithi090.stdout: java-1.8.0-openjdk-headless 2024-03-04T12:49:04.321 INFO:teuthology.orchestra.run.smithi090.stdout: x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 32 M 2024-03-04T12:49:04.321 INFO:teuthology.orchestra.run.smithi090.stdout:Installing weak dependencies: 2024-03-04T12:49:04.321 INFO:teuthology.orchestra.run.smithi090.stdout: gtk2 x86_64 2.24.33-8.el9 CentOS-AppStream 3.5 M 2024-03-04T12:49:04.321 INFO:teuthology.orchestra.run.smithi090.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 CentOS-AppStream 25 k 2024-03-04T12:49:04.321 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:04.321 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-03-04T12:49:04.321 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-03-04T12:49:04.321 INFO:teuthology.orchestra.run.smithi090.stdout:Install 5 Packages 2024-03-04T12:49:04.321 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:04.322 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 45 M 2024-03-04T12:49:04.322 INFO:teuthology.orchestra.run.smithi090.stdout:Installed size: 166 M 2024-03-04T12:49:04.322 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-03-04T12:49:04.518 INFO:teuthology.orchestra.run.smithi090.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 2.1 MB/s | 424 kB 00:00 2024-03-04T12:49:04.686 INFO:teuthology.orchestra.run.smithi090.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 9.5 MB/s | 3.5 MB 00:00 2024-03-04T12:49:04.870 INFO:teuthology.orchestra.run.smithi090.stdout:(3/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 17 MB/s | 9.3 MB 00:00 2024-03-04T12:49:04.903 INFO:teuthology.orchestra.run.smithi090.stdout:(4/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 117 kB/s | 25 kB 00:00 2024-03-04T12:49:05.853 INFO:teuthology.orchestra.run.smithi090.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 24 MB/s | 32 MB 00:01 2024-03-04T12:49:05.856 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-03-04T12:49:05.856 INFO:teuthology.orchestra.run.smithi090.stdout:Total 30 MB/s | 45 MB 00:01 2024-03-04T12:49:05.857 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-03-04T12:49:05.875 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-03-04T12:49:05.875 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-03-04T12:49:06.246 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-03-04T12:49:06.247 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-03-04T12:49:06.667 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-03-04T12:49:06.806 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-03-04T12:49:06.984 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-03-04T12:49:07.592 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-03-04T12:49:07.651 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-03-04T12:49:07.886 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-03-04T12:49:07.919 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-03-04T12:49:08.163 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-03-04T12:49:08.208 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-03-04T12:49:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-03-04T12:49:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-03-04T12:49:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-03-04T12:49:11.785 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-03-04T12:49:11.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-03-04T12:49:11.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-03-04T12:49:11.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-03-04T12:49:11.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-03-04T12:49:12.154 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-03-04T12:49:12.154 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:12.154 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2024-03-04T12:49:12.154 INFO:teuthology.orchestra.run.smithi090.stdout: gtk2-2.24.33-8.el9.x86_64 2024-03-04T12:49:12.154 INFO:teuthology.orchestra.run.smithi090.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-03-04T12:49:12.154 INFO:teuthology.orchestra.run.smithi090.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-03-04T12:49:12.155 INFO:teuthology.orchestra.run.smithi090.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-03-04T12:49:12.155 INFO:teuthology.orchestra.run.smithi090.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-03-04T12:49:12.155 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:12.155 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-03-04T12:49:12.684 INFO:teuthology.orchestra.run.smithi090.stdout: Gradle will be installed under /opt/gradle 2024-03-04T12:49:12.750 INFO:teuthology.orchestra.run.smithi090.stderr:--2024-03-04 12:49:12-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-03-04T12:49:12.870 INFO:teuthology.orchestra.run.smithi090.stderr:Resolving services.gradle.org (services.gradle.org)... 104.17.129.37, 104.17.128.37, 2606:4700::6811:8125, ... 2024-03-04T12:49:12.879 INFO:teuthology.orchestra.run.smithi090.stderr:Connecting to services.gradle.org (services.gradle.org)|104.17.129.37|:443... connected. 2024-03-04T12:49:12.965 INFO:teuthology.orchestra.run.smithi090.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-03-04T12:49:12.965 INFO:teuthology.orchestra.run.smithi090.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-03-04T12:49:12.966 INFO:teuthology.orchestra.run.smithi090.stderr:--2024-03-04 12:49:12-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-03-04T12:49:12.966 INFO:teuthology.orchestra.run.smithi090.stderr:Resolving github.com (github.com)... 140.82.114.4 2024-03-04T12:49:12.977 INFO:teuthology.orchestra.run.smithi090.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2024-03-04T12:49:13.071 INFO:teuthology.orchestra.run.smithi090.stderr:HTTP request sent, awaiting response... 302 Found 2024-03-04T12:49:13.071 INFO:teuthology.orchestra.run.smithi090.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240304%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240304T124905Z&X-Amz-Expires=300&X-Amz-Signature=08d24e12c684d2efd3ee104abf1e0f7c8928a8197c5ab4f09292cf93dc975bf1&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-03-04T12:49:13.071 INFO:teuthology.orchestra.run.smithi090.stderr:--2024-03-04 12:49:13-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240304%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240304T124905Z&X-Amz-Expires=300&X-Amz-Signature=08d24e12c684d2efd3ee104abf1e0f7c8928a8197c5ab4f09292cf93dc975bf1&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-03-04T12:49:13.071 INFO:teuthology.orchestra.run.smithi090.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.108.133, 185.199.111.133, ... 2024-03-04T12:49:13.086 INFO:teuthology.orchestra.run.smithi090.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-03-04T12:49:13.191 INFO:teuthology.orchestra.run.smithi090.stderr:HTTP request sent, awaiting response... 200 OK 2024-03-04T12:49:13.191 INFO:teuthology.orchestra.run.smithi090.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-03-04T12:49:13.191 INFO:teuthology.orchestra.run.smithi090.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-03-04T12:49:13.191 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-03-04T12:49:13.221 INFO:teuthology.orchestra.run.smithi090.stderr: 0K .......... .......... .......... .......... .......... 0% 1.58M 57s 2024-03-04T12:49:13.225 INFO:teuthology.orchestra.run.smithi090.stderr: 50K .......... .......... .......... .......... .......... 0% 12.6M 32s 2024-03-04T12:49:13.235 INFO:teuthology.orchestra.run.smithi090.stderr: 100K .......... .......... .......... .......... .......... 0% 4.73M 28s 2024-03-04T12:49:13.238 INFO:teuthology.orchestra.run.smithi090.stderr: 150K .......... .......... .......... .......... .......... 0% 15.4M 22s 2024-03-04T12:49:13.240 INFO:teuthology.orchestra.run.smithi090.stderr: 200K .......... .......... .......... .......... .......... 0% 23.4M 19s 2024-03-04T12:49:13.242 INFO:teuthology.orchestra.run.smithi090.stderr: 250K .......... .......... .......... .......... .......... 0% 21.2M 16s 2024-03-04T12:49:13.249 INFO:teuthology.orchestra.run.smithi090.stderr: 300K .......... .......... .......... .......... .......... 0% 7.28M 16s 2024-03-04T12:49:13.252 INFO:teuthology.orchestra.run.smithi090.stderr: 350K .......... .......... .......... .......... .......... 0% 14.0M 15s 2024-03-04T12:49:13.255 INFO:teuthology.orchestra.run.smithi090.stderr: 400K .......... .......... .......... .......... .......... 0% 41.2M 13s 2024-03-04T12:49:13.255 INFO:teuthology.orchestra.run.smithi090.stderr: 450K .......... .......... .......... .......... .......... 0% 55.3M 12s 2024-03-04T12:49:13.257 INFO:teuthology.orchestra.run.smithi090.stderr: 500K .......... .......... .......... .......... .......... 0% 33.2M 11s 2024-03-04T12:49:13.257 INFO:teuthology.orchestra.run.smithi090.stderr: 550K .......... .......... .......... .......... .......... 0% 69.2M 10s 2024-03-04T12:49:13.258 INFO:teuthology.orchestra.run.smithi090.stderr: 600K .......... .......... .......... .......... .......... 0% 58.3M 10s 2024-03-04T12:49:13.259 INFO:teuthology.orchestra.run.smithi090.stderr: 650K .......... .......... .......... .......... .......... 0% 37.4M 9s 2024-03-04T12:49:13.265 INFO:teuthology.orchestra.run.smithi090.stderr: 700K .......... .......... .......... .......... .......... 0% 8.43M 9s 2024-03-04T12:49:13.268 INFO:teuthology.orchestra.run.smithi090.stderr: 750K .......... .......... .......... .......... .......... 0% 23.7M 9s 2024-03-04T12:49:13.268 INFO:teuthology.orchestra.run.smithi090.stderr: 800K .......... .......... .......... .......... .......... 0% 44.1M 8s 2024-03-04T12:49:13.274 INFO:teuthology.orchestra.run.smithi090.stderr: 850K .......... .......... .......... .......... .......... 0% 57.1M 8s 2024-03-04T12:49:13.274 INFO:teuthology.orchestra.run.smithi090.stderr: 900K .......... .......... .......... .......... .......... 1% 73.9M 8s 2024-03-04T12:49:13.274 INFO:teuthology.orchestra.run.smithi090.stderr: 950K .......... .......... .......... .......... .......... 1% 67.7M 7s 2024-03-04T12:49:13.274 INFO:teuthology.orchestra.run.smithi090.stderr: 1000K .......... .......... .......... .......... .......... 1% 61.0M 7s 2024-03-04T12:49:13.274 INFO:teuthology.orchestra.run.smithi090.stderr: 1050K .......... .......... .......... .......... .......... 1% 123M 7s 2024-03-04T12:49:13.274 INFO:teuthology.orchestra.run.smithi090.stderr: 1100K .......... .......... .......... .......... .......... 1% 62.2M 7s 2024-03-04T12:49:13.274 INFO:teuthology.orchestra.run.smithi090.stderr: 1150K .......... .......... .......... .......... .......... 1% 33.6M 6s 2024-03-04T12:49:13.278 INFO:teuthology.orchestra.run.smithi090.stderr: 1200K .......... .......... .......... .......... .......... 1% 25.3M 6s 2024-03-04T12:49:13.278 INFO:teuthology.orchestra.run.smithi090.stderr: 1250K .......... .......... .......... .......... .......... 1% 93.6M 6s 2024-03-04T12:49:13.278 INFO:teuthology.orchestra.run.smithi090.stderr: 1300K .......... .......... .......... .......... .......... 1% 113M 6s 2024-03-04T12:49:13.278 INFO:teuthology.orchestra.run.smithi090.stderr: 1350K .......... .......... .......... .......... .......... 1% 52.2M 6s 2024-03-04T12:49:13.281 INFO:teuthology.orchestra.run.smithi090.stderr: 1400K .......... .......... .......... .......... .......... 1% 27.6M 6s 2024-03-04T12:49:13.281 INFO:teuthology.orchestra.run.smithi090.stderr: 1450K .......... .......... .......... .......... .......... 1% 52.8M 6s 2024-03-04T12:49:13.281 INFO:teuthology.orchestra.run.smithi090.stderr: 1500K .......... .......... .......... .......... .......... 1% 74.4M 5s 2024-03-04T12:49:13.285 INFO:teuthology.orchestra.run.smithi090.stderr: 1550K .......... .......... .......... .......... .......... 1% 25.0M 5s 2024-03-04T12:49:13.285 INFO:teuthology.orchestra.run.smithi090.stderr: 1600K .......... .......... .......... .......... .......... 1% 67.2M 5s 2024-03-04T12:49:13.285 INFO:teuthology.orchestra.run.smithi090.stderr: 1650K .......... .......... .......... .......... .......... 1% 55.9M 5s 2024-03-04T12:49:13.306 INFO:teuthology.orchestra.run.smithi090.stderr: 1700K .......... .......... .......... .......... .......... 1% 57.8M 5s 2024-03-04T12:49:13.306 INFO:teuthology.orchestra.run.smithi090.stderr: 1750K .......... .......... .......... .......... .......... 1% 110M 5s 2024-03-04T12:49:13.306 INFO:teuthology.orchestra.run.smithi090.stderr: 1800K .......... .......... .......... .......... .......... 1% 78.3M 5s 2024-03-04T12:49:13.306 INFO:teuthology.orchestra.run.smithi090.stderr: 1850K .......... .......... .......... .......... .......... 2% 85.1M 5s 2024-03-04T12:49:13.306 INFO:teuthology.orchestra.run.smithi090.stderr: 1900K .......... .......... .......... .......... .......... 2% 48.1M 5s 2024-03-04T12:49:13.306 INFO:teuthology.orchestra.run.smithi090.stderr: 1950K .......... .......... .......... .......... .......... 2% 53.0M 4s 2024-03-04T12:49:13.306 INFO:teuthology.orchestra.run.smithi090.stderr: 2000K .......... .......... .......... .......... .......... 2% 92.0M 4s 2024-03-04T12:49:13.306 INFO:teuthology.orchestra.run.smithi090.stderr: 2050K .......... .......... .......... .......... .......... 2% 80.4M 4s 2024-03-04T12:49:13.306 INFO:teuthology.orchestra.run.smithi090.stderr: 2100K .......... .......... .......... .......... .......... 2% 85.0M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2150K .......... .......... .......... .......... .......... 2% 65.5M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2200K .......... .......... .......... .......... .......... 2% 93.5M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2250K .......... .......... .......... .......... .......... 2% 60.2M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2300K .......... .......... .......... .......... .......... 2% 70.3M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2350K .......... .......... .......... .......... .......... 2% 55.0M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2400K .......... .......... .......... .......... .......... 2% 60.3M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2450K .......... .......... .......... .......... .......... 2% 120M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2500K .......... .......... .......... .......... .......... 2% 35.5M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2550K .......... .......... .......... .......... .......... 2% 88.4M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2600K .......... .......... .......... .......... .......... 2% 84.8M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2650K .......... .......... .......... .......... .......... 2% 116M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2700K .......... .......... .......... .......... .......... 2% 84.4M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2750K .......... .......... .......... .......... .......... 3% 33.4M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2800K .......... .......... .......... .......... .......... 3% 116M 4s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2850K .......... .......... .......... .......... .......... 3% 42.5M 3s 2024-03-04T12:49:13.307 INFO:teuthology.orchestra.run.smithi090.stderr: 2900K .......... .......... .......... .......... .......... 3% 92.3M 3s 2024-03-04T12:49:13.308 INFO:teuthology.orchestra.run.smithi090.stderr: 2950K .......... .......... .......... .......... .......... 3% 54.8M 3s 2024-03-04T12:49:13.308 INFO:teuthology.orchestra.run.smithi090.stderr: 3000K .......... .......... .......... .......... .......... 3% 51.2M 3s 2024-03-04T12:49:13.308 INFO:teuthology.orchestra.run.smithi090.stderr: 3050K .......... .......... .......... .......... .......... 3% 119M 3s 2024-03-04T12:49:13.308 INFO:teuthology.orchestra.run.smithi090.stderr: 3100K .......... .......... .......... .......... .......... 3% 105M 3s 2024-03-04T12:49:14.418 INFO:teuthology.orchestra.run.smithi090.stderr: 3150K .......... .......... .......... .......... .......... 3% 28.1M 3s 2024-03-04T12:49:14.418 INFO:teuthology.orchestra.run.smithi090.stderr: 3200K .......... .......... .......... .......... .......... 3% 40.1M 3s 2024-03-04T12:49:14.418 INFO:teuthology.orchestra.run.smithi090.stderr: 3250K .......... .......... .......... .......... .......... 3% 63.9M 3s 2024-03-04T12:49:14.418 INFO:teuthology.orchestra.run.smithi090.stderr: 3300K .......... .......... .......... .......... .......... 3% 72.0M 3s 2024-03-04T12:49:14.418 INFO:teuthology.orchestra.run.smithi090.stderr: 3350K .......... .......... .......... .......... .......... 3% 111M 3s 2024-03-04T12:49:14.418 INFO:teuthology.orchestra.run.smithi090.stderr: 3400K .......... .......... .......... .......... .......... 3% 41.8M 3s 2024-03-04T12:49:14.418 INFO:teuthology.orchestra.run.smithi090.stderr: 3450K .......... .......... .......... .......... .......... 3% 69.7M 3s 2024-03-04T12:49:14.418 INFO:teuthology.orchestra.run.smithi090.stderr: 3500K .......... .......... .......... .......... .......... 3% 48.3M 3s 2024-03-04T12:49:14.419 INFO:teuthology.orchestra.run.smithi090.stderr: 3550K .......... .......... .......... .......... .......... 3% 74.0M 3s 2024-03-04T12:49:14.419 INFO:teuthology.orchestra.run.smithi090.stderr: 3600K .......... .......... .......... .......... .......... 3% 111M 3s 2024-03-04T12:49:14.419 INFO:teuthology.orchestra.run.smithi090.stderr: 3650K .......... .......... .......... .......... .......... 3% 92.1M 3s 2024-03-04T12:49:14.419 INFO:teuthology.orchestra.run.smithi090.stderr: 3700K .......... .......... .......... .......... .......... 4% 107M 3s 2024-03-04T12:49:14.419 INFO:teuthology.orchestra.run.smithi090.stderr: 3750K .......... .......... .......... .......... .......... 4% 64.2M 3s 2024-03-04T12:49:14.419 INFO:teuthology.orchestra.run.smithi090.stderr: 3800K .......... .......... .......... .......... .......... 4% 82.8M 3s 2024-03-04T12:49:14.419 INFO:teuthology.orchestra.run.smithi090.stderr: 3850K .......... .......... .......... .......... .......... 4% 114M 3s 2024-03-04T12:49:14.419 INFO:teuthology.orchestra.run.smithi090.stderr: 3900K .......... .......... .......... .......... .......... 4% 50.4M 3s 2024-03-04T12:49:14.419 INFO:teuthology.orchestra.run.smithi090.stderr: 3950K .......... .......... .......... .......... .......... 4% 72.7M 3s 2024-03-04T12:49:14.419 INFO:teuthology.orchestra.run.smithi090.stderr: 4000K .......... .......... .......... .......... .......... 4% 56.7M 3s 2024-03-04T12:49:14.419 INFO:teuthology.orchestra.run.smithi090.stderr: 4050K .......... .......... .......... .......... .......... 4% 103M 3s 2024-03-04T12:49:14.419 INFO:teuthology.orchestra.run.smithi090.stderr: 4100K .......... .......... .......... .......... .......... 4% 117M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4150K .......... .......... .......... .......... .......... 4% 70.7M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4200K .......... .......... .......... .......... .......... 4% 117M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4250K .......... .......... .......... .......... .......... 4% 96.5M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4300K .......... .......... .......... .......... .......... 4% 80.3M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4350K .......... .......... .......... .......... .......... 4% 81.7M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4400K .......... .......... .......... .......... .......... 4% 48.8M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4450K .......... .......... .......... .......... .......... 4% 52.0M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4500K .......... .......... .......... .......... .......... 4% 37.7M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4550K .......... .......... .......... .......... .......... 4% 104M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4600K .......... .......... .......... .......... .......... 5% 70.7M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4650K .......... .......... .......... .......... .......... 5% 78.4M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4700K .......... .......... .......... .......... .......... 5% 86.1M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4750K .......... .......... .......... .......... .......... 5% 61.8M 3s 2024-03-04T12:49:14.420 INFO:teuthology.orchestra.run.smithi090.stderr: 4800K .......... .......... .......... .......... .......... 5% 128M 3s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 4850K .......... .......... .......... .......... .......... 5% 72.2M 3s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 4900K .......... .......... .......... .......... .......... 5% 48.6M 3s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 4950K .......... .......... .......... .......... .......... 5% 99.4M 2s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 5000K .......... .......... .......... .......... .......... 5% 113M 2s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 5050K .......... .......... .......... .......... .......... 5% 43.2M 2s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 5100K .......... .......... .......... .......... .......... 5% 76.4M 2s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 5150K .......... .......... .......... .......... .......... 5% 42.1M 2s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 5200K .......... .......... .......... .......... .......... 5% 67.9M 2s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 5250K .......... .......... .......... .......... .......... 5% 108M 2s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 5300K .......... .......... .......... .......... .......... 5% 54.2M 2s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 5350K .......... .......... .......... .......... .......... 5% 42.8M 2s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 5400K .......... .......... .......... .......... .......... 5% 48.8M 2s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 5450K .......... .......... .......... .......... .......... 5% 101M 2s 2024-03-04T12:49:14.421 INFO:teuthology.orchestra.run.smithi090.stderr: 5500K .......... .......... .......... .......... .......... 5% 111M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 5550K .......... .......... .......... .......... .......... 6% 37.0M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 5600K .......... .......... .......... .......... .......... 6% 48.6M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 5650K .......... .......... .......... .......... .......... 6% 67.7M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 5700K .......... .......... .......... .......... .......... 6% 99.0M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 5750K .......... .......... .......... .......... .......... 6% 48.3M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 5800K .......... .......... .......... .......... .......... 6% 55.9M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 5850K .......... .......... .......... .......... .......... 6% 82.2M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 5900K .......... .......... .......... .......... .......... 6% 112M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 5950K .......... .......... .......... .......... .......... 6% 53.3M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 6000K .......... .......... .......... .......... .......... 6% 59.1M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 6050K .......... .......... .......... .......... .......... 6% 71.3M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 6100K .......... .......... .......... .......... .......... 6% 63.0M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 6150K .......... .......... .......... .......... .......... 6% 112M 2s 2024-03-04T12:49:14.422 INFO:teuthology.orchestra.run.smithi090.stderr: 6200K .......... .......... .......... .......... .......... 6% 81.2M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6250K .......... .......... .......... .......... .......... 6% 37.4M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6300K .......... .......... .......... .......... .......... 6% 60.1M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6350K .......... .......... .......... .......... .......... 6% 62.3M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6400K .......... .......... .......... .......... .......... 6% 58.4M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6450K .......... .......... .......... .......... .......... 6% 118M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6500K .......... .......... .......... .......... .......... 7% 90.7M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6550K .......... .......... .......... .......... .......... 7% 77.2M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6600K .......... .......... .......... .......... .......... 7% 107M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6650K .......... .......... .......... .......... .......... 7% 111M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6700K .......... .......... .......... .......... .......... 7% 64.0M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6750K .......... .......... .......... .......... .......... 7% 70.7M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6800K .......... .......... .......... .......... .......... 7% 50.5M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6850K .......... .......... .......... .......... .......... 7% 55.2M 2s 2024-03-04T12:49:14.423 INFO:teuthology.orchestra.run.smithi090.stderr: 6900K .......... .......... .......... .......... .......... 7% 116M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 6950K .......... .......... .......... .......... .......... 7% 51.9M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7000K .......... .......... .......... .......... .......... 7% 66.6M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7050K .......... .......... .......... .......... .......... 7% 96.5M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7100K .......... .......... .......... .......... .......... 7% 94.8M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7150K .......... .......... .......... .......... .......... 7% 65.8M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7200K .......... .......... .......... .......... .......... 7% 64.4M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7250K .......... .......... .......... .......... .......... 7% 96.1M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7300K .......... .......... .......... .......... .......... 7% 69.6M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7350K .......... .......... .......... .......... .......... 7% 115M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7400K .......... .......... .......... .......... .......... 8% 85.3M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7450K .......... .......... .......... .......... .......... 8% 68.5M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7500K .......... .......... .......... .......... .......... 8% 55.6M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7550K .......... .......... .......... .......... .......... 8% 73.0M 2s 2024-03-04T12:49:14.424 INFO:teuthology.orchestra.run.smithi090.stderr: 7600K .......... .......... .......... .......... .......... 8% 118M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 7650K .......... .......... .......... .......... .......... 8% 103M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 7700K .......... .......... .......... .......... .......... 8% 54.7M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 7750K .......... .......... .......... .......... .......... 8% 47.5M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 7800K .......... .......... .......... .......... .......... 8% 220M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 7850K .......... .......... .......... .......... .......... 8% 62.0M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 7900K .......... .......... .......... .......... .......... 8% 105M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 7950K .......... .......... .......... .......... .......... 8% 32.6M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 8000K .......... .......... .......... .......... .......... 8% 55.8M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 8050K .......... .......... .......... .......... .......... 8% 132M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 8100K .......... .......... .......... .......... .......... 8% 100M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 8150K .......... .......... .......... .......... .......... 8% 34.4M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 8200K .......... .......... .......... .......... .......... 8% 87.9M 2s 2024-03-04T12:49:14.425 INFO:teuthology.orchestra.run.smithi090.stderr: 8250K .......... .......... .......... .......... .......... 8% 113M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8300K .......... .......... .......... .......... .......... 8% 87.3M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8350K .......... .......... .......... .......... .......... 9% 54.2M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8400K .......... .......... .......... .......... .......... 9% 60.3M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8450K .......... .......... .......... .......... .......... 9% 42.4M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8500K .......... .......... .......... .......... .......... 9% 97.1M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8550K .......... .......... .......... .......... .......... 9% 62.4M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8600K .......... .......... .......... .......... .......... 9% 54.5M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8650K .......... .......... .......... .......... .......... 9% 39.6M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8700K .......... .......... .......... .......... .......... 9% 121M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8750K .......... .......... .......... .......... .......... 9% 43.1M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8800K .......... .......... .......... .......... .......... 9% 77.7M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8850K .......... .......... .......... .......... .......... 9% 110M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8900K .......... .......... .......... .......... .......... 9% 62.0M 2s 2024-03-04T12:49:14.426 INFO:teuthology.orchestra.run.smithi090.stderr: 8950K .......... .......... .......... .......... .......... 9% 114M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9000K .......... .......... .......... .......... .......... 9% 40.7M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9050K .......... .......... .......... .......... .......... 9% 66.5M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9100K .......... .......... .......... .......... .......... 9% 51.3M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9150K .......... .......... .......... .......... .......... 9% 44.2M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9200K .......... .......... .......... .......... .......... 9% 57.4M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9250K .......... .......... .......... .......... .......... 10% 113M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9300K .......... .......... .......... .......... .......... 10% 49.6M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9350K .......... .......... .......... .......... .......... 10% 52.1M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9400K .......... .......... .......... .......... .......... 10% 56.1M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9450K .......... .......... .......... .......... .......... 10% 105M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9500K .......... .......... .......... .......... .......... 10% 45.3M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9550K .......... .......... .......... .......... .......... 10% 45.5M 2s 2024-03-04T12:49:14.427 INFO:teuthology.orchestra.run.smithi090.stderr: 9600K .......... .......... .......... .......... .......... 10% 62.3M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 9650K .......... .......... .......... .......... .......... 10% 54.2M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 9700K .......... .......... .......... .......... .......... 10% 116M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 9750K .......... .......... .......... .......... .......... 10% 72.9M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 9800K .......... .......... .......... .......... .......... 10% 60.7M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 9850K .......... .......... .......... .......... .......... 10% 45.0M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 9900K .......... .......... .......... .......... .......... 10% 112M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 9950K .......... .......... .......... .......... .......... 10% 55.1M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 10000K .......... .......... .......... .......... .......... 10% 80.2M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 10050K .......... .......... .......... .......... .......... 10% 75.0M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 10100K .......... .......... .......... .......... .......... 10% 36.8M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 10150K .......... .......... .......... .......... .......... 10% 82.8M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 10200K .......... .......... .......... .......... .......... 11% 44.4M 2s 2024-03-04T12:49:14.428 INFO:teuthology.orchestra.run.smithi090.stderr: 10250K .......... .......... .......... .......... .......... 11% 51.1M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10300K .......... .......... .......... .......... .......... 11% 71.8M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10350K .......... .......... .......... .......... .......... 11% 44.5M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10400K .......... .......... .......... .......... .......... 11% 116M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10450K .......... .......... .......... .......... .......... 11% 64.0M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10500K .......... .......... .......... .......... .......... 11% 65.8M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10550K .......... .......... .......... .......... .......... 11% 65.3M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10600K .......... .......... .......... .......... .......... 11% 114M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10650K .......... .......... .......... .......... .......... 11% 64.5M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10700K .......... .......... .......... .......... .......... 11% 82.0M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10750K .......... .......... .......... .......... .......... 11% 77.9M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10800K .......... .......... .......... .......... .......... 11% 57.6M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10850K .......... .......... .......... .......... .......... 11% 117M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10900K .......... .......... .......... .......... .......... 11% 76.4M 2s 2024-03-04T12:49:14.429 INFO:teuthology.orchestra.run.smithi090.stderr: 10950K .......... .......... .......... .......... .......... 11% 71.6M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11000K .......... .......... .......... .......... .......... 11% 79.3M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11050K .......... .......... .......... .......... .......... 11% 109M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11100K .......... .......... .......... .......... .......... 12% 72.1M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11150K .......... .......... .......... .......... .......... 12% 11.2M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11200K .......... .......... .......... .......... .......... 12% 109M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11250K .......... .......... .......... .......... .......... 12% 333M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11300K .......... .......... .......... .......... .......... 12% 374M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11350K .......... .......... .......... .......... .......... 12% 225M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11400K .......... .......... .......... .......... .......... 12% 242M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11450K .......... .......... .......... .......... .......... 12% 263M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11500K .......... .......... .......... .......... .......... 12% 151M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11550K .......... .......... .......... .......... .......... 12% 69.6M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11600K .......... .......... .......... .......... .......... 12% 97.2M 2s 2024-03-04T12:49:14.430 INFO:teuthology.orchestra.run.smithi090.stderr: 11650K .......... .......... .......... .......... .......... 12% 102M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 11700K .......... .......... .......... .......... .......... 12% 43.2M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 11750K .......... .......... .......... .......... .......... 12% 53.9M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 11800K .......... .......... .......... .......... .......... 12% 107M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 11850K .......... .......... .......... .......... .......... 12% 84.5M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 11900K .......... .......... .......... .......... .......... 12% 57.4M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 11950K .......... .......... .......... .......... .......... 12% 48.3M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 12000K .......... .......... .......... .......... .......... 12% 51.4M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 12050K .......... .......... .......... .......... .......... 13% 117M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 12100K .......... .......... .......... .......... .......... 13% 50.4M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 12150K .......... .......... .......... .......... .......... 13% 92.3M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 12200K .......... .......... .......... .......... .......... 13% 63.5M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 12250K .......... .......... .......... .......... .......... 13% 124M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 12300K .......... .......... .......... .......... .......... 13% 44.4M 2s 2024-03-04T12:49:14.431 INFO:teuthology.orchestra.run.smithi090.stderr: 12350K .......... .......... .......... .......... .......... 13% 43.7M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 12400K .......... .......... .......... .......... .......... 13% 119M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 12450K .......... .......... .......... .......... .......... 13% 50.3M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 12500K .......... .......... .......... .......... .......... 13% 121M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 12550K .......... .......... .......... .......... .......... 13% 42.1M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 12600K .......... .......... .......... .......... .......... 13% 96.4M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 12650K .......... .......... .......... .......... .......... 13% 58.2M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 12700K .......... .......... .......... .......... .......... 13% 119M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 12750K .......... .......... .......... .......... .......... 13% 37.2M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 12800K .......... .......... .......... .......... .......... 13% 48.7M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 12850K .......... .......... .......... .......... .......... 13% 84.1M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 12900K .......... .......... .......... .......... .......... 13% 61.2M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 12950K .......... .......... .......... .......... .......... 13% 108M 2s 2024-03-04T12:49:14.432 INFO:teuthology.orchestra.run.smithi090.stderr: 13000K .......... .......... .......... .......... .......... 14% 72.3M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13050K .......... .......... .......... .......... .......... 14% 36.1M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13100K .......... .......... .......... .......... .......... 14% 61.6M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13150K .......... .......... .......... .......... .......... 14% 74.8M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13200K .......... .......... .......... .......... .......... 14% 114M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13250K .......... .......... .......... .......... .......... 14% 90.9M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13300K .......... .......... .......... .......... .......... 14% 74.7M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13350K .......... .......... .......... .......... .......... 14% 62.0M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13400K .......... .......... .......... .......... .......... 14% 115M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13450K .......... .......... .......... .......... .......... 14% 58.6M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13500K .......... .......... .......... .......... .......... 14% 23.4M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13550K .......... .......... .......... .......... .......... 14% 36.3M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13600K .......... .......... .......... .......... .......... 14% 83.2M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13650K .......... .......... .......... .......... .......... 14% 104M 2s 2024-03-04T12:49:14.433 INFO:teuthology.orchestra.run.smithi090.stderr: 13700K .......... .......... .......... .......... .......... 14% 51.9M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 13750K .......... .......... .......... .......... .......... 14% 57.9M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 13800K .......... .......... .......... .......... .......... 14% 66.3M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 13850K .......... .......... .......... .......... .......... 14% 110M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 13900K .......... .......... .......... .......... .......... 15% 66.9M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 13950K .......... .......... .......... .......... .......... 15% 48.9M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 14000K .......... .......... .......... .......... .......... 15% 65.9M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 14050K .......... .......... .......... .......... .......... 15% 107M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 14100K .......... .......... .......... .......... .......... 15% 115M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 14150K .......... .......... .......... .......... .......... 15% 74.8M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 14200K .......... .......... .......... .......... .......... 15% 78.5M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 14250K .......... .......... .......... .......... .......... 15% 60.6M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 14300K .......... .......... .......... .......... .......... 15% 116M 2s 2024-03-04T12:49:14.434 INFO:teuthology.orchestra.run.smithi090.stderr: 14350K .......... .......... .......... .......... .......... 15% 75.3M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 14400K .......... .......... .......... .......... .......... 15% 90.2M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 14450K .......... .......... .......... .......... .......... 15% 111M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 14500K .......... .......... .......... .......... .......... 15% 105M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 14550K .......... .......... .......... .......... .......... 15% 103M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 14600K .......... .......... .......... .......... .......... 15% 111M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 14650K .......... .......... .......... .......... .......... 15% 86.8M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 14700K .......... .......... .......... .......... .......... 15% 97.9M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 14750K .......... .......... .......... .......... .......... 15% 76.4M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 14800K .......... .......... .......... .......... .......... 15% 44.7M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 14850K .......... .......... .......... .......... .......... 16% 114M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 14900K .......... .......... .......... .......... .......... 16% 93.4M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 14950K .......... .......... .......... .......... .......... 16% 55.6M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 15000K .......... .......... .......... .......... .......... 16% 57.3M 2s 2024-03-04T12:49:14.435 INFO:teuthology.orchestra.run.smithi090.stderr: 15050K .......... .......... .......... .......... .......... 16% 111M 1s 2024-03-04T12:49:14.436 INFO:teuthology.orchestra.run.smithi090.stderr: 15100K .......... .......... .......... .......... .......... 16% 62.1M 1s 2024-03-04T12:49:14.436 INFO:teuthology.orchestra.run.smithi090.stderr: 15150K .......... .......... .......... .......... .......... 16% 49.9M 1s 2024-03-04T12:49:14.436 INFO:teuthology.orchestra.run.smithi090.stderr: 15200K .......... .......... .......... .......... .......... 16% 31.4M 1s 2024-03-04T12:49:14.436 INFO:teuthology.orchestra.run.smithi090.stderr: 15250K .......... .......... .......... .......... .......... 16% 42.7M 1s 2024-03-04T12:49:14.436 INFO:teuthology.orchestra.run.smithi090.stderr: 15300K .......... .......... .......... .......... .......... 16% 99.6M 1s 2024-03-04T12:49:14.436 INFO:teuthology.orchestra.run.smithi090.stderr: 15350K .......... .......... .......... .......... .......... 16% 46.9M 1s 2024-03-04T12:49:14.436 INFO:teuthology.orchestra.run.smithi090.stderr: 15400K .......... .......... .......... .......... .......... 16% 53.1M 1s 2024-03-04T12:49:14.436 INFO:teuthology.orchestra.run.smithi090.stderr: 15450K .......... .......... .......... .......... .......... 16% 55.6M 1s 2024-03-04T12:49:14.436 INFO:teuthology.orchestra.run.smithi090.stderr: 15500K .......... .......... .......... .......... .......... 16% 79.2M 1s 2024-03-04T12:49:14.436 INFO:teuthology.orchestra.run.smithi090.stderr: 15550K .......... .......... .......... .......... .......... 16% 41.4M 1s 2024-03-04T12:49:14.436 INFO:teuthology.orchestra.run.smithi090.stderr: 15600K .......... .......... .......... .......... .......... 16% 44.1M 1s 2024-03-04T12:49:14.436 INFO:teuthology.orchestra.run.smithi090.stderr: 15650K .......... .......... .......... .......... .......... 16% 84.4M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 15700K .......... .......... .......... .......... .......... 16% 42.6M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 15750K .......... .......... .......... .......... .......... 17% 103M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 15800K .......... .......... .......... .......... .......... 17% 52.4M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 15850K .......... .......... .......... .......... .......... 17% 50.4M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 15900K .......... .......... .......... .......... .......... 17% 28.7M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 15950K .......... .......... .......... .......... .......... 17% 28.6M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 16000K .......... .......... .......... .......... .......... 17% 83.2M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 16050K .......... .......... .......... .......... .......... 17% 68.3M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 16100K .......... .......... .......... .......... .......... 17% 44.7M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 16150K .......... .......... .......... .......... .......... 17% 59.7M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 16200K .......... .......... .......... .......... .......... 17% 114M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 16250K .......... .......... .......... .......... .......... 17% 94.1M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 16300K .......... .......... .......... .......... .......... 17% 88.4M 1s 2024-03-04T12:49:14.437 INFO:teuthology.orchestra.run.smithi090.stderr: 16350K .......... .......... .......... .......... .......... 17% 53.1M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 16400K .......... .......... .......... .......... .......... 17% 59.0M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 16450K .......... .......... .......... .......... .......... 17% 108M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 16500K .......... .......... .......... .......... .......... 17% 93.0M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 16550K .......... .......... .......... .......... .......... 17% 96.9M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 16600K .......... .......... .......... .......... .......... 17% 81.3M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 16650K .......... .......... .......... .......... .......... 17% 114M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 16700K .......... .......... .......... .......... .......... 18% 88.7M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 16750K .......... .......... .......... .......... .......... 18% 76.9M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 16800K .......... .......... .......... .......... .......... 18% 106M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 16850K .......... .......... .......... .......... .......... 18% 84.9M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 16900K .......... .......... .......... .......... .......... 18% 111M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 16950K .......... .......... .......... .......... .......... 18% 57.0M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 17000K .......... .......... .......... .......... .......... 18% 69.8M 1s 2024-03-04T12:49:14.438 INFO:teuthology.orchestra.run.smithi090.stderr: 17050K .......... .......... .......... .......... .......... 18% 47.4M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17100K .......... .......... .......... .......... .......... 18% 49.4M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17150K .......... .......... .......... .......... .......... 18% 67.3M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17200K .......... .......... .......... .......... .......... 18% 90.9M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17250K .......... .......... .......... .......... .......... 18% 84.3M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17300K .......... .......... .......... .......... .......... 18% 90.5M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17350K .......... .......... .......... .......... .......... 18% 109M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17400K .......... .......... .......... .......... .......... 18% 115M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17450K .......... .......... .......... .......... .......... 18% 60.7M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17500K .......... .......... .......... .......... .......... 18% 68.6M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17550K .......... .......... .......... .......... .......... 18% 53.9M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17600K .......... .......... .......... .......... .......... 18% 46.4M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17650K .......... .......... .......... .......... .......... 19% 106M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17700K .......... .......... .......... .......... .......... 19% 41.3M 1s 2024-03-04T12:49:14.439 INFO:teuthology.orchestra.run.smithi090.stderr: 17750K .......... .......... .......... .......... .......... 19% 66.3M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 17800K .......... .......... .......... .......... .......... 19% 78.3M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 17850K .......... .......... .......... .......... .......... 19% 118M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 17900K .......... .......... .......... .......... .......... 19% 80.0M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 17950K .......... .......... .......... .......... .......... 19% 35.5M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 18000K .......... .......... .......... .......... .......... 19% 71.5M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 18050K .......... .......... .......... .......... .......... 19% 111M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 18100K .......... .......... .......... .......... .......... 19% 120M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 18150K .......... .......... .......... .......... .......... 19% 51.5M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 18200K .......... .......... .......... .......... .......... 19% 69.7M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 18250K .......... .......... .......... .......... .......... 19% 63.1M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 18300K .......... .......... .......... .......... .......... 19% 119M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 18350K .......... .......... .......... .......... .......... 19% 35.6M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 18400K .......... .......... .......... .......... .......... 19% 77.0M 1s 2024-03-04T12:49:14.440 INFO:teuthology.orchestra.run.smithi090.stderr: 18450K .......... .......... .......... .......... .......... 19% 77.3M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 18500K .......... .......... .......... .......... .......... 19% 35.7M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 18550K .......... .......... .......... .......... .......... 20% 110M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 18600K .......... .......... .......... .......... .......... 20% 59.6M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 18650K .......... .......... .......... .......... .......... 20% 84.6M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 18700K .......... .......... .......... .......... .......... 20% 74.1M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 18750K .......... .......... .......... .......... .......... 20% 48.3M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 18800K .......... .......... .......... .......... .......... 20% 116M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 18850K .......... .......... .......... .......... .......... 20% 57.5M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 18900K .......... .......... .......... .......... .......... 20% 94.2M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 18950K .......... .......... .......... .......... .......... 20% 107M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 19000K .......... .......... .......... .......... .......... 20% 116M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 19050K .......... .......... .......... .......... .......... 20% 34.5M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 19100K .......... .......... .......... .......... .......... 20% 98.9M 1s 2024-03-04T12:49:14.441 INFO:teuthology.orchestra.run.smithi090.stderr: 19150K .......... .......... .......... .......... .......... 20% 39.0M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19200K .......... .......... .......... .......... .......... 20% 109M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19250K .......... .......... .......... .......... .......... 20% 102M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19300K .......... .......... .......... .......... .......... 20% 120M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19350K .......... .......... .......... .......... .......... 20% 95.3M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19400K .......... .......... .......... .......... .......... 20% 57.3M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19450K .......... .......... .......... .......... .......... 20% 121M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19500K .......... .......... .......... .......... .......... 21% 80.6M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19550K .......... .......... .......... .......... .......... 21% 45.3M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19600K .......... .......... .......... .......... .......... 21% 53.2M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19650K .......... .......... .......... .......... .......... 21% 105M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19700K .......... .......... .......... .......... .......... 21% 118M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19750K .......... .......... .......... .......... .......... 21% 94.5M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19800K .......... .......... .......... .......... .......... 21% 64.8M 1s 2024-03-04T12:49:14.442 INFO:teuthology.orchestra.run.smithi090.stderr: 19850K .......... .......... .......... .......... .......... 21% 39.5M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 19900K .......... .......... .......... .......... .......... 21% 79.3M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 19950K .......... .......... .......... .......... .......... 21% 68.1M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 20000K .......... .......... .......... .......... .......... 21% 114M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 20050K .......... .......... .......... .......... .......... 21% 47.6M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 20100K .......... .......... .......... .......... .......... 21% 37.6M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 20150K .......... .......... .......... .......... .......... 21% 42.2M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 20200K .......... .......... .......... .......... .......... 21% 96.2M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 20250K .......... .......... .......... .......... .......... 21% 93.9M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 20300K .......... .......... .......... .......... .......... 21% 59.4M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 20350K .......... .......... .......... .......... .......... 21% 50.4M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 20400K .......... .......... .......... .......... .......... 22% 61.5M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 20450K .......... .......... .......... .......... .......... 22% 106M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 20500K .......... .......... .......... .......... .......... 22% 84.0M 1s 2024-03-04T12:49:14.443 INFO:teuthology.orchestra.run.smithi090.stderr: 20550K .......... .......... .......... .......... .......... 22% 49.6M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 20600K .......... .......... .......... .......... .......... 22% 84.1M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 20650K .......... .......... .......... .......... .......... 22% 117M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 20700K .......... .......... .......... .......... .......... 22% 36.2M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 20750K .......... .......... .......... .......... .......... 22% 38.9M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 20800K .......... .......... .......... .......... .......... 22% 62.5M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 20850K .......... .......... .......... .......... .......... 22% 58.7M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 20900K .......... .......... .......... .......... .......... 22% 106M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 20950K .......... .......... .......... .......... .......... 22% 38.4M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 21000K .......... .......... .......... .......... .......... 22% 75.7M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 21050K .......... .......... .......... .......... .......... 22% 52.1M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 21100K .......... .......... .......... .......... .......... 22% 113M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 21150K .......... .......... .......... .......... .......... 22% 40.9M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 21200K .......... .......... .......... .......... .......... 22% 61.9M 1s 2024-03-04T12:49:14.444 INFO:teuthology.orchestra.run.smithi090.stderr: 21250K .......... .......... .......... .......... .......... 22% 77.4M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21300K .......... .......... .......... .......... .......... 22% 46.3M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21350K .......... .......... .......... .......... .......... 23% 110M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21400K .......... .......... .......... .......... .......... 23% 66.7M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21450K .......... .......... .......... .......... .......... 23% 55.1M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21500K .......... .......... .......... .......... .......... 23% 76.7M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21550K .......... .......... .......... .......... .......... 23% 62.8M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21600K .......... .......... .......... .......... .......... 23% 105M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21650K .......... .......... .......... .......... .......... 23% 88.7M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21700K .......... .......... .......... .......... .......... 23% 86.1M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21750K .......... .......... .......... .......... .......... 23% 98.8M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21800K .......... .......... .......... .......... .......... 23% 117M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21850K .......... .......... .......... .......... .......... 23% 97.4M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21900K .......... .......... .......... .......... .......... 23% 71.6M 1s 2024-03-04T12:49:14.445 INFO:teuthology.orchestra.run.smithi090.stderr: 21950K .......... .......... .......... .......... .......... 23% 66.5M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22000K .......... .......... .......... .......... .......... 23% 72.5M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22050K .......... .......... .......... .......... .......... 23% 90.4M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22100K .......... .......... .......... .......... .......... 23% 85.7M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22150K .......... .......... .......... .......... .......... 23% 58.9M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22200K .......... .......... .......... .......... .......... 23% 56.6M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22250K .......... .......... .......... .......... .......... 24% 116M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22300K .......... .......... .......... .......... .......... 24% 31.9M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22350K .......... .......... .......... .......... .......... 24% 49.6M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22400K .......... .......... .......... .......... .......... 24% 48.4M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22450K .......... .......... .......... .......... .......... 24% 41.7M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22500K .......... .......... .......... .......... .......... 24% 27.8M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22550K .......... .......... .......... .......... .......... 24% 103M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22600K .......... .......... .......... .......... .......... 24% 33.7M 1s 2024-03-04T12:49:14.446 INFO:teuthology.orchestra.run.smithi090.stderr: 22650K .......... .......... .......... .......... .......... 24% 166M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 22700K .......... .......... .......... .......... .......... 24% 39.1M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 22750K .......... .......... .......... .......... .......... 24% 74.0M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 22800K .......... .......... .......... .......... .......... 24% 120M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 22850K .......... .......... .......... .......... .......... 24% 58.5M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 22900K .......... .......... .......... .......... .......... 24% 69.1M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 22950K .......... .......... .......... .......... .......... 24% 59.7M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 23000K .......... .......... .......... .......... .......... 24% 120M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 23050K .......... .......... .......... .......... .......... 24% 74.6M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 23100K .......... .......... .......... .......... .......... 24% 36.6M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 23150K .......... .......... .......... .......... .......... 24% 63.1M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 23200K .......... .......... .......... .......... .......... 25% 58.9M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 23250K .......... .......... .......... .......... .......... 25% 115M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 23300K .......... .......... .......... .......... .......... 25% 56.5M 1s 2024-03-04T12:49:14.447 INFO:teuthology.orchestra.run.smithi090.stderr: 23350K .......... .......... .......... .......... .......... 25% 59.2M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 23400K .......... .......... .......... .......... .......... 25% 60.0M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 23450K .......... .......... .......... .......... .......... 25% 120M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 23500K .......... .......... .......... .......... .......... 25% 48.7M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 23550K .......... .......... .......... .......... .......... 25% 47.8M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 23600K .......... .......... .......... .......... .......... 25% 98.9M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 23650K .......... .......... .......... .......... .......... 25% 77.3M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 23700K .......... .......... .......... .......... .......... 25% 110M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 23750K .......... .......... .......... .......... .......... 25% 88.9M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 23800K .......... .......... .......... .......... .......... 25% 73.4M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 23850K .......... .......... .......... .......... .......... 25% 82.5M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 23900K .......... .......... .......... .......... .......... 25% 116M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 23950K .......... .......... .......... .......... .......... 25% 74.6M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 24000K .......... .......... .......... .......... .......... 25% 69.1M 1s 2024-03-04T12:49:14.448 INFO:teuthology.orchestra.run.smithi090.stderr: 24050K .......... .......... .......... .......... .......... 25% 83.6M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24100K .......... .......... .......... .......... .......... 25% 79.4M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24150K .......... .......... .......... .......... .......... 26% 115M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24200K .......... .......... .......... .......... .......... 26% 71.3M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24250K .......... .......... .......... .......... .......... 26% 68.7M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24300K .......... .......... .......... .......... .......... 26% 80.1M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24350K .......... .......... .......... .......... .......... 26% 55.8M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24400K .......... .......... .......... .......... .......... 26% 112M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24450K .......... .......... .......... .......... .......... 26% 67.1M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24500K .......... .......... .......... .......... .......... 26% 55.5M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24550K .......... .......... .......... .......... .......... 26% 70.6M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24600K .......... .......... .......... .......... .......... 26% 104M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24650K .......... .......... .......... .......... .......... 26% 47.7M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24700K .......... .......... .......... .......... .......... 26% 44.5M 1s 2024-03-04T12:49:14.449 INFO:teuthology.orchestra.run.smithi090.stderr: 24750K .......... .......... .......... .......... .......... 26% 43.6M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 24800K .......... .......... .......... .......... .......... 26% 50.6M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 24850K .......... .......... .......... .......... .......... 26% 119M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 24900K .......... .......... .......... .......... .......... 26% 65.1M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 24950K .......... .......... .......... .......... .......... 26% 40.5M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 25000K .......... .......... .......... .......... .......... 26% 49.4M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 25050K .......... .......... .......... .......... .......... 27% 120M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 25100K .......... .......... .......... .......... .......... 27% 80.1M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 25150K .......... .......... .......... .......... .......... 27% 53.3M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 25200K .......... .......... .......... .......... .......... 27% 92.3M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 25250K .......... .......... .......... .......... .......... 27% 60.5M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 25300K .......... .......... .......... .......... .......... 27% 83.6M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 25350K .......... .......... .......... .......... .......... 27% 111M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 25400K .......... .......... .......... .......... .......... 27% 98.2M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 25450K .......... .......... .......... .......... .......... 27% 97.3M 1s 2024-03-04T12:49:14.450 INFO:teuthology.orchestra.run.smithi090.stderr: 25500K .......... .......... .......... .......... .......... 27% 58.3M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 25550K .......... .......... .......... .......... .......... 27% 84.0M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 25600K .......... .......... .......... .......... .......... 27% 109M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 25650K .......... .......... .......... .......... .......... 27% 56.1M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 25700K .......... .......... .......... .......... .......... 27% 56.9M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 25750K .......... .......... .......... .......... .......... 27% 39.9M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 25800K .......... .......... .......... .......... .......... 27% 105M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 25850K .......... .......... .......... .......... .......... 27% 61.4M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 25900K .......... .......... .......... .......... .......... 27% 48.7M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 25950K .......... .......... .......... .......... .......... 27% 55.3M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 26000K .......... .......... .......... .......... .......... 28% 92.2M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 26050K .......... .......... .......... .......... .......... 28% 115M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 26100K .......... .......... .......... .......... .......... 28% 53.0M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 26150K .......... .......... .......... .......... .......... 28% 55.1M 1s 2024-03-04T12:49:14.451 INFO:teuthology.orchestra.run.smithi090.stderr: 26200K .......... .......... .......... .......... .......... 28% 82.3M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26250K .......... .......... .......... .......... .......... 28% 114M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26300K .......... .......... .......... .......... .......... 28% 83.2M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26350K .......... .......... .......... .......... .......... 28% 78.6M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26400K .......... .......... .......... .......... .......... 28% 93.2M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26450K .......... .......... .......... .......... .......... 28% 45.5M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26500K .......... .......... .......... .......... .......... 28% 86.7M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26550K .......... .......... .......... .......... .......... 28% 34.8M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26600K .......... .......... .......... .......... .......... 28% 47.7M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26650K .......... .......... .......... .......... .......... 28% 55.4M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26700K .......... .......... .......... .......... .......... 28% 118M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26750K .......... .......... .......... .......... .......... 28% 43.7M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26800K .......... .......... .......... .......... .......... 28% 52.1M 1s 2024-03-04T12:49:14.452 INFO:teuthology.orchestra.run.smithi090.stderr: 26850K .......... .......... .......... .......... .......... 28% 48.7M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 26900K .......... .......... .......... .......... .......... 29% 53.2M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 26950K .......... .......... .......... .......... .......... 29% 111M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 27000K .......... .......... .......... .......... .......... 29% 51.6M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 27050K .......... .......... .......... .......... .......... 29% 48.9M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 27100K .......... .......... .......... .......... .......... 29% 45.4M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 27150K .......... .......... .......... .......... .......... 29% 45.5M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 27200K .......... .......... .......... .......... .......... 29% 99.4M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 27250K .......... .......... .......... .......... .......... 29% 45.9M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 27300K .......... .......... .......... .......... .......... 29% 59.2M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 27350K .......... .......... .......... .......... .......... 29% 56.4M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 27400K .......... .......... .......... .......... .......... 29% 117M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 27450K .......... .......... .......... .......... .......... 29% 51.2M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 27500K .......... .......... .......... .......... .......... 29% 65.1M 1s 2024-03-04T12:49:14.453 INFO:teuthology.orchestra.run.smithi090.stderr: 27550K .......... .......... .......... .......... .......... 29% 47.0M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 27600K .......... .......... .......... .......... .......... 29% 72.1M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 27650K .......... .......... .......... .......... .......... 29% 82.1M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 27700K .......... .......... .......... .......... .......... 29% 60.6M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 27750K .......... .......... .......... .......... .......... 29% 52.9M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 27800K .......... .......... .......... .......... .......... 29% 94.7M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 27850K .......... .......... .......... .......... .......... 30% 56.9M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 27900K .......... .......... .......... .......... .......... 30% 115M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 27950K .......... .......... .......... .......... .......... 30% 58.7M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 28000K .......... .......... .......... .......... .......... 30% 96.0M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 28050K .......... .......... .......... .......... .......... 30% 71.5M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 28100K .......... .......... .......... .......... .......... 30% 50.6M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 28150K .......... .......... .......... .......... .......... 30% 117M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 28200K .......... .......... .......... .......... .......... 30% 38.0M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 28250K .......... .......... .......... .......... .......... 30% 43.7M 1s 2024-03-04T12:49:14.454 INFO:teuthology.orchestra.run.smithi090.stderr: 28300K .......... .......... .......... .......... .......... 30% 75.1M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28350K .......... .......... .......... .......... .......... 30% 47.6M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28400K .......... .......... .......... .......... .......... 30% 111M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28450K .......... .......... .......... .......... .......... 30% 94.1M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28500K .......... .......... .......... .......... .......... 30% 72.8M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28550K .......... .......... .......... .......... .......... 30% 52.4M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28600K .......... .......... .......... .......... .......... 30% 121M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28650K .......... .......... .......... .......... .......... 30% 102M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28700K .......... .......... .......... .......... .......... 30% 104M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28750K .......... .......... .......... .......... .......... 31% 93.2M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28800K .......... .......... .......... .......... .......... 31% 77.8M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28850K .......... .......... .......... .......... .......... 31% 119M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28900K .......... .......... .......... .......... .......... 31% 59.7M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 28950K .......... .......... .......... .......... .......... 31% 76.6M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 29000K .......... .......... .......... .......... .......... 31% 44.1M 1s 2024-03-04T12:49:14.455 INFO:teuthology.orchestra.run.smithi090.stderr: 29050K .......... .......... .......... .......... .......... 31% 112M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29100K .......... .......... .......... .......... .......... 31% 107M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29150K .......... .......... .......... .......... .......... 31% 64.2M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29200K .......... .......... .......... .......... .......... 31% 47.3M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29250K .......... .......... .......... .......... .......... 31% 45.2M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29300K .......... .......... .......... .......... .......... 31% 119M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29350K .......... .......... .......... .......... .......... 31% 53.3M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29400K .......... .......... .......... .......... .......... 31% 42.0M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29450K .......... .......... .......... .......... .......... 31% 69.6M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29500K .......... .......... .......... .......... .......... 31% 120M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29550K .......... .......... .......... .......... .......... 31% 38.4M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29600K .......... .......... .......... .......... .......... 31% 44.0M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29650K .......... .......... .......... .......... .......... 31% 64.8M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29700K .......... .......... .......... .......... .......... 32% 102M 1s 2024-03-04T12:49:14.456 INFO:teuthology.orchestra.run.smithi090.stderr: 29750K .......... .......... .......... .......... .......... 32% 110M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 29800K .......... .......... .......... .......... .......... 32% 76.2M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 29850K .......... .......... .......... .......... .......... 32% 60.3M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 29900K .......... .......... .......... .......... .......... 32% 56.2M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 29950K .......... .......... .......... .......... .......... 32% 118M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 30000K .......... .......... .......... .......... .......... 32% 57.8M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 30050K .......... .......... .......... .......... .......... 32% 48.0M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 30100K .......... .......... .......... .......... .......... 32% 61.9M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 30150K .......... .......... .......... .......... .......... 32% 42.5M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 30200K .......... .......... .......... .......... .......... 32% 86.2M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 30250K .......... .......... .......... .......... .......... 32% 108M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 30300K .......... .......... .......... .......... .......... 32% 43.3M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 30350K .......... .......... .......... .......... .......... 32% 67.1M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 30400K .......... .......... .......... .......... .......... 32% 94.1M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 30450K .......... .......... .......... .......... .......... 32% 83.1M 1s 2024-03-04T12:49:14.457 INFO:teuthology.orchestra.run.smithi090.stderr: 30500K .......... .......... .......... .......... .......... 32% 124M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 30550K .......... .......... .......... .......... .......... 32% 63.8M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 30600K .......... .......... .......... .......... .......... 32% 58.0M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 30650K .......... .......... .......... .......... .......... 33% 54.9M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 30700K .......... .......... .......... .......... .......... 33% 100M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 30750K .......... .......... .......... .......... .......... 33% 55.2M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 30800K .......... .......... .......... .......... .......... 33% 57.4M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 30850K .......... .......... .......... .......... .......... 33% 66.4M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 30900K .......... .......... .......... .......... .......... 33% 70.5M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 30950K .......... .......... .......... .......... .......... 33% 110M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 31000K .......... .......... .......... .......... .......... 33% 47.6M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 31050K .......... .......... .......... .......... .......... 33% 116M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 31100K .......... .......... .......... .......... .......... 33% 48.9M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 31150K .......... .......... .......... .......... .......... 33% 115M 1s 2024-03-04T12:49:14.458 INFO:teuthology.orchestra.run.smithi090.stderr: 31200K .......... .......... .......... .......... .......... 33% 83.4M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31250K .......... .......... .......... .......... .......... 33% 80.4M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31300K .......... .......... .......... .......... .......... 33% 76.1M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31350K .......... .......... .......... .......... .......... 33% 48.6M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31400K .......... .......... .......... .......... .......... 33% 118M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31450K .......... .......... .......... .......... .......... 33% 54.1M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31500K .......... .......... .......... .......... .......... 33% 80.8M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31550K .......... .......... .......... .......... .......... 34% 72.4M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31600K .......... .......... .......... .......... .......... 34% 105M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31650K .......... .......... .......... .......... .......... 34% 52.8M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31700K .......... .......... .......... .......... .......... 34% 66.2M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31750K .......... .......... .......... .......... .......... 34% 74.4M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31800K .......... .......... .......... .......... .......... 34% 38.1M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31850K .......... .......... .......... .......... .......... 34% 74.3M 1s 2024-03-04T12:49:14.459 INFO:teuthology.orchestra.run.smithi090.stderr: 31900K .......... .......... .......... .......... .......... 34% 94.6M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 31950K .......... .......... .......... .......... .......... 34% 51.6M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 32000K .......... .......... .......... .......... .......... 34% 59.1M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 32050K .......... .......... .......... .......... .......... 34% 66.5M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 32100K .......... .......... .......... .......... .......... 34% 108M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 32150K .......... .......... .......... .......... .......... 34% 68.1M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 32200K .......... .......... .......... .......... .......... 34% 64.9M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 32250K .......... .......... .......... .......... .......... 34% 106M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 32300K .......... .......... .......... .......... .......... 34% 118M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 32350K .......... .......... .......... .......... .......... 34% 109M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 32400K .......... .......... .......... .......... .......... 34% 62.6M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 32450K .......... .......... .......... .......... .......... 34% 29.6M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 32500K .......... .......... .......... .......... .......... 35% 74.5M 1s 2024-03-04T12:49:14.460 INFO:teuthology.orchestra.run.smithi090.stderr: 32550K .......... .......... .......... .......... .......... 35% 120M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 32600K .......... .......... .......... .......... .......... 35% 62.5M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 32650K .......... .......... .......... .......... .......... 35% 85.9M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 32700K .......... .......... .......... .......... .......... 35% 54.4M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 32750K .......... .......... .......... .......... .......... 35% 106M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 32800K .......... .......... .......... .......... .......... 35% 109M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 32850K .......... .......... .......... .......... .......... 35% 46.1M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 32900K .......... .......... .......... .......... .......... 35% 63.5M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 32950K .......... .......... .......... .......... .......... 35% 51.4M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 33000K .......... .......... .......... .......... .......... 35% 54.8M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 33050K .......... .......... .......... .......... .......... 35% 89.3M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 33100K .......... .......... .......... .......... .......... 35% 49.4M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 33150K .......... .......... .......... .......... .......... 35% 34.7M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 33200K .......... .......... .......... .......... .......... 35% 39.3M 1s 2024-03-04T12:49:14.461 INFO:teuthology.orchestra.run.smithi090.stderr: 33250K .......... .......... .......... .......... .......... 35% 28.1M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33300K .......... .......... .......... .......... .......... 35% 116M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33350K .......... .......... .......... .......... .......... 35% 52.8M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33400K .......... .......... .......... .......... .......... 36% 47.8M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33450K .......... .......... .......... .......... .......... 36% 63.4M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33500K .......... .......... .......... .......... .......... 36% 124M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33550K .......... .......... .......... .......... .......... 36% 39.5M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33600K .......... .......... .......... .......... .......... 36% 71.8M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33650K .......... .......... .......... .......... .......... 36% 59.2M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33700K .......... .......... .......... .......... .......... 36% 46.1M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33750K .......... .......... .......... .......... .......... 36% 112M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33800K .......... .......... .......... .......... .......... 36% 38.5M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33850K .......... .......... .......... .......... .......... 36% 95.8M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33900K .......... .......... .......... .......... .......... 36% 50.8M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 33950K .......... .......... .......... .......... .......... 36% 119M 1s 2024-03-04T12:49:14.462 INFO:teuthology.orchestra.run.smithi090.stderr: 34000K .......... .......... .......... .......... .......... 36% 57.3M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34050K .......... .......... .......... .......... .......... 36% 51.8M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34100K .......... .......... .......... .......... .......... 36% 85.8M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34150K .......... .......... .......... .......... .......... 36% 65.9M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34200K .......... .......... .......... .......... .......... 36% 116M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34250K .......... .......... .......... .......... .......... 36% 38.9M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34300K .......... .......... .......... .......... .......... 36% 71.9M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34350K .......... .......... .......... .......... .......... 37% 49.1M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34400K .......... .......... .......... .......... .......... 37% 110M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34450K .......... .......... .......... .......... .......... 37% 85.2M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34500K .......... .......... .......... .......... .......... 37% 83.9M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34550K .......... .......... .......... .......... .......... 37% 81.8M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34600K .......... .......... .......... .......... .......... 37% 58.6M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34650K .......... .......... .......... .......... .......... 37% 117M 1s 2024-03-04T12:49:14.463 INFO:teuthology.orchestra.run.smithi090.stderr: 34700K .......... .......... .......... .......... .......... 37% 76.8M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 34750K .......... .......... .......... .......... .......... 37% 60.7M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 34800K .......... .......... .......... .......... .......... 37% 78.5M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 34850K .......... .......... .......... .......... .......... 37% 61.7M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 34900K .......... .......... .......... .......... .......... 37% 74.7M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 34950K .......... .......... .......... .......... .......... 37% 68.1M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 35000K .......... .......... .......... .......... .......... 37% 75.9M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 35050K .......... .......... .......... .......... .......... 37% 52.7M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 35100K .......... .......... .......... .......... .......... 37% 116M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 35150K .......... .......... .......... .......... .......... 37% 57.6M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 35200K .......... .......... .......... .......... .......... 37% 97.5M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 35250K .......... .......... .......... .......... .......... 37% 57.1M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 35300K .......... .......... .......... .......... .......... 38% 84.9M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 35350K .......... .......... .......... .......... .......... 38% 51.3M 1s 2024-03-04T12:49:14.464 INFO:teuthology.orchestra.run.smithi090.stderr: 35400K .......... .......... .......... .......... .......... 38% 105M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 35450K .......... .......... .......... .......... .......... 38% 62.9M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 35500K .......... .......... .......... .......... .......... 38% 49.3M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 35550K .......... .......... .......... .......... .......... 38% 28.2M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 35600K .......... .......... .......... .......... .......... 38% 107M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 35650K .......... .......... .......... .......... .......... 38% 88.7M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 35700K .......... .......... .......... .......... .......... 38% 65.2M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 35750K .......... .......... .......... .......... .......... 38% 44.7M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 35800K .......... .......... .......... .......... .......... 38% 56.8M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 35850K .......... .......... .......... .......... .......... 38% 114M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 35900K .......... .......... .......... .......... .......... 38% 52.1M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 35950K .......... .......... .......... .......... .......... 38% 59.2M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 36000K .......... .......... .......... .......... .......... 38% 83.2M 1s 2024-03-04T12:49:14.465 INFO:teuthology.orchestra.run.smithi090.stderr: 36050K .......... .......... .......... .......... .......... 38% 67.9M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36100K .......... .......... .......... .......... .......... 38% 116M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36150K .......... .......... .......... .......... .......... 38% 69.6M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36200K .......... .......... .......... .......... .......... 39% 108M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36250K .......... .......... .......... .......... .......... 39% 81.0M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36300K .......... .......... .......... .......... .......... 39% 118M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36350K .......... .......... .......... .......... .......... 39% 65.5M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36400K .......... .......... .......... .......... .......... 39% 56.2M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36450K .......... .......... .......... .......... .......... 39% 37.1M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36500K .......... .......... .......... .......... .......... 39% 108M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36550K .......... .......... .......... .......... .......... 39% 112M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36600K .......... .......... .......... .......... .......... 39% 51.8M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36650K .......... .......... .......... .......... .......... 39% 56.6M 1s 2024-03-04T12:49:14.466 INFO:teuthology.orchestra.run.smithi090.stderr: 36700K .......... .......... .......... .......... .......... 39% 63.8M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 36750K .......... .......... .......... .......... .......... 39% 109M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 36800K .......... .......... .......... .......... .......... 39% 54.3M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 36850K .......... .......... .......... .......... .......... 39% 74.8M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 36900K .......... .......... .......... .......... .......... 39% 63.2M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 36950K .......... .......... .......... .......... .......... 39% 77.8M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 37000K .......... .......... .......... .......... .......... 39% 117M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 37050K .......... .......... .......... .......... .......... 39% 102M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 37100K .......... .......... .......... .......... .......... 39% 71.1M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 37150K .......... .......... .......... .......... .......... 40% 106M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 37200K .......... .......... .......... .......... .......... 40% 130M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 37250K .......... .......... .......... .......... .......... 40% 44.2M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 37300K .......... .......... .......... .......... .......... 40% 53.1M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 37350K .......... .......... .......... .......... .......... 40% 50.5M 1s 2024-03-04T12:49:14.467 INFO:teuthology.orchestra.run.smithi090.stderr: 37400K .......... .......... .......... .......... .......... 40% 74.1M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 37450K .......... .......... .......... .......... .......... 40% 112M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 37500K .......... .......... .......... .......... .......... 40% 46.1M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 37550K .......... .......... .......... .......... .......... 40% 59.9M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 37600K .......... .......... .......... .......... .......... 40% 105M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 37650K .......... .......... .......... .......... .......... 40% 53.1M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 37700K .......... .......... .......... .......... .......... 40% 117M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 37750K .......... .......... .......... .......... .......... 40% 57.5M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 37800K .......... .......... .......... .......... .......... 40% 72.2M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 37850K .......... .......... .......... .......... .......... 40% 73.1M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 37900K .......... .......... .......... .......... .......... 40% 93.9M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 37950K .......... .......... .......... .......... .......... 40% 34.7M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 38000K .......... .......... .......... .......... .......... 40% 51.1M 1s 2024-03-04T12:49:14.468 INFO:teuthology.orchestra.run.smithi090.stderr: 38050K .......... .......... .......... .......... .......... 41% 57.5M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38100K .......... .......... .......... .......... .......... 41% 50.1M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38150K .......... .......... .......... .......... .......... 41% 57.9M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38200K .......... .......... .......... .......... .......... 41% 88.1M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38250K .......... .......... .......... .......... .......... 41% 41.0M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38300K .......... .......... .......... .......... .......... 41% 59.5M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38350K .......... .......... .......... .......... .......... 41% 55.2M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38400K .......... .......... .......... .......... .......... 41% 93.3M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38450K .......... .......... .......... .......... .......... 41% 52.3M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38500K .......... .......... .......... .......... .......... 41% 73.1M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38550K .......... .......... .......... .......... .......... 41% 69.8M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38600K .......... .......... .......... .......... .......... 41% 47.9M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38650K .......... .......... .......... .......... .......... 41% 116M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38700K .......... .......... .......... .......... .......... 41% 102M 1s 2024-03-04T12:49:14.469 INFO:teuthology.orchestra.run.smithi090.stderr: 38750K .......... .......... .......... .......... .......... 41% 46.8M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 38800K .......... .......... .......... .......... .......... 41% 104M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 38850K .......... .......... .......... .......... .......... 41% 33.6M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 38900K .......... .......... .......... .......... .......... 41% 114M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 38950K .......... .......... .......... .......... .......... 41% 49.4M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 39000K .......... .......... .......... .......... .......... 42% 74.8M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 39050K .......... .......... .......... .......... .......... 42% 68.4M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 39100K .......... .......... .......... .......... .......... 42% 115M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 39150K .......... .......... .......... .......... .......... 42% 44.6M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 39200K .......... .......... .......... .......... .......... 42% 60.1M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 39250K .......... .......... .......... .......... .......... 42% 50.8M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 39300K .......... .......... .......... .......... .......... 42% 81.5M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 39350K .......... .......... .......... .......... .......... 42% 115M 1s 2024-03-04T12:49:14.470 INFO:teuthology.orchestra.run.smithi090.stderr: 39400K .......... .......... .......... .......... .......... 42% 62.7M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 39450K .......... .......... .......... .......... .......... 42% 60.5M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 39500K .......... .......... .......... .......... .......... 42% 75.7M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 39550K .......... .......... .......... .......... .......... 42% 89.1M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 39600K .......... .......... .......... .......... .......... 42% 114M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 39650K .......... .......... .......... .......... .......... 42% 51.8M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 39700K .......... .......... .......... .......... .......... 42% 64.9M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 39750K .......... .......... .......... .......... .......... 42% 77.3M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 39800K .......... .......... .......... .......... .......... 42% 120M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 39850K .......... .......... .......... .......... .......... 42% 56.4M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 39900K .......... .......... .......... .......... .......... 43% 44.3M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 39950K .......... .......... .......... .......... .......... 43% 55.8M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 40000K .......... .......... .......... .......... .......... 43% 110M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 40050K .......... .......... .......... .......... .......... 43% 49.1M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 40100K .......... .......... .......... .......... .......... 43% 41.2M 1s 2024-03-04T12:49:14.471 INFO:teuthology.orchestra.run.smithi090.stderr: 40150K .......... .......... .......... .......... .......... 43% 35.2M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40200K .......... .......... .......... .......... .......... 43% 56.0M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40250K .......... .......... .......... .......... .......... 43% 110M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40300K .......... .......... .......... .......... .......... 43% 62.6M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40350K .......... .......... .......... .......... .......... 43% 35.0M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40400K .......... .......... .......... .......... .......... 43% 55.3M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40450K .......... .......... .......... .......... .......... 43% 57.5M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40500K .......... .......... .......... .......... .......... 43% 110M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40550K .......... .......... .......... .......... .......... 43% 44.1M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40600K .......... .......... .......... .......... .......... 43% 68.9M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40650K .......... .......... .......... .......... .......... 43% 58.2M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40700K .......... .......... .......... .......... .......... 43% 123M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40750K .......... .......... .......... .......... .......... 43% 53.2M 1s 2024-03-04T12:49:14.472 INFO:teuthology.orchestra.run.smithi090.stderr: 40800K .......... .......... .......... .......... .......... 43% 34.0M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 40850K .......... .......... .......... .......... .......... 44% 65.5M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 40900K .......... .......... .......... .......... .......... 44% 42.6M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 40950K .......... .......... .......... .......... .......... 44% 101M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 41000K .......... .......... .......... .......... .......... 44% 124M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 41050K .......... .......... .......... .......... .......... 44% 63.7M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 41100K .......... .......... .......... .......... .......... 44% 57.6M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 41150K .......... .......... .......... .......... .......... 44% 107M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 41200K .......... .......... .......... .......... .......... 44% 108M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 41250K .......... .......... .......... .......... .......... 44% 94.6M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 41300K .......... .......... .......... .......... .......... 44% 51.2M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 41350K .......... .......... .......... .......... .......... 44% 52.3M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 41400K .......... .......... .......... .......... .......... 44% 101M 1s 2024-03-04T12:49:14.473 INFO:teuthology.orchestra.run.smithi090.stderr: 41450K .......... .......... .......... .......... .......... 44% 96.7M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 41500K .......... .......... .......... .......... .......... 44% 72.1M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 41550K .......... .......... .......... .......... .......... 44% 56.3M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 41600K .......... .......... .......... .......... .......... 44% 78.6M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 41650K .......... .......... .......... .......... .......... 44% 63.5M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 41700K .......... .......... .......... .......... .......... 44% 108M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 41750K .......... .......... .......... .......... .......... 44% 79.7M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 41800K .......... .......... .......... .......... .......... 45% 63.9M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 41850K .......... .......... .......... .......... .......... 45% 110M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 41900K .......... .......... .......... .......... .......... 45% 114M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 41950K .......... .......... .......... .......... .......... 45% 91.5M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 42000K .......... .......... .......... .......... .......... 45% 74.5M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 42050K .......... .......... .......... .......... .......... 45% 41.7M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 42100K .......... .......... .......... .......... .......... 45% 89.6M 1s 2024-03-04T12:49:14.474 INFO:teuthology.orchestra.run.smithi090.stderr: 42150K .......... .......... .......... .......... .......... 45% 116M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42200K .......... .......... .......... .......... .......... 45% 60.0M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42250K .......... .......... .......... .......... .......... 45% 90.9M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42300K .......... .......... .......... .......... .......... 45% 59.1M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42350K .......... .......... .......... .......... .......... 45% 116M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42400K .......... .......... .......... .......... .......... 45% 36.7M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42450K .......... .......... .......... .......... .......... 45% 42.6M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42500K .......... .......... .......... .......... .......... 45% 44.1M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42550K .......... .......... .......... .......... .......... 45% 43.3M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42600K .......... .......... .......... .......... .......... 45% 53.6M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42650K .......... .......... .......... .......... .......... 45% 134M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42700K .......... .......... .......... .......... .......... 46% 64.5M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42750K .......... .......... .......... .......... .......... 46% 49.2M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42800K .......... .......... .......... .......... .......... 46% 90.3M 1s 2024-03-04T12:49:14.475 INFO:teuthology.orchestra.run.smithi090.stderr: 42850K .......... .......... .......... .......... .......... 46% 42.4M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 42900K .......... .......... .......... .......... .......... 46% 63.7M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 42950K .......... .......... .......... .......... .......... 46% 67.9M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 43000K .......... .......... .......... .......... .......... 46% 58.4M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 43050K .......... .......... .......... .......... .......... 46% 105M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 43100K .......... .......... .......... .......... .......... 46% 93.6M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 43150K .......... .......... .......... .......... .......... 46% 58.8M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 43200K .......... .......... .......... .......... .......... 46% 74.1M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 43250K .......... .......... .......... .......... .......... 46% 45.6M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 43300K .......... .......... .......... .......... .......... 46% 120M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 43350K .......... .......... .......... .......... .......... 46% 77.7M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 43400K .......... .......... .......... .......... .......... 46% 69.3M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 43450K .......... .......... .......... .......... .......... 46% 83.7M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 43500K .......... .......... .......... .......... .......... 46% 54.2M 1s 2024-03-04T12:49:14.476 INFO:teuthology.orchestra.run.smithi090.stderr: 43550K .......... .......... .......... .......... .......... 46% 110M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 43600K .......... .......... .......... .......... .......... 46% 70.7M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 43650K .......... .......... .......... .......... .......... 47% 67.3M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 43700K .......... .......... .......... .......... .......... 47% 86.7M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 43750K .......... .......... .......... .......... .......... 47% 59.4M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 43800K .......... .......... .......... .......... .......... 47% 121M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 43850K .......... .......... .......... .......... .......... 47% 76.5M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 43900K .......... .......... .......... .......... .......... 47% 90.2M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 43950K .......... .......... .......... .......... .......... 47% 50.0M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 44000K .......... .......... .......... .......... .......... 47% 124M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 44050K .......... .......... .......... .......... .......... 47% 50.9M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 44100K .......... .......... .......... .......... .......... 47% 50.8M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 44150K .......... .......... .......... .......... .......... 47% 55.3M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 44200K .......... .......... .......... .......... .......... 47% 52.2M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 44250K .......... .......... .......... .......... .......... 47% 108M 1s 2024-03-04T12:49:14.477 INFO:teuthology.orchestra.run.smithi090.stderr: 44300K .......... .......... .......... .......... .......... 47% 101M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44350K .......... .......... .......... .......... .......... 47% 45.7M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44400K .......... .......... .......... .......... .......... 47% 74.3M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44450K .......... .......... .......... .......... .......... 47% 41.7M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44500K .......... .......... .......... .......... .......... 47% 103M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44550K .......... .......... .......... .......... .......... 48% 36.6M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44600K .......... .......... .......... .......... .......... 48% 85.8M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44650K .......... .......... .......... .......... .......... 48% 68.0M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44700K .......... .......... .......... .......... .......... 48% 107M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44750K .......... .......... .......... .......... .......... 48% 54.2M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44800K .......... .......... .......... .......... .......... 48% 39.9M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44850K .......... .......... .......... .......... .......... 48% 60.5M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44900K .......... .......... .......... .......... .......... 48% 34.6M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 44950K .......... .......... .......... .......... .......... 48% 111M 1s 2024-03-04T12:49:14.478 INFO:teuthology.orchestra.run.smithi090.stderr: 45000K .......... .......... .......... .......... .......... 48% 57.3M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45050K .......... .......... .......... .......... .......... 48% 48.8M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45100K .......... .......... .......... .......... .......... 48% 53.6M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45150K .......... .......... .......... .......... .......... 48% 109M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45200K .......... .......... .......... .......... .......... 48% 50.3M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45250K .......... .......... .......... .......... .......... 48% 41.2M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45300K .......... .......... .......... .......... .......... 48% 46.2M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45350K .......... .......... .......... .......... .......... 48% 55.8M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45400K .......... .......... .......... .......... .......... 48% 125M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45450K .......... .......... .......... .......... .......... 48% 51.5M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45500K .......... .......... .......... .......... .......... 49% 96.2M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45550K .......... .......... .......... .......... .......... 49% 53.3M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45600K .......... .......... .......... .......... .......... 49% 118M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45650K .......... .......... .......... .......... .......... 49% 56.9M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45700K .......... .......... .......... .......... .......... 49% 58.6M 1s 2024-03-04T12:49:14.479 INFO:teuthology.orchestra.run.smithi090.stderr: 45750K .......... .......... .......... .......... .......... 49% 56.4M 1s 2024-03-04T12:49:14.480 INFO:teuthology.orchestra.run.smithi090.stderr: 45800K .......... .......... .......... .......... .......... 49% 89.1M 1s 2024-03-04T12:49:14.480 INFO:teuthology.orchestra.run.smithi090.stderr: 45850K .......... .......... .......... .......... .......... 49% 116M 1s 2024-03-04T12:49:14.480 INFO:teuthology.orchestra.run.smithi090.stderr: 45900K .......... .......... .......... .......... .......... 49% 66.7M 1s 2024-03-04T12:49:14.480 INFO:teuthology.orchestra.run.smithi090.stderr: 45950K .......... .......... .......... .......... .......... 49% 65.3M 1s 2024-03-04T12:49:14.480 INFO:teuthology.orchestra.run.smithi090.stderr: 46000K .......... .......... .......... .......... .......... 49% 59.0M 1s 2024-03-04T12:49:14.480 INFO:teuthology.orchestra.run.smithi090.stderr: 46050K .......... .......... .......... .......... .......... 49% 47.8M 1s 2024-03-04T12:49:14.480 INFO:teuthology.orchestra.run.smithi090.stderr: 46100K .......... .......... .......... .......... .......... 49% 71.8M 1s 2024-03-04T12:49:14.480 INFO:teuthology.orchestra.run.smithi090.stderr: 46150K .......... .......... .......... .......... .......... 49% 123M 1s 2024-03-04T12:49:14.480 INFO:teuthology.orchestra.run.smithi090.stderr: 46200K .......... .......... .......... .......... .......... 49% 96.9M 1s 2024-03-04T12:49:14.480 INFO:teuthology.orchestra.run.smithi090.stderr: 46250K .......... .......... .......... .......... .......... 49% 45.8M 1s 2024-03-04T12:49:14.480 INFO:teuthology.orchestra.run.smithi090.stderr: 46300K .......... .......... .......... .......... .......... 49% 59.1M 1s 2024-03-04T12:49:14.480 INFO:teuthology.orchestra.run.smithi090.stderr: 46350K .......... .......... .......... .......... .......... 49% 122M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 46400K .......... .......... .......... .......... .......... 49% 53.3M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 46450K .......... .......... .......... .......... .......... 50% 40.0M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 46500K .......... .......... .......... .......... .......... 50% 56.6M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 46550K .......... .......... .......... .......... .......... 50% 87.2M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 46600K .......... .......... .......... .......... .......... 50% 103M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 46650K .......... .......... .......... .......... .......... 50% 77.7M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 46700K .......... .......... .......... .......... .......... 50% 85.5M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 46750K .......... .......... .......... .......... .......... 50% 51.0M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 46800K .......... .......... .......... .......... .......... 50% 113M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 46850K .......... .......... .......... .......... .......... 50% 71.8M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 46900K .......... .......... .......... .......... .......... 50% 68.7M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 46950K .......... .......... .......... .......... .......... 50% 82.9M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 47000K .......... .......... .......... .......... .......... 50% 41.5M 1s 2024-03-04T12:49:14.481 INFO:teuthology.orchestra.run.smithi090.stderr: 47050K .......... .......... .......... .......... .......... 50% 107M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47100K .......... .......... .......... .......... .......... 50% 85.2M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47150K .......... .......... .......... .......... .......... 50% 31.6M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47200K .......... .......... .......... .......... .......... 50% 41.4M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47250K .......... .......... .......... .......... .......... 50% 53.7M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47300K .......... .......... .......... .......... .......... 50% 121M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47350K .......... .......... .......... .......... .......... 51% 41.9M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47400K .......... .......... .......... .......... .......... 51% 72.6M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47450K .......... .......... .......... .......... .......... 51% 56.5M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47500K .......... .......... .......... .......... .......... 51% 110M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47550K .......... .......... .......... .......... .......... 51% 49.1M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47600K .......... .......... .......... .......... .......... 51% 175M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47650K .......... .......... .......... .......... .......... 51% 60.1M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47700K .......... .......... .......... .......... .......... 51% 35.4M 1s 2024-03-04T12:49:14.482 INFO:teuthology.orchestra.run.smithi090.stderr: 47750K .......... .......... .......... .......... .......... 51% 110M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 47800K .......... .......... .......... .......... .......... 51% 44.5M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 47850K .......... .......... .......... .......... .......... 51% 48.7M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 47900K .......... .......... .......... .......... .......... 51% 81.6M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 47950K .......... .......... .......... .......... .......... 51% 114M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 48000K .......... .......... .......... .......... .......... 51% 44.8M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 48050K .......... .......... .......... .......... .......... 51% 57.6M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 48100K .......... .......... .......... .......... .......... 51% 72.9M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 48150K .......... .......... .......... .......... .......... 51% 61.6M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 48200K .......... .......... .......... .......... .......... 51% 113M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 48250K .......... .......... .......... .......... .......... 51% 65.2M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 48300K .......... .......... .......... .......... .......... 52% 86.8M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 48350K .......... .......... .......... .......... .......... 52% 78.1M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 48400K .......... .......... .......... .......... .......... 52% 110M 1s 2024-03-04T12:49:14.483 INFO:teuthology.orchestra.run.smithi090.stderr: 48450K .......... .......... .......... .......... .......... 52% 44.6M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 48500K .......... .......... .......... .......... .......... 52% 54.1M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 48550K .......... .......... .......... .......... .......... 52% 62.8M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 48600K .......... .......... .......... .......... .......... 52% 93.6M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 48650K .......... .......... .......... .......... .......... 52% 121M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 48700K .......... .......... .......... .......... .......... 52% 44.1M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 48750K .......... .......... .......... .......... .......... 52% 69.6M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 48800K .......... .......... .......... .......... .......... 52% 61.0M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 48850K .......... .......... .......... .......... .......... 52% 68.0M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 48900K .......... .......... .......... .......... .......... 52% 87.7M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 48950K .......... .......... .......... .......... .......... 52% 116M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 49000K .......... .......... .......... .......... .......... 52% 90.8M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 49050K .......... .......... .......... .......... .......... 52% 97.8M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 49100K .......... .......... .......... .......... .......... 52% 69.1M 1s 2024-03-04T12:49:14.484 INFO:teuthology.orchestra.run.smithi090.stderr: 49150K .......... .......... .......... .......... .......... 52% 118M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49200K .......... .......... .......... .......... .......... 53% 48.0M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49250K .......... .......... .......... .......... .......... 53% 70.7M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49300K .......... .......... .......... .......... .......... 53% 39.2M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49350K .......... .......... .......... .......... .......... 53% 69.9M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49400K .......... .......... .......... .......... .......... 53% 119M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49450K .......... .......... .......... .......... .......... 53% 51.9M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49500K .......... .......... .......... .......... .......... 53% 63.8M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49550K .......... .......... .......... .......... .......... 53% 43.5M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49600K .......... .......... .......... .......... .......... 53% 112M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49650K .......... .......... .......... .......... .......... 53% 55.5M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49700K .......... .......... .......... .......... .......... 53% 68.1M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49750K .......... .......... .......... .......... .......... 53% 41.3M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49800K .......... .......... .......... .......... .......... 53% 79.9M 1s 2024-03-04T12:49:14.485 INFO:teuthology.orchestra.run.smithi090.stderr: 49850K .......... .......... .......... .......... .......... 53% 93.6M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 49900K .......... .......... .......... .......... .......... 53% 35.9M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 49950K .......... .......... .......... .......... .......... 53% 44.3M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50000K .......... .......... .......... .......... .......... 53% 106M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50050K .......... .......... .......... .......... .......... 53% 45.3M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50100K .......... .......... .......... .......... .......... 53% 108M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50150K .......... .......... .......... .......... .......... 54% 33.6M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50200K .......... .......... .......... .......... .......... 54% 64.0M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50250K .......... .......... .......... .......... .......... 54% 66.0M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50300K .......... .......... .......... .......... .......... 54% 62.1M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50350K .......... .......... .......... .......... .......... 54% 94.9M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50400K .......... .......... .......... .......... .......... 54% 51.4M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50450K .......... .......... .......... .......... .......... 54% 58.9M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50500K .......... .......... .......... .......... .......... 54% 90.9M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50550K .......... .......... .......... .......... .......... 54% 117M 1s 2024-03-04T12:49:14.486 INFO:teuthology.orchestra.run.smithi090.stderr: 50600K .......... .......... .......... .......... .......... 54% 54.4M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 50650K .......... .......... .......... .......... .......... 54% 52.6M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 50700K .......... .......... .......... .......... .......... 54% 41.7M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 50750K .......... .......... .......... .......... .......... 54% 114M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 50800K .......... .......... .......... .......... .......... 54% 80.6M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 50850K .......... .......... .......... .......... .......... 54% 34.2M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 50900K .......... .......... .......... .......... .......... 54% 68.7M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 50950K .......... .......... .......... .......... .......... 54% 62.7M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 51000K .......... .......... .......... .......... .......... 54% 113M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 51050K .......... .......... .......... .......... .......... 55% 85.8M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 51100K .......... .......... .......... .......... .......... 55% 59.2M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 51150K .......... .......... .......... .......... .......... 55% 54.3M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 51200K .......... .......... .......... .......... .......... 55% 124M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 51250K .......... .......... .......... .......... .......... 55% 48.2M 1s 2024-03-04T12:49:14.487 INFO:teuthology.orchestra.run.smithi090.stderr: 51300K .......... .......... .......... .......... .......... 55% 37.7M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51350K .......... .......... .......... .......... .......... 55% 83.9M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51400K .......... .......... .......... .......... .......... 55% 68.3M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51450K .......... .......... .......... .......... .......... 55% 111M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51500K .......... .......... .......... .......... .......... 55% 43.1M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51550K .......... .......... .......... .......... .......... 55% 46.9M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51600K .......... .......... .......... .......... .......... 55% 44.3M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51650K .......... .......... .......... .......... .......... 55% 45.2M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51700K .......... .......... .......... .......... .......... 55% 51.3M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51750K .......... .......... .......... .......... .......... 55% 118M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51800K .......... .......... .......... .......... .......... 55% 65.7M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51850K .......... .......... .......... .......... .......... 55% 94.7M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51900K .......... .......... .......... .......... .......... 55% 76.9M 1s 2024-03-04T12:49:14.488 INFO:teuthology.orchestra.run.smithi090.stderr: 51950K .......... .......... .......... .......... .......... 55% 86.6M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52000K .......... .......... .......... .......... .......... 56% 44.9M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52050K .......... .......... .......... .......... .......... 56% 36.3M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52100K .......... .......... .......... .......... .......... 56% 59.7M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52150K .......... .......... .......... .......... .......... 56% 37.7M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52200K .......... .......... .......... .......... .......... 56% 87.8M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52250K .......... .......... .......... .......... .......... 56% 73.8M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52300K .......... .......... .......... .......... .......... 56% 32.3M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52350K .......... .......... .......... .......... .......... 56% 34.7M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52400K .......... .......... .......... .......... .......... 56% 115M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52450K .......... .......... .......... .......... .......... 56% 78.5M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52500K .......... .......... .......... .......... .......... 56% 84.1M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52550K .......... .......... .......... .......... .......... 56% 50.4M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52600K .......... .......... .......... .......... .......... 56% 52.7M 1s 2024-03-04T12:49:14.489 INFO:teuthology.orchestra.run.smithi090.stderr: 52650K .......... .......... .......... .......... .......... 56% 96.9M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 52700K .......... .......... .......... .......... .......... 56% 73.4M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 52750K .......... .......... .......... .......... .......... 56% 68.8M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 52800K .......... .......... .......... .......... .......... 56% 75.6M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 52850K .......... .......... .......... .......... .......... 56% 52.2M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 52900K .......... .......... .......... .......... .......... 56% 114M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 52950K .......... .......... .......... .......... .......... 57% 47.7M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 53000K .......... .......... .......... .......... .......... 57% 49.2M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 53050K .......... .......... .......... .......... .......... 57% 46.2M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 53100K .......... .......... .......... .......... .......... 57% 118M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 53150K .......... .......... .......... .......... .......... 57% 59.4M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 53200K .......... .......... .......... .......... .......... 57% 44.2M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 53250K .......... .......... .......... .......... .......... 57% 67.5M 1s 2024-03-04T12:49:14.490 INFO:teuthology.orchestra.run.smithi090.stderr: 53300K .......... .......... .......... .......... .......... 57% 98.5M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53350K .......... .......... .......... .......... .......... 57% 115M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53400K .......... .......... .......... .......... .......... 57% 69.4M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53450K .......... .......... .......... .......... .......... 57% 43.9M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53500K .......... .......... .......... .......... .......... 57% 61.9M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53550K .......... .......... .......... .......... .......... 57% 108M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53600K .......... .......... .......... .......... .......... 57% 97.5M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53650K .......... .......... .......... .......... .......... 57% 34.8M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53700K .......... .......... .......... .......... .......... 57% 40.7M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53750K .......... .......... .......... .......... .......... 57% 89.3M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53800K .......... .......... .......... .......... .......... 57% 119M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53850K .......... .......... .......... .......... .......... 58% 57.1M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53900K .......... .......... .......... .......... .......... 58% 44.6M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 53950K .......... .......... .......... .......... .......... 58% 63.3M 1s 2024-03-04T12:49:14.491 INFO:teuthology.orchestra.run.smithi090.stderr: 54000K .......... .......... .......... .......... .......... 58% 114M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54050K .......... .......... .......... .......... .......... 58% 65.2M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54100K .......... .......... .......... .......... .......... 58% 58.8M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54150K .......... .......... .......... .......... .......... 58% 88.3M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54200K .......... .......... .......... .......... .......... 58% 69.5M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54250K .......... .......... .......... .......... .......... 58% 55.5M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54300K .......... .......... .......... .......... .......... 58% 117M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54350K .......... .......... .......... .......... .......... 58% 52.0M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54400K .......... .......... .......... .......... .......... 58% 28.4M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54450K .......... .......... .......... .......... .......... 58% 33.9M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54500K .......... .......... .......... .......... .......... 58% 56.4M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54550K .......... .......... .......... .......... .......... 58% 118M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54600K .......... .......... .......... .......... .......... 58% 27.7M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54650K .......... .......... .......... .......... .......... 58% 75.7M 1s 2024-03-04T12:49:14.492 INFO:teuthology.orchestra.run.smithi090.stderr: 54700K .......... .......... .......... .......... .......... 58% 49.0M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 54750K .......... .......... .......... .......... .......... 58% 77.4M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 54800K .......... .......... .......... .......... .......... 59% 34.3M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 54850K .......... .......... .......... .......... .......... 59% 61.1M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 54900K .......... .......... .......... .......... .......... 59% 86.1M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 54950K .......... .......... .......... .......... .......... 59% 90.2M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 55000K .......... .......... .......... .......... .......... 59% 90.7M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 55050K .......... .......... .......... .......... .......... 59% 50.7M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 55100K .......... .......... .......... .......... .......... 59% 61.8M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 55150K .......... .......... .......... .......... .......... 59% 91.6M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 55200K .......... .......... .......... .......... .......... 59% 118M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 55250K .......... .......... .......... .......... .......... 59% 42.8M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 55300K .......... .......... .......... .......... .......... 59% 60.8M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 55350K .......... .......... .......... .......... .......... 59% 36.1M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 55400K .......... .......... .......... .......... .......... 59% 25.5M 1s 2024-03-04T12:49:14.493 INFO:teuthology.orchestra.run.smithi090.stderr: 55450K .......... .......... .......... .......... .......... 59% 127M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 55500K .......... .......... .......... .......... .......... 59% 48.0M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 55550K .......... .......... .......... .......... .......... 59% 64.6M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 55600K .......... .......... .......... .......... .......... 59% 31.3M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 55650K .......... .......... .......... .......... .......... 59% 42.7M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 55700K .......... .......... .......... .......... .......... 60% 133M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 55750K .......... .......... .......... .......... .......... 60% 100M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 55800K .......... .......... .......... .......... .......... 60% 51.3M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 55850K .......... .......... .......... .......... .......... 60% 38.2M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 55900K .......... .......... .......... .......... .......... 60% 116M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 55950K .......... .......... .......... .......... .......... 60% 49.3M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 56000K .......... .......... .......... .......... .......... 60% 62.3M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 56050K .......... .......... .......... .......... .......... 60% 30.4M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 56100K .......... .......... .......... .......... .......... 60% 64.8M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 56150K .......... .......... .......... .......... .......... 60% 74.4M 1s 2024-03-04T12:49:14.494 INFO:teuthology.orchestra.run.smithi090.stderr: 56200K .......... .......... .......... .......... .......... 60% 72.8M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56250K .......... .......... .......... .......... .......... 60% 44.1M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56300K .......... .......... .......... .......... .......... 60% 54.1M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56350K .......... .......... .......... .......... .......... 60% 121M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56400K .......... .......... .......... .......... .......... 60% 117M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56450K .......... .......... .......... .......... .......... 60% 39.1M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56500K .......... .......... .......... .......... .......... 60% 52.3M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56550K .......... .......... .......... .......... .......... 60% 52.7M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56600K .......... .......... .......... .......... .......... 60% 106M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56650K .......... .......... .......... .......... .......... 61% 56.7M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56700K .......... .......... .......... .......... .......... 61% 46.3M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56750K .......... .......... .......... .......... .......... 61% 63.2M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56800K .......... .......... .......... .......... .......... 61% 117M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56850K .......... .......... .......... .......... .......... 61% 19.3M 1s 2024-03-04T12:49:14.495 INFO:teuthology.orchestra.run.smithi090.stderr: 56900K .......... .......... .......... .......... .......... 61% 94.0M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 56950K .......... .......... .......... .......... .......... 61% 66.8M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 57000K .......... .......... .......... .......... .......... 61% 29.8M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 57050K .......... .......... .......... .......... .......... 61% 83.4M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 57100K .......... .......... .......... .......... .......... 61% 113M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 57150K .......... .......... .......... .......... .......... 61% 43.0M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 57200K .......... .......... .......... .......... .......... 61% 44.8M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 57250K .......... .......... .......... .......... .......... 61% 46.7M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 57300K .......... .......... .......... .......... .......... 61% 64.7M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 57350K .......... .......... .......... .......... .......... 61% 114M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 57400K .......... .......... .......... .......... .......... 61% 55.6M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 57450K .......... .......... .......... .......... .......... 61% 50.6M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 57500K .......... .......... .......... .......... .......... 61% 62.0M 1s 2024-03-04T12:49:14.496 INFO:teuthology.orchestra.run.smithi090.stderr: 57550K .......... .......... .......... .......... .......... 62% 108M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 57600K .......... .......... .......... .......... .......... 62% 117M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 57650K .......... .......... .......... .......... .......... 62% 28.3M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 57700K .......... .......... .......... .......... .......... 62% 103M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 57750K .......... .......... .......... .......... .......... 62% 39.2M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 57800K .......... .......... .......... .......... .......... 62% 115M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 57850K .......... .......... .......... .......... .......... 62% 35.4M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 57900K .......... .......... .......... .......... .......... 62% 29.1M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 57950K .......... .......... .......... .......... .......... 62% 38.7M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 58000K .......... .......... .......... .......... .......... 62% 120M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 58050K .......... .......... .......... .......... .......... 62% 28.7M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 58100K .......... .......... .......... .......... .......... 62% 49.6M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 58150K .......... .......... .......... .......... .......... 62% 72.9M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 58200K .......... .......... .......... .......... .......... 62% 65.1M 1s 2024-03-04T12:49:14.497 INFO:teuthology.orchestra.run.smithi090.stderr: 58250K .......... .......... .......... .......... .......... 62% 111M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58300K .......... .......... .......... .......... .......... 62% 38.0M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58350K .......... .......... .......... .......... .......... 62% 50.6M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58400K .......... .......... .......... .......... .......... 62% 123M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58450K .......... .......... .......... .......... .......... 62% 36.9M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58500K .......... .......... .......... .......... .......... 63% 90.0M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58550K .......... .......... .......... .......... .......... 63% 89.0M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58600K .......... .......... .......... .......... .......... 63% 58.0M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58650K .......... .......... .......... .......... .......... 63% 60.4M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58700K .......... .......... .......... .......... .......... 63% 108M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58750K .......... .......... .......... .......... .......... 63% 48.0M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58800K .......... .......... .......... .......... .......... 63% 85.0M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58850K .......... .......... .......... .......... .......... 63% 39.5M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58900K .......... .......... .......... .......... .......... 63% 67.5M 1s 2024-03-04T12:49:14.498 INFO:teuthology.orchestra.run.smithi090.stderr: 58950K .......... .......... .......... .......... .......... 63% 119M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59000K .......... .......... .......... .......... .......... 63% 50.1M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59050K .......... .......... .......... .......... .......... 63% 78.4M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59100K .......... .......... .......... .......... .......... 63% 33.6M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59150K .......... .......... .......... .......... .......... 63% 113M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59200K .......... .......... .......... .......... .......... 63% 91.8M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59250K .......... .......... .......... .......... .......... 63% 32.4M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59300K .......... .......... .......... .......... .......... 63% 61.7M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59350K .......... .......... .......... .......... .......... 63% 72.8M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59400K .......... .......... .......... .......... .......... 63% 97.5M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59450K .......... .......... .......... .......... .......... 64% 33.6M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59500K .......... .......... .......... .......... .......... 64% 35.6M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59550K .......... .......... .......... .......... .......... 64% 40.8M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59600K .......... .......... .......... .......... .......... 64% 40.5M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59650K .......... .......... .......... .......... .......... 64% 54.9M 1s 2024-03-04T12:49:14.499 INFO:teuthology.orchestra.run.smithi090.stderr: 59700K .......... .......... .......... .......... .......... 64% 116M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 59750K .......... .......... .......... .......... .......... 64% 57.2M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 59800K .......... .......... .......... .......... .......... 64% 35.0M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 59850K .......... .......... .......... .......... .......... 64% 53.8M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 59900K .......... .......... .......... .......... .......... 64% 108M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 59950K .......... .......... .......... .......... .......... 64% 106M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 60000K .......... .......... .......... .......... .......... 64% 113M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 60050K .......... .......... .......... .......... .......... 64% 30.4M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 60100K .......... .......... .......... .......... .......... 64% 92.3M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 60150K .......... .......... .......... .......... .......... 64% 114M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 60200K .......... .......... .......... .......... .......... 64% 58.9M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 60250K .......... .......... .......... .......... .......... 64% 72.4M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 60300K .......... .......... .......... .......... .......... 64% 46.7M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 60350K .......... .......... .......... .......... .......... 65% 57.4M 1s 2024-03-04T12:49:14.500 INFO:teuthology.orchestra.run.smithi090.stderr: 60400K .......... .......... .......... .......... .......... 65% 51.1M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 60450K .......... .......... .......... .......... .......... 65% 30.4M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 60500K .......... .......... .......... .......... .......... 65% 54.1M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 60550K .......... .......... .......... .......... .......... 65% 60.7M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 60600K .......... .......... .......... .......... .......... 65% 102M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 60650K .......... .......... .......... .......... .......... 65% 61.1M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 60700K .......... .......... .......... .......... .......... 65% 44.9M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 60750K .......... .......... .......... .......... .......... 65% 52.5M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 60800K .......... .......... .......... .......... .......... 65% 111M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 60850K .......... .......... .......... .......... .......... 65% 42.4M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 60900K .......... .......... .......... .......... .......... 65% 62.4M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 60950K .......... .......... .......... .......... .......... 65% 96.8M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 61000K .......... .......... .......... .......... .......... 65% 37.4M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 61050K .......... .......... .......... .......... .......... 65% 117M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 61100K .......... .......... .......... .......... .......... 65% 51.2M 1s 2024-03-04T12:49:14.501 INFO:teuthology.orchestra.run.smithi090.stderr: 61150K .......... .......... .......... .......... .......... 65% 49.3M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61200K .......... .......... .......... .......... .......... 65% 73.5M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61250K .......... .......... .......... .......... .......... 65% 26.6M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61300K .......... .......... .......... .......... .......... 66% 89.8M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61350K .......... .......... .......... .......... .......... 66% 87.3M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61400K .......... .......... .......... .......... .......... 66% 41.9M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61450K .......... .......... .......... .......... .......... 66% 38.7M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61500K .......... .......... .......... .......... .......... 66% 108M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61550K .......... .......... .......... .......... .......... 66% 26.6M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61600K .......... .......... .......... .......... .......... 66% 116M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61650K .......... .......... .......... .......... .......... 66% 17.4M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61700K .......... .......... .......... .......... .......... 66% 86.3M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61750K .......... .......... .......... .......... .......... 66% 114M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61800K .......... .......... .......... .......... .......... 66% 104M 1s 2024-03-04T12:49:14.502 INFO:teuthology.orchestra.run.smithi090.stderr: 61850K .......... .......... .......... .......... .......... 66% 36.8M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 61900K .......... .......... .......... .......... .......... 66% 34.4M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 61950K .......... .......... .......... .......... .......... 66% 116M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62000K .......... .......... .......... .......... .......... 66% 37.7M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62050K .......... .......... .......... .......... .......... 66% 32.3M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62100K .......... .......... .......... .......... .......... 66% 70.0M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62150K .......... .......... .......... .......... .......... 66% 36.9M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62200K .......... .......... .......... .......... .......... 67% 118M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62250K .......... .......... .......... .......... .......... 67% 38.3M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62300K .......... .......... .......... .......... .......... 67% 61.7M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62350K .......... .......... .......... .......... .......... 67% 85.2M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62400K .......... .......... .......... .......... .......... 67% 49.4M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62450K .......... .......... .......... .......... .......... 67% 44.3M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62500K .......... .......... .......... .......... .......... 67% 114M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62550K .......... .......... .......... .......... .......... 67% 47.3M 1s 2024-03-04T12:49:14.503 INFO:teuthology.orchestra.run.smithi090.stderr: 62600K .......... .......... .......... .......... .......... 67% 48.4M 1s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 62650K .......... .......... .......... .......... .......... 67% 73.1M 0s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 62700K .......... .......... .......... .......... .......... 67% 115M 0s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 62750K .......... .......... .......... .......... .......... 67% 30.8M 0s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 62800K .......... .......... .......... .......... .......... 67% 50.7M 0s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 62850K .......... .......... .......... .......... .......... 67% 25.8M 0s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 62900K .......... .......... .......... .......... .......... 67% 74.4M 0s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 62950K .......... .......... .......... .......... .......... 67% 113M 0s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 63000K .......... .......... .......... .......... .......... 67% 34.3M 0s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 63050K .......... .......... .......... .......... .......... 67% 88.2M 0s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 63100K .......... .......... .......... .......... .......... 67% 68.9M 0s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 63150K .......... .......... .......... .......... .......... 68% 114M 0s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 63200K .......... .......... .......... .......... .......... 68% 26.1M 0s 2024-03-04T12:49:14.504 INFO:teuthology.orchestra.run.smithi090.stderr: 63250K .......... .......... .......... .......... .......... 68% 53.4M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63300K .......... .......... .......... .......... .......... 68% 51.4M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63350K .......... .......... .......... .......... .......... 68% 78.8M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63400K .......... .......... .......... .......... .......... 68% 116M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63450K .......... .......... .......... .......... .......... 68% 38.6M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63500K .......... .......... .......... .......... .......... 68% 47.5M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63550K .......... .......... .......... .......... .......... 68% 69.9M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63600K .......... .......... .......... .......... .......... 68% 113M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63650K .......... .......... .......... .......... .......... 68% 49.3M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63700K .......... .......... .......... .......... .......... 68% 31.5M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63750K .......... .......... .......... .......... .......... 68% 56.6M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63800K .......... .......... .......... .......... .......... 68% 79.5M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63850K .......... .......... .......... .......... .......... 68% 110M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63900K .......... .......... .......... .......... .......... 68% 54.9M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 63950K .......... .......... .......... .......... .......... 68% 39.3M 0s 2024-03-04T12:49:14.505 INFO:teuthology.orchestra.run.smithi090.stderr: 64000K .......... .......... .......... .......... .......... 68% 94.6M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64050K .......... .......... .......... .......... .......... 68% 32.3M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64100K .......... .......... .......... .......... .......... 69% 98.9M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64150K .......... .......... .......... .......... .......... 69% 101M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64200K .......... .......... .......... .......... .......... 69% 67.3M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64250K .......... .......... .......... .......... .......... 69% 47.4M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64300K .......... .......... .......... .......... .......... 69% 108M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64350K .......... .......... .......... .......... .......... 69% 45.9M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64400K .......... .......... .......... .......... .......... 69% 93.6M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64450K .......... .......... .......... .......... .......... 69% 30.3M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64500K .......... .......... .......... .......... .......... 69% 60.7M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64550K .......... .......... .......... .......... .......... 69% 113M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64600K .......... .......... .......... .......... .......... 69% 46.1M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64650K .......... .......... .......... .......... .......... 69% 34.7M 0s 2024-03-04T12:49:14.506 INFO:teuthology.orchestra.run.smithi090.stderr: 64700K .......... .......... .......... .......... .......... 69% 77.2M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 64750K .......... .......... .......... .......... .......... 69% 114M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 64800K .......... .......... .......... .......... .......... 69% 84.1M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 64850K .......... .......... .......... .......... .......... 69% 78.2M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 64900K .......... .......... .......... .......... .......... 69% 35.0M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 64950K .......... .......... .......... .......... .......... 69% 51.3M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 65000K .......... .......... .......... .......... .......... 70% 26.2M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 65050K .......... .......... .......... .......... .......... 70% 118M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 65100K .......... .......... .......... .......... .......... 70% 89.9M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 65150K .......... .......... .......... .......... .......... 70% 28.4M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 65200K .......... .......... .......... .......... .......... 70% 44.1M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 65250K .......... .......... .......... .......... .......... 70% 52.7M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 65300K .......... .......... .......... .......... .......... 70% 67.5M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 65350K .......... .......... .......... .......... .......... 70% 54.7M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 65400K .......... .......... .......... .......... .......... 70% 29.0M 0s 2024-03-04T12:49:14.507 INFO:teuthology.orchestra.run.smithi090.stderr: 65450K .......... .......... .......... .......... .......... 70% 44.4M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 65500K .......... .......... .......... .......... .......... 70% 115M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 65550K .......... .......... .......... .......... .......... 70% 114M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 65600K .......... .......... .......... .......... .......... 70% 31.4M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 65650K .......... .......... .......... .......... .......... 70% 72.1M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 65700K .......... .......... .......... .......... .......... 70% 44.8M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 65750K .......... .......... .......... .......... .......... 70% 124M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 65800K .......... .......... .......... .......... .......... 70% 81.9M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 65850K .......... .......... .......... .......... .......... 70% 54.5M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 65900K .......... .......... .......... .......... .......... 70% 35.9M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 65950K .......... .......... .......... .......... .......... 71% 97.6M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 66000K .......... .......... .......... .......... .......... 71% 51.4M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 66050K .......... .......... .......... .......... .......... 71% 40.5M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 66100K .......... .......... .......... .......... .......... 71% 35.0M 0s 2024-03-04T12:49:14.508 INFO:teuthology.orchestra.run.smithi090.stderr: 66150K .......... .......... .......... .......... .......... 71% 49.9M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66200K .......... .......... .......... .......... .......... 71% 116M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66250K .......... .......... .......... .......... .......... 71% 69.4M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66300K .......... .......... .......... .......... .......... 71% 52.3M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66350K .......... .......... .......... .......... .......... 71% 40.6M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66400K .......... .......... .......... .......... .......... 71% 109M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66450K .......... .......... .......... .......... .......... 71% 38.9M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66500K .......... .......... .......... .......... .......... 71% 48.7M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66550K .......... .......... .......... .......... .......... 71% 64.6M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66600K .......... .......... .......... .......... .......... 71% 46.4M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66650K .......... .......... .......... .......... .......... 71% 106M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66700K .......... .......... .......... .......... .......... 71% 49.6M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66750K .......... .......... .......... .......... .......... 71% 48.4M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66800K .......... .......... .......... .......... .......... 71% 72.1M 0s 2024-03-04T12:49:14.509 INFO:teuthology.orchestra.run.smithi090.stderr: 66850K .......... .......... .......... .......... .......... 72% 35.1M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 66900K .......... .......... .......... .......... .......... 72% 114M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 66950K .......... .......... .......... .......... .......... 72% 53.0M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 67000K .......... .......... .......... .......... .......... 72% 57.9M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 67050K .......... .......... .......... .......... .......... 72% 34.2M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 67100K .......... .......... .......... .......... .......... 72% 80.0M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 67150K .......... .......... .......... .......... .......... 72% 51.0M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 67200K .......... .......... .......... .......... .......... 72% 82.4M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 67250K .......... .......... .......... .......... .......... 72% 60.1M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 67300K .......... .......... .......... .......... .......... 72% 55.7M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 67350K .......... .......... .......... .......... .......... 72% 120M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 67400K .......... .......... .......... .......... .......... 72% 45.5M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 67450K .......... .......... .......... .......... .......... 72% 25.3M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 67500K .......... .......... .......... .......... .......... 72% 49.0M 0s 2024-03-04T12:49:14.510 INFO:teuthology.orchestra.run.smithi090.stderr: 67550K .......... .......... .......... .......... .......... 72% 135M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 67600K .......... .......... .......... .......... .......... 72% 34.9M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 67650K .......... .......... .......... .......... .......... 72% 28.5M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 67700K .......... .......... .......... .......... .......... 72% 57.8M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 67750K .......... .......... .......... .......... .......... 72% 58.7M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 67800K .......... .......... .......... .......... .......... 73% 32.6M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 67850K .......... .......... .......... .......... .......... 73% 66.5M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 67900K .......... .......... .......... .......... .......... 73% 41.1M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 67950K .......... .......... .......... .......... .......... 73% 106M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 68000K .......... .......... .......... .......... .......... 73% 53.1M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 68050K .......... .......... .......... .......... .......... 73% 36.0M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 68100K .......... .......... .......... .......... .......... 73% 114M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 68150K .......... .......... .......... .......... .......... 73% 54.6M 0s 2024-03-04T12:49:14.511 INFO:teuthology.orchestra.run.smithi090.stderr: 68200K .......... .......... .......... .......... .......... 73% 58.1M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68250K .......... .......... .......... .......... .......... 73% 60.8M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68300K .......... .......... .......... .......... .......... 73% 115M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68350K .......... .......... .......... .......... .......... 73% 40.3M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68400K .......... .......... .......... .......... .......... 73% 86.1M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68450K .......... .......... .......... .......... .......... 73% 41.6M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68500K .......... .......... .......... .......... .......... 73% 38.2M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68550K .......... .......... .......... .......... .......... 73% 115M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68600K .......... .......... .......... .......... .......... 73% 34.8M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68650K .......... .......... .......... .......... .......... 73% 49.8M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68700K .......... .......... .......... .......... .......... 74% 41.4M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68750K .......... .......... .......... .......... .......... 74% 118M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68800K .......... .......... .......... .......... .......... 74% 53.7M 0s 2024-03-04T12:49:14.512 INFO:teuthology.orchestra.run.smithi090.stderr: 68850K .......... .......... .......... .......... .......... 74% 38.9M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 68900K .......... .......... .......... .......... .......... 74% 66.9M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 68950K .......... .......... .......... .......... .......... 74% 86.6M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 69000K .......... .......... .......... .......... .......... 74% 106M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 69050K .......... .......... .......... .......... .......... 74% 50.3M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 69100K .......... .......... .......... .......... .......... 74% 45.2M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 69150K .......... .......... .......... .......... .......... 74% 77.0M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 69200K .......... .......... .......... .......... .......... 74% 116M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 69250K .......... .......... .......... .......... .......... 74% 52.0M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 69300K .......... .......... .......... .......... .......... 74% 31.8M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 69350K .......... .......... .......... .......... .......... 74% 59.7M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 69400K .......... .......... .......... .......... .......... 74% 72.6M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 69450K .......... .......... .......... .......... .......... 74% 109M 0s 2024-03-04T12:49:14.513 INFO:teuthology.orchestra.run.smithi090.stderr: 69500K .......... .......... .......... .......... .......... 74% 28.5M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 69550K .......... .......... .......... .......... .......... 74% 41.7M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 69600K .......... .......... .......... .......... .......... 74% 79.7M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 69650K .......... .......... .......... .......... .......... 75% 85.9M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 69700K .......... .......... .......... .......... .......... 75% 116M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 69750K .......... .......... .......... .......... .......... 75% 49.4M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 69800K .......... .......... .......... .......... .......... 75% 58.9M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 69850K .......... .......... .......... .......... .......... 75% 29.7M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 69900K .......... .......... .......... .......... .......... 75% 93.5M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 69950K .......... .......... .......... .......... .......... 75% 86.6M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 70000K .......... .......... .......... .......... .......... 75% 48.4M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 70050K .......... .......... .......... .......... .......... 75% 31.8M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 70100K .......... .......... .......... .......... .......... 75% 45.0M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 70150K .......... .......... .......... .......... .......... 75% 105M 0s 2024-03-04T12:49:14.514 INFO:teuthology.orchestra.run.smithi090.stderr: 70200K .......... .......... .......... .......... .......... 75% 74.8M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70250K .......... .......... .......... .......... .......... 75% 40.5M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70300K .......... .......... .......... .......... .......... 75% 37.4M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70350K .......... .......... .......... .......... .......... 75% 57.9M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70400K .......... .......... .......... .......... .......... 75% 113M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70450K .......... .......... .......... .......... .......... 75% 30.4M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70500K .......... .......... .......... .......... .......... 75% 51.1M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70550K .......... .......... .......... .......... .......... 75% 57.4M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70600K .......... .......... .......... .......... .......... 76% 97.6M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70650K .......... .......... .......... .......... .......... 76% 83.6M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70700K .......... .......... .......... .......... .......... 76% 64.4M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70750K .......... .......... .......... .......... .......... 76% 30.7M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70800K .......... .......... .......... .......... .......... 76% 63.3M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70850K .......... .......... .......... .......... .......... 76% 36.0M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70900K .......... .......... .......... .......... .......... 76% 124M 0s 2024-03-04T12:49:14.515 INFO:teuthology.orchestra.run.smithi090.stderr: 70950K .......... .......... .......... .......... .......... 76% 46.5M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71000K .......... .......... .......... .......... .......... 76% 55.8M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71050K .......... .......... .......... .......... .......... 76% 38.0M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71100K .......... .......... .......... .......... .......... 76% 131M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71150K .......... .......... .......... .......... .......... 76% 59.4M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71200K .......... .......... .......... .......... .......... 76% 75.4M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71250K .......... .......... .......... .......... .......... 76% 30.7M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71300K .......... .......... .......... .......... .......... 76% 47.6M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71350K .......... .......... .......... .......... .......... 76% 86.9M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71400K .......... .......... .......... .......... .......... 76% 48.5M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71450K .......... .......... .......... .......... .......... 76% 49.4M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71500K .......... .......... .......... .......... .......... 77% 33.7M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71550K .......... .......... .......... .......... .......... 77% 122M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71600K .......... .......... .......... .......... .......... 77% 68.7M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71650K .......... .......... .......... .......... .......... 77% 60.6M 0s 2024-03-04T12:49:14.516 INFO:teuthology.orchestra.run.smithi090.stderr: 71700K .......... .......... .......... .......... .......... 77% 38.9M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 71750K .......... .......... .......... .......... .......... 77% 37.3M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 71800K .......... .......... .......... .......... .......... 77% 119M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 71850K .......... .......... .......... .......... .......... 77% 52.4M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 71900K .......... .......... .......... .......... .......... 77% 34.8M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 71950K .......... .......... .......... .......... .......... 77% 41.0M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 72000K .......... .......... .......... .......... .......... 77% 130M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 72050K .......... .......... .......... .......... .......... 77% 39.1M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 72100K .......... .......... .......... .......... .......... 77% 55.3M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 72150K .......... .......... .......... .......... .......... 77% 53.1M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 72200K .......... .......... .......... .......... .......... 77% 59.2M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 72250K .......... .......... .......... .......... .......... 77% 122M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 72300K .......... .......... .......... .......... .......... 77% 30.1M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 72350K .......... .......... .......... .......... .......... 77% 104M 0s 2024-03-04T12:49:14.517 INFO:teuthology.orchestra.run.smithi090.stderr: 72400K .......... .......... .......... .......... .......... 77% 86.3M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 72450K .......... .......... .......... .......... .......... 78% 25.6M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 72500K .......... .......... .......... .......... .......... 78% 117M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 72550K .......... .......... .......... .......... .......... 78% 36.8M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 72600K .......... .......... .......... .......... .......... 78% 53.3M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 72650K .......... .......... .......... .......... .......... 78% 30.9M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 72700K .......... .......... .......... .......... .......... 78% 116M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 72750K .......... .......... .......... .......... .......... 78% 37.8M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 72800K .......... .......... .......... .......... .......... 78% 49.8M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 72850K .......... .......... .......... .......... .......... 78% 26.2M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 72900K .......... .......... .......... .......... .......... 78% 58.4M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 72950K .......... .......... .......... .......... .......... 78% 111M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 73000K .......... .......... .......... .......... .......... 78% 58.9M 0s 2024-03-04T12:49:14.518 INFO:teuthology.orchestra.run.smithi090.stderr: 73050K .......... .......... .......... .......... .......... 78% 50.8M 0s 2024-03-04T12:49:14.719 INFO:teuthology.orchestra.run.smithi090.stderr: 73100K .......... .......... .......... .......... .......... 78% 44.2M 0s 2024-03-04T12:49:14.719 INFO:teuthology.orchestra.run.smithi090.stderr: 73150K .......... .......... .......... .......... .......... 78% 33.6M 0s 2024-03-04T12:49:14.719 INFO:teuthology.orchestra.run.smithi090.stderr: 73200K .......... .......... .......... .......... .......... 78% 106M 0s 2024-03-04T12:49:14.719 INFO:teuthology.orchestra.run.smithi090.stderr: 73250K .......... .......... .......... .......... .......... 78% 52.9M 0s 2024-03-04T12:49:14.719 INFO:teuthology.orchestra.run.smithi090.stderr: 73300K .......... .......... .......... .......... .......... 78% 38.5M 0s 2024-03-04T12:49:14.719 INFO:teuthology.orchestra.run.smithi090.stderr: 73350K .......... .......... .......... .......... .......... 79% 13.0M 0s 2024-03-04T12:49:14.719 INFO:teuthology.orchestra.run.smithi090.stderr: 73400K .......... .......... .......... .......... .......... 79% 329M 0s 2024-03-04T12:49:14.719 INFO:teuthology.orchestra.run.smithi090.stderr: 73450K .......... .......... .......... .......... .......... 79% 311M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 73500K .......... .......... .......... .......... .......... 79% 370M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 73550K .......... .......... .......... .......... .......... 79% 140M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 73600K .......... .......... .......... .......... .......... 79% 87.1M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 73650K .......... .......... .......... .......... .......... 79% 56.2M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 73700K .......... .......... .......... .......... .......... 79% 115M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 73750K .......... .......... .......... .......... .......... 79% 36.9M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 73800K .......... .......... .......... .......... .......... 79% 55.0M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 73850K .......... .......... .......... .......... .......... 79% 54.4M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 73900K .......... .......... .......... .......... .......... 79% 130M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 73950K .......... .......... .......... .......... .......... 79% 42.2M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 74000K .......... .......... .......... .......... .......... 79% 46.5M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 74050K .......... .......... .......... .......... .......... 79% 43.1M 0s 2024-03-04T12:49:14.720 INFO:teuthology.orchestra.run.smithi090.stderr: 74100K .......... .......... .......... .......... .......... 79% 55.6M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74150K .......... .......... .......... .......... .......... 79% 107M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74200K .......... .......... .......... .......... .......... 79% 53.2M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74250K .......... .......... .......... .......... .......... 79% 42.2M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74300K .......... .......... .......... .......... .......... 80% 38.7M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74350K .......... .......... .......... .......... .......... 80% 122M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74400K .......... .......... .......... .......... .......... 80% 43.9M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74450K .......... .......... .......... .......... .......... 80% 41.2M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74500K .......... .......... .......... .......... .......... 80% 56.9M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74550K .......... .......... .......... .......... .......... 80% 114M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74600K .......... .......... .......... .......... .......... 80% 113M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74650K .......... .......... .......... .......... .......... 80% 65.9M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74700K .......... .......... .......... .......... .......... 80% 35.3M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74750K .......... .......... .......... .......... .......... 80% 40.8M 0s 2024-03-04T12:49:14.721 INFO:teuthology.orchestra.run.smithi090.stderr: 74800K .......... .......... .......... .......... .......... 80% 119M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 74850K .......... .......... .......... .......... .......... 80% 66.6M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 74900K .......... .......... .......... .......... .......... 80% 30.4M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 74950K .......... .......... .......... .......... .......... 80% 51.6M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 75000K .......... .......... .......... .......... .......... 80% 60.7M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 75050K .......... .......... .......... .......... .......... 80% 107M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 75100K .......... .......... .......... .......... .......... 80% 31.9M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 75150K .......... .......... .......... .......... .......... 80% 49.8M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 75200K .......... .......... .......... .......... .......... 81% 62.1M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 75250K .......... .......... .......... .......... .......... 81% 34.2M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 75300K .......... .......... .......... .......... .......... 81% 74.0M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 75350K .......... .......... .......... .......... .......... 81% 61.7M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 75400K .......... .......... .......... .......... .......... 81% 52.7M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 75450K .......... .......... .......... .......... .......... 81% 93.9M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 75500K .......... .......... .......... .......... .......... 81% 67.4M 0s 2024-03-04T12:49:14.722 INFO:teuthology.orchestra.run.smithi090.stderr: 75550K .......... .......... .......... .......... .......... 81% 42.1M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 75600K .......... .......... .......... .......... .......... 81% 60.7M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 75650K .......... .......... .......... .......... .......... 81% 56.8M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 75700K .......... .......... .......... .......... .......... 81% 67.7M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 75750K .......... .......... .......... .......... .......... 81% 15.1M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 75800K .......... .......... .......... .......... .......... 81% 125M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 75850K .......... .......... .......... .......... .......... 81% 68.5M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 75900K .......... .......... .......... .......... .......... 81% 82.3M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 75950K .......... .......... .......... .......... .......... 81% 64.9M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 76000K .......... .......... .......... .......... .......... 81% 105M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 76050K .......... .......... .......... .......... .......... 81% 32.9M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 76100K .......... .......... .......... .......... .......... 81% 55.0M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 76150K .......... .......... .......... .......... .......... 82% 76.6M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 76200K .......... .......... .......... .......... .......... 82% 60.2M 0s 2024-03-04T12:49:14.723 INFO:teuthology.orchestra.run.smithi090.stderr: 76250K .......... .......... .......... .......... .......... 82% 111M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76300K .......... .......... .......... .......... .......... 82% 48.6M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76350K .......... .......... .......... .......... .......... 82% 58.8M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76400K .......... .......... .......... .......... .......... 82% 40.1M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76450K .......... .......... .......... .......... .......... 82% 59.7M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76500K .......... .......... .......... .......... .......... 82% 119M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76550K .......... .......... .......... .......... .......... 82% 36.4M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76600K .......... .......... .......... .......... .......... 82% 41.5M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76650K .......... .......... .......... .......... .......... 82% 73.0M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76700K .......... .......... .......... .......... .......... 82% 112M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76750K .......... .......... .......... .......... .......... 82% 75.2M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76800K .......... .......... .......... .......... .......... 82% 56.7M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76850K .......... .......... .......... .......... .......... 82% 31.0M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76900K .......... .......... .......... .......... .......... 82% 44.4M 0s 2024-03-04T12:49:14.724 INFO:teuthology.orchestra.run.smithi090.stderr: 76950K .......... .......... .......... .......... .......... 82% 87.3M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77000K .......... .......... .......... .......... .......... 82% 37.0M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77050K .......... .......... .......... .......... .......... 82% 68.9M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77100K .......... .......... .......... .......... .......... 83% 37.0M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77150K .......... .......... .......... .......... .......... 83% 120M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77200K .......... .......... .......... .......... .......... 83% 46.8M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77250K .......... .......... .......... .......... .......... 83% 41.9M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77300K .......... .......... .......... .......... .......... 83% 26.7M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77350K .......... .......... .......... .......... .......... 83% 47.0M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77400K .......... .......... .......... .......... .......... 83% 130M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77450K .......... .......... .......... .......... .......... 83% 54.3M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77500K .......... .......... .......... .......... .......... 83% 29.3M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77550K .......... .......... .......... .......... .......... 83% 38.0M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77600K .......... .......... .......... .......... .......... 83% 100M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77650K .......... .......... .......... .......... .......... 83% 44.9M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77700K .......... .......... .......... .......... .......... 83% 31.8M 0s 2024-03-04T12:49:14.725 INFO:teuthology.orchestra.run.smithi090.stderr: 77750K .......... .......... .......... .......... .......... 83% 46.1M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 77800K .......... .......... .......... .......... .......... 83% 64.4M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 77850K .......... .......... .......... .......... .......... 83% 103M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 77900K .......... .......... .......... .......... .......... 83% 89.6M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 77950K .......... .......... .......... .......... .......... 83% 45.7M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 78000K .......... .......... .......... .......... .......... 84% 35.6M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 78050K .......... .......... .......... .......... .......... 84% 41.5M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 78100K .......... .......... .......... .......... .......... 84% 81.9M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 78150K .......... .......... .......... .......... .......... 84% 63.8M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 78200K .......... .......... .......... .......... .......... 84% 19.7M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 78250K .......... .......... .......... .......... .......... 84% 49.5M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 78300K .......... .......... .......... .......... .......... 84% 116M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 78350K .......... .......... .......... .......... .......... 84% 67.6M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 78400K .......... .......... .......... .......... .......... 84% 57.3M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 78450K .......... .......... .......... .......... .......... 84% 37.0M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 78500K .......... .......... .......... .......... .......... 84% 59.1M 0s 2024-03-04T12:49:14.726 INFO:teuthology.orchestra.run.smithi090.stderr: 78550K .......... .......... .......... .......... .......... 84% 85.4M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 78600K .......... .......... .......... .......... .......... 84% 114M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 78650K .......... .......... .......... .......... .......... 84% 49.5M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 78700K .......... .......... .......... .......... .......... 84% 64.4M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 78750K .......... .......... .......... .......... .......... 84% 50.7M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 78800K .......... .......... .......... .......... .......... 84% 110M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 78850K .......... .......... .......... .......... .......... 84% 81.7M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 78900K .......... .......... .......... .......... .......... 84% 45.1M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 78950K .......... .......... .......... .......... .......... 85% 26.7M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 79000K .......... .......... .......... .......... .......... 85% 32.6M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 79050K .......... .......... .......... .......... .......... 85% 108M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 79100K .......... .......... .......... .......... .......... 85% 74.9M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 79150K .......... .......... .......... .......... .......... 85% 36.2M 0s 2024-03-04T12:49:14.727 INFO:teuthology.orchestra.run.smithi090.stderr: 79200K .......... .......... .......... .......... .......... 85% 28.7M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79250K .......... .......... .......... .......... .......... 85% 54.7M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79300K .......... .......... .......... .......... .......... 85% 108M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79350K .......... .......... .......... .......... .......... 85% 33.2M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79400K .......... .......... .......... .......... .......... 85% 28.8M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79450K .......... .......... .......... .......... .......... 85% 54.9M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79500K .......... .......... .......... .......... .......... 85% 119M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79550K .......... .......... .......... .......... .......... 85% 57.9M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79600K .......... .......... .......... .......... .......... 85% 50.4M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79650K .......... .......... .......... .......... .......... 85% 72.6M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79700K .......... .......... .......... .......... .......... 85% 35.5M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79750K .......... .......... .......... .......... .......... 85% 57.0M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79800K .......... .......... .......... .......... .......... 85% 47.7M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79850K .......... .......... .......... .......... .......... 86% 63.8M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79900K .......... .......... .......... .......... .......... 86% 47.1M 0s 2024-03-04T12:49:14.728 INFO:teuthology.orchestra.run.smithi090.stderr: 79950K .......... .......... .......... .......... .......... 86% 78.7M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80000K .......... .......... .......... .......... .......... 86% 73.1M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80050K .......... .......... .......... .......... .......... 86% 71.7M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80100K .......... .......... .......... .......... .......... 86% 54.3M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80150K .......... .......... .......... .......... .......... 86% 39.6M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80200K .......... .......... .......... .......... .......... 86% 103M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80250K .......... .......... .......... .......... .......... 86% 22.9M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80300K .......... .......... .......... .......... .......... 86% 42.7M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80350K .......... .......... .......... .......... .......... 86% 61.9M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80400K .......... .......... .......... .......... .......... 86% 112M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80450K .......... .......... .......... .......... .......... 86% 51.3M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80500K .......... .......... .......... .......... .......... 86% 37.7M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80550K .......... .......... .......... .......... .......... 86% 72.9M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80600K .......... .......... .......... .......... .......... 86% 36.6M 0s 2024-03-04T12:49:14.729 INFO:teuthology.orchestra.run.smithi090.stderr: 80650K .......... .......... .......... .......... .......... 86% 83.5M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 80700K .......... .......... .......... .......... .......... 86% 51.4M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 80750K .......... .......... .......... .......... .......... 86% 67.9M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 80800K .......... .......... .......... .......... .......... 87% 45.2M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 80850K .......... .......... .......... .......... .......... 87% 57.3M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 80900K .......... .......... .......... .......... .......... 87% 75.1M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 80950K .......... .......... .......... .......... .......... 87% 92.8M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 81000K .......... .......... .......... .......... .......... 87% 82.9M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 81050K .......... .......... .......... .......... .......... 87% 46.4M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 81100K .......... .......... .......... .......... .......... 87% 63.2M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 81150K .......... .......... .......... .......... .......... 87% 109M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 81200K .......... .......... .......... .......... .......... 87% 48.9M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 81250K .......... .......... .......... .......... .......... 87% 61.7M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 81300K .......... .......... .......... .......... .......... 87% 50.1M 0s 2024-03-04T12:49:14.730 INFO:teuthology.orchestra.run.smithi090.stderr: 81350K .......... .......... .......... .......... .......... 87% 37.4M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 81400K .......... .......... .......... .......... .......... 87% 115M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 81450K .......... .......... .......... .......... .......... 87% 58.0M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 81500K .......... .......... .......... .......... .......... 87% 52.8M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 81550K .......... .......... .......... .......... .......... 87% 40.5M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 81600K .......... .......... .......... .......... .......... 87% 114M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 81650K .......... .......... .......... .......... .......... 87% 32.4M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 81700K .......... .......... .......... .......... .......... 87% 38.2M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 81750K .......... .......... .......... .......... .......... 88% 33.3M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 81800K .......... .......... .......... .......... .......... 88% 37.1M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 81850K .......... .......... .......... .......... .......... 88% 104M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 81900K .......... .......... .......... .......... .......... 88% 64.4M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 81950K .......... .......... .......... .......... .......... 88% 44.2M 0s 2024-03-04T12:49:14.731 INFO:teuthology.orchestra.run.smithi090.stderr: 82000K .......... .......... .......... .......... .......... 88% 48.5M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82050K .......... .......... .......... .......... .......... 88% 51.2M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82100K .......... .......... .......... .......... .......... 88% 118M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82150K .......... .......... .......... .......... .......... 88% 36.1M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82200K .......... .......... .......... .......... .......... 88% 28.5M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82250K .......... .......... .......... .......... .......... 88% 76.0M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82300K .......... .......... .......... .......... .......... 88% 110M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82350K .......... .......... .......... .......... .......... 88% 30.5M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82400K .......... .......... .......... .......... .......... 88% 87.1M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82450K .......... .......... .......... .......... .......... 88% 42.3M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82500K .......... .......... .......... .......... .......... 88% 37.9M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82550K .......... .......... .......... .......... .......... 88% 98.5M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82600K .......... .......... .......... .......... .......... 88% 36.8M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82650K .......... .......... .......... .......... .......... 89% 41.3M 0s 2024-03-04T12:49:14.732 INFO:teuthology.orchestra.run.smithi090.stderr: 82700K .......... .......... .......... .......... .......... 89% 33.1M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 82750K .......... .......... .......... .......... .......... 89% 122M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 82800K .......... .......... .......... .......... .......... 89% 36.1M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 82850K .......... .......... .......... .......... .......... 89% 68.4M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 82900K .......... .......... .......... .......... .......... 89% 50.3M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 82950K .......... .......... .......... .......... .......... 89% 84.7M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 83000K .......... .......... .......... .......... .......... 89% 116M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 83050K .......... .......... .......... .......... .......... 89% 40.4M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 83100K .......... .......... .......... .......... .......... 89% 48.1M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 83150K .......... .......... .......... .......... .......... 89% 31.1M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 83200K .......... .......... .......... .......... .......... 89% 137M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 83250K .......... .......... .......... .......... .......... 89% 71.6M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 83300K .......... .......... .......... .......... .......... 89% 57.6M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 83350K .......... .......... .......... .......... .......... 89% 36.2M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 83400K .......... .......... .......... .......... .......... 89% 70.2M 0s 2024-03-04T12:49:14.733 INFO:teuthology.orchestra.run.smithi090.stderr: 83450K .......... .......... .......... .......... .......... 89% 94.1M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 83500K .......... .......... .......... .......... .......... 89% 49.7M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 83550K .......... .......... .......... .......... .......... 89% 55.6M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 83600K .......... .......... .......... .......... .......... 90% 39.7M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 83650K .......... .......... .......... .......... .......... 90% 50.1M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 83700K .......... .......... .......... .......... .......... 90% 145M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 83750K .......... .......... .......... .......... .......... 90% 66.1M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 83800K .......... .......... .......... .......... .......... 90% 59.9M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 83850K .......... .......... .......... .......... .......... 90% 44.8M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 83900K .......... .......... .......... .......... .......... 90% 89.1M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 83950K .......... .......... .......... .......... .......... 90% 102M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 84000K .......... .......... .......... .......... .......... 90% 69.8M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 84050K .......... .......... .......... .......... .......... 90% 35.1M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 84100K .......... .......... .......... .......... .......... 90% 31.7M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 84150K .......... .......... .......... .......... .......... 90% 31.4M 0s 2024-03-04T12:49:14.734 INFO:teuthology.orchestra.run.smithi090.stderr: 84200K .......... .......... .......... .......... .......... 90% 115M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84250K .......... .......... .......... .......... .......... 90% 35.8M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84300K .......... .......... .......... .......... .......... 90% 70.7M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84350K .......... .......... .......... .......... .......... 90% 56.8M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84400K .......... .......... .......... .......... .......... 90% 104M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84450K .......... .......... .......... .......... .......... 90% 38.8M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84500K .......... .......... .......... .......... .......... 91% 88.6M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84550K .......... .......... .......... .......... .......... 91% 41.4M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84600K .......... .......... .......... .......... .......... 91% 57.9M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84650K .......... .......... .......... .......... .......... 91% 64.3M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84700K .......... .......... .......... .......... .......... 91% 62.4M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84750K .......... .......... .......... .......... .......... 91% 37.3M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84800K .......... .......... .......... .......... .......... 91% 49.9M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84850K .......... .......... .......... .......... .......... 91% 41.4M 0s 2024-03-04T12:49:14.735 INFO:teuthology.orchestra.run.smithi090.stderr: 84900K .......... .......... .......... .......... .......... 91% 108M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 84950K .......... .......... .......... .......... .......... 91% 31.3M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85000K .......... .......... .......... .......... .......... 91% 28.9M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85050K .......... .......... .......... .......... .......... 91% 57.1M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85100K .......... .......... .......... .......... .......... 91% 114M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85150K .......... .......... .......... .......... .......... 91% 40.6M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85200K .......... .......... .......... .......... .......... 91% 65.9M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85250K .......... .......... .......... .......... .......... 91% 55.3M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85300K .......... .......... .......... .......... .......... 91% 67.9M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85350K .......... .......... .......... .......... .......... 91% 114M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85400K .......... .......... .......... .......... .......... 91% 31.1M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85450K .......... .......... .......... .......... .......... 92% 46.5M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85500K .......... .......... .......... .......... .......... 92% 56.0M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85550K .......... .......... .......... .......... .......... 92% 118M 0s 2024-03-04T12:49:14.736 INFO:teuthology.orchestra.run.smithi090.stderr: 85600K .......... .......... .......... .......... .......... 92% 34.0M 0s 2024-03-04T12:49:14.737 INFO:teuthology.orchestra.run.smithi090.stderr: 85650K .......... .......... .......... .......... .......... 92% 63.8M 0s 2024-03-04T12:49:14.737 INFO:teuthology.orchestra.run.smithi090.stderr: 85700K .......... .......... .......... .......... .......... 92% 48.1M 0s 2024-03-04T12:49:14.737 INFO:teuthology.orchestra.run.smithi090.stderr: 85750K .......... .......... .......... .......... .......... 92% 41.6M 0s 2024-03-04T12:49:14.737 INFO:teuthology.orchestra.run.smithi090.stderr: 85800K .......... .......... .......... .......... .......... 92% 119M 0s 2024-03-04T12:49:14.737 INFO:teuthology.orchestra.run.smithi090.stderr: 85850K .......... .......... .......... .......... .......... 92% 50.8M 0s 2024-03-04T12:49:14.737 INFO:teuthology.orchestra.run.smithi090.stderr: 85900K .......... .......... .......... .......... .......... 92% 99.2M 0s 2024-03-04T12:49:14.737 INFO:teuthology.orchestra.run.smithi090.stderr: 85950K .......... .......... .......... .......... .......... 92% 66.3M 0s 2024-03-04T12:49:14.737 INFO:teuthology.orchestra.run.smithi090.stderr: 86000K .......... .......... .......... .......... .......... 92% 114M 0s 2024-03-04T12:49:14.737 INFO:teuthology.orchestra.run.smithi090.stderr: 86050K .......... .......... .......... .......... .......... 92% 33.6M 0s 2024-03-04T12:49:14.737 INFO:teuthology.orchestra.run.smithi090.stderr: 86100K .......... .......... .......... .......... .......... 92% 60.7M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86150K .......... .......... .......... .......... .......... 92% 59.0M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86200K .......... .......... .......... .......... .......... 92% 76.5M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86250K .......... .......... .......... .......... .......... 92% 94.1M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86300K .......... .......... .......... .......... .......... 92% 57.5M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86350K .......... .......... .......... .......... .......... 93% 46.4M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86400K .......... .......... .......... .......... .......... 93% 42.2M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86450K .......... .......... .......... .......... .......... 93% 17.1M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86500K .......... .......... .......... .......... .......... 93% 37.2M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86550K .......... .......... .......... .......... .......... 93% 123M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86600K .......... .......... .......... .......... .......... 93% 33.9M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86650K .......... .......... .......... .......... .......... 93% 49.7M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86700K .......... .......... .......... .......... .......... 93% 62.1M 0s 2024-03-04T12:49:14.739 INFO:teuthology.orchestra.run.smithi090.stderr: 86750K .......... .......... .......... .......... .......... 93% 131M 0s 2024-03-04T12:49:14.740 INFO:teuthology.orchestra.run.smithi090.stderr: 86800K .......... .......... .......... .......... .......... 93% 34.1M 0s 2024-03-04T12:49:14.740 INFO:teuthology.orchestra.run.smithi090.stderr: 86850K .......... .......... .......... .......... .......... 93% 49.1M 0s 2024-03-04T12:49:14.740 INFO:teuthology.orchestra.run.smithi090.stderr: 86900K .......... .......... .......... .......... .......... 93% 52.0M 0s 2024-03-04T12:49:14.740 INFO:teuthology.orchestra.run.smithi090.stderr: 86950K .......... .......... .......... .......... .......... 93% 45.7M 0s 2024-03-04T12:49:14.740 INFO:teuthology.orchestra.run.smithi090.stderr: 87000K .......... .......... .......... .......... .......... 93% 118M 0s 2024-03-04T12:49:14.740 INFO:teuthology.orchestra.run.smithi090.stderr: 87050K .......... .......... .......... .......... .......... 93% 45.0M 0s 2024-03-04T12:49:14.740 INFO:teuthology.orchestra.run.smithi090.stderr: 87100K .......... .......... .......... .......... .......... 93% 38.0M 0s 2024-03-04T12:49:14.740 INFO:teuthology.orchestra.run.smithi090.stderr: 87150K .......... .......... .......... .......... .......... 93% 11.9M 0s 2024-03-04T12:49:14.740 INFO:teuthology.orchestra.run.smithi090.stderr: 87200K .......... .......... .......... .......... .......... 93% 171M 0s 2024-03-04T12:49:14.740 INFO:teuthology.orchestra.run.smithi090.stderr: 87250K .......... .......... .......... .......... .......... 93% 18.9M 0s 2024-03-04T12:49:14.740 INFO:teuthology.orchestra.run.smithi090.stderr: 87300K .......... .......... .......... .......... .......... 94% 12.6M 0s 2024-03-04T12:49:14.831 INFO:teuthology.orchestra.run.smithi090.stderr: 87350K .......... .......... .......... .......... .......... 94% 843K 0s 2024-03-04T12:49:14.831 INFO:teuthology.orchestra.run.smithi090.stderr: 87400K .......... .......... .......... .......... .......... 94% 127M 0s 2024-03-04T12:49:14.831 INFO:teuthology.orchestra.run.smithi090.stderr: 87450K .......... .......... .......... .......... .......... 94% 325M 0s 2024-03-04T12:49:14.831 INFO:teuthology.orchestra.run.smithi090.stderr: 87500K .......... .......... .......... .......... .......... 94% 425M 0s 2024-03-04T12:49:14.831 INFO:teuthology.orchestra.run.smithi090.stderr: 87550K .......... .......... .......... .......... .......... 94% 430M 0s 2024-03-04T12:49:14.831 INFO:teuthology.orchestra.run.smithi090.stderr: 87600K .......... .......... .......... .......... .......... 94% 440M 0s 2024-03-04T12:49:14.831 INFO:teuthology.orchestra.run.smithi090.stderr: 87650K .......... .......... .......... .......... .......... 94% 303M 0s 2024-03-04T12:49:14.831 INFO:teuthology.orchestra.run.smithi090.stderr: 87700K .......... .......... .......... .......... .......... 94% 435M 0s 2024-03-04T12:49:14.831 INFO:teuthology.orchestra.run.smithi090.stderr: 87750K .......... .......... .......... .......... .......... 94% 420M 0s 2024-03-04T12:49:14.831 INFO:teuthology.orchestra.run.smithi090.stderr: 87800K .......... .......... .......... .......... .......... 94% 402M 0s 2024-03-04T12:49:14.831 INFO:teuthology.orchestra.run.smithi090.stderr: 87850K .......... .......... .......... .......... .......... 94% 17.8M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 87900K .......... .......... .......... .......... .......... 94% 381M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 87950K .......... .......... .......... .......... .......... 94% 422M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 88000K .......... .......... .......... .......... .......... 94% 414M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 88050K .......... .......... .......... .......... .......... 94% 320M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 88100K .......... .......... .......... .......... .......... 94% 11.0M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 88150K .......... .......... .......... .......... .......... 94% 383M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 88200K .......... .......... .......... .......... .......... 94% 407M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 88250K .......... .......... .......... .......... .......... 95% 367M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 88300K .......... .......... .......... .......... .......... 95% 311M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 88350K .......... .......... .......... .......... .......... 95% 387M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 88400K .......... .......... .......... .......... .......... 95% 406M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 88450K .......... .......... .......... .......... .......... 95% 352M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 88500K .......... .......... .......... .......... .......... 95% 405M 0s 2024-03-04T12:49:14.832 INFO:teuthology.orchestra.run.smithi090.stderr: 88550K .......... .......... .......... .......... .......... 95% 10.8M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 88600K .......... .......... .......... .......... .......... 95% 411M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 88650K .......... .......... .......... .......... .......... 95% 328M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 88700K .......... .......... .......... .......... .......... 95% 44.3M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 88750K .......... .......... .......... .......... .......... 95% 46.5M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 88800K .......... .......... .......... .......... .......... 95% 275M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 88850K .......... .......... .......... .......... .......... 95% 46.8M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 88900K .......... .......... .......... .......... .......... 95% 398M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 88950K .......... .......... .......... .......... .......... 95% 15.4M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 89000K .......... .......... .......... .......... .......... 95% 343M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 89050K .......... .......... .......... .......... .......... 95% 343M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 89100K .......... .......... .......... .......... .......... 95% 61.4M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 89150K .......... .......... .......... .......... .......... 96% 190M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 89200K .......... .......... .......... .......... .......... 96% 98.2M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 89250K .......... .......... .......... .......... .......... 96% 276M 0s 2024-03-04T12:49:14.833 INFO:teuthology.orchestra.run.smithi090.stderr: 89300K .......... .......... .......... .......... .......... 96% 25.2M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89350K .......... .......... .......... .......... .......... 96% 128M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89400K .......... .......... .......... .......... .......... 96% 112M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89450K .......... .......... .......... .......... .......... 96% 355M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89500K .......... .......... .......... .......... .......... 96% 376M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89550K .......... .......... .......... .......... .......... 96% 414M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89600K .......... .......... .......... .......... .......... 96% 420M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89650K .......... .......... .......... .......... .......... 96% 345M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89700K .......... .......... .......... .......... .......... 96% 424M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89750K .......... .......... .......... .......... .......... 96% 424M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89800K .......... .......... .......... .......... .......... 96% 424M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89850K .......... .......... .......... .......... .......... 96% 379M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89900K .......... .......... .......... .......... .......... 96% 411M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 89950K .......... .......... .......... .......... .......... 96% 424M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 90000K .......... .......... .......... .......... .......... 96% 413M 0s 2024-03-04T12:49:14.834 INFO:teuthology.orchestra.run.smithi090.stderr: 90050K .......... .......... .......... .......... .......... 96% 342M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90100K .......... .......... .......... .......... .......... 97% 431M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90150K .......... .......... .......... .......... .......... 97% 419M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90200K .......... .......... .......... .......... .......... 97% 421M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90250K .......... .......... .......... .......... .......... 97% 374M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90300K .......... .......... .......... .......... .......... 97% 369M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90350K .......... .......... .......... .......... .......... 97% 438M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90400K .......... .......... .......... .......... .......... 97% 425M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90450K .......... .......... .......... .......... .......... 97% 354M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90500K .......... .......... .......... .......... .......... 97% 424M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90550K .......... .......... .......... .......... .......... 97% 422M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90600K .......... .......... .......... .......... .......... 97% 429M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90650K .......... .......... .......... .......... .......... 97% 383M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90700K .......... .......... .......... .......... .......... 97% 421M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90750K .......... .......... .......... .......... .......... 97% 425M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90800K .......... .......... .......... .......... .......... 97% 416M 0s 2024-03-04T12:49:14.835 INFO:teuthology.orchestra.run.smithi090.stderr: 90850K .......... .......... .......... .......... .......... 97% 332M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 90900K .......... .......... .......... .......... .......... 97% 457M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 90950K .......... .......... .......... .......... .......... 97% 455M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91000K .......... .......... .......... .......... .......... 98% 472M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91050K .......... .......... .......... .......... .......... 98% 4.25M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91100K .......... .......... .......... .......... .......... 98% 36.7M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91150K .......... .......... .......... .......... .......... 98% 71.5M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91200K .......... .......... .......... .......... .......... 98% 110M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91250K .......... .......... .......... .......... .......... 98% 27.1M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91300K .......... .......... .......... .......... .......... 98% 47.7M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91350K .......... .......... .......... .......... .......... 98% 50.0M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91400K .......... .......... .......... .......... .......... 98% 91.2M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91450K .......... .......... .......... .......... .......... 98% 72.5M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91500K .......... .......... .......... .......... .......... 98% 46.2M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91550K .......... .......... .......... .......... .......... 98% 29.9M 0s 2024-03-04T12:49:14.836 INFO:teuthology.orchestra.run.smithi090.stderr: 91600K .......... .......... .......... .......... .......... 98% 38.1M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 91650K .......... .......... .......... .......... .......... 98% 45.4M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 91700K .......... .......... .......... .......... .......... 98% 80.9M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 91750K .......... .......... .......... .......... .......... 98% 33.0M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 91800K .......... .......... .......... .......... .......... 98% 41.1M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 91850K .......... .......... .......... .......... .......... 98% 37.2M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 91900K .......... .......... .......... .......... .......... 98% 122M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 91950K .......... .......... .......... .......... .......... 99% 33.7M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 92000K .......... .......... .......... .......... .......... 99% 39.1M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 92050K .......... .......... .......... .......... .......... 99% 32.2M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 92100K .......... .......... .......... .......... .......... 99% 28.1M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 92150K .......... .......... .......... .......... .......... 99% 113M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 92200K .......... .......... .......... .......... .......... 99% 45.5M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 92250K .......... .......... .......... .......... .......... 99% 46.0M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 92300K .......... .......... .......... .......... .......... 99% 36.5M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 92350K .......... .......... .......... .......... .......... 99% 113M 0s 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi090.stderr: 92400K .......... .......... .......... .......... .......... 99% 37.4M 0s 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr: 92450K .......... .......... .......... .......... .......... 99% 37.8M 0s 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr: 92500K .......... .......... .......... .......... .......... 99% 102M 0s 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr: 92550K .......... .......... .......... .......... .......... 99% 48.4M 0s 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr: 92600K .......... .......... .......... .......... .......... 99% 117M 0s 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr: 92650K .......... .......... .......... .......... .......... 99% 78.2M 0s 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr: 92700K .......... .......... .......... .......... .......... 99% 31.6M 0s 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr: 92750K .......... .......... .......... .......... .......... 99% 102M 0s 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr: 92800K .......... .......... .......... .......... .......... 99% 103M 0s 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr: 92850K .......... .......... .......... .......... .......... 99% 79.4M 0s 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr: 92900K 100% 134G=1.6s 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04 12:49:14 (55.4 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-03-04T12:49:14.838 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-03-04T12:49:14.893 INFO:teuthology.orchestra.run.smithi090.stdout:Archive: gradle-6.0.1-bin.zip 2024-03-04T12:49:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-03-04T12:49:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-03-04T12:49:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-03-04T12:49:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-03-04T12:49:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-03-04T12:49:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-03-04T12:49:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-03-04T12:49:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-03-04T12:49:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-03-04T12:49:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-03-04T12:49:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-03-04T12:49:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-03-04T12:49:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-03-04T12:49:14.906 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-03-04T12:49:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-03-04T12:49:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-03-04T12:49:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-03-04T12:49:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-03-04T12:49:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-03-04T12:49:14.925 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-03-04T12:49:14.925 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-03-04T12:49:14.926 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-03-04T12:49:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-03-04T12:49:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-03-04T12:49:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-03-04T12:49:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-03-04T12:49:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-03-04T12:49:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-03-04T12:49:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-03-04T12:49:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-03-04T12:49:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-03-04T12:49:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-03-04T12:49:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-03-04T12:49:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-03-04T12:49:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-03-04T12:49:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-03-04T12:49:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-03-04T12:49:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-03-04T12:49:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-03-04T12:49:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-03-04T12:49:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-03-04T12:49:15.173 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-03-04T12:49:15.173 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-03-04T12:49:15.173 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-03-04T12:49:15.173 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-03-04T12:49:15.225 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-03-04T12:49:15.225 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-03-04T12:49:15.225 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-03-04T12:49:15.225 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-03-04T12:49:15.225 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-03-04T12:49:15.241 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-03-04T12:49:15.242 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-03-04T12:49:15.244 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-03-04T12:49:15.245 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-03-04T12:49:15.245 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-03-04T12:49:15.245 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-03-04T12:49:15.246 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-03-04T12:49:15.261 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-03-04T12:49:15.261 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-03-04T12:49:15.261 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-03-04T12:49:15.262 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-03-04T12:49:15.263 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-03-04T12:49:15.264 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-03-04T12:49:15.265 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-03-04T12:49:15.268 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-03-04T12:49:15.268 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-03-04T12:49:15.282 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-03-04T12:49:15.286 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-03-04T12:49:15.289 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-03-04T12:49:15.291 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-03-04T12:49:15.291 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-03-04T12:49:15.293 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-03-04T12:49:15.295 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-03-04T12:49:15.295 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-03-04T12:49:15.298 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-03-04T12:49:15.300 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-03-04T12:49:15.317 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-03-04T12:49:15.317 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-03-04T12:49:15.326 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-03-04T12:49:15.326 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-03-04T12:49:15.327 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-03-04T12:49:15.327 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-03-04T12:49:15.327 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-03-04T12:49:15.334 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-03-04T12:49:15.334 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-03-04T12:49:15.336 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-03-04T12:49:15.337 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-03-04T12:49:15.337 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-03-04T12:49:15.337 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-03-04T12:49:15.337 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-03-04T12:49:15.337 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-03-04T12:49:15.337 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-03-04T12:49:15.337 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-03-04T12:49:15.337 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-03-04T12:49:15.337 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-03-04T12:49:15.339 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-03-04T12:49:15.339 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-03-04T12:49:15.339 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-03-04T12:49:15.339 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-03-04T12:49:15.339 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-03-04T12:49:15.339 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-03-04T12:49:15.339 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-03-04T12:49:15.340 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-03-04T12:49:15.340 INFO:teuthology.orchestra.run.smithi090.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-03-04T12:49:15.340 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-03-04T12:49:15.341 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-03-04T12:49:15.341 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-03-04T12:49:15.341 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-03-04T12:49:15.342 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-03-04T12:49:15.343 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-03-04T12:49:15.345 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-03-04T12:49:15.346 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-03-04T12:49:15.517 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-03-04T12:49:15.517 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-03-04T12:49:15.517 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-03-04T12:49:15.517 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-03-04T12:49:15.517 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-03-04T12:49:15.517 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-03-04T12:49:15.517 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-03-04T12:49:15.517 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-03-04T12:49:15.517 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-03-04T12:49:15.517 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-03-04T12:49:15.517 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-03-04T12:49:15.518 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-03-04T12:49:15.518 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-03-04T12:49:15.518 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-03-04T12:49:15.518 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-03-04T12:49:15.518 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-03-04T12:49:15.518 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-03-04T12:49:15.518 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-03-04T12:49:15.518 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-03-04T12:49:15.518 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-03-04T12:49:15.519 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-03-04T12:49:15.520 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-03-04T12:49:15.521 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-03-04T12:49:15.522 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-03-04T12:49:15.523 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-03-04T12:49:15.523 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-03-04T12:49:15.523 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-03-04T12:49:15.523 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-03-04T12:49:15.523 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-03-04T12:49:15.524 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-03-04T12:49:15.555 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-03-04T12:49:15.556 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-03-04T12:49:15.556 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-03-04T12:49:15.556 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-03-04T12:49:15.557 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-03-04T12:49:15.558 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-03-04T12:49:15.558 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-03-04T12:49:15.559 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-03-04T12:49:15.561 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-03-04T12:49:15.561 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-03-04T12:49:15.562 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-03-04T12:49:15.562 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-03-04T12:49:15.563 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-03-04T12:49:15.564 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-03-04T12:49:15.564 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-03-04T12:49:15.567 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-03-04T12:49:15.567 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-03-04T12:49:15.567 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-03-04T12:49:15.567 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-03-04T12:49:15.567 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-03-04T12:49:15.567 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-03-04T12:49:15.567 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-03-04T12:49:15.567 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-03-04T12:49:15.568 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-03-04T12:49:15.569 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-03-04T12:49:15.573 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-03-04T12:49:15.574 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-03-04T12:49:15.575 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-03-04T12:49:15.575 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-03-04T12:49:15.575 INFO:teuthology.orchestra.run.smithi090.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-03-04T12:49:15.614 INFO:teuthology.orchestra.run.smithi090.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-03-04T12:49:15.932 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:15.932 INFO:teuthology.orchestra.run.smithi090.stdout:Welcome to Gradle 6.0.1! 2024-03-04T12:49:15.932 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:15.932 INFO:teuthology.orchestra.run.smithi090.stdout:Here are the highlights of this release: 2024-03-04T12:49:15.932 INFO:teuthology.orchestra.run.smithi090.stdout: - Substantial improvements in dependency management, including 2024-03-04T12:49:15.932 INFO:teuthology.orchestra.run.smithi090.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-03-04T12:49:15.932 INFO:teuthology.orchestra.run.smithi090.stdout: - Advanced control of transitive versions 2024-03-04T12:49:15.932 INFO:teuthology.orchestra.run.smithi090.stdout: - Support for optional features and dependencies 2024-03-04T12:49:15.932 INFO:teuthology.orchestra.run.smithi090.stdout: - Rules to tweak published metadata 2024-03-04T12:49:15.933 INFO:teuthology.orchestra.run.smithi090.stdout: - Support for Java 13 2024-03-04T12:49:15.933 INFO:teuthology.orchestra.run.smithi090.stdout: - Faster incremental Java and Groovy compilation 2024-03-04T12:49:15.933 INFO:teuthology.orchestra.run.smithi090.stdout: - New Zinc compiler for Scala 2024-03-04T12:49:15.933 INFO:teuthology.orchestra.run.smithi090.stdout: - VS2019 support 2024-03-04T12:49:15.933 INFO:teuthology.orchestra.run.smithi090.stdout: - Support for Gradle Enterprise plugin 3.0 2024-03-04T12:49:15.933 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:15.936 INFO:teuthology.orchestra.run.smithi090.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-03-04T12:49:15.936 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:15.937 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:15.937 INFO:teuthology.orchestra.run.smithi090.stdout:------------------------------------------------------------ 2024-03-04T12:49:15.937 INFO:teuthology.orchestra.run.smithi090.stdout:Gradle 6.0.1 2024-03-04T12:49:15.937 INFO:teuthology.orchestra.run.smithi090.stdout:------------------------------------------------------------ 2024-03-04T12:49:15.937 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:15.937 INFO:teuthology.orchestra.run.smithi090.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-03-04T12:49:15.937 INFO:teuthology.orchestra.run.smithi090.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-03-04T12:49:15.937 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:15.937 INFO:teuthology.orchestra.run.smithi090.stdout:Kotlin: 1.3.50 2024-03-04T12:49:15.937 INFO:teuthology.orchestra.run.smithi090.stdout:Groovy: 2.5.8 2024-03-04T12:49:15.937 INFO:teuthology.orchestra.run.smithi090.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-03-04T12:49:15.937 INFO:teuthology.orchestra.run.smithi090.stdout:JVM: 11.0.18 (Red Hat, Inc. 11.0.18+10-LTS) 2024-03-04T12:49:15.938 INFO:teuthology.orchestra.run.smithi090.stdout:OS: Linux 5.14.0-427.el9.x86_64 amd64 2024-03-04T12:49:15.938 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:15.938 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-03-04T12:49:15.938 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-03-04T12:49:15.938 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi090.front.sepia.ceph.com 2024-03-04T12:49:15.938 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-03-04T12:49:15.938 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi184.front.sepia.ceph.com 2024-03-04T12:49:15.938 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-03-04T12:49:16.258 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-03-04T12:49:16.258 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-03-04T12:49:16.259 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'IZSGHRIFKBNRJFNKSXIK', 'access_secret': 'Y1lYRfYTG8fjbuUnx2lIHFuRymK/JdRLLWbWjb00TiwlPBDAINW/Ag==', 'region': 'mexico', 'endpoint': 'smithi090.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi090.front.sepia.ceph.com'} 2024-03-04T12:49:16.259 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-03-04T12:49:16.259 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'IZSGHRIFKBNRJFNKSXIK', '--secret', 'Y1lYRfYTG8fjbuUnx2lIHFuRymK/JdRLLWbWjb00TiwlPBDAINW/Ag==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-03-04T12:49:16.259 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key IZSGHRIFKBNRJFNKSXIK --secret Y1lYRfYTG8fjbuUnx2lIHFuRymK/JdRLLWbWjb00TiwlPBDAINW/Ag== --email tester.client.0_test@test.test --cluster ceph 2024-03-04T12:49:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:49:16.321 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:49:16.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.345+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.346+0000 7f94bcd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:16.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.346+0000 7f94bcd2b800 20 realm 2024-03-04T12:49:16.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.346+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.346+0000 7f94bcd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:16.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.346+0000 7f94bcd2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:49:16.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.346+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.346+0000 7f94bcd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:16.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.346+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.347+0000 7f94bcd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:49:16.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.347+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.348+0000 7f94bcd2b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:49:16.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.348+0000 7f94bcd2b800 20 searching for the correct realm 2024-03-04T12:49:16.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.352+0000 7f94b8153640 0 -- 172.21.15.90:0/2420464088 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f94ac07a070 msgr2=0x7f94ac07a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:49:16.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.557+0000 7f94b8954640 0 -- 172.21.15.90:0/2420464088 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f94ac094920 msgr2=0x7f94ac04d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:49:16.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.764+0000 7f94bcd2b800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:49:16.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.764+0000 7f94bcd2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:49:16.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.764+0000 7f94bcd2b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:49:16.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.764+0000 7f94bcd2b800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:49:16.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.764+0000 7f94bcd2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:49:16.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.764+0000 7f94bcd2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:49:16.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.764+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.764+0000 7f94bcd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:16.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.764+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.764+0000 7f94bcd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:49:16.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.764+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.765+0000 7f94bcd2b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:49:16.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.765+0000 7f94bcd2b800 20 zone default found 2024-03-04T12:49:16.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.765+0000 7f94bcd2b800 4 Realm: () 2024-03-04T12:49:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.765+0000 7f94bcd2b800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:49:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.765+0000 7f94bcd2b800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:49:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.765+0000 7f94bcd2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:49:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.765+0000 7f94bcd2b800 20 zonegroup default 2024-03-04T12:49:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.765+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.765+0000 7f94bcd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.765+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.765+0000 7f94bcd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.765+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.766+0000 7f94bcd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.766+0000 7f94bcd2b800 20 started sync module instance, tier type = 2024-03-04T12:49:16.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.766+0000 7f94bcd2b800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:49:16.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.775+0000 7f94bcd2b800 20 add_watcher() i=0 2024-03-04T12:49:16.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.775+0000 7f94bcd2b800 20 add_watcher() i=1 2024-03-04T12:49:16.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.775+0000 7f94bcd2b800 20 add_watcher() i=2 2024-03-04T12:49:16.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.775+0000 7f94bcd2b800 20 add_watcher() i=3 2024-03-04T12:49:16.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.775+0000 7f94bcd2b800 20 add_watcher() i=4 2024-03-04T12:49:16.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.775+0000 7f94bcd2b800 20 add_watcher() i=5 2024-03-04T12:49:16.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.775+0000 7f94bcd2b800 20 add_watcher() i=6 2024-03-04T12:49:16.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.776+0000 7f94bcd2b800 20 add_watcher() i=7 2024-03-04T12:49:16.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.776+0000 7f94bcd2b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:49:16.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.778+0000 7f936efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:49:16.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.778+0000 7f94bcd2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:49:16.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.778+0000 7f94bcd2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:49:16.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.778+0000 7f94bcd2b800 5 note: GC not initialized 2024-03-04T12:49:16.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.778+0000 7f936dfe3640 20 reqs_thread_entry: start 2024-03-04T12:49:16.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.778+0000 7f94bcd2b800 20 init_complete bucket index max shards: 11 2024-03-04T12:49:16.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.778+0000 7f94bcd2b800 20 Filter name: none 2024-03-04T12:49:16.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.778+0000 7f92df7fe640 20 reqs_thread_entry: start 2024-03-04T12:49:16.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.778+0000 7f94bcd2b800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-03-04T12:49:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.778+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-03-04T12:49:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-04T12:49:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-03-04T12:49:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-03-04T12:49:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-04T12:49:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 10 cache get: name=default.rgw.meta+users.keys+IZSGHRIFKBNRJFNKSXIK : miss 2024-03-04T12:49:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 20 rados->read ofs=0 len=0 2024-03-04T12:49:16.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:16.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 10 cache put: name=default.rgw.meta+users.keys+IZSGHRIFKBNRJFNKSXIK info.flags=0x0 2024-03-04T12:49:16.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 10 adding default.rgw.meta+users.keys+IZSGHRIFKBNRJFNKSXIK to cache LRU end 2024-03-04T12:49:16.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 10 cache get: name=default.rgw.meta+users.keys+IZSGHRIFKBNRJFNKSXIK : hit (negative entry) 2024-03-04T12:49:16.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.779+0000 7f94bcd2b800 10 cache get: name=default.rgw.meta+users.keys+IZSGHRIFKBNRJFNKSXIK : hit (negative entry) 2024-03-04T12:49:16.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.781+0000 7f94bcd2b800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-03-04T12:49:16.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.781+0000 7f94bcd2b800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-04T12:49:16.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.781+0000 7f94bcd2b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-03-04T12:49:16.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.781+0000 7f938ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824089 cookie 94366472743232 notifier 7404 bl.length()=637 2024-03-04T12:49:16.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.781+0000 7f938ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-03-04T12:49:16.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.781+0000 7f938ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-04T12:49:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.783+0000 7f94bcd2b800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-03-04T12:49:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.783+0000 7f94bcd2b800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-04T12:49:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.783+0000 7f94bcd2b800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-03-04T12:49:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.783+0000 7f938ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824030 cookie 94366472729296 notifier 7404 bl.length()=200 2024-03-04T12:49:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.783+0000 7f938ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-03-04T12:49:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.783+0000 7f938ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-04T12:49:16.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.785+0000 7f94bcd2b800 10 cache put: name=default.rgw.meta+users.keys+IZSGHRIFKBNRJFNKSXIK info.flags=0x7 2024-03-04T12:49:16.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.785+0000 7f94bcd2b800 10 moving default.rgw.meta+users.keys+IZSGHRIFKBNRJFNKSXIK to cache LRU end 2024-03-04T12:49:16.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.785+0000 7f94bcd2b800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:IZSGHRIFKBNRJFNKSXIK, ofs0, ns] 2024-03-04T12:49:16.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.785+0000 7f938f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824031 cookie 94366472729296 notifier 7404 bl.length()=189 2024-03-04T12:49:16.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.785+0000 7f938f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IZSGHRIFKBNRJFNKSXIK info.flags=0x7 2024-03-04T12:49:16.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.785+0000 7f938f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IZSGHRIFKBNRJFNKSXIK to cache LRU end 2024-03-04T12:49:16.792 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T12:49:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "user_id": "tester.client.0", 2024-03-04T12:49:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "display_name": "Ms. tester.client.0", 2024-03-04T12:49:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "email": "tester.client.0_test@test.test", 2024-03-04T12:49:16.792 INFO:teuthology.orchestra.run.smithi090.stdout: "suspended": 0, 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "max_buckets": 1000, 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "subusers": [], 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "keys": [ 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "user": "tester.client.0", 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "access_key": "IZSGHRIFKBNRJFNKSXIK", 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "secret_key": "Y1lYRfYTG8fjbuUnx2lIHFuRymK/JdRLLWbWjb00TiwlPBDAINW/Ag==", 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "active": true 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "swift_keys": [], 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": [], 2024-03-04T12:49:16.793 INFO:teuthology.orchestra.run.smithi090.stdout: "op_mask": "read, write, delete", 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "default_placement": "", 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "default_storage_class": "", 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "placement_tags": [], 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "bucket_quota": { 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "user_quota": { 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:49:16.794 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:49:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:49:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:49:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "temp_url_keys": [], 2024-03-04T12:49:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "rgw", 2024-03-04T12:49:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: "mfa_ids": [] 2024-03-04T12:49:16.795 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T12:49:16.795 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:16.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.787+0000 7f936efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:49:16.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.789+0000 7f94bcd2b800 20 remove_watcher() i=0 2024-03-04T12:49:16.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.789+0000 7f94bcd2b800 2 removed watcher, disabling cache 2024-03-04T12:49:16.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.790+0000 7f94bcd2b800 20 remove_watcher() i=1 2024-03-04T12:49:16.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.791+0000 7f94bcd2b800 20 remove_watcher() i=2 2024-03-04T12:49:16.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.793+0000 7f94bcd2b800 20 remove_watcher() i=3 2024-03-04T12:49:16.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.794+0000 7f94bcd2b800 20 remove_watcher() i=4 2024-03-04T12:49:16.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.795+0000 7f94bcd2b800 20 remove_watcher() i=5 2024-03-04T12:49:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.795+0000 7f94bcd2b800 20 remove_watcher() i=6 2024-03-04T12:49:16.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:16.796+0000 7f94bcd2b800 20 remove_watcher() i=7 2024-03-04T12:49:16.814 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:49:16.814 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-03-04T12:49:16.843 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-03-04T12:49:16.844 DEBUG:teuthology.orchestra.run.smithi090:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-03-04T12:49:16.908 DEBUG:teuthology.orchestra.run.smithi090:> radosgw-admin gc process --include-all 2024-03-04T12:49:16.997 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:49:16.998 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:49:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.024+0000 7f411112f800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.026+0000 7f411112f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.026+0000 7f411112f800 20 realm 2024-03-04T12:49:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.026+0000 7f411112f800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.026+0000 7f411112f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.026+0000 7f411112f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:49:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.026+0000 7f411112f800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.026+0000 7f411112f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.026+0000 7f411112f800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.027+0000 7f411112f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:49:17.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.027+0000 7f411112f800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.027+0000 7f411112f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:49:17.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.028+0000 7f411112f800 20 searching for the correct realm 2024-03-04T12:49:17.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.031+0000 7f410d5f8640 0 -- 172.21.15.90:0/2974252386 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x562400adcc40 msgr2=0x562400adf100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:49:17.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.034+0000 7f410cdf7640 0 -- 172.21.15.90:0/2974252386 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f40f4009040 msgr2=0x7f40f4056420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:49:17.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 zone default found 2024-03-04T12:49:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 4 Realm: () 2024-03-04T12:49:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:49:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:49:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:49:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 zonegroup default 2024-03-04T12:49:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.039+0000 7f411112f800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.040+0000 7f411112f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.040+0000 7f411112f800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.040+0000 7f411112f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.040+0000 7f411112f800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.040+0000 7f411112f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.040+0000 7f411112f800 20 started sync module instance, tier type = 2024-03-04T12:49:17.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.040+0000 7f411112f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:49:17.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.049+0000 7f411112f800 20 add_watcher() i=0 2024-03-04T12:49:17.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.049+0000 7f411112f800 20 add_watcher() i=1 2024-03-04T12:49:17.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.049+0000 7f411112f800 20 add_watcher() i=2 2024-03-04T12:49:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.049+0000 7f411112f800 20 add_watcher() i=3 2024-03-04T12:49:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.049+0000 7f411112f800 20 add_watcher() i=4 2024-03-04T12:49:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.049+0000 7f411112f800 20 add_watcher() i=5 2024-03-04T12:49:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.049+0000 7f411112f800 20 add_watcher() i=6 2024-03-04T12:49:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.050+0000 7f411112f800 20 add_watcher() i=7 2024-03-04T12:49:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.050+0000 7f411112f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:49:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.052+0000 7f3fc2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:49:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.052+0000 7f411112f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:49:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.052+0000 7f411112f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:49:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.088+0000 7f3fc1fe3640 20 reqs_thread_entry: start 2024-03-04T12:49:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.088+0000 7f411112f800 20 init_complete bucket index max shards: 11 2024-03-04T12:49:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.088+0000 7f411112f800 20 Filter name: none 2024-03-04T12:49:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.088+0000 7f3f337fe640 20 reqs_thread_entry: start 2024-03-04T12:49:17.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.088+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:49:17.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.090+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.090+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-03-04T12:49:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_1_9e9c2623d4a7d045babc8d6140e6c719', time=2024-03-04T14:45:03.164145+0000, chain.objs.size()=2 2024-03-04T12:49:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_0 2024-03-04T12:49:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_1 2024-03-04T12:49:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.2_67bc19265e03d855e0e6a78b2e8523e3', time=2024-03-04T14:45:03.212641+0000, chain.objs.size()=3 2024-03-04T12:49:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.1 2024-03-04T12:49:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.2 2024-03-04T12:49:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.3 2024-03-04T12:49:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10940711117398106267', time=2024-03-04T14:46:12.646240+0000, chain.objs.size()=1 2024-03-04T12:49:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.t3FLqVMFDNwMjWEmGR4yEidFluQnR2G_0 2024-03-04T12:49:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8059950315360569708', time=2024-03-04T14:46:13.879657+0000, chain.objs.size()=1 2024-03-04T12:49:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.S6K4nsioLtweKO4CpUozy0xiQI9YDcG_0 2024-03-04T12:49:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10790484892174755915', time=2024-03-04T14:46:13.880592+0000, chain.objs.size()=1 2024-03-04T12:49:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.4h2kqtZcQ4JnkiF-820r16lcAnFpU91_0 2024-03-04T12:49:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4953512940606861911', time=2024-03-04T14:46:13.891271+0000, chain.objs.size()=1 2024-03-04T12:49:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.YwLF3DU2_0jRWPr-NK0VpnHWcNQdMKq_0 2024-03-04T12:49:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9225284128308370038', time=2024-03-04T14:46:48.286788+0000, chain.objs.size()=1 2024-03-04T12:49:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.hUwG6Nysch_GwE7PK2blEj4QXSoz3VR_0 2024-03-04T12:49:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5962166095459374870', time=2024-03-04T14:47:21.476528+0000, chain.objs.size()=1 2024-03-04T12:49:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.oAE55BlaKp_26I36AZPZQD5vVdHU5f7_0 2024-03-04T12:49:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18093324458749294692', time=2024-03-04T14:47:56.454960+0000, chain.objs.size()=1 2024-03-04T12:49:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.091+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.Vh_02GeDDHk3tXijSPDUjTslGwzrtC2_0 2024-03-04T12:49:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.092+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7619407008599107904', time=2024-03-04T14:47:56.455815+0000, chain.objs.size()=1 2024-03-04T12:49:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.092+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.c9q1m_mIXV7ICOgH4CrJr8r9_wWH4MW_0 2024-03-04T12:49:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.093+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8953242481786441269', time=2024-03-04T14:47:56.457828+0000, chain.objs.size()=1 2024-03-04T12:49:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.093+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.4OYzNxmdPiW9sktI0jHBcm2tKvwlL87_0 2024-03-04T12:49:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.093+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12812803407807373657', time=2024-03-04T14:48:28.523159+0000, chain.objs.size()=1 2024-03-04T12:49:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.093+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17__shadow_.4ZuLyMxj_LE8V0mvMbwArgs6WcY_8ws_0 2024-03-04T12:49:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.093+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11863900647692446690', time=2024-03-04T14:48:35.972270+0000, chain.objs.size()=1 2024-03-04T12:49:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.093+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18__shadow:M7AGC11b8ap6iMaPoVKm-i2sZMpjU-F_.fg4Da2BSmsyEYlzJ9wRhGLcNIAyDQgr_0 2024-03-04T12:49:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.094+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.096+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:49:17.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-04T12:49:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13243424865187786640', time=2024-03-04T14:45:02.994061+0000, chain.objs.size()=1 2024-03-04T12:49:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.ebXzYELir-4-akVpDrRtsQDJkUSlmuZ_0 2024-03-04T12:49:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17561105583866408347', time=2024-03-04T14:46:12.639217+0000, chain.objs.size()=1 2024-03-04T12:49:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.x8JXG7ufYNvFpkWFnsdiFVBEQ79_Utt_0 2024-03-04T12:49:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13724156504019162738', time=2024-03-04T14:46:13.883605+0000, chain.objs.size()=1 2024-03-04T12:49:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.WFOjp5AxVQ2x2YTG3Jp0ibk-jCgjQFA_0 2024-03-04T12:49:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9376490227923501978', time=2024-03-04T14:46:13.884274+0000, chain.objs.size()=1 2024-03-04T12:49:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.tTj9GHTFJ6gKuji3Gvge1hZLNw_5heu_0 2024-03-04T12:49:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15000432058701143608', time=2024-03-04T14:46:45.959519+0000, chain.objs.size()=1 2024-03-04T12:49:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.g1tcIqGqkllTB6St74sxCrqIljTdxL0_0 2024-03-04T12:49:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10483321257996941613', time=2024-03-04T14:47:22.129356+0000, chain.objs.size()=1 2024-03-04T12:49:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.lT_lNxe-0_NQUkwYUaQ-2E5a_PKZmjF_0 2024-03-04T12:49:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17416716861879790855', time=2024-03-04T14:47:22.137848+0000, chain.objs.size()=1 2024-03-04T12:49:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.i82BkmR35Me0GzLhzUt0ZjDFL_ubjkf_0 2024-03-04T12:49:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17411119268803665343', time=2024-03-04T14:47:56.151869+0000, chain.objs.size()=1 2024-03-04T12:49:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.098+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.21mHC-WDeI354C4biozAJTHt839WKnT_0 2024-03-04T12:49:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.100+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.102+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:49:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.104+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-03-04T12:49:17.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4448641747401922174', time=2024-03-04T14:45:02.980916+0000, chain.objs.size()=1 2024-03-04T12:49:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.J748fjT5QAbLHvVWDtti4bHasRTtQti_0 2024-03-04T12:49:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13232151550821571829', time=2024-03-04T14:45:03.366634+0000, chain.objs.size()=1 2024-03-04T12:49:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8__shadow_.sJeLN2jsvyooUZVTAZrPBTsf906MFzR_0 2024-03-04T12:49:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16297292098869002634', time=2024-03-04T14:46:12.636178+0000, chain.objs.size()=1 2024-03-04T12:49:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.-l6_p5VqqRFWH3IQw3sNZ_9E8OplXzl_0 2024-03-04T12:49:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13687873919070890207', time=2024-03-04T14:46:45.954679+0000, chain.objs.size()=1 2024-03-04T12:49:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.kMPzqlhrtN1SqT2odN-c2hjmCwk_Fbn_0 2024-03-04T12:49:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2532517556529248501', time=2024-03-04T14:46:48.285129+0000, chain.objs.size()=1 2024-03-04T12:49:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.CPc5RC_tf-g6uBekKHLUy2iGigcMZno_0 2024-03-04T12:49:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11000741239102215486', time=2024-03-04T14:46:48.295155+0000, chain.objs.size()=1 2024-03-04T12:49:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_._QE-cgZ3dJ3WmQiyUqgahT-UToEfmlm_0 2024-03-04T12:49:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4396936252289354919', time=2024-03-04T14:47:22.138374+0000, chain.objs.size()=1 2024-03-04T12:49:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.VF47R2JJ_GNEFYb8tgDGzYu3P-GECnL_0 2024-03-04T12:49:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8800337133782780895', time=2024-03-04T14:47:54.913482+0000, chain.objs.size()=1 2024-03-04T12:49:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.DHAeRH15OsxJVuwfeGTGGsoYlqdqa2k_0 2024-03-04T12:49:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.816249889732547', time=2024-03-04T14:48:28.522488+0000, chain.objs.size()=1 2024-03-04T12:49:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.105+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17__shadow_.N_u8aXzGqUBZAQVJjt_IO0JQpl57q2N_0 2024-03-04T12:49:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.107+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.109+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:49:17.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.110+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-03-04T12:49:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1_1_2275a546903cf0f5aaabc79bebf2ab40', time=2024-03-04T14:45:03.223845+0000, chain.objs.size()=5 2024-03-04T12:49:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1 2024-03-04T12:49:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1_1 2024-03-04T12:49:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.2 2024-03-04T12:49:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.2_1 2024-03-04T12:49:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.3 2024-03-04T12:49:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10509456626276625691', time=2024-03-04T14:45:03.274873+0000, chain.objs.size()=1 2024-03-04T12:49:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.UolwZ1aszqPgj_oyXGrF0KEhNaK1B39_0 2024-03-04T12:49:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4859904179692526410', time=2024-03-04T14:46:45.963522+0000, chain.objs.size()=1 2024-03-04T12:49:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.RfxfE1VY2u6tk-ZdlDaU_2m-Xb-PKJg_0 2024-03-04T12:49:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1734282186950766194', time=2024-03-04T14:46:48.288560+0000, chain.objs.size()=1 2024-03-04T12:49:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.KdoHp9n-FpY8-7oR02yxzvXPIKS-BcA_0 2024-03-04T12:49:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9659188461041500787', time=2024-03-04T14:47:19.946851+0000, chain.objs.size()=1 2024-03-04T12:49:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.zL7IjgC5LSRabIPEQwJmgN_4SBUoaY2_0 2024-03-04T12:49:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3324503506514073500', time=2024-03-04T14:47:19.948681+0000, chain.objs.size()=1 2024-03-04T12:49:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.ifRWpWxFfVlsP9oJDOinY9NX6nclDJv_0 2024-03-04T12:49:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5432465068220261894', time=2024-03-04T14:47:56.454523+0000, chain.objs.size()=1 2024-03-04T12:49:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.Ep4NUNas67B6PeZD_MXtY9bQjmhYAIZ_0 2024-03-04T12:49:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.291562393428385199', time=2024-03-04T14:48:27.803357+0000, chain.objs.size()=1 2024-03-04T12:49:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.111+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.i8PL4fQMgoX0abv3MAwir0kP7t9N8bE_0 2024-03-04T12:49:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.113+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5784760853243639723', time=2024-03-04T14:48:27.805331+0000, chain.objs.size()=1 2024-03-04T12:49:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.113+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.XmlBsVBVRHv_oeNf8bpCavIS9ordxia_0 2024-03-04T12:49:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.114+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.117+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:49:17.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.118+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.118+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.119+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-04T12:49:17.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.119+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5639892658830847309', time=2024-03-04T14:46:12.637301+0000, chain.objs.size()=1 2024-03-04T12:49:17.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.119+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.H1VUxjnTfZf2wS66bmRIjag95BSn225_0 2024-03-04T12:49:17.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.119+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11307899577543895884', time=2024-03-04T14:46:13.890901+0000, chain.objs.size()=1 2024-03-04T12:49:17.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.119+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.Z7BJOlEz9du64rhcKF-NK7EoTuFU1Ji_0 2024-03-04T12:49:17.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.119+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.664715566147758390', time=2024-03-04T14:46:45.954805+0000, chain.objs.size()=1 2024-03-04T12:49:17.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.119+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.rqBolrMHg1-GL4DFErMqfco4iVphhFK_0 2024-03-04T12:49:17.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.119+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15914257926522197588', time=2024-03-04T14:47:19.950776+0000, chain.objs.size()=1 2024-03-04T12:49:17.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.119+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.Q7-cWQhxx5BKonJIJc_IO4mh2VzgUyF_0 2024-03-04T12:49:17.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.119+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18278432941857961282', time=2024-03-04T14:47:21.474621+0000, chain.objs.size()=1 2024-03-04T12:49:17.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.119+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.yeigRRYUgpQ-q3SXlkTRUi3pDqS8haS_0 2024-03-04T12:49:17.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.120+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.122+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:49:17.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.124+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.124+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T12:49:17.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6033768491510279195', time=2024-03-04T14:45:02.989758+0000, chain.objs.size()=1 2024-03-04T12:49:17.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.5WPt-YN2-791oooY5CdXVBcNPaf5vI-_0 2024-03-04T12:49:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11232157747667055242', time=2024-03-04T14:47:19.945391+0000, chain.objs.size()=1 2024-03-04T12:49:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.OaQWAr0qV0Bz2qzblil-M34LJqMVBHg_0 2024-03-04T12:49:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5963918881034230206', time=2024-03-04T14:47:19.947441+0000, chain.objs.size()=1 2024-03-04T12:49:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.ROOe3r7Ml4eXP0dJDLD7lXlJEE-zS7i_0 2024-03-04T12:49:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17945348010835653366', time=2024-03-04T14:47:21.483423+0000, chain.objs.size()=1 2024-03-04T12:49:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.xANWkB-ggJIChP4KyXhcHrfeSAOnRNu_0 2024-03-04T12:49:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8052718429342117653', time=2024-03-04T14:47:56.458784+0000, chain.objs.size()=1 2024-03-04T12:49:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.RgdcYHjisJSDkRKa8TzXCaJsXAuF0w6_0 2024-03-04T12:49:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6782147537813881582', time=2024-03-04T14:48:27.804537+0000, chain.objs.size()=1 2024-03-04T12:49:17.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.125+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.YHuMyfM69qep2bI4ACETIZD3rv_Zv4U_0 2024-03-04T12:49:17.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.126+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.128+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:49:17.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.130+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T12:49:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15215636884480252228', time=2024-03-04T14:46:11.928484+0000, chain.objs.size()=1 2024-03-04T12:49:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.qc5rRiI6DVkFCNzrHmVP7pI1UhWnEmy_0 2024-03-04T12:49:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15130628280908079950', time=2024-03-04T14:46:45.955568+0000, chain.objs.size()=1 2024-03-04T12:49:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.uzBUPFc07Zwsivutr65OvtBQsq5hAhk_0 2024-03-04T12:49:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14711313810700984818', time=2024-03-04T14:47:56.456720+0000, chain.objs.size()=1 2024-03-04T12:49:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.Yvv4JvzeHHAQ28l8LMY1URFT9dvC7Xt_0 2024-03-04T12:49:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.374654653496200755', time=2024-03-04T14:47:56.461211+0000, chain.objs.size()=1 2024-03-04T12:49:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.zH-Hf05YmfPSkPeyaUUDvlaFN62xS6M_0 2024-03-04T12:49:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.61039496309596862', time=2024-03-04T14:48:27.805890+0000, chain.objs.size()=1 2024-03-04T12:49:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.qwEyXYUpHybp9YQ0Edlg7ZSMyMIk8F1_0 2024-03-04T12:49:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7584474660265742247', time=2024-03-04T14:48:39.662180+0000, chain.objs.size()=1 2024-03-04T12:49:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.131+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18__shadow:tNIlo-V8RbbeoA4xG-LpwClIY9-qezj_.o6lbrn-QvRi1-IdWnbisOSWJo1Pb0ly_0 2024-03-04T12:49:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.133+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.135+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:49:17.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.137+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.137+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.137+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-03-04T12:49:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.137+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='_PTOt6IoguAfkDOqIZqOX88Oc2tS4eBp', time=2024-03-04T14:45:03.197280+0000, chain.objs.size()=3 2024-03-04T12:49:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.137+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.wgokfsORPIEEVM0liUwgacypBuVss8r_0 2024-03-04T12:49:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.137+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.wgokfsORPIEEVM0liUwgacypBuVss8r_1 2024-03-04T12:49:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.137+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.wgokfsORPIEEVM0liUwgacypBuVss8r_2 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.137+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14569185674393856301', time=2024-03-04T14:46:12.640147+0000, chain.objs.size()=1 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.137+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.eIP_WT7jH5j91IZ4I2ZH3B3HFxwiXev_0 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.137+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.958796137934986720', time=2024-03-04T14:46:45.955798+0000, chain.objs.size()=1 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.137+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.F3E4mWGleuC-y4G1cixRDSnK0lYkWWH_0 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17062657987574384196', time=2024-03-04T14:46:48.290111+0000, chain.objs.size()=1 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.EyDPmGkPWK2yNZYg7slfwkxj4PRZ_uP_0 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15955843278504387361', time=2024-03-04T14:47:19.945013+0000, chain.objs.size()=1 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.byXU0ne48-Ig2lozTe1VCUhH6KaJ2cB_0 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5030942503974818807', time=2024-03-04T14:47:19.949660+0000, chain.objs.size()=1 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.8mbwCpw2gSps-Cm_hmO8eBKyvfzOlya_0 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7586966705691572821', time=2024-03-04T14:47:21.479920+0000, chain.objs.size()=1 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.c9XgIC6p_hr9n47sIotsMm6jplqoewr_0 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5406667087294280899', time=2024-03-04T14:47:22.131028+0000, chain.objs.size()=1 2024-03-04T12:49:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.JTPYimtfFZux_rM2sjIucAwCtN4WjU2_0 2024-03-04T12:49:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5507825020976514652', time=2024-03-04T14:47:22.131653+0000, chain.objs.size()=1 2024-03-04T12:49:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.gUKfl1oRXaejBbQUh-h7rLdbPYCXScG_0 2024-03-04T12:49:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17804304345077353449', time=2024-03-04T14:47:22.132306+0000, chain.objs.size()=1 2024-03-04T12:49:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.138+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.mc6YH0WGC0HUtgaz4E0zxTB0eEz3Iwz_0 2024-03-04T12:49:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.140+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12830727382899401555', time=2024-03-04T14:47:53.981340+0000, chain.objs.size()=1 2024-03-04T12:49:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.140+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.IVQFUdqZfZETb36fm5T-k5AJCDQYH0Z_0 2024-03-04T12:49:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.140+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7989019019643779660', time=2024-03-04T14:47:54.912464+0000, chain.objs.size()=1 2024-03-04T12:49:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.140+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.70MpWkbMHruW0S3_GEKLmmx_fqsuN_E_0 2024-03-04T12:49:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.142+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.144+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:49:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.145+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-03-04T12:49:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='_Ag12p5qhdAMKsDXg08wUv2tN4kGgU_5', time=2024-03-04T14:45:03.137699+0000, chain.objs.size()=2 2024-03-04T12:49:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.2plAO1UrZ86B0hVKf8UjZptYSw1FNa3_0 2024-03-04T12:49:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.2plAO1UrZ86B0hVKf8UjZptYSw1FNa3_1 2024-03-04T12:49:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1_1_84254bc068a326e756f8cd8032864a32', time=2024-03-04T14:45:03.216405+0000, chain.objs.size()=5 2024-03-04T12:49:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1 2024-03-04T12:49:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1_1 2024-03-04T12:49:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.2 2024-03-04T12:49:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.2_1 2024-03-04T12:49:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.3 2024-03-04T12:49:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9265165539613524766', time=2024-03-04T14:46:13.890225+0000, chain.objs.size()=1 2024-03-04T12:49:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.146+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.C6sQm_Wf0BSu3qUgxrA_mxk8BzXHrs-_0 2024-03-04T12:49:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.147+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10855660210214510342', time=2024-03-04T14:46:48.286758+0000, chain.objs.size()=1 2024-03-04T12:49:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.147+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.gcpRq9peFqKfNvBOv9limSxWdaKKhK7_0 2024-03-04T12:49:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.147+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3408370500992864207', time=2024-03-04T14:47:19.950243+0000, chain.objs.size()=1 2024-03-04T12:49:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.147+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.87APKeh7xnFWnN-QDn2Jikb-lQHhm13_0 2024-03-04T12:49:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.147+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6146048946371919005', time=2024-03-04T14:47:21.480331+0000, chain.objs.size()=1 2024-03-04T12:49:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.147+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.xn2jJHhSaZ7qo4tGP7VNX3v6fT0NP1y_0 2024-03-04T12:49:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.147+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5800379310504200527', time=2024-03-04T14:47:54.916290+0000, chain.objs.size()=1 2024-03-04T12:49:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.147+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.kI9Ry5Tu7IGD7y1vUHptXmfd2TRGK1D_0 2024-03-04T12:49:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.149+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16004384242719217580', time=2024-03-04T14:47:54.921681+0000, chain.objs.size()=1 2024-03-04T12:49:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.149+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.erwf-tu8qPyuHt-z0MA_jXEwunJiRqS_0 2024-03-04T12:49:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.149+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7606747519197905264', time=2024-03-04T14:47:56.457870+0000, chain.objs.size()=1 2024-03-04T12:49:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.149+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.k7F5FxAWLQElZKBG5tpTP3kKQNqXPMR_0 2024-03-04T12:49:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.149+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17074067612384369535', time=2024-03-04T14:48:27.805994+0000, chain.objs.size()=1 2024-03-04T12:49:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.149+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.6vKBeNZevpeMjI1yDPL01hsHNK2Dhhr_0 2024-03-04T12:49:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.151+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.153+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:49:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.154+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.154+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-03-04T12:49:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12524464277266614591', time=2024-03-04T14:45:03.141425+0000, chain.objs.size()=1 2024-03-04T12:49:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.JiaCq-7DUIO8jSELxt17iRHEd-MVaTX_0 2024-03-04T12:49:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5538951145949265990', time=2024-03-04T14:45:03.149292+0000, chain.objs.size()=2 2024-03-04T12:49:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_0 2024-03-04T12:49:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_1 2024-03-04T12:49:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14088493918940893319', time=2024-03-04T14:45:03.278630+0000, chain.objs.size()=3 2024-03-04T12:49:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.NJRKUTwhvpaw6hKnz4ASxB-oQ7u4OxR_0 2024-03-04T12:49:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.NJRKUTwhvpaw6hKnz4ASxB-oQ7u4OxR_1 2024-03-04T12:49:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.NJRKUTwhvpaw6hKnz4ASxB-oQ7u4OxR_2 2024-03-04T12:49:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7526613213369234056', time=2024-03-04T14:46:12.639985+0000, chain.objs.size()=1 2024-03-04T12:49:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.37B9_61Gks9sR1wn7DbM6GINQ08lXe__0 2024-03-04T12:49:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15763727546514654328', time=2024-03-04T14:46:45.958152+0000, chain.objs.size()=1 2024-03-04T12:49:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.ADHAz-XcKJZXYr88jXgXZO3UKb6hz6D_0 2024-03-04T12:49:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11983228926308711925', time=2024-03-04T14:46:47.781500+0000, chain.objs.size()=1 2024-03-04T12:49:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.9cRHDbpbN-XgbpCt6CeyNiPxqRGY459_0 2024-03-04T12:49:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17547965900478878577', time=2024-03-04T14:46:48.287627+0000, chain.objs.size()=1 2024-03-04T12:49:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.WgMFqUFZP4N1rJkohzbdf_fPevqiu4r_0 2024-03-04T12:49:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7038499391405184986', time=2024-03-04T14:46:48.293072+0000, chain.objs.size()=1 2024-03-04T12:49:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.nH_mMNX-RlloXwu1PWJ7nqk4FGDQNMP_0 2024-03-04T12:49:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18240823190892148456', time=2024-03-04T14:46:48.294771+0000, chain.objs.size()=1 2024-03-04T12:49:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.155+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.CJqueRWi1Woj3LmpQTdU1id2luh7CC8_0 2024-03-04T12:49:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.157+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5106884564646413522', time=2024-03-04T14:47:21.475179+0000, chain.objs.size()=1 2024-03-04T12:49:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.157+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.EI566wfxLEb4CH_iOA1sqPj_d5l64Lc_0 2024-03-04T12:49:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.157+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11691565016238912510', time=2024-03-04T14:47:56.453960+0000, chain.objs.size()=1 2024-03-04T12:49:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.157+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.zo0iaNZ9leLnGfHfWZQCtgjg0qXHlTN_0 2024-03-04T12:49:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.158+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6374526699351681039', time=2024-03-04T14:48:27.804980+0000, chain.objs.size()=1 2024-03-04T12:49:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.158+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.ioRwGZn8r7HtsfSTDbi6edvqMSqCHPS_0 2024-03-04T12:49:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.158+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17052634604371917535', time=2024-03-04T14:48:27.806112+0000, chain.objs.size()=1 2024-03-04T12:49:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.158+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.fvWXXOVobcN_TywYhy6wsQQCfKLTO3x_0 2024-03-04T12:49:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.159+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.161+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:49:17.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.162+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-03-04T12:49:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='_4mXFfaXyH0Lzw38rF-2NbXizmDr_FqG', time=2024-03-04T14:45:03.204841+0000, chain.objs.size()=3 2024-03-04T12:49:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.At-mztM2riM63UmzqgTnqfnNbX3SPS__0 2024-03-04T12:49:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.At-mztM2riM63UmzqgTnqfnNbX3SPS__1 2024-03-04T12:49:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.At-mztM2riM63UmzqgTnqfnNbX3SPS__2 2024-03-04T12:49:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12055802830089599338', time=2024-03-04T14:46:12.640189+0000, chain.objs.size()=1 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.VR2aMMnysnBIN14tqLYSDcDPROwliY5_0 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10748048462140486841', time=2024-03-04T14:46:13.883525+0000, chain.objs.size()=1 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.qe89yp5tsjIPGpKvqv9B6VxuFW05Zjg_0 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2329816479123473249', time=2024-03-04T14:46:45.960593+0000, chain.objs.size()=1 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.HyWh3MkFhFmWrqaZoTU5EhML_Zsp84L_0 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3429639656868252760', time=2024-03-04T14:46:48.286976+0000, chain.objs.size()=1 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.2SVg6-XzRR6M56T39fH7ly-Mi1hIzLj_0 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3842896608122187470', time=2024-03-04T14:47:19.952388+0000, chain.objs.size()=1 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.g6CDHDEIbLvoK4fHu9LwfC8OsFj8HYn_0 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17465233746172041585', time=2024-03-04T14:47:22.128348+0000, chain.objs.size()=1 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.ggqHJY-Q2TmiRoxXlIzYmLICPTUG1wD_0 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9707180850560596256', time=2024-03-04T14:47:54.912075+0000, chain.objs.size()=1 2024-03-04T12:49:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_._b3qiGCH6U7xLPcXXQfM8ZHmj61QhuL_0 2024-03-04T12:49:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10765399473374118462', time=2024-03-04T14:47:54.915332+0000, chain.objs.size()=1 2024-03-04T12:49:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.g2X1roF30zLkEhpmu4Kx3xBnjeZFNWg_0 2024-03-04T12:49:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15442367830526420078', time=2024-03-04T14:48:27.807409+0000, chain.objs.size()=1 2024-03-04T12:49:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.163+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.DjbleXi5zetpjCoeGYd4tnaYT3OSijS_0 2024-03-04T12:49:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.166+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14004833488235692582', time=2024-03-04T14:48:27.809932+0000, chain.objs.size()=1 2024-03-04T12:49:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.166+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.JB7ej93M_CTG4hwBB3dYCjkHy8Lu4D6_0 2024-03-04T12:49:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.167+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.169+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:49:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.170+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.170+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-03-04T12:49:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='_5qGpQQ9kO49LbVRPoNiwfhL7Rt8lDro', time=2024-03-04T14:45:03.134029+0000, chain.objs.size()=2 2024-03-04T12:49:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.D3mFdGxZrREQmaxopSgjNIwk41Fm3hV_0 2024-03-04T12:49:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.D3mFdGxZrREQmaxopSgjNIwk41Fm3hV_1 2024-03-04T12:49:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='_05YWIC92c2TLy9TNKsR3W-8xmB7bpyd', time=2024-03-04T14:45:03.220380+0000, chain.objs.size()=1 2024-03-04T12:49:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.bxRnBQA-LMpPfQO5f9qLnEeUgtbyPdt_0 2024-03-04T12:49:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1277381903965407827', time=2024-03-04T14:46:12.640283+0000, chain.objs.size()=1 2024-03-04T12:49:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.AkcSU4F631VjcqjW_bLfA8I8SUurHN9_0 2024-03-04T12:49:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14132950734581466059', time=2024-03-04T14:46:13.884009+0000, chain.objs.size()=1 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.CCOj730pPtVHZghDot-y_Kc8JG0BSM4_0 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9526323776246503115', time=2024-03-04T14:46:45.955403+0000, chain.objs.size()=1 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.CA-bmChmyPVwgOwvxLENVt_QNL-C3PS_0 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1167495547033920455', time=2024-03-04T14:47:22.130415+0000, chain.objs.size()=1 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.SzlqUq3DR7uhpXfKVLx4uIz1cPEZbVA_0 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2884359888241939956', time=2024-03-04T14:47:54.913902+0000, chain.objs.size()=1 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.jZX7vy4vQlahXwyaTqXMI_i61IBLmme_0 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4799785825784805233', time=2024-03-04T14:47:54.916339+0000, chain.objs.size()=1 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.fJ8jkPfFOi-tIiefOJ6-f_DmUxIXaVs_0 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.58403847528457372', time=2024-03-04T14:47:54.917531+0000, chain.objs.size()=1 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.1Qwob9ohpXNfT2qNSwUwx1Oa4Js86oe_0 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1794658382647894075', time=2024-03-04T14:47:56.455955+0000, chain.objs.size()=1 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.zJ11cHRPo7rHYj2C6DlrJBiX7i7U0yj_0 2024-03-04T12:49:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5023846859680122784', time=2024-03-04T14:48:28.522966+0000, chain.objs.size()=1 2024-03-04T12:49:17.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.171+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17__shadow_.OogVDxAOm3vNOao3-e2-9u633EQ4WSi_0 2024-03-04T12:49:17.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.175+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.177+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:49:17.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.178+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T12:49:17.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12649941423062809509', time=2024-03-04T14:45:03.130271+0000, chain.objs.size()=2 2024-03-04T12:49:17.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_0 2024-03-04T12:49:17.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.-MtEl5Vl4KlLkCBzLnVTjXJcd24twSi_1 2024-03-04T12:49:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15517085135182093968', time=2024-03-04T14:46:13.881505+0000, chain.objs.size()=1 2024-03-04T12:49:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.yzXvPPAnkw11DZiED9XWFSsG_UyJJUT_0 2024-03-04T12:49:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7006457026774108968', time=2024-03-04T14:46:13.883221+0000, chain.objs.size()=1 2024-03-04T12:49:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.vBntcOYTaYJPLpLeEf7nOCS5BCb8O-B_0 2024-03-04T12:49:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2666723177114691104', time=2024-03-04T14:47:54.914078+0000, chain.objs.size()=1 2024-03-04T12:49:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.g3RrbCutxSFryNanrgKElT6KKJI_c4j_0 2024-03-04T12:49:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9366483994659636169', time=2024-03-04T14:47:54.916110+0000, chain.objs.size()=1 2024-03-04T12:49:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.8e5h5yYppKdf3H7dw2l_l4tvPKBCpyO_0 2024-03-04T12:49:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8891570911668479305', time=2024-03-04T14:48:27.812240+0000, chain.objs.size()=1 2024-03-04T12:49:17.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.179+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.38ZS80EubxDikq6EmPfI7kL-9VSEht3_0 2024-03-04T12:49:17.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.183+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.185+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:49:17.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-04T12:49:17.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.374907358464523883', time=2024-03-04T14:45:03.009676+0000, chain.objs.size()=1 2024-03-04T12:49:17.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.QrjivzhUjPMQvbweoLD0uMvWQnyd5Qf_0 2024-03-04T12:49:17.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15966295111669766117', time=2024-03-04T14:45:03.358578+0000, chain.objs.size()=1 2024-03-04T12:49:17.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8__shadow_.RbKJIst664UuE_JaLzL78gYlrzhAvSC_0 2024-03-04T12:49:17.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16382212137374975933', time=2024-03-04T14:46:12.640003+0000, chain.objs.size()=1 2024-03-04T12:49:17.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.7PqKd85LUc1OFcnNpF21sMQIjL3x3H5_0 2024-03-04T12:49:17.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8271223935400183056', time=2024-03-04T14:46:45.958150+0000, chain.objs.size()=1 2024-03-04T12:49:17.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.1L3FVBHS7I2DVVciL4ZiksXifQ9-xRl_0 2024-03-04T12:49:17.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5202760628621671788', time=2024-03-04T14:46:48.288498+0000, chain.objs.size()=1 2024-03-04T12:49:17.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.Z7wSyISlDDbHeKfWFINbuaXXZIyy9HT_0 2024-03-04T12:49:17.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16570571635519622775', time=2024-03-04T14:47:19.949746+0000, chain.objs.size()=1 2024-03-04T12:49:17.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.ZnlVp-8kuc8K3QRGAYgLNbTBSR3iciE_0 2024-03-04T12:49:17.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8579004065418076398', time=2024-03-04T14:47:54.915179+0000, chain.objs.size()=1 2024-03-04T12:49:17.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.4yFKHL1gOFm_iZ2rOakvXHakssJFTcP_0 2024-03-04T12:49:17.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2572226371075478360', time=2024-03-04T14:47:56.456790+0000, chain.objs.size()=1 2024-03-04T12:49:17.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.187+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.6mX21kk0zmfusF0NnjJ7bjCK9OqAl0R_0 2024-03-04T12:49:17.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.189+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.191+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:49:17.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.192+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.193+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.193+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.193+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16461061621600055906', time=2024-03-04T14:45:03.032598+0000, chain.objs.size()=7 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.193+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__multipart_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.1 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.193+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__shadow_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.1_1 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.193+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__multipart_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.2 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__shadow_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.2_1 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__multipart_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.3 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__shadow_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.3_1 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11__multipart_foo.2~K1KJmngMMxQyoYiKtehjuhwu-qnYiUe.4 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16688790801019361235', time=2024-03-04T14:46:13.883907+0000, chain.objs.size()=1 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.iHwe3lRk8T3gcif4kojzU7sc9mM3gcX_0 2024-03-04T12:49:17.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3327989692177178135', time=2024-03-04T14:46:13.885443+0000, chain.objs.size()=1 2024-03-04T12:49:17.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.fxYcqIT4ND8d1dp931rMpgK7q14qAAG_0 2024-03-04T12:49:17.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18250459190782882547', time=2024-03-04T14:46:45.958490+0000, chain.objs.size()=1 2024-03-04T12:49:17.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.sc5P2JGxcORjSy1xE8fByFn2wU0QJ9t_0 2024-03-04T12:49:17.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4563627107934310724', time=2024-03-04T14:46:48.285397+0000, chain.objs.size()=1 2024-03-04T12:49:17.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.4iYZmdFPPeDj_pURaSLpssd5ZQRibcA_0 2024-03-04T12:49:17.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12144615168069377714', time=2024-03-04T14:46:48.287168+0000, chain.objs.size()=1 2024-03-04T12:49:17.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.194+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.VEeoJ5FrS9dRybvP1naNbEJDBjMufIc_0 2024-03-04T12:49:17.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.197+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3108227928419030044', time=2024-03-04T14:46:48.288995+0000, chain.objs.size()=1 2024-03-04T12:49:17.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.197+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.a9r3o-m1aWCnOMA64nD6XPqiZ2Wpi6__0 2024-03-04T12:49:17.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.197+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7885975649283691955', time=2024-03-04T14:47:21.475308+0000, chain.objs.size()=1 2024-03-04T12:49:17.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.197+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.IrVnV8fx3UYAajgvmJOxbSH2cWmcKYU_0 2024-03-04T12:49:17.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.197+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1044774516204276515', time=2024-03-04T14:47:22.131215+0000, chain.objs.size()=1 2024-03-04T12:49:17.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.197+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.euw7cCIUtfDPOlgyVEAMOdym9vpwIRr_0 2024-03-04T12:49:17.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.197+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13074207204674668003', time=2024-03-04T14:47:22.137991+0000, chain.objs.size()=1 2024-03-04T12:49:17.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.197+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.YJhtLViKaNyYIOLp7Dcv609gHpPwwkk_0 2024-03-04T12:49:17.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.197+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8283695415431726452', time=2024-03-04T14:47:56.453921+0000, chain.objs.size()=1 2024-03-04T12:49:17.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.197+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.Cm5d2nTRd0olG7Wp70QQdBNZn493QKW_0 2024-03-04T12:49:17.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.197+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10557316832847821298', time=2024-03-04T14:47:56.454634+0000, chain.objs.size()=1 2024-03-04T12:49:17.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.197+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.q23pkEv43BU9gyUkHH9tqkEL0GDa6Wl_0 2024-03-04T12:49:17.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.199+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.201+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:49:17.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.202+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.202+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T12:49:17.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17486071241571340808', time=2024-03-04T14:45:03.242215+0000, chain.objs.size()=5 2024-03-04T12:49:17.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-FROZEN.2~QX1TRjzxD6VWkTQsTg9tK4AKf1JZt0e.1 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__shadow_foo-FROZEN.2~QX1TRjzxD6VWkTQsTg9tK4AKf1JZt0e.1_1 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-FROZEN.2~QX1TRjzxD6VWkTQsTg9tK4AKf1JZt0e.2 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__shadow_foo-FROZEN.2~QX1TRjzxD6VWkTQsTg9tK4AKf1JZt0e.2_1 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-FROZEN.2~QX1TRjzxD6VWkTQsTg9tK4AKf1JZt0e.3 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15268362319900535886', time=2024-03-04T14:46:15.099025+0000, chain.objs.size()=1 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.awp4NzyeNalh-CRd8ZuHJXooz86KcRq_0 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3971807813302991354', time=2024-03-04T14:46:45.959995+0000, chain.objs.size()=1 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.6TQT2iu4hRl3P-_rzJei4W9IFyfIrOm_0 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2369833951762329151', time=2024-03-04T14:46:48.287794+0000, chain.objs.size()=1 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.Vdbi4rWrh0QPnLSS75Sm-RyMbtuSFJJ_0 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5055212669325933905', time=2024-03-04T14:48:27.805176+0000, chain.objs.size()=1 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.llTtwdsfkeSQts0gFMItOyC3npnSEWV_0 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13305685962835138870', time=2024-03-04T14:48:27.808972+0000, chain.objs.size()=1 2024-03-04T12:49:17.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.203+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.rPmDsBVe9kZ-YQmlDl-d9HNGj7NU_vK_0 2024-03-04T12:49:17.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.206+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.208+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:49:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.209+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.209+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.209+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-04T12:49:17.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.209+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='_ExB55sYjYKTyts0C4Lz0HoQR-4zceNL', time=2024-03-04T14:45:03.124877+0000, chain.objs.size()=2 2024-03-04T12:49:17.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.209+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.2T3c0gixP9AcRMM6n7fDHYUWI9ssiX1_0 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.2T3c0gixP9AcRMM6n7fDHYUWI9ssiX1_1 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='_3HBvMxvg1tVLHoJc3662yM9S2XQ9xrj', time=2024-03-04T14:45:03.160314+0000, chain.objs.size()=1 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.anEBD73fyK39xCfdLDIhmb_TANdzpjK_0 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14800452474259616068', time=2024-03-04T14:47:19.945476+0000, chain.objs.size()=1 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.xEx46xABsoxF9XjFm3ArcMxA7mAnrAJ_0 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8897944482558325449', time=2024-03-04T14:47:19.954266+0000, chain.objs.size()=1 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.QQGcavXfOmwA5JWsXJBrmlOlMlDb3Wh_0 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8050329657213071849', time=2024-03-04T14:47:21.476790+0000, chain.objs.size()=1 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.lpsKQXA0C3BHyZjRMUKIFef5kJYo30Y_0 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6263214129386760106', time=2024-03-04T14:47:56.461755+0000, chain.objs.size()=1 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.Hx9JJYRuzSUHFpwn6eKA_XfbRBbZIgo_0 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14366988454281899786', time=2024-03-04T14:48:27.489203+0000, chain.objs.size()=1 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.m22w5YWAjhPXWyQk6L0bjF8BEyirRT3_0 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8831895026606627407', time=2024-03-04T14:48:28.522006+0000, chain.objs.size()=1 2024-03-04T12:49:17.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.210+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17__shadow_.JmCt1WSdkaKj3UIUbn7kX2B-5am1l9h_0 2024-03-04T12:49:17.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.212+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.213+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:49:17.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.215+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.215+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-03-04T12:49:17.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13075715566042930173', time=2024-03-04T14:45:02.998382+0000, chain.objs.size()=1 2024-03-04T12:49:17.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.WCqYnZjfsAla1DxEAlUVdYWB-hX5ojB_0 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14137185255432477116', time=2024-03-04T14:45:03.002088+0000, chain.objs.size()=1 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.tK9zWgmLNnLM6hYko-Gbk5chnI8rsqP_0 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3469867616764009457', time=2024-03-04T14:45:03.362946+0000, chain.objs.size()=1 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8__shadow_.Skeg0fXEDiR-LGUn_H57QXhj9nly8bh_0 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1632288579237185703', time=2024-03-04T14:46:12.642583+0000, chain.objs.size()=1 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.gkMlY5uZxZoX5CZd7kfL18rj2aecDJL_0 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1772455040452895121', time=2024-03-04T14:46:12.646234+0000, chain.objs.size()=1 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.e2EowU4xcVbK8RaHaKVW7DBcqOhzKEf_0 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12036784033496559380', time=2024-03-04T14:46:48.289451+0000, chain.objs.size()=1 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.SpjObzYx2xB2JI8YbtwWKbO4_ddI1IP_0 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6726711149361573536', time=2024-03-04T14:47:19.945159+0000, chain.objs.size()=1 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.EoOl-Jpi5dBFtgU8smZXECcJ3L30zA4_0 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10099574454804778529', time=2024-03-04T14:47:21.482787+0000, chain.objs.size()=1 2024-03-04T12:49:17.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.V_0hII5lkBtMtHVy8pciUx3dmkbRjow_0 2024-03-04T12:49:17.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7119325662682355013', time=2024-03-04T14:47:22.131139+0000, chain.objs.size()=1 2024-03-04T12:49:17.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.7ItcsGApJSHvbND3RrSYF9i6EVhc5iG_0 2024-03-04T12:49:17.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7973026248759243244', time=2024-03-04T14:47:22.132567+0000, chain.objs.size()=1 2024-03-04T12:49:17.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.q8veOFFFWen7G6juCPZDNXYetrwdHP__0 2024-03-04T12:49:17.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11655385648752412971', time=2024-03-04T14:48:39.662241+0000, chain.objs.size()=1 2024-03-04T12:49:17.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.216+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18__shadow:9n.wUyJ7D-08RnZ4m5UmlhfjlEQkpai_.kib_b68HUX3b6X-69k6Xbo5vnX2sDcr_0 2024-03-04T12:49:17.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.218+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.220+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:49:17.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.221+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-03-04T12:49:17.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_1_094a84ef45d50e50f1f4de097c905286', time=2024-03-04T14:45:03.156296+0000, chain.objs.size()=2 2024-03-04T12:49:17.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_0 2024-03-04T12:49:17.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.BncBdSiLQ4OkyUxrIf7etS6aeTHJ2_a_1 2024-03-04T12:49:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='_g8KOKi1UA86-KKA71U9uYLcpGp1gO7_', time=2024-03-04T14:45:03.193930+0000, chain.objs.size()=3 2024-03-04T12:49:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.p6zuKIxAESooBk3CNk1oWF8Dopn_1jE_0 2024-03-04T12:49:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.p6zuKIxAESooBk3CNk1oWF8Dopn_1jE_1 2024-03-04T12:49:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.p6zuKIxAESooBk3CNk1oWF8Dopn_1jE_2 2024-03-04T12:49:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11445943614669277341', time=2024-03-04T14:45:03.271284+0000, chain.objs.size()=3 2024-03-04T12:49:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.hl5JMgN6Y2rDRAxlT5MUu5JVmsl-yK8_0 2024-03-04T12:49:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.hl5JMgN6Y2rDRAxlT5MUu5JVmsl-yK8_1 2024-03-04T12:49:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13__shadow_.hl5JMgN6Y2rDRAxlT5MUu5JVmsl-yK8_2 2024-03-04T12:49:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9424338689814720128', time=2024-03-04T14:45:03.336533+0000, chain.objs.size()=1 2024-03-04T12:49:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7__shadow_.Azi0PSE-xeYY_HLiiQchvoGVgNWu19f_0 2024-03-04T12:49:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14423678070311151337', time=2024-03-04T14:46:12.637340+0000, chain.objs.size()=1 2024-03-04T12:49:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.XjM9-1WeyEqcsNKcpS1i46XmlI55Hmw_0 2024-03-04T12:49:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16716949331623417902', time=2024-03-04T14:46:13.881809+0000, chain.objs.size()=1 2024-03-04T12:49:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.222+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.Cr71aFtksenfRf7Vj66DkrfNC50BNZA_0 2024-03-04T12:49:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.223+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5896304367554776729', time=2024-03-04T14:46:45.956550+0000, chain.objs.size()=1 2024-03-04T12:49:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.223+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.UucoiXg8PD8WLZWmQ_Bl8pt51QqpoOS_0 2024-03-04T12:49:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.224+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12032294265036688843', time=2024-03-04T14:46:48.285843+0000, chain.objs.size()=1 2024-03-04T12:49:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.224+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.zmlSvC46WyTc-PWkZeRSLwih2EaUmLl_0 2024-03-04T12:49:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.224+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10504542550382233702', time=2024-03-04T14:46:48.286792+0000, chain.objs.size()=1 2024-03-04T12:49:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.224+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.zEU5Ex5MQ9T5HSHS3hNXjXUoXx-7IhQ_0 2024-03-04T12:49:17.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.226+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11417074416035243066', time=2024-03-04T14:47:19.947177+0000, chain.objs.size()=1 2024-03-04T12:49:17.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.226+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.MvdquayB77hcZQZIScpXDac2wMl4LZu_0 2024-03-04T12:49:17.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.226+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2054762205148384012', time=2024-03-04T14:47:19.949138+0000, chain.objs.size()=1 2024-03-04T12:49:17.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.226+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.i2kinOvAFgQlwKrTqINPfSkM8gbgEJ5_0 2024-03-04T12:49:17.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.226+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1442849457452249488', time=2024-03-04T14:47:54.917485+0000, chain.objs.size()=1 2024-03-04T12:49:17.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.226+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.5NTrDzoCvPU7_MDnFu0i4EXNFxD1-0S_0 2024-03-04T12:49:17.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.226+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17085653836894107329', time=2024-03-04T14:48:28.521654+0000, chain.objs.size()=1 2024-03-04T12:49:17.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.226+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17__shadow_.5M-AOPGNF9veSIhb3BzIrMdT2INR_NH_0 2024-03-04T12:49:17.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.226+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5898124863818915155', time=2024-03-04T14:48:39.661792+0000, chain.objs.size()=1 2024-03-04T12:49:17.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.226+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18__shadow:i8Zz1WW57f5wEPFDAkBFz8EOOQxmbNx_.JiWwlwiBHU522TWG6Wf8EClnsB6WobC_0 2024-03-04T12:49:17.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.228+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.230+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:49:17.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.231+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T12:49:17.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11978490666276407046', time=2024-03-04T14:45:03.201067+0000, chain.objs.size()=3 2024-03-04T12:49:17.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.1 2024-03-04T12:49:17.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.2 2024-03-04T12:49:17.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-STANDARD.2~PnzsfvDmZFmNZqNE_UxviT8usb9cqN0.3 2024-03-04T12:49:17.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14076461130301922375', time=2024-03-04T14:45:03.250613+0000, chain.objs.size()=5 2024-03-04T12:49:17.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-LUKEWARM.2~DKZrOjkXIJakmkWTW_Br-2TTQ_SrVIP.1 2024-03-04T12:49:17.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__shadow_foo-LUKEWARM.2~DKZrOjkXIJakmkWTW_Br-2TTQ_SrVIP.1_1 2024-03-04T12:49:17.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-LUKEWARM.2~DKZrOjkXIJakmkWTW_Br-2TTQ_SrVIP.2 2024-03-04T12:49:17.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__shadow_foo-LUKEWARM.2~DKZrOjkXIJakmkWTW_Br-2TTQ_SrVIP.2_1 2024-03-04T12:49:17.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-LUKEWARM.2~DKZrOjkXIJakmkWTW_Br-2TTQ_SrVIP.3 2024-03-04T12:49:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2451880170801922542', time=2024-03-04T14:45:03.329226+0000, chain.objs.size()=1 2024-03-04T12:49:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7__shadow_.cyW9vZCXjxEky9UQiXHDGtRv1nsUiFL_0 2024-03-04T12:49:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3438045162621838804', time=2024-03-04T14:47:21.480431+0000, chain.objs.size()=1 2024-03-04T12:49:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.xdkerxQUQDMfOTDPwceYXScAyJPj0x2_0 2024-03-04T12:49:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2663879560094682188', time=2024-03-04T14:47:56.454972+0000, chain.objs.size()=1 2024-03-04T12:49:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.bEb-si5_fS0LFa-x_6I4nf8RLx4lRzO_0 2024-03-04T12:49:17.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14997098281145188383', time=2024-03-04T14:48:27.807610+0000, chain.objs.size()=1 2024-03-04T12:49:17.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.232+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.yoFLz3fWPy6_vFf__bpL7bvXuxgNVVD_0 2024-03-04T12:49:17.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.235+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.237+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:49:17.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.238+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.239+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.239+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-04T12:49:17.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.239+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16025905523737806951', time=2024-03-04T14:47:21.476478+0000, chain.objs.size()=1 2024-03-04T12:49:17.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.239+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.s4VYFFCg6WGko7W7zCNHufpUqlCkyFN_0 2024-03-04T12:49:17.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.239+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3294021215062184698', time=2024-03-04T14:47:56.458246+0000, chain.objs.size()=1 2024-03-04T12:49:17.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.239+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.1i_2u4O2m7FdceGZm26750DMmzl980p_0 2024-03-04T12:49:17.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.239+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.660915927023516163', time=2024-03-04T14:48:27.804684+0000, chain.objs.size()=1 2024-03-04T12:49:17.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.239+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.Hvx3b8AHcwRagmET9VQ0iuY4E2Yo3yP_0 2024-03-04T12:49:17.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.239+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17856342022002525715', time=2024-03-04T14:48:27.811943+0000, chain.objs.size()=1 2024-03-04T12:49:17.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.239+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.jpk6F6ZZqYlmc76WoS-ZmICirUw3Xs7_0 2024-03-04T12:49:17.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.239+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1211737649136700896', time=2024-03-04T14:48:27.812567+0000, chain.objs.size()=1 2024-03-04T12:49:17.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.239+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.CnQcpCsRauHyiVAnfTayIhfphb93HUe_0 2024-03-04T12:49:17.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.240+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.243+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:49:17.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.244+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.244+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.245+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T12:49:17.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.245+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12333260455574309796', time=2024-03-04T14:45:03.053383+0000, chain.objs.size()=4 2024-03-04T12:49:17.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.245+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12__multipart_foo.2~sIgV_VazsY-HhJsXKdbQAUl8HINlZ9k.1 2024-03-04T12:49:17.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.245+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12__multipart_foo.2~sIgV_VazsY-HhJsXKdbQAUl8HINlZ9k.2 2024-03-04T12:49:17.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.245+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12__multipart_foo.2~sIgV_VazsY-HhJsXKdbQAUl8HINlZ9k.3 2024-03-04T12:49:17.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.245+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12__multipart_foo.2~sIgV_VazsY-HhJsXKdbQAUl8HINlZ9k.4 2024-03-04T12:49:17.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.245+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4175851243849493711', time=2024-03-04T14:46:49.284927+0000, chain.objs.size()=1 2024-03-04T12:49:17.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.245+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.xolLxwFMvflRYbq47ZJ9Yvo4EoYyPFt_0 2024-03-04T12:49:17.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.245+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13446596500745356411', time=2024-03-04T14:47:21.477787+0000, chain.objs.size()=1 2024-03-04T12:49:17.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.245+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.JieTjavoIWyKkHT8-_ZtYtvkPrKQuGn_0 2024-03-04T12:49:17.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.245+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17077313853526842768', time=2024-03-04T14:48:28.522933+0000, chain.objs.size()=1 2024-03-04T12:49:17.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.245+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17__shadow_.QfOk4IgXHi58djKwvEG-7h6m5VwPgpl_0 2024-03-04T12:49:17.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.246+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.248+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:49:17.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.250+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.250+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.251+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T12:49:17.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.251+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15134872263646086925', time=2024-03-04T14:46:45.963316+0000, chain.objs.size()=1 2024-03-04T12:49:17.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.251+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.IoZRmFIoyVP8bpfwWFZs7lsraBa5AU6_0 2024-03-04T12:49:17.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.251+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.257584435098891767', time=2024-03-04T14:47:19.946438+0000, chain.objs.size()=1 2024-03-04T12:49:17.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.251+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.MjnKcuKig2XB8bjsrUshQ5hvhqYFq7y_0 2024-03-04T12:49:17.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.251+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11583485085148595508', time=2024-03-04T14:47:54.915217+0000, chain.objs.size()=1 2024-03-04T12:49:17.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.251+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.KgwLS3gwivIqWsy2xwMemtNSdJLaOUZ_0 2024-03-04T12:49:17.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.251+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8768194918970642189', time=2024-03-04T14:47:56.455220+0000, chain.objs.size()=1 2024-03-04T12:49:17.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.251+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.qsrb10W9-mMyYVeo_aoANJSYq6O8nsS_0 2024-03-04T12:49:17.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.252+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.254+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:49:17.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.255+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.255+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-04T12:49:17.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.129809551865370974', time=2024-03-04T14:45:03.005888+0000, chain.objs.size()=1 2024-03-04T12:49:17.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.SSEGmEjVRaFIdD2oorbgHtSemygKDC-_0 2024-03-04T12:49:17.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='_4imWX8h5OnJvop6NiKJTejwXem6YlMM', time=2024-03-04T14:45:03.183104+0000, chain.objs.size()=1 2024-03-04T12:49:17.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.HB6w-wSWZwOV4FjQR-Lual0vwX8Dg2i_0 2024-03-04T12:49:17.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9639297755641970622', time=2024-03-04T14:45:03.190470+0000, chain.objs.size()=5 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.1_1 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.2 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.2_1 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-FROZEN.2~k7WF726K1_IxgG66fe4FMlfazvOvMCC.3 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1055965796053186726', time=2024-03-04T14:46:13.887543+0000, chain.objs.size()=1 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.xmXRdE_ktdt1h0YBNWWmQOj_mB0FlfE_0 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14014646927498873057', time=2024-03-04T14:47:19.948870+0000, chain.objs.size()=1 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.cAd1UszC_cZREJpvoXEzJ-OQEBESN0Z_0 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12155716403224276829', time=2024-03-04T14:47:22.134843+0000, chain.objs.size()=1 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.Y4sEYXapuMglVYX8JjcrGt6o6cdTPlI_0 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11798832816345365819', time=2024-03-04T14:47:54.917672+0000, chain.objs.size()=1 2024-03-04T12:49:17.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.256+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.QpYn-MKmKunpCKMs8K7QV9JcVHi6DNi_0 2024-03-04T12:49:17.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.258+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.260+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:49:17.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.261+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.261+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.262+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-04T12:49:17.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.262+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4359670642566153055', time=2024-03-04T14:46:13.881364+0000, chain.objs.size()=1 2024-03-04T12:49:17.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.262+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.Y0n49_TnEG7A-Yt4ccQ7h_C7dAvUNzf_0 2024-03-04T12:49:17.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.262+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11710968123070536795', time=2024-03-04T14:46:48.285393+0000, chain.objs.size()=1 2024-03-04T12:49:17.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.262+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.22__shadow_.9euV4Phw_i1C7GMYpRZgcWOJiQuRjbG_0 2024-03-04T12:49:17.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.262+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4444302518723823743', time=2024-03-04T14:47:21.483131+0000, chain.objs.size()=1 2024-03-04T12:49:17.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.262+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.GOSvoay53U7kqreiSpGU42aGkDTTI8G_0 2024-03-04T12:49:17.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.262+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4315177903538002531', time=2024-03-04T14:47:22.129594+0000, chain.objs.size()=1 2024-03-04T12:49:17.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.262+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.I2FlNT2gLZPgv7TW-Tm_roFkTVepyKh_0 2024-03-04T12:49:17.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.262+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12358546188922202183', time=2024-03-04T14:48:28.521580+0000, chain.objs.size()=1 2024-03-04T12:49:17.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.262+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17__shadow_.j6R4jmhn11f7xenad5RFu4EXLbZT3l3_0 2024-03-04T12:49:17.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.263+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.265+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:49:17.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.266+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T12:49:17.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='_mDnLiTxVLyrCpaYND3dGzfdRwPgAk4C', time=2024-03-04T14:45:03.145470+0000, chain.objs.size()=2 2024-03-04T12:49:17.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.GlOPa-m5ngyy-UrQuIshbUyrNLTitHd_0 2024-03-04T12:49:17.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.GlOPa-m5ngyy-UrQuIshbUyrNLTitHd_1 2024-03-04T12:49:17.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15358263107747482271', time=2024-03-04T14:45:03.332927+0000, chain.objs.size()=1 2024-03-04T12:49:17.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7__shadow_.B3h5EBNpvETp0N66pVi1LvJHxr5a4tG_0 2024-03-04T12:49:17.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4529674573862697165', time=2024-03-04T14:46:45.960187+0000, chain.objs.size()=1 2024-03-04T12:49:17.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.h_hGG7l9vbx-YWkCYbcdStHpmBsjQdB_0 2024-03-04T12:49:17.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17509228172752559824', time=2024-03-04T14:47:19.946510+0000, chain.objs.size()=1 2024-03-04T12:49:17.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.QAXGOLbKFa2HW59-QCir2q1bX6fIJ9k_0 2024-03-04T12:49:17.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11340614749771946314', time=2024-03-04T14:48:27.804037+0000, chain.objs.size()=1 2024-03-04T12:49:17.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.NQIeBUa6Rqw4tK2ya9M8ut6HBvoOJIU_0 2024-03-04T12:49:17.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10119730634210308554', time=2024-03-04T14:48:28.523600+0000, chain.objs.size()=1 2024-03-04T12:49:17.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.267+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17__shadow_.YOoFurHIv_ley4c8tiGXSl6g6GYUmga_0 2024-03-04T12:49:17.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.270+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.271+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:49:17.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-03-04T12:49:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.JiaCq-7DUIO8jSELxt17iRHEd-MVaTX_1_14f2fb2a148055c29f8bd605d200ab78', time=2024-03-04T14:45:03.152880+0000, chain.objs.size()=1 2024-03-04T12:49:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.JiaCq-7DUIO8jSELxt17iRHEd-MVaTX_0 2024-03-04T12:49:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='_9TU2q5M0SmSGMzGvmDdbcmYmwiZBuZw', time=2024-03-04T14:45:03.186440+0000, chain.objs.size()=3 2024-03-04T12:49:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.bB5pf4MqibZKWzocgGJXJPJwJEhrNdG_0 2024-03-04T12:49:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.bB5pf4MqibZKWzocgGJXJPJwJEhrNdG_1 2024-03-04T12:49:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_.bB5pf4MqibZKWzocgGJXJPJwJEhrNdG_2 2024-03-04T12:49:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3218230263259982134', time=2024-03-04T14:45:03.354817+0000, chain.objs.size()=1 2024-03-04T12:49:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8__shadow_.ZQ1XwYwII22TrgywEdq4GfWdk30okNF_0 2024-03-04T12:49:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.185271590063089652', time=2024-03-04T14:46:12.642425+0000, chain.objs.size()=1 2024-03-04T12:49:17.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.zm-dOl2goA-YY2ZYEsM6uN6Qw4w413H_0 2024-03-04T12:49:17.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4856794753656430160', time=2024-03-04T14:46:13.882225+0000, chain.objs.size()=1 2024-03-04T12:49:17.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.TkrYlYnot75QRyf_KWwDi6rq6XY9v_V_0 2024-03-04T12:49:17.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12539350170582595805', time=2024-03-04T14:47:19.955023+0000, chain.objs.size()=1 2024-03-04T12:49:17.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.23__shadow_.06CNq_c6ti7-3snEx4EpQbCzSBLA33L_0 2024-03-04T12:49:17.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7837390727882072473', time=2024-03-04T14:47:20.974378+0000, chain.objs.size()=1 2024-03-04T12:49:17.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.273+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.Wc9UAwGkFWs5Z_SgeBLRdaO4isOZdhU_0 2024-03-04T12:49:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.274+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9457882451470089237', time=2024-03-04T14:47:56.454637+0000, chain.objs.size()=1 2024-03-04T12:49:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.274+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.jpa3jWpwpQ3VQRQTOCvAF33j9CzZE7N_0 2024-03-04T12:49:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.274+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16062944335938150679', time=2024-03-04T14:47:56.461905+0000, chain.objs.size()=1 2024-03-04T12:49:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.274+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.27__shadow_.8eCi2I3IeczuIIQ_x1WSogwnuf-K2gC_0 2024-03-04T12:49:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.274+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8093805913409252106', time=2024-03-04T14:48:27.807520+0000, chain.objs.size()=1 2024-03-04T12:49:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.274+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.ZiWGTYagnquvPl7e_5reqD6A2oZ2odF_0 2024-03-04T12:49:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.277+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.279+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:49:17.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.280+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.280+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-03-04T12:49:17.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14046541780323815699', time=2024-03-04T14:45:02.984336+0000, chain.objs.size()=1 2024-03-04T12:49:17.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.QvLPxx3ohpFWrh1oHGqbuVCDzhSowOS_0 2024-03-04T12:49:17.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11826440884600772743', time=2024-03-04T14:45:03.076578+0000, chain.objs.size()=4 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10__multipart_foo.2~JYMph1NQQbPBAsPbT_Lp5ZGRnjGzqRl.1 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10__multipart_foo.2~JYMph1NQQbPBAsPbT_Lp5ZGRnjGzqRl.2 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10__multipart_foo.2~JYMph1NQQbPBAsPbT_Lp5ZGRnjGzqRl.3 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10__multipart_foo.2~JYMph1NQQbPBAsPbT_Lp5ZGRnjGzqRl.4 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4421321697612287510', time=2024-03-04T14:46:45.954432+0000, chain.objs.size()=1 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.wPzRY2X-4fkfzYzPj-xkX8dokJjBJ8E_0 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5704269710149662611', time=2024-03-04T14:46:45.956074+0000, chain.objs.size()=1 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.7GYG5qlSJg_4NwG5mPoJWOpSwO_e8yk_0 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10162770934929493481', time=2024-03-04T14:47:21.476919+0000, chain.objs.size()=1 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.xmfDLNsQDgw3QDB90rvfBBxezl7Lp-i_0 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14312478804617631137', time=2024-03-04T14:47:22.129929+0000, chain.objs.size()=1 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.85cIhZ2FiYfE8METFKk4c1PK4lKu_yw_0 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9076124351810029903', time=2024-03-04T14:47:22.132055+0000, chain.objs.size()=1 2024-03-04T12:49:17.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.oFDxnJ-KfXtc0uVJxMCXZEneysRB-wS_0 2024-03-04T12:49:17.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2646962479245101912', time=2024-03-04T14:47:22.132692+0000, chain.objs.size()=1 2024-03-04T12:49:17.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.bhvDDfAwTonrWXMbwxY4o7-zdFnWPfk_0 2024-03-04T12:49:17.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12114054583045956632', time=2024-03-04T14:47:22.134415+0000, chain.objs.size()=1 2024-03-04T12:49:17.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.281+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.udz9ITOJqD2NK4xjLpfyD_7ZQ2Dino4_0 2024-03-04T12:49:17.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.282+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6557944395223587209', time=2024-03-04T14:47:54.917338+0000, chain.objs.size()=1 2024-03-04T12:49:17.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.282+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.XTB6teypmWhu0ZwDuzYJmNRvaDgvBpL_0 2024-03-04T12:49:17.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.283+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1770479350773519744', time=2024-03-04T14:47:54.921941+0000, chain.objs.size()=1 2024-03-04T12:49:17.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.283+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.oCkIuaSSt-B8NTCA0tUkf0ux0rT2wBG_0 2024-03-04T12:49:17.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.284+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.286+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:49:17.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.287+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.288+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.288+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T12:49:17.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.288+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='_cMw1JFcGlUoofwBJsn_fGFGlXRmASSY', time=2024-03-04T14:45:03.121179+0000, chain.objs.size()=1 2024-03-04T12:49:17.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.288+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15__shadow_.fkWDqoBrAG81VSo0Tyh107PlsgiO1-6_0 2024-03-04T12:49:17.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.288+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5437292840366431913', time=2024-03-04T14:45:03.208715+0000, chain.objs.size()=5 2024-03-04T12:49:17.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.288+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1 2024-03-04T12:49:17.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.288+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.1_1 2024-03-04T12:49:17.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.2 2024-03-04T12:49:17.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__shadow_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.2_1 2024-03-04T12:49:17.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16__multipart_foo-LUKEWARM.2~tTMeh_2T8nNmhGxnmeKhXLs6Vm7CVQk.3 2024-03-04T12:49:17.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6437584966347240911', time=2024-03-04T14:45:03.246570+0000, chain.objs.size()=3 2024-03-04T12:49:17.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-STANDARD.2~C7FvvchTTn-9FeFMkcplXdXU9Txv47S.1 2024-03-04T12:49:17.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-STANDARD.2~C7FvvchTTn-9FeFMkcplXdXU9Txv47S.2 2024-03-04T12:49:17.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14__multipart_foo-STANDARD.2~C7FvvchTTn-9FeFMkcplXdXU9Txv47S.3 2024-03-04T12:49:17.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5393983517970498770', time=2024-03-04T14:46:13.883431+0000, chain.objs.size()=1 2024-03-04T12:49:17.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.ahuQttjF_DamlbKCLMapLMRvqeygMA-_0 2024-03-04T12:49:17.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12948822379922947555', time=2024-03-04T14:47:21.477260+0000, chain.objs.size()=1 2024-03-04T12:49:17.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.GgCTdt-rrjHozkGahKAofokR_qC5_xq_0 2024-03-04T12:49:17.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.606009049905438392', time=2024-03-04T14:47:54.921814+0000, chain.objs.size()=1 2024-03-04T12:49:17.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.289+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.q-YOePM9v5aTSxt-LTVfFufl4MXKI7d_0 2024-03-04T12:49:17.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.291+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.293+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:49:17.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.294+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.294+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.295+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:49:17.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.295+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3605301450841119021', time=2024-03-04T14:46:12.636924+0000, chain.objs.size()=1 2024-03-04T12:49:17.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.295+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.DRULL8XQ10riSo3ACb8Dptg1grVWr34_0 2024-03-04T12:49:17.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.295+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10527892339989134836', time=2024-03-04T14:46:12.637773+0000, chain.objs.size()=1 2024-03-04T12:49:17.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.295+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.Y6F1x24DvuGPhrTB3MtVYsDyvaOqS11_0 2024-03-04T12:49:17.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.295+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5628126531765643540', time=2024-03-04T14:46:12.642439+0000, chain.objs.size()=1 2024-03-04T12:49:17.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.295+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.uEee7ii60O9D2o8F3pNeqoEjuEBzyp6_0 2024-03-04T12:49:17.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.296+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.298+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:49:17.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.299+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-03-04T12:49:17.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11906545806180745552', time=2024-03-04T14:45:03.099308+0000, chain.objs.size()=4 2024-03-04T12:49:17.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9__multipart_foo.2~E5fG0h0FF85MoKfMEoCK6PoBuSwHmLv.1 2024-03-04T12:49:17.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9__multipart_foo.2~E5fG0h0FF85MoKfMEoCK6PoBuSwHmLv.2 2024-03-04T12:49:17.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9__multipart_foo.2~E5fG0h0FF85MoKfMEoCK6PoBuSwHmLv.3 2024-03-04T12:49:17.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9__multipart_foo.2~E5fG0h0FF85MoKfMEoCK6PoBuSwHmLv.4 2024-03-04T12:49:17.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5567522123342858996', time=2024-03-04T14:45:03.325370+0000, chain.objs.size()=1 2024-03-04T12:49:17.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7__shadow_.YvN0tpq5puGYwjroGbavNnDkbkXatF2_0 2024-03-04T12:49:17.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.948714956905311211', time=2024-03-04T14:46:12.645804+0000, chain.objs.size()=1 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.cuUOFxh6caHNg2el_hQx9djps2cTFRn_0 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3267939278741288519', time=2024-03-04T14:46:45.962235+0000, chain.objs.size()=1 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.ZsvhryML5ieibpCO770veyuGmBE4l-d_0 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4424325488101100690', time=2024-03-04T14:46:45.965058+0000, chain.objs.size()=1 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.21__shadow_.tM3-uSZE_mN5cU1KB3MGZA4YwrOplHn_0 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7618836312501189995', time=2024-03-04T14:47:21.474244+0000, chain.objs.size()=1 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.jZHnwbp61149zyncD69TIuBGgpbPgWP_0 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13233680399344172425', time=2024-03-04T14:47:21.475205+0000, chain.objs.size()=1 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.fDwbIb7SQvbFk0_LqotNXbdESYryrmq_0 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5330609510425818861', time=2024-03-04T14:47:21.476125+0000, chain.objs.size()=1 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.QG6vlI-Qi4QAFZYPGt2yIMe0yrWgWQn_0 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6746200678053944706', time=2024-03-04T14:47:21.476950+0000, chain.objs.size()=1 2024-03-04T12:49:17.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.300+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.24__shadow_.zVSAaeMs7H82FylPujmPak7iwhHLnox_0 2024-03-04T12:49:17.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.302+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8472826708059211482', time=2024-03-04T14:47:22.134305+0000, chain.objs.size()=1 2024-03-04T12:49:17.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.302+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.ca7z6dSOPLfxztnDBeLYjD6ISsZWmhG_0 2024-03-04T12:49:17.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.302+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2122679812546773003', time=2024-03-04T14:48:27.805495+0000, chain.objs.size()=1 2024-03-04T12:49:17.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.302+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.28__shadow_.PMskMIgeJ_x6Dt6SCZg2NnhQQ1e8dKF_0 2024-03-04T12:49:17.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.303+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.306+0000 7f411112f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:49:17.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.307+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-04T12:49:17.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4644290029589540113', time=2024-03-04T14:45:03.013472+0000, chain.objs.size()=1 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4__shadow_.wg3JgjKuH18qYmgLB7my2o0Z67ZefLj_0 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3206635373585916485', time=2024-03-04T14:46:12.637104+0000, chain.objs.size()=1 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.L2zhLW0a5P7cOdBE0JNS8Aex-paoZ6v_0 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14200140356506258062', time=2024-03-04T14:46:12.639255+0000, chain.objs.size()=1 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.19__shadow_.DOyjxq1nNiCILGu0n_qFnGb0p5HRYJe_0 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11495782596877999286', time=2024-03-04T14:46:13.882088+0000, chain.objs.size()=1 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.KZKDE6hWxbCr_Ttk7Eb6UTdM1cBb6z5_0 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1080619704702766559', time=2024-03-04T14:46:13.889840+0000, chain.objs.size()=1 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.20__shadow_.GLeO62goN3Qe9MjjCQ8yRMz42wz3eJO_0 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9371183296886206369', time=2024-03-04T14:47:22.138268+0000, chain.objs.size()=1 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.25__shadow_.80VAhwdvlZTQmZNtktix6urv1xEj2T5_0 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2294831536356513169', time=2024-03-04T14:47:54.913926+0000, chain.objs.size()=1 2024-03-04T12:49:17.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.308+0000 7f411112f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.26__shadow_.rG0dypGcjPag1cCjMCWQX4tfPBA8TlZ_0 2024-03-04T12:49:17.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.310+0000 7f411112f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:49:17.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.312+0000 7f3fc2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:49:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.314+0000 7f411112f800 20 remove_watcher() i=0 2024-03-04T12:49:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.314+0000 7f411112f800 2 removed watcher, disabling cache 2024-03-04T12:49:17.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.315+0000 7f411112f800 20 remove_watcher() i=1 2024-03-04T12:49:17.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.316+0000 7f411112f800 20 remove_watcher() i=2 2024-03-04T12:49:17.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.317+0000 7f411112f800 20 remove_watcher() i=3 2024-03-04T12:49:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.318+0000 7f411112f800 20 remove_watcher() i=4 2024-03-04T12:49:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.319+0000 7f411112f800 20 remove_watcher() i=5 2024-03-04T12:49:17.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.320+0000 7f411112f800 20 remove_watcher() i=6 2024-03-04T12:49:17.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.321+0000 7f411112f800 20 remove_watcher() i=7 2024-03-04T12:49:17.337 DEBUG:teuthology.orchestra.run.smithi090:> radosgw-admin gc process --include-all 2024-03-04T12:49:17.387 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:49:17.387 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:49:17.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.413+0000 7fb914412800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.415+0000 7fb914412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.415+0000 7fb914412800 20 realm 2024-03-04T12:49:17.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.415+0000 7fb914412800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.415+0000 7fb914412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.415+0000 7fb914412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:49:17.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.415+0000 7fb914412800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.415+0000 7fb914412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.415+0000 7fb914412800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.416+0000 7fb914412800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:49:17.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.416+0000 7fb914412800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.417+0000 7fb914412800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:49:17.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.417+0000 7fb914412800 20 searching for the correct realm 2024-03-04T12:49:17.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.419+0000 7fb907fff640 0 -- 172.21.15.90:0/3821148103 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x556c8d1398f0 msgr2=0x7fb8f803ef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:49:17.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.423+0000 7fb90fa81640 0 -- 172.21.15.90:0/3821148103 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fb8f8087790 msgr2=0x7fb8f803e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:49:17.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:49:17.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:49:17.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:49:17.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:49:17.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:49:17.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:49:17.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:49:17.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:49:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 zone default found 2024-03-04T12:49:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 4 Realm: () 2024-03-04T12:49:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:49:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:49:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:49:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 zonegroup default 2024-03-04T12:49:17.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.629+0000 7fb914412800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.630+0000 7fb914412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.630+0000 7fb914412800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.630+0000 7fb914412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.630+0000 7fb914412800 20 rados->read ofs=0 len=0 2024-03-04T12:49:17.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.630+0000 7fb914412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:49:17.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.630+0000 7fb914412800 20 started sync module instance, tier type = 2024-03-04T12:49:17.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.630+0000 7fb914412800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:49:17.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.639+0000 7fb914412800 20 add_watcher() i=0 2024-03-04T12:49:17.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.639+0000 7fb914412800 20 add_watcher() i=1 2024-03-04T12:49:17.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.639+0000 7fb914412800 20 add_watcher() i=2 2024-03-04T12:49:17.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.639+0000 7fb914412800 20 add_watcher() i=3 2024-03-04T12:49:17.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.639+0000 7fb914412800 20 add_watcher() i=4 2024-03-04T12:49:17.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.639+0000 7fb914412800 20 add_watcher() i=5 2024-03-04T12:49:17.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.639+0000 7fb914412800 20 add_watcher() i=6 2024-03-04T12:49:17.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.640+0000 7fb914412800 20 add_watcher() i=7 2024-03-04T12:49:17.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.640+0000 7fb914412800 2 all 8 watchers are set, enabling cache 2024-03-04T12:49:17.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.642+0000 7fb7c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:49:17.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.642+0000 7fb914412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:49:17.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.642+0000 7fb914412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:49:17.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.676+0000 7fb7c4fe1640 20 reqs_thread_entry: start 2024-03-04T12:49:17.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.676+0000 7fb914412800 20 init_complete bucket index max shards: 11 2024-03-04T12:49:17.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.676+0000 7fb914412800 20 Filter name: none 2024-03-04T12:49:17.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.676+0000 7fb73e7fc640 20 reqs_thread_entry: start 2024-03-04T12:49:17.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.676+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:49:17.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.678+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.678+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.678+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.679+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:49:17.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.681+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.681+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.681+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.682+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:49:17.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.683+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.684+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.684+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.685+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:49:17.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.686+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.687+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.687+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.688+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:49:17.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.689+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.690+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.690+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.691+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:49:17.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.693+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.693+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.693+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.694+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:49:17.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.696+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.696+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.696+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.697+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:49:17.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.698+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.699+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.699+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.700+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:49:17.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.701+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.702+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.702+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.703+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:49:17.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.704+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.704+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.705+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.705+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:49:17.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.707+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.707+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.708+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.708+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:49:17.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.710+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.710+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.711+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.712+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:49:17.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.713+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.713+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.713+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.714+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:49:17.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.716+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.716+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.717+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.718+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:49:17.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.719+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.719+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.720+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.721+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:49:17.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.722+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.723+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.723+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.724+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:49:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.726+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.726+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.726+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.728+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:49:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.729+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.729+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.730+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.731+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:49:17.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.732+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.732+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.733+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.734+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:49:17.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.735+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.735+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.736+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.737+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:49:17.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.738+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.739+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.739+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.740+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:49:17.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.741+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.742+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.742+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.743+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:49:17.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.744+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.745+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.745+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.746+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:49:17.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.747+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.747+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.748+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.749+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:49:17.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.750+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.751+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.751+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.752+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:49:17.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.754+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.754+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.755+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.756+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:49:17.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.757+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.757+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.757+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.758+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:49:17.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.760+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.760+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.760+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.761+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:49:17.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.763+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.763+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.763+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.764+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:49:17.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.766+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.766+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.766+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.767+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:49:17.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.769+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.769+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.769+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.771+0000 7fb914412800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:49:17.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.772+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.772+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:49:17.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.773+0000 7fb914412800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:49:17.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.774+0000 7fb7c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:49:17.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.776+0000 7fb914412800 20 remove_watcher() i=0 2024-03-04T12:49:17.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.776+0000 7fb914412800 2 removed watcher, disabling cache 2024-03-04T12:49:17.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.777+0000 7fb914412800 20 remove_watcher() i=1 2024-03-04T12:49:17.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.778+0000 7fb914412800 20 remove_watcher() i=2 2024-03-04T12:49:17.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.779+0000 7fb914412800 20 remove_watcher() i=3 2024-03-04T12:49:17.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.780+0000 7fb914412800 20 remove_watcher() i=4 2024-03-04T12:49:17.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.781+0000 7fb914412800 20 remove_watcher() i=5 2024-03-04T12:49:17.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.782+0000 7fb914412800 20 remove_watcher() i=6 2024-03-04T12:49:17.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:49:17.783+0000 7fb914412800 20 remove_watcher() i=7 2024-03-04T12:49:17.799 DEBUG:teuthology.orchestra.run.smithi090:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-03-04T12:49:18.307 INFO:teuthology.orchestra.run.smithi090.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-03-04T12:49:22.507 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :clean UP-TO-DATE 2024-03-04T12:49:46.107 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :compileJava 2024-03-04T12:49:46.579 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :processResources 2024-03-04T12:49:46.580 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :classes 2024-03-04T12:49:46.906 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:46.906 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :compileTestJava 2024-03-04T12:49:46.907 INFO:teuthology.orchestra.run.smithi090.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-04T12:49:46.907 INFO:teuthology.orchestra.run.smithi090.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-04T12:49:46.908 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:46.908 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :processTestResources NO-SOURCE 2024-03-04T12:49:46.908 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :testClasses 2024-03-04T12:49:52.706 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:52.706 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :test 2024-03-04T12:49:52.706 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:52.706 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-03-04T12:49:53.405 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:53.406 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-03-04T12:49:53.605 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:53.606 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-03-04T12:49:53.705 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:53.706 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-03-04T12:49:53.905 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:53.905 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-03-04T12:49:54.405 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:54.406 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-03-04T12:49:54.606 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:54.606 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-03-04T12:49:54.606 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:54.606 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-03-04T12:49:54.706 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:54.706 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-03-04T12:49:54.706 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:54.706 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-03-04T12:49:54.905 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:54.906 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-03-04T12:49:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:55.306 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-03-04T12:49:55.605 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:55.605 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-03-04T12:49:55.805 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:55.805 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-03-04T12:49:55.806 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04 12:49:55,705 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-04T12:49:59.605 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:59.606 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-03-04T12:49:59.906 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:59.906 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-03-04T12:49:59.906 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:49:59.906 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-03-04T12:50:00.105 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:00.105 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-03-04T12:50:00.205 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:00.205 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-03-04T12:50:00.505 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:00.506 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-03-04T12:50:00.805 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:00.805 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-03-04T12:50:01.005 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:01.005 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-03-04T12:50:01.105 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:01.105 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-03-04T12:50:01.205 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:01.205 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-03-04T12:50:03.505 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:03.506 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-03-04T12:50:03.705 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:03.705 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-03-04T12:50:04.105 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:04.105 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-03-04T12:50:04.305 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:04.305 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-03-04T12:50:04.605 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:04.606 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-03-04T12:50:04.805 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:04.805 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-03-04T12:50:08.705 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:08.706 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-03-04T12:50:08.905 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:08.905 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-03-04T12:50:10.005 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:10.006 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-03-04T12:50:10.205 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:10.205 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-03-04T12:50:10.605 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:10.605 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-03-04T12:50:10.805 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:10.805 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-03-04T12:50:11.206 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:11.206 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-03-04T12:50:11.405 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:11.405 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-03-04T12:50:11.505 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:11.505 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-03-04T12:50:11.705 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:11.705 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-03-04T12:50:11.706 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:11.706 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-03-04T12:50:11.906 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:11.906 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-03-04T12:50:11.906 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:11.906 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-03-04T12:50:12.105 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:12.105 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-03-04T12:50:12.106 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:12.106 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-03-04T12:50:12.305 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:12.306 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-03-04T12:50:12.306 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:12.306 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-03-04T12:50:12.605 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:12.605 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-03-04T12:50:12.606 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:12.606 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-03-04T12:50:12.806 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:12.806 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-03-04T12:50:12.806 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:12.806 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-03-04T12:50:13.005 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:13.005 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-03-04T12:50:13.505 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:13.505 INFO:teuthology.orchestra.run.smithi090.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-03-04T12:50:13.806 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:13.807 INFO:teuthology.orchestra.run.smithi090.stdout:---------------------------------------------------------------------- 2024-03-04T12:50:13.807 INFO:teuthology.orchestra.run.smithi090.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-03-04T12:50:13.807 INFO:teuthology.orchestra.run.smithi090.stdout:---------------------------------------------------------------------- 2024-03-04T12:50:13.807 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:13.807 INFO:teuthology.orchestra.run.smithi090.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-04T12:50:13.807 INFO:teuthology.orchestra.run.smithi090.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-04T12:50:13.807 INFO:teuthology.orchestra.run.smithi090.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-04T12:50:13.807 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:13.807 INFO:teuthology.orchestra.run.smithi090.stdout:BUILD SUCCESSFUL in 55s 2024-03-04T12:50:13.807 INFO:teuthology.orchestra.run.smithi090.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-03-04T12:50:14.125 DEBUG:teuthology.orchestra.run.smithi090:> radosgw-admin gc process --include-all 2024-03-04T12:50:14.175 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:50:14.176 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:50:14.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.203+0000 7f1e01533800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.204+0000 7f1e01533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.204+0000 7f1e01533800 20 realm 2024-03-04T12:50:14.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.204+0000 7f1e01533800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.204+0000 7f1e01533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.204+0000 7f1e01533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:50:14.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.204+0000 7f1e01533800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.204+0000 7f1e01533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.204+0000 7f1e01533800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.205+0000 7f1e01533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.205+0000 7f1e01533800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.206+0000 7f1e01533800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:50:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.206+0000 7f1e01533800 20 searching for the correct realm 2024-03-04T12:50:14.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.209+0000 7f1df7fff640 0 -- 172.21.15.90:0/1646067804 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f1de8079070 msgr2=0x7f1de806c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:50:14.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.213+0000 7f1df7fff640 0 -- 172.21.15.90:0/1646067804 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f1cc8079cd0 msgr2=0x7f1cc807c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:14.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.217+0000 7f1e01533800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:50:14.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.217+0000 7f1e01533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:50:14.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.217+0000 7f1e01533800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:50:14.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.217+0000 7f1e01533800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:50:14.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.217+0000 7f1e01533800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:50:14.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.217+0000 7f1e01533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:50:14.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.217+0000 7f1e01533800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.217+0000 7f1e01533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.217+0000 7f1e01533800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 20 zone default found 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 4 Realm: () 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 20 zonegroup default 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.218+0000 7f1e01533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.219+0000 7f1e01533800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.219+0000 7f1e01533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.219+0000 7f1e01533800 20 started sync module instance, tier type = 2024-03-04T12:50:14.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.219+0000 7f1e01533800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:50:14.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.228+0000 7f1e01533800 20 add_watcher() i=0 2024-03-04T12:50:14.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.228+0000 7f1e01533800 20 add_watcher() i=1 2024-03-04T12:50:14.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.228+0000 7f1e01533800 20 add_watcher() i=2 2024-03-04T12:50:14.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.228+0000 7f1e01533800 20 add_watcher() i=3 2024-03-04T12:50:14.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.228+0000 7f1e01533800 20 add_watcher() i=4 2024-03-04T12:50:14.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.228+0000 7f1e01533800 20 add_watcher() i=5 2024-03-04T12:50:14.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.228+0000 7f1e01533800 20 add_watcher() i=6 2024-03-04T12:50:14.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.229+0000 7f1e01533800 20 add_watcher() i=7 2024-03-04T12:50:14.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.229+0000 7f1e01533800 2 all 8 watchers are set, enabling cache 2024-03-04T12:50:14.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.230+0000 7f1cb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:14.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.231+0000 7f1e01533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:50:14.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.231+0000 7f1e01533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:50:14.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.265+0000 7f1cb27e4640 20 reqs_thread_entry: start 2024-03-04T12:50:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.265+0000 7f1e01533800 20 init_complete bucket index max shards: 11 2024-03-04T12:50:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.265+0000 7f1e01533800 20 Filter name: none 2024-03-04T12:50:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.265+0000 7f1c23fff640 20 reqs_thread_entry: start 2024-03-04T12:50:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.265+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:50:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.267+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.267+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.267+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.268+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:50:14.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.269+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.270+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.270+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:50:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.270+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15740759453638303026', time=2024-03-04T14:49:59.629065+0000, chain.objs.size()=6 2024-03-04T12:50:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.270+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.35__shadow_._eh0hP1LE8AMcv8P-shNsYIKrNm3Hte_0 2024-03-04T12:50:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.270+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.35__shadow_._eh0hP1LE8AMcv8P-shNsYIKrNm3Hte_1 2024-03-04T12:50:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.270+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.35__shadow_._eh0hP1LE8AMcv8P-shNsYIKrNm3Hte_2 2024-03-04T12:50:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.270+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.35__shadow_._eh0hP1LE8AMcv8P-shNsYIKrNm3Hte_3 2024-03-04T12:50:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.270+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.35__shadow_._eh0hP1LE8AMcv8P-shNsYIKrNm3Hte_4 2024-03-04T12:50:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.270+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.35__shadow_._eh0hP1LE8AMcv8P-shNsYIKrNm3Hte_5 2024-03-04T12:50:14.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.273+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.275+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:50:14.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.277+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.277+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.277+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.279+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:50:14.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.280+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.280+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:14.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15578538085458922820', time=2024-03-04T14:49:54.402717+0000, chain.objs.size()=9 2024-03-04T12:50:14.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.31__multipart_key1.2~1B2YIKHobU5eHJL_Mu0kuVRPRj49pMp.1 2024-03-04T12:50:14.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.31__shadow_key1.2~1B2YIKHobU5eHJL_Mu0kuVRPRj49pMp.1_1 2024-03-04T12:50:14.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.31__multipart_key1.2~1B2YIKHobU5eHJL_Mu0kuVRPRj49pMp.2 2024-03-04T12:50:14.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.31__shadow_key1.2~1B2YIKHobU5eHJL_Mu0kuVRPRj49pMp.2_1 2024-03-04T12:50:14.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.31__multipart_key1.2~1B2YIKHobU5eHJL_Mu0kuVRPRj49pMp.3 2024-03-04T12:50:14.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.31__shadow_key1.2~1B2YIKHobU5eHJL_Mu0kuVRPRj49pMp.3_1 2024-03-04T12:50:14.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.31__multipart_key1.2~1B2YIKHobU5eHJL_Mu0kuVRPRj49pMp.4 2024-03-04T12:50:14.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.31__shadow_key1.2~1B2YIKHobU5eHJL_Mu0kuVRPRj49pMp.4_1 2024-03-04T12:50:14.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.31__multipart_key1.2~1B2YIKHobU5eHJL_Mu0kuVRPRj49pMp.5 2024-03-04T12:50:14.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16237338819026102661', time=2024-03-04T14:50:12.167923+0000, chain.objs.size()=1 2024-03-04T12:50:14.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.281+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.51__shadow_.3SpObNR78tlBQ9YBhGI2wSQF93ePUTB_0 2024-03-04T12:50:14.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.284+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.287+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:50:14.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.288+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:50:14.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5849981670375491861', time=2024-03-04T14:50:06.259176+0000, chain.objs.size()=21 2024-03-04T12:50:14.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.1 2024-03-04T12:50:14.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.1_1 2024-03-04T12:50:14.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.2 2024-03-04T12:50:14.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.2_1 2024-03-04T12:50:14.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.3 2024-03-04T12:50:14.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.3_1 2024-03-04T12:50:14.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.4 2024-03-04T12:50:14.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.4_1 2024-03-04T12:50:14.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.5 2024-03-04T12:50:14.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.5_1 2024-03-04T12:50:14.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.6 2024-03-04T12:50:14.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.289+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.6_1 2024-03-04T12:50:14.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.292+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.7 2024-03-04T12:50:14.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.292+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.7_1 2024-03-04T12:50:14.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.292+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.8 2024-03-04T12:50:14.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.293+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.8_1 2024-03-04T12:50:14.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.293+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.9 2024-03-04T12:50:14.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.293+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.9_1 2024-03-04T12:50:14.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.293+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.10 2024-03-04T12:50:14.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.293+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.10_1 2024-03-04T12:50:14.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.293+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~raN5epuCOTVPPr0Orvd06ynb69hL2Nv.11 2024-03-04T12:50:14.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.293+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9', time=2024-03-04T14:50:11.311075+0000, chain.objs.size()=82 2024-03-04T12:50:14.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.293+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.1 2024-03-04T12:50:14.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.293+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.2 2024-03-04T12:50:14.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.295+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.3 2024-03-04T12:50:14.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.295+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.4 2024-03-04T12:50:14.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.296+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.5 2024-03-04T12:50:14.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.296+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.6 2024-03-04T12:50:14.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.296+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.7 2024-03-04T12:50:14.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.296+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.8 2024-03-04T12:50:14.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.296+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.9 2024-03-04T12:50:14.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.296+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.10 2024-03-04T12:50:14.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.296+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.11 2024-03-04T12:50:14.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.296+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.12 2024-03-04T12:50:14.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.296+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.13 2024-03-04T12:50:14.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.297+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.14 2024-03-04T12:50:14.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.297+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.15 2024-03-04T12:50:14.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.298+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.16 2024-03-04T12:50:14.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.298+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.17 2024-03-04T12:50:14.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.298+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.18 2024-03-04T12:50:14.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.298+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.19 2024-03-04T12:50:14.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.298+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.20 2024-03-04T12:50:14.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.298+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.21 2024-03-04T12:50:14.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.298+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.22 2024-03-04T12:50:14.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.298+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.23 2024-03-04T12:50:14.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.300+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.24 2024-03-04T12:50:14.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.300+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.25 2024-03-04T12:50:14.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.300+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.26 2024-03-04T12:50:14.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.300+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.27 2024-03-04T12:50:14.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.300+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.28 2024-03-04T12:50:14.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.300+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.29 2024-03-04T12:50:14.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.300+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.30 2024-03-04T12:50:14.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.300+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.31 2024-03-04T12:50:14.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.300+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.32 2024-03-04T12:50:14.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.300+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.33 2024-03-04T12:50:14.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.300+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.34 2024-03-04T12:50:14.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.302+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.35 2024-03-04T12:50:14.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.303+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.36 2024-03-04T12:50:14.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.303+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.37 2024-03-04T12:50:14.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.303+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.38 2024-03-04T12:50:14.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.303+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.39 2024-03-04T12:50:14.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.303+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.40 2024-03-04T12:50:14.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.303+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.41 2024-03-04T12:50:14.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.303+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.42 2024-03-04T12:50:14.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.303+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.43 2024-03-04T12:50:14.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.303+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.44 2024-03-04T12:50:14.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.303+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.45 2024-03-04T12:50:14.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.303+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.46 2024-03-04T12:50:14.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.304+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.47 2024-03-04T12:50:14.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.305+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.48 2024-03-04T12:50:14.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.305+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.49 2024-03-04T12:50:14.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.305+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.50 2024-03-04T12:50:14.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.305+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.51 2024-03-04T12:50:14.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.305+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.52 2024-03-04T12:50:14.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.306+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.53 2024-03-04T12:50:14.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.306+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.54 2024-03-04T12:50:14.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.306+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.55 2024-03-04T12:50:14.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.306+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.56 2024-03-04T12:50:14.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.306+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.57 2024-03-04T12:50:14.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.306+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.58 2024-03-04T12:50:14.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.306+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.59 2024-03-04T12:50:14.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.306+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.60 2024-03-04T12:50:14.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.306+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.61 2024-03-04T12:50:14.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.307+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.62 2024-03-04T12:50:14.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.307+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.63 2024-03-04T12:50:14.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.307+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.64 2024-03-04T12:50:14.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.307+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.65 2024-03-04T12:50:14.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.308+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.66 2024-03-04T12:50:14.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.308+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.67 2024-03-04T12:50:14.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.308+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.68 2024-03-04T12:50:14.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.309+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.69 2024-03-04T12:50:14.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.309+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.70 2024-03-04T12:50:14.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.309+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.71 2024-03-04T12:50:14.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.309+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.72 2024-03-04T12:50:14.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.309+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.73 2024-03-04T12:50:14.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.310+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.74 2024-03-04T12:50:14.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.310+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.75 2024-03-04T12:50:14.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.310+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.76 2024-03-04T12:50:14.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.310+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.77 2024-03-04T12:50:14.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.310+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.78 2024-03-04T12:50:14.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.310+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.79 2024-03-04T12:50:14.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.310+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.80 2024-03-04T12:50:14.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.311+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.81 2024-03-04T12:50:14.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.312+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47__multipart_key1.2~x61aPLWv1-UcKGHuERQbYir6EHW5pl9.82 2024-03-04T12:50:14.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.312+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14432757493919445994', time=2024-03-04T14:50:12.606618+0000, chain.objs.size()=1 2024-03-04T12:50:14.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.312+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.53__shadow_.VmIFWJ4NtOW9HkteEEDvKhxsGTE78fb_0 2024-03-04T12:50:14.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.313+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.315+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:50:14.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:14.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__shadow_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.1_1_dc29eeaa2c670bb1273e7f083adbc53a', time=2024-03-04T14:49:55.302104+0000, chain.objs.size()=9 2024-03-04T12:50:14.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__multipart_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.1 2024-03-04T12:50:14.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__shadow_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.1_1 2024-03-04T12:50:14.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__multipart_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.2 2024-03-04T12:50:14.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__shadow_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.2_1 2024-03-04T12:50:14.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__multipart_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.3 2024-03-04T12:50:14.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__shadow_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.3_1 2024-03-04T12:50:14.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__multipart_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.4 2024-03-04T12:50:14.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__shadow_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.4_1 2024-03-04T12:50:14.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__multipart_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.5 2024-03-04T12:50:14.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3876186754269041379', time=2024-03-04T14:49:58.302519+0000, chain.objs.size()=9 2024-03-04T12:50:14.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~OoBcq9KfTLgxpcVixrfec5WaNSYQ94S.1 2024-03-04T12:50:14.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~OoBcq9KfTLgxpcVixrfec5WaNSYQ94S.1_1 2024-03-04T12:50:14.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.317+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~OoBcq9KfTLgxpcVixrfec5WaNSYQ94S.2 2024-03-04T12:50:14.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.319+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~OoBcq9KfTLgxpcVixrfec5WaNSYQ94S.2_1 2024-03-04T12:50:14.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.319+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~OoBcq9KfTLgxpcVixrfec5WaNSYQ94S.3 2024-03-04T12:50:14.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.319+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~OoBcq9KfTLgxpcVixrfec5WaNSYQ94S.3_1 2024-03-04T12:50:14.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.320+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~OoBcq9KfTLgxpcVixrfec5WaNSYQ94S.4 2024-03-04T12:50:14.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.320+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~OoBcq9KfTLgxpcVixrfec5WaNSYQ94S.4_1 2024-03-04T12:50:14.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.320+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~OoBcq9KfTLgxpcVixrfec5WaNSYQ94S.5 2024-03-04T12:50:14.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.322+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.325+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:50:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.326+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.327+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.327+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:50:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.327+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8797953534982326368', time=2024-03-04T14:50:00.858275+0000, chain.objs.size()=9 2024-03-04T12:50:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.327+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.40__multipart_key1.2~etrDa0iyhxD3ttE_n2_CQB9CDQ7JXqe.1 2024-03-04T12:50:14.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.327+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.40__shadow_key1.2~etrDa0iyhxD3ttE_n2_CQB9CDQ7JXqe.1_1 2024-03-04T12:50:14.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.327+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.40__multipart_key1.2~etrDa0iyhxD3ttE_n2_CQB9CDQ7JXqe.2 2024-03-04T12:50:14.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.327+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.40__shadow_key1.2~etrDa0iyhxD3ttE_n2_CQB9CDQ7JXqe.2_1 2024-03-04T12:50:14.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.327+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.40__multipart_key1.2~etrDa0iyhxD3ttE_n2_CQB9CDQ7JXqe.3 2024-03-04T12:50:14.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.327+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.40__shadow_key1.2~etrDa0iyhxD3ttE_n2_CQB9CDQ7JXqe.3_1 2024-03-04T12:50:14.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.327+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.40__multipart_key1.2~etrDa0iyhxD3ttE_n2_CQB9CDQ7JXqe.4 2024-03-04T12:50:14.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.327+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.40__shadow_key1.2~etrDa0iyhxD3ttE_n2_CQB9CDQ7JXqe.4_1 2024-03-04T12:50:14.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.327+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.40__multipart_key1.2~etrDa0iyhxD3ttE_n2_CQB9CDQ7JXqe.5 2024-03-04T12:50:14.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.330+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.332+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:50:14.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.334+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.334+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.334+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:50:14.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.334+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15470148781158312120', time=2024-03-04T14:50:10.672339+0000, chain.objs.size()=9 2024-03-04T12:50:14.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.334+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.46__multipart_key1.2~PcS-12ZZBumNn1y7iwg-mHH2pTkOYIp.1 2024-03-04T12:50:14.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.334+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.46__shadow_key1.2~PcS-12ZZBumNn1y7iwg-mHH2pTkOYIp.1_1 2024-03-04T12:50:14.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.334+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.46__multipart_key1.2~PcS-12ZZBumNn1y7iwg-mHH2pTkOYIp.2 2024-03-04T12:50:14.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.334+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.46__shadow_key1.2~PcS-12ZZBumNn1y7iwg-mHH2pTkOYIp.2_1 2024-03-04T12:50:14.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.335+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.46__multipart_key1.2~PcS-12ZZBumNn1y7iwg-mHH2pTkOYIp.3 2024-03-04T12:50:14.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.335+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.46__shadow_key1.2~PcS-12ZZBumNn1y7iwg-mHH2pTkOYIp.3_1 2024-03-04T12:50:14.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.335+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.46__multipart_key1.2~PcS-12ZZBumNn1y7iwg-mHH2pTkOYIp.4 2024-03-04T12:50:14.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.335+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.46__shadow_key1.2~PcS-12ZZBumNn1y7iwg-mHH2pTkOYIp.4_1 2024-03-04T12:50:14.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.335+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.46__multipart_key1.2~PcS-12ZZBumNn1y7iwg-mHH2pTkOYIp.5 2024-03-04T12:50:14.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.337+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.339+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:50:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.341+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.341+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.341+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:50:14.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.341+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4990634571162192390', time=2024-03-04T14:49:59.086745+0000, chain.objs.size()=7 2024-03-04T12:50:14.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.341+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~CtdBHlEVNvV4sARuY-0NuhG--cZ9sLS.1 2024-03-04T12:50:14.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.341+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~CtdBHlEVNvV4sARuY-0NuhG--cZ9sLS.1_1 2024-03-04T12:50:14.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.341+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~CtdBHlEVNvV4sARuY-0NuhG--cZ9sLS.1_2 2024-03-04T12:50:14.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.341+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~CtdBHlEVNvV4sARuY-0NuhG--cZ9sLS.2 2024-03-04T12:50:14.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.341+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~CtdBHlEVNvV4sARuY-0NuhG--cZ9sLS.2_1 2024-03-04T12:50:14.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.341+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~CtdBHlEVNvV4sARuY-0NuhG--cZ9sLS.2_2 2024-03-04T12:50:14.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.341+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~CtdBHlEVNvV4sARuY-0NuhG--cZ9sLS.3 2024-03-04T12:50:14.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.345+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.347+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:50:14.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.348+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.349+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.349+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.350+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:50:14.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.351+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.351+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.351+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.352+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:50:14.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.354+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.354+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.355+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:50:14.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.355+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='2~43mn5I4AjHwzZE3gN5xSy7rd6ALedwV', time=2024-03-04T14:49:53.342193+0000, chain.objs.size()=9 2024-03-04T12:50:14.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.355+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.29__multipart_key1.2~43mn5I4AjHwzZE3gN5xSy7rd6ALedwV.1 2024-03-04T12:50:14.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.355+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.29__shadow_key1.2~43mn5I4AjHwzZE3gN5xSy7rd6ALedwV.1_1 2024-03-04T12:50:14.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.355+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.29__multipart_key1.2~43mn5I4AjHwzZE3gN5xSy7rd6ALedwV.2 2024-03-04T12:50:14.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.355+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.29__shadow_key1.2~43mn5I4AjHwzZE3gN5xSy7rd6ALedwV.2_1 2024-03-04T12:50:14.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.355+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.29__multipart_key1.2~43mn5I4AjHwzZE3gN5xSy7rd6ALedwV.3 2024-03-04T12:50:14.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.355+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.29__shadow_key1.2~43mn5I4AjHwzZE3gN5xSy7rd6ALedwV.3_1 2024-03-04T12:50:14.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.355+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.29__multipart_key1.2~43mn5I4AjHwzZE3gN5xSy7rd6ALedwV.4 2024-03-04T12:50:14.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.355+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.29__shadow_key1.2~43mn5I4AjHwzZE3gN5xSy7rd6ALedwV.4_1 2024-03-04T12:50:14.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.355+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.29__multipart_key1.2~43mn5I4AjHwzZE3gN5xSy7rd6ALedwV.5 2024-03-04T12:50:14.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.360+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.363+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:50:14.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.364+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.364+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:50:14.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14484638407606533360', time=2024-03-04T14:49:58.697086+0000, chain.objs.size()=9 2024-03-04T12:50:14.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~ecj2xoJMbKvf7zzQb0G49dua7GCsZ7d.1 2024-03-04T12:50:14.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~ecj2xoJMbKvf7zzQb0G49dua7GCsZ7d.1_1 2024-03-04T12:50:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~ecj2xoJMbKvf7zzQb0G49dua7GCsZ7d.2 2024-03-04T12:50:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~ecj2xoJMbKvf7zzQb0G49dua7GCsZ7d.2_1 2024-03-04T12:50:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~ecj2xoJMbKvf7zzQb0G49dua7GCsZ7d.3 2024-03-04T12:50:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~ecj2xoJMbKvf7zzQb0G49dua7GCsZ7d.3_1 2024-03-04T12:50:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~ecj2xoJMbKvf7zzQb0G49dua7GCsZ7d.4 2024-03-04T12:50:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~ecj2xoJMbKvf7zzQb0G49dua7GCsZ7d.4_1 2024-03-04T12:50:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~ecj2xoJMbKvf7zzQb0G49dua7GCsZ7d.5 2024-03-04T12:50:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2675806496288807503', time=2024-03-04T14:50:09.457159+0000, chain.objs.size()=1 2024-03-04T12:50:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.45__shadow_.o-Fz-K91SSJFeyvLVNPhKLaMD0KmJTw_0 2024-03-04T12:50:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7983926587394247856', time=2024-03-04T14:50:12.385980+0000, chain.objs.size()=1 2024-03-04T12:50:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.365+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.52__shadow_.gAlqOoi1rK1oHgG01_qCXG4Q9Lp2cJb_0 2024-03-04T12:50:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.368+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.370+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:50:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.372+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.372+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.372+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:50:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.372+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18241488937507616598', time=2024-03-04T14:49:59.750269+0000, chain.objs.size()=7 2024-03-04T12:50:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.372+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~UwLcA4fn4gHF-ml4qsLqxaq5BeIbc5q.1 2024-03-04T12:50:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.372+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~UwLcA4fn4gHF-ml4qsLqxaq5BeIbc5q.1_1 2024-03-04T12:50:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.372+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~UwLcA4fn4gHF-ml4qsLqxaq5BeIbc5q.1_2 2024-03-04T12:50:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.372+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~UwLcA4fn4gHF-ml4qsLqxaq5BeIbc5q.2 2024-03-04T12:50:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.372+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~UwLcA4fn4gHF-ml4qsLqxaq5BeIbc5q.2_1 2024-03-04T12:50:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.372+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~UwLcA4fn4gHF-ml4qsLqxaq5BeIbc5q.2_2 2024-03-04T12:50:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.372+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~UwLcA4fn4gHF-ml4qsLqxaq5BeIbc5q.3 2024-03-04T12:50:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.375+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.378+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:50:14.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.379+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.380+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.380+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.381+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:50:14.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.382+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.383+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.383+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.384+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:50:14.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.385+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16275363971742075154', time=2024-03-04T14:50:03.516244+0000, chain.objs.size()=9 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.41__multipart_key1.2~Ci9kxdv33om-JcKDiLMAnQahHs374T8.1 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.41__shadow_key1.2~Ci9kxdv33om-JcKDiLMAnQahHs374T8.1_1 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.41__multipart_key1.2~Ci9kxdv33om-JcKDiLMAnQahHs374T8.2 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.41__shadow_key1.2~Ci9kxdv33om-JcKDiLMAnQahHs374T8.2_1 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.41__multipart_key1.2~Ci9kxdv33om-JcKDiLMAnQahHs374T8.3 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.41__shadow_key1.2~Ci9kxdv33om-JcKDiLMAnQahHs374T8.3_1 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.41__multipart_key1.2~Ci9kxdv33om-JcKDiLMAnQahHs374T8.4 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.41__shadow_key1.2~Ci9kxdv33om-JcKDiLMAnQahHs374T8.4_1 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.41__multipart_key1.2~Ci9kxdv33om-JcKDiLMAnQahHs374T8.5 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.559978485802793732', time=2024-03-04T14:50:04.132524+0000, chain.objs.size()=1 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__shadow_.mnxUuF9GuJrFg-XDZN_C2ifkBK1CyVV_0 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10306730614243090656', time=2024-03-04T14:50:11.946634+0000, chain.objs.size()=1 2024-03-04T12:50:14.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.386+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.50__shadow_.h-M09jIdjNmy9bQTIN1AhiTci4ZKXzC_0 2024-03-04T12:50:14.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.390+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.392+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:50:14.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.393+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T12:50:14.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1066290194394184009', time=2024-03-04T14:49:59.487701+0000, chain.objs.size()=7 2024-03-04T12:50:14.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~146jZllq45Vk4Tszx06StRiIXoQUpPR.1 2024-03-04T12:50:14.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~146jZllq45Vk4Tszx06StRiIXoQUpPR.1_1 2024-03-04T12:50:14.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~146jZllq45Vk4Tszx06StRiIXoQUpPR.1_2 2024-03-04T12:50:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~146jZllq45Vk4Tszx06StRiIXoQUpPR.2 2024-03-04T12:50:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~146jZllq45Vk4Tszx06StRiIXoQUpPR.2_1 2024-03-04T12:50:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~146jZllq45Vk4Tszx06StRiIXoQUpPR.2_2 2024-03-04T12:50:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~146jZllq45Vk4Tszx06StRiIXoQUpPR.3 2024-03-04T12:50:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5210154500599310439', time=2024-03-04T14:50:04.145433+0000, chain.objs.size()=1 2024-03-04T12:50:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__shadow_.7d0XciMeeloIS8dPUT50KcFRE3Ac4za_0 2024-03-04T12:50:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8397494782331370827', time=2024-03-04T14:50:08.758371+0000, chain.objs.size()=16 2024-03-04T12:50:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.1 2024-03-04T12:50:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.394+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.1_1 2024-03-04T12:50:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.395+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.1_2 2024-03-04T12:50:14.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.395+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.2 2024-03-04T12:50:14.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.397+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.2_1 2024-03-04T12:50:14.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.398+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.2_2 2024-03-04T12:50:14.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.398+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.3 2024-03-04T12:50:14.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.398+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.3_1 2024-03-04T12:50:14.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.398+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.3_2 2024-03-04T12:50:14.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.398+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.4 2024-03-04T12:50:14.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.399+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.4_1 2024-03-04T12:50:14.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.399+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.4_2 2024-03-04T12:50:14.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.399+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.5 2024-03-04T12:50:14.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.399+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.5_1 2024-03-04T12:50:14.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.399+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.5_2 2024-03-04T12:50:14.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.401+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~S6QqyWQ4d0qLSd3jivl8F3Mek0xpgFP.6 2024-03-04T12:50:14.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.401+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16269928521392669307', time=2024-03-04T14:50:11.500386+0000, chain.objs.size()=1 2024-03-04T12:50:14.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.401+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.48__shadow_.xOAdgIaI2Ny9xEZXphOxtN7frgiHDWi_0 2024-03-04T12:50:14.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.403+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.405+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:50:14.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.406+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.407+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.407+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:50:14.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.407+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.808613906405899720', time=2024-03-04T14:50:04.127263+0000, chain.objs.size()=9 2024-03-04T12:50:14.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.407+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__multipart_file.mpg.2~a_Mt1ywiLUk9qIwuMlrIj3W2vofDHEZ.1 2024-03-04T12:50:14.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.407+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__shadow_file.mpg.2~a_Mt1ywiLUk9qIwuMlrIj3W2vofDHEZ.1_1 2024-03-04T12:50:14.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.407+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__multipart_file.mpg.2~a_Mt1ywiLUk9qIwuMlrIj3W2vofDHEZ.2 2024-03-04T12:50:14.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.407+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__shadow_file.mpg.2~a_Mt1ywiLUk9qIwuMlrIj3W2vofDHEZ.2_1 2024-03-04T12:50:14.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.407+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__multipart_file.mpg.2~a_Mt1ywiLUk9qIwuMlrIj3W2vofDHEZ.3 2024-03-04T12:50:14.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.407+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__shadow_file.mpg.2~a_Mt1ywiLUk9qIwuMlrIj3W2vofDHEZ.3_1 2024-03-04T12:50:14.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.407+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__multipart_file.mpg.2~a_Mt1ywiLUk9qIwuMlrIj3W2vofDHEZ.4 2024-03-04T12:50:14.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.408+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__shadow_file.mpg.2~a_Mt1ywiLUk9qIwuMlrIj3W2vofDHEZ.4_1 2024-03-04T12:50:14.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.408+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__multipart_file.mpg.2~a_Mt1ywiLUk9qIwuMlrIj3W2vofDHEZ.5 2024-03-04T12:50:14.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.411+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.413+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:50:14.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.415+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.415+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.415+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:50:14.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.415+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10651885754099763041', time=2024-03-04T14:50:07.501841+0000, chain.objs.size()=19 2024-03-04T12:50:14.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.415+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.1 2024-03-04T12:50:14.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.415+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.1_1 2024-03-04T12:50:14.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.416+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.2 2024-03-04T12:50:14.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.416+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.2_1 2024-03-04T12:50:14.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.416+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.3 2024-03-04T12:50:14.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.416+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.3_1 2024-03-04T12:50:14.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.416+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.4 2024-03-04T12:50:14.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.416+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.4_1 2024-03-04T12:50:14.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.416+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.5 2024-03-04T12:50:14.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.416+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.5_1 2024-03-04T12:50:14.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.416+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.6 2024-03-04T12:50:14.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.417+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.6_1 2024-03-04T12:50:14.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.418+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.7 2024-03-04T12:50:14.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.419+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.7_1 2024-03-04T12:50:14.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.419+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.8 2024-03-04T12:50:14.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.419+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.8_1 2024-03-04T12:50:14.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.419+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.9 2024-03-04T12:50:14.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.419+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.9_1 2024-03-04T12:50:14.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.419+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~9iUA_JKDTyUprWb8KtmGBqLfbHjV7qE.10 2024-03-04T12:50:14.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.421+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.423+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:50:14.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.425+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.425+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.426+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.426+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:50:14.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.428+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.428+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.428+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.429+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:50:14.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.431+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.431+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:50:14.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8391662823940790807', time=2024-03-04T14:50:06.940626+0000, chain.objs.size()=21 2024-03-04T12:50:14.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.1 2024-03-04T12:50:14.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.1_1 2024-03-04T12:50:14.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.2 2024-03-04T12:50:14.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.2_1 2024-03-04T12:50:14.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.3 2024-03-04T12:50:14.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.3_1 2024-03-04T12:50:14.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.4 2024-03-04T12:50:14.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.4_1 2024-03-04T12:50:14.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.5 2024-03-04T12:50:14.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.5_1 2024-03-04T12:50:14.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.6 2024-03-04T12:50:14.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.432+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.6_1 2024-03-04T12:50:14.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.434+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.7 2024-03-04T12:50:14.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.435+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.7_1 2024-03-04T12:50:14.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.435+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.8 2024-03-04T12:50:14.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.435+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.8_1 2024-03-04T12:50:14.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.435+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.9 2024-03-04T12:50:14.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.435+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.9_1 2024-03-04T12:50:14.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.436+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.10 2024-03-04T12:50:14.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.436+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.10_1 2024-03-04T12:50:14.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.436+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~PeTzuT1t7Avo3bZWeMLfgs40KHIDuPr.11 2024-03-04T12:50:14.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.439+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.441+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:50:14.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:50:14.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2664469218621600087', time=2024-03-04T14:50:08.617487+0000, chain.objs.size()=16 2024-03-04T12:50:14.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.1 2024-03-04T12:50:14.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.1_1 2024-03-04T12:50:14.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.1_2 2024-03-04T12:50:14.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.2 2024-03-04T12:50:14.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.2_1 2024-03-04T12:50:14.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.2_2 2024-03-04T12:50:14.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.3 2024-03-04T12:50:14.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.3_1 2024-03-04T12:50:14.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.3_2 2024-03-04T12:50:14.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.442+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.4 2024-03-04T12:50:14.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.443+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.4_1 2024-03-04T12:50:14.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.443+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.4_2 2024-03-04T12:50:14.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.446+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.5 2024-03-04T12:50:14.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.446+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.5_1 2024-03-04T12:50:14.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.446+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.5_2 2024-03-04T12:50:14.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.447+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~2iNXuV0lRN8PRgzaiva_cavZw3Ei6sw.6 2024-03-04T12:50:14.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.448+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.450+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:50:14.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.452+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.452+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:14.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14263226869575276243', time=2024-03-04T14:50:08.052099+0000, chain.objs.size()=16 2024-03-04T12:50:14.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.1 2024-03-04T12:50:14.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.1_1 2024-03-04T12:50:14.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.1_2 2024-03-04T12:50:14.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.2 2024-03-04T12:50:14.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.2_1 2024-03-04T12:50:14.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.2_2 2024-03-04T12:50:14.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.3 2024-03-04T12:50:14.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.3_1 2024-03-04T12:50:14.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.3_2 2024-03-04T12:50:14.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.4 2024-03-04T12:50:14.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.4_1 2024-03-04T12:50:14.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.453+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.4_2 2024-03-04T12:50:14.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.457+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.5 2024-03-04T12:50:14.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.457+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.5_1 2024-03-04T12:50:14.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.457+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__shadow_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.5_2 2024-03-04T12:50:14.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.457+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.44__multipart_key1.2~m8JCeli8DTZ-yc-mmG85DYF_Ex21gCt.6 2024-03-04T12:50:14.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.457+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15090748961268383250', time=2024-03-04T14:50:13.559453+0000, chain.objs.size()=21 2024-03-04T12:50:14.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.457+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__multipart_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.1 2024-03-04T12:50:14.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.457+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__shadow_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.1_1 2024-03-04T12:50:14.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.457+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__multipart_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.2 2024-03-04T12:50:14.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.457+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__shadow_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.2_1 2024-03-04T12:50:14.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.457+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__multipart_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.3 2024-03-04T12:50:14.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.458+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__shadow_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.3_1 2024-03-04T12:50:14.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.459+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__multipart_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.4 2024-03-04T12:50:14.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.460+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__shadow_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.4_1 2024-03-04T12:50:14.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.460+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__multipart_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.5 2024-03-04T12:50:14.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.461+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__shadow_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.5_1 2024-03-04T12:50:14.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.461+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__multipart_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.6 2024-03-04T12:50:14.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.461+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__shadow_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.6_1 2024-03-04T12:50:14.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.461+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__multipart_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.7 2024-03-04T12:50:14.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.461+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__shadow_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.7_1 2024-03-04T12:50:14.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.461+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__multipart_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.8 2024-03-04T12:50:14.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.461+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__shadow_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.8_1 2024-03-04T12:50:14.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.462+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__multipart_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.9 2024-03-04T12:50:14.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.462+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__shadow_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.9_1 2024-03-04T12:50:14.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.462+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__multipart_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.10 2024-03-04T12:50:14.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.462+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__shadow_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.10_1 2024-03-04T12:50:14.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.465+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.55__multipart_key1.2~4n272hX6rCdp6k82P5L7o8rxGCfO2Wt.11 2024-03-04T12:50:14.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.466+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.469+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:50:14.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.470+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.470+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.470+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.471+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:50:14.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.473+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.473+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.474+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.474+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:50:14.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:14.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4854978752110739863', time=2024-03-04T14:49:55.422590+0000, chain.objs.size()=9 2024-03-04T12:50:14.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__multipart_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.1 2024-03-04T12:50:14.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__shadow_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.1_1 2024-03-04T12:50:14.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__multipart_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.2 2024-03-04T12:50:14.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__shadow_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.2_1 2024-03-04T12:50:14.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__multipart_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.3 2024-03-04T12:50:14.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__shadow_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.3_1 2024-03-04T12:50:14.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__multipart_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.4 2024-03-04T12:50:14.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__shadow_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.4_1 2024-03-04T12:50:14.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.33__multipart_key1.2~OXZlgmwG_AxCZROqaPtyZAbAf-G6t5P.5 2024-03-04T12:50:14.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2714305617387293879', time=2024-03-04T14:50:11.725812+0000, chain.objs.size()=1 2024-03-04T12:50:14.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.476+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.49__shadow_.HdH6iyQ7Vc-R2Zc0etSDz3FSY0SsPGf_0 2024-03-04T12:50:14.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.478+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.480+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:50:14.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.481+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.482+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.482+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.483+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:50:14.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.484+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.485+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.485+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:14.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.485+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.256680015283060399', time=2024-03-04T14:50:04.138915+0000, chain.objs.size()=9 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.485+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__multipart_file2.mpg.2~dNRE3nplV2Myvqm3vev-Y4GqFL6OUrr.1 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.485+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__shadow_file2.mpg.2~dNRE3nplV2Myvqm3vev-Y4GqFL6OUrr.1_1 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.485+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__multipart_file2.mpg.2~dNRE3nplV2Myvqm3vev-Y4GqFL6OUrr.2 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.485+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__shadow_file2.mpg.2~dNRE3nplV2Myvqm3vev-Y4GqFL6OUrr.2_1 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.485+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__multipart_file2.mpg.2~dNRE3nplV2Myvqm3vev-Y4GqFL6OUrr.3 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.485+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__shadow_file2.mpg.2~dNRE3nplV2Myvqm3vev-Y4GqFL6OUrr.3_1 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.485+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__multipart_file2.mpg.2~dNRE3nplV2Myvqm3vev-Y4GqFL6OUrr.4 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.485+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__shadow_file2.mpg.2~dNRE3nplV2Myvqm3vev-Y4GqFL6OUrr.4_1 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.485+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__multipart_file2.mpg.2~dNRE3nplV2Myvqm3vev-Y4GqFL6OUrr.5 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.486+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9159284290354621754', time=2024-03-04T14:50:10.029606+0000, chain.objs.size()=9 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.486+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.45__multipart_key1.2~W0eeTGMUcP0ZhpKyYRyU0Nt45iz843W.1 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.486+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.45__shadow_key1.2~W0eeTGMUcP0ZhpKyYRyU0Nt45iz843W.1_1 2024-03-04T12:50:14.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.486+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.45__multipart_key1.2~W0eeTGMUcP0ZhpKyYRyU0Nt45iz843W.2 2024-03-04T12:50:14.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.488+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.45__shadow_key1.2~W0eeTGMUcP0ZhpKyYRyU0Nt45iz843W.2_1 2024-03-04T12:50:14.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.488+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.45__multipart_key1.2~W0eeTGMUcP0ZhpKyYRyU0Nt45iz843W.3 2024-03-04T12:50:14.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.488+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.45__shadow_key1.2~W0eeTGMUcP0ZhpKyYRyU0Nt45iz843W.3_1 2024-03-04T12:50:14.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.488+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.45__multipart_key1.2~W0eeTGMUcP0ZhpKyYRyU0Nt45iz843W.4 2024-03-04T12:50:14.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.489+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.45__shadow_key1.2~W0eeTGMUcP0ZhpKyYRyU0Nt45iz843W.4_1 2024-03-04T12:50:14.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.489+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.45__multipart_key1.2~W0eeTGMUcP0ZhpKyYRyU0Nt45iz843W.5 2024-03-04T12:50:14.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.492+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.494+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:50:14.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:14.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5314520164298393776', time=2024-03-04T14:49:57.246293+0000, chain.objs.size()=9 2024-03-04T12:50:14.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~MfjCTLWMFjAvitHlj_sgAqgZxlUbl0A.1 2024-03-04T12:50:14.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~MfjCTLWMFjAvitHlj_sgAqgZxlUbl0A.1_1 2024-03-04T12:50:14.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~MfjCTLWMFjAvitHlj_sgAqgZxlUbl0A.2 2024-03-04T12:50:14.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~MfjCTLWMFjAvitHlj_sgAqgZxlUbl0A.2_1 2024-03-04T12:50:14.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~MfjCTLWMFjAvitHlj_sgAqgZxlUbl0A.3 2024-03-04T12:50:14.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~MfjCTLWMFjAvitHlj_sgAqgZxlUbl0A.3_1 2024-03-04T12:50:14.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~MfjCTLWMFjAvitHlj_sgAqgZxlUbl0A.4 2024-03-04T12:50:14.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__shadow_key1.2~MfjCTLWMFjAvitHlj_sgAqgZxlUbl0A.4_1 2024-03-04T12:50:14.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.36__multipart_key1.2~MfjCTLWMFjAvitHlj_sgAqgZxlUbl0A.5 2024-03-04T12:50:14.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9964646524589419411', time=2024-03-04T14:50:04.150726+0000, chain.objs.size()=1 2024-03-04T12:50:14.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.496+0000 7f1e01533800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.42__shadow_.czaupX7E4u-URsJtcPGso8aiJMmkvcM_0 2024-03-04T12:50:14.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.500+0000 7f1e01533800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:14.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.502+0000 7f1e01533800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:50:14.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.503+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.504+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.504+0000 7f1e01533800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.506+0000 7f1cb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.508+0000 7f1e01533800 20 remove_watcher() i=0 2024-03-04T12:50:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.508+0000 7f1e01533800 2 removed watcher, disabling cache 2024-03-04T12:50:14.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.509+0000 7f1e01533800 20 remove_watcher() i=1 2024-03-04T12:50:14.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.510+0000 7f1e01533800 20 remove_watcher() i=2 2024-03-04T12:50:14.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.511+0000 7f1e01533800 20 remove_watcher() i=3 2024-03-04T12:50:14.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.512+0000 7f1e01533800 20 remove_watcher() i=4 2024-03-04T12:50:14.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.513+0000 7f1e01533800 20 remove_watcher() i=5 2024-03-04T12:50:14.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.514+0000 7f1e01533800 20 remove_watcher() i=6 2024-03-04T12:50:14.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.515+0000 7f1e01533800 20 remove_watcher() i=7 2024-03-04T12:50:14.531 DEBUG:teuthology.orchestra.run.smithi090:> radosgw-admin gc process --include-all 2024-03-04T12:50:14.579 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:50:14.580 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:50:14.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.606+0000 7ffa0f91f800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.608+0000 7ffa0f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.608+0000 7ffa0f91f800 20 realm 2024-03-04T12:50:14.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.608+0000 7ffa0f91f800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.608+0000 7ffa0f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.608+0000 7ffa0f91f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:50:14.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.608+0000 7ffa0f91f800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.608+0000 7ffa0f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.608+0000 7ffa0f91f800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.609+0000 7ffa0f91f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:14.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.609+0000 7ffa0f91f800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.609+0000 7ffa0f91f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:50:14.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.609+0000 7ffa0f91f800 20 searching for the correct realm 2024-03-04T12:50:14.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.613+0000 7ffa0aee7640 0 -- 172.21.15.90:0/2124627589 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x5613656396b0 msgr2=0x56136563bb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:14.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.616+0000 7ffa0b6e8640 0 -- 172.21.15.90:0/2124627589 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7ffa0003ab90 msgr2=0x7ffa000522d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:14.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.620+0000 7ffa0f91f800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:50:14.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.620+0000 7ffa0f91f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:50:14.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.620+0000 7ffa0f91f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:50:14.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.620+0000 7ffa0f91f800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:50:14.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.620+0000 7ffa0f91f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:50:14.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.620+0000 7ffa0f91f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:50:14.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.620+0000 7ffa0f91f800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.620+0000 7ffa0f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.620+0000 7ffa0f91f800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.620+0000 7ffa0f91f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.620+0000 7ffa0f91f800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:50:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 20 zone default found 2024-03-04T12:50:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 4 Realm: () 2024-03-04T12:50:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:50:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:50:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:50:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 20 zonegroup default 2024-03-04T12:50:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 20 started sync module instance, tier type = 2024-03-04T12:50:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.621+0000 7ffa0f91f800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:50:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.630+0000 7ffa0f91f800 20 add_watcher() i=0 2024-03-04T12:50:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.630+0000 7ffa0f91f800 20 add_watcher() i=1 2024-03-04T12:50:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.630+0000 7ffa0f91f800 20 add_watcher() i=2 2024-03-04T12:50:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.630+0000 7ffa0f91f800 20 add_watcher() i=3 2024-03-04T12:50:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.630+0000 7ffa0f91f800 20 add_watcher() i=4 2024-03-04T12:50:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.630+0000 7ffa0f91f800 20 add_watcher() i=5 2024-03-04T12:50:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.630+0000 7ffa0f91f800 20 add_watcher() i=6 2024-03-04T12:50:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.631+0000 7ffa0f91f800 20 add_watcher() i=7 2024-03-04T12:50:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.631+0000 7ffa0f91f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:50:14.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.633+0000 7ff8c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:14.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.633+0000 7ffa0f91f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:50:14.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.633+0000 7ffa0f91f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:50:14.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.666+0000 7ff8c0fe1640 20 reqs_thread_entry: start 2024-03-04T12:50:14.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.666+0000 7ffa0f91f800 20 init_complete bucket index max shards: 11 2024-03-04T12:50:14.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.666+0000 7ffa0f91f800 20 Filter name: none 2024-03-04T12:50:14.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.666+0000 7ff83a7fc640 20 reqs_thread_entry: start 2024-03-04T12:50:14.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.666+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:50:14.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.667+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.668+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.668+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.669+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:50:14.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.670+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.670+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.671+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.671+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:50:14.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.673+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.673+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.674+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.675+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:50:14.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.676+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.676+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.677+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.677+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:50:14.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.679+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.679+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.679+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.680+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:50:14.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.681+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.682+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.682+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.683+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:50:14.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.684+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.685+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.685+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.686+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:50:14.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.687+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.688+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.688+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.689+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:50:14.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.690+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.691+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.691+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.692+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:50:14.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.693+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.694+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.694+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.695+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:50:14.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.697+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.697+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.697+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.698+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:50:14.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.699+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.700+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.700+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.701+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:50:14.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.702+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.703+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.703+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.704+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:50:14.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.705+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.706+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.706+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.707+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:50:14.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.708+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.709+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.709+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.710+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:50:14.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.711+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.712+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.712+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.713+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:50:14.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.714+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.715+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.715+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.716+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:50:14.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.717+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.718+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.718+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.719+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:50:14.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.720+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.721+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.721+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.722+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:50:14.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.723+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.724+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.724+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.725+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:50:14.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.726+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.726+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.727+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.727+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:50:14.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.729+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.729+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.729+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.731+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:50:14.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.732+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.732+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.732+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.733+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:50:14.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.735+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.735+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.735+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.736+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:50:14.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.738+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.738+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.738+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.739+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:50:14.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.741+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.741+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.742+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.742+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:50:14.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.744+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.744+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.745+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.746+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:50:14.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.747+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.747+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.747+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.748+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:50:14.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.750+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.750+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.750+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.751+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:50:14.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.753+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.753+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.753+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.754+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:50:14.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.756+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.756+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.756+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.757+0000 7ffa0f91f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:50:14.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.759+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.759+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:14.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.759+0000 7ffa0f91f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:14.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.761+0000 7ff8c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:14.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.763+0000 7ffa0f91f800 20 remove_watcher() i=0 2024-03-04T12:50:14.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.763+0000 7ffa0f91f800 2 removed watcher, disabling cache 2024-03-04T12:50:14.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.764+0000 7ffa0f91f800 20 remove_watcher() i=1 2024-03-04T12:50:14.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.765+0000 7ffa0f91f800 20 remove_watcher() i=2 2024-03-04T12:50:14.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.766+0000 7ffa0f91f800 20 remove_watcher() i=3 2024-03-04T12:50:14.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.767+0000 7ffa0f91f800 20 remove_watcher() i=4 2024-03-04T12:50:14.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.768+0000 7ffa0f91f800 20 remove_watcher() i=5 2024-03-04T12:50:14.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.769+0000 7ffa0f91f800 20 remove_watcher() i=6 2024-03-04T12:50:14.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.770+0000 7ffa0f91f800 20 remove_watcher() i=7 2024-03-04T12:50:14.786 DEBUG:teuthology.orchestra.run.smithi090:> radosgw-admin gc process --include-all 2024-03-04T12:50:14.834 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:50:14.835 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:50:14.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.861+0000 7f0741e85800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.862+0000 7f0741e85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.862+0000 7f0741e85800 20 realm 2024-03-04T12:50:14.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.862+0000 7f0741e85800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.863+0000 7f0741e85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.863+0000 7f0741e85800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:50:14.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.863+0000 7f0741e85800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.863+0000 7f0741e85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:14.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.863+0000 7f0741e85800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.864+0000 7f0741e85800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:14.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.864+0000 7f0741e85800 20 rados->read ofs=0 len=0 2024-03-04T12:50:14.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.864+0000 7f0741e85800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:50:14.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.864+0000 7f0741e85800 20 searching for the correct realm 2024-03-04T12:50:14.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.867+0000 7f0737fff640 0 -- 172.21.15.90:0/769474706 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f0728016070 msgr2=0x7f072800a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:14.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:14.871+0000 7f073f981640 0 -- 172.21.15.90:0/769474706 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f0728047410 msgr2=0x7f0728047870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:15.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:50:15.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:50:15.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 zone default found 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 4 Realm: () 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:50:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:50:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:50:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 zonegroup default 2024-03-04T12:50:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.077+0000 7f0741e85800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.078+0000 7f0741e85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.078+0000 7f0741e85800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.078+0000 7f0741e85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.078+0000 7f0741e85800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.078+0000 7f0741e85800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.078+0000 7f0741e85800 20 started sync module instance, tier type = 2024-03-04T12:50:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.078+0000 7f0741e85800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:50:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.087+0000 7f0741e85800 20 add_watcher() i=0 2024-03-04T12:50:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.087+0000 7f0741e85800 20 add_watcher() i=1 2024-03-04T12:50:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.087+0000 7f0741e85800 20 add_watcher() i=2 2024-03-04T12:50:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.087+0000 7f0741e85800 20 add_watcher() i=3 2024-03-04T12:50:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.087+0000 7f0741e85800 20 add_watcher() i=4 2024-03-04T12:50:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.087+0000 7f0741e85800 20 add_watcher() i=5 2024-03-04T12:50:15.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.087+0000 7f0741e85800 20 add_watcher() i=6 2024-03-04T12:50:15.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.088+0000 7f0741e85800 20 add_watcher() i=7 2024-03-04T12:50:15.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.088+0000 7f0741e85800 2 all 8 watchers are set, enabling cache 2024-03-04T12:50:15.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.089+0000 7f05f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:15.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.089+0000 7f0741e85800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:50:15.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.089+0000 7f0741e85800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:50:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.126+0000 7f05f4fe1640 20 reqs_thread_entry: start 2024-03-04T12:50:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.127+0000 7f0741e85800 20 init_complete bucket index max shards: 11 2024-03-04T12:50:15.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.127+0000 7f0741e85800 20 Filter name: none 2024-03-04T12:50:15.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.127+0000 7f056e7fc640 20 reqs_thread_entry: start 2024-03-04T12:50:15.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.127+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:50:15.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.129+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.129+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.129+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.130+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:50:15.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.132+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.132+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.132+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.133+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:50:15.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.141+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.142+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.142+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.143+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:50:15.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.144+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.145+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.145+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.146+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:50:15.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.147+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.147+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.148+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.148+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:50:15.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.150+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.151+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.151+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.152+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:50:15.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.154+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.154+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.154+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.155+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:50:15.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.157+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.157+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.157+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.158+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:50:15.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.160+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.160+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.161+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.162+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:50:15.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.163+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.164+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.164+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.165+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:50:15.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.166+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.167+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.167+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.168+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:50:15.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.169+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.170+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.170+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.171+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:50:15.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.173+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.173+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.173+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.174+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:50:15.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.176+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.176+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.177+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.178+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:50:15.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.179+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.180+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.180+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.181+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:50:15.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.182+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.183+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.183+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.184+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:50:15.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.185+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.185+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.186+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.187+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:50:15.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.188+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.188+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.189+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.190+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:50:15.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.191+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.191+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.191+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.192+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:50:15.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.194+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.194+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.195+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.196+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:50:15.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.197+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.197+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.198+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.199+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:50:15.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.200+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.200+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.201+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.201+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:50:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.203+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.203+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.203+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.204+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:50:15.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.206+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.206+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.207+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.208+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:50:15.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.209+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.210+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.210+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.211+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:50:15.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.212+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.213+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.213+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.214+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:50:15.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.215+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.216+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.216+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.217+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:50:15.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.218+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.219+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.219+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.220+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:50:15.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.221+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.222+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.222+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.223+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:50:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.224+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.225+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.225+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.226+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:50:15.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.227+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.227+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.228+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.228+0000 7f0741e85800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:50:15.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.230+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.230+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.231+0000 7f0741e85800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.232+0000 7f05f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:15.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.234+0000 7f0741e85800 20 remove_watcher() i=0 2024-03-04T12:50:15.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.234+0000 7f0741e85800 2 removed watcher, disabling cache 2024-03-04T12:50:15.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.235+0000 7f0741e85800 20 remove_watcher() i=1 2024-03-04T12:50:15.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.236+0000 7f0741e85800 20 remove_watcher() i=2 2024-03-04T12:50:15.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.237+0000 7f0741e85800 20 remove_watcher() i=3 2024-03-04T12:50:15.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.238+0000 7f0741e85800 20 remove_watcher() i=4 2024-03-04T12:50:15.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.239+0000 7f0741e85800 20 remove_watcher() i=5 2024-03-04T12:50:15.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.240+0000 7f0741e85800 20 remove_watcher() i=6 2024-03-04T12:50:15.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.241+0000 7f0741e85800 20 remove_watcher() i=7 2024-03-04T12:50:15.257 DEBUG:teuthology.orchestra.run.smithi090:> radosgw-admin gc process --include-all 2024-03-04T12:50:15.306 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:50:15.306 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:50:15.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.335+0000 7fb623d33800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.336+0000 7fb623d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:15.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.337+0000 7fb623d33800 20 realm 2024-03-04T12:50:15.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.337+0000 7fb623d33800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.337+0000 7fb623d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:15.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.337+0000 7fb623d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:50:15.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.337+0000 7fb623d33800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.337+0000 7fb623d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:15.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.337+0000 7fb623d33800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.338+0000 7fb623d33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:15.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.338+0000 7fb623d33800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.338+0000 7fb623d33800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:50:15.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.338+0000 7fb623d33800 20 searching for the correct realm 2024-03-04T12:50:15.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.341+0000 7fb61f1d2640 0 -- 172.21.15.90:0/2043837470 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fb608080060 msgr2=0x7fb6080c92b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:15.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.344+0000 7fb61f9d3640 0 -- 172.21.15.90:0/2043837470 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fb60806e7b0 msgr2=0x7fb6080a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:15.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.549+0000 7fb623d33800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:50:15.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.549+0000 7fb623d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:50:15.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.549+0000 7fb623d33800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:50:15.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.549+0000 7fb623d33800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:50:15.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.549+0000 7fb623d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:50:15.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.549+0000 7fb623d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:50:15.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.549+0000 7fb623d33800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.550+0000 7fb623d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:15.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.550+0000 7fb623d33800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.550+0000 7fb623d33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:15.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.550+0000 7fb623d33800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.550+0000 7fb623d33800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:50:15.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.550+0000 7fb623d33800 20 zone default found 2024-03-04T12:50:15.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.550+0000 7fb623d33800 4 Realm: () 2024-03-04T12:50:15.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.550+0000 7fb623d33800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:50:15.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.550+0000 7fb623d33800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:50:15.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.550+0000 7fb623d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:50:15.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.550+0000 7fb623d33800 20 zonegroup default 2024-03-04T12:50:15.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.550+0000 7fb623d33800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.551+0000 7fb623d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:15.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.551+0000 7fb623d33800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.551+0000 7fb623d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:15.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.551+0000 7fb623d33800 20 rados->read ofs=0 len=0 2024-03-04T12:50:15.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.551+0000 7fb623d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:15.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.551+0000 7fb623d33800 20 started sync module instance, tier type = 2024-03-04T12:50:15.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.551+0000 7fb623d33800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:50:15.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.560+0000 7fb623d33800 20 add_watcher() i=0 2024-03-04T12:50:15.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.560+0000 7fb623d33800 20 add_watcher() i=1 2024-03-04T12:50:15.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.560+0000 7fb623d33800 20 add_watcher() i=2 2024-03-04T12:50:15.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.560+0000 7fb623d33800 20 add_watcher() i=3 2024-03-04T12:50:15.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.560+0000 7fb623d33800 20 add_watcher() i=4 2024-03-04T12:50:15.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.560+0000 7fb623d33800 20 add_watcher() i=5 2024-03-04T12:50:15.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.560+0000 7fb623d33800 20 add_watcher() i=6 2024-03-04T12:50:15.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.561+0000 7fb623d33800 20 add_watcher() i=7 2024-03-04T12:50:15.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.561+0000 7fb623d33800 2 all 8 watchers are set, enabling cache 2024-03-04T12:50:15.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.563+0000 7fb4d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:15.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.563+0000 7fb623d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:50:15.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.563+0000 7fb623d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:50:15.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.598+0000 7fb4d4fe1640 20 reqs_thread_entry: start 2024-03-04T12:50:15.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.598+0000 7fb623d33800 20 init_complete bucket index max shards: 11 2024-03-04T12:50:15.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.598+0000 7fb623d33800 20 Filter name: none 2024-03-04T12:50:15.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.598+0000 7fb44e7fc640 20 reqs_thread_entry: start 2024-03-04T12:50:15.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.598+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:50:15.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.599+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.600+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.600+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.601+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:50:15.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.602+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.603+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.603+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.604+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:50:15.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.605+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.606+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.606+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.607+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:50:15.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.608+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.609+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.609+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.610+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:50:15.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.611+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.612+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.612+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.613+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:50:15.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.614+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.615+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.615+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.616+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:50:15.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.617+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.618+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.618+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.619+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:50:15.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.620+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.621+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.621+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.622+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:50:15.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.623+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.624+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.624+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.625+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:50:15.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.626+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.627+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.627+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.628+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:50:15.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.630+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.630+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.631+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.632+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:50:15.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.633+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.633+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.634+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.634+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:50:15.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.636+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.636+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.636+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.637+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:50:15.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.639+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.639+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.639+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.640+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:50:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.642+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.642+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.642+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.644+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:50:15.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.645+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.645+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.645+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.647+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:50:15.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.648+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.648+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.649+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.650+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:50:15.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.651+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.651+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.651+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.652+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:50:15.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.654+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.654+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.655+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.656+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:50:15.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.657+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.658+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.658+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.659+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:50:15.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.660+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.661+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.661+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.662+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:50:15.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.663+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.664+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.664+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.665+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:50:15.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.666+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.667+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.667+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.668+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:50:15.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.669+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.670+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.670+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.671+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:50:15.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.673+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.673+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.673+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.674+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:50:15.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.676+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.677+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.677+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.678+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:50:15.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.679+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.679+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.679+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.680+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:50:15.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.682+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.682+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.682+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.683+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:50:15.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.685+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.685+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.685+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.686+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:50:15.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.688+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.689+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.689+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.690+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:50:15.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.691+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.691+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.692+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.692+0000 7fb623d33800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:50:15.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.694+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.695+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:15.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.695+0000 7fb623d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:15.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.697+0000 7fb4d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:15.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.699+0000 7fb623d33800 20 remove_watcher() i=0 2024-03-04T12:50:15.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.699+0000 7fb623d33800 2 removed watcher, disabling cache 2024-03-04T12:50:15.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.700+0000 7fb623d33800 20 remove_watcher() i=1 2024-03-04T12:50:15.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.701+0000 7fb623d33800 20 remove_watcher() i=2 2024-03-04T12:50:15.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.702+0000 7fb623d33800 20 remove_watcher() i=3 2024-03-04T12:50:15.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.703+0000 7fb623d33800 20 remove_watcher() i=4 2024-03-04T12:50:15.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.704+0000 7fb623d33800 20 remove_watcher() i=5 2024-03-04T12:50:15.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.705+0000 7fb623d33800 20 remove_watcher() i=6 2024-03-04T12:50:15.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:15.706+0000 7fb623d33800 20 remove_watcher() i=7 2024-03-04T12:50:15.722 DEBUG:teuthology.orchestra.run.smithi090:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-03-04T12:50:16.205 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :clean 2024-03-04T12:50:17.000 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :compileJava 2024-03-04T12:50:17.001 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :processResources 2024-03-04T12:50:17.100 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :classes 2024-03-04T12:50:17.501 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:17.501 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :compileTestJava 2024-03-04T12:50:17.501 INFO:teuthology.orchestra.run.smithi090.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-04T12:50:17.502 INFO:teuthology.orchestra.run.smithi090.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-04T12:50:17.502 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:17.502 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :processTestResources NO-SOURCE 2024-03-04T12:50:17.502 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :testClasses 2024-03-04T12:50:19.502 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :test 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests STANDARD_OUT 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04 12:50:18,761 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-03-04T12:50:19.503 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:19.504 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-03-04T12:50:19.504 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:19.504 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-03-04T12:50:19.700 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:19.701 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-03-04T12:50:19.800 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:19.801 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-03-04T12:50:19.901 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:19.901 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-03-04T12:50:19.901 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:19.901 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-03-04T12:50:20.201 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:20.201 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-03-04T12:50:20.201 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:20.201 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-03-04T12:50:20.300 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:20.300 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-03-04T12:50:20.403 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:20.403 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-03-04T12:50:20.700 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:20.700 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-03-04T12:50:20.800 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:20.800 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-03-04T12:50:21.001 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:21.001 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-03-04T12:50:21.001 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:21.001 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-03-04T12:50:21.084 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:21.084 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------- 2024-03-04T12:50:21.084 INFO:teuthology.orchestra.run.smithi090.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-03-04T12:50:21.084 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------- 2024-03-04T12:50:21.084 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:21.084 INFO:teuthology.orchestra.run.smithi090.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-04T12:50:21.084 INFO:teuthology.orchestra.run.smithi090.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-04T12:50:21.084 INFO:teuthology.orchestra.run.smithi090.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-04T12:50:21.085 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:21.085 INFO:teuthology.orchestra.run.smithi090.stdout:BUILD SUCCESSFUL in 5s 2024-03-04T12:50:21.085 INFO:teuthology.orchestra.run.smithi090.stdout:5 actionable tasks: 5 executed 2024-03-04T12:50:21.088 DEBUG:teuthology.orchestra.run.smithi090:> radosgw-admin gc process --include-all 2024-03-04T12:50:21.137 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:50:21.137 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:50:21.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.164+0000 7fcc6e844800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.165+0000 7fcc6e844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.165+0000 7fcc6e844800 20 realm 2024-03-04T12:50:21.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.165+0000 7fcc6e844800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.165+0000 7fcc6e844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.165+0000 7fcc6e844800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:50:21.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.165+0000 7fcc6e844800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.165+0000 7fcc6e844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.165+0000 7fcc6e844800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.166+0000 7fcc6e844800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:21.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.166+0000 7fcc6e844800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.167+0000 7fcc6e844800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:50:21.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.167+0000 7fcc6e844800 20 searching for the correct realm 2024-03-04T12:50:21.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.170+0000 7fcc6cb41640 0 -- 172.21.15.90:0/17372619 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x563dc2714220 msgr2=0x563dc27166c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:21.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.174+0000 7fcc6bb3f640 0 -- 172.21.15.90:0/17372619 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fcc6000b040 msgr2=0x7fcc60014930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:21.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.178+0000 7fcc6e844800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:50:21.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.178+0000 7fcc6e844800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:50:21.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.178+0000 7fcc6e844800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:50:21.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.178+0000 7fcc6e844800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:50:21.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.178+0000 7fcc6e844800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:50:21.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.178+0000 7fcc6e844800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:50:21.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.178+0000 7fcc6e844800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:21.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:50:21.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 20 zone default found 2024-03-04T12:50:21.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 4 Realm: () 2024-03-04T12:50:21.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:50:21.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:50:21.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:50:21.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 20 zonegroup default 2024-03-04T12:50:21.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.179+0000 7fcc6e844800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.180+0000 7fcc6e844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.180+0000 7fcc6e844800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.180+0000 7fcc6e844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.180+0000 7fcc6e844800 20 started sync module instance, tier type = 2024-03-04T12:50:21.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.180+0000 7fcc6e844800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:50:21.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.190+0000 7fcc6e844800 20 add_watcher() i=0 2024-03-04T12:50:21.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.190+0000 7fcc6e844800 20 add_watcher() i=1 2024-03-04T12:50:21.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.190+0000 7fcc6e844800 20 add_watcher() i=2 2024-03-04T12:50:21.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.190+0000 7fcc6e844800 20 add_watcher() i=3 2024-03-04T12:50:21.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.190+0000 7fcc6e844800 20 add_watcher() i=4 2024-03-04T12:50:21.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.190+0000 7fcc6e844800 20 add_watcher() i=5 2024-03-04T12:50:21.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.190+0000 7fcc6e844800 20 add_watcher() i=6 2024-03-04T12:50:21.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.191+0000 7fcc6e844800 20 add_watcher() i=7 2024-03-04T12:50:21.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.191+0000 7fcc6e844800 2 all 8 watchers are set, enabling cache 2024-03-04T12:50:21.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.193+0000 7fcb22fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:21.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.193+0000 7fcc6e844800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:50:21.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.193+0000 7fcc6e844800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:50:21.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.233+0000 7fcb21fdb640 20 reqs_thread_entry: start 2024-03-04T12:50:21.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.233+0000 7fcc6e844800 20 init_complete bucket index max shards: 11 2024-03-04T12:50:21.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.233+0000 7fcc6e844800 20 Filter name: none 2024-03-04T12:50:21.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.233+0000 7fca937fe640 20 reqs_thread_entry: start 2024-03-04T12:50:21.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.233+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:50:21.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.234+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.235+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.235+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.236+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:50:21.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.237+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.238+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.238+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.239+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:50:21.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.240+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.241+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.241+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.242+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:50:21.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.244+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.244+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.244+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.246+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:50:21.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.247+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.247+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.248+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.249+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:50:21.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.250+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.251+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.251+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.252+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:50:21.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.253+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.253+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.254+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.255+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:50:21.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.256+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.257+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.257+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.259+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:50:21.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.260+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.261+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.261+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.262+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:50:21.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.263+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.263+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.264+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:21.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.264+0000 7fcc6e844800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7304526267117953944', time=2024-03-04T14:50:19.978769+0000, chain.objs.size()=1 2024-03-04T12:50:21.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.264+0000 7fcc6e844800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.60__shadow_.Icg1jVzdXNCcV6-JYhiliwUU091-My8_0 2024-03-04T12:50:21.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.264+0000 7fcc6e844800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4063269997189387197', time=2024-03-04T14:50:20.514095+0000, chain.objs.size()=1 2024-03-04T12:50:21.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.264+0000 7fcc6e844800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.61__shadow_.80EfFLEctDalKZkmJJ8t1Kryvqt8J0N_0 2024-03-04T12:50:21.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.265+0000 7fcc6e844800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:21.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.269+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:50:21.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.271+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.271+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.272+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.272+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:50:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.274+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.274+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.275+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.276+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:50:21.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.277+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.277+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.278+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.278+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:50:21.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.280+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.280+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.281+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.282+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:50:21.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.283+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.284+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.284+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.285+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:50:21.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.286+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.287+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.287+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.288+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:50:21.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.289+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.290+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.290+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.291+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:50:21.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.292+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.293+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.293+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.294+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:50:21.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.296+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.296+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.297+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.298+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:50:21.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.299+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.299+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.300+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.301+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:50:21.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.302+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.303+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.303+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.304+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:50:21.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.305+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.306+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.306+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.307+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:50:21.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.309+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.309+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.310+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.311+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:50:21.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.312+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.312+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.313+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.314+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:50:21.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.315+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.316+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.316+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.317+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:50:21.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.319+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.319+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.319+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.321+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:50:21.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.322+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.323+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.323+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.324+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:50:21.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.325+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.326+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.326+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.327+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:50:21.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.330+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.330+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.331+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.332+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:50:21.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.333+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.333+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.333+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.334+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:50:21.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.336+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.336+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.336+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.337+0000 7fcc6e844800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:50:21.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.339+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.340+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.340+0000 7fcc6e844800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.342+0000 7fcb22fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:21.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.344+0000 7fcc6e844800 20 remove_watcher() i=0 2024-03-04T12:50:21.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.344+0000 7fcc6e844800 2 removed watcher, disabling cache 2024-03-04T12:50:21.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.345+0000 7fcc6e844800 20 remove_watcher() i=1 2024-03-04T12:50:21.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.346+0000 7fcc6e844800 20 remove_watcher() i=2 2024-03-04T12:50:21.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.347+0000 7fcc6e844800 20 remove_watcher() i=3 2024-03-04T12:50:21.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.348+0000 7fcc6e844800 20 remove_watcher() i=4 2024-03-04T12:50:21.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.350+0000 7fcc6e844800 20 remove_watcher() i=5 2024-03-04T12:50:21.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.352+0000 7fcc6e844800 20 remove_watcher() i=6 2024-03-04T12:50:21.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.353+0000 7fcc6e844800 20 remove_watcher() i=7 2024-03-04T12:50:21.370 DEBUG:teuthology.orchestra.run.smithi090:> radosgw-admin gc process --include-all 2024-03-04T12:50:21.420 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:50:21.420 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:50:21.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.447+0000 7fa90a413800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.448+0000 7fa90a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.448+0000 7fa90a413800 20 realm 2024-03-04T12:50:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.448+0000 7fa90a413800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.448+0000 7fa90a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.448+0000 7fa90a413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:50:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.448+0000 7fa90a413800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.448+0000 7fa90a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.448+0000 7fa90a413800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.449+0000 7fa90a413800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.449+0000 7fa90a413800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.450+0000 7fa90a413800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:50:21.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.450+0000 7fa90a413800 20 searching for the correct realm 2024-03-04T12:50:21.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.453+0000 7fa8fffff640 0 -- 172.21.15.90:0/2174687645 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fa8f008a040 msgr2=0x7fa8f000a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:21.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.456+0000 7fa8fffff640 0 -- 172.21.15.90:0/2174687645 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fa7d0079cd0 msgr2=0x7fa7d007c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:21.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:50:21.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:50:21.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:50:21.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:50:21.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:50:21.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:50:21.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:21.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:50:21.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 zone default found 2024-03-04T12:50:21.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 4 Realm: () 2024-03-04T12:50:21.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:50:21.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:50:21.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:50:21.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 zonegroup default 2024-03-04T12:50:21.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.460+0000 7fa90a413800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.461+0000 7fa90a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.461+0000 7fa90a413800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.461+0000 7fa90a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.461+0000 7fa90a413800 20 started sync module instance, tier type = 2024-03-04T12:50:21.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.461+0000 7fa90a413800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:50:21.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.470+0000 7fa90a413800 20 add_watcher() i=0 2024-03-04T12:50:21.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.470+0000 7fa90a413800 20 add_watcher() i=1 2024-03-04T12:50:21.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.470+0000 7fa90a413800 20 add_watcher() i=2 2024-03-04T12:50:21.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.470+0000 7fa90a413800 20 add_watcher() i=3 2024-03-04T12:50:21.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.470+0000 7fa90a413800 20 add_watcher() i=4 2024-03-04T12:50:21.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.470+0000 7fa90a413800 20 add_watcher() i=5 2024-03-04T12:50:21.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.470+0000 7fa90a413800 20 add_watcher() i=6 2024-03-04T12:50:21.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.472+0000 7fa90a413800 20 add_watcher() i=7 2024-03-04T12:50:21.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.472+0000 7fa90a413800 2 all 8 watchers are set, enabling cache 2024-03-04T12:50:21.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.473+0000 7fa7bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:21.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.473+0000 7fa90a413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:50:21.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.473+0000 7fa90a413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:50:21.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.507+0000 7fa7bcfe1640 20 reqs_thread_entry: start 2024-03-04T12:50:21.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.507+0000 7fa90a413800 20 init_complete bucket index max shards: 11 2024-03-04T12:50:21.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.507+0000 7fa90a413800 20 Filter name: none 2024-03-04T12:50:21.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.507+0000 7fa7367fc640 20 reqs_thread_entry: start 2024-03-04T12:50:21.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.507+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:50:21.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.508+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.509+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.509+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.510+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:50:21.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.512+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.512+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.512+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.513+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:50:21.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.515+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.515+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.516+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.517+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:50:21.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.518+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.518+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.518+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.520+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:50:21.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.521+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.521+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.522+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.522+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:50:21.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.524+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.524+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.524+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.525+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:50:21.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.527+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.527+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.528+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.528+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:50:21.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.530+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.530+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.530+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.531+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:50:21.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.533+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.533+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.533+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.534+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:50:21.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.536+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.536+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.536+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.537+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:50:21.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.539+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.539+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.540+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.541+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:50:21.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.542+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.543+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.543+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.544+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:50:21.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.545+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.546+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.546+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.547+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:50:21.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.549+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.549+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.549+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.550+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:50:21.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.551+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.552+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.552+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.553+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:50:21.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.554+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.555+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.555+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.556+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:50:21.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.557+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.558+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.558+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.559+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:50:21.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.561+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.562+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.562+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.563+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:50:21.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.565+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.565+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.565+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.566+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:50:21.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.568+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.568+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.568+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.569+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:50:21.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.570+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.571+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.571+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.572+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:50:21.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.573+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.574+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.574+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.575+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:50:21.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.576+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.576+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.577+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.578+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:50:21.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.579+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.579+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.580+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.581+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:50:21.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.582+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.583+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.583+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.584+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:50:21.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.585+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.586+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.586+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.587+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:50:21.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.588+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.589+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.589+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.590+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:50:21.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.591+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.592+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.592+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.594+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:50:21.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.595+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.595+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.596+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.597+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:50:21.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.598+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.598+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.599+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.599+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:50:21.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.601+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.601+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.601+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.602+0000 7fa90a413800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:50:21.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.603+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.604+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:21.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.604+0000 7fa90a413800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:21.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.605+0000 7fa7bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:21.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.607+0000 7fa90a413800 20 remove_watcher() i=0 2024-03-04T12:50:21.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.607+0000 7fa90a413800 2 removed watcher, disabling cache 2024-03-04T12:50:21.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.608+0000 7fa90a413800 20 remove_watcher() i=1 2024-03-04T12:50:21.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.609+0000 7fa90a413800 20 remove_watcher() i=2 2024-03-04T12:50:21.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.611+0000 7fa90a413800 20 remove_watcher() i=3 2024-03-04T12:50:21.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.612+0000 7fa90a413800 20 remove_watcher() i=4 2024-03-04T12:50:21.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.612+0000 7fa90a413800 20 remove_watcher() i=5 2024-03-04T12:50:21.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.613+0000 7fa90a413800 20 remove_watcher() i=6 2024-03-04T12:50:21.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.614+0000 7fa90a413800 20 remove_watcher() i=7 2024-03-04T12:50:21.630 DEBUG:teuthology.orchestra.run.smithi090:> radosgw-admin gc process --include-all 2024-03-04T12:50:21.679 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:50:21.680 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:50:21.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.706+0000 7fcf83733800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.708+0000 7fcf83733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.708+0000 7fcf83733800 20 realm 2024-03-04T12:50:21.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.708+0000 7fcf83733800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.708+0000 7fcf83733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.708+0000 7fcf83733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:50:21.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.708+0000 7fcf83733800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.708+0000 7fcf83733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:21.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.708+0000 7fcf83733800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.709+0000 7fcf83733800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:21.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.709+0000 7fcf83733800 20 rados->read ofs=0 len=0 2024-03-04T12:50:21.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.709+0000 7fcf83733800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:50:21.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.709+0000 7fcf83733800 20 searching for the correct realm 2024-03-04T12:50:21.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.711+0000 7fcf7ec63640 0 -- 172.21.15.90:0/2994418564 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fcf74053630 msgr2=0x7fcf7407f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:50:21.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:21.918+0000 7fcf7f464640 0 -- 172.21.15.90:0/2994418564 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fcf7405c8a0 msgr2=0x7fcf7405b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:22.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.124+0000 7fcf83733800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:50:22.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.124+0000 7fcf83733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:50:22.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.124+0000 7fcf83733800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:50:22.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.124+0000 7fcf83733800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:50:22.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.124+0000 7fcf83733800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:50:22.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.124+0000 7fcf83733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:50:22.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.124+0000 7fcf83733800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.124+0000 7fcf83733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:22.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.124+0000 7fcf83733800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.125+0000 7fcf83733800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:22.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.125+0000 7fcf83733800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.125+0000 7fcf83733800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.125+0000 7fcf83733800 20 zone default found 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.125+0000 7fcf83733800 4 Realm: () 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.125+0000 7fcf83733800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.125+0000 7fcf83733800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.125+0000 7fcf83733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.125+0000 7fcf83733800 20 zonegroup default 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.125+0000 7fcf83733800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.125+0000 7fcf83733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.125+0000 7fcf83733800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.126+0000 7fcf83733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.126+0000 7fcf83733800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.126+0000 7fcf83733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.126+0000 7fcf83733800 20 started sync module instance, tier type = 2024-03-04T12:50:22.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.126+0000 7fcf83733800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:50:22.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.136+0000 7fcf83733800 20 add_watcher() i=0 2024-03-04T12:50:22.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.136+0000 7fcf83733800 20 add_watcher() i=1 2024-03-04T12:50:22.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.136+0000 7fcf83733800 20 add_watcher() i=2 2024-03-04T12:50:22.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.136+0000 7fcf83733800 20 add_watcher() i=3 2024-03-04T12:50:22.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.136+0000 7fcf83733800 20 add_watcher() i=4 2024-03-04T12:50:22.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.136+0000 7fcf83733800 20 add_watcher() i=5 2024-03-04T12:50:22.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.136+0000 7fcf83733800 20 add_watcher() i=6 2024-03-04T12:50:22.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.137+0000 7fcf83733800 20 add_watcher() i=7 2024-03-04T12:50:22.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.137+0000 7fcf83733800 2 all 8 watchers are set, enabling cache 2024-03-04T12:50:22.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.139+0000 7fce35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:22.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.139+0000 7fcf83733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:50:22.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.139+0000 7fcf83733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:50:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.173+0000 7fce34fe1640 20 reqs_thread_entry: start 2024-03-04T12:50:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.173+0000 7fcf83733800 20 init_complete bucket index max shards: 11 2024-03-04T12:50:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.173+0000 7fcf83733800 20 Filter name: none 2024-03-04T12:50:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.173+0000 7fcdae7fc640 20 reqs_thread_entry: start 2024-03-04T12:50:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.173+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:50:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.175+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.176+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.176+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.177+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:50:22.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.179+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.179+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.179+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.181+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:50:22.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.183+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.183+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.183+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.184+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:50:22.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.186+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.186+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.186+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.187+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:50:22.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.188+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.189+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.189+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.190+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:50:22.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.192+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.192+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.192+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.193+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:50:22.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.195+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.195+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.195+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.196+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:50:22.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.198+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.198+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.198+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.199+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:50:22.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.201+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.201+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.201+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.203+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:50:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.204+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.204+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.205+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.206+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:50:22.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.207+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.207+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.207+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.209+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:50:22.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.210+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.210+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.211+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.212+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:50:22.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.213+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.214+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.214+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.215+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:50:22.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.216+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.217+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.217+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.218+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:50:22.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.220+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.220+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.221+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.222+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:50:22.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.223+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.224+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.224+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.225+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:50:22.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.226+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.227+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.227+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.228+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:50:22.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.229+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.229+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.230+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.231+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:50:22.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.232+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.232+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.233+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.233+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:50:22.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.235+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.235+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.235+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.236+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:50:22.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.238+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.238+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.239+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.239+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:50:22.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.241+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.241+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.242+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.243+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:50:22.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.244+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.244+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.244+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.245+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:50:22.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.247+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.247+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.247+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.248+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:50:22.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.250+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.250+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.250+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.251+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:50:22.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.252+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.253+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.253+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.254+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:50:22.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.256+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.256+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.257+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.258+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:50:22.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.259+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.259+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.259+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.260+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:50:22.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.262+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.262+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.262+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.264+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:50:22.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.266+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.266+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.266+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.267+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:50:22.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.268+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.269+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.269+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.270+0000 7fcf83733800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:50:22.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.271+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.272+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.272+0000 7fcf83733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.274+0000 7fce35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:22.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.276+0000 7fcf83733800 20 remove_watcher() i=0 2024-03-04T12:50:22.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.276+0000 7fcf83733800 2 removed watcher, disabling cache 2024-03-04T12:50:22.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.277+0000 7fcf83733800 20 remove_watcher() i=1 2024-03-04T12:50:22.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.278+0000 7fcf83733800 20 remove_watcher() i=2 2024-03-04T12:50:22.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.280+0000 7fcf83733800 20 remove_watcher() i=3 2024-03-04T12:50:22.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.281+0000 7fcf83733800 20 remove_watcher() i=4 2024-03-04T12:50:22.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.281+0000 7fcf83733800 20 remove_watcher() i=5 2024-03-04T12:50:22.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.282+0000 7fcf83733800 20 remove_watcher() i=6 2024-03-04T12:50:22.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.283+0000 7fcf83733800 20 remove_watcher() i=7 2024-03-04T12:50:22.300 DEBUG:teuthology.orchestra.run.smithi090:> radosgw-admin gc process --include-all 2024-03-04T12:50:22.350 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:50:22.350 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:50:22.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.378+0000 7f17c2729800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.378+0000 7f17c2729800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:22.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.378+0000 7f17c2729800 20 realm 2024-03-04T12:50:22.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.378+0000 7f17c2729800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.378+0000 7f17c2729800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:22.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.378+0000 7f17c2729800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:50:22.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.378+0000 7f17c2729800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.379+0000 7f17c2729800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:22.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.379+0000 7f17c2729800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.379+0000 7f17c2729800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:22.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.379+0000 7f17c2729800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.380+0000 7f17c2729800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:50:22.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.380+0000 7f17c2729800 20 searching for the correct realm 2024-03-04T12:50:22.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.382+0000 7f17b7fff640 0 -- 172.21.15.90:0/2441698809 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f17a8061070 msgr2=0x7f17a8076170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:22.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.386+0000 7f17be350640 0 -- 172.21.15.90:0/2441698809 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f17a8010bc0 msgr2=0x7f17a8053150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:22.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.592+0000 7f17c2729800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:50:22.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.592+0000 7f17c2729800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:50:22.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.592+0000 7f17c2729800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:50:22.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.592+0000 7f17c2729800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:50:22.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.592+0000 7f17c2729800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:50:22.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.592+0000 7f17c2729800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:50:22.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.592+0000 7f17c2729800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.592+0000 7f17c2729800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:22.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.592+0000 7f17c2729800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.592+0000 7f17c2729800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:22.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.592+0000 7f17c2729800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:50:22.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 20 zone default found 2024-03-04T12:50:22.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 4 Realm: () 2024-03-04T12:50:22.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:50:22.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:50:22.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:50:22.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 20 zonegroup default 2024-03-04T12:50:22.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:22.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:22.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 20 rados->read ofs=0 len=0 2024-03-04T12:50:22.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:22.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.593+0000 7f17c2729800 20 started sync module instance, tier type = 2024-03-04T12:50:22.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.594+0000 7f17c2729800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:50:22.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.602+0000 7f17c2729800 20 add_watcher() i=0 2024-03-04T12:50:22.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.602+0000 7f17c2729800 20 add_watcher() i=1 2024-03-04T12:50:22.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.602+0000 7f17c2729800 20 add_watcher() i=2 2024-03-04T12:50:22.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.602+0000 7f17c2729800 20 add_watcher() i=3 2024-03-04T12:50:22.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.602+0000 7f17c2729800 20 add_watcher() i=4 2024-03-04T12:50:22.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.602+0000 7f17c2729800 20 add_watcher() i=5 2024-03-04T12:50:22.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.602+0000 7f17c2729800 20 add_watcher() i=6 2024-03-04T12:50:22.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.603+0000 7f17c2729800 20 add_watcher() i=7 2024-03-04T12:50:22.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.603+0000 7f17c2729800 2 all 8 watchers are set, enabling cache 2024-03-04T12:50:22.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.605+0000 7f1674fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:22.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.605+0000 7f17c2729800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:50:22.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.605+0000 7f17c2729800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:50:22.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.639+0000 7f15ef7fe640 20 reqs_thread_entry: start 2024-03-04T12:50:22.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.639+0000 7f17c2729800 20 init_complete bucket index max shards: 11 2024-03-04T12:50:22.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.639+0000 7f17c2729800 20 Filter name: none 2024-03-04T12:50:22.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.639+0000 7f15ed7fa640 20 reqs_thread_entry: start 2024-03-04T12:50:22.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.639+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:50:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.641+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.641+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.641+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.642+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:50:22.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.644+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.644+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.644+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.645+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:50:22.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.647+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.648+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.648+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.649+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:50:22.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.650+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.651+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.651+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.652+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:50:22.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.653+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.653+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.654+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.655+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:50:22.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.656+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.657+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.657+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.658+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:50:22.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.659+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.660+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.660+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.661+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:50:22.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.662+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.663+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.663+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.664+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:50:22.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.665+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.665+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.666+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.666+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:50:22.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.668+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.668+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.668+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.669+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:50:22.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.671+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.672+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.672+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.673+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:50:22.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.674+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.675+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.675+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.676+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:50:22.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.678+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.678+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.679+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.680+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:50:22.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.681+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.682+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.682+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.683+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:50:22.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.684+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.684+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.684+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.685+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:50:22.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.687+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.687+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.688+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.689+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:50:22.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.690+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.691+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.691+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.692+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:50:22.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.693+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.693+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.694+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.694+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:50:22.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.696+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.696+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.697+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.698+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:50:22.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.699+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.700+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.700+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.701+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:50:22.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.702+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.703+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.703+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.704+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:50:22.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.706+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.706+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.707+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.708+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:50:22.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.709+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.710+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.710+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.711+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:50:22.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.712+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.713+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.713+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.714+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:50:22.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.715+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.716+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.716+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.717+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:50:22.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.718+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.719+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.719+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.720+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:50:22.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.721+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.722+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.722+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.724+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:50:22.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.725+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.726+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.726+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.727+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:50:22.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.728+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.729+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.729+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.730+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:50:22.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.731+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.732+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.732+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.733+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:50:22.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.734+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.735+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.735+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.736+0000 7f17c2729800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:50:22.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.737+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.738+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:22.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.738+0000 7f17c2729800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:22.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.740+0000 7f1674fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:22.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.742+0000 7f17c2729800 20 remove_watcher() i=0 2024-03-04T12:50:22.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.742+0000 7f17c2729800 2 removed watcher, disabling cache 2024-03-04T12:50:22.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.743+0000 7f17c2729800 20 remove_watcher() i=1 2024-03-04T12:50:22.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.744+0000 7f17c2729800 20 remove_watcher() i=2 2024-03-04T12:50:22.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.745+0000 7f17c2729800 20 remove_watcher() i=3 2024-03-04T12:50:22.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.746+0000 7f17c2729800 20 remove_watcher() i=4 2024-03-04T12:50:22.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.747+0000 7f17c2729800 20 remove_watcher() i=5 2024-03-04T12:50:22.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.748+0000 7f17c2729800 20 remove_watcher() i=6 2024-03-04T12:50:22.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:22.749+0000 7f17c2729800 20 remove_watcher() i=7 2024-03-04T12:50:22.766 DEBUG:teuthology.orchestra.run.smithi090:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-03-04T12:50:23.362 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :clean 2024-03-04T12:50:24.060 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :compileJava 2024-03-04T12:50:24.060 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :processResources 2024-03-04T12:50:24.060 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :classes 2024-03-04T12:50:24.560 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:24.560 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :compileTestJava 2024-03-04T12:50:24.561 INFO:teuthology.orchestra.run.smithi090.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-04T12:50:24.561 INFO:teuthology.orchestra.run.smithi090.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-04T12:50:24.562 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:24.562 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :processTestResources NO-SOURCE 2024-03-04T12:50:24.562 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :testClasses 2024-03-04T12:50:26.561 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:26.561 INFO:teuthology.orchestra.run.smithi090.stdout:> Task :test 2024-03-04T12:50:26.562 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:26.562 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests STANDARD_OUT 2024-03-04T12:50:26.562 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04 12:50:25,828 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-04T12:50:26.562 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:26.562 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-03-04T12:50:26.562 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:26.562 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-03-04T12:50:26.562 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:26.562 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-03-04T12:50:26.562 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:26.562 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-03-04T12:50:26.760 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:26.760 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-03-04T12:50:26.760 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:26.760 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-03-04T12:50:26.959 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:26.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-03-04T12:50:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:27.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-03-04T12:50:27.860 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:27.860 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-03-04T12:50:27.860 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:27.860 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-03-04T12:50:28.060 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:28.060 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-03-04T12:50:28.359 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:28.360 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-03-04T12:50:28.560 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:28.560 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-03-04T12:50:28.560 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:28.560 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-03-04T12:50:28.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:28.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-03-04T12:50:28.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:28.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-03-04T12:50:28.859 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:28.860 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-03-04T12:50:29.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:29.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-03-04T12:50:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:29.360 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-03-04T12:50:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:29.360 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-03-04T12:50:29.559 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:29.560 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-03-04T12:50:29.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:29.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-03-04T12:50:29.859 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:29.860 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-03-04T12:50:29.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:29.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-03-04T12:50:30.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:30.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-03-04T12:50:30.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:30.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-03-04T12:50:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:30.359 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-03-04T12:50:30.460 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:30.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-03-04T12:50:30.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:30.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-03-04T12:50:30.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:30.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-03-04T12:50:30.859 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:30.859 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-03-04T12:50:30.959 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:30.959 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-03-04T12:50:31.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:31.159 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-03-04T12:50:31.659 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:31.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-03-04T12:50:31.959 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:31.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-03-04T12:50:36.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:36.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-03-04T12:50:36.959 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:36.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-03-04T12:50:36.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:36.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-03-04T12:50:37.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:37.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-03-04T12:50:37.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:37.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-03-04T12:50:37.559 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:37.560 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-03-04T12:50:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:37.860 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-03-04T12:50:38.059 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:38.060 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-03-04T12:50:38.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:38.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-03-04T12:50:38.259 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:38.259 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-03-04T12:50:38.959 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:38.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-03-04T12:50:39.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:39.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-03-04T12:50:39.460 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:39.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-03-04T12:50:39.759 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:39.759 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-03-04T12:50:40.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:40.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-03-04T12:50:40.359 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:40.359 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-03-04T12:50:42.959 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:42.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-03-04T12:50:43.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:43.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-03-04T12:50:44.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:44.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-03-04T12:50:44.859 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:44.860 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-03-04T12:50:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:45.260 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-03-04T12:50:45.459 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:45.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-03-04T12:50:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:45.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-03-04T12:50:46.259 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:46.259 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-03-04T12:50:46.359 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:46.360 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-03-04T12:50:46.460 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:46.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-03-04T12:50:46.460 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:46.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-03-04T12:50:46.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:46.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-03-04T12:50:46.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:46.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-03-04T12:50:46.860 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:46.860 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-03-04T12:50:46.959 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:46.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-03-04T12:50:47.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:47.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-03-04T12:50:47.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:47.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-03-04T12:50:47.359 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:47.360 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-03-04T12:50:47.460 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:47.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-03-04T12:50:47.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:47.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-03-04T12:50:47.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:47.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-03-04T12:50:47.859 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:47.860 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-03-04T12:50:47.959 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:47.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-03-04T12:50:48.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:48.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-03-04T12:50:48.260 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:48.260 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-03-04T12:50:48.459 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:48.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-03-04T12:50:48.560 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:48.560 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-03-04T12:50:48.759 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:48.760 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-03-04T12:50:48.859 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:48.859 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-03-04T12:50:49.060 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:49.060 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-03-04T12:50:49.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:49.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-03-04T12:50:49.360 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:49.360 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-03-04T12:50:49.459 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:49.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-03-04T12:50:49.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:49.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-03-04T12:50:49.660 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:49.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-03-04T12:50:49.959 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:49.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-03-04T12:50:49.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:49.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-03-04T12:50:50.260 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:50.260 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-03-04T12:50:50.260 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:50.260 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-03-04T12:50:50.459 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:50.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-03-04T12:50:50.559 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:50.559 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-03-04T12:50:50.759 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:50.759 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-03-04T12:50:50.860 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:50.860 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-03-04T12:50:51.059 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:51.060 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-03-04T12:50:51.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:51.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-03-04T12:50:51.359 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:51.360 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-03-04T12:50:51.459 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:51.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-03-04T12:50:51.659 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:51.659 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-03-04T12:50:51.759 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:51.760 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-03-04T12:50:51.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:51.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-03-04T12:50:51.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:51.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-03-04T12:50:52.259 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:52.260 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-03-04T12:50:52.260 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:52.260 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-03-04T12:50:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:52.560 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-03-04T12:50:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:52.560 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-03-04T12:50:52.759 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:52.760 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-03-04T12:50:52.859 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:52.860 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-03-04T12:50:53.060 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:53.060 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-03-04T12:50:53.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:53.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-03-04T12:50:53.360 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:53.360 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-03-04T12:50:53.459 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:53.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-03-04T12:50:53.659 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:53.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-03-04T12:50:53.759 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:53.760 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-03-04T12:50:53.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:53.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-03-04T12:50:53.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:53.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-03-04T12:50:54.259 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:54.260 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-03-04T12:50:54.260 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:54.260 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-03-04T12:50:54.460 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:54.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-03-04T12:50:54.560 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:54.560 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-03-04T12:50:54.760 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:54.760 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-03-04T12:50:54.760 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:54.761 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-03-04T12:50:54.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:54.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-03-04T12:50:54.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:54.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-03-04T12:50:55.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:55.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-03-04T12:50:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:55.360 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-03-04T12:50:55.559 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:55.559 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-03-04T12:50:55.560 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:55.560 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-03-04T12:50:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:55.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-03-04T12:50:55.759 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:55.759 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-03-04T12:50:55.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:55.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-03-04T12:50:55.960 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:55.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-03-04T12:50:56.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:56.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-03-04T12:50:56.260 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:56.260 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-03-04T12:50:56.460 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:56.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-03-04T12:50:56.460 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:56.460 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-03-04T12:50:56.659 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:56.660 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-03-04T12:50:56.959 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:56.960 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-03-04T12:50:57.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:57.160 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-03-04T12:50:57.559 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:57.560 INFO:teuthology.orchestra.run.smithi090.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-03-04T12:50:57.747 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:57.747 INFO:teuthology.orchestra.run.smithi090.stdout:---------------------------------------------------------------------- 2024-03-04T12:50:57.747 INFO:teuthology.orchestra.run.smithi090.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-03-04T12:50:57.748 INFO:teuthology.orchestra.run.smithi090.stdout:---------------------------------------------------------------------- 2024-03-04T12:50:57.748 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:57.748 INFO:teuthology.orchestra.run.smithi090.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-04T12:50:57.748 INFO:teuthology.orchestra.run.smithi090.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-04T12:50:57.748 INFO:teuthology.orchestra.run.smithi090.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-04T12:50:57.748 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:57.748 INFO:teuthology.orchestra.run.smithi090.stdout:BUILD SUCCESSFUL in 34s 2024-03-04T12:50:57.748 INFO:teuthology.orchestra.run.smithi090.stdout:5 actionable tasks: 5 executed 2024-03-04T12:50:57.762 DEBUG:teuthology.orchestra.run.smithi090:> radosgw-admin gc process --include-all 2024-03-04T12:50:57.812 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:50:57.812 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:50:57.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.837+0000 7faa1314b800 20 rados->read ofs=0 len=0 2024-03-04T12:50:57.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.838+0000 7faa1314b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:57.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.838+0000 7faa1314b800 20 realm 2024-03-04T12:50:57.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.838+0000 7faa1314b800 20 rados->read ofs=0 len=0 2024-03-04T12:50:57.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.839+0000 7faa1314b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:57.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.839+0000 7faa1314b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:50:57.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.839+0000 7faa1314b800 20 rados->read ofs=0 len=0 2024-03-04T12:50:57.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.839+0000 7faa1314b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:57.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.839+0000 7faa1314b800 20 rados->read ofs=0 len=0 2024-03-04T12:50:57.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.840+0000 7faa1314b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:57.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.840+0000 7faa1314b800 20 rados->read ofs=0 len=0 2024-03-04T12:50:57.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.840+0000 7faa1314b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:50:57.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.840+0000 7faa1314b800 20 searching for the correct realm 2024-03-04T12:50:57.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.842+0000 7faa0844d640 0 -- 172.21.15.90:0/3090525237 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fa9f801e040 msgr2=0x7fa9f8020450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:57.846+0000 7faa10c4e640 0 -- 172.21.15.90:0/3090525237 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fa9f8020960 msgr2=0x7fa9f801e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:58.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.051+0000 7faa1314b800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:50:58.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.051+0000 7faa1314b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:50:58.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.051+0000 7faa1314b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:50:58.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.051+0000 7faa1314b800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:50:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.051+0000 7faa1314b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:50:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.051+0000 7faa1314b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:50:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.051+0000 7faa1314b800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.052+0000 7faa1314b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.052+0000 7faa1314b800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.052+0000 7faa1314b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.052+0000 7faa1314b800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.052+0000 7faa1314b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:50:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.052+0000 7faa1314b800 20 zone default found 2024-03-04T12:50:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.052+0000 7faa1314b800 4 Realm: () 2024-03-04T12:50:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.052+0000 7faa1314b800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:50:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.052+0000 7faa1314b800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:50:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.052+0000 7faa1314b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:50:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.052+0000 7faa1314b800 20 zonegroup default 2024-03-04T12:50:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.052+0000 7faa1314b800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.053+0000 7faa1314b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.053+0000 7faa1314b800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.053+0000 7faa1314b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.053+0000 7faa1314b800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.053+0000 7faa1314b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.053+0000 7faa1314b800 20 started sync module instance, tier type = 2024-03-04T12:50:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.053+0000 7faa1314b800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:50:58.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.063+0000 7faa1314b800 20 add_watcher() i=0 2024-03-04T12:50:58.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.063+0000 7faa1314b800 20 add_watcher() i=1 2024-03-04T12:50:58.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.063+0000 7faa1314b800 20 add_watcher() i=2 2024-03-04T12:50:58.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.063+0000 7faa1314b800 20 add_watcher() i=3 2024-03-04T12:50:58.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.063+0000 7faa1314b800 20 add_watcher() i=4 2024-03-04T12:50:58.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.063+0000 7faa1314b800 20 add_watcher() i=5 2024-03-04T12:50:58.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.063+0000 7faa1314b800 20 add_watcher() i=6 2024-03-04T12:50:58.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.063+0000 7faa1314b800 20 add_watcher() i=7 2024-03-04T12:50:58.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.063+0000 7faa1314b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:50:58.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.065+0000 7fa8c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:58.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.065+0000 7faa1314b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:50:58.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.065+0000 7faa1314b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:50:58.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.102+0000 7fa8c5fe3640 20 reqs_thread_entry: start 2024-03-04T12:50:58.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.102+0000 7faa1314b800 20 init_complete bucket index max shards: 11 2024-03-04T12:50:58.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.102+0000 7faa1314b800 20 Filter name: none 2024-03-04T12:50:58.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.102+0000 7fa8377fe640 20 reqs_thread_entry: start 2024-03-04T12:50:58.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.102+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:50:58.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.103+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:50:58.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2729987185391167447', time=2024-03-04T14:50:26.602377+0000, chain.objs.size()=1 2024-03-04T12:50:58.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.66__shadow_.2nCZqj00WrpZZ4lW_TDnggG2c3O--z2_0 2024-03-04T12:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17100699723288854755', time=2024-03-04T14:50:41.570201+0000, chain.objs.size()=9 2024-03-04T12:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~-RbPXSXt5v_mK2p0AQLF-26ocOIo7eD.1 2024-03-04T12:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~-RbPXSXt5v_mK2p0AQLF-26ocOIo7eD.1_1 2024-03-04T12:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~-RbPXSXt5v_mK2p0AQLF-26ocOIo7eD.2 2024-03-04T12:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~-RbPXSXt5v_mK2p0AQLF-26ocOIo7eD.2_1 2024-03-04T12:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~-RbPXSXt5v_mK2p0AQLF-26ocOIo7eD.3 2024-03-04T12:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~-RbPXSXt5v_mK2p0AQLF-26ocOIo7eD.3_1 2024-03-04T12:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~-RbPXSXt5v_mK2p0AQLF-26ocOIo7eD.4 2024-03-04T12:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~-RbPXSXt5v_mK2p0AQLF-26ocOIo7eD.4_1 2024-03-04T12:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~-RbPXSXt5v_mK2p0AQLF-26ocOIo7eD.5 2024-03-04T12:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14429740824870416173', time=2024-03-04T14:50:54.032867+0000, chain.objs.size()=1 2024-03-04T12:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.104+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.122__shadow_.2KhFsRdgLj5b98dRQTqheGAHCecgZuT_0 2024-03-04T12:50:58.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.108+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.110+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.111+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-04T12:50:58.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__shadow_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.1_1_5532baea2bfe24f0e6f386860d50c662', time=2024-03-04T14:50:31.784118+0000, chain.objs.size()=9 2024-03-04T12:50:58.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__multipart_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.1 2024-03-04T12:50:58.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__shadow_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.1_1 2024-03-04T12:50:58.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__multipart_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.2 2024-03-04T12:50:58.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__shadow_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.2_1 2024-03-04T12:50:58.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__multipart_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.3 2024-03-04T12:50:58.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__shadow_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.3_1 2024-03-04T12:50:58.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__multipart_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.4 2024-03-04T12:50:58.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__shadow_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.4_1 2024-03-04T12:50:58.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__multipart_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.5 2024-03-04T12:50:58.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9504306154185680507', time=2024-03-04T14:50:34.654832+0000, chain.objs.size()=9 2024-03-04T12:50:58.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~29r26ZSO7WTqBE2yWfAAONxNs9MX2x5.1 2024-03-04T12:50:58.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~29r26ZSO7WTqBE2yWfAAONxNs9MX2x5.1_1 2024-03-04T12:50:58.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.112+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~29r26ZSO7WTqBE2yWfAAONxNs9MX2x5.2 2024-03-04T12:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.114+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~29r26ZSO7WTqBE2yWfAAONxNs9MX2x5.2_1 2024-03-04T12:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.114+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~29r26ZSO7WTqBE2yWfAAONxNs9MX2x5.3 2024-03-04T12:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.114+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~29r26ZSO7WTqBE2yWfAAONxNs9MX2x5.3_1 2024-03-04T12:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.114+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~29r26ZSO7WTqBE2yWfAAONxNs9MX2x5.4 2024-03-04T12:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.114+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~29r26ZSO7WTqBE2yWfAAONxNs9MX2x5.4_1 2024-03-04T12:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.115+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~29r26ZSO7WTqBE2yWfAAONxNs9MX2x5.5 2024-03-04T12:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.115+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12321509732529855396', time=2024-03-04T14:50:39.522875+0000, chain.objs.size()=9 2024-03-04T12:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.115+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__multipart_file.mpg.2~2XvaMaLQZX2EttB3t5fHu6xqHnb5XMP.1 2024-03-04T12:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.115+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__shadow_file.mpg.2~2XvaMaLQZX2EttB3t5fHu6xqHnb5XMP.1_1 2024-03-04T12:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.115+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__multipart_file.mpg.2~2XvaMaLQZX2EttB3t5fHu6xqHnb5XMP.2 2024-03-04T12:50:58.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.117+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__shadow_file.mpg.2~2XvaMaLQZX2EttB3t5fHu6xqHnb5XMP.2_1 2024-03-04T12:50:58.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.117+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__multipart_file.mpg.2~2XvaMaLQZX2EttB3t5fHu6xqHnb5XMP.3 2024-03-04T12:50:58.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.118+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__shadow_file.mpg.2~2XvaMaLQZX2EttB3t5fHu6xqHnb5XMP.3_1 2024-03-04T12:50:58.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.118+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__multipart_file.mpg.2~2XvaMaLQZX2EttB3t5fHu6xqHnb5XMP.4 2024-03-04T12:50:58.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.118+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__shadow_file.mpg.2~2XvaMaLQZX2EttB3t5fHu6xqHnb5XMP.4_1 2024-03-04T12:50:58.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.118+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__multipart_file.mpg.2~2XvaMaLQZX2EttB3t5fHu6xqHnb5XMP.5 2024-03-04T12:50:58.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.118+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13629001093950988530', time=2024-03-04T14:50:43.009303+0000, chain.objs.size()=7 2024-03-04T12:50:58.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.118+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~shO_CXfYMfHFAXXotL6Xof1PibGD9tw.1 2024-03-04T12:50:58.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.118+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~shO_CXfYMfHFAXXotL6Xof1PibGD9tw.1_1 2024-03-04T12:50:58.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.118+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~shO_CXfYMfHFAXXotL6Xof1PibGD9tw.1_2 2024-03-04T12:50:58.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.119+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~shO_CXfYMfHFAXXotL6Xof1PibGD9tw.2 2024-03-04T12:50:58.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.119+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~shO_CXfYMfHFAXXotL6Xof1PibGD9tw.2_1 2024-03-04T12:50:58.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.119+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~shO_CXfYMfHFAXXotL6Xof1PibGD9tw.2_2 2024-03-04T12:50:58.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.119+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~shO_CXfYMfHFAXXotL6Xof1PibGD9tw.3 2024-03-04T12:50:58.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.120+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17312550153360175703', time=2024-03-04T14:50:48.291247+0000, chain.objs.size()=1 2024-03-04T12:50:58.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.120+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.102__shadow_.aHQhOOuVek7EmhVCSyPeV4HkY8z3rua_0 2024-03-04T12:50:58.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.122+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3181230462552867604', time=2024-03-04T14:50:48.575699+0000, chain.objs.size()=1 2024-03-04T12:50:58.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.122+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.103__shadow_.PmhoyM35ywArf5yP54ZEwmOSrrPSSj__0 2024-03-04T12:50:58.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.122+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3242128052032513420', time=2024-03-04T14:50:50.324027+0000, chain.objs.size()=1 2024-03-04T12:50:58.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.122+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.109__shadow_.l-DzTxL9hWu2CPzkIVVXhCywZ8a0Asg_0 2024-03-04T12:50:58.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.123+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.126+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:50:58.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.127+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T12:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14765250054121763872', time=2024-03-04T14:50:36.510931+0000, chain.objs.size()=7 2024-03-04T12:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~h_qtY2ASWLlPfiDcG_-BiOMpaOjMlsb.1 2024-03-04T12:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~h_qtY2ASWLlPfiDcG_-BiOMpaOjMlsb.1_1 2024-03-04T12:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~h_qtY2ASWLlPfiDcG_-BiOMpaOjMlsb.1_2 2024-03-04T12:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~h_qtY2ASWLlPfiDcG_-BiOMpaOjMlsb.2 2024-03-04T12:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~h_qtY2ASWLlPfiDcG_-BiOMpaOjMlsb.2_1 2024-03-04T12:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~h_qtY2ASWLlPfiDcG_-BiOMpaOjMlsb.2_2 2024-03-04T12:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~h_qtY2ASWLlPfiDcG_-BiOMpaOjMlsb.3 2024-03-04T12:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13551908771906687107', time=2024-03-04T14:50:48.580745+0000, chain.objs.size()=1 2024-03-04T12:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.103__shadow_.4ZaIhSWDHaapYfA71aW-HncT4ymjHiM_0 2024-03-04T12:50:58.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7322379353220028312', time=2024-03-04T14:50:49.461120+0000, chain.objs.size()=1 2024-03-04T12:50:58.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.106__shadow_.MFNXv5-sYBtYjXbs9BkLHjyv6y9wQDD_0 2024-03-04T12:50:58.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11308940196133474224', time=2024-03-04T14:50:50.900723+0000, chain.objs.size()=1 2024-03-04T12:50:58.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.128+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.111__shadow_.5Yvcydnyfh3xBUGtCp07uYbNxNihhht_0 2024-03-04T12:50:58.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.132+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.135+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:50:58.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.136+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T12:50:58.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4291621880872581189', time=2024-03-04T14:50:29.421717+0000, chain.objs.size()=1 2024-03-04T12:50:58.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.73__shadow_.zfnInc_2AikH7tpUZGewlkTGStP7cit_0 2024-03-04T12:50:58.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6480519378114072508', time=2024-03-04T14:50:49.155623+0000, chain.objs.size()=1 2024-03-04T12:50:58.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.105__shadow_.7-v5LKngvOgyXmaB8Y58HiNztx5YMJi_0 2024-03-04T12:50:58.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17524808823267645563', time=2024-03-04T14:50:49.742265+0000, chain.objs.size()=1 2024-03-04T12:50:58.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.107__shadow_.S4JsxBqnAD5-0hkD7itQVwfMz64Tegj_0 2024-03-04T12:50:58.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1689301297447110175', time=2024-03-04T14:50:52.041909+0000, chain.objs.size()=1 2024-03-04T12:50:58.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.115__shadow_.YSYPeNx9rUG8PzHsuns9aHH3bnRKJ51_0 2024-03-04T12:50:58.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.721744609656126568', time=2024-03-04T14:50:52.341593+0000, chain.objs.size()=1 2024-03-04T12:50:58.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.116__shadow_.9h1SlnLepe_Un3X1yeJaBGw66gqwmrH_0 2024-03-04T12:50:58.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12763662936628531275', time=2024-03-04T14:50:56.004067+0000, chain.objs.size()=1 2024-03-04T12:50:58.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.137+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.129__shadow_.LzWblJb9m4EOo6-8iF_ZOY262ws_wiG_0 2024-03-04T12:50:58.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.139+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.141+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:50:58.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.142+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.142+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.143+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:50:58.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.143+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8456704236737298872', time=2024-03-04T14:50:50.041987+0000, chain.objs.size()=1 2024-03-04T12:50:58.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.143+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.108__shadow_.DqymffqSI5EOmThxdwLno8cWwXRk07q_0 2024-03-04T12:50:58.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.143+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7707217844710059335', time=2024-03-04T14:50:50.613342+0000, chain.objs.size()=1 2024-03-04T12:50:58.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.143+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.110__shadow_.UZ5ZvKkbaaTQGeueEHsvTgw0oIlfrZb_0 2024-03-04T12:50:58.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.143+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.119739149140469072', time=2024-03-04T14:50:52.914660+0000, chain.objs.size()=1 2024-03-04T12:50:58.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.143+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.118__shadow_.t9stJ9FhY1UwIDsUfvIACrMRNRW9HDo_0 2024-03-04T12:50:58.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.145+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.147+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:50:58.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.148+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.149+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.149+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-04T12:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.149+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4023178848104989771', time=2024-03-04T14:50:47.995773+0000, chain.objs.size()=1 2024-03-04T12:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.149+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.101__shadow_.g8GdfCPSyPg9gjOGMme6NH3lJBHLjrr_0 2024-03-04T12:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.149+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.818442412532258443', time=2024-03-04T14:50:49.165992+0000, chain.objs.size()=1 2024-03-04T12:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.149+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.105__shadow_.9EJf07adLhF1N45jeRre1W3lz7rJ4Mk_0 2024-03-04T12:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.149+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2489361707400689456', time=2024-03-04T14:50:50.618158+0000, chain.objs.size()=1 2024-03-04T12:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.149+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.110__shadow_.vfjA1TCWJ72Z2MMXKwNzvom8Q9yHcy__0 2024-03-04T12:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.149+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11917083487824250242', time=2024-03-04T14:50:53.193306+0000, chain.objs.size()=1 2024-03-04T12:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.149+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.119__shadow_.eBWFpoA2QAusl53FDygcBpd2YMROPZt_0 2024-03-04T12:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.149+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4103869088113464966', time=2024-03-04T14:50:54.038548+0000, chain.objs.size()=1 2024-03-04T12:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.149+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.122__shadow_.VCL2FQ4KTL__C_Y9vvpFVmmzKWGqGxu_0 2024-03-04T12:50:58.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.151+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.153+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:50:58.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.154+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.154+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.155+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T12:50:58.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.155+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15985149577233124803', time=2024-03-04T14:50:28.399725+0000, chain.objs.size()=1 2024-03-04T12:50:58.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.155+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.70__shadow_.lrkdrC7Pf1QMKzHXpNg5RKBcHKOW-LV_0 2024-03-04T12:50:58.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.155+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4271457530227827499', time=2024-03-04T14:50:50.036452+0000, chain.objs.size()=1 2024-03-04T12:50:58.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.155+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.108__shadow_.xs2van1xryauPAz6uSPAmRbmDGTavcZ_0 2024-03-04T12:50:58.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.155+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15272301112759131607', time=2024-03-04T14:50:51.191715+0000, chain.objs.size()=1 2024-03-04T12:50:58.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.155+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.112__shadow_.frv2qHb5ifTds4anZqapkBED9nxVJ-s_0 2024-03-04T12:50:58.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.155+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10448924522046593204', time=2024-03-04T14:50:53.471204+0000, chain.objs.size()=1 2024-03-04T12:50:58.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.155+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.120__shadow_.yREQKCYBTs1Prvqx9sJnzKhFgZpJuY__0 2024-03-04T12:50:58.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.156+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.158+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:50:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.160+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.160+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.161+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:58.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.161+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7888495758245459139', time=2024-03-04T14:50:49.160478+0000, chain.objs.size()=1 2024-03-04T12:50:58.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.161+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.105__shadow_.keTSCI3kohZNjH5gp4wYxBHqEuAkQE2_0 2024-03-04T12:50:58.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.161+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9853095455371671945', time=2024-03-04T14:50:50.608801+0000, chain.objs.size()=1 2024-03-04T12:50:58.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.161+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.110__shadow_.EnZwepSrT9K4zqKgsMuoVh6aBJnU3sN_0 2024-03-04T12:50:58.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.162+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.164+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:50:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.165+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.166+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.166+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-04T12:50:58.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.166+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8169815272450042935', time=2024-03-04T14:50:47.980219+0000, chain.objs.size()=1 2024-03-04T12:50:58.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.166+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.101__shadow_.llfCvLji9ygE3GcQ-40TLNCg8zVAS2P_0 2024-03-04T12:50:58.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.166+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11696235144671828705', time=2024-03-04T14:50:51.463458+0000, chain.objs.size()=1 2024-03-04T12:50:58.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.166+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.113__shadow_.9bLro6h0QgaezNzTJitj0Wx3IES-Q2i_0 2024-03-04T12:50:58.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.166+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16788165665075368252', time=2024-03-04T14:50:52.331722+0000, chain.objs.size()=1 2024-03-04T12:50:58.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.166+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.116__shadow_.8F6LVfJDxKqx_zn6cEML3Foex5rs4a__0 2024-03-04T12:50:58.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.166+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3614333335231885617', time=2024-03-04T14:50:52.621557+0000, chain.objs.size()=1 2024-03-04T12:50:58.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.166+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.117__shadow_.KA2kX7n6QZCD_XBX49eb99eQlpW1A7f_0 2024-03-04T12:50:58.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.166+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17055700444738819697', time=2024-03-04T14:50:52.919621+0000, chain.objs.size()=1 2024-03-04T12:50:58.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.166+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.118__shadow_.9Ic01k6MJZ6yFRATKP1E1jr1sxJ_oCx_0 2024-03-04T12:50:58.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.167+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.170+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:50:58.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.171+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.172+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.172+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:50:58.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.172+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5276086930661322699', time=2024-03-04T14:50:48.878908+0000, chain.objs.size()=1 2024-03-04T12:50:58.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.172+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.104__shadow_.fptzKYaSXY1KoR1T4N4z7Qc0Fdvb1G4_0 2024-03-04T12:50:58.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.172+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10919128132249017653', time=2024-03-04T14:50:53.481979+0000, chain.objs.size()=1 2024-03-04T12:50:58.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.172+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.120__shadow_._94Ug9Dfgyuk64aUVBj25Vf4oSTgUL-_0 2024-03-04T12:50:58.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.172+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14701825668363940230', time=2024-03-04T14:50:54.997343+0000, chain.objs.size()=1 2024-03-04T12:50:58.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.172+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.126__shadow_.MEZePmGqvMep8FPfkBH3-BHXwxR8aer_0 2024-03-04T12:50:58.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.173+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.176+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:50:58.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.177+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.177+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T12:50:58.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10883203346646237164', time=2024-03-04T14:50:33.211270+0000, chain.objs.size()=9 2024-03-04T12:50:58.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~Bz-nNH7TT137JdszJWMkzB6UOeH56x9.1 2024-03-04T12:50:58.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~Bz-nNH7TT137JdszJWMkzB6UOeH56x9.1_1 2024-03-04T12:50:58.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~Bz-nNH7TT137JdszJWMkzB6UOeH56x9.2 2024-03-04T12:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~Bz-nNH7TT137JdszJWMkzB6UOeH56x9.2_1 2024-03-04T12:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~Bz-nNH7TT137JdszJWMkzB6UOeH56x9.3 2024-03-04T12:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~Bz-nNH7TT137JdszJWMkzB6UOeH56x9.3_1 2024-03-04T12:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~Bz-nNH7TT137JdszJWMkzB6UOeH56x9.4 2024-03-04T12:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~Bz-nNH7TT137JdszJWMkzB6UOeH56x9.4_1 2024-03-04T12:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~Bz-nNH7TT137JdszJWMkzB6UOeH56x9.5 2024-03-04T12:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14093421053785540001', time=2024-03-04T14:50:46.475988+0000, chain.objs.size()=1 2024-03-04T12:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.95__shadow_.PFUISETlSbigA8pORIO7iaAriULlCBz_0 2024-03-04T12:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12795872439072363830', time=2024-03-04T14:50:47.990283+0000, chain.objs.size()=1 2024-03-04T12:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.101__shadow_.YsUMctOVRqNuPZ3biD_IBXuKOnxYJeV_0 2024-03-04T12:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4628851305231909497', time=2024-03-04T14:50:55.224938+0000, chain.objs.size()=1 2024-03-04T12:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.178+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.127__shadow_.g3kgzqRPzLCUT_Hb29BdKAWrTzRmbfW_0 2024-03-04T12:50:58.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.182+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.184+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:50:58.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.185+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.186+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.186+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-04T12:50:58.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.186+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2327068105896055336', time=2024-03-04T14:50:39.528805+0000, chain.objs.size()=1 2024-03-04T12:50:58.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.186+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__shadow_.GA-jU0_5fijUMEcIEujtkX-is6EOS3C_0 2024-03-04T12:50:58.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.186+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9304159998871516022', time=2024-03-04T14:50:49.746890+0000, chain.objs.size()=1 2024-03-04T12:50:58.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.186+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.107__shadow_.mm8JSl9cMAxdxwI_jecj-Nz1D_7_ShM_0 2024-03-04T12:50:58.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.186+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17782847044539777113', time=2024-03-04T14:50:51.181967+0000, chain.objs.size()=1 2024-03-04T12:50:58.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.186+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.112__shadow_.R3TS2Gt6KA58Ovta4sba6NO0k454Sqq_0 2024-03-04T12:50:58.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.186+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14751622458631278890', time=2024-03-04T14:50:51.468748+0000, chain.objs.size()=1 2024-03-04T12:50:58.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.186+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.113__shadow_.ZaK8sPV0K5On_5WILprhWN8BvMYil1I_0 2024-03-04T12:50:58.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.186+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14360565295459093419', time=2024-03-04T14:50:51.747918+0000, chain.objs.size()=1 2024-03-04T12:50:58.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.186+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.114__shadow_.b_RI6vuYwavkpm4sk4W-PkaNFTf1cC__0 2024-03-04T12:50:58.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.188+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.190+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:50:58.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.191+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.191+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ', time=2024-03-04T14:50:46.131027+0000, chain.objs.size()=104 2024-03-04T12:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.1 2024-03-04T12:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.2 2024-03-04T12:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.3 2024-03-04T12:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.4 2024-03-04T12:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.5 2024-03-04T12:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.6 2024-03-04T12:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.7 2024-03-04T12:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.8 2024-03-04T12:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.9 2024-03-04T12:50:58.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.10 2024-03-04T12:50:58.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.11 2024-03-04T12:50:58.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.192+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.12 2024-03-04T12:50:58.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.194+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.13 2024-03-04T12:50:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.194+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.14 2024-03-04T12:50:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.194+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.15 2024-03-04T12:50:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.194+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.16 2024-03-04T12:50:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.194+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.17 2024-03-04T12:50:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.194+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.18 2024-03-04T12:50:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.194+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.19 2024-03-04T12:50:58.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.196+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.20 2024-03-04T12:50:58.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.196+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.21 2024-03-04T12:50:58.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.196+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.22 2024-03-04T12:50:58.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.196+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.23 2024-03-04T12:50:58.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.196+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.24 2024-03-04T12:50:58.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.196+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.25 2024-03-04T12:50:58.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.196+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.26 2024-03-04T12:50:58.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.196+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.27 2024-03-04T12:50:58.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.196+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.28 2024-03-04T12:50:58.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.196+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.29 2024-03-04T12:50:58.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.196+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.30 2024-03-04T12:50:58.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.198+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.31 2024-03-04T12:50:58.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.198+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.32 2024-03-04T12:50:58.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.198+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.33 2024-03-04T12:50:58.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.198+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.34 2024-03-04T12:50:58.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.198+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.35 2024-03-04T12:50:58.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.198+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.36 2024-03-04T12:50:58.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.198+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.37 2024-03-04T12:50:58.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.198+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.38 2024-03-04T12:50:58.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.199+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.39 2024-03-04T12:50:58.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.199+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.40 2024-03-04T12:50:58.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.199+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.41 2024-03-04T12:50:58.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.200+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.42 2024-03-04T12:50:58.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.200+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.43 2024-03-04T12:50:58.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.200+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.44 2024-03-04T12:50:58.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.200+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.45 2024-03-04T12:50:58.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.200+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.46 2024-03-04T12:50:58.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.200+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.47 2024-03-04T12:50:58.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.201+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.48 2024-03-04T12:50:58.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.201+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.49 2024-03-04T12:50:58.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.201+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.50 2024-03-04T12:50:58.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.201+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.51 2024-03-04T12:50:58.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.201+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.52 2024-03-04T12:50:58.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.202+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.53 2024-03-04T12:50:58.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.202+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.54 2024-03-04T12:50:58.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.202+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.55 2024-03-04T12:50:58.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.202+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.56 2024-03-04T12:50:58.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.203+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.57 2024-03-04T12:50:58.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.203+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.58 2024-03-04T12:50:58.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.203+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.59 2024-03-04T12:50:58.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.203+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.60 2024-03-04T12:50:58.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.203+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.61 2024-03-04T12:50:58.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.203+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.62 2024-03-04T12:50:58.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.203+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.63 2024-03-04T12:50:58.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.204+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.64 2024-03-04T12:50:58.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.204+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.65 2024-03-04T12:50:58.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.204+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.66 2024-03-04T12:50:58.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.204+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.67 2024-03-04T12:50:58.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.204+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.68 2024-03-04T12:50:58.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.205+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.69 2024-03-04T12:50:58.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.205+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.70 2024-03-04T12:50:58.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.205+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.71 2024-03-04T12:50:58.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.205+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.72 2024-03-04T12:50:58.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.205+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.73 2024-03-04T12:50:58.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.205+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.74 2024-03-04T12:50:58.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.206+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.75 2024-03-04T12:50:58.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.206+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.76 2024-03-04T12:50:58.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.207+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.77 2024-03-04T12:50:58.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.207+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.78 2024-03-04T12:50:58.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.207+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.79 2024-03-04T12:50:58.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.207+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.80 2024-03-04T12:50:58.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.207+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.81 2024-03-04T12:50:58.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.207+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.82 2024-03-04T12:50:58.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.207+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.83 2024-03-04T12:50:58.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.207+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.84 2024-03-04T12:50:58.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.207+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.85 2024-03-04T12:50:58.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.208+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.86 2024-03-04T12:50:58.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.209+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.87 2024-03-04T12:50:58.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.209+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.88 2024-03-04T12:50:58.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.209+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.89 2024-03-04T12:50:58.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.209+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.90 2024-03-04T12:50:58.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.209+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.91 2024-03-04T12:50:58.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.209+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.92 2024-03-04T12:50:58.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.209+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.93 2024-03-04T12:50:58.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.209+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.94 2024-03-04T12:50:58.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.209+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.95 2024-03-04T12:50:58.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.210+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.96 2024-03-04T12:50:58.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.211+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.97 2024-03-04T12:50:58.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.211+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.98 2024-03-04T12:50:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.211+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.99 2024-03-04T12:50:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.211+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.100 2024-03-04T12:50:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.211+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.101 2024-03-04T12:50:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.211+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.102 2024-03-04T12:50:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.211+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.103 2024-03-04T12:50:58.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.211+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.94__multipart_key1.2~msFqseSvEfjMqYTVf6fShp7xhHSZYwJ.104 2024-03-04T12:50:58.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.213+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.215+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:50:58.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.217+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.217+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-04T12:50:58.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3089450212374361125', time=2024-03-04T14:50:48.868765+0000, chain.objs.size()=1 2024-03-04T12:50:58.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.104__shadow_.hCn1sDpHUNKVExQ9H_0pjkeh559cjFz_0 2024-03-04T12:50:58.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4626231281664082841', time=2024-03-04T14:50:50.318650+0000, chain.objs.size()=1 2024-03-04T12:50:58.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.109__shadow_.clRQbZ7btlwd5LL0hC2bN73eEuNMvqY_0 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12180757027312965155', time=2024-03-04T14:50:52.051333+0000, chain.objs.size()=1 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.115__shadow_.eDUD3Zy84w_Z-0a7HrbO-cCHDRsl48V_0 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12107442832880851452', time=2024-03-04T14:50:52.905319+0000, chain.objs.size()=1 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.118__shadow_.LBliGDHcx2jFiCsRXvhgj6AvTQp1dNe_0 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17835113902713293539', time=2024-03-04T14:50:57.023776+0000, chain.objs.size()=9 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.132__multipart_key1.2~6kZEBvUvNJstWMeS68uW6VM08uDp4GR.1 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.132__shadow_key1.2~6kZEBvUvNJstWMeS68uW6VM08uDp4GR.1_1 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.132__multipart_key1.2~6kZEBvUvNJstWMeS68uW6VM08uDp4GR.2 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.132__shadow_key1.2~6kZEBvUvNJstWMeS68uW6VM08uDp4GR.2_1 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.132__multipart_key1.2~6kZEBvUvNJstWMeS68uW6VM08uDp4GR.3 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.132__shadow_key1.2~6kZEBvUvNJstWMeS68uW6VM08uDp4GR.3_1 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.132__multipart_key1.2~6kZEBvUvNJstWMeS68uW6VM08uDp4GR.4 2024-03-04T12:50:58.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.218+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.132__shadow_key1.2~6kZEBvUvNJstWMeS68uW6VM08uDp4GR.4_1 2024-03-04T12:50:58.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.220+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.132__multipart_key1.2~6kZEBvUvNJstWMeS68uW6VM08uDp4GR.5 2024-03-04T12:50:58.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.221+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.224+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:50:58.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.225+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.225+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9597151274676397861', time=2024-03-04T14:50:30.859954+0000, chain.objs.size()=1 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.79__shadow_.5LwzQE71y-6HYW___xggeYivXDOYT9Z_0 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14227292894818057367', time=2024-03-04T14:50:37.924990+0000, chain.objs.size()=9 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.87__multipart_key1.2~261NEvcYOd_lFGsGbn6AoDGYgkEr42w.1 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.87__shadow_key1.2~261NEvcYOd_lFGsGbn6AoDGYgkEr42w.1_1 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.87__multipart_key1.2~261NEvcYOd_lFGsGbn6AoDGYgkEr42w.2 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.87__shadow_key1.2~261NEvcYOd_lFGsGbn6AoDGYgkEr42w.2_1 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.87__multipart_key1.2~261NEvcYOd_lFGsGbn6AoDGYgkEr42w.3 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.87__shadow_key1.2~261NEvcYOd_lFGsGbn6AoDGYgkEr42w.3_1 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.87__multipart_key1.2~261NEvcYOd_lFGsGbn6AoDGYgkEr42w.4 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.87__shadow_key1.2~261NEvcYOd_lFGsGbn6AoDGYgkEr42w.4_1 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.87__multipart_key1.2~261NEvcYOd_lFGsGbn6AoDGYgkEr42w.5 2024-03-04T12:50:58.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6515732518574202886', time=2024-03-04T14:50:53.477096+0000, chain.objs.size()=1 2024-03-04T12:50:58.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.120__shadow_.TTrxZEHPf2ycK1IyG3CUtUXo2daZrXQ_0 2024-03-04T12:50:58.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8174752418941801503', time=2024-03-04T14:50:57.575260+0000, chain.objs.size()=9 2024-03-04T12:50:58.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.226+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.133__multipart_key1/data/file.mpg.2~5RIhtqJuc-FQIJYhEB2ltgcSu1dN7Nb.1 2024-03-04T12:50:58.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.229+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.133__shadow_key1/data/file.mpg.2~5RIhtqJuc-FQIJYhEB2ltgcSu1dN7Nb.1_1 2024-03-04T12:50:58.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.230+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.133__multipart_key1/data/file.mpg.2~5RIhtqJuc-FQIJYhEB2ltgcSu1dN7Nb.2 2024-03-04T12:50:58.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.230+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.133__shadow_key1/data/file.mpg.2~5RIhtqJuc-FQIJYhEB2ltgcSu1dN7Nb.2_1 2024-03-04T12:50:58.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.231+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.133__multipart_key1/data/file.mpg.2~5RIhtqJuc-FQIJYhEB2ltgcSu1dN7Nb.3 2024-03-04T12:50:58.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.231+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.133__shadow_key1/data/file.mpg.2~5RIhtqJuc-FQIJYhEB2ltgcSu1dN7Nb.3_1 2024-03-04T12:50:58.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.231+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.133__multipart_key1/data/file.mpg.2~5RIhtqJuc-FQIJYhEB2ltgcSu1dN7Nb.4 2024-03-04T12:50:58.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.231+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.133__shadow_key1/data/file.mpg.2~5RIhtqJuc-FQIJYhEB2ltgcSu1dN7Nb.4_1 2024-03-04T12:50:58.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.231+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.133__multipart_key1/data/file.mpg.2~5RIhtqJuc-FQIJYhEB2ltgcSu1dN7Nb.5 2024-03-04T12:50:58.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.233+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.235+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:50:58.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.236+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.237+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.237+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:58.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.237+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16372618700943220302', time=2024-03-04T14:50:36.651238+0000, chain.objs.size()=6 2024-03-04T12:50:58.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.237+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.82__shadow_.xLlHKxjl2ZUH2YlSCjmM1rpFv_fI9bp_0 2024-03-04T12:50:58.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.237+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.82__shadow_.xLlHKxjl2ZUH2YlSCjmM1rpFv_fI9bp_1 2024-03-04T12:50:58.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.237+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.82__shadow_.xLlHKxjl2ZUH2YlSCjmM1rpFv_fI9bp_2 2024-03-04T12:50:58.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.237+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.82__shadow_.xLlHKxjl2ZUH2YlSCjmM1rpFv_fI9bp_3 2024-03-04T12:50:58.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.237+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.82__shadow_.xLlHKxjl2ZUH2YlSCjmM1rpFv_fI9bp_4 2024-03-04T12:50:58.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.237+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.82__shadow_.xLlHKxjl2ZUH2YlSCjmM1rpFv_fI9bp_5 2024-03-04T12:50:58.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.237+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11190483832766200555', time=2024-03-04T14:50:50.905114+0000, chain.objs.size()=1 2024-03-04T12:50:58.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.237+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.111__shadow_.PTs6b8MsHaMQRSiKyUzaWOWY3hcTq7A_0 2024-03-04T12:50:58.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.240+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.242+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:50:58.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-04T12:50:58.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.415484364493943000', time=2024-03-04T14:50:29.691235+0000, chain.objs.size()=1 2024-03-04T12:50:58.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.74__shadow_.tbFRDOeWS2jZRrhsx7zQLGX_stssoH6_0 2024-03-04T12:50:58.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11060296228478565296', time=2024-03-04T14:50:33.735278+0000, chain.objs.size()=9 2024-03-04T12:50:58.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~1TCJc37eoaOPxcgD2yo6d6Ub6WqTnz1.1 2024-03-04T12:50:58.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~1TCJc37eoaOPxcgD2yo6d6Ub6WqTnz1.1_1 2024-03-04T12:50:58.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~1TCJc37eoaOPxcgD2yo6d6Ub6WqTnz1.2 2024-03-04T12:50:58.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~1TCJc37eoaOPxcgD2yo6d6Ub6WqTnz1.2_1 2024-03-04T12:50:58.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~1TCJc37eoaOPxcgD2yo6d6Ub6WqTnz1.3 2024-03-04T12:50:58.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~1TCJc37eoaOPxcgD2yo6d6Ub6WqTnz1.3_1 2024-03-04T12:50:58.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~1TCJc37eoaOPxcgD2yo6d6Ub6WqTnz1.4 2024-03-04T12:50:58.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~1TCJc37eoaOPxcgD2yo6d6Ub6WqTnz1.4_1 2024-03-04T12:50:58.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~1TCJc37eoaOPxcgD2yo6d6Ub6WqTnz1.5 2024-03-04T12:50:58.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7978564356072803850', time=2024-03-04T14:50:36.773339+0000, chain.objs.size()=7 2024-03-04T12:50:58.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~uT5t-J83-D3b3wnCSpN8dWoDkmyN0iA.1 2024-03-04T12:50:58.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.244+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~uT5t-J83-D3b3wnCSpN8dWoDkmyN0iA.1_1 2024-03-04T12:50:58.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.247+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~uT5t-J83-D3b3wnCSpN8dWoDkmyN0iA.1_2 2024-03-04T12:50:58.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.247+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~uT5t-J83-D3b3wnCSpN8dWoDkmyN0iA.2 2024-03-04T12:50:58.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.247+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~uT5t-J83-D3b3wnCSpN8dWoDkmyN0iA.2_1 2024-03-04T12:50:58.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.247+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~uT5t-J83-D3b3wnCSpN8dWoDkmyN0iA.2_2 2024-03-04T12:50:58.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.249+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~uT5t-J83-D3b3wnCSpN8dWoDkmyN0iA.3 2024-03-04T12:50:58.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.249+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1250112505121440815', time=2024-03-04T14:50:49.451046+0000, chain.objs.size()=1 2024-03-04T12:50:58.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.249+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.106__shadow_.hG7dnwA-oVibWpU5Um1W_akwwzTg5Ee_0 2024-03-04T12:50:58.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.249+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.421294781307462171', time=2024-03-04T14:50:50.031519+0000, chain.objs.size()=1 2024-03-04T12:50:58.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.249+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.108__shadow_.362mOphLtEoo1lj0xiA3s39ZD76wRoJ_0 2024-03-04T12:50:58.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.249+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14417471139013956634', time=2024-03-04T14:50:50.910644+0000, chain.objs.size()=1 2024-03-04T12:50:58.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.249+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.111__shadow_.ztXkl8DN6cqJttc3lTjFLloayO2WuXZ_0 2024-03-04T12:50:58.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.249+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15483365493239607353', time=2024-03-04T14:50:52.046836+0000, chain.objs.size()=1 2024-03-04T12:50:58.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.249+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.115__shadow_.RiCJyy53XNenYvvHV6TSyc23ViALFNv_0 2024-03-04T12:50:58.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.249+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10386714440420002442', time=2024-03-04T14:50:53.198065+0000, chain.objs.size()=1 2024-03-04T12:50:58.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.249+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.119__shadow_.jnHC3i8B7C5BESjXeTnjcAT3YtXpxI3_0 2024-03-04T12:50:58.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.251+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.253+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:50:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.255+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.255+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.256+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:50:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.256+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.378734245074513774', time=2024-03-04T14:50:48.585216+0000, chain.objs.size()=1 2024-03-04T12:50:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.256+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.103__shadow_.iTQVrGANscmY4iYv9utVii4TQBQRfVp_0 2024-03-04T12:50:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.256+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14121762933683289708', time=2024-03-04T14:50:51.757232+0000, chain.objs.size()=1 2024-03-04T12:50:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.256+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.114__shadow_.TjeNQ5jYUYLHPcbpl18Oz4Ak5H61K1h_0 2024-03-04T12:50:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.256+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8160972658011718300', time=2024-03-04T14:50:53.760476+0000, chain.objs.size()=1 2024-03-04T12:50:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.256+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.121__shadow_.cRD8sP4n_7Hr-AGOXTr2UsTXlBSqeav_0 2024-03-04T12:50:58.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.257+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.259+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:50:58.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.260+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T12:50:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14326297972181043696', time=2024-03-04T14:50:42.245363+0000, chain.objs.size()=9 2024-03-04T12:50:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~yiTK2wBCJOpzz4MHisDq_5wgUzPqDBA.1 2024-03-04T12:50:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~yiTK2wBCJOpzz4MHisDq_5wgUzPqDBA.1_1 2024-03-04T12:50:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~yiTK2wBCJOpzz4MHisDq_5wgUzPqDBA.2 2024-03-04T12:50:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~yiTK2wBCJOpzz4MHisDq_5wgUzPqDBA.2_1 2024-03-04T12:50:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~yiTK2wBCJOpzz4MHisDq_5wgUzPqDBA.3 2024-03-04T12:50:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~yiTK2wBCJOpzz4MHisDq_5wgUzPqDBA.3_1 2024-03-04T12:50:58.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~yiTK2wBCJOpzz4MHisDq_5wgUzPqDBA.4 2024-03-04T12:50:58.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~yiTK2wBCJOpzz4MHisDq_5wgUzPqDBA.4_1 2024-03-04T12:50:58.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~yiTK2wBCJOpzz4MHisDq_5wgUzPqDBA.5 2024-03-04T12:50:58.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18443990490646286814', time=2024-03-04T14:50:47.985167+0000, chain.objs.size()=1 2024-03-04T12:50:58.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.101__shadow_.s91oj1S0Fl_N9oyTeLdYni3EiEW1YgP_0 2024-03-04T12:50:58.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2003333677464257879', time=2024-03-04T14:50:48.873423+0000, chain.objs.size()=1 2024-03-04T12:50:58.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.104__shadow_.vIErELoeTCOdRQ0Po3xHrZ-jINNNd7b_0 2024-03-04T12:50:58.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13467872191464606637', time=2024-03-04T14:50:49.455403+0000, chain.objs.size()=1 2024-03-04T12:50:58.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.261+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.106__shadow_.fYRIZpS84Tc_OkPZ7EqlsoQUo6ooW4a_0 2024-03-04T12:50:58.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.265+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2479162791806178675', time=2024-03-04T14:50:50.895159+0000, chain.objs.size()=1 2024-03-04T12:50:58.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.265+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.111__shadow_.1HswHNMzAWHPWy2lv3j0qgYS67N88SU_0 2024-03-04T12:50:58.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.265+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7113412689837202374', time=2024-03-04T14:50:52.616319+0000, chain.objs.size()=1 2024-03-04T12:50:58.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.265+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.117__shadow_.ty8YmhBBnDGhdiJmysPTcPO_eNqutLN_0 2024-03-04T12:50:58.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.266+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.268+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:50:58.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T12:50:58.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3931195047096012075', time=2024-03-04T14:50:38.930629+0000, chain.objs.size()=9 2024-03-04T12:50:58.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.88__multipart_key1.2~dB-ybHk671YN8RKR1J4BcHnFUB32tjr.1 2024-03-04T12:50:58.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.88__shadow_key1.2~dB-ybHk671YN8RKR1J4BcHnFUB32tjr.1_1 2024-03-04T12:50:58.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.88__multipart_key1.2~dB-ybHk671YN8RKR1J4BcHnFUB32tjr.2 2024-03-04T12:50:58.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.88__shadow_key1.2~dB-ybHk671YN8RKR1J4BcHnFUB32tjr.2_1 2024-03-04T12:50:58.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.88__multipart_key1.2~dB-ybHk671YN8RKR1J4BcHnFUB32tjr.3 2024-03-04T12:50:58.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.88__shadow_key1.2~dB-ybHk671YN8RKR1J4BcHnFUB32tjr.3_1 2024-03-04T12:50:58.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.88__multipart_key1.2~dB-ybHk671YN8RKR1J4BcHnFUB32tjr.4 2024-03-04T12:50:58.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.88__shadow_key1.2~dB-ybHk671YN8RKR1J4BcHnFUB32tjr.4_1 2024-03-04T12:50:58.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.88__multipart_key1.2~dB-ybHk671YN8RKR1J4BcHnFUB32tjr.5 2024-03-04T12:50:58.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8427312269920473548', time=2024-03-04T14:50:44.087906+0000, chain.objs.size()=1 2024-03-04T12:50:58.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.92__shadow_.hE9nsZuqInyvtS3KjQKwzFNKnLGJjJP_0 2024-03-04T12:50:58.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10449005373291148201', time=2024-03-04T14:50:49.445636+0000, chain.objs.size()=1 2024-03-04T12:50:58.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.270+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.106__shadow_.BdoFP14BUoi59xLFIOdAzY9NNzaaUs6_0 2024-03-04T12:50:58.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.271+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12327536400491508020', time=2024-03-04T14:50:49.751531+0000, chain.objs.size()=1 2024-03-04T12:50:58.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.271+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.107__shadow_.m7Ykzl4oSnHRSGxep7PINfiOcoUkUyi_0 2024-03-04T12:50:58.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.275+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.277+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:50:58.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.278+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.278+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.279+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:58.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.279+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17972067396158565312', time=2024-03-04T14:50:48.276038+0000, chain.objs.size()=1 2024-03-04T12:50:58.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.279+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.102__shadow_.CC9BWLWpF5rhCR8WgsvJ1rfBNmAIjsP_0 2024-03-04T12:50:58.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.279+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.898279411955698166', time=2024-03-04T14:50:53.188373+0000, chain.objs.size()=1 2024-03-04T12:50:58.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.279+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.119__shadow_.CRkWcu9v9_pLVkrOezpxKYaRFBkZPT9_0 2024-03-04T12:50:58.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.280+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.283+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:50:58.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.284+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.285+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.285+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:50:58.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.285+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17936650915323024917', time=2024-03-04T14:50:50.328500+0000, chain.objs.size()=1 2024-03-04T12:50:58.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.285+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.109__shadow_.MtLh8EUwBYC37cLsL3KOoqtCgwk3g1s_0 2024-03-04T12:50:58.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.285+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17448231096019411071', time=2024-03-04T14:50:51.473683+0000, chain.objs.size()=1 2024-03-04T12:50:58.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.285+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.113__shadow_.DNbs3x5iFCbp7VrTVOVwItCNRcaeJWa_0 2024-03-04T12:50:58.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.285+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17421867549374094384', time=2024-03-04T14:50:52.909676+0000, chain.objs.size()=1 2024-03-04T12:50:58.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.285+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.118__shadow_.qkREfLrqiDNFp6VT7xz7dVHQZuqk-B5_0 2024-03-04T12:50:58.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.286+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.288+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:50:58.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.290+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.290+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.290+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-04T12:50:58.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.290+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1761010482253040831', time=2024-03-04T14:50:35.579057+0000, chain.objs.size()=7 2024-03-04T12:50:58.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.290+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~1XwJVyTNYl0lprxSJr14e6X7DJyRnfG.1 2024-03-04T12:50:58.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.290+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~1XwJVyTNYl0lprxSJr14e6X7DJyRnfG.1_1 2024-03-04T12:50:58.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.290+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~1XwJVyTNYl0lprxSJr14e6X7DJyRnfG.1_2 2024-03-04T12:50:58.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.291+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~1XwJVyTNYl0lprxSJr14e6X7DJyRnfG.2 2024-03-04T12:50:58.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.291+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~1XwJVyTNYl0lprxSJr14e6X7DJyRnfG.2_1 2024-03-04T12:50:58.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.291+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__shadow_key1.2~1XwJVyTNYl0lprxSJr14e6X7DJyRnfG.2_2 2024-03-04T12:50:58.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.291+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.83__multipart_key1.2~1XwJVyTNYl0lprxSJr14e6X7DJyRnfG.3 2024-03-04T12:50:58.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.291+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10674888125378345129', time=2024-03-04T14:50:48.281132+0000, chain.objs.size()=1 2024-03-04T12:50:58.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.291+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.102__shadow_.Nd42S4BP6SSrFFLlOgVbYzp-m3HPucy_0 2024-03-04T12:50:58.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.291+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11016096638294769249', time=2024-03-04T14:50:48.285978+0000, chain.objs.size()=1 2024-03-04T12:50:58.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.291+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.102__shadow_.kwxdgHsfrT_W7rEKJpJv57bWKySAG6J_0 2024-03-04T12:50:58.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.291+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.850399600852867122', time=2024-03-04T14:50:52.326662+0000, chain.objs.size()=1 2024-03-04T12:50:58.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.291+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.116__shadow_.799N6FdMxHuHleX3Kzgcj2mY7LfhXJz_0 2024-03-04T12:50:58.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.291+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15002074011777602808', time=2024-03-04T14:50:52.631403+0000, chain.objs.size()=1 2024-03-04T12:50:58.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.291+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.117__shadow_.ux3vtVWs6kyLHiRWjoVxfHwS-xP8A04_0 2024-03-04T12:50:58.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.294+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.296+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:50:58.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.297+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:50:58.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5334373157442452002', time=2024-03-04T14:50:42.871638+0000, chain.objs.size()=7 2024-03-04T12:50:58.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~dUmOYyC0RL5niFEg6Bs_dJI4phKFC9U.1 2024-03-04T12:50:58.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~dUmOYyC0RL5niFEg6Bs_dJI4phKFC9U.1_1 2024-03-04T12:50:58.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~dUmOYyC0RL5niFEg6Bs_dJI4phKFC9U.1_2 2024-03-04T12:50:58.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~dUmOYyC0RL5niFEg6Bs_dJI4phKFC9U.2 2024-03-04T12:50:58.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~dUmOYyC0RL5niFEg6Bs_dJI4phKFC9U.2_1 2024-03-04T12:50:58.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~dUmOYyC0RL5niFEg6Bs_dJI4phKFC9U.2_2 2024-03-04T12:50:58.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~dUmOYyC0RL5niFEg6Bs_dJI4phKFC9U.3 2024-03-04T12:50:58.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13216111678809599764', time=2024-03-04T14:50:44.647947+0000, chain.objs.size()=9 2024-03-04T12:50:58.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.92__multipart_key1.2~8yyZsGaeBm__9wXCGxdLK8fWe2z3I7s.1 2024-03-04T12:50:58.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.92__shadow_key1.2~8yyZsGaeBm__9wXCGxdLK8fWe2z3I7s.1_1 2024-03-04T12:50:58.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.92__multipart_key1.2~8yyZsGaeBm__9wXCGxdLK8fWe2z3I7s.2 2024-03-04T12:50:58.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.92__shadow_key1.2~8yyZsGaeBm__9wXCGxdLK8fWe2z3I7s.2_1 2024-03-04T12:50:58.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.298+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.92__multipart_key1.2~8yyZsGaeBm__9wXCGxdLK8fWe2z3I7s.3 2024-03-04T12:50:58.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.302+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.92__shadow_key1.2~8yyZsGaeBm__9wXCGxdLK8fWe2z3I7s.3_1 2024-03-04T12:50:58.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.302+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.92__multipart_key1.2~8yyZsGaeBm__9wXCGxdLK8fWe2z3I7s.4 2024-03-04T12:50:58.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.302+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.92__shadow_key1.2~8yyZsGaeBm__9wXCGxdLK8fWe2z3I7s.4_1 2024-03-04T12:50:58.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.302+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.92__multipart_key1.2~8yyZsGaeBm__9wXCGxdLK8fWe2z3I7s.5 2024-03-04T12:50:58.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.302+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7303539525019757274', time=2024-03-04T14:50:52.336085+0000, chain.objs.size()=1 2024-03-04T12:50:58.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.302+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.116__shadow_.d-UNVBDl6RNhEFQLTcO-4zrPokcZyPU_0 2024-03-04T12:50:58.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.305+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.306+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:50:58.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.308+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.308+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.308+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-04T12:50:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.308+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13533228320452535464', time=2024-03-04T14:50:39.543529+0000, chain.objs.size()=1 2024-03-04T12:50:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.308+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__shadow_.QSggLYq78aoxlgS0QJp_rsuh_2Au6lv_0 2024-03-04T12:50:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4980118950790841369', time=2024-03-04T14:50:41.938975+0000, chain.objs.size()=9 2024-03-04T12:50:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~8hWPmaeRKVKthmh18r-qZPPef0XMOJQ.1 2024-03-04T12:50:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~8hWPmaeRKVKthmh18r-qZPPef0XMOJQ.1_1 2024-03-04T12:50:58.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~8hWPmaeRKVKthmh18r-qZPPef0XMOJQ.2 2024-03-04T12:50:58.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~8hWPmaeRKVKthmh18r-qZPPef0XMOJQ.2_1 2024-03-04T12:50:58.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~8hWPmaeRKVKthmh18r-qZPPef0XMOJQ.3 2024-03-04T12:50:58.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~8hWPmaeRKVKthmh18r-qZPPef0XMOJQ.3_1 2024-03-04T12:50:58.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~8hWPmaeRKVKthmh18r-qZPPef0XMOJQ.4 2024-03-04T12:50:58.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~8hWPmaeRKVKthmh18r-qZPPef0XMOJQ.4_1 2024-03-04T12:50:58.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~8hWPmaeRKVKthmh18r-qZPPef0XMOJQ.5 2024-03-04T12:50:58.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.229952697093491877', time=2024-03-04T14:50:45.327231+0000, chain.objs.size()=9 2024-03-04T12:50:58.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.93__multipart_key1.2~cGovu2zYKdrJHBnIs3pqaHA9OF5L6SM.1 2024-03-04T12:50:58.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.309+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.93__shadow_key1.2~cGovu2zYKdrJHBnIs3pqaHA9OF5L6SM.1_1 2024-03-04T12:50:58.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.311+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.93__multipart_key1.2~cGovu2zYKdrJHBnIs3pqaHA9OF5L6SM.2 2024-03-04T12:50:58.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.93__shadow_key1.2~cGovu2zYKdrJHBnIs3pqaHA9OF5L6SM.2_1 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.93__multipart_key1.2~cGovu2zYKdrJHBnIs3pqaHA9OF5L6SM.3 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.93__shadow_key1.2~cGovu2zYKdrJHBnIs3pqaHA9OF5L6SM.3_1 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.93__multipart_key1.2~cGovu2zYKdrJHBnIs3pqaHA9OF5L6SM.4 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.93__shadow_key1.2~cGovu2zYKdrJHBnIs3pqaHA9OF5L6SM.4_1 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.93__multipart_key1.2~cGovu2zYKdrJHBnIs3pqaHA9OF5L6SM.5 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11933608304093551473', time=2024-03-04T14:50:50.333206+0000, chain.objs.size()=1 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.109__shadow_.frhjNzpJDrFxlw-mXRSLNZYPLwVzU5b_0 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18257783526695853058', time=2024-03-04T14:50:50.622229+0000, chain.objs.size()=1 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.110__shadow_.JqnXFhQuNOqlLSyivZ_uUoX3BWtwnWu_0 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15531336229511618417', time=2024-03-04T14:50:53.755657+0000, chain.objs.size()=1 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.121__shadow_.TP0Up-yyRwD0v_2RnRqI9JqDUui7D-t_0 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6935207293247613109', time=2024-03-04T14:50:55.740616+0000, chain.objs.size()=1 2024-03-04T12:50:58.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.312+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.128__shadow_.frTxOsZFRBlJEG3tFy8gBk9BbERQDn8_0 2024-03-04T12:50:58.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.316+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.318+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:50:58.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.320+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.320+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T12:50:58.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6344138461977132278', time=2024-03-04T14:50:31.664873+0000, chain.objs.size()=9 2024-03-04T12:50:58.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__multipart_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.1 2024-03-04T12:50:58.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__shadow_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.1_1 2024-03-04T12:50:58.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__multipart_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.2 2024-03-04T12:50:58.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__shadow_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.2_1 2024-03-04T12:50:58.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__multipart_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.3 2024-03-04T12:50:58.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__shadow_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.3_1 2024-03-04T12:50:58.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__multipart_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.4 2024-03-04T12:50:58.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__shadow_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.4_1 2024-03-04T12:50:58.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.80__multipart_key1.2~pB4usCngt6VWDDXZT4gcCOezrFGRtaQ.5 2024-03-04T12:50:58.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14862504216382789428', time=2024-03-04T14:50:39.533763+0000, chain.objs.size()=9 2024-03-04T12:50:58.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__multipart_file2.mpg.2~1O8snSAIA6eU9qkVyyOTZneZ-0KACp9.1 2024-03-04T12:50:58.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__shadow_file2.mpg.2~1O8snSAIA6eU9qkVyyOTZneZ-0KACp9.1_1 2024-03-04T12:50:58.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.321+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__multipart_file2.mpg.2~1O8snSAIA6eU9qkVyyOTZneZ-0KACp9.2 2024-03-04T12:50:58.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.322+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__shadow_file2.mpg.2~1O8snSAIA6eU9qkVyyOTZneZ-0KACp9.2_1 2024-03-04T12:50:58.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.322+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__multipart_file2.mpg.2~1O8snSAIA6eU9qkVyyOTZneZ-0KACp9.3 2024-03-04T12:50:58.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.323+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__shadow_file2.mpg.2~1O8snSAIA6eU9qkVyyOTZneZ-0KACp9.3_1 2024-03-04T12:50:58.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.323+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__multipart_file2.mpg.2~1O8snSAIA6eU9qkVyyOTZneZ-0KACp9.4 2024-03-04T12:50:58.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.323+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__shadow_file2.mpg.2~1O8snSAIA6eU9qkVyyOTZneZ-0KACp9.4_1 2024-03-04T12:50:58.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.323+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__multipart_file2.mpg.2~1O8snSAIA6eU9qkVyyOTZneZ-0KACp9.5 2024-03-04T12:50:58.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.323+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2940763042743247672', time=2024-03-04T14:50:49.170791+0000, chain.objs.size()=1 2024-03-04T12:50:58.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.323+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.105__shadow_.GYCumyC_iQnlz1CUzRbeGswOF400h3W_0 2024-03-04T12:50:58.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.323+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2553517823872900118', time=2024-03-04T14:50:51.187071+0000, chain.objs.size()=1 2024-03-04T12:50:58.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.323+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.112__shadow_.1HHRgyq9Pj4mSbu1k0PgBwYLRmq1HTc_0 2024-03-04T12:50:58.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.328+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.330+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:50:58.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.331+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T12:50:58.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='2~GgqlZt5gmYCIIPqTzeXMph57uZkdhpZ', time=2024-03-04T14:50:27.549735+0000, chain.objs.size()=9 2024-03-04T12:50:58.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.68__multipart_key1.2~GgqlZt5gmYCIIPqTzeXMph57uZkdhpZ.1 2024-03-04T12:50:58.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.68__shadow_key1.2~GgqlZt5gmYCIIPqTzeXMph57uZkdhpZ.1_1 2024-03-04T12:50:58.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.68__multipart_key1.2~GgqlZt5gmYCIIPqTzeXMph57uZkdhpZ.2 2024-03-04T12:50:58.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.68__shadow_key1.2~GgqlZt5gmYCIIPqTzeXMph57uZkdhpZ.2_1 2024-03-04T12:50:58.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.68__multipart_key1.2~GgqlZt5gmYCIIPqTzeXMph57uZkdhpZ.3 2024-03-04T12:50:58.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.68__shadow_key1.2~GgqlZt5gmYCIIPqTzeXMph57uZkdhpZ.3_1 2024-03-04T12:50:58.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.68__multipart_key1.2~GgqlZt5gmYCIIPqTzeXMph57uZkdhpZ.4 2024-03-04T12:50:58.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.68__shadow_key1.2~GgqlZt5gmYCIIPqTzeXMph57uZkdhpZ.4_1 2024-03-04T12:50:58.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.68__multipart_key1.2~GgqlZt5gmYCIIPqTzeXMph57uZkdhpZ.5 2024-03-04T12:50:58.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2917972692036889821', time=2024-03-04T14:50:50.025223+0000, chain.objs.size()=1 2024-03-04T12:50:58.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.108__shadow_.AyWt_tmBl80CUwU1PrUIUtAx6loM2_0_0 2024-03-04T12:50:58.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6657352109594023767', time=2024-03-04T14:50:53.750591+0000, chain.objs.size()=1 2024-03-04T12:50:58.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.121__shadow_.w1FDy26UqmpiKFyDGG4XXq287vNpgLD_0 2024-03-04T12:50:58.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6944938616388471770', time=2024-03-04T14:50:55.177292+0000, chain.objs.size()=1 2024-03-04T12:50:58.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.332+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.127__shadow_.94OXD2KuL8e_hW8VwR_A6HlChf4KhHm_0 2024-03-04T12:50:58.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.336+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.338+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:50:58.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.339+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.340+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.340+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:58.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.340+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.221029609370675167', time=2024-03-04T14:50:42.551648+0000, chain.objs.size()=7 2024-03-04T12:50:58.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.340+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~1xQojYdBtMDmOryfNef3nkOHWbxKblw.1 2024-03-04T12:50:58.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.340+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~1xQojYdBtMDmOryfNef3nkOHWbxKblw.1_1 2024-03-04T12:50:58.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.340+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~1xQojYdBtMDmOryfNef3nkOHWbxKblw.1_2 2024-03-04T12:50:58.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.340+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~1xQojYdBtMDmOryfNef3nkOHWbxKblw.2 2024-03-04T12:50:58.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.340+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~1xQojYdBtMDmOryfNef3nkOHWbxKblw.2_1 2024-03-04T12:50:58.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.340+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__shadow_key1.2~1xQojYdBtMDmOryfNef3nkOHWbxKblw.2_2 2024-03-04T12:50:58.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.340+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91__multipart_key1.2~1xQojYdBtMDmOryfNef3nkOHWbxKblw.3 2024-03-04T12:50:58.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.340+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8285177800634509134', time=2024-03-04T14:50:48.570331+0000, chain.objs.size()=1 2024-03-04T12:50:58.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.340+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.103__shadow_.IqWKMrFuOJYKSzVNpzTotsN3vM0NUgi_0 2024-03-04T12:50:58.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.343+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.345+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:50:58.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.346+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.346+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.347+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:50:58.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.347+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7443827219078539901', time=2024-03-04T14:50:48.863614+0000, chain.objs.size()=1 2024-03-04T12:50:58.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.347+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.104__shadow_.lvyZhuipGd0ZfMXM5Tn0R4UYzRC2Zhj_0 2024-03-04T12:50:58.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.347+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.623964537419113612', time=2024-03-04T14:50:51.761784+0000, chain.objs.size()=1 2024-03-04T12:50:58.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.347+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.114__shadow_.1u3G7qpeE4OT96cHwn-rqXLtDknNL1-_0 2024-03-04T12:50:58.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.347+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18320233679545585143', time=2024-03-04T14:50:54.043611+0000, chain.objs.size()=1 2024-03-04T12:50:58.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.347+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.122__shadow_.oLNdZFcuWahHb-WLEcs-1Ewx1Uz0c68_0 2024-03-04T12:50:58.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.348+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.350+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:50:58.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.351+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.352+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.352+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:58.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.352+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15211442382300199632', time=2024-03-04T14:50:51.753110+0000, chain.objs.size()=1 2024-03-04T12:50:58.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.352+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.114__shadow_.aRmAAX_73hsighyuzKANBUi4CEbExQP_0 2024-03-04T12:50:58.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.352+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2194436253100188730', time=2024-03-04T14:50:57.580437+0000, chain.objs.size()=1 2024-03-04T12:50:58.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.352+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.133__shadow_.8VWwYhrbLm2k5BG3QZgofOHR8mEvWC4_0 2024-03-04T12:50:58.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.353+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.355+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:50:58.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.356+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.357+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.357+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T12:50:58.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.357+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13274926598727286749', time=2024-03-04T14:50:29.145041+0000, chain.objs.size()=3 2024-03-04T12:50:58.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.357+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.72__shadow_.u72ayAqzlPINYihcrYFFtaTpctCxgYS_0 2024-03-04T12:50:58.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.357+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.72__shadow_.u72ayAqzlPINYihcrYFFtaTpctCxgYS_1 2024-03-04T12:50:58.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.357+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.72__shadow_.u72ayAqzlPINYihcrYFFtaTpctCxgYS_2 2024-03-04T12:50:58.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.357+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.991203457383064176', time=2024-03-04T14:50:39.538211+0000, chain.objs.size()=1 2024-03-04T12:50:58.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.357+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.89__shadow_.CrB26__-BxWbf3JuXNpTgLZ-8gB3oom_0 2024-03-04T12:50:58.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.357+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2215034770354060401', time=2024-03-04T14:50:52.035961+0000, chain.objs.size()=1 2024-03-04T12:50:58.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.357+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.115__shadow_.LBsBnvpY0N22L3anQK3NjUOqTTNV08v_0 2024-03-04T12:50:58.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.357+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2014734527587375454', time=2024-03-04T14:50:52.625812+0000, chain.objs.size()=1 2024-03-04T12:50:58.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.357+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.117__shadow_.ky7cBpV_PrZ4Tpk2v7gPsR9pbLbzc-y_0 2024-03-04T12:50:58.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.360+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.362+0000 7faa1314b800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:50:58.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.363+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.363+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.364+0000 7faa1314b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:50:58.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.364+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15044686094463924564', time=2024-03-04T14:50:49.736364+0000, chain.objs.size()=1 2024-03-04T12:50:58.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.364+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.107__shadow_.fr9x0H69I6SDhibiMPF2b5B5x-NBiqB_0 2024-03-04T12:50:58.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.364+0000 7faa1314b800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17869942516037277031', time=2024-03-04T14:50:54.774953+0000, chain.objs.size()=1 2024-03-04T12:50:58.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.364+0000 7faa1314b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.125__shadow_.gTBHNxHpU00A-SLOpjPxbBXr3fsQnQK_0 2024-03-04T12:50:58.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.365+0000 7faa1314b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:50:58.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.368+0000 7fa8c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:58.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.370+0000 7faa1314b800 20 remove_watcher() i=0 2024-03-04T12:50:58.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.370+0000 7faa1314b800 2 removed watcher, disabling cache 2024-03-04T12:50:58.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.371+0000 7faa1314b800 20 remove_watcher() i=1 2024-03-04T12:50:58.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.371+0000 7faa1314b800 20 remove_watcher() i=2 2024-03-04T12:50:58.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.372+0000 7faa1314b800 20 remove_watcher() i=3 2024-03-04T12:50:58.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.373+0000 7faa1314b800 20 remove_watcher() i=4 2024-03-04T12:50:58.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.374+0000 7faa1314b800 20 remove_watcher() i=5 2024-03-04T12:50:58.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.375+0000 7faa1314b800 20 remove_watcher() i=6 2024-03-04T12:50:58.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.376+0000 7faa1314b800 20 remove_watcher() i=7 2024-03-04T12:50:58.393 DEBUG:teuthology.orchestra.run.smithi090:> radosgw-admin gc process --include-all 2024-03-04T12:50:58.442 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:50:58.442 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:50:58.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.468+0000 7f0c8fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.469+0000 7f0c8fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:58.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.469+0000 7f0c8fc15800 20 realm 2024-03-04T12:50:58.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.470+0000 7f0c8fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.470+0000 7f0c8fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:58.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.470+0000 7f0c8fc15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:50:58.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.470+0000 7f0c8fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.470+0000 7f0c8fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:58.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.470+0000 7f0c8fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.471+0000 7f0c8fc15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:58.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.471+0000 7f0c8fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.471+0000 7f0c8fc15800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:50:58.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.471+0000 7f0c8fc15800 20 searching for the correct realm 2024-03-04T12:50:58.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.474+0000 7f0c8a9dd640 0 -- 172.21.15.90:0/3898580796 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f0c74037060 msgr2=0x7f0c7405e070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:58.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.477+0000 7f0c8b1de640 0 -- 172.21.15.90:0/3898580796 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f0c74088810 msgr2=0x7f0c7405d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:50:58.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.683+0000 7f0c8fc15800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:50:58.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.683+0000 7f0c8fc15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:50:58.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.683+0000 7f0c8fc15800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:50:58.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.683+0000 7f0c8fc15800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:50:58.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.683+0000 7f0c8fc15800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:50:58.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.683+0000 7f0c8fc15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:50:58.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.683+0000 7f0c8fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.683+0000 7f0c8fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:58.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.683+0000 7f0c8fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:58.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:50:58.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 20 zone default found 2024-03-04T12:50:58.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 4 Realm: () 2024-03-04T12:50:58.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:50:58.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:50:58.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:50:58.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 20 zonegroup default 2024-03-04T12:50:58.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:58.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:58.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.684+0000 7f0c8fc15800 20 rados->read ofs=0 len=0 2024-03-04T12:50:58.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.685+0000 7f0c8fc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:58.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.685+0000 7f0c8fc15800 20 started sync module instance, tier type = 2024-03-04T12:50:58.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.685+0000 7f0c8fc15800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:50:58.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.694+0000 7f0c8fc15800 20 add_watcher() i=0 2024-03-04T12:50:58.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.694+0000 7f0c8fc15800 20 add_watcher() i=1 2024-03-04T12:50:58.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.694+0000 7f0c8fc15800 20 add_watcher() i=2 2024-03-04T12:50:58.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.694+0000 7f0c8fc15800 20 add_watcher() i=3 2024-03-04T12:50:58.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.694+0000 7f0c8fc15800 20 add_watcher() i=4 2024-03-04T12:50:58.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.694+0000 7f0c8fc15800 20 add_watcher() i=5 2024-03-04T12:50:58.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.694+0000 7f0c8fc15800 20 add_watcher() i=6 2024-03-04T12:50:58.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.695+0000 7f0c8fc15800 20 add_watcher() i=7 2024-03-04T12:50:58.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.695+0000 7f0c8fc15800 2 all 8 watchers are set, enabling cache 2024-03-04T12:50:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.696+0000 7f0b41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.696+0000 7f0c8fc15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:50:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.697+0000 7f0c8fc15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:50:58.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.731+0000 7f0b40fe1640 20 reqs_thread_entry: start 2024-03-04T12:50:58.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.731+0000 7f0c8fc15800 20 init_complete bucket index max shards: 11 2024-03-04T12:50:58.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.731+0000 7f0c8fc15800 20 Filter name: none 2024-03-04T12:50:58.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.732+0000 7f0aba7fc640 20 reqs_thread_entry: start 2024-03-04T12:50:58.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.732+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:50:58.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.733+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.733+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.733+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.735+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:50:58.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.736+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.736+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.737+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.738+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:50:58.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.739+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.739+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.740+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.741+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:50:58.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.742+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.742+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.743+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.744+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:50:58.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.745+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.745+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.745+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.746+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:50:58.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.747+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.748+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.748+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.749+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:50:58.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.751+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.751+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.751+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.752+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:50:58.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.753+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.754+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.754+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.755+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:50:58.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.757+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.757+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.758+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.759+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:50:58.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.760+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.760+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.760+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.761+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:50:58.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.763+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.763+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.763+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.764+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:50:58.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.766+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.766+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.766+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.767+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:50:58.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.769+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.770+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.770+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.771+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:50:58.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.772+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.773+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.773+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.774+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:50:58.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.776+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.776+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.776+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.777+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:50:58.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.778+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.779+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.779+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.780+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:50:58.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.781+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.782+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.782+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.783+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:50:58.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.785+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.785+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.785+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.786+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:50:58.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.787+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.788+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.788+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.790+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:50:58.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.791+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.792+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.792+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.793+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:50:58.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.794+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.795+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.795+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.796+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:50:58.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.797+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.798+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.798+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.799+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:50:58.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.801+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.801+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.801+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.802+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:50:58.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.804+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.804+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.805+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.806+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:50:58.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.807+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.808+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.808+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.809+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:50:58.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.810+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.810+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.811+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.812+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:50:58.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.813+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.813+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.813+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.814+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:50:58.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.816+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.816+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.816+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.817+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:50:58.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.819+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.820+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.820+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.821+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:50:58.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.822+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.823+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.823+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.824+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:50:58.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.825+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.826+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.826+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.827+0000 7f0c8fc15800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:50:58.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.828+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.829+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:50:58.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.829+0000 7f0c8fc15800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:50:58.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.831+0000 7f0b41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:58.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.833+0000 7f0c8fc15800 20 remove_watcher() i=0 2024-03-04T12:50:58.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.833+0000 7f0c8fc15800 2 removed watcher, disabling cache 2024-03-04T12:50:58.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.834+0000 7f0c8fc15800 20 remove_watcher() i=1 2024-03-04T12:50:58.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.835+0000 7f0c8fc15800 20 remove_watcher() i=2 2024-03-04T12:50:58.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.836+0000 7f0c8fc15800 20 remove_watcher() i=3 2024-03-04T12:50:58.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.837+0000 7f0c8fc15800 20 remove_watcher() i=4 2024-03-04T12:50:58.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.838+0000 7f0c8fc15800 20 remove_watcher() i=5 2024-03-04T12:50:58.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.839+0000 7f0c8fc15800 20 remove_watcher() i=6 2024-03-04T12:50:58.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:58.840+0000 7f0c8fc15800 20 remove_watcher() i=7 2024-03-04T12:50:58.857 INFO:teuthology.run_tasks:Running task s3tests... 2024-03-04T12:50:58.875 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-03-04T12:50:58.875 INFO:tasks.s3tests:Downloading s3-tests... 2024-03-04T12:50:58.875 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-03-04T12:50:58.875 DEBUG:teuthology.orchestra.run.smithi090:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-03-04T12:50:58.902 INFO:teuthology.orchestra.run.smithi090.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-03-04T12:50:59.793 INFO:tasks.s3tests:Creating rgw users... 2024-03-04T12:50:59.793 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-03-04T12:50:59.793 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --email foo.client.0+test@test.test --caps 'user-policy=*' --access-key PHRJBNITSHUYIVOPLEOA --secret nG35tqvs8xYqf+xXnW/W60pUVV4g71RRolw0EISi3B2zga7jdqjj+Q== --cluster ceph 2024-03-04T12:50:59.897 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:50:59.897 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:50:59.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.919+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.920+0000 7f79bd531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:59.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.920+0000 7f79bd531800 20 realm 2024-03-04T12:50:59.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.920+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.921+0000 7f79bd531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:59.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.921+0000 7f79bd531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:50:59.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.921+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.921+0000 7f79bd531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:59.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.921+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.922+0000 7f79bd531800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:59.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.922+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.922+0000 7f79bd531800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:50:59.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.922+0000 7f79bd531800 20 searching for the correct realm 2024-03-04T12:50:59.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.926+0000 7f79b89d2640 0 -- 172.21.15.90:0/2569783368 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f79b0057040 msgr2=0x7f79b0057420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:50:59.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.930+0000 7f79b99d4640 0 -- 172.21.15.90:0/2569783368 >> [v2:172.21.15.184:6808/2808753711,v1:172.21.15.184:6809/2808753711] conn(0x7f79b009b040 msgr2=0x7f79b009b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:50:59.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.934+0000 7f79bd531800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:50:59.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.934+0000 7f79bd531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:50:59.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.934+0000 7f79bd531800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:50:59.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.934+0000 7f79bd531800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:50:59.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.934+0000 7f79bd531800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:50:59.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.934+0000 7f79bd531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:50:59.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.934+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.934+0000 7f79bd531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:59.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.934+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.934+0000 7f79bd531800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:50:59.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.934+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.935+0000 7f79bd531800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:50:59.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.935+0000 7f79bd531800 20 zone default found 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.935+0000 7f79bd531800 4 Realm: () 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.935+0000 7f79bd531800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.935+0000 7f79bd531800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.935+0000 7f79bd531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.935+0000 7f79bd531800 20 zonegroup default 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.935+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.935+0000 7f79bd531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.935+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.935+0000 7f79bd531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.935+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.936+0000 7f79bd531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.936+0000 7f79bd531800 20 started sync module instance, tier type = 2024-03-04T12:50:59.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.936+0000 7f79bd531800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:50:59.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.944+0000 7f79bd531800 20 add_watcher() i=0 2024-03-04T12:50:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.944+0000 7f79bd531800 20 add_watcher() i=1 2024-03-04T12:50:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.944+0000 7f79bd531800 20 add_watcher() i=2 2024-03-04T12:50:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.944+0000 7f79bd531800 20 add_watcher() i=3 2024-03-04T12:50:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.944+0000 7f79bd531800 20 add_watcher() i=4 2024-03-04T12:50:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.944+0000 7f79bd531800 20 add_watcher() i=5 2024-03-04T12:50:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.944+0000 7f79bd531800 20 add_watcher() i=6 2024-03-04T12:50:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.945+0000 7f79bd531800 20 add_watcher() i=7 2024-03-04T12:50:59.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.945+0000 7f79bd531800 2 all 8 watchers are set, enabling cache 2024-03-04T12:50:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.947+0000 7f786f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.947+0000 7f79bd531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:50:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.947+0000 7f79bd531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:50:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.947+0000 7f79bd531800 5 note: GC not initialized 2024-03-04T12:50:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.947+0000 7f786e7e4640 20 reqs_thread_entry: start 2024-03-04T12:50:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.947+0000 7f79bd531800 20 init_complete bucket index max shards: 11 2024-03-04T12:50:59.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.947+0000 7f79bd531800 20 Filter name: none 2024-03-04T12:50:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f77dffff640 20 reqs_thread_entry: start 2024-03-04T12:50:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f79bd531800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-03-04T12:50:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f79bd531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f79bd531800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-03-04T12:50:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f79bd531800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-04T12:50:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f79bd531800 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2024-03-04T12:50:59.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f79bd531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f79bd531800 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2024-03-04T12:50:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f79bd531800 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2024-03-04T12:50:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f79bd531800 10 cache get: name=default.rgw.meta+users.keys+PHRJBNITSHUYIVOPLEOA : miss 2024-03-04T12:50:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.948+0000 7f79bd531800 20 rados->read ofs=0 len=0 2024-03-04T12:50:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.949+0000 7f79bd531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:50:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.949+0000 7f79bd531800 10 cache put: name=default.rgw.meta+users.keys+PHRJBNITSHUYIVOPLEOA info.flags=0x0 2024-03-04T12:50:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.949+0000 7f79bd531800 10 adding default.rgw.meta+users.keys+PHRJBNITSHUYIVOPLEOA to cache LRU end 2024-03-04T12:50:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.949+0000 7f79bd531800 10 cache get: name=default.rgw.meta+users.keys+PHRJBNITSHUYIVOPLEOA : hit (negative entry) 2024-03-04T12:50:59.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.949+0000 7f79bd531800 10 cache get: name=default.rgw.meta+users.keys+PHRJBNITSHUYIVOPLEOA : hit (negative entry) 2024-03-04T12:50:59.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.950+0000 7f79bd531800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-04T12:50:59.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.950+0000 7f79bd531800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-04T12:50:59.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.950+0000 7f79bd531800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-03-04T12:50:59.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.950+0000 7f789cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824149 cookie 94786872898544 notifier 7205 bl.length()=641 2024-03-04T12:50:59.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.950+0000 7f789cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-04T12:50:59.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.950+0000 7f789cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-04T12:50:59.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.952+0000 7f79bd531800 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2024-03-04T12:50:59.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.952+0000 7f79bd531800 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2024-03-04T12:50:59.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.952+0000 7f79bd531800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.email:foo.client.0+test@test.test, ofs0, ns] 2024-03-04T12:50:59.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.952+0000 7f789cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824168 cookie 94786872920384 notifier 7205 bl.length()=194 2024-03-04T12:50:59.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.952+0000 7f789cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2024-03-04T12:50:59.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.952+0000 7f789cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2024-03-04T12:50:59.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.954+0000 7f79bd531800 10 cache put: name=default.rgw.meta+users.keys+PHRJBNITSHUYIVOPLEOA info.flags=0x7 2024-03-04T12:50:59.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.954+0000 7f79bd531800 10 moving default.rgw.meta+users.keys+PHRJBNITSHUYIVOPLEOA to cache LRU end 2024-03-04T12:50:59.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.954+0000 7f79bd531800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:PHRJBNITSHUYIVOPLEOA, ofs0, ns] 2024-03-04T12:50:59.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.954+0000 7f788bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824169 cookie 94786872916224 notifier 7205 bl.length()=186 2024-03-04T12:50:59.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.954+0000 7f788bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PHRJBNITSHUYIVOPLEOA info.flags=0x7 2024-03-04T12:50:59.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.954+0000 7f788bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PHRJBNITSHUYIVOPLEOA to cache LRU end 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: "user_id": "foo.client.0", 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: "display_name": "Mr. foo.client.0", 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: "email": "foo.client.0+test@test.test", 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: "suspended": 0, 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: "max_buckets": 1000, 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: "subusers": [], 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: "keys": [ 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: "user": "foo.client.0", 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: "access_key": "PHRJBNITSHUYIVOPLEOA", 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: "secret_key": "nG35tqvs8xYqf+xXnW/W60pUVV4g71RRolw0EISi3B2zga7jdqjj+Q==", 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: "active": true 2024-03-04T12:50:59.962 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: "swift_keys": [], 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": [ 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "user-policy", 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: "perm": "*" 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: "op_mask": "read, write, delete", 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: "default_placement": "", 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: "default_storage_class": "", 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: "placement_tags": [], 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: "bucket_quota": { 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:50:59.963 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: "user_quota": { 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: "temp_url_keys": [], 2024-03-04T12:50:59.964 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "rgw", 2024-03-04T12:50:59.965 INFO:teuthology.orchestra.run.smithi090.stdout: "mfa_ids": [] 2024-03-04T12:50:59.965 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T12:50:59.965 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:50:59.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.955+0000 7f786f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:50:59.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.957+0000 7f79bd531800 20 remove_watcher() i=0 2024-03-04T12:50:59.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.957+0000 7f79bd531800 2 removed watcher, disabling cache 2024-03-04T12:50:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.958+0000 7f79bd531800 20 remove_watcher() i=1 2024-03-04T12:50:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.959+0000 7f79bd531800 20 remove_watcher() i=2 2024-03-04T12:50:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.960+0000 7f79bd531800 20 remove_watcher() i=3 2024-03-04T12:50:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.961+0000 7f79bd531800 20 remove_watcher() i=4 2024-03-04T12:50:59.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.962+0000 7f79bd531800 20 remove_watcher() i=5 2024-03-04T12:50:59.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.963+0000 7f79bd531800 20 remove_watcher() i=6 2024-03-04T12:50:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:50:59.964+0000 7f79bd531800 20 remove_watcher() i=7 2024-03-04T12:50:59.981 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 3956721247 --totp-seed E2KWGMXZR5EPNDSRIPK7FO237WUFTRVFF6ZCVPWDPMQ6BKG7MCZTB2LLSN7KMLYC --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-04T12:51:00.044 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:51:00.044 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:51:00.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.066+0000 7f5a4e733800 20 rados->read ofs=0 len=0 2024-03-04T12:51:00.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.068+0000 7f5a4e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:00.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.068+0000 7f5a4e733800 20 realm 2024-03-04T12:51:00.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.068+0000 7f5a4e733800 20 rados->read ofs=0 len=0 2024-03-04T12:51:00.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.068+0000 7f5a4e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:00.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.068+0000 7f5a4e733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:51:00.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.068+0000 7f5a4e733800 20 rados->read ofs=0 len=0 2024-03-04T12:51:00.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.068+0000 7f5a4e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:00.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.068+0000 7f5a4e733800 20 rados->read ofs=0 len=0 2024-03-04T12:51:00.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.069+0000 7f5a4e733800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:00.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.069+0000 7f5a4e733800 20 rados->read ofs=0 len=0 2024-03-04T12:51:00.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.069+0000 7f5a4e733800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:51:00.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.069+0000 7f5a4e733800 20 searching for the correct realm 2024-03-04T12:51:00.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.072+0000 7f5a49bd2640 0 -- 172.21.15.90:0/1855017334 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f5a3402d690 msgr2=0x7f5a3402d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:00.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.075+0000 7f5a4a3d3640 0 -- 172.21.15.90:0/1855017334 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f5a34089040 msgr2=0x7f5a340608f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:00.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.281+0000 7f5a4e733800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:51:00.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.281+0000 7f5a4e733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:51:00.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.281+0000 7f5a4e733800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:51:00.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.281+0000 7f5a4e733800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:51:00.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.281+0000 7f5a4e733800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:51:00.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.281+0000 7f5a4e733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:51:00.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.281+0000 7f5a4e733800 20 rados->read ofs=0 len=0 2024-03-04T12:51:00.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.282+0000 7f5a4e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:00.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.282+0000 7f5a4e733800 20 rados->read ofs=0 len=0 2024-03-04T12:51:00.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.282+0000 7f5a4e733800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.282+0000 7f5a4e733800 20 rados->read ofs=0 len=0 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.282+0000 7f5a4e733800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.282+0000 7f5a4e733800 20 zone default found 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.282+0000 7f5a4e733800 4 Realm: () 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.282+0000 7f5a4e733800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.282+0000 7f5a4e733800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.282+0000 7f5a4e733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.282+0000 7f5a4e733800 20 zonegroup default 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.282+0000 7f5a4e733800 20 rados->read ofs=0 len=0 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.283+0000 7f5a4e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.283+0000 7f5a4e733800 20 rados->read ofs=0 len=0 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.283+0000 7f5a4e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.283+0000 7f5a4e733800 20 rados->read ofs=0 len=0 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.283+0000 7f5a4e733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:00.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.283+0000 7f5a4e733800 20 started sync module instance, tier type = 2024-03-04T12:51:00.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.283+0000 7f5a4e733800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:51:00.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.293+0000 7f5a4e733800 20 add_watcher() i=0 2024-03-04T12:51:00.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.293+0000 7f5a4e733800 20 add_watcher() i=1 2024-03-04T12:51:00.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.293+0000 7f5a4e733800 20 add_watcher() i=2 2024-03-04T12:51:00.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.293+0000 7f5a4e733800 20 add_watcher() i=3 2024-03-04T12:51:00.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.293+0000 7f5a4e733800 20 add_watcher() i=4 2024-03-04T12:51:00.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.293+0000 7f5a4e733800 20 add_watcher() i=5 2024-03-04T12:51:00.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.293+0000 7f5a4e733800 20 add_watcher() i=6 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.294+0000 7f5a4e733800 20 add_watcher() i=7 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.294+0000 7f5a4e733800 2 all 8 watchers are set, enabling cache 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.296+0000 7f5900fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.296+0000 7f5a4e733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.296+0000 7f5a4e733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.296+0000 7f5a4e733800 5 note: GC not initialized 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.296+0000 7f587b7fe640 20 reqs_thread_entry: start 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.296+0000 7f5a4e733800 20 init_complete bucket index max shards: 11 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.296+0000 7f5a4e733800 20 Filter name: none 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.296+0000 7f58797fa640 20 reqs_thread_entry: start 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.296+0000 7f5a4e733800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.296+0000 7f5a4e733800 20 rados->read ofs=0 len=0 2024-03-04T12:51:00.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.297+0000 7f5a4e733800 20 rados_obj.operate() r=0 bl.length=456 2024-03-04T12:51:00.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.297+0000 7f5a4e733800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-03-04T12:51:00.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.297+0000 7f5a4e733800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-04T12:51:00.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:00.297+0000 7f5a4e733800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:51:01.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.600+0000 7f5a4e733800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-04T12:51:01.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.600+0000 7f5a4e733800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-04T12:51:01.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.600+0000 7f5a4e733800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-03-04T12:51:01.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.600+0000 7f592d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758742 cookie 94325723594080 notifier 7220 bl.length()=655 2024-03-04T12:51:01.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.600+0000 7f592d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-04T12:51:01.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.600+0000 7f592d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-04T12:51:01.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.602+0000 7f5900fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:01.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.605+0000 7f5a4e733800 20 remove_watcher() i=0 2024-03-04T12:51:01.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.605+0000 7f5a4e733800 2 removed watcher, disabling cache 2024-03-04T12:51:01.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.606+0000 7f5a4e733800 20 remove_watcher() i=1 2024-03-04T12:51:01.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.607+0000 7f5a4e733800 20 remove_watcher() i=2 2024-03-04T12:51:01.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.609+0000 7f5a4e733800 20 remove_watcher() i=3 2024-03-04T12:51:01.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.610+0000 7f5a4e733800 20 remove_watcher() i=4 2024-03-04T12:51:01.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.612+0000 7f5a4e733800 20 remove_watcher() i=5 2024-03-04T12:51:01.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.613+0000 7f5a4e733800 20 remove_watcher() i=6 2024-03-04T12:51:01.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.614+0000 7f5a4e733800 20 remove_watcher() i=7 2024-03-04T12:51:01.632 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-03-04T12:51:01.633 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --email bar.client.0+test@test.test --caps 'user-policy=*' --access-key LYVWJEMCTZFKTZBTTTND --secret M7U/ajCcgBTse5GSCziIyhq3coJTCcKox1fLvZ9QpUQz63T65kiEVg== --cluster ceph 2024-03-04T12:51:01.699 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:51:01.699 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:51:01.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.725+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.726+0000 7f9fc6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.726+0000 7f9fc6f3b800 20 realm 2024-03-04T12:51:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.726+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.726+0000 7f9fc6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.726+0000 7f9fc6f3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:51:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.726+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.727+0000 7f9fc6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:01.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.727+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.728+0000 7f9fc6f3b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:01.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.728+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.728+0000 7f9fc6f3b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:51:01.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.728+0000 7f9fc6f3b800 20 searching for the correct realm 2024-03-04T12:51:01.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.731+0000 7f9fc2ccd640 0 -- 172.21.15.90:0/2732448412 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f9fbc076040 msgr2=0x7f9fbc076930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:01.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.735+0000 7f9fc2ccd640 0 -- 172.21.15.90:0/2732448412 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f9fb8058d70 msgr2=0x7f9fb805a670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:01.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.941+0000 7f9fc6f3b800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:51:01.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.941+0000 7f9fc6f3b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:51:01.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.941+0000 7f9fc6f3b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:51:01.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.941+0000 7f9fc6f3b800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:51:01.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.941+0000 7f9fc6f3b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:51:01.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.941+0000 7f9fc6f3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:51:01.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.941+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.942+0000 7f9fc6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:01.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.942+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.942+0000 7f9fc6f3b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.942+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.942+0000 7f9fc6f3b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.942+0000 7f9fc6f3b800 20 zone default found 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.942+0000 7f9fc6f3b800 4 Realm: () 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.942+0000 7f9fc6f3b800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.942+0000 7f9fc6f3b800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.942+0000 7f9fc6f3b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.942+0000 7f9fc6f3b800 20 zonegroup default 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.942+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.943+0000 7f9fc6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.943+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.943+0000 7f9fc6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:01.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.943+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.943+0000 7f9fc6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:01.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.943+0000 7f9fc6f3b800 20 started sync module instance, tier type = 2024-03-04T12:51:01.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.943+0000 7f9fc6f3b800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:51:01.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.952+0000 7f9fc6f3b800 20 add_watcher() i=0 2024-03-04T12:51:01.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.952+0000 7f9fc6f3b800 20 add_watcher() i=1 2024-03-04T12:51:01.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.952+0000 7f9fc6f3b800 20 add_watcher() i=2 2024-03-04T12:51:01.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.952+0000 7f9fc6f3b800 20 add_watcher() i=3 2024-03-04T12:51:01.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.952+0000 7f9fc6f3b800 20 add_watcher() i=4 2024-03-04T12:51:01.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.952+0000 7f9fc6f3b800 20 add_watcher() i=5 2024-03-04T12:51:01.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.952+0000 7f9fc6f3b800 20 add_watcher() i=6 2024-03-04T12:51:01.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.953+0000 7f9fc6f3b800 20 add_watcher() i=7 2024-03-04T12:51:01.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.953+0000 7f9fc6f3b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:51:01.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.955+0000 7f9e797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:01.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.955+0000 7f9fc6f3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:51:01.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.955+0000 7f9fc6f3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:51:01.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.956+0000 7f9fc6f3b800 5 note: GC not initialized 2024-03-04T12:51:01.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.956+0000 7f9df3fff640 20 reqs_thread_entry: start 2024-03-04T12:51:01.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.956+0000 7f9fc6f3b800 20 init_complete bucket index max shards: 11 2024-03-04T12:51:01.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.956+0000 7f9fc6f3b800 20 Filter name: none 2024-03-04T12:51:01.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.956+0000 7f9df1ffb640 20 reqs_thread_entry: start 2024-03-04T12:51:01.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.956+0000 7f9fc6f3b800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-03-04T12:51:01.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.956+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.956+0000 7f9fc6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:01.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.956+0000 7f9fc6f3b800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-03-04T12:51:01.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.956+0000 7f9fc6f3b800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-04T12:51:01.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.956+0000 7f9fc6f3b800 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2024-03-04T12:51:01.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.956+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.957+0000 7f9fc6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:01.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.957+0000 7f9fc6f3b800 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2024-03-04T12:51:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.957+0000 7f9fc6f3b800 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-03-04T12:51:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.957+0000 7f9fc6f3b800 10 cache get: name=default.rgw.meta+users.keys+LYVWJEMCTZFKTZBTTTND : miss 2024-03-04T12:51:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.957+0000 7f9fc6f3b800 20 rados->read ofs=0 len=0 2024-03-04T12:51:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.957+0000 7f9fc6f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.957+0000 7f9fc6f3b800 10 cache put: name=default.rgw.meta+users.keys+LYVWJEMCTZFKTZBTTTND info.flags=0x0 2024-03-04T12:51:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.957+0000 7f9fc6f3b800 10 adding default.rgw.meta+users.keys+LYVWJEMCTZFKTZBTTTND to cache LRU end 2024-03-04T12:51:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.957+0000 7f9fc6f3b800 10 cache get: name=default.rgw.meta+users.keys+LYVWJEMCTZFKTZBTTTND : hit (negative entry) 2024-03-04T12:51:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.957+0000 7f9fc6f3b800 10 cache get: name=default.rgw.meta+users.keys+LYVWJEMCTZFKTZBTTTND : hit (negative entry) 2024-03-04T12:51:01.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.959+0000 7f9fc6f3b800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-04T12:51:01.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.959+0000 7f9fc6f3b800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-04T12:51:01.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.959+0000 7f9fc6f3b800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-03-04T12:51:01.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.959+0000 7f9ea67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758765 cookie 94375274185856 notifier 7677 bl.length()=641 2024-03-04T12:51:01.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.959+0000 7f9ea67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-04T12:51:01.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.959+0000 7f9ea67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-04T12:51:01.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.961+0000 7f9fc6f3b800 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2024-03-04T12:51:01.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.961+0000 7f9fc6f3b800 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-03-04T12:51:01.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.961+0000 7f9fc6f3b800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:bar.client.0+test@test.test, ofs0, ns] 2024-03-04T12:51:01.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.961+0000 7f9ea67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758766 cookie 94375274185856 notifier 7677 bl.length()=194 2024-03-04T12:51:01.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.961+0000 7f9ea67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2024-03-04T12:51:01.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.961+0000 7f9ea67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-03-04T12:51:01.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.963+0000 7f9fc6f3b800 10 cache put: name=default.rgw.meta+users.keys+LYVWJEMCTZFKTZBTTTND info.flags=0x7 2024-03-04T12:51:01.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.963+0000 7f9fc6f3b800 10 moving default.rgw.meta+users.keys+LYVWJEMCTZFKTZBTTTND to cache LRU end 2024-03-04T12:51:01.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.963+0000 7f9fc6f3b800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:LYVWJEMCTZFKTZBTTTND, ofs0, ns] 2024-03-04T12:51:01.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.964+0000 7f9ea67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758688 cookie 94375274194320 notifier 7677 bl.length()=186 2024-03-04T12:51:01.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.964+0000 7f9ea67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LYVWJEMCTZFKTZBTTTND info.flags=0x7 2024-03-04T12:51:01.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.964+0000 7f9ea67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LYVWJEMCTZFKTZBTTTND to cache LRU end 2024-03-04T12:51:01.970 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: "user_id": "bar.client.0", 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: "display_name": "Mr. bar.client.0", 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: "email": "bar.client.0+test@test.test", 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: "suspended": 0, 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: "max_buckets": 1000, 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: "subusers": [], 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: "keys": [ 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: "user": "bar.client.0", 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: "access_key": "LYVWJEMCTZFKTZBTTTND", 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: "secret_key": "M7U/ajCcgBTse5GSCziIyhq3coJTCcKox1fLvZ9QpUQz63T65kiEVg==", 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: "active": true 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:51:01.971 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: "swift_keys": [], 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": [ 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "user-policy", 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: "perm": "*" 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: "op_mask": "read, write, delete", 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: "default_placement": "", 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: "default_storage_class": "", 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: "placement_tags": [], 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: "bucket_quota": { 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:51:01.972 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: "user_quota": { 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: "temp_url_keys": [], 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "rgw", 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: "mfa_ids": [] 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T12:51:01.973 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:51:01.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.965+0000 7f9e797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:01.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.967+0000 7f9fc6f3b800 20 remove_watcher() i=0 2024-03-04T12:51:01.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.967+0000 7f9fc6f3b800 2 removed watcher, disabling cache 2024-03-04T12:51:01.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.968+0000 7f9fc6f3b800 20 remove_watcher() i=1 2024-03-04T12:51:01.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.969+0000 7f9fc6f3b800 20 remove_watcher() i=2 2024-03-04T12:51:01.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.970+0000 7f9fc6f3b800 20 remove_watcher() i=3 2024-03-04T12:51:01.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.972+0000 7f9fc6f3b800 20 remove_watcher() i=4 2024-03-04T12:51:01.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.973+0000 7f9fc6f3b800 20 remove_watcher() i=5 2024-03-04T12:51:01.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.973+0000 7f9fc6f3b800 20 remove_watcher() i=6 2024-03-04T12:51:01.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:01.974+0000 7f9fc6f3b800 20 remove_watcher() i=7 2024-03-04T12:51:01.991 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 7332930638 --totp-seed PJK6VKTTCZM3ZURL2M3YJKTA5CMIKZPBL47WPRUYBSEMBDWPBUS66WYRFKD2BGEY --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-04T12:51:02.055 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:51:02.055 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:51:02.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.079+0000 7f025a509800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.080+0000 7f025a509800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.080+0000 7f025a509800 20 realm 2024-03-04T12:51:02.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.080+0000 7f025a509800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.080+0000 7f025a509800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.080+0000 7f025a509800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:51:02.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.080+0000 7f025a509800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.081+0000 7f025a509800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.081+0000 7f025a509800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.082+0000 7f025a509800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:02.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.082+0000 7f025a509800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.082+0000 7f025a509800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:51:02.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.082+0000 7f025a509800 20 searching for the correct realm 2024-03-04T12:51:02.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.085+0000 7f0258005640 0 -- 172.21.15.90:0/1975259479 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f0250033040 msgr2=0x7f0250014940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:02.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.089+0000 7f0258005640 0 -- 172.21.15.90:0/1975259479 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f024002b040 msgr2=0x7f024007da90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:02.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.295+0000 7f025a509800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:51:02.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.295+0000 7f025a509800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:51:02.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.295+0000 7f025a509800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:51:02.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.295+0000 7f025a509800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:51:02.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.295+0000 7f025a509800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:51:02.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.295+0000 7f025a509800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:51:02.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.295+0000 7f025a509800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.295+0000 7f025a509800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.295+0000 7f025a509800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.296+0000 7f025a509800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.296+0000 7f025a509800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.296+0000 7f025a509800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:51:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.296+0000 7f025a509800 20 zone default found 2024-03-04T12:51:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.296+0000 7f025a509800 4 Realm: () 2024-03-04T12:51:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.296+0000 7f025a509800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:51:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.296+0000 7f025a509800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:51:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.296+0000 7f025a509800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:51:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.296+0000 7f025a509800 20 zonegroup default 2024-03-04T12:51:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.296+0000 7f025a509800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.297+0000 7f025a509800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.297+0000 7f025a509800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.297+0000 7f025a509800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.297+0000 7f025a509800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.297+0000 7f025a509800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.297+0000 7f025a509800 20 started sync module instance, tier type = 2024-03-04T12:51:02.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.297+0000 7f025a509800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:51:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.307+0000 7f025a509800 20 add_watcher() i=0 2024-03-04T12:51:02.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.307+0000 7f025a509800 20 add_watcher() i=1 2024-03-04T12:51:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.307+0000 7f025a509800 20 add_watcher() i=2 2024-03-04T12:51:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.307+0000 7f025a509800 20 add_watcher() i=3 2024-03-04T12:51:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.307+0000 7f025a509800 20 add_watcher() i=4 2024-03-04T12:51:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.307+0000 7f025a509800 20 add_watcher() i=5 2024-03-04T12:51:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.307+0000 7f025a509800 20 add_watcher() i=6 2024-03-04T12:51:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.308+0000 7f025a509800 20 add_watcher() i=7 2024-03-04T12:51:02.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.308+0000 7f025a509800 2 all 8 watchers are set, enabling cache 2024-03-04T12:51:02.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.310+0000 7f010dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:02.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.310+0000 7f025a509800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:51:02.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.310+0000 7f025a509800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:51:02.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.310+0000 7f025a509800 5 note: GC not initialized 2024-03-04T12:51:02.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.310+0000 7f010cfe1640 20 reqs_thread_entry: start 2024-03-04T12:51:02.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.310+0000 7f025a509800 20 init_complete bucket index max shards: 11 2024-03-04T12:51:02.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.310+0000 7f025a509800 20 Filter name: none 2024-03-04T12:51:02.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.310+0000 7f00867fc640 20 reqs_thread_entry: start 2024-03-04T12:51:02.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.310+0000 7f025a509800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-03-04T12:51:02.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.310+0000 7f025a509800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.311+0000 7f025a509800 20 rados_obj.operate() r=0 bl.length=456 2024-03-04T12:51:02.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.311+0000 7f025a509800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-03-04T12:51:02.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.311+0000 7f025a509800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-04T12:51:02.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.311+0000 7f025a509800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:51:02.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.314+0000 7f025a509800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-04T12:51:02.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.314+0000 7f025a509800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-04T12:51:02.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.314+0000 7f025a509800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-03-04T12:51:02.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.315+0000 7f0136ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758767 cookie 94403771852240 notifier 7253 bl.length()=655 2024-03-04T12:51:02.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.315+0000 7f0136ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-04T12:51:02.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.315+0000 7f0136ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-04T12:51:02.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.316+0000 7f010dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:02.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.318+0000 7f025a509800 20 remove_watcher() i=0 2024-03-04T12:51:02.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.318+0000 7f025a509800 2 removed watcher, disabling cache 2024-03-04T12:51:02.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.319+0000 7f025a509800 20 remove_watcher() i=1 2024-03-04T12:51:02.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.320+0000 7f025a509800 20 remove_watcher() i=2 2024-03-04T12:51:02.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.321+0000 7f025a509800 20 remove_watcher() i=3 2024-03-04T12:51:02.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.322+0000 7f025a509800 20 remove_watcher() i=4 2024-03-04T12:51:02.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.323+0000 7f025a509800 20 remove_watcher() i=5 2024-03-04T12:51:02.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.324+0000 7f025a509800 20 remove_watcher() i=6 2024-03-04T12:51:02.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.325+0000 7f025a509800 20 remove_watcher() i=7 2024-03-04T12:51:02.344 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-03-04T12:51:02.344 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --email 'testx$tenanteduser.client.0+test@test.test' --caps 'user-policy=*' --access-key EAQRQPLXDTCVWMWFWZMC --secret I/IVxWCavACHRrE4nB/X51b37guby0ufDaBtIDrRHeVAFAs9GhN+lw== --cluster ceph 2024-03-04T12:51:02.411 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:51:02.411 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:51:02.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.441+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.442+0000 7fab7bf2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.442+0000 7fab7bf2d800 20 realm 2024-03-04T12:51:02.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.442+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.442+0000 7fab7bf2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.442+0000 7fab7bf2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:51:02.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.442+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.442+0000 7fab7bf2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.442+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.443+0000 7fab7bf2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:02.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.443+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.444+0000 7fab7bf2d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:51:02.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.444+0000 7fab7bf2d800 20 searching for the correct realm 2024-03-04T12:51:02.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.454+0000 7fab773af640 0 -- 172.21.15.90:0/1338966490 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fab6c061b00 msgr2=0x7fab6c0587f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:02.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.660+0000 7fab77bb0640 0 -- 172.21.15.90:0/1338966490 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fab6c0710c0 msgr2=0x7fab6c06d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:02.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.866+0000 7fab7bf2d800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:51:02.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.867+0000 7fab7bf2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:51:02.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.867+0000 7fab7bf2d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:51:02.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.867+0000 7fab7bf2d800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:51:02.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.867+0000 7fab7bf2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:51:02.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.867+0000 7fab7bf2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:51:02.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.867+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.867+0000 7fab7bf2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.867+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.867+0000 7fab7bf2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:02.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.867+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.868+0000 7fab7bf2d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:51:02.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.868+0000 7fab7bf2d800 20 zone default found 2024-03-04T12:51:02.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.868+0000 7fab7bf2d800 4 Realm: () 2024-03-04T12:51:02.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.868+0000 7fab7bf2d800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:51:02.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.868+0000 7fab7bf2d800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:51:02.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.868+0000 7fab7bf2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:51:02.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.868+0000 7fab7bf2d800 20 zonegroup default 2024-03-04T12:51:02.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.868+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.868+0000 7fab7bf2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.868+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.868+0000 7fab7bf2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.868+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.869+0000 7fab7bf2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.869+0000 7fab7bf2d800 20 started sync module instance, tier type = 2024-03-04T12:51:02.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.869+0000 7fab7bf2d800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:51:02.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.878+0000 7fab7bf2d800 20 add_watcher() i=0 2024-03-04T12:51:02.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.878+0000 7fab7bf2d800 20 add_watcher() i=1 2024-03-04T12:51:02.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.878+0000 7fab7bf2d800 20 add_watcher() i=2 2024-03-04T12:51:02.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.878+0000 7fab7bf2d800 20 add_watcher() i=3 2024-03-04T12:51:02.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.878+0000 7fab7bf2d800 20 add_watcher() i=4 2024-03-04T12:51:02.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.878+0000 7fab7bf2d800 20 add_watcher() i=5 2024-03-04T12:51:02.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.878+0000 7fab7bf2d800 20 add_watcher() i=6 2024-03-04T12:51:02.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.879+0000 7fab7bf2d800 20 add_watcher() i=7 2024-03-04T12:51:02.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.879+0000 7fab7bf2d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:51:02.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.881+0000 7faa2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:02.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.881+0000 7fab7bf2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:51:02.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.881+0000 7fab7bf2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:51:02.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.881+0000 7fab7bf2d800 5 note: GC not initialized 2024-03-04T12:51:02.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7faa2cfe1640 20 reqs_thread_entry: start 2024-03-04T12:51:02.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 20 init_complete bucket index max shards: 11 2024-03-04T12:51:02.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 20 Filter name: none 2024-03-04T12:51:02.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fa9a67fc640 20 reqs_thread_entry: start 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 10 cache get: name=default.rgw.meta+users.keys+EAQRQPLXDTCVWMWFWZMC : miss 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.882+0000 7fab7bf2d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.883+0000 7fab7bf2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.883+0000 7fab7bf2d800 10 cache put: name=default.rgw.meta+users.keys+EAQRQPLXDTCVWMWFWZMC info.flags=0x0 2024-03-04T12:51:02.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.883+0000 7fab7bf2d800 10 adding default.rgw.meta+users.keys+EAQRQPLXDTCVWMWFWZMC to cache LRU end 2024-03-04T12:51:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.883+0000 7fab7bf2d800 10 cache get: name=default.rgw.meta+users.keys+EAQRQPLXDTCVWMWFWZMC : hit (negative entry) 2024-03-04T12:51:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.883+0000 7fab7bf2d800 10 cache get: name=default.rgw.meta+users.keys+EAQRQPLXDTCVWMWFWZMC : hit (negative entry) 2024-03-04T12:51:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.884+0000 7fab7bf2d800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-04T12:51:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.884+0000 7fab7bf2d800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-04T12:51:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.884+0000 7fab7bf2d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-03-04T12:51:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.884+0000 7faa56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726058 cookie 94366847233264 notifier 7268 bl.length()=715 2024-03-04T12:51:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.884+0000 7faa56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-04T12:51:02.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.884+0000 7faa56ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-04T12:51:02.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.887+0000 7fab7bf2d800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2024-03-04T12:51:02.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.887+0000 7fab7bf2d800 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2024-03-04T12:51:02.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.887+0000 7fab7bf2d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test, ofs0, ns] 2024-03-04T12:51:02.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.887+0000 7faa56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725959 cookie 94366847228272 notifier 7268 bl.length()=224 2024-03-04T12:51:02.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.887+0000 7faa56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2024-03-04T12:51:02.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.887+0000 7faa56ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2024-03-04T12:51:02.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.888+0000 7fab7bf2d800 10 cache put: name=default.rgw.meta+users.keys+EAQRQPLXDTCVWMWFWZMC info.flags=0x7 2024-03-04T12:51:02.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.888+0000 7fab7bf2d800 10 moving default.rgw.meta+users.keys+EAQRQPLXDTCVWMWFWZMC to cache LRU end 2024-03-04T12:51:02.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.888+0000 7fab7bf2d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:EAQRQPLXDTCVWMWFWZMC, ofs0, ns] 2024-03-04T12:51:02.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.889+0000 7faa567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726039 cookie 94366847229840 notifier 7268 bl.length()=201 2024-03-04T12:51:02.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.889+0000 7faa567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EAQRQPLXDTCVWMWFWZMC info.flags=0x7 2024-03-04T12:51:02.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.889+0000 7faa567fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EAQRQPLXDTCVWMWFWZMC to cache LRU end 2024-03-04T12:51:02.895 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T12:51:02.896 INFO:teuthology.orchestra.run.smithi090.stdout: "user_id": "testx$tenanteduser.client.0", 2024-03-04T12:51:02.896 INFO:teuthology.orchestra.run.smithi090.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2024-03-04T12:51:02.896 INFO:teuthology.orchestra.run.smithi090.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2024-03-04T12:51:02.896 INFO:teuthology.orchestra.run.smithi090.stdout: "suspended": 0, 2024-03-04T12:51:02.896 INFO:teuthology.orchestra.run.smithi090.stdout: "max_buckets": 1000, 2024-03-04T12:51:02.896 INFO:teuthology.orchestra.run.smithi090.stdout: "subusers": [], 2024-03-04T12:51:02.896 INFO:teuthology.orchestra.run.smithi090.stdout: "keys": [ 2024-03-04T12:51:02.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:02.896 INFO:teuthology.orchestra.run.smithi090.stdout: "user": "testx$tenanteduser.client.0", 2024-03-04T12:51:02.896 INFO:teuthology.orchestra.run.smithi090.stdout: "access_key": "EAQRQPLXDTCVWMWFWZMC", 2024-03-04T12:51:02.896 INFO:teuthology.orchestra.run.smithi090.stdout: "secret_key": "I/IVxWCavACHRrE4nB/X51b37guby0ufDaBtIDrRHeVAFAs9GhN+lw==", 2024-03-04T12:51:02.896 INFO:teuthology.orchestra.run.smithi090.stdout: "active": true 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: "swift_keys": [], 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": [ 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "user-policy", 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: "perm": "*" 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: "op_mask": "read, write, delete", 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: "default_placement": "", 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: "default_storage_class": "", 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: "placement_tags": [], 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: "bucket_quota": { 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:51:02.897 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: "user_quota": { 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: "temp_url_keys": [], 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "rgw", 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: "mfa_ids": [] 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T12:51:02.898 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:51:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.890+0000 7faa2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.892+0000 7fab7bf2d800 20 remove_watcher() i=0 2024-03-04T12:51:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.892+0000 7fab7bf2d800 2 removed watcher, disabling cache 2024-03-04T12:51:02.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.893+0000 7fab7bf2d800 20 remove_watcher() i=1 2024-03-04T12:51:02.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.895+0000 7fab7bf2d800 20 remove_watcher() i=2 2024-03-04T12:51:02.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.896+0000 7fab7bf2d800 20 remove_watcher() i=3 2024-03-04T12:51:02.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.897+0000 7fab7bf2d800 20 remove_watcher() i=4 2024-03-04T12:51:02.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.898+0000 7fab7bf2d800 20 remove_watcher() i=5 2024-03-04T12:51:02.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.898+0000 7fab7bf2d800 20 remove_watcher() i=6 2024-03-04T12:51:02.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:02.899+0000 7fab7bf2d800 20 remove_watcher() i=7 2024-03-04T12:51:02.916 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 9320116252 --totp-seed UUA2FIESPZY5MFSXHTCLPGHE4N3PSQBGEC632CMY3LEXJKQCSGQV5BWDOXL7JBT6 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-04T12:51:02.978 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:51:02.978 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:51:03.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.002+0000 7fb957f28800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.003+0000 7fb957f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.003+0000 7fb957f28800 20 realm 2024-03-04T12:51:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.003+0000 7fb957f28800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.003+0000 7fb957f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.003+0000 7fb957f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:51:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.003+0000 7fb957f28800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.003+0000 7fb957f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.003+0000 7fb957f28800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.004+0000 7fb957f28800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:03.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.004+0000 7fb957f28800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.005+0000 7fb957f28800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:51:03.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.005+0000 7fb957f28800 20 searching for the correct realm 2024-03-04T12:51:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.008+0000 7fb95442b640 0 -- 172.21.15.90:0/3223497721 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x55dda76d51a0 msgr2=0x55dda76d7660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:03.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.011+0000 7fb953c2a640 0 -- 172.21.15.90:0/3223497721 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fb93c0ccb90 msgr2=0x7fb93c050a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:51:03.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.016+0000 7fb957f28800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:51:03.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.016+0000 7fb957f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:51:03.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.016+0000 7fb957f28800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:51:03.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.016+0000 7fb957f28800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:51:03.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.016+0000 7fb957f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:51:03.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.016+0000 7fb957f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:51:03.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.016+0000 7fb957f28800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.016+0000 7fb957f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.016+0000 7fb957f28800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:03.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:51:03.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 20 zone default found 2024-03-04T12:51:03.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 4 Realm: () 2024-03-04T12:51:03.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:51:03.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:51:03.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:51:03.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 20 zonegroup default 2024-03-04T12:51:03.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.017+0000 7fb957f28800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.018+0000 7fb957f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.018+0000 7fb957f28800 20 started sync module instance, tier type = 2024-03-04T12:51:03.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.018+0000 7fb957f28800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:51:03.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.027+0000 7fb957f28800 20 add_watcher() i=0 2024-03-04T12:51:03.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.027+0000 7fb957f28800 20 add_watcher() i=1 2024-03-04T12:51:03.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.027+0000 7fb957f28800 20 add_watcher() i=2 2024-03-04T12:51:03.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.027+0000 7fb957f28800 20 add_watcher() i=3 2024-03-04T12:51:03.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.027+0000 7fb957f28800 20 add_watcher() i=4 2024-03-04T12:51:03.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.027+0000 7fb957f28800 20 add_watcher() i=5 2024-03-04T12:51:03.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.027+0000 7fb957f28800 20 add_watcher() i=6 2024-03-04T12:51:03.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.027+0000 7fb957f28800 20 add_watcher() i=7 2024-03-04T12:51:03.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.027+0000 7fb957f28800 2 all 8 watchers are set, enabling cache 2024-03-04T12:51:03.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.029+0000 7fb809fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:03.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.029+0000 7fb957f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:51:03.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.029+0000 7fb957f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:51:03.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.029+0000 7fb957f28800 5 note: GC not initialized 2024-03-04T12:51:03.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.029+0000 7fb808fe1640 20 reqs_thread_entry: start 2024-03-04T12:51:03.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.029+0000 7fb957f28800 20 init_complete bucket index max shards: 11 2024-03-04T12:51:03.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.030+0000 7fb957f28800 20 Filter name: none 2024-03-04T12:51:03.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.030+0000 7fb7827fc640 20 reqs_thread_entry: start 2024-03-04T12:51:03.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.030+0000 7fb957f28800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-03-04T12:51:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.030+0000 7fb957f28800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.030+0000 7fb957f28800 20 rados_obj.operate() r=0 bl.length=515 2024-03-04T12:51:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.030+0000 7fb957f28800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-03-04T12:51:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.030+0000 7fb957f28800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-04T12:51:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.030+0000 7fb957f28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:51:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.033+0000 7fb957f28800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-04T12:51:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.033+0000 7fb957f28800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-04T12:51:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.033+0000 7fb957f28800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-03-04T12:51:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.033+0000 7fb832ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726059 cookie 94410485116896 notifier 7740 bl.length()=729 2024-03-04T12:51:03.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.033+0000 7fb832ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-04T12:51:03.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.033+0000 7fb832ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-04T12:51:03.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.034+0000 7fb809fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:03.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.037+0000 7fb957f28800 20 remove_watcher() i=0 2024-03-04T12:51:03.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.037+0000 7fb957f28800 2 removed watcher, disabling cache 2024-03-04T12:51:03.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.038+0000 7fb957f28800 20 remove_watcher() i=1 2024-03-04T12:51:03.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.039+0000 7fb957f28800 20 remove_watcher() i=2 2024-03-04T12:51:03.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.040+0000 7fb957f28800 20 remove_watcher() i=3 2024-03-04T12:51:03.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.041+0000 7fb957f28800 20 remove_watcher() i=4 2024-03-04T12:51:03.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.042+0000 7fb957f28800 20 remove_watcher() i=5 2024-03-04T12:51:03.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.043+0000 7fb957f28800 20 remove_watcher() i=6 2024-03-04T12:51:03.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.044+0000 7fb957f28800 20 remove_watcher() i=7 2024-03-04T12:51:03.060 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-03-04T12:51:03.060 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name 'Mr. foobar.client.0' --email foobar.client.0+test@test.test --caps 'user-policy=*' --access-key CRBRRATKXYAFNZARHTYJ --secret NoR02PRFgB+IGyxQGHJeDivPqjhMU2SB4EE5ontNXi1zS9//wigqgA== --cluster ceph 2024-03-04T12:51:03.124 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:51:03.124 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:51:03.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.147+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.148+0000 7f6974531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.148+0000 7f6974531800 20 realm 2024-03-04T12:51:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.148+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.148+0000 7f6974531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.148+0000 7f6974531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:51:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.148+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.148+0000 7f6974531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.148+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.149+0000 7f6974531800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:03.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.149+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.150+0000 7f6974531800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:51:03.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.150+0000 7f6974531800 20 searching for the correct realm 2024-03-04T12:51:03.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.152+0000 7f6967a30640 0 -- 172.21.15.90:0/2151544125 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f695801f040 msgr2=0x7f6958020430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:03.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.157+0000 7f6970231640 0 -- 172.21.15.90:0/2151544125 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f6958030930 msgr2=0x7f695801d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:03.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.379+0000 7f6974531800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:51:03.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.379+0000 7f6974531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:51:03.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.379+0000 7f6974531800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:51:03.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.379+0000 7f6974531800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:51:03.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.379+0000 7f6974531800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:51:03.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.379+0000 7f6974531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.379+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.379+0000 7f6974531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.379+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.379+0000 7f6974531800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.379+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 20 zone default found 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 4 Realm: () 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 20 zonegroup default 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 20 started sync module instance, tier type = 2024-03-04T12:51:03.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.380+0000 7f6974531800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:51:03.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.390+0000 7f6974531800 20 add_watcher() i=0 2024-03-04T12:51:03.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.390+0000 7f6974531800 20 add_watcher() i=1 2024-03-04T12:51:03.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.390+0000 7f6974531800 20 add_watcher() i=2 2024-03-04T12:51:03.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.390+0000 7f6974531800 20 add_watcher() i=3 2024-03-04T12:51:03.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.390+0000 7f6974531800 20 add_watcher() i=4 2024-03-04T12:51:03.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.390+0000 7f6974531800 20 add_watcher() i=5 2024-03-04T12:51:03.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.390+0000 7f6974531800 20 add_watcher() i=6 2024-03-04T12:51:03.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.391+0000 7f6974531800 20 add_watcher() i=7 2024-03-04T12:51:03.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.391+0000 7f6974531800 2 all 8 watchers are set, enabling cache 2024-03-04T12:51:03.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.393+0000 7f6826fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:03.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.393+0000 7f6974531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:51:03.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.393+0000 7f6974531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:51:03.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.393+0000 7f6974531800 5 note: GC not initialized 2024-03-04T12:51:03.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.393+0000 7f6825fdb640 20 reqs_thread_entry: start 2024-03-04T12:51:03.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.393+0000 7f6974531800 20 init_complete bucket index max shards: 11 2024-03-04T12:51:03.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.393+0000 7f6974531800 20 Filter name: none 2024-03-04T12:51:03.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.393+0000 7f67977fe640 20 reqs_thread_entry: start 2024-03-04T12:51:03.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.393+0000 7f6974531800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-04T12:51:03.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.393+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 10 cache get: name=default.rgw.meta+users.email+foobar.client.0+test@test.test : miss 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x0 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 10 adding default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 10 cache get: name=default.rgw.meta+users.keys+CRBRRATKXYAFNZARHTYJ : miss 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 10 cache put: name=default.rgw.meta+users.keys+CRBRRATKXYAFNZARHTYJ info.flags=0x0 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 10 adding default.rgw.meta+users.keys+CRBRRATKXYAFNZARHTYJ to cache LRU end 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 10 cache get: name=default.rgw.meta+users.keys+CRBRRATKXYAFNZARHTYJ : hit (negative entry) 2024-03-04T12:51:03.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.394+0000 7f6974531800 10 cache get: name=default.rgw.meta+users.keys+CRBRRATKXYAFNZARHTYJ : hit (negative entry) 2024-03-04T12:51:03.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.395+0000 7f6974531800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:51:03.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.395+0000 7f6974531800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:51:03.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.395+0000 7f6974531800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-04T12:51:03.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.396+0000 7f68477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693256 cookie 94226584105056 notifier 7298 bl.length()=656 2024-03-04T12:51:03.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.396+0000 7f68477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:51:03.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.396+0000 7f68477fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:51:03.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.398+0000 7f6974531800 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2024-03-04T12:51:03.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.398+0000 7f6974531800 10 moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2024-03-04T12:51:03.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.398+0000 7f6974531800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:foobar.client.0+test@test.test, ofs0, ns] 2024-03-04T12:51:03.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.398+0000 7f68477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693356 cookie 94226584100208 notifier 7298 bl.length()=200 2024-03-04T12:51:03.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.398+0000 7f68477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2024-03-04T12:51:03.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.398+0000 7f68477fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2024-03-04T12:51:03.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.399+0000 7f6974531800 10 cache put: name=default.rgw.meta+users.keys+CRBRRATKXYAFNZARHTYJ info.flags=0x7 2024-03-04T12:51:03.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.399+0000 7f6974531800 10 moving default.rgw.meta+users.keys+CRBRRATKXYAFNZARHTYJ to cache LRU end 2024-03-04T12:51:03.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.399+0000 7f6974531800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:CRBRRATKXYAFNZARHTYJ, ofs0, ns] 2024-03-04T12:51:03.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.400+0000 7f6846ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693281 cookie 94226584084128 notifier 7298 bl.length()=189 2024-03-04T12:51:03.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.400+0000 7f6846ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CRBRRATKXYAFNZARHTYJ info.flags=0x7 2024-03-04T12:51:03.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.400+0000 7f6846ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CRBRRATKXYAFNZARHTYJ to cache LRU end 2024-03-04T12:51:03.406 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T12:51:03.406 INFO:teuthology.orchestra.run.smithi090.stdout: "user_id": "foobar.client.0", 2024-03-04T12:51:03.406 INFO:teuthology.orchestra.run.smithi090.stdout: "display_name": "Mr. foobar.client.0", 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: "email": "foobar.client.0+test@test.test", 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: "suspended": 0, 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: "max_buckets": 1000, 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: "subusers": [], 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: "keys": [ 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: "user": "foobar.client.0", 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: "access_key": "CRBRRATKXYAFNZARHTYJ", 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: "secret_key": "NoR02PRFgB+IGyxQGHJeDivPqjhMU2SB4EE5ontNXi1zS9//wigqgA==", 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: "active": true 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: "swift_keys": [], 2024-03-04T12:51:03.407 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": [ 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "user-policy", 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: "perm": "*" 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: "op_mask": "read, write, delete", 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: "default_placement": "", 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: "default_storage_class": "", 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: "placement_tags": [], 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: "bucket_quota": { 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:51:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: "user_quota": { 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: "temp_url_keys": [], 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "rgw", 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: "mfa_ids": [] 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T12:51:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:51:03.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.401+0000 7f6826fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:03.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.403+0000 7f6974531800 20 remove_watcher() i=0 2024-03-04T12:51:03.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.403+0000 7f6974531800 2 removed watcher, disabling cache 2024-03-04T12:51:03.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.404+0000 7f6974531800 20 remove_watcher() i=1 2024-03-04T12:51:03.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.405+0000 7f6974531800 20 remove_watcher() i=2 2024-03-04T12:51:03.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.406+0000 7f6974531800 20 remove_watcher() i=3 2024-03-04T12:51:03.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.407+0000 7f6974531800 20 remove_watcher() i=4 2024-03-04T12:51:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.408+0000 7f6974531800 20 remove_watcher() i=5 2024-03-04T12:51:03.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.408+0000 7f6974531800 20 remove_watcher() i=6 2024-03-04T12:51:03.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.409+0000 7f6974531800 20 remove_watcher() i=7 2024-03-04T12:51:03.425 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 2416989945 --totp-seed 3PZ6JJPXS6SLVMFR242SOQFWWB4CS5V2WZDXNFODQNH2HAZ63FVZ5FJ63RELT7WL --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-04T12:51:03.488 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:51:03.489 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:51:03.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.715+0000 7fed2202d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.716+0000 7fed2202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.716+0000 7fed2202d800 20 realm 2024-03-04T12:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.716+0000 7fed2202d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.716+0000 7fed2202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.716+0000 7fed2202d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:51:03.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.716+0000 7fed2202d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.716+0000 7fed2202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:03.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.716+0000 7fed2202d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.717+0000 7fed2202d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:03.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.717+0000 7fed2202d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:03.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.718+0000 7fed2202d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:51:03.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.718+0000 7fed2202d800 20 searching for the correct realm 2024-03-04T12:51:03.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.720+0000 7fed1cad8640 0 -- 172.21.15.90:0/657462651 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7fed1406c040 msgr2=0x7fed140167b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:03.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:03.927+0000 7fed1d2d9640 0 -- 172.21.15.90:0/657462651 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7fed14076650 msgr2=0x7fed1406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:04.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.134+0000 7fed2202d800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:51:04.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.134+0000 7fed2202d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:51:04.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.134+0000 7fed2202d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:51:04.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.134+0000 7fed2202d800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:51:04.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.134+0000 7fed2202d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:51:04.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.134+0000 7fed2202d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:51:04.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.134+0000 7fed2202d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.134+0000 7fed2202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.134+0000 7fed2202d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.135+0000 7fed2202d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.135+0000 7fed2202d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.135+0000 7fed2202d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:51:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.135+0000 7fed2202d800 20 zone default found 2024-03-04T12:51:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.135+0000 7fed2202d800 4 Realm: () 2024-03-04T12:51:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.135+0000 7fed2202d800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:51:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.135+0000 7fed2202d800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:51:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.135+0000 7fed2202d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:51:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.135+0000 7fed2202d800 20 zonegroup default 2024-03-04T12:51:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.135+0000 7fed2202d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.135+0000 7fed2202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.135+0000 7fed2202d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.136+0000 7fed2202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.136+0000 7fed2202d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.136+0000 7fed2202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.136+0000 7fed2202d800 20 started sync module instance, tier type = 2024-03-04T12:51:04.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.136+0000 7fed2202d800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:51:04.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.147+0000 7fed2202d800 20 add_watcher() i=0 2024-03-04T12:51:04.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.147+0000 7fed2202d800 20 add_watcher() i=1 2024-03-04T12:51:04.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.147+0000 7fed2202d800 20 add_watcher() i=2 2024-03-04T12:51:04.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.147+0000 7fed2202d800 20 add_watcher() i=3 2024-03-04T12:51:04.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.147+0000 7fed2202d800 20 add_watcher() i=4 2024-03-04T12:51:04.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.147+0000 7fed2202d800 20 add_watcher() i=5 2024-03-04T12:51:04.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.147+0000 7fed2202d800 20 add_watcher() i=6 2024-03-04T12:51:04.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.148+0000 7fed2202d800 20 add_watcher() i=7 2024-03-04T12:51:04.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.148+0000 7fed2202d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:51:04.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.150+0000 7febd3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:04.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.150+0000 7fed2202d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:51:04.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.150+0000 7fed2202d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:51:04.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.150+0000 7fed2202d800 5 note: GC not initialized 2024-03-04T12:51:04.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.150+0000 7febd2fe5640 20 reqs_thread_entry: start 2024-03-04T12:51:04.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.150+0000 7fed2202d800 20 init_complete bucket index max shards: 11 2024-03-04T12:51:04.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.150+0000 7fed2202d800 20 Filter name: none 2024-03-04T12:51:04.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.150+0000 7febd0fe1640 20 reqs_thread_entry: start 2024-03-04T12:51:04.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.151+0000 7fed2202d800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-04T12:51:04.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.151+0000 7fed2202d800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.151+0000 7fed2202d800 20 rados_obj.operate() r=0 bl.length=468 2024-03-04T12:51:04.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.151+0000 7fed2202d800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-03-04T12:51:04.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.151+0000 7fed2202d800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:51:04.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.151+0000 7fed2202d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:51:04.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.154+0000 7fed2202d800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:51:04.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.154+0000 7fed2202d800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:51:04.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.154+0000 7fed2202d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-04T12:51:04.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.154+0000 7fec00ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693257 cookie 94608841365536 notifier 7779 bl.length()=670 2024-03-04T12:51:04.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.154+0000 7fec00ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:51:04.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.154+0000 7fec00ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:51:04.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.155+0000 7febd3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:04.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.158+0000 7fed2202d800 20 remove_watcher() i=0 2024-03-04T12:51:04.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.158+0000 7fed2202d800 2 removed watcher, disabling cache 2024-03-04T12:51:04.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.159+0000 7fed2202d800 20 remove_watcher() i=1 2024-03-04T12:51:04.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.160+0000 7fed2202d800 20 remove_watcher() i=2 2024-03-04T12:51:04.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.161+0000 7fed2202d800 20 remove_watcher() i=3 2024-03-04T12:51:04.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.162+0000 7fed2202d800 20 remove_watcher() i=4 2024-03-04T12:51:04.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.164+0000 7fed2202d800 20 remove_watcher() i=5 2024-03-04T12:51:04.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.165+0000 7fed2202d800 20 remove_watcher() i=6 2024-03-04T12:51:04.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.166+0000 7fed2202d800 20 remove_watcher() i=7 2024-03-04T12:51:04.183 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'roles=*' --cluster ceph 2024-03-04T12:51:04.239 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:51:04.239 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:51:04.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.262+0000 7f2888c36800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.263+0000 7f2888c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.263+0000 7f2888c36800 20 realm 2024-03-04T12:51:04.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.263+0000 7f2888c36800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.264+0000 7f2888c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.264+0000 7f2888c36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:51:04.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.264+0000 7f2888c36800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.264+0000 7f2888c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.264+0000 7f2888c36800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.265+0000 7f2888c36800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:04.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.265+0000 7f2888c36800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.265+0000 7f2888c36800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:51:04.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.265+0000 7f2888c36800 20 searching for the correct realm 2024-03-04T12:51:04.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.268+0000 7f28846da640 0 -- 172.21.15.90:0/2738677973 >> [v2:172.21.15.90:6816/543891292,v1:172.21.15.90:6818/543891292] conn(0x5634a6c68370 msgr2=0x5634a6c6a760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:04.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.272+0000 7f2883ed9640 0 -- 172.21.15.90:0/2738677973 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f286c021920 msgr2=0x7f286c01e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:04.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.276+0000 7f2888c36800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:51:04.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.276+0000 7f2888c36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:51:04.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.276+0000 7f2888c36800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.276+0000 7f2888c36800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.276+0000 7f2888c36800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.276+0000 7f2888c36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.276+0000 7f2888c36800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.276+0000 7f2888c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.276+0000 7f2888c36800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 20 zone default found 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 4 Realm: () 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:51:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 20 zonegroup default 2024-03-04T12:51:04.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.277+0000 7f2888c36800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.278+0000 7f2888c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.278+0000 7f2888c36800 20 started sync module instance, tier type = 2024-03-04T12:51:04.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.278+0000 7f2888c36800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:51:04.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.286+0000 7f2888c36800 20 add_watcher() i=0 2024-03-04T12:51:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.286+0000 7f2888c36800 20 add_watcher() i=1 2024-03-04T12:51:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.286+0000 7f2888c36800 20 add_watcher() i=2 2024-03-04T12:51:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.286+0000 7f2888c36800 20 add_watcher() i=3 2024-03-04T12:51:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.286+0000 7f2888c36800 20 add_watcher() i=4 2024-03-04T12:51:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.286+0000 7f2888c36800 20 add_watcher() i=5 2024-03-04T12:51:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.286+0000 7f2888c36800 20 add_watcher() i=6 2024-03-04T12:51:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.287+0000 7f2888c36800 20 add_watcher() i=7 2024-03-04T12:51:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.287+0000 7f2888c36800 2 all 8 watchers are set, enabling cache 2024-03-04T12:51:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.289+0000 7f2739fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.289+0000 7f2888c36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:51:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.289+0000 7f2888c36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:51:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.289+0000 7f2888c36800 5 note: GC not initialized 2024-03-04T12:51:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.289+0000 7f2738fe1640 20 reqs_thread_entry: start 2024-03-04T12:51:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.289+0000 7f2888c36800 20 init_complete bucket index max shards: 11 2024-03-04T12:51:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.289+0000 7f2888c36800 20 Filter name: none 2024-03-04T12:51:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.289+0000 7f26b27fc640 20 reqs_thread_entry: start 2024-03-04T12:51:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.290+0000 7f2888c36800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-04T12:51:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.290+0000 7f2888c36800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.290+0000 7f2888c36800 20 rados_obj.operate() r=0 bl.length=482 2024-03-04T12:51:04.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.290+0000 7f2888c36800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-03-04T12:51:04.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.290+0000 7f2888c36800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:51:04.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.290+0000 7f2888c36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:51:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.291+0000 7f2888c36800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:51:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.291+0000 7f2888c36800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:51:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.291+0000 7f2888c36800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-04T12:51:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.291+0000 7f2762ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693258 cookie 94784136329840 notifier 7334 bl.length()=683 2024-03-04T12:51:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.291+0000 7f2762ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:51:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.291+0000 7f2762ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:51:04.298 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T12:51:04.298 INFO:teuthology.orchestra.run.smithi090.stdout: "user_id": "foobar.client.0", 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: "display_name": "Mr. foobar.client.0", 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: "email": "foobar.client.0+test@test.test", 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: "suspended": 0, 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: "max_buckets": 1000, 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: "subusers": [], 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: "keys": [ 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: "user": "foobar.client.0", 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: "access_key": "CRBRRATKXYAFNZARHTYJ", 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: "secret_key": "NoR02PRFgB+IGyxQGHJeDivPqjhMU2SB4EE5ontNXi1zS9//wigqgA==", 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: "active": true 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: "swift_keys": [], 2024-03-04T12:51:04.299 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": [ 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "roles", 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: "perm": "*" 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "user-policy", 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: "perm": "*" 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: "op_mask": "read, write, delete", 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: "default_placement": "", 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: "default_storage_class": "", 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: "placement_tags": [], 2024-03-04T12:51:04.300 INFO:teuthology.orchestra.run.smithi090.stdout: "bucket_quota": { 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "user_quota": { 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "temp_url_keys": [], 2024-03-04T12:51:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "rgw", 2024-03-04T12:51:04.302 INFO:teuthology.orchestra.run.smithi090.stdout: "mfa_ids": [ 2024-03-04T12:51:04.302 INFO:teuthology.orchestra.run.smithi090.stdout: "2416989945" 2024-03-04T12:51:04.302 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-03-04T12:51:04.302 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T12:51:04.302 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:51:04.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.292+0000 7f2739fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:04.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.295+0000 7f2888c36800 20 remove_watcher() i=0 2024-03-04T12:51:04.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.295+0000 7f2888c36800 2 removed watcher, disabling cache 2024-03-04T12:51:04.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.296+0000 7f2888c36800 20 remove_watcher() i=1 2024-03-04T12:51:04.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.297+0000 7f2888c36800 20 remove_watcher() i=2 2024-03-04T12:51:04.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.298+0000 7f2888c36800 20 remove_watcher() i=3 2024-03-04T12:51:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.299+0000 7f2888c36800 20 remove_watcher() i=4 2024-03-04T12:51:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.300+0000 7f2888c36800 20 remove_watcher() i=5 2024-03-04T12:51:04.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.301+0000 7f2888c36800 20 remove_watcher() i=6 2024-03-04T12:51:04.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.302+0000 7f2888c36800 20 remove_watcher() i=7 2024-03-04T12:51:04.318 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*' --cluster ceph 2024-03-04T12:51:04.374 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:51:04.374 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:51:04.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.402+0000 7f15f8e44800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.404+0000 7f15f8e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.404+0000 7f15f8e44800 20 realm 2024-03-04T12:51:04.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.404+0000 7f15f8e44800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.404+0000 7f15f8e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.404+0000 7f15f8e44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:51:04.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.404+0000 7f15f8e44800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.404+0000 7f15f8e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.404+0000 7f15f8e44800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.405+0000 7f15f8e44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:04.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.405+0000 7f15f8e44800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.406+0000 7f15f8e44800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:51:04.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.406+0000 7f15f8e44800 20 searching for the correct realm 2024-03-04T12:51:04.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.409+0000 7f15f6940640 0 -- 172.21.15.90:0/2403021949 >> [v2:172.21.15.184:6816/2607900362,v1:172.21.15.184:6817/2607900362] conn(0x7f15f0024030 msgr2=0x7f15f00804a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:51:04.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.412+0000 7f15f6940640 0 -- 172.21.15.90:0/2403021949 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x7f15ec05fb30 msgr2=0x7f15ec06c880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:51:04.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.618+0000 7f15f8e44800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T12:51:04.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.618+0000 7f15f8e44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:51:04.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.618+0000 7f15f8e44800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:51:04.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.618+0000 7f15f8e44800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T12:51:04.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.618+0000 7f15f8e44800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:51:04.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.618+0000 7f15f8e44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:51:04.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.618+0000 7f15f8e44800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.618+0000 7f15f8e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.618+0000 7f15f8e44800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.619+0000 7f15f8e44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:51:04.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.619+0000 7f15f8e44800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.619+0000 7f15f8e44800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:51:04.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.619+0000 7f15f8e44800 20 zone default found 2024-03-04T12:51:04.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.619+0000 7f15f8e44800 4 Realm: () 2024-03-04T12:51:04.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.619+0000 7f15f8e44800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T12:51:04.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.619+0000 7f15f8e44800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T12:51:04.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.619+0000 7f15f8e44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:51:04.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.619+0000 7f15f8e44800 20 zonegroup default 2024-03-04T12:51:04.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.619+0000 7f15f8e44800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.619+0000 7f15f8e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.619+0000 7f15f8e44800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.620+0000 7f15f8e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.620+0000 7f15f8e44800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.620+0000 7f15f8e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:51:04.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.620+0000 7f15f8e44800 20 started sync module instance, tier type = 2024-03-04T12:51:04.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.620+0000 7f15f8e44800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T12:51:04.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.629+0000 7f15f8e44800 20 add_watcher() i=0 2024-03-04T12:51:04.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.629+0000 7f15f8e44800 20 add_watcher() i=1 2024-03-04T12:51:04.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.629+0000 7f15f8e44800 20 add_watcher() i=2 2024-03-04T12:51:04.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.629+0000 7f15f8e44800 20 add_watcher() i=3 2024-03-04T12:51:04.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.629+0000 7f15f8e44800 20 add_watcher() i=4 2024-03-04T12:51:04.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.629+0000 7f15f8e44800 20 add_watcher() i=5 2024-03-04T12:51:04.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.629+0000 7f15f8e44800 20 add_watcher() i=6 2024-03-04T12:51:04.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.630+0000 7f15f8e44800 20 add_watcher() i=7 2024-03-04T12:51:04.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.630+0000 7f15f8e44800 2 all 8 watchers are set, enabling cache 2024-03-04T12:51:04.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.632+0000 7f14ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.632+0000 7f15f8e44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:51:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.632+0000 7f15f8e44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:51:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.632+0000 7f15f8e44800 5 note: GC not initialized 2024-03-04T12:51:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.632+0000 7f1427fff640 20 reqs_thread_entry: start 2024-03-04T12:51:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.632+0000 7f15f8e44800 20 init_complete bucket index max shards: 11 2024-03-04T12:51:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.632+0000 7f15f8e44800 20 Filter name: none 2024-03-04T12:51:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.632+0000 7f1425ffb640 20 reqs_thread_entry: start 2024-03-04T12:51:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.632+0000 7f15f8e44800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-04T12:51:04.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.632+0000 7f15f8e44800 20 rados->read ofs=0 len=0 2024-03-04T12:51:04.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.633+0000 7f15f8e44800 20 rados_obj.operate() r=0 bl.length=495 2024-03-04T12:51:04.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.633+0000 7f15f8e44800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-03-04T12:51:04.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.633+0000 7f15f8e44800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:51:04.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.633+0000 7f15f8e44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:51:04.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.634+0000 7f15f8e44800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:51:04.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.634+0000 7f15f8e44800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:51:04.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.634+0000 7f15f8e44800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-04T12:51:04.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.634+0000 7f14da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693259 cookie 93967109265632 notifier 7812 bl.length()=704 2024-03-04T12:51:04.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.634+0000 7f14da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:51:04.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.634+0000 7f14da7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:51:04.641 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: "user_id": "foobar.client.0", 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: "display_name": "Mr. foobar.client.0", 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: "email": "foobar.client.0+test@test.test", 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: "suspended": 0, 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: "max_buckets": 1000, 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: "subusers": [], 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: "keys": [ 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: "user": "foobar.client.0", 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: "access_key": "CRBRRATKXYAFNZARHTYJ", 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: "secret_key": "NoR02PRFgB+IGyxQGHJeDivPqjhMU2SB4EE5ontNXi1zS9//wigqgA==", 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: "active": true 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:51:04.642 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: "swift_keys": [], 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": [ 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "oidc-provider", 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: "perm": "*" 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "roles", 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: "perm": "*" 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "user-policy", 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: "perm": "*" 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-03-04T12:51:04.643 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "op_mask": "read, write, delete", 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "default_placement": "", 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "default_storage_class": "", 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "placement_tags": [], 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "bucket_quota": { 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "user_quota": { 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "enabled": false, 2024-03-04T12:51:04.644 INFO:teuthology.orchestra.run.smithi090.stdout: "check_on_raw": false, 2024-03-04T12:51:04.645 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size": -1, 2024-03-04T12:51:04.645 INFO:teuthology.orchestra.run.smithi090.stdout: "max_size_kb": 0, 2024-03-04T12:51:04.645 INFO:teuthology.orchestra.run.smithi090.stdout: "max_objects": -1 2024-03-04T12:51:04.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-03-04T12:51:04.645 INFO:teuthology.orchestra.run.smithi090.stdout: "temp_url_keys": [], 2024-03-04T12:51:04.645 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "rgw", 2024-03-04T12:51:04.645 INFO:teuthology.orchestra.run.smithi090.stdout: "mfa_ids": [ 2024-03-04T12:51:04.645 INFO:teuthology.orchestra.run.smithi090.stdout: "2416989945" 2024-03-04T12:51:04.645 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-03-04T12:51:04.645 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T12:51:04.645 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:51:04.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.635+0000 7f14ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:51:04.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.638+0000 7f15f8e44800 20 remove_watcher() i=0 2024-03-04T12:51:04.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.638+0000 7f15f8e44800 2 removed watcher, disabling cache 2024-03-04T12:51:04.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.639+0000 7f15f8e44800 20 remove_watcher() i=1 2024-03-04T12:51:04.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.640+0000 7f15f8e44800 20 remove_watcher() i=2 2024-03-04T12:51:04.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.641+0000 7f15f8e44800 20 remove_watcher() i=3 2024-03-04T12:51:04.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.642+0000 7f15f8e44800 20 remove_watcher() i=4 2024-03-04T12:51:04.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.643+0000 7f15f8e44800 20 remove_watcher() i=5 2024-03-04T12:51:04.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.644+0000 7f15f8e44800 20 remove_watcher() i=6 2024-03-04T12:51:04.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T12:51:04.645+0000 7f15f8e44800 20 remove_watcher() i=7 2024-03-04T12:51:04.661 INFO:tasks.s3tests:Configuring s3-tests... 2024-03-04T12:51:04.661 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:51:04.661 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-03-04T12:51:04.688 INFO:tasks.s3tests:Configuring boto... 2024-03-04T12:51:04.689 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-03-04T12:51:04.689 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-03-04T12:51:04.755 DEBUG:teuthology.orchestra.run.smithi090:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-03-04T12:51:04.921 INFO:teuthology.orchestra.run.smithi090.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-03-04T12:51:05.098 INFO:teuthology.orchestra.run.smithi090.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-03-04T12:51:05.332 INFO:teuthology.orchestra.run.smithi090.stdout:py installdeps: -rrequirements.txt 2024-03-04T12:52:46.770 INFO:teuthology.orchestra.run.smithi090.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-03-04T12:52:48.424 INFO:teuthology.orchestra.run.smithi090.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.3.3,certifi==2024.2.2,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.0,filelock==3.13.1,gevent==24.2.1,greenlet==3.0.3,httplib2==0.22.0,idna==3.6,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.1.0,munch==4.0.0,packaging==23.2,platformdirs==4.2.0,pluggy==1.4.0,pyparsing==3.1.1,pyproject-api==1.6.1,pytest==8.1.0,python-dateutil==2.9.0.post0,pytz==2024.1,PyYAML==6.0.1,requests==2.31.0,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=9ac2caaba70189e8042caf44cf87493d294cf21b7be1da460e4ce3fba99f86c1,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.13.0,urllib3==1.26.18,virtualenv==20.25.1,zope.event==5.0,zope.interface==6.2 2024-03-04T12:52:48.424 INFO:teuthology.orchestra.run.smithi090.stdout:py run-test-pre: PYTHONHASHSEED='3947009639' 2024-03-04T12:52:48.424 INFO:teuthology.orchestra.run.smithi090.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-03-04T12:52:48.573 INFO:teuthology.orchestra.run.smithi090.stdout:============================= test session starts ============================== 2024-03-04T12:52:48.573 INFO:teuthology.orchestra.run.smithi090.stdout:platform linux -- Python 3.9.17, pytest-8.1.0, pluggy-1.4.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-03-04T12:52:48.573 INFO:teuthology.orchestra.run.smithi090.stdout:cachedir: .tox/py/.pytest_cache 2024-03-04T12:52:48.573 INFO:teuthology.orchestra.run.smithi090.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-03-04T12:52:48.573 INFO:teuthology.orchestra.run.smithi090.stdout:configfile: pytest.ini 2024-03-04T12:52:50.145 INFO:teuthology.orchestra.run.smithi090.stdout:collecting ... collected 787 items / 124 deselected / 663 selected 2024-03-04T12:52:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T12:52:50.526 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none FAILED [ 0%] 2024-03-04T12:52:50.711 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty FAILED [ 0%] 2024-03-04T12:52:50.888 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-03-04T12:52:51.060 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-03-04T12:52:51.240 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none FAILED [ 0%] 2024-03-04T12:52:51.361 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-03-04T12:52:51.534 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 1%] 2024-03-04T12:52:51.657 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-03-04T12:52:51.789 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty FAILED [ 1%] 2024-03-04T12:52:51.922 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none FAILED [ 1%] 2024-03-04T12:52:52.302 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 FAILED [ 1%] 2024-03-04T12:52:52.481 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 FAILED [ 1%] 2024-03-04T12:52:52.660 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 FAILED [ 1%] 2024-03-04T12:52:52.841 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 FAILED [ 2%] 2024-03-04T12:52:52.974 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 FAILED [ 2%] 2024-03-04T12:52:53.126 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 FAILED [ 2%] 2024-03-04T12:52:53.171 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-03-04T12:52:53.219 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-03-04T12:52:53.263 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-03-04T12:52:53.308 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 3%] 2024-03-04T12:52:53.354 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 3%] 2024-03-04T12:52:53.400 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 3%] 2024-03-04T12:52:53.445 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-03-04T12:52:53.491 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-03-04T12:52:53.538 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-03-04T12:52:53.584 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-03-04T12:52:53.631 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 4%] 2024-03-04T12:52:53.676 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 4%] 2024-03-04T12:52:53.723 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 4%] 2024-03-04T12:52:53.768 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-03-04T12:52:53.815 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-03-04T12:52:53.860 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-03-04T12:52:53.906 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-03-04T12:52:53.953 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 5%] 2024-03-04T12:52:53.998 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 5%] 2024-03-04T12:52:54.045 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 5%] 2024-03-04T12:52:54.091 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 5%] 2024-03-04T12:52:54.138 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-03-04T12:52:54.184 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-03-04T12:52:54.231 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 6%] 2024-03-04T12:52:54.277 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 6%] 2024-03-04T12:52:54.323 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 6%] 2024-03-04T12:52:54.369 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 6%] 2024-03-04T12:52:54.415 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 6%] 2024-03-04T12:52:54.462 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-03-04T12:52:54.509 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-03-04T12:52:54.556 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 7%] 2024-03-04T12:52:54.603 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 7%] 2024-03-04T12:52:54.650 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 7%] 2024-03-04T12:52:54.697 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 7%] 2024-03-04T12:52:54.744 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 7%] 2024-03-04T12:52:54.791 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 7%] 2024-03-04T12:52:54.839 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-03-04T12:52:55.329 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 8%] 2024-03-04T12:52:55.870 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 8%] 2024-03-04T12:52:56.895 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 8%] 2024-03-04T12:52:57.966 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 8%] 2024-03-04T12:52:59.730 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 8%] 2024-03-04T12:53:00.323 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 8%] 2024-03-04T12:53:01.076 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 9%] 2024-03-04T12:53:01.359 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 9%] 2024-03-04T12:53:01.510 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 9%] 2024-03-04T12:53:01.747 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 9%] 2024-03-04T12:53:01.982 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 9%] 2024-03-04T12:53:02.389 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 9%] 2024-03-04T12:53:02.614 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 9%] 2024-03-04T12:53:02.912 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 10%] 2024-03-04T12:53:02.913 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 10%] 2024-03-04T12:53:02.913 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 10%] 2024-03-04T12:53:02.914 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 10%] 2024-03-04T12:53:02.915 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 10%] 2024-03-04T12:53:02.916 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 10%] 2024-03-04T12:53:02.917 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 11%] 2024-03-04T12:53:02.918 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2024-03-04T12:53:02.919 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2024-03-04T12:53:02.920 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2024-03-04T12:53:02.921 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2024-03-04T12:53:02.922 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 11%] 2024-03-04T12:53:02.923 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 11%] 2024-03-04T12:53:02.924 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 12%] 2024-03-04T12:53:02.925 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2024-03-04T12:53:02.926 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2024-03-04T12:53:02.927 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2024-03-04T12:53:02.928 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2024-03-04T12:53:02.929 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2024-03-04T12:53:02.930 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2024-03-04T12:53:02.931 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 13%] 2024-03-04T12:53:02.932 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 13%] 2024-03-04T12:53:02.933 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 13%] 2024-03-04T12:53:02.934 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 13%] 2024-03-04T12:53:02.935 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 13%] 2024-03-04T12:53:02.936 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 13%] 2024-03-04T12:53:02.937 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 14%] 2024-03-04T12:53:02.938 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 14%] 2024-03-04T12:53:02.995 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 14%] 2024-03-04T12:53:03.007 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 14%] 2024-03-04T12:53:03.720 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 14%] 2024-03-04T12:53:08.891 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 14%] 2024-03-04T12:53:09.232 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 14%] 2024-03-04T12:53:09.628 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 15%] 2024-03-04T12:53:10.063 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 15%] 2024-03-04T12:53:10.416 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 15%] 2024-03-04T12:53:10.779 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 15%] 2024-03-04T12:53:11.101 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 15%] 2024-03-04T12:53:11.488 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 15%] 2024-03-04T12:53:11.832 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 15%] 2024-03-04T12:53:12.202 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 16%] 2024-03-04T12:53:12.578 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 16%] 2024-03-04T12:53:12.890 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 16%] 2024-03-04T12:53:13.203 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 16%] 2024-03-04T12:53:13.454 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 16%] 2024-03-04T12:53:13.752 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 16%] 2024-03-04T12:53:14.167 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 17%] 2024-03-04T12:53:14.600 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 17%] 2024-03-04T12:53:14.936 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 17%] 2024-03-04T12:53:15.282 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 17%] 2024-03-04T12:53:15.660 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 17%] 2024-03-04T12:53:16.024 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 17%] 2024-03-04T12:53:16.402 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 17%] 2024-03-04T12:53:16.728 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 18%] 2024-03-04T12:53:17.054 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 18%] 2024-03-04T12:53:17.294 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 18%] 2024-03-04T12:53:17.586 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 18%] 2024-03-04T12:53:17.825 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 18%] 2024-03-04T12:53:18.065 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 18%] 2024-03-04T12:53:18.316 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 19%] 2024-03-04T12:53:18.766 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 19%] 2024-03-04T12:53:19.006 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 19%] 2024-03-04T12:53:19.254 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 19%] 2024-03-04T12:53:19.603 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 19%] 2024-03-04T12:53:19.958 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 19%] 2024-03-04T12:53:20.212 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 19%] 2024-03-04T12:53:20.588 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 20%] 2024-03-04T12:53:20.943 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 20%] 2024-03-04T12:53:21.387 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 20%] 2024-03-04T12:53:21.688 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 20%] 2024-03-04T12:53:22.034 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 20%] 2024-03-04T12:53:22.375 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 20%] 2024-03-04T12:53:22.917 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 20%] 2024-03-04T12:53:23.339 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 21%] 2024-03-04T12:53:23.706 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 21%] 2024-03-04T12:53:24.143 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 21%] 2024-03-04T12:53:24.638 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 21%] 2024-03-04T12:53:25.094 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 21%] 2024-03-04T12:53:25.584 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 21%] 2024-03-04T12:53:26.027 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 22%] 2024-03-04T12:53:26.520 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 22%] 2024-03-04T12:53:27.135 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 22%] 2024-03-04T12:53:27.708 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 22%] 2024-03-04T12:53:28.103 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 22%] 2024-03-04T12:53:28.639 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 22%] 2024-03-04T12:53:29.154 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 22%] 2024-03-04T12:53:29.640 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 23%] 2024-03-04T12:53:30.087 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 23%] 2024-03-04T12:53:30.513 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 23%] 2024-03-04T12:53:30.987 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 23%] 2024-03-04T12:53:31.428 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 23%] 2024-03-04T12:53:31.839 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 23%] 2024-03-04T12:53:32.246 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 23%] 2024-03-04T12:53:33.042 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 24%] 2024-03-04T12:53:33.848 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 24%] 2024-03-04T12:53:34.267 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2024-03-04T12:53:34.654 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2024-03-04T12:53:35.092 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 24%] 2024-03-04T12:53:35.530 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 24%] 2024-03-04T12:53:36.325 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 25%] 2024-03-04T12:53:37.160 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 25%] 2024-03-04T12:53:37.575 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 25%] 2024-03-04T12:53:37.984 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 25%] 2024-03-04T12:53:38.443 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 25%] 2024-03-04T12:53:38.883 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 25%] 2024-03-04T12:53:39.292 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 25%] 2024-03-04T12:53:39.766 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 26%] 2024-03-04T12:53:40.204 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 26%] 2024-03-04T12:53:40.648 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 26%] 2024-03-04T12:53:41.088 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 26%] 2024-03-04T12:53:41.541 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 26%] 2024-03-04T12:53:41.999 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 26%] 2024-03-04T12:53:42.436 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 26%] 2024-03-04T12:53:42.876 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 27%] 2024-03-04T12:53:43.323 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 27%] 2024-03-04T12:53:43.738 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 27%] 2024-03-04T12:53:44.181 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 27%] 2024-03-04T12:53:44.603 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 27%] 2024-03-04T12:53:54.653 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 27%] 2024-03-04T12:53:55.065 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 28%] 2024-03-04T12:53:55.474 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 28%] 2024-03-04T12:53:55.945 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 28%] 2024-03-04T12:53:56.344 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 28%] 2024-03-04T12:53:56.773 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 28%] 2024-03-04T12:53:57.214 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 28%] 2024-03-04T12:53:57.661 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 28%] 2024-03-04T12:53:58.103 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 29%] 2024-03-04T12:53:58.593 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 29%] 2024-03-04T12:53:59.033 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 29%] 2024-03-04T12:53:59.474 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 29%] 2024-03-04T12:53:59.906 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 29%] 2024-03-04T12:54:00.345 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 29%] 2024-03-04T12:54:00.793 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 30%] 2024-03-04T12:54:01.202 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 30%] 2024-03-04T12:54:01.663 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 30%] 2024-03-04T12:54:02.068 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2024-03-04T12:54:02.480 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2024-03-04T12:54:02.892 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2024-03-04T12:54:03.334 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2024-03-04T12:54:03.784 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 31%] 2024-03-04T12:54:04.276 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 31%] 2024-03-04T12:54:04.721 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 31%] 2024-03-04T12:54:05.185 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 31%] 2024-03-04T12:54:05.636 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 31%] 2024-03-04T12:54:06.080 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 31%] 2024-03-04T12:54:06.526 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 31%] 2024-03-04T12:54:06.973 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 32%] 2024-03-04T12:54:07.250 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 32%] 2024-03-04T12:54:07.674 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 32%] 2024-03-04T12:54:08.458 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 32%] 2024-03-04T12:54:09.242 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 32%] 2024-03-04T12:54:09.692 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 32%] 2024-03-04T12:54:10.117 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 33%] 2024-03-04T12:54:10.575 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 33%] 2024-03-04T12:54:11.016 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 33%] 2024-03-04T12:54:11.510 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 33%] 2024-03-04T12:54:11.981 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 33%] 2024-03-04T12:54:12.417 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 33%] 2024-03-04T12:54:12.851 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 33%] 2024-03-04T12:54:13.299 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 34%] 2024-03-04T12:54:13.770 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 34%] 2024-03-04T12:54:14.203 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 34%] 2024-03-04T12:54:14.638 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 34%] 2024-03-04T12:54:15.246 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 34%] 2024-03-04T12:54:15.943 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 34%] 2024-03-04T12:54:16.314 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 34%] 2024-03-04T12:54:16.690 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 35%] 2024-03-04T12:54:17.074 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 35%] 2024-03-04T12:54:17.408 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 35%] 2024-03-04T12:54:17.648 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 35%] 2024-03-04T12:54:17.902 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 35%] 2024-03-04T12:54:18.141 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 35%] 2024-03-04T12:54:18.526 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 36%] 2024-03-04T12:54:18.912 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 36%] 2024-03-04T12:54:19.155 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 36%] 2024-03-04T12:54:19.537 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 36%] 2024-03-04T12:54:19.918 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 36%] 2024-03-04T12:54:20.250 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 36%] 2024-03-04T12:54:20.586 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 36%] 2024-03-04T12:54:21.170 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 37%] 2024-03-04T12:54:21.698 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 37%] 2024-03-04T12:54:22.273 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 37%] 2024-03-04T12:54:30.993 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 37%] 2024-03-04T12:54:39.677 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 37%] 2024-03-04T12:54:40.053 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 37%] 2024-03-04T12:54:40.459 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 38%] 2024-03-04T12:54:40.874 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 38%] 2024-03-04T12:54:41.285 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 38%] 2024-03-04T12:54:41.739 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 38%] 2024-03-04T12:54:42.173 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 38%] 2024-03-04T12:54:42.520 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 38%] 2024-03-04T12:54:42.999 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 38%] 2024-03-04T12:54:43.438 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 39%] 2024-03-04T12:54:43.894 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 39%] 2024-03-04T12:54:44.297 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 39%] 2024-03-04T12:54:44.749 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 39%] 2024-03-04T12:54:45.180 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 39%] 2024-03-04T12:54:45.565 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 39%] 2024-03-04T12:54:46.003 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 39%] 2024-03-04T12:54:46.447 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 40%] 2024-03-04T12:54:46.868 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 40%] 2024-03-04T12:54:47.332 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 40%] 2024-03-04T12:54:47.735 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 40%] 2024-03-04T12:54:48.177 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 40%] 2024-03-04T12:54:48.651 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 40%] 2024-03-04T12:54:49.130 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 41%] 2024-03-04T12:54:49.519 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 41%] 2024-03-04T12:54:49.950 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 41%] 2024-03-04T12:54:50.304 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 41%] 2024-03-04T12:54:50.704 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 41%] 2024-03-04T12:54:51.105 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 41%] 2024-03-04T12:54:51.491 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 41%] 2024-03-04T12:54:51.939 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 42%] 2024-03-04T12:54:52.298 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 42%] 2024-03-04T12:54:52.699 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 42%] 2024-03-04T12:54:53.086 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 42%] 2024-03-04T12:54:53.496 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 42%] 2024-03-04T12:54:53.976 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 42%] 2024-03-04T12:54:54.330 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 42%] 2024-03-04T12:54:54.686 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 43%] 2024-03-04T12:54:55.087 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 43%] 2024-03-04T12:54:55.476 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 43%] 2024-03-04T12:54:55.867 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 43%] 2024-03-04T12:54:56.257 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 43%] 2024-03-04T12:54:56.644 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 43%] 2024-03-04T12:54:57.125 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 44%] 2024-03-04T12:54:57.480 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 44%] 2024-03-04T12:54:57.881 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 44%] 2024-03-04T12:54:58.270 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 44%] 2024-03-04T12:54:58.687 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 44%] 2024-03-04T12:54:59.102 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 44%] 2024-03-04T12:54:59.491 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 44%] 2024-03-04T12:55:01.148 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 45%] 2024-03-04T12:55:01.592 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 45%] 2024-03-04T12:55:02.057 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 45%] 2024-03-04T12:55:02.571 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 45%] 2024-03-04T12:55:03.081 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 45%] 2024-03-04T12:55:03.607 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 45%] 2024-03-04T12:55:04.035 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 46%] 2024-03-04T12:55:04.513 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 46%] 2024-03-04T12:55:05.032 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 46%] 2024-03-04T12:55:05.497 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 46%] 2024-03-04T12:55:06.046 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 46%] 2024-03-04T12:55:06.415 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 46%] 2024-03-04T12:55:06.738 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 46%] 2024-03-04T12:55:07.085 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 47%] 2024-03-04T12:55:07.479 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 47%] 2024-03-04T12:55:07.806 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 47%] 2024-03-04T12:55:08.046 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 47%] 2024-03-04T12:55:08.542 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 47%] 2024-03-04T12:55:08.897 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 47%] 2024-03-04T12:55:09.285 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 47%] 2024-03-04T12:55:11.971 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 48%] 2024-03-04T12:55:12.391 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 48%] 2024-03-04T12:55:12.808 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 48%] 2024-03-04T12:55:13.148 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 48%] 2024-03-04T12:55:13.510 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 48%] 2024-03-04T12:55:13.887 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 48%] 2024-03-04T12:55:14.284 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 49%] 2024-03-04T12:55:14.775 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 49%] 2024-03-04T12:55:15.251 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 49%] 2024-03-04T12:55:15.674 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 49%] 2024-03-04T12:55:16.113 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 49%] 2024-03-04T12:55:16.520 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 49%] 2024-03-04T12:55:16.957 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 49%] 2024-03-04T12:55:17.342 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 50%] 2024-03-04T12:55:17.806 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 50%] 2024-03-04T12:55:18.293 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 50%] 2024-03-04T12:55:18.548 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 50%] 2024-03-04T12:55:18.803 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 50%] 2024-03-04T12:55:19.043 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 50%] 2024-03-04T12:55:19.355 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 50%] 2024-03-04T12:55:19.672 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 51%] 2024-03-04T12:55:19.989 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 51%] 2024-03-04T12:55:20.305 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 51%] 2024-03-04T12:55:20.650 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 51%] 2024-03-04T12:55:20.894 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 51%] 2024-03-04T12:55:21.137 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 51%] 2024-03-04T12:55:21.451 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 52%] 2024-03-04T12:55:21.742 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 52%] 2024-03-04T12:55:21.997 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 52%] 2024-03-04T12:55:22.239 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 52%] 2024-03-04T12:55:22.481 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 52%] 2024-03-04T12:55:22.826 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 52%] 2024-03-04T12:55:23.152 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 52%] 2024-03-04T12:55:23.507 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 53%] 2024-03-04T12:55:23.869 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 53%] 2024-03-04T12:55:24.244 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 53%] 2024-03-04T12:55:24.619 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 53%] 2024-03-04T12:55:24.945 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 53%] 2024-03-04T12:55:25.330 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 53%] 2024-03-04T12:55:25.690 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 53%] 2024-03-04T12:55:26.051 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 54%] 2024-03-04T12:55:26.510 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 54%] 2024-03-04T12:55:26.980 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 54%] 2024-03-04T12:55:27.486 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 54%] 2024-03-04T12:55:27.941 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 54%] 2024-03-04T12:55:28.435 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 54%] 2024-03-04T12:55:28.897 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 55%] 2024-03-04T12:55:29.368 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 55%] 2024-03-04T12:55:29.803 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 55%] 2024-03-04T12:55:30.206 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 55%] 2024-03-04T12:55:30.571 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 55%] 2024-03-04T12:55:31.049 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 55%] 2024-03-04T12:55:31.566 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 55%] 2024-03-04T12:55:32.048 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 56%] 2024-03-04T12:55:32.480 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 56%] 2024-03-04T12:55:32.910 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 56%] 2024-03-04T12:55:33.636 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 56%] 2024-03-04T12:55:34.266 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 56%] 2024-03-04T12:55:34.886 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 56%] 2024-03-04T12:55:35.597 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 57%] 2024-03-04T12:55:36.229 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 57%] 2024-03-04T12:55:36.659 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 57%] 2024-03-04T12:55:37.209 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_no_grants PASSED [ 57%] 2024-03-04T12:55:37.594 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 57%] 2024-03-04T12:55:37.986 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 57%] 2024-03-04T12:55:38.418 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 57%] 2024-03-04T12:55:38.847 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 58%] 2024-03-04T12:55:39.393 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 58%] 2024-03-04T12:55:40.066 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 58%] 2024-03-04T12:55:40.739 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 58%] 2024-03-04T12:55:41.430 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 58%] 2024-03-04T12:55:42.085 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 58%] 2024-03-04T12:55:42.843 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 58%] 2024-03-04T12:55:43.524 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 59%] 2024-03-04T12:55:44.201 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 59%] 2024-03-04T12:55:44.878 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 59%] 2024-03-04T12:55:45.604 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 59%] 2024-03-04T12:55:46.167 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 59%] 2024-03-04T12:55:46.776 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 59%] 2024-03-04T12:55:47.339 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 60%] 2024-03-04T12:55:48.052 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 60%] 2024-03-04T12:55:48.710 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 60%] 2024-03-04T12:55:48.950 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 60%] 2024-03-04T12:55:49.191 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 60%] 2024-03-04T12:55:49.435 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 60%] 2024-03-04T12:55:49.815 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 60%] 2024-03-04T12:55:50.191 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 61%] 2024-03-04T12:55:50.503 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 61%] 2024-03-04T12:55:50.827 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 61%] 2024-03-04T12:55:51.359 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 61%] 2024-03-04T12:55:52.471 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 61%] 2024-03-04T12:55:52.941 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 61%] 2024-03-04T12:55:53.391 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 61%] 2024-03-04T12:55:53.892 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 62%] 2024-03-04T12:55:54.402 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 62%] 2024-03-04T12:55:54.882 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 62%] 2024-03-04T12:55:55.384 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 62%] 2024-03-04T12:55:55.780 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 62%] 2024-03-04T12:55:56.422 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 62%] 2024-03-04T12:55:56.928 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 63%] 2024-03-04T12:55:57.560 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 63%] 2024-03-04T12:55:58.081 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 63%] 2024-03-04T12:55:58.731 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 63%] 2024-03-04T12:55:59.425 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 63%] 2024-03-04T12:55:59.775 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 63%] 2024-03-04T12:56:00.155 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 63%] 2024-03-04T12:56:01.432 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 64%] 2024-03-04T12:56:01.969 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 64%] 2024-03-04T12:56:03.758 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 64%] 2024-03-04T12:56:04.185 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 64%] 2024-03-04T12:56:04.669 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 64%] 2024-03-04T12:56:05.565 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 64%] 2024-03-04T12:56:06.039 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-03-04T12:56:06.846 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-03-04T12:56:08.794 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 65%] 2024-03-04T12:56:11.092 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 65%] 2024-03-04T12:56:13.608 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 65%] 2024-03-04T12:56:22.683 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 65%] 2024-03-04T12:56:23.980 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 65%] 2024-03-04T12:56:26.752 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-03-04T12:56:27.244 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-03-04T12:56:27.981 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 66%] 2024-03-04T12:56:28.560 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 66%] 2024-03-04T12:56:29.074 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 66%] 2024-03-04T12:56:29.538 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 66%] 2024-03-04T12:56:30.245 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 66%] 2024-03-04T12:56:30.693 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-03-04T12:56:31.117 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-03-04T12:56:31.584 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-03-04T12:56:46.315 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 67%] 2024-03-04T12:56:46.787 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 67%] 2024-03-04T12:56:47.085 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 67%] 2024-03-04T12:56:47.562 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-03-04T12:56:53.212 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-03-04T12:56:56.752 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-03-04T12:57:00.210 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 68%] 2024-03-04T12:57:00.731 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 68%] 2024-03-04T12:57:01.263 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 68%] 2024-03-04T12:57:01.717 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 68%] 2024-03-04T12:57:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 69%] 2024-03-04T12:57:02.698 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 69%] 2024-03-04T12:57:03.311 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 69%] 2024-03-04T12:57:03.862 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 69%] 2024-03-04T12:57:04.561 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 69%] 2024-03-04T12:57:05.320 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 69%] 2024-03-04T12:57:05.854 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 69%] 2024-03-04T12:57:06.369 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 70%] 2024-03-04T12:57:06.992 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 70%] 2024-03-04T12:57:07.529 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 70%] 2024-03-04T12:57:08.109 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 70%] 2024-03-04T12:57:08.816 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 70%] 2024-03-04T12:57:09.211 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 70%] 2024-03-04T12:57:13.840 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-03-04T12:57:14.254 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-03-04T12:57:14.728 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 71%] 2024-03-04T12:57:15.170 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 71%] 2024-03-04T12:57:15.605 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 71%] 2024-03-04T12:57:16.338 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 71%] 2024-03-04T12:57:22.648 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 71%] 2024-03-04T12:57:23.160 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-03-04T12:57:23.701 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-03-04T12:57:24.381 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 72%] 2024-03-04T12:57:25.131 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 72%] 2024-03-04T12:57:27.948 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 72%] 2024-03-04T12:57:31.348 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 72%] 2024-03-04T12:57:44.227 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-03-04T12:57:46.484 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-03-04T12:57:47.504 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-03-04T12:57:48.774 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 73%] 2024-03-04T12:57:49.440 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 73%] 2024-03-04T12:57:50.034 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 73%] 2024-03-04T12:57:50.556 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 73%] 2024-03-04T12:57:51.206 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-03-04T12:57:51.796 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-03-04T12:57:52.468 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-03-04T12:57:52.768 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 74%] 2024-03-04T12:57:53.147 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 74%] 2024-03-04T12:57:53.531 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 74%] 2024-03-04T12:57:53.881 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 74%] 2024-03-04T12:57:54.247 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-03-04T12:57:54.699 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-03-04T12:57:55.034 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-03-04T12:57:55.413 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 75%] 2024-03-04T12:57:55.804 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 75%] 2024-03-04T12:57:56.135 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 75%] 2024-03-04T12:57:56.504 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-03-04T12:57:56.874 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-03-04T12:57:57.246 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-03-04T12:57:57.584 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-03-04T12:57:58.008 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-03-04T12:57:58.479 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 76%] 2024-03-04T12:57:58.885 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 76%] 2024-03-04T12:57:59.269 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-03-04T12:57:59.638 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-03-04T12:58:00.040 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-03-04T12:58:00.469 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-03-04T12:58:00.823 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-03-04T12:58:01.158 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 77%] 2024-03-04T12:58:01.492 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 77%] 2024-03-04T12:58:01.875 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-03-04T12:58:04.595 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-03-04T12:58:07.570 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-03-04T12:58:08.562 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-03-04T12:58:09.026 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-03-04T12:58:09.486 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 78%] 2024-03-04T12:58:09.887 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-03-04T12:58:10.248 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-03-04T12:58:10.584 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-03-04T12:58:12.850 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-03-04T12:58:13.667 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-03-04T12:58:14.469 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 79%] 2024-03-04T12:58:14.926 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 79%] 2024-03-04T12:58:15.393 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-03-04T12:58:15.779 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-03-04T12:58:16.168 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-03-04T12:58:16.563 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-03-04T12:58:16.962 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-03-04T12:58:17.357 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-03-04T12:58:17.800 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 80%] 2024-03-04T12:58:18.292 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-03-04T12:58:18.743 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-03-04T12:58:19.457 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-03-04T12:58:20.116 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-03-04T12:58:20.672 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 81%] 2024-03-04T12:58:21.148 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 81%] 2024-03-04T12:58:21.663 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-03-04T12:58:22.271 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-03-04T12:58:22.820 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-03-04T12:58:23.344 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-03-04T12:58:23.868 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-03-04T12:58:24.457 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-03-04T12:58:25.059 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 82%] 2024-03-04T12:58:25.535 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-03-04T12:58:26.018 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-03-04T12:58:26.562 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-03-04T12:58:27.048 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-03-04T12:58:27.505 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-03-04T12:58:28.078 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-03-04T12:58:28.995 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-03-04T12:58:31.210 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-03-04T12:58:31.861 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-03-04T12:58:32.459 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-03-04T12:58:33.001 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-03-04T12:58:33.791 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-03-04T12:58:34.433 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-03-04T12:58:34.911 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 85%] 2024-03-04T12:58:35.597 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-03-04T12:58:35.935 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-03-04T12:58:36.267 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-03-04T12:58:36.600 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-03-04T12:58:36.932 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-03-04T12:58:37.389 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-03-04T12:58:37.765 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 86%] 2024-03-04T12:58:38.415 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-03-04T12:58:38.767 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-03-04T12:58:39.099 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-03-04T12:58:39.471 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-03-04T12:58:39.833 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-03-04T12:58:40.197 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 87%] 2024-03-04T12:58:40.596 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 87%] 2024-03-04T12:58:40.967 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 87%] 2024-03-04T12:58:41.293 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-03-04T12:58:41.636 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-03-04T12:58:42.008 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-03-04T12:58:42.440 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-03-04T12:58:42.844 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 88%] 2024-03-04T12:58:43.310 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 88%] 2024-03-04T12:58:43.673 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 88%] 2024-03-04T12:58:43.994 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-03-04T12:58:44.373 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-03-04T12:58:44.822 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-03-04T12:58:45.218 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-03-04T12:58:45.636 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 89%] 2024-03-04T12:58:46.084 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 89%] 2024-03-04T12:58:46.459 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 89%] 2024-03-04T12:58:46.839 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-03-04T12:58:47.259 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-03-04T12:58:47.671 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-03-04T12:58:48.061 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 90%] 2024-03-04T12:58:48.475 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 90%] 2024-03-04T12:58:48.872 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 90%] 2024-03-04T12:58:49.323 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 90%] 2024-03-04T12:58:49.739 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-03-04T12:58:50.181 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-03-04T12:58:50.537 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-03-04T12:58:50.903 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 91%] 2024-03-04T12:58:51.255 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 91%] 2024-03-04T12:59:01.510 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 91%] 2024-03-04T12:59:01.953 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-03-04T12:59:11.237 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-03-04T12:59:11.680 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-03-04T12:59:12.131 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 92%] 2024-03-04T12:59:12.507 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 92%] 2024-03-04T12:59:12.850 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 92%] 2024-03-04T12:59:13.232 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 92%] 2024-03-04T12:59:13.648 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-03-04T12:59:14.073 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-03-04T12:59:14.486 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status PASSED [ 92%] 2024-03-04T12:59:15.051 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_default_public_block PASSED [ 93%] 2024-03-04T12:59:15.420 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 93%] 2024-03-04T12:59:15.939 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 93%] 2024-03-04T12:59:16.472 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-03-04T12:59:16.866 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-03-04T12:59:17.441 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-03-04T12:59:18.567 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-03-04T12:59:18.906 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 94%] 2024-03-04T12:59:19.318 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 94%] 2024-03-04T12:59:19.747 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 94%] 2024-03-04T12:59:20.228 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-03-04T12:59:20.703 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-03-04T12:59:26.037 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-03-04T12:59:31.167 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-03-04T12:59:31.548 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-03-04T12:59:32.055 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-03-04T12:59:33.186 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-03-04T12:59:34.558 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-03-04T12:59:35.613 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-03-04T12:59:36.441 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-03-04T12:59:37.144 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 96%] 2024-03-04T12:59:37.793 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-03-04T12:59:38.179 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-03-04T12:59:39.121 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-03-04T12:59:40.115 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-03-04T12:59:44.822 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-03-04T12:59:45.791 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-03-04T12:59:46.512 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 97%] 2024-03-04T12:59:47.076 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-03-04T12:59:47.548 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-03-04T12:59:48.185 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-03-04T12:59:48.833 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-03-04T12:59:49.483 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-03-04T12:59:50.023 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 98%] 2024-03-04T12:59:50.656 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 98%] 2024-03-04T12:59:51.299 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 98%] 2024-03-04T12:59:52.015 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-03-04T12:59:52.713 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-03-04T12:59:52.906 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-03-04T12:59:53.888 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-03-04T12:59:54.767 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 99%] 2024-03-04T12:59:55.360 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 99%] 2024-03-04T12:59:55.906 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 99%] 2024-03-04T12:59:56.398 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-03-04T13:00:07.633 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-03-04T13:00:07.837 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-03-04T13:00:07.863 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-03-04T13:00:07.863 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.863 INFO:teuthology.orchestra.run.smithi090.stdout:=================================== FAILURES =================================== 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout:__________________ test_object_create_bad_contentlength_none ___________________ 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.auth_common 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout: def test_object_create_bad_contentlength_none(): 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout: key = _setup_bad_object(remove=('Content-Length',)) 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:180: 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.864 INFO:teuthology.orchestra.run.smithi090.stdout:excClass = 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout:callableObj = > 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout: try: 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout: callableObj(*args, **kwargs) 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout: except excClass as e: 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout: return e 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:00:07.865 INFO:teuthology.orchestra.run.smithi090.stdout: excName = excClass.__name__ 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout: excName = str(excClass) 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on main 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection main prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on alt 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection alt prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on tenant 2024-03-04T13:00:07.866 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:Done with cleanup of test buckets. 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on main 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection main prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:prefix= test-client.0-cbsc2sy2cueuqab- 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket key 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on alt 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection alt prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on tenant 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:Done with cleanup of test buckets. 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:__________________ test_object_create_bad_authorization_empty __________________ 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.867 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.auth_common 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout: def test_object_create_bad_authorization_empty(): 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout: key = _setup_bad_object({'Authorization': ''}) 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:210: 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout:excClass = 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout:callableObj = > 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:00:07.868 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: try: 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: callableObj(*args, **kwargs) 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: except excClass as e: 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: return e 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: excName = excClass.__name__ 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: excName = str(excClass) 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:00:07.869 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on main 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection main prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:prefix= test-client.0-cbsc2sy2cueuqab- 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket key 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on alt 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection alt prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on tenant 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:Done with cleanup of test buckets. 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout:__________________ test_object_create_bad_authorization_none ___________________ 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.auth_common 2024-03-04T13:00:07.870 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout: def test_object_create_bad_authorization_none(): 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout: key = _setup_bad_object(remove=('Authorization',)) 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:236: 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout:excClass = 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout:callableObj = > 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.871 INFO:teuthology.orchestra.run.smithi090.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout: try: 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout: callableObj(*args, **kwargs) 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout: except excClass as e: 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout: return e 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout: excName = excClass.__name__ 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout: excName = str(excClass) 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:00:07.872 INFO:teuthology.orchestra.run.smithi090.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on main 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection main prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout:prefix= test-client.0-cbsc2sy2cueuqab- 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket key 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on alt 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection alt prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on tenant 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.873 INFO:teuthology.orchestra.run.smithi090.stdout:Done with cleanup of test buckets. 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout:__________________ test_bucket_create_bad_authorization_empty __________________ 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.auth_common 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout: def test_bucket_create_bad_authorization_empty(): 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout: _add_custom_headers({'Authorization': ''}) 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:294: 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout:excClass = 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout:callableObj = , args = () 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.874 INFO:teuthology.orchestra.run.smithi090.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: try: 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: callableObj(*args, **kwargs) 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: except excClass as e: 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: return e 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: excName = excClass.__name__ 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: excName = str(excClass) 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:00:07.875 INFO:teuthology.orchestra.run.smithi090.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on main 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection main prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout:prefix= test-client.0-cbsc2sy2cueuqab- 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on alt 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection alt prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on tenant 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout:Done with cleanup of test buckets. 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout:__________________ test_bucket_create_bad_authorization_none ___________________ 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.auth_common 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:00:07.876 INFO:teuthology.orchestra.run.smithi090.stdout: def test_bucket_create_bad_authorization_none(): 2024-03-04T13:00:07.877 INFO:teuthology.orchestra.run.smithi090.stdout: _add_custom_headers(remove=('Authorization',)) 2024-03-04T13:00:07.877 INFO:teuthology.orchestra.run.smithi090.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-04T13:00:07.877 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.877 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:305: 2024-03-04T13:00:07.877 INFO:teuthology.orchestra.run.smithi090.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout:excClass = 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout:callableObj = , args = () 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout: try: 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout: callableObj(*args, **kwargs) 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout: except excClass as e: 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout: return e 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.878 INFO:teuthology.orchestra.run.smithi090.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout: excName = excClass.__name__ 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout: excName = str(excClass) 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on main 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection main prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout:prefix= test-client.0-cbsc2sy2cueuqab- 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on alt 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection alt prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.879 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on tenant 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout:Done with cleanup of test buckets. 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout:___________ test_object_create_bad_contentlength_mismatch_below_aws2 ___________ 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.auth_aws2 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout: def test_object_create_bad_contentlength_mismatch_below_aws2(): 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout: check_aws2_support() 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout: content = 'bar' 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout: length = len(content) - 1 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout: key = _setup_bad_object({'Content-Length': length}) 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, content) 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.880 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:321: 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout:excClass = 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout:callableObj = > 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout: try: 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout: callableObj(*args, **kwargs) 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout: except excClass as e: 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout: return e 2024-03-04T13:00:07.881 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout: excName = excClass.__name__ 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout: excName = str(excClass) 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on main 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection main prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout:prefix= test-client.0-cbsc2sy2cueuqab- 2024-03-04T13:00:07.882 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket key 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on alt 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection alt prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on tenant 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout:Done with cleanup of test buckets. 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout:_____________ test_object_create_bad_authorization_incorrect_aws2 ______________ 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.auth_aws2 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout: def test_object_create_bad_authorization_incorrect_aws2(): 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout: check_aws2_support() 2024-03-04T13:00:07.883 INFO:teuthology.orchestra.run.smithi090.stdout: key = _setup_bad_object({'Authorization': 'AWS AKIAIGR7ZNNBHC5BKSUB:FWeDfwojDSdS2Ztmpfeubhd9isU='}) 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:332: 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout:excClass = 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout:callableObj = > 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.884 INFO:teuthology.orchestra.run.smithi090.stdout: try: 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout: callableObj(*args, **kwargs) 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout: except excClass as e: 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout: return e 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout: excName = excClass.__name__ 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout: excName = str(excClass) 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:00:07.885 INFO:teuthology.orchestra.run.smithi090.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on main 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection main prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout:prefix= test-client.0-cbsc2sy2cueuqab- 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket key 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on alt 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection alt prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on tenant 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout:Done with cleanup of test buckets. 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout:______________ test_object_create_bad_authorization_invalid_aws2 _______________ 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.auth_aws2 2024-03-04T13:00:07.886 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout: def test_object_create_bad_authorization_invalid_aws2(): 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout: check_aws2_support() 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout: key = _setup_bad_object({'Authorization': 'AWS HAHAHA'}) 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:343: 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout:excClass = 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout:callableObj = > 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:00:07.887 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout: try: 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout: callableObj(*args, **kwargs) 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout: except excClass as e: 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout: return e 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout: excName = excClass.__name__ 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout: excName = str(excClass) 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:00:07.888 INFO:teuthology.orchestra.run.smithi090.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on main 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection main prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:prefix= test-client.0-cbsc2sy2cueuqab- 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket key 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on alt 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection alt prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on tenant 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:Done with cleanup of test buckets. 2024-03-04T13:00:07.889 INFO:teuthology.orchestra.run.smithi090.stdout:____________________ test_object_create_bad_date_none_aws2 _____________________ 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.auth_aws2 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout: def test_object_create_bad_date_none_aws2(): 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout: check_aws2_support() 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout: key = _setup_bad_object(remove=('Date',)) 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:353: 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout:excClass = 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout:callableObj = > 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:00:07.890 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: try: 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: callableObj(*args, **kwargs) 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: except excClass as e: 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: return e 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: excName = excClass.__name__ 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout: excName = str(excClass) 2024-03-04T13:00:07.891 INFO:teuthology.orchestra.run.smithi090.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on main 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection main prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:prefix= test-client.0-cbsc2sy2cueuqab- 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket key 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on alt 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection alt prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on tenant 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.892 INFO:teuthology.orchestra.run.smithi090.stdout:Done with cleanup of test buckets. 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout:______________ test_bucket_create_bad_authorization_invalid_aws2 _______________ 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.auth_aws2 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout: def test_bucket_create_bad_authorization_invalid_aws2(): 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout: check_aws2_support() 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout: _add_custom_headers({'Authorization': 'AWS HAHAHA'}) 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:363: 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout:excClass = 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout:callableObj = , args = () 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:00:07.893 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout: try: 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout: callableObj(*args, **kwargs) 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout: except excClass as e: 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout: return e 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout: excName = excClass.__name__ 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout: excName = str(excClass) 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:00:07.894 INFO:teuthology.orchestra.run.smithi090.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on main 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection main prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout:prefix= test-client.0-cbsc2sy2cueuqab- 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on alt 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection alt prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on tenant 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout:Done with cleanup of test buckets. 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout:____________________ test_bucket_create_bad_date_none_aws2 _____________________ 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.auth_aws2 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout: def test_bucket_create_bad_date_none_aws2(): 2024-03-04T13:00:07.895 INFO:teuthology.orchestra.run.smithi090.stdout: check_aws2_support() 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout: _add_custom_headers(remove=('Date',)) 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:373: 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout:excClass = 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout:callableObj = , args = () 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.896 INFO:teuthology.orchestra.run.smithi090.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:00:07.897 INFO:teuthology.orchestra.run.smithi090.stdout: """ 2024-03-04T13:00:07.897 INFO:teuthology.orchestra.run.smithi090.stdout: try: 2024-03-04T13:00:07.897 INFO:teuthology.orchestra.run.smithi090.stdout: callableObj(*args, **kwargs) 2024-03-04T13:00:07.897 INFO:teuthology.orchestra.run.smithi090.stdout: except excClass as e: 2024-03-04T13:00:07.897 INFO:teuthology.orchestra.run.smithi090.stdout: return e 2024-03-04T13:00:07.897 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.897 INFO:teuthology.orchestra.run.smithi090.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:00:07.897 INFO:teuthology.orchestra.run.smithi090.stdout: excName = excClass.__name__ 2024-03-04T13:00:07.897 INFO:teuthology.orchestra.run.smithi090.stdout: else: 2024-03-04T13:00:07.897 INFO:teuthology.orchestra.run.smithi090.stdout: excName = str(excClass) 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on main 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection main prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout:prefix= test-client.0-cbsc2sy2cueuqab- 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning bucket 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on alt 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection alt prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting buckets on tenant 2024-03-04T13:00:07.898 INFO:teuthology.orchestra.run.smithi090.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-cbsc2sy2cueuqab-'. 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout:Done with cleanup of test buckets. 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout:=============================== warnings summary =============================== 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout: import imp 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:124 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout: if boto_type is 'S3Connection': 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_headers.py:129 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:129: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout: elif boto_type is 'HTTPRequest': 2024-03-04T13:00:07.899 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3.py:359 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py:176 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout: if k is 'BucketName': 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py:253 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.timeout(10) 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests/functional/test_s3_website.py:1077 2024-03-04T13:00:07.900 INFO:teuthology.orchestra.run.smithi090.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout: @pytest.mark.s3website_routing_rules 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py:2212 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2212: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py:2227 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2227: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py:2233 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2233: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.901 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py:2290 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2290: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py:2305 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2305: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py:2323 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2323: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py:2338 2024-03-04T13:00:07.902 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2338: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py:2356 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2356: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py:2371 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2371: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py:2421 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2421: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-04T13:00:07.903 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py:2453 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2453: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_iam.py: 23 warnings 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3.py: 477 warnings 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi090.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout: warnings.warn( 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout:=========================== short test summary info ============================ 2024-03-04T13:00:07.904 INFO:teuthology.orchestra.run.smithi090.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none 2024-03-04T13:00:07.905 INFO:teuthology.orchestra.run.smithi090.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty 2024-03-04T13:00:07.905 INFO:teuthology.orchestra.run.smithi090.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_none 2024-03-04T13:00:07.905 INFO:teuthology.orchestra.run.smithi090.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty 2024-03-04T13:00:07.905 INFO:teuthology.orchestra.run.smithi090.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none 2024-03-04T13:00:07.905 INFO:teuthology.orchestra.run.smithi090.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 2024-03-04T13:00:07.905 INFO:teuthology.orchestra.run.smithi090.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 2024-03-04T13:00:07.905 INFO:teuthology.orchestra.run.smithi090.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 2024-03-04T13:00:07.905 INFO:teuthology.orchestra.run.smithi090.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 2024-03-04T13:00:07.905 INFO:teuthology.orchestra.run.smithi090.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 2024-03-04T13:00:07.905 INFO:teuthology.orchestra.run.smithi090.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 2024-03-04T13:00:07.905 INFO:teuthology.orchestra.run.smithi090.stdout:= 11 failed, 586 passed, 65 skipped, 124 deselected, 1 xfailed, 580 warnings in 439.30s (0:07:19) = 2024-03-04T13:00:07.997 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: InvocationError for command /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' (exited with code 1) 2024-03-04T13:00:07.997 INFO:teuthology.orchestra.run.smithi090.stdout:___________________________________ summary ____________________________________ 2024-03-04T13:00:07.997 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: py: commands failed 2024-03-04T13:00:08.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T13:00:08.011 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 437, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 380, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi090 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-04T13:00:08.012 INFO:tasks.s3tests:Cleaning up boto... 2024-03-04T13:00:08.013 DEBUG:teuthology.orchestra.run.smithi090:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-03-04T13:00:08.040 INFO:tasks.s3tests:Removing s3-tests... 2024-03-04T13:00:08.040 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-03-04T13:00:08.224 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 703, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 437, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 380, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi090 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-04T13:00:08.429 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c6bc25fad7cd42ef97513ea9bc1600f3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 703, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 437, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 380, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi090 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-04T13:00:08.432 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-03-04T13:00:08.443 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-03-04T13:00:08.484 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-03-04T13:00:08.485 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-03-04T13:00:08.485 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-03-04T13:00:08.550 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-03-04T13:00:08.550 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-03-04T13:00:08.604 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T13:00:08.605 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T13:00:08.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.626+0000 7f2630511800 20 rados->read ofs=0 len=0 2024-03-04T13:00:08.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.627+0000 7f2630511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:08.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.627+0000 7f2630511800 20 realm 2024-03-04T13:00:08.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.627+0000 7f2630511800 20 rados->read ofs=0 len=0 2024-03-04T13:00:08.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.628+0000 7f2630511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:08.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.628+0000 7f2630511800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T13:00:08.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.628+0000 7f2630511800 20 rados->read ofs=0 len=0 2024-03-04T13:00:08.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.628+0000 7f2630511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:08.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.628+0000 7f2630511800 20 rados->read ofs=0 len=0 2024-03-04T13:00:08.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.629+0000 7f2630511800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T13:00:08.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.629+0000 7f2630511800 20 rados->read ofs=0 len=0 2024-03-04T13:00:08.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.629+0000 7f2630511800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T13:00:08.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.629+0000 7f2630511800 20 searching for the correct realm 2024-03-04T13:00:08.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.633+0000 7f262580c640 0 -- 172.21.15.90:0/1063352680 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f261803d040 msgr2=0x7f261802f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T13:00:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.637+0000 7f262580c640 0 -- 172.21.15.90:0/1063352680 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f24f807aab0 msgr2=0x7f24f807cee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T13:00:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.641+0000 7f2630511800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T13:00:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.641+0000 7f2630511800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T13:00:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.641+0000 7f2630511800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T13:00:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.641+0000 7f2630511800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T13:00:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.641+0000 7f2630511800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T13:00:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.641+0000 7f2630511800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T13:00:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.641+0000 7f2630511800 20 rados->read ofs=0 len=0 2024-03-04T13:00:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.641+0000 7f2630511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.641+0000 7f2630511800 20 rados->read ofs=0 len=0 2024-03-04T13:00:08.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.641+0000 7f2630511800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T13:00:08.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.641+0000 7f2630511800 20 rados->read ofs=0 len=0 2024-03-04T13:00:08.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T13:00:08.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 20 zone default found 2024-03-04T13:00:08.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 4 Realm: () 2024-03-04T13:00:08.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T13:00:08.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T13:00:08.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T13:00:08.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 20 zonegroup default 2024-03-04T13:00:08.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 20 rados->read ofs=0 len=0 2024-03-04T13:00:08.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:08.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 20 rados->read ofs=0 len=0 2024-03-04T13:00:08.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:08.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 20 rados->read ofs=0 len=0 2024-03-04T13:00:08.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:08.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 20 started sync module instance, tier type = 2024-03-04T13:00:08.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.642+0000 7f2630511800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T13:00:08.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.651+0000 7f2630511800 20 add_watcher() i=0 2024-03-04T13:00:08.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.651+0000 7f2630511800 20 add_watcher() i=1 2024-03-04T13:00:08.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.651+0000 7f2630511800 20 add_watcher() i=2 2024-03-04T13:00:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.651+0000 7f2630511800 20 add_watcher() i=3 2024-03-04T13:00:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.651+0000 7f2630511800 20 add_watcher() i=4 2024-03-04T13:00:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.651+0000 7f2630511800 20 add_watcher() i=5 2024-03-04T13:00:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.651+0000 7f2630511800 20 add_watcher() i=6 2024-03-04T13:00:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.652+0000 7f2630511800 20 add_watcher() i=7 2024-03-04T13:00:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.652+0000 7f2630511800 2 all 8 watchers are set, enabling cache 2024-03-04T13:00:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.654+0000 7f24e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T13:00:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.654+0000 7f2630511800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T13:00:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.654+0000 7f2630511800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T13:00:08.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.698+0000 7f245f7fe640 20 reqs_thread_entry: start 2024-03-04T13:00:08.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.699+0000 7f2630511800 20 init_complete bucket index max shards: 11 2024-03-04T13:00:08.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.699+0000 7f2630511800 20 Filter name: none 2024-03-04T13:00:08.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.699+0000 7f245d7fa640 20 reqs_thread_entry: start 2024-03-04T13:00:08.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.699+0000 7f2630511800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-03-04T13:00:08.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.699+0000 7f2630511800 20 rados->read ofs=0 len=0 2024-03-04T13:00:08.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.700+0000 7f2630511800 20 rados_obj.operate() r=0 bl.length=449 2024-03-04T13:00:08.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.700+0000 7f2630511800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-03-04T13:00:08.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.700+0000 7f2630511800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-04T13:00:08.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.700+0000 7f2630511800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T13:00:08.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.700+0000 7f2630511800 10 removing key index: IZSGHRIFKBNRJFNKSXIK 2024-03-04T13:00:08.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.701+0000 7f2630511800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:IZSGHRIFKBNRJFNKSXIK, ofs0, ns] 2024-03-04T13:00:08.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.702+0000 7f2511ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627957 cookie 94073640740576 notifier 7827 bl.length()=170 2024-03-04T13:00:08.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.702+0000 7f2630511800 10 removing email index: tester.client.0_test@test.test 2024-03-04T13:00:08.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.703+0000 7f2630511800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-03-04T13:00:08.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.703+0000 7f2511ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627958 cookie 94073640740576 notifier 7827 bl.length()=181 2024-03-04T13:00:08.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.703+0000 7f2630511800 10 removing user buckets index 2024-03-04T13:00:08.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.705+0000 7f2630511800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-03-04T13:00:08.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.705+0000 7f25117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511628040 cookie 94073640752720 notifier 7827 bl.length()=172 2024-03-04T13:00:08.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.705+0000 7f2630511800 10 removing user index: tester.client.0 2024-03-04T13:00:08.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.707+0000 7f2630511800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-03-04T13:00:08.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.707+0000 7f2630511800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-03-04T13:00:08.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.707+0000 7f25117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511628896 cookie 94073640748096 notifier 7827 bl.length()=164 2024-03-04T13:00:08.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.708+0000 7f24e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T13:00:08.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.710+0000 7f2630511800 20 remove_watcher() i=0 2024-03-04T13:00:08.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.710+0000 7f2630511800 2 removed watcher, disabling cache 2024-03-04T13:00:08.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.711+0000 7f2630511800 20 remove_watcher() i=1 2024-03-04T13:00:08.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.712+0000 7f2630511800 20 remove_watcher() i=2 2024-03-04T13:00:08.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.713+0000 7f2630511800 20 remove_watcher() i=3 2024-03-04T13:00:08.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.714+0000 7f2630511800 20 remove_watcher() i=4 2024-03-04T13:00:08.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.715+0000 7f2630511800 20 remove_watcher() i=5 2024-03-04T13:00:08.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.716+0000 7f2630511800 20 remove_watcher() i=6 2024-03-04T13:00:08.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:08.718+0000 7f2630511800 20 remove_watcher() i=7 2024-03-04T13:00:08.735 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-03-04T13:00:08.747 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-03-04T13:00:08.769 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-03-04T13:00:08.822 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-03-04T13:00:08.832 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-03-04T13:00:08.832 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:00:08.833 INFO:tasks.rgw.client.0.smithi090.stdout:2024-03-04T13:00:08.826+0000 7f30ee4a6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 47266) UID: 0 2024-03-04T13:00:08.833 INFO:tasks.rgw.client.0.smithi090.stdout:2024-03-04T13:00:08.826+0000 7f30f1d01880 -1 shutting down 2024-03-04T13:00:10.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-03-04T13:00:14.934 INFO:tasks.rgw.client.0:Stopped 2024-03-04T13:00:14.934 DEBUG:teuthology.orchestra.run.smithi090:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-03-04T13:00:14.967 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f /etc/ceph/vault-root-token 2024-03-04T13:00:15.053 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-03-04T13:00:15.094 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-03-04T13:00:15.095 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-03-04T13:00:15.095 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-03-04T13:00:15.190 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setuser ceph since I am not root 2024-03-04T13:00:15.190 INFO:teuthology.orchestra.run.smithi090.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T13:00:15.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.213+0000 7f4aa2f24800 20 rados->read ofs=0 len=0 2024-03-04T13:00:15.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.214+0000 7f4aa2f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:15.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.214+0000 7f4aa2f24800 20 realm 2024-03-04T13:00:15.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.214+0000 7f4aa2f24800 20 rados->read ofs=0 len=0 2024-03-04T13:00:15.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.214+0000 7f4aa2f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:15.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.214+0000 7f4aa2f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T13:00:15.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.214+0000 7f4aa2f24800 20 rados->read ofs=0 len=0 2024-03-04T13:00:15.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.214+0000 7f4aa2f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:15.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.214+0000 7f4aa2f24800 20 rados->read ofs=0 len=0 2024-03-04T13:00:15.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.216+0000 7f4aa2f24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T13:00:15.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.216+0000 7f4aa2f24800 20 rados->read ofs=0 len=0 2024-03-04T13:00:15.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.216+0000 7f4aa2f24800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T13:00:15.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.216+0000 7f4aa2f24800 20 searching for the correct realm 2024-03-04T13:00:15.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.220+0000 7f4a9f424640 0 -- 172.21.15.90:0/1356638699 >> [v2:172.21.15.90:6800/1270080005,v1:172.21.15.90:6801/1270080005] conn(0x55bfc9526ad0 msgr2=0x55bfc9528f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T13:00:15.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.224+0000 7f4a9e422640 0 -- 172.21.15.90:0/1356638699 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f4a8803d070 msgr2=0x7f4a8800a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T13:00:15.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.229+0000 7f4aa2f24800 20 RGWRados::pool_iterate: got zonegroup_info.559a1484-bf6f-4bd4-83cd-bb97f718e9c9 2024-03-04T13:00:15.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.229+0000 7f4aa2f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T13:00:15.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.229+0000 7f4aa2f24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T13:00:15.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.229+0000 7f4aa2f24800 20 RGWRados::pool_iterate: got zone_info.9ff357d4-34bf-43e3-830f-e9301a1282c1 2024-03-04T13:00:15.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.229+0000 7f4aa2f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T13:00:15.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.229+0000 7f4aa2f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T13:00:15.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.229+0000 7f4aa2f24800 20 rados->read ofs=0 len=0 2024-03-04T13:00:15.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.229+0000 7f4aa2f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:15.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.229+0000 7f4aa2f24800 20 rados->read ofs=0 len=0 2024-03-04T13:00:15.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.229+0000 7f4aa2f24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T13:00:15.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.229+0000 7f4aa2f24800 20 rados->read ofs=0 len=0 2024-03-04T13:00:15.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T13:00:15.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 20 zone default found 2024-03-04T13:00:15.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 4 Realm: () 2024-03-04T13:00:15.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 4 ZoneGroup: default (559a1484-bf6f-4bd4-83cd-bb97f718e9c9) 2024-03-04T13:00:15.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 4 Zone: default (9ff357d4-34bf-43e3-830f-e9301a1282c1) 2024-03-04T13:00:15.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T13:00:15.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 20 zonegroup default 2024-03-04T13:00:15.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 20 rados->read ofs=0 len=0 2024-03-04T13:00:15.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:15.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 20 rados->read ofs=0 len=0 2024-03-04T13:00:15.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:15.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 20 rados->read ofs=0 len=0 2024-03-04T13:00:15.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:00:15.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 20 started sync module instance, tier type = 2024-03-04T13:00:15.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.230+0000 7f4aa2f24800 20 started zone id=9ff357d4-34bf-43e3-830f-e9301a1282c1 (name=default) with tier type = 2024-03-04T13:00:15.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.240+0000 7f4aa2f24800 20 add_watcher() i=0 2024-03-04T13:00:15.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.240+0000 7f4aa2f24800 20 add_watcher() i=1 2024-03-04T13:00:15.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.240+0000 7f4aa2f24800 20 add_watcher() i=2 2024-03-04T13:00:15.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.240+0000 7f4aa2f24800 20 add_watcher() i=3 2024-03-04T13:00:15.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.240+0000 7f4aa2f24800 20 add_watcher() i=4 2024-03-04T13:00:15.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.240+0000 7f4aa2f24800 20 add_watcher() i=5 2024-03-04T13:00:15.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.240+0000 7f4aa2f24800 20 add_watcher() i=6 2024-03-04T13:00:15.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.241+0000 7f4aa2f24800 20 add_watcher() i=7 2024-03-04T13:00:15.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.241+0000 7f4aa2f24800 2 all 8 watchers are set, enabling cache 2024-03-04T13:00:15.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.243+0000 7f49557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T13:00:15.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.243+0000 7f4aa2f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T13:00:15.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.243+0000 7f4aa2f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T13:00:15.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.282+0000 7f48cffff640 20 reqs_thread_entry: start 2024-03-04T13:00:15.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.282+0000 7f4aa2f24800 20 init_complete bucket index max shards: 11 2024-03-04T13:00:15.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.282+0000 7f4aa2f24800 20 Filter name: none 2024-03-04T13:00:15.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.282+0000 7f48cdffb640 20 reqs_thread_entry: start 2024-03-04T13:00:15.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.283+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T13:00:15.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.284+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:15.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.285+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:15.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43986' 2024-03-04T13:00:15.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17474966907573288014', time=2024-03-04T14:53:10.205260+0000, chain.objs.size()=1 2024-03-04T13:00:15.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.171__shadow_.wRSnmuPyIwZH_8t_gRoCret3N98kd5v_0 2024-03-04T13:00:15.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~scqW8wVoRTZivZUbOvEh4wBV9mLcgg0', time=2024-03-04T14:53:25.343139+0000, chain.objs.size()=1 2024-03-04T13:00:15.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.195__multipart_mymultipart.2~scqW8wVoRTZivZUbOvEh4wBV9mLcgg0.1 2024-03-04T13:00:15.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.749410456411238263', time=2024-03-04T14:53:29.418767+0000, chain.objs.size()=1 2024-03-04T13:00:15.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.203__shadow_.QHVUfOBOh-nQOrKQJ6g2XnMbQ6Q3F9k_0 2024-03-04T13:00:15.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7617872456315304140', time=2024-03-04T14:53:43.969486+0000, chain.objs.size()=1 2024-03-04T13:00:15.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.233__shadow_.T6kQlGL8sF7GQZWT_hAZFj_LBOshxLq_0 2024-03-04T13:00:15.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6222983513032943048', time=2024-03-04T14:53:52.048451+0000, chain.objs.size()=1 2024-03-04T13:00:15.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ymqbBnhUvPOWcT-KlPgNbP7i0W95fmg_0 2024-03-04T13:00:15.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7618081120344337144', time=2024-03-04T14:53:52.057864+0000, chain.objs.size()=1 2024-03-04T13:00:15.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.folAvl_2dg-KVqNPMXgo9e-ClIaBNsW_0 2024-03-04T13:00:15.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2829164829448055497', time=2024-03-04T14:53:52.234553+0000, chain.objs.size()=1 2024-03-04T13:00:15.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.2CGwAcComy_ovJ_IEfWoAPjDVhKwU5m_0 2024-03-04T13:00:15.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4567441463879157360', time=2024-03-04T14:53:52.257443+0000, chain.objs.size()=1 2024-03-04T13:00:15.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wCFjZEFR11TPI43TRKQrWd6IpO1lidl_0 2024-03-04T13:00:15.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3090129617092710347', time=2024-03-04T14:53:52.288383+0000, chain.objs.size()=1 2024-03-04T13:00:15.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.El3PaKqHLjsSe2E1g8iPkOMpcdVMKQC_0 2024-03-04T13:00:15.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17161656987511088535', time=2024-03-04T14:53:52.314999+0000, chain.objs.size()=1 2024-03-04T13:00:15.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.seGlQ6sIs7UWkbC6_RQo1rKCs80dVND_0 2024-03-04T13:00:15.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1016762522441130756', time=2024-03-04T14:53:52.413350+0000, chain.objs.size()=1 2024-03-04T13:00:15.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._r_1SeZizYk7G81nohdjXwm4qqzEgIQ_0 2024-03-04T13:00:15.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15512897865783550270', time=2024-03-04T14:53:52.433094+0000, chain.objs.size()=1 2024-03-04T13:00:15.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.286+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mdN9InBCKZyd_skxWt95O27g9Ywdp0R_0 2024-03-04T13:00:15.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1895376476024829827', time=2024-03-04T14:53:52.436199+0000, chain.objs.size()=1 2024-03-04T13:00:15.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.s2Z_MSii9_YPG8P1P1oKM_D-JLWb5Gq_0 2024-03-04T13:00:15.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15792917946791460619', time=2024-03-04T14:53:52.444854+0000, chain.objs.size()=1 2024-03-04T13:00:15.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ku_N0I_WCKV-6imEDiCPTk11iewQy5o_0 2024-03-04T13:00:15.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2274768856973206311', time=2024-03-04T14:53:52.459659+0000, chain.objs.size()=1 2024-03-04T13:00:15.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wiQCtdFlEzv6jthrysUNJClrdnywP1f_0 2024-03-04T13:00:15.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10972079879857057069', time=2024-03-04T14:53:52.476204+0000, chain.objs.size()=1 2024-03-04T13:00:15.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.QsQFYNcBtGooE6yQEcnUcCbwlCE-5pY_0 2024-03-04T13:00:15.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1902876333592325387', time=2024-03-04T14:53:52.564653+0000, chain.objs.size()=1 2024-03-04T13:00:15.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xZ0ocSlVPZFtrWt6JJWy0gfk9IXpwZK_0 2024-03-04T13:00:15.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2334350488240176039', time=2024-03-04T14:53:52.629570+0000, chain.objs.size()=1 2024-03-04T13:00:15.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.fafMy2PBDxlEkuxdi4eizKdghm35lt5_0 2024-03-04T13:00:15.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4502743114280032851', time=2024-03-04T14:53:52.635149+0000, chain.objs.size()=1 2024-03-04T13:00:15.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.hgSYpxcwUiEtLyIaDOcNarXI19nAhTX_0 2024-03-04T13:00:15.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18253914095954388784', time=2024-03-04T14:53:52.644179+0000, chain.objs.size()=1 2024-03-04T13:00:15.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.288+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.D-1-eXxkNcIQHppPZ7l_-_WdxgWD4L7_0 2024-03-04T13:00:15.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.289+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4373274813121696713', time=2024-03-04T14:53:52.650477+0000, chain.objs.size()=1 2024-03-04T13:00:15.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.289+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ibnRflhD2FdzsEmLO8ix884XcIH39xH_0 2024-03-04T13:00:15.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.289+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14309648426937914966', time=2024-03-04T14:53:52.751095+0000, chain.objs.size()=1 2024-03-04T13:00:15.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.289+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jMxlUx--wmuDrqpVhZ6AYERKRYgqF0x_0 2024-03-04T13:00:15.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.290+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17863419182760839573', time=2024-03-04T14:53:52.775709+0000, chain.objs.size()=1 2024-03-04T13:00:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.290+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GrOuBoYCXrT8JYHuqB7nuUzCSk1ggyb_0 2024-03-04T13:00:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.290+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8366477209211534539', time=2024-03-04T14:53:52.788522+0000, chain.objs.size()=1 2024-03-04T13:00:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.290+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wnvEBHDLegmw4Qe5Zf9iyLkPVdI5f11_0 2024-03-04T13:00:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.290+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12516742514182292829', time=2024-03-04T14:53:52.791692+0000, chain.objs.size()=1 2024-03-04T13:00:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.290+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8Vi-StrhCPhAXgJUnY18D2MPSN9wsLF_0 2024-03-04T13:00:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.290+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11786240316073294061', time=2024-03-04T14:53:52.798443+0000, chain.objs.size()=1 2024-03-04T13:00:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.290+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wC7YBCXXixCuYnKfEyJfjMJqyjcYDYd_0 2024-03-04T13:00:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13594088322231735615', time=2024-03-04T14:53:52.821262+0000, chain.objs.size()=1 2024-03-04T13:00:15.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.QpP5e41AUAuPVXYRkF3-6iUATCussmZ_0 2024-03-04T13:00:15.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12360637006100879696', time=2024-03-04T14:53:52.828928+0000, chain.objs.size()=1 2024-03-04T13:00:15.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0dDT9IAmWxg0IB9MZ3v5mkTX0t5SAkQ_0 2024-03-04T13:00:15.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3186141682271657103', time=2024-03-04T14:53:52.948408+0000, chain.objs.size()=1 2024-03-04T13:00:15.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zr9xfwxA9-VhjdDbQBGI2Pb29XmyJ1o_0 2024-03-04T13:00:15.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11874247588345682308', time=2024-03-04T14:53:52.971691+0000, chain.objs.size()=1 2024-03-04T13:00:15.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VhEYLARPz1EVf76PXqPrur7Sw1gD_Bb_0 2024-03-04T13:00:15.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15007614255854114149', time=2024-03-04T14:53:52.972534+0000, chain.objs.size()=1 2024-03-04T13:00:15.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.FzEjqss-gGAjfAEQraWELIsPn-u62l6_0 2024-03-04T13:00:15.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10598523941280189663', time=2024-03-04T14:53:52.974193+0000, chain.objs.size()=1 2024-03-04T13:00:15.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.7U8YU2EFgmWsivCmuXNdyp8Zsvjdl5O_0 2024-03-04T13:00:15.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5324774036576997280', time=2024-03-04T14:53:52.983177+0000, chain.objs.size()=1 2024-03-04T13:00:15.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.291+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.4tVsiC0XnasU5J5UyiQgDxqhBaZ4Irx_0 2024-03-04T13:00:15.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.293+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1006098608573498273', time=2024-03-04T14:53:52.991997+0000, chain.objs.size()=1 2024-03-04T13:00:15.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.293+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.C7mrxrqEr9PMNvTjy8MWDeLDEdIewdj_0 2024-03-04T13:00:15.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.293+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11570477619068956042', time=2024-03-04T14:53:53.004072+0000, chain.objs.size()=1 2024-03-04T13:00:15.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.293+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.FVlhmkYZeRzOF1gzgqZBHjNo8WupEMI_0 2024-03-04T13:00:15.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.293+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15205966331307229367', time=2024-03-04T14:53:53.085485+0000, chain.objs.size()=1 2024-03-04T13:00:15.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.293+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.45780HB1V_ORqMI6kWMlGpZg07kvTSf_0 2024-03-04T13:00:15.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.293+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8888534195702720729', time=2024-03-04T14:53:53.086195+0000, chain.objs.size()=1 2024-03-04T13:00:15.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.293+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.h_tm3aqm95EsBIN4ZR_5NCft1w97JKS_0 2024-03-04T13:00:15.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.293+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7758851003417367738', time=2024-03-04T14:53:53.143041+0000, chain.objs.size()=1 2024-03-04T13:00:15.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.293+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.r4o83V6eF89-Yo-OGLv9vp90Og5FudX_0 2024-03-04T13:00:15.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1409170656673378027', time=2024-03-04T14:53:53.260586+0000, chain.objs.size()=1 2024-03-04T13:00:15.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.WkClIgPiAQDuE0ToXlT4-9hxcwtYcZ7_0 2024-03-04T13:00:15.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9858917883155241551', time=2024-03-04T14:53:53.276791+0000, chain.objs.size()=1 2024-03-04T13:00:15.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.dxXdUdcbcZWzM6ey-_1JRbyKB5dChE1_0 2024-03-04T13:00:15.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7248369083023565554', time=2024-03-04T14:53:53.283896+0000, chain.objs.size()=1 2024-03-04T13:00:15.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.2IBBpQ5BXlNWZR9d9pgtUm-jgJ0HcP0_0 2024-03-04T13:00:15.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17658333177251829387', time=2024-03-04T14:53:53.301133+0000, chain.objs.size()=1 2024-03-04T13:00:15.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.FEgEcw1ifPOTrOuRWPp4S67al04WWAm_0 2024-03-04T13:00:15.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3472115847873392323', time=2024-03-04T14:53:53.331535+0000, chain.objs.size()=1 2024-03-04T13:00:15.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mvVSPQlerBTOgqRZueaSPbls0sdHIm7_0 2024-03-04T13:00:15.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14813008595874014006', time=2024-03-04T14:54:08.249234+0000, chain.objs.size()=1 2024-03-04T13:00:15.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.ePYfq0fgbwyY21O3XHcPTxJYL1no6PL_0 2024-03-04T13:00:15.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.805107471961040554', time=2024-03-04T14:54:09.038211+0000, chain.objs.size()=1 2024-03-04T13:00:15.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.2FMxoS3fbELSnkCQbwAU_3dP9FOS0C-_0 2024-03-04T13:00:15.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8410343245329936108', time=2024-03-04T14:54:09.891508+0000, chain.objs.size()=1 2024-03-04T13:00:15.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.268__shadow_.9i2a1w5XSJmILFFlHnqeHDeJXJHnX0u_0 2024-03-04T13:00:15.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3630773892173412940', time=2024-03-04T14:54:09.892388+0000, chain.objs.size()=1 2024-03-04T13:00:15.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.268__shadow_.IJfzFK2OT-Q-Tx0k_kblQcNx5kVR3Lj_0 2024-03-04T13:00:15.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17228862462284224584', time=2024-03-04T14:54:29.654970+0000, chain.objs.size()=1 2024-03-04T13:00:15.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oDcfedTMDatxnK1U4nJ_42jVwJqy7u-_0 2024-03-04T13:00:15.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6620819705918036940', time=2024-03-04T14:54:29.685137+0000, chain.objs.size()=1 2024-03-04T13:00:15.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4wGMg9Vf0-NvEtV75lLLRZocBqXwZhg_0 2024-03-04T13:00:15.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5742620458294333958', time=2024-03-04T14:54:29.790112+0000, chain.objs.size()=1 2024-03-04T13:00:15.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wtp7YJY4dJcBhCK7ogMIlAqQrOWAfTz_0 2024-03-04T13:00:15.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10245903340370777419', time=2024-03-04T14:54:29.792009+0000, chain.objs.size()=1 2024-03-04T13:00:15.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.qAbRkKyVFlKvnp6eqbfJvNiQ6bsOVOj_0 2024-03-04T13:00:15.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2284519612845647363', time=2024-03-04T14:54:29.793775+0000, chain.objs.size()=1 2024-03-04T13:00:15.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.40nmW2NNAh8OWWqZpSCzh8aKKgz4epr_0 2024-03-04T13:00:15.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10380708326185185481', time=2024-03-04T14:54:29.839628+0000, chain.objs.size()=1 2024-03-04T13:00:15.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.SexEShKUtgMlq-3yvMkEf2J2gIDnDVr_0 2024-03-04T13:00:15.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13803783383408279129', time=2024-03-04T14:54:29.840586+0000, chain.objs.size()=1 2024-03-04T13:00:15.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.A8yyYEdPa4c5D4rMIn1uTYqXP84Jrys_0 2024-03-04T13:00:15.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6382765254125049957', time=2024-03-04T14:54:29.844726+0000, chain.objs.size()=1 2024-03-04T13:00:15.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.sqH5bipc-4EE-dWOKEZ5j_mwD_dJvrO_0 2024-03-04T13:00:15.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15479570037446247570', time=2024-03-04T14:54:29.864712+0000, chain.objs.size()=1 2024-03-04T13:00:15.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-itE9w6sTOrv048GHZAXkMcmFPrtrnk_0 2024-03-04T13:00:15.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6815211427607991511', time=2024-03-04T14:54:29.952844+0000, chain.objs.size()=1 2024-03-04T13:00:15.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.PeqNLgnBoU2dn2Uge42k6o-0RYax6Ht_0 2024-03-04T13:00:15.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2940358082140290491', time=2024-03-04T14:54:29.955145+0000, chain.objs.size()=1 2024-03-04T13:00:15.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.J7vIIxRddCi-DlDkkLZU-yjFWHPz_TD_0 2024-03-04T13:00:15.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3730956291562314230', time=2024-03-04T14:54:29.974116+0000, chain.objs.size()=1 2024-03-04T13:00:15.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.SQn9ph-y0jwgi9J3YepnlMAmV7pIcR1_0 2024-03-04T13:00:15.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15571307292518184536', time=2024-03-04T14:54:29.994045+0000, chain.objs.size()=1 2024-03-04T13:00:15.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.mEocURyH908Kruh-h0dEuBYKnMx63-D_0 2024-03-04T13:00:15.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.305+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7502314653767129392', time=2024-03-04T14:54:29.995564+0000, chain.objs.size()=1 2024-03-04T13:00:15.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.305+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-qwe5xz7klNBE6EqxSEWO3vBXGH0Oea_0 2024-03-04T13:00:15.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.306+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4926837413685718390', time=2024-03-04T14:54:30.113617+0000, chain.objs.size()=1 2024-03-04T13:00:15.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.306+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.UInGuwiHihZXRfqjwN31QsfgELJ0zMJ_0 2024-03-04T13:00:15.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.306+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6563690618953548498', time=2024-03-04T14:54:30.133708+0000, chain.objs.size()=1 2024-03-04T13:00:15.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.306+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4zeOGR8bSBREz9WmqU2RWxHRAjNKYWG_0 2024-03-04T13:00:15.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.306+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11849639513798287660', time=2024-03-04T14:54:30.147977+0000, chain.objs.size()=1 2024-03-04T13:00:15.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.306+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4lOCHhRhJyif_R413YA4RyYTIoSOwjd_0 2024-03-04T13:00:15.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.306+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7108427986947912121', time=2024-03-04T14:54:30.148684+0000, chain.objs.size()=1 2024-03-04T13:00:15.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.306+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.myxjP9Zg_tY8lPjE0tc-YjO44fa6sGl_0 2024-03-04T13:00:15.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.306+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2176674135117303442', time=2024-03-04T14:54:30.151069+0000, chain.objs.size()=1 2024-03-04T13:00:15.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.306+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2pNikKj31Jy1nmuixdkCA7X2orphmr3_0 2024-03-04T13:00:15.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.311+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4339339261483648672', time=2024-03-04T14:54:30.183151+0000, chain.objs.size()=1 2024-03-04T13:00:15.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.311+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oGlrbS6aqlZim2lEDHIR4ajHUjeszKb_0 2024-03-04T13:00:15.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.311+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10513270872698932418', time=2024-03-04T14:54:30.273652+0000, chain.objs.size()=1 2024-03-04T13:00:15.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.311+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VTgzyV-io6o1B7lmFR-ETPfGFmunZ11_0 2024-03-04T13:00:15.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.311+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7447500900858695513', time=2024-03-04T14:54:30.300043+0000, chain.objs.size()=1 2024-03-04T13:00:15.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.311+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.53rfQzidvZkCC9HqjTE7hsE1E6A4k8m_0 2024-03-04T13:00:15.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.311+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8930569262197291397', time=2024-03-04T14:54:30.435303+0000, chain.objs.size()=1 2024-03-04T13:00:15.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.311+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.6bpzWIf__5-VMNSLUOjKSo9bV81iWFv_0 2024-03-04T13:00:15.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.311+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5059091630674408593', time=2024-03-04T14:54:30.441353+0000, chain.objs.size()=1 2024-03-04T13:00:15.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.311+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.07Qlz_QTSTNwuHCmNfvzIDSUGh3Vk5g_0 2024-03-04T13:00:15.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.311+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11784623198839573806', time=2024-03-04T14:54:30.456867+0000, chain.objs.size()=1 2024-03-04T13:00:15.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.311+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.mdVA0bIykF2MviM0quNWkcLtizO-D8F_0 2024-03-04T13:00:15.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.312+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17494973659602297393', time=2024-03-04T14:54:30.480226+0000, chain.objs.size()=1 2024-03-04T13:00:15.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.312+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.PAiLSYmQJL2WbjTrYG3YNG4ycVbtr5V_0 2024-03-04T13:00:15.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.312+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5210193505650038278', time=2024-03-04T14:54:30.481642+0000, chain.objs.size()=1 2024-03-04T13:00:15.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.312+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RxewTkpsYQWrUj3VaOMplmGZ5gZQVAj_0 2024-03-04T13:00:15.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.312+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12566976969336970601', time=2024-03-04T14:54:30.496552+0000, chain.objs.size()=1 2024-03-04T13:00:15.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.312+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.TzPBiE-fgg8w3hQmVtN-qwAK2UWoAkn_0 2024-03-04T13:00:15.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.312+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2813721292541909708', time=2024-03-04T14:54:30.580429+0000, chain.objs.size()=1 2024-03-04T13:00:15.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.312+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.T0tO5Lw5I8sJbzLd94qIDSXc6Zez7rz_0 2024-03-04T13:00:15.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.312+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12331928745445810953', time=2024-03-04T14:54:30.592760+0000, chain.objs.size()=1 2024-03-04T13:00:15.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.312+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FMCYpp3hValmDNISoiht43pBzoRe6oE_0 2024-03-04T13:00:15.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.315+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14351271005840457494', time=2024-03-04T14:54:30.666006+0000, chain.objs.size()=1 2024-03-04T13:00:15.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.315+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.xUtJMxIyiRb_e-Am-VvXBKi1X_QrKLz_0 2024-03-04T13:00:15.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14694329182372155880', time=2024-03-04T14:54:30.754749+0000, chain.objs.size()=1 2024-03-04T13:00:15.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.r8FU6tLubVb9qYKHDUj3uzgflfahOv9_0 2024-03-04T13:00:15.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14121653881462785915', time=2024-03-04T14:54:30.762366+0000, chain.objs.size()=1 2024-03-04T13:00:15.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.suiDQEIBSQDwjm3WxClm15eIy1IO2jf_0 2024-03-04T13:00:15.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12016082176373372090', time=2024-03-04T14:54:30.795745+0000, chain.objs.size()=1 2024-03-04T13:00:15.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Ha5TrQR4uoTLdlxgBzGAmcBCF3dy0sh_0 2024-03-04T13:00:15.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12780791045905126502', time=2024-03-04T14:54:38.356607+0000, chain.objs.size()=1 2024-03-04T13:00:15.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.XyHBTIz-ieUZHVi5pCEzYgajP7L6wiv_0 2024-03-04T13:00:15.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.119340646071374062', time=2024-03-04T14:54:38.360979+0000, chain.objs.size()=1 2024-03-04T13:00:15.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.GC_mT8cxdrwxoTG7EZUkbkCq_YwGbzm_0 2024-03-04T13:00:15.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17809706214962175735', time=2024-03-04T14:54:38.490772+0000, chain.objs.size()=1 2024-03-04T13:00:15.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.o0pkfWEns2EAW5wl0M1XsDN9m6ljgdW_0 2024-03-04T13:00:15.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7941129422381367489', time=2024-03-04T14:54:38.498441+0000, chain.objs.size()=1 2024-03-04T13:00:15.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kN4Ei3SSeFilLSRkU0cFEj53tNegEYZ_0 2024-03-04T13:00:15.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1536635470906491962', time=2024-03-04T14:54:38.499676+0000, chain.objs.size()=1 2024-03-04T13:00:15.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Or8kqTnSgbAcDT-YgFWr1ilqaqtHKja_0 2024-03-04T13:00:15.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4029592968098389461', time=2024-03-04T14:54:38.677693+0000, chain.objs.size()=1 2024-03-04T13:00:15.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.1uPGEsv0SogPZUNuHKEbU0ElcIaR-EA_0 2024-03-04T13:00:15.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3395049199197023321', time=2024-03-04T14:54:38.680179+0000, chain.objs.size()=1 2024-03-04T13:00:15.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jmNLBQ95RLCRZynZq4O8Djkz0HpGAFH_0 2024-03-04T13:00:15.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5450272081847617600', time=2024-03-04T14:54:38.697515+0000, chain.objs.size()=1 2024-03-04T13:00:15.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.318+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.8lwpNtDIVvXywozmck_8yI4TmvSsGzq_0 2024-03-04T13:00:15.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1139473148631079911', time=2024-03-04T14:54:38.708047+0000, chain.objs.size()=1 2024-03-04T13:00:15.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.GF6SV-QmifQjDKCCf1m5_jo4N57c3Mb_0 2024-03-04T13:00:15.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3162937117382906900', time=2024-03-04T14:54:38.812429+0000, chain.objs.size()=1 2024-03-04T13:00:15.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.i541iqPOWjej5J7EpmVacjY9xli3e8h_0 2024-03-04T13:00:15.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9595581677332701590', time=2024-03-04T14:54:38.831028+0000, chain.objs.size()=1 2024-03-04T13:00:15.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wITTlWvTi1szzNDeKQWtkVbNqkGeBfh_0 2024-03-04T13:00:15.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11093198759383637711', time=2024-03-04T14:54:38.837122+0000, chain.objs.size()=1 2024-03-04T13:00:15.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rZo-T7rtlfK1JumvZYr_pMcO0-fX0D5_0 2024-03-04T13:00:15.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13690852860831961724', time=2024-03-04T14:54:38.958357+0000, chain.objs.size()=1 2024-03-04T13:00:15.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.b74Jn9nCkUti_MkGTxTQSrRF1J_rBBI_0 2024-03-04T13:00:15.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4690376740091528458', time=2024-03-04T14:54:39.000966+0000, chain.objs.size()=1 2024-03-04T13:00:15.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.MxDTXEe48n7DI7HBabY_W4leTY9GNrG_0 2024-03-04T13:00:15.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16948501407596871448', time=2024-03-04T14:54:39.004738+0000, chain.objs.size()=1 2024-03-04T13:00:15.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VQ5imPgYFaCigV4QIUtmMK3Jdd3k5af_0 2024-03-04T13:00:15.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.77571195317849958', time=2024-03-04T14:54:39.012792+0000, chain.objs.size()=1 2024-03-04T13:00:15.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.nitWetrlkchFJ8fepy8slVUMGWtcTxK_0 2024-03-04T13:00:15.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15587905628465511028', time=2024-03-04T14:54:39.108263+0000, chain.objs.size()=1 2024-03-04T13:00:15.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Yi-Uur8S8MC70bjrUb0EprWQtSsUQ5z_0 2024-03-04T13:00:15.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12064485917456772868', time=2024-03-04T14:54:39.129640+0000, chain.objs.size()=1 2024-03-04T13:00:15.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Z2fqpiBbuzEL81Lp7v2Jk5aiXsCruHf_0 2024-03-04T13:00:15.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10679413658310759928', time=2024-03-04T14:54:39.266462+0000, chain.objs.size()=1 2024-03-04T13:00:15.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zGXtyqwyKCPCgIbul6w-NaNlYKXja9J_0 2024-03-04T13:00:15.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.338+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/43986 2024-03-04T13:00:15.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-03-04T13:00:15.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4678197010881561442', time=2024-03-04T14:54:39.274099+0000, chain.objs.size()=1 2024-03-04T13:00:15.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.yIuVPAdBK-JB6_z3lmfrCCpA9cv3xbp_0 2024-03-04T13:00:15.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7715736141482454651', time=2024-03-04T14:54:39.313121+0000, chain.objs.size()=1 2024-03-04T13:00:15.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2ZMwjshGuGIF3KGrrihlu1lGFrf_SoZ_0 2024-03-04T13:00:15.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.450103383921197339', time=2024-03-04T14:54:39.324131+0000, chain.objs.size()=1 2024-03-04T13:00:15.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.UO1SE0TatSFguaBRq3aal6OcHl0uxA0_0 2024-03-04T13:00:15.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11005940853099356520', time=2024-03-04T14:54:39.327655+0000, chain.objs.size()=1 2024-03-04T13:00:15.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gJvddI9ixs-sT6kq0J5deN__9AKLsd7_0 2024-03-04T13:00:15.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2513753597372481500', time=2024-03-04T14:54:39.435180+0000, chain.objs.size()=1 2024-03-04T13:00:15.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IFwK8XcS461JjQtu1bOoYsk8WK2GiMp_0 2024-03-04T13:00:15.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1345590920732784365', time=2024-03-04T14:54:39.437299+0000, chain.objs.size()=1 2024-03-04T13:00:15.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.k9KOiB-E0cTwl5MfFUz4fm91Ji4IiiF_0 2024-03-04T13:00:15.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9939651354495336089', time=2024-03-04T14:54:39.456397+0000, chain.objs.size()=1 2024-03-04T13:00:15.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gGPAcqJTxPJtwj6y0Pb75mduJp8THyI_0 2024-03-04T13:00:15.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2303878152600387345', time=2024-03-04T14:54:39.472728+0000, chain.objs.size()=1 2024-03-04T13:00:15.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._KHVvZtLyAfbZMLfmSEOubrWeXuaefh_0 2024-03-04T13:00:15.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1940056797070066254', time=2024-03-04T14:55:29.591176+0000, chain.objs.size()=1 2024-03-04T13:00:15.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.407__shadow_.qU7vKs4wKIrmOQoE6A2n0TWRWA92a71_0 2024-03-04T13:00:15.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.832840380860298533', time=2024-03-04T14:55:43.307812+0000, chain.objs.size()=1 2024-03-04T13:00:15.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.432__shadow_.dMYikdtobfP0An8vJivzrrDlH7JwHSz_0 2024-03-04T13:00:15.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13842490425500641772', time=2024-03-04T14:57:24.649420+0000, chain.objs.size()=1 2024-03-04T13:00:15.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.540__shadow_.67yU16UoQx0SAry6PKqRvvIlrkqKKM1_0 2024-03-04T13:00:15.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17700100989462507852', time=2024-03-04T14:57:29.888602+0000, chain.objs.size()=1 2024-03-04T13:00:15.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.340+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.542__shadow:f5ylEJnMLG.VXcKAa8IvT92LUfzY7vg_.c9qtB462Pcie1CtQccMSk7qFWyTtDbt_0 2024-03-04T13:00:15.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.342+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5060159303474693827', time=2024-03-04T14:57:33.659490+0000, chain.objs.size()=1 2024-03-04T13:00:15.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.342+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:fUQJH-yyJiXsJ0SKAtcy7Z44KHRnfbo_.58JGsn3X6TePwDESc16Iv87FEVOJcxt_0 2024-03-04T13:00:15.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.968812932606063577', time=2024-03-04T14:57:40.306754+0000, chain.objs.size()=1 2024-03-04T13:00:15.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:C6ZSr.WwJicLGe0DuVFwq2b9iuAzjLe_.X49DooSiF0c8zVdwXh_PG190oZ-inxr_0 2024-03-04T13:00:15.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11592172957146761516', time=2024-03-04T14:57:59.411161+0000, chain.objs.size()=1 2024-03-04T13:00:15.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.572__shadow_.gebM1nHFzqB8g9526DEKr9iDTdrEHVn_0 2024-03-04T13:00:15.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.348+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16355239258951091414', time=2024-03-04T14:58:30.886914+0000, chain.objs.size()=6 2024-03-04T13:00:15.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.348+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.623__multipart_baz.2~inUV336A3Bi5dcVenWbj8zviXC0Ofns.1 2024-03-04T13:00:15.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.348+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.623__multipart_baz.2~inUV336A3Bi5dcVenWbj8zviXC0Ofns.2 2024-03-04T13:00:15.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.348+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.623__multipart_baz.2~inUV336A3Bi5dcVenWbj8zviXC0Ofns.3 2024-03-04T13:00:15.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.348+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.623__multipart_baz.2~inUV336A3Bi5dcVenWbj8zviXC0Ofns.4 2024-03-04T13:00:15.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.348+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.623__multipart_baz.2~inUV336A3Bi5dcVenWbj8zviXC0Ofns.5 2024-03-04T13:00:15.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.348+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.623__multipart_baz.2~inUV336A3Bi5dcVenWbj8zviXC0Ofns.6 2024-03-04T13:00:15.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.348+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8010676407093579718', time=2024-03-04T14:58:34.097887+0000, chain.objs.size()=1 2024-03-04T13:00:15.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.348+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.630__shadow_.q-v1zEH0kKh-R91EB_Gs7H1ENkg514L_0 2024-03-04T13:00:15.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.352+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:15.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.355+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T13:00:15.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.356+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:15.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.356+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:15.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/72942' 2024-03-04T13:00:15.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_0VDphmYG43ec4DVlEdhjGy98t5GKM6b', time=2024-03-04T14:53:00.281821+0000, chain.objs.size()=1 2024-03-04T13:00:15.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.156__shadow_.POlfr4dmElq-sK-4OIrtZYor3zHJ4Bd_0 2024-03-04T13:00:15.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5769004962396571472', time=2024-03-04T14:53:02.579891+0000, chain.objs.size()=1 2024-03-04T13:00:15.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.164__shadow_.OeTY2yfURBnFnMWkvB094NWMELW-9Ue_0 2024-03-04T13:00:15.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7180168445802939816', time=2024-03-04T14:53:36.112474+0000, chain.objs.size()=1 2024-03-04T13:00:15.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.216__shadow_.dl32QD7LY1FkpSZLw4rGDeR-IB2jD1-_0 2024-03-04T13:00:15.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9250287935649292132', time=2024-03-04T14:53:38.670256+0000, chain.objs.size()=1 2024-03-04T13:00:15.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.221__shadow_.JJmf6PDENjs2l-ZzeBycFXAmMZspVK9_0 2024-03-04T13:00:15.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7940999101316377184', time=2024-03-04T14:53:44.380038+0000, chain.objs.size()=1 2024-03-04T13:00:15.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.234__shadow_.Yz6hIP-c_bJplYUjAZE7xeMA9Lo36ha_0 2024-03-04T13:00:15.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13135725116840200105', time=2024-03-04T14:53:52.061967+0000, chain.objs.size()=1 2024-03-04T13:00:15.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.FQndCAjQ4zkuV5_JhWdJ15vI0ctesOS_0 2024-03-04T13:00:15.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10632767115915645401', time=2024-03-04T14:53:52.136889+0000, chain.objs.size()=1 2024-03-04T13:00:15.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.aEw9IXY5MLwd8fvD5OFysjvtWOHSlJI_0 2024-03-04T13:00:15.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5323980176526987711', time=2024-03-04T14:53:52.217208+0000, chain.objs.size()=1 2024-03-04T13:00:15.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.szCXmUHGLPbRw2egGh7AdhOrV4IsTog_0 2024-03-04T13:00:15.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.983406263345313983', time=2024-03-04T14:53:52.272138+0000, chain.objs.size()=1 2024-03-04T13:00:15.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.gdjS--e18N-zrJ3G9TpgZsarq4KqkNW_0 2024-03-04T13:00:15.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12271127346806472719', time=2024-03-04T14:53:52.294914+0000, chain.objs.size()=1 2024-03-04T13:00:15.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.gyEWBVxYxaNL6FhuLTizzXRWRVYgHhS_0 2024-03-04T13:00:15.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7549315875189594558', time=2024-03-04T14:53:52.435835+0000, chain.objs.size()=1 2024-03-04T13:00:15.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jutpG1762I_rHaBy3THtmPIRxblBC_j_0 2024-03-04T13:00:15.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12153769775668531901', time=2024-03-04T14:53:52.466430+0000, chain.objs.size()=1 2024-03-04T13:00:15.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.rzglbwEA0dJ8jjJnrcMXfwfQaR7QexG_0 2024-03-04T13:00:15.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12260302767692432235', time=2024-03-04T14:53:52.487561+0000, chain.objs.size()=1 2024-03-04T13:00:15.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ih_nHrtMZvk4WuXw2I5pIjVaKAH3ze1_0 2024-03-04T13:00:15.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2954838838758294184', time=2024-03-04T14:53:52.574994+0000, chain.objs.size()=1 2024-03-04T13:00:15.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.XF4ehNQTe-A_A8TahHvQMF6OB7wySt8_0 2024-03-04T13:00:15.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1177999317497771822', time=2024-03-04T14:53:52.610071+0000, chain.objs.size()=1 2024-03-04T13:00:15.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.EqJaHQylFF2XYga2eULTJj5QF9nU_Z8_0 2024-03-04T13:00:15.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3738633476832232618', time=2024-03-04T14:53:52.757808+0000, chain.objs.size()=1 2024-03-04T13:00:15.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Yl_HYoIGAb8SYEM6WyciEtRNwgXjfBK_0 2024-03-04T13:00:15.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.362+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11487790899429219977', time=2024-03-04T14:53:52.762063+0000, chain.objs.size()=1 2024-03-04T13:00:15.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.362+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.uCbF0Tj6IfKMfxVukg6RHVXini_OMPq_0 2024-03-04T13:00:15.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.362+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1233597238786654075', time=2024-03-04T14:53:52.803849+0000, chain.objs.size()=1 2024-03-04T13:00:15.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.362+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.50n50IJXsdkGKUVleJVGqQm4nveugSa_0 2024-03-04T13:00:15.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.362+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12887320215378237302', time=2024-03-04T14:53:52.920880+0000, chain.objs.size()=1 2024-03-04T13:00:15.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.362+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HYlib2cxKW0czfy_vYo7YbLCeetXsY__0 2024-03-04T13:00:15.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1459470752326902197', time=2024-03-04T14:53:52.961771+0000, chain.objs.size()=1 2024-03-04T13:00:15.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.j61pqnFD4PkSsdHdFiOLGJeCgnqZixD_0 2024-03-04T13:00:15.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15900410699717882937', time=2024-03-04T14:53:52.982666+0000, chain.objs.size()=1 2024-03-04T13:00:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.U_u4oKPDl0PouUQbH-Yhg4hBiv6-gQg_0 2024-03-04T13:00:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13960878324405973348', time=2024-03-04T14:53:52.998282+0000, chain.objs.size()=1 2024-03-04T13:00:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.a-gnLJh6JVam-7f-urq-JV3081wOfhy_0 2024-03-04T13:00:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5756741832859011748', time=2024-03-04T14:53:53.256608+0000, chain.objs.size()=1 2024-03-04T13:00:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LZp3CJW59o1fsLjYIRlmZ8syQPhaaFy_0 2024-03-04T13:00:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16815949970102967880', time=2024-03-04T14:53:56.562741+0000, chain.objs.size()=1 2024-03-04T13:00:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.240__shadow_.FLwUaOLx_mF_krGzBwOo393iHmpxsOe_0 2024-03-04T13:00:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5941022995713093770', time=2024-03-04T14:54:04.013633+0000, chain.objs.size()=1 2024-03-04T13:00:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.257__shadow_.ffClqYXi2qA_Dvjl4NeUqTQo9aX3c5X_0 2024-03-04T13:00:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4976687588666818177', time=2024-03-04T14:54:05.862268+0000, chain.objs.size()=1 2024-03-04T13:00:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.261__shadow_.hvHYgrmslRQkJT-m0zWMqe6OcRcmp5f_0 2024-03-04T13:00:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11799514752966749128', time=2024-03-04T14:54:12.206028+0000, chain.objs.size()=1 2024-03-04T13:00:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.273__shadow_.l1qgx07yNwH2HDF9BZO4GvuI4x1AjJp_0 2024-03-04T13:00:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12014745398143804167', time=2024-03-04T14:54:29.615469+0000, chain.objs.size()=1 2024-03-04T13:00:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yWJBAalh8dnDU-iXI2biLZhuJIJ9gPw_0 2024-03-04T13:00:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18145898720875189415', time=2024-03-04T14:54:29.629033+0000, chain.objs.size()=1 2024-03-04T13:00:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YMK9zEMwEtPNcnP9Vids4Gc2SDiW1rS_0 2024-03-04T13:00:15.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13495578426260737903', time=2024-03-04T14:54:29.654562+0000, chain.objs.size()=1 2024-03-04T13:00:15.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.367+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ejOb3y3fSOm2iNqI0l_fsNt4hBWWdVA_0 2024-03-04T13:00:15.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2642073445353492356', time=2024-03-04T14:54:29.778905+0000, chain.objs.size()=1 2024-03-04T13:00:15.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0qkkcyyYP0wnBLzSBKaMP_nicR99tee_0 2024-03-04T13:00:15.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15292554168057613721', time=2024-03-04T14:54:29.787897+0000, chain.objs.size()=1 2024-03-04T13:00:15.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.W17yZ5Y7BKMOlTgJvFQVQzjRqJg8B3T_0 2024-03-04T13:00:15.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15444841411743355758', time=2024-03-04T14:54:29.849796+0000, chain.objs.size()=1 2024-03-04T13:00:15.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Ua2ugmnlrlyhHRTU1D-TsRtH2f4kSRb_0 2024-03-04T13:00:15.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5701807641682655464', time=2024-03-04T14:54:29.966319+0000, chain.objs.size()=1 2024-03-04T13:00:15.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.BRkJwmWw6uXUaPLEC3K6mh1mQRgtYCc_0 2024-03-04T13:00:15.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9852967646882211650', time=2024-03-04T14:54:30.021673+0000, chain.objs.size()=1 2024-03-04T13:00:15.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7DyywHIP4_ykHmOqLy-kiszMbbHJNVL_0 2024-03-04T13:00:15.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1512391550158412977', time=2024-03-04T14:54:30.022399+0000, chain.objs.size()=1 2024-03-04T13:00:15.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.bAWFukWbZ-EiwsIq6NVGFjAhf_qZzBT_0 2024-03-04T13:00:15.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.664793586986716333', time=2024-03-04T14:54:30.159166+0000, chain.objs.size()=1 2024-03-04T13:00:15.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.szypZOVl_3eo_G6xmDgSsZHGxYROH9C_0 2024-03-04T13:00:15.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7238208629162168003', time=2024-03-04T14:54:30.160599+0000, chain.objs.size()=1 2024-03-04T13:00:15.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.8EQW0QweDnF3MGkAlQYIZoHS8V_2ffx_0 2024-03-04T13:00:15.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1085081605049241709', time=2024-03-04T14:54:30.179331+0000, chain.objs.size()=1 2024-03-04T13:00:15.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.CPABL-u_D1zymF2jhqWNR7ig4Gu6R_5_0 2024-03-04T13:00:15.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4949145399282791128', time=2024-03-04T14:54:30.327638+0000, chain.objs.size()=1 2024-03-04T13:00:15.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.BIJpzXw1dktrm8CJaWWxp8EDPbPCtQ5_0 2024-03-04T13:00:15.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16322060838662805283', time=2024-03-04T14:54:30.329975+0000, chain.objs.size()=1 2024-03-04T13:00:15.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ZpGbwr8ZSLthO9xUN2AvQyQvfhFbQWi_0 2024-03-04T13:00:15.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.375+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12669087925065304824', time=2024-03-04T14:54:30.460777+0000, chain.objs.size()=1 2024-03-04T13:00:15.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.375+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.B20NB9lD7kgWXTjzLRkCHmZWDQugB2Y_0 2024-03-04T13:00:15.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.375+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12152512506495752656', time=2024-03-04T14:54:30.504801+0000, chain.objs.size()=1 2024-03-04T13:00:15.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.375+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ssBcUZruF5n6e8VDNLhmfAGAEqRN9Tw_0 2024-03-04T13:00:15.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.378+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6219407506015891235', time=2024-03-04T14:54:30.601755+0000, chain.objs.size()=1 2024-03-04T13:00:15.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.378+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-KSacmEjZo81Mo-Ac0_jidceWcEyzet_0 2024-03-04T13:00:15.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.378+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15240557948628703426', time=2024-03-04T14:54:30.620073+0000, chain.objs.size()=1 2024-03-04T13:00:15.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.378+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tn4LvM6psVzZSMGs_qeCUEzARI7DJ8w_0 2024-03-04T13:00:15.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.378+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12023070449940435825', time=2024-03-04T14:54:30.620796+0000, chain.objs.size()=1 2024-03-04T13:00:15.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.378+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VQTCc19GAiRbMgDUPXVZr6N9lt9AbU__0 2024-03-04T13:00:15.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.378+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17980930650223743730', time=2024-03-04T14:54:30.632795+0000, chain.objs.size()=1 2024-03-04T13:00:15.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.378+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.s985BL6LVWS-cho8ks5Ys-ce3mJcsQe_0 2024-03-04T13:00:15.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.378+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.969709808252820362', time=2024-03-04T14:54:30.637806+0000, chain.objs.size()=1 2024-03-04T13:00:15.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.378+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.emIem0DXMFNpK72dCWYkxZTfo2whagq_0 2024-03-04T13:00:15.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.378+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5994839223923539660', time=2024-03-04T14:54:30.662709+0000, chain.objs.size()=1 2024-03-04T13:00:15.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.378+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7u8y5caFP4ZwZT-C_9cw64qL3ZzqT2o_0 2024-03-04T13:00:15.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.379+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1495901061683852951', time=2024-03-04T14:54:30.742210+0000, chain.objs.size()=1 2024-03-04T13:00:15.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.379+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wJRd01dDwu0gnqtUBwwCfrs_lizKxet_0 2024-03-04T13:00:15.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.379+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15723688740606298324', time=2024-03-04T14:54:30.779015+0000, chain.objs.size()=1 2024-03-04T13:00:15.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.379+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YSwx6Yj6-QSJ6ljqpjkkvkZoG6RVgSK_0 2024-03-04T13:00:15.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.379+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2255704432438024656', time=2024-03-04T14:54:30.790139+0000, chain.objs.size()=1 2024-03-04T13:00:15.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.379+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.OYRBKt4YTpXXmPo59oT-u89yPDT7Ol5_0 2024-03-04T13:00:15.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.379+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5559040581040716775', time=2024-03-04T14:54:38.292128+0000, chain.objs.size()=1 2024-03-04T13:00:15.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.379+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.CLQtrIDegu83cfBc8oMh6D1xxfOelFx_0 2024-03-04T13:00:15.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.379+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15658409077667033080', time=2024-03-04T14:54:38.313255+0000, chain.objs.size()=1 2024-03-04T13:00:15.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.379+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7mr9cnPR31-2wspkYF8fIgEtat5XaxQ_0 2024-03-04T13:00:15.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.380+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2963654953041028799', time=2024-03-04T14:54:38.339017+0000, chain.objs.size()=1 2024-03-04T13:00:15.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.380+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Cy217zPadw02WqiiVqcKI3C8Ep3LkNh_0 2024-03-04T13:00:15.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.381+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7634435165230115362', time=2024-03-04T14:54:38.350257+0000, chain.objs.size()=1 2024-03-04T13:00:15.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.381+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.TAOHv-OUmB6xuft8svjCeRQqTFzSEXB_0 2024-03-04T13:00:15.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.381+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7410105854840689980', time=2024-03-04T14:54:38.362749+0000, chain.objs.size()=1 2024-03-04T13:00:15.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.381+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.bR0cZ1YfvMTIVCSeAsUMtPt937Yl6w5_0 2024-03-04T13:00:15.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.383+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15698534262486110103', time=2024-03-04T14:54:38.369904+0000, chain.objs.size()=1 2024-03-04T13:00:15.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.383+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zXttsFGdJb8L00nU4BzQEJlwnaO6PbN_0 2024-03-04T13:00:15.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.383+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1712568178504022338', time=2024-03-04T14:54:38.374116+0000, chain.objs.size()=1 2024-03-04T13:00:15.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.383+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5dUFstm36HRYKFeVPdzmbfJ3noKK4Su_0 2024-03-04T13:00:15.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.383+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2512477823188281948', time=2024-03-04T14:54:38.458378+0000, chain.objs.size()=1 2024-03-04T13:00:15.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.383+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.85WlPHC66wZgmnjBgSLRrrZSekPizEb_0 2024-03-04T13:00:15.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18411758372875183716', time=2024-03-04T14:54:38.493249+0000, chain.objs.size()=1 2024-03-04T13:00:15.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.386+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.sJtttpByLzZAwrHG3j2m0h1dtmzLVku_0 2024-03-04T13:00:15.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8400552543801568803', time=2024-03-04T14:54:38.504270+0000, chain.objs.size()=1 2024-03-04T13:00:15.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.386+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0yyyBR6BPO0AX-plgewh_kk7EEJRR5h_0 2024-03-04T13:00:15.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7209598618800324463', time=2024-03-04T14:54:38.622532+0000, chain.objs.size()=1 2024-03-04T13:00:15.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.386+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.MBqOkHDUoyhY3o9l3RUuXjmDrD7trO4_0 2024-03-04T13:00:15.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18355312442312352693', time=2024-03-04T14:54:38.636488+0000, chain.objs.size()=1 2024-03-04T13:00:15.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.386+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Ndid4wvbwv_QEF7mJNMi6OM8pe6Z5Y7_0 2024-03-04T13:00:15.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1685577460793857942', time=2024-03-04T14:54:38.649028+0000, chain.objs.size()=1 2024-03-04T13:00:15.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.386+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.hACDo2SBNzgN8ZrTjgoXMHU9F8Z0npI_0 2024-03-04T13:00:15.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2918287990200916540', time=2024-03-04T14:54:38.663003+0000, chain.objs.size()=1 2024-03-04T13:00:15.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.386+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.FIsU059jTK3L1iGmpMO_7o3F3FVElsr_0 2024-03-04T13:00:15.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.387+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14856639622427841973', time=2024-03-04T14:54:38.697345+0000, chain.objs.size()=1 2024-03-04T13:00:15.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.387+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.1Fx3vsL5Cw-HfILoFBamOOK29Wtbj-c_0 2024-03-04T13:00:15.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.387+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1589886575782695478', time=2024-03-04T14:54:38.797541+0000, chain.objs.size()=1 2024-03-04T13:00:15.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.387+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.BdIQ9C8ztzWcATEdONgpbRL5Sn8hZDd_0 2024-03-04T13:00:15.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.387+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.887321369983504638', time=2024-03-04T14:54:38.838230+0000, chain.objs.size()=1 2024-03-04T13:00:15.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.387+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.14PSvxNzk-B1jUtK87R5euvlpPwZJyB_0 2024-03-04T13:00:15.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.387+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15526242510909332072', time=2024-03-04T14:54:38.851289+0000, chain.objs.size()=1 2024-03-04T13:00:15.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.387+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.lPrmT9SEEnqronsWXaVLf0qc-xgxiQ6_0 2024-03-04T13:00:15.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.387+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7261835547260044234', time=2024-03-04T14:54:38.857004+0000, chain.objs.size()=1 2024-03-04T13:00:15.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.387+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Y-OI-UFlxFAJkU61CUwKrU03imyeWjt_0 2024-03-04T13:00:15.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.387+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3627885063826350209', time=2024-03-04T14:54:38.860833+0000, chain.objs.size()=1 2024-03-04T13:00:15.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.387+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.WQc0AP0vYZpeRi9KzoZOjcI3f1dJvrH_0 2024-03-04T13:00:15.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.388+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5839324119551718423', time=2024-03-04T14:54:38.862067+0000, chain.objs.size()=1 2024-03-04T13:00:15.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.388+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Mbg4cHFwLg8Rt1AF6_hre6uJO67D2-1_0 2024-03-04T13:00:15.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4584274738523559311', time=2024-03-04T14:54:38.869154+0000, chain.objs.size()=1 2024-03-04T13:00:15.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.urRl66avTI-ufL21jCtWVDAdLeAOOs6_0 2024-03-04T13:00:15.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15775427945033493126', time=2024-03-04T14:54:38.974644+0000, chain.objs.size()=1 2024-03-04T13:00:15.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gJmlyK5dBvNhGkfL6ZbLDO0aAPU1NWp_0 2024-03-04T13:00:15.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13694374896867628741', time=2024-03-04T14:54:38.979880+0000, chain.objs.size()=1 2024-03-04T13:00:15.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.voNqkZr-inDkGFgJAokSwlc9942Uiv4_0 2024-03-04T13:00:15.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7968870807464930265', time=2024-03-04T14:54:38.990205+0000, chain.objs.size()=1 2024-03-04T13:00:15.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.c87Gs3stHRIIN-frOggRhqKVwP0WfPV_0 2024-03-04T13:00:15.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5960622845798753262', time=2024-03-04T14:54:39.002615+0000, chain.objs.size()=1 2024-03-04T13:00:15.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pmyDgVweDMEfXw-pjaeBjA0sGHXb0Rx_0 2024-03-04T13:00:15.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7276699198913833727', time=2024-03-04T14:54:39.007628+0000, chain.objs.size()=1 2024-03-04T13:00:15.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.CMr91kyVL9gm09rx-N3T6LBba7u7f88_0 2024-03-04T13:00:15.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10522732527765389704', time=2024-03-04T14:54:39.018838+0000, chain.objs.size()=1 2024-03-04T13:00:15.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.bZjXkU-974xQ94YtTJel-vpMKA4EOl2_0 2024-03-04T13:00:15.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14359219884277704436', time=2024-03-04T14:54:39.106556+0000, chain.objs.size()=1 2024-03-04T13:00:15.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.SIvMWBjp8ykm8mt0KRkL_HH4KgzRpqt_0 2024-03-04T13:00:15.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5526956799715904199', time=2024-03-04T14:54:39.124869+0000, chain.objs.size()=1 2024-03-04T13:00:15.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.389+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Q4kE6hBrhqkLeZf5iHFUvrglKntgHOn_0 2024-03-04T13:00:15.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.390+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1891045532403479070', time=2024-03-04T14:54:39.134278+0000, chain.objs.size()=1 2024-03-04T13:00:15.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.390+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.u6EeTsnHltkrFvjWHpI4OTk7qVpyfWm_0 2024-03-04T13:00:15.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.390+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13103611195346529674', time=2024-03-04T14:54:39.144515+0000, chain.objs.size()=1 2024-03-04T13:00:15.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.390+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.9Kfnk_zpv50dmDJ0QJUqDvJ7-O71UEM_0 2024-03-04T13:00:15.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.391+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18007081149791602840', time=2024-03-04T14:54:39.167057+0000, chain.objs.size()=1 2024-03-04T13:00:15.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.391+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rsYc3OZ-0vHRl5kgGVnhrJIb314rzpY_0 2024-03-04T13:00:15.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.391+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12170732909665326762', time=2024-03-04T14:54:39.179797+0000, chain.objs.size()=1 2024-03-04T13:00:15.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.391+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ZYEMeTtZC9KMYmVmnS_So6pu-JwGWeb_0 2024-03-04T13:00:15.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14247012169551408642', time=2024-03-04T14:54:39.275933+0000, chain.objs.size()=1 2024-03-04T13:00:15.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0VzzJclii6iO1SpqZdgU5n7vYIrk-mv_0 2024-03-04T13:00:15.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11265916974485392006', time=2024-03-04T14:54:39.276757+0000, chain.objs.size()=1 2024-03-04T13:00:15.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.govZHcBoLoDLL2Jl3mSixJ3eJkt-UrA_0 2024-03-04T13:00:15.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17644082853874950759', time=2024-03-04T14:54:39.279819+0000, chain.objs.size()=1 2024-03-04T13:00:15.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ovfq0yomVF8n_41bo1uHAIrlRXuepAk_0 2024-03-04T13:00:15.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11078453372727295381', time=2024-03-04T14:54:39.324741+0000, chain.objs.size()=1 2024-03-04T13:00:15.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.OE6fFE14AUNht36WG9qd-4VmLFTzi-j_0 2024-03-04T13:00:15.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11896153890425505949', time=2024-03-04T14:54:39.351361+0000, chain.objs.size()=1 2024-03-04T13:00:15.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7cbwUJf7FceHg4SZrAxC-NMqnB8Wbls_0 2024-03-04T13:00:15.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17518061492808923875', time=2024-03-04T14:54:39.481134+0000, chain.objs.size()=1 2024-03-04T13:00:15.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.az4ifCwUynb3_M83cb7_4k5yM_niazb_0 2024-03-04T13:00:15.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.133309178733794130', time=2024-03-04T14:54:40.252521+0000, chain.objs.size()=1 2024-03-04T13:00:15.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.299__shadow_.grj8qapn2Tgh1Utv1kcXRf5c35Toyov_0 2024-03-04T13:00:15.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17510987188226212507', time=2024-03-04T14:54:41.075946+0000, chain.objs.size()=1 2024-03-04T13:00:15.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.301__shadow_.l5HCpFZQccV2vzWZ9VFgCb2_WCPaQk8_0 2024-03-04T13:00:15.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1340134822166539729', time=2024-03-04T14:55:05.835473+0000, chain.objs.size()=1 2024-03-04T13:00:15.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.393+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.357__shadow_.xeTeajBOmqJaqk3wcTIViI4OVlqQ3gQ_0 2024-03-04T13:00:15.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.394+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6701548115599563757', time=2024-03-04T14:55:28.222620+0000, chain.objs.size()=1 2024-03-04T13:00:15.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.394+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.404__shadow_.lFFsILu9CGsQ9OLDrabyq4PsGS_C_6e_0 2024-03-04T13:00:15.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.394+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16168815083919821714', time=2024-03-04T14:55:45.378326+0000, chain.objs.size()=1 2024-03-04T13:00:15.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.394+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.435__shadow_.JI8e1QDkqZlINb2aUUIpzzuKLiqV7Op_0 2024-03-04T13:00:15.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.394+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18236593654389705618', time=2024-03-04T14:55:52.266416+0000, chain.objs.size()=1 2024-03-04T13:00:15.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.394+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.455__shadow_.LFMJk_0a4UUpef5IAwJSgaXXqj-l6vQ_0 2024-03-04T13:00:15.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.396+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.475__shadow:uVjDMegxP6XYWgvybwvxI64cJu5z7Q0_.3EygMS0MkBsJBGyX0Po4m4qYgkDoKJC_1_47f17d4261dccb83f4a1c762bdddd4a9', time=2024-03-04T14:56:01.002423+0000, chain.objs.size()=1 2024-03-04T13:00:15.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.396+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.475__shadow:uVjDMegxP6XYWgvybwvxI64cJu5z7Q0_.3EygMS0MkBsJBGyX0Po4m4qYgkDoKJC_0 2024-03-04T13:00:15.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.397+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw', time=2024-03-04T14:56:19.309208+0000, chain.objs.size()=2 2024-03-04T13:00:15.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.397+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw.2 2024-03-04T13:00:15.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.397+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw.2_1 2024-03-04T13:00:15.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.402+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/72942 2024-03-04T13:00:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-03-04T13:00:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw', time=2024-03-04T14:56:19.310735+0000, chain.objs.size()=2 2024-03-04T13:00:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw.3 2024-03-04T13:00:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw.3_1 2024-03-04T13:00:15.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15742588224221670055', time=2024-03-04T14:56:26.203224+0000, chain.objs.size()=3 2024-03-04T13:00:15.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~6fA7WjtuvhWh3OrRkncf5TtGElff_WC.1 2024-03-04T13:00:15.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~6fA7WjtuvhWh3OrRkncf5TtGElff_WC.2 2024-03-04T13:00:15.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~6fA7WjtuvhWh3OrRkncf5TtGElff_WC.3 2024-03-04T13:00:15.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14409809862427394070', time=2024-03-04T14:57:07.314637+0000, chain.objs.size()=1 2024-03-04T13:00:15.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.526__shadow_.niBDih8z54oBvbyw11cfgeK4yV3g7fF_0 2024-03-04T13:00:15.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10210701880165627714', time=2024-03-04T14:57:14.944018+0000, chain.objs.size()=1 2024-03-04T13:00:15.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.533__shadow_.x0SiTyxWdsMqh3ZuiB_Q1rmt97Ym8tj_0 2024-03-04T13:00:15.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12682386085396280988', time=2024-03-04T14:57:17.353780+0000, chain.objs.size()=1 2024-03-04T13:00:15.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:ZDz90pWeG7xck1dE2av.W3C5vcOq9km_.Qd0ochhR-jYMUb5UzrU0UWUVQn006zl_0 2024-03-04T13:00:15.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10241689214331585309', time=2024-03-04T14:57:30.478098+0000, chain.objs.size()=1 2024-03-04T13:00:15.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.542__shadow:xbPmhK6.oy3FbxO5IZojuQsy8RcEPQs_.NLeNGm8DzCs3QXqcBs_SVD-QJRetwsH_0 2024-03-04T13:00:15.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10423445902355496004', time=2024-03-04T14:57:33.337409+0000, chain.objs.size()=1 2024-03-04T13:00:15.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:C3gZeS2FNrcuLzeatVEg9FUAWMzrFf._.X4aIl7meeVrywGM1lOYkhv6T8zPMOb8_0 2024-03-04T13:00:15.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15029724581214475055', time=2024-03-04T14:57:42.182227+0000, chain.objs.size()=1 2024-03-04T13:00:15.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:9L223hwNC1ffiJmuvtikH7JejUH1ICi_.tzeE2lA1XNFGQZxJ1Yqda0qWrLcXKZi_0 2024-03-04T13:00:15.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5384262462029305902', time=2024-03-04T14:57:47.306632+0000, chain.objs.size()=1 2024-03-04T13:00:15.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.404+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.545__shadow:FR7Zwe9NLz9jjweSdqOgfb00gZrhAc1_.lbbjJCf9OYUJkA584M2Tbg0a2dbSvpn_0 2024-03-04T13:00:15.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.412+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3700826276084752354', time=2024-03-04T14:57:52.016330+0000, chain.objs.size()=1 2024-03-04T13:00:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.412+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.553__shadow:x78Ivketuw0KIcDDTbMukm1CaXNWk36_.ife55jYbLsFxPNEhmMEwvsyUah2mXHk_0 2024-03-04T13:00:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.412+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4875900777422870072', time=2024-03-04T14:58:18.081516+0000, chain.objs.size()=1 2024-03-04T13:00:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.412+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.598__shadow_.YLTj1x0wZ5MXRyMBVCU3fN5wyTd2M9F_0 2024-03-04T13:00:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.412+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18431728039718870238', time=2024-03-04T14:58:20.457098+0000, chain.objs.size()=1 2024-03-04T13:00:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.412+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.604__shadow_.atcq746wsviGfKAVqqBLMS3cmh2CzeU_0 2024-03-04T13:00:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.413+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8420917144568580643', time=2024-03-04T14:58:26.349207+0000, chain.objs.size()=1 2024-03-04T13:00:15.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.413+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.615__shadow_.S6ii4HkoE-XVBCmJ2HCtMfrKEGqvBn4_0 2024-03-04T13:00:15.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.417+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:15.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.419+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T13:00:15.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.420+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:15.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.421+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:15.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54138' 2024-03-04T13:00:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5087713538188744947', time=2024-03-04T14:52:52.807277+0000, chain.objs.size()=1 2024-03-04T13:00:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.147__shadow_.vbI62z9cusm6fpIW6CEC4ucFmYgQ7sa_0 2024-03-04T13:00:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.913639086821653852', time=2024-03-04T14:52:55.823923+0000, chain.objs.size()=3 2024-03-04T13:00:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.151__shadow_.s8emFXUkwikP-ENxoHu686a-YBhar2d_0 2024-03-04T13:00:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.151__shadow_.s8emFXUkwikP-ENxoHu686a-YBhar2d_1 2024-03-04T13:00:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.151__shadow_.s8emFXUkwikP-ENxoHu686a-YBhar2d_2 2024-03-04T13:00:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13650779389971293394', time=2024-03-04T14:53:32.820883+0000, chain.objs.size()=1 2024-03-04T13:00:15.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.210__shadow_.sza7Q3nSxWauEZFokB_Gf_oMPptGR7t_0 2024-03-04T13:00:15.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16990946234357911752', time=2024-03-04T14:53:34.885537+0000, chain.objs.size()=1 2024-03-04T13:00:15.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.214__shadow_.Oegy-vL2x1hze2jTCY1k41RztQUtS8B_0 2024-03-04T13:00:15.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10033675474209822197', time=2024-03-04T14:53:52.045370+0000, chain.objs.size()=1 2024-03-04T13:00:15.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VgFVHeawHHw9uio4I6Dr-NGs4GM1Rvf_0 2024-03-04T13:00:15.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4883713218713836565', time=2024-03-04T14:53:52.072328+0000, chain.objs.size()=1 2024-03-04T13:00:15.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VC7ZXF4F9au6xKoN_I3RX5D1WMaKvka_0 2024-03-04T13:00:15.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3894005985026474202', time=2024-03-04T14:53:52.090403+0000, chain.objs.size()=1 2024-03-04T13:00:15.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.DWk8Vg_SqE_KNeBndhl5DRmdrcjcRnd_0 2024-03-04T13:00:15.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17019958858104700538', time=2024-03-04T14:53:52.101079+0000, chain.objs.size()=1 2024-03-04T13:00:15.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.XEIgiXVtAwoZfJNjrsgA3TN4DbuEGwT_0 2024-03-04T13:00:15.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9956107027692552079', time=2024-03-04T14:53:52.104272+0000, chain.objs.size()=1 2024-03-04T13:00:15.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.B1dnUcojUIDgEmtn6For-_898EiE0UC_0 2024-03-04T13:00:15.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16204157405122201854', time=2024-03-04T14:53:52.106633+0000, chain.objs.size()=1 2024-03-04T13:00:15.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.422+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.sUxtxYuetuzMnbhslQW377jZhkYlm3g_0 2024-03-04T13:00:15.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.424+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3527715323952619354', time=2024-03-04T14:53:52.120187+0000, chain.objs.size()=1 2024-03-04T13:00:15.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.424+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.iRv9CuqV-I9D_HE41Mf3xYYrZUPn8RH_0 2024-03-04T13:00:15.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.424+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6174745312021978581', time=2024-03-04T14:53:52.243862+0000, chain.objs.size()=1 2024-03-04T13:00:15.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.424+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ahY2m8sdxeOuVKtzyX1YH_umt99FmLI_0 2024-03-04T13:00:15.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13007698477833539604', time=2024-03-04T14:53:52.272188+0000, chain.objs.size()=1 2024-03-04T13:00:15.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.7ypuVlfgmMfilq7lA-u1V7oDszud5g1_0 2024-03-04T13:00:15.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10028173180761316272', time=2024-03-04T14:53:52.273699+0000, chain.objs.size()=1 2024-03-04T13:00:15.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.lPzUaUJhe5Rifj2_kqKk6PPKP5qt6Vo_0 2024-03-04T13:00:15.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6347431031146878080', time=2024-03-04T14:53:52.296869+0000, chain.objs.size()=1 2024-03-04T13:00:15.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.okf64G3nvwCcV7CLIg4Dp-7v_UM5IHQ_0 2024-03-04T13:00:15.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.34955915003353685', time=2024-03-04T14:53:52.425984+0000, chain.objs.size()=1 2024-03-04T13:00:15.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.kxuvjBan8MeJBN5AsKgKwhAT7-R-9pI_0 2024-03-04T13:00:15.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2748431594333010789', time=2024-03-04T14:53:52.566129+0000, chain.objs.size()=1 2024-03-04T13:00:15.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LJ4dKcdvjdMA0ODkxf80ibVz7yXE4Co_0 2024-03-04T13:00:15.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17773133236412629926', time=2024-03-04T14:53:52.568347+0000, chain.objs.size()=1 2024-03-04T13:00:15.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.k_UkWXwz-Vw8ffVVi2YFdXgh5OVMWcB_0 2024-03-04T13:00:15.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7473103044775866079', time=2024-03-04T14:53:52.579924+0000, chain.objs.size()=1 2024-03-04T13:00:15.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.t5mf_xmMUbrUnehklckR13HCfsU5Tpz_0 2024-03-04T13:00:15.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16744974669954395409', time=2024-03-04T14:53:52.583142+0000, chain.objs.size()=1 2024-03-04T13:00:15.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.lUElJhgDsk16APvNnhSsTLa2p9LibSz_0 2024-03-04T13:00:15.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12305410048335266375', time=2024-03-04T14:53:52.593509+0000, chain.objs.size()=1 2024-03-04T13:00:15.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.425+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.15Q8CeP1tltgpCiR18B7pTId9iMbpVv_0 2024-03-04T13:00:15.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.426+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2905462655782213263', time=2024-03-04T14:53:52.608883+0000, chain.objs.size()=1 2024-03-04T13:00:15.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.426+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PwXjkOdO8Sc-Y9DR_adcwKYL6xswZWz_0 2024-03-04T13:00:15.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.426+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5043937241819273342', time=2024-03-04T14:53:52.630889+0000, chain.objs.size()=1 2024-03-04T13:00:15.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.426+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YaZqBZrNQ6JGTPZ-sQaaObC9MikJyUu_0 2024-03-04T13:00:15.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15381165734072523868', time=2024-03-04T14:53:52.765647+0000, chain.objs.size()=1 2024-03-04T13:00:15.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xJ0Bw7SSGVnOHAJHv_CiLfmmC4NW_UM_0 2024-03-04T13:00:15.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11875426392146926645', time=2024-03-04T14:53:52.818222+0000, chain.objs.size()=1 2024-03-04T13:00:15.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yaf52Y-o5qYhSlVWAfkXmQXRIfAkab4_0 2024-03-04T13:00:15.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14376396827714600883', time=2024-03-04T14:53:52.824974+0000, chain.objs.size()=1 2024-03-04T13:00:15.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.1HQ9xglC3O6e-JltiqwRKrMPlrrK5fc_0 2024-03-04T13:00:15.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5791716731766353147', time=2024-03-04T14:53:52.922271+0000, chain.objs.size()=1 2024-03-04T13:00:15.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Jz0LJ6YXOVNg6pWuO9w9B_qE8MN4O0N_0 2024-03-04T13:00:15.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15692892660683201262', time=2024-03-04T14:53:52.958342+0000, chain.objs.size()=1 2024-03-04T13:00:15.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.cAEO2ZkoHTN_watU3i2UCLpkEWTUk1T_0 2024-03-04T13:00:15.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5533532819768472365', time=2024-03-04T14:53:52.971547+0000, chain.objs.size()=1 2024-03-04T13:00:15.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mP00q_-qCWUADHNI87RB_ps7rzkCwth_0 2024-03-04T13:00:15.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.808223581018546540', time=2024-03-04T14:53:52.991966+0000, chain.objs.size()=1 2024-03-04T13:00:15.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.429+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.QrTunQhKKlC4jq1Sw23DCutrfsCRJ5w_0 2024-03-04T13:00:15.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.431+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8503798490026888451', time=2024-03-04T14:53:53.117150+0000, chain.objs.size()=1 2024-03-04T13:00:15.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.431+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.9eySG_PfNN7Jv5fnP1SC5CX9HmyBXy1_0 2024-03-04T13:00:15.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.431+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12610742279094141464', time=2024-03-04T14:53:53.177191+0000, chain.objs.size()=1 2024-03-04T13:00:15.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.431+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-hUPPcDEhBlT7L9mrAkhxZ7zzSG4J4N_0 2024-03-04T13:00:15.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.431+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15418059892789853969', time=2024-03-04T14:53:53.253029+0000, chain.objs.size()=1 2024-03-04T13:00:15.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.431+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GJq7hRsqHxN_Cus-BeC80waelfVCQE1_0 2024-03-04T13:00:15.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.431+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6097801543321530239', time=2024-03-04T14:53:53.284168+0000, chain.objs.size()=1 2024-03-04T13:00:15.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.431+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.qw5uc0gJoOTcgWdVy-NmVFfU0fZ4_Zt_0 2024-03-04T13:00:15.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.434+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6527415427849335646', time=2024-03-04T14:53:53.296312+0000, chain.objs.size()=1 2024-03-04T13:00:15.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.434+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.qtaCZ3ugz_7MCxl-StFu7hnUn6vlXBc_0 2024-03-04T13:00:15.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8405443729488632265', time=2024-03-04T14:53:54.854096+0000, chain.objs.size()=1 2024-03-04T13:00:15.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.236__shadow_.lhIiwXlsGB4dGwx9cRLgjg_SdYZx6TK_0 2024-03-04T13:00:15.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6015505947939315870', time=2024-03-04T14:53:58.325376+0000, chain.objs.size()=1 2024-03-04T13:00:15.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.244__shadow_.ayMGdU5Cl9TFh23UWG7j_AeZ1uwfP_a_0 2024-03-04T13:00:15.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7639164931898111820', time=2024-03-04T14:53:58.326166+0000, chain.objs.size()=1 2024-03-04T13:00:15.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.244__shadow_.2A46JJiUNL4pgGjnwyXQyjx2-h1PDNb_0 2024-03-04T13:00:15.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6220125585069898534', time=2024-03-04T14:53:59.252393+0000, chain.objs.size()=1 2024-03-04T13:00:15.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.246__shadow_.n4tEgGZYov0yvy-0fiRQka6xIJSuug__0 2024-03-04T13:00:15.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12631388365630547538', time=2024-03-04T14:53:59.253244+0000, chain.objs.size()=1 2024-03-04T13:00:15.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.246__shadow_.eLtRW2aHbJK0sTmNwLOm4y810gVTRjs_0 2024-03-04T13:00:15.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13319009500178968135', time=2024-03-04T14:54:03.563110+0000, chain.objs.size()=1 2024-03-04T13:00:15.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.256__shadow_.78N1_BwlxhbAme6rENALlBRBV2A6ImS_0 2024-03-04T13:00:15.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9601518292010358112', time=2024-03-04T14:54:06.752701+0000, chain.objs.size()=1 2024-03-04T13:00:15.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.263__shadow_.1oO1OEdV8US6mgYBy8Tz8lpLTzVAZyb_0 2024-03-04T13:00:15.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13236723044558681734', time=2024-03-04T14:54:09.030041+0000, chain.objs.size()=1 2024-03-04T13:00:15.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.QSXQxI_hcpxXLps6bK9CPtiCNZ8dRfd_0 2024-03-04T13:00:15.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15411487089692964397', time=2024-03-04T14:54:09.036933+0000, chain.objs.size()=1 2024-03-04T13:00:15.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.5A-eLBHfO72k6d6dvEEXV2nxBU0wv1p_0 2024-03-04T13:00:15.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6008200194347765168', time=2024-03-04T14:54:09.037712+0000, chain.objs.size()=1 2024-03-04T13:00:15.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.437+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.fUA_losZwFM35BGLUop3yqMbD7bSxSQ_0 2024-03-04T13:00:15.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.438+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6136289999932750211', time=2024-03-04T14:54:09.470407+0000, chain.objs.size()=1 2024-03-04T13:00:15.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.438+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.267__shadow_.bUQqJHy_retGCWt3LmS4jjdxzyMLNoc_0 2024-03-04T13:00:15.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.439+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8094492194424051834', time=2024-03-04T14:54:19.318730+0000, chain.objs.size()=1 2024-03-04T13:00:15.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.439+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.288__shadow_.ZXIebBEdV951-46BRqO3sCen0X9Hlr__0 2024-03-04T13:00:15.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.439+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8346539963182186958', time=2024-03-04T14:54:29.625580+0000, chain.objs.size()=1 2024-03-04T13:00:15.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.439+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yxW8L7s35L8fC3OyNNLX4Ut0TehfGLZ_0 2024-03-04T13:00:15.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.439+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8029476807185533676', time=2024-03-04T14:54:29.630173+0000, chain.objs.size()=1 2024-03-04T13:00:15.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.439+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3H-CIIwYoW0fG8GwXiAsin_9DEWQynv_0 2024-03-04T13:00:15.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.440+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5450818528370420233', time=2024-03-04T14:54:29.655024+0000, chain.objs.size()=1 2024-03-04T13:00:15.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.440+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.zVPHfzDKo2suI6pZFNYh6E6EadimiRu_0 2024-03-04T13:00:15.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.440+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14261952328056336713', time=2024-03-04T14:54:29.666405+0000, chain.objs.size()=1 2024-03-04T13:00:15.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.440+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.kQRdSs9ne9a0Q7vQvpvWEDHrK_Bwhmv_0 2024-03-04T13:00:15.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.442+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10733015230965908944', time=2024-03-04T14:54:29.794732+0000, chain.objs.size()=1 2024-03-04T13:00:15.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.442+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.llvZ15h98l-nzw7zjpIl5kPxDTMY9KI_0 2024-03-04T13:00:15.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.442+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10288359512376710922', time=2024-03-04T14:54:29.847730+0000, chain.objs.size()=1 2024-03-04T13:00:15.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.442+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.fHmzpIbNtwomJgY0-HqfiN4IggWf5qy_0 2024-03-04T13:00:15.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.442+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5640632187119379172', time=2024-03-04T14:54:29.941763+0000, chain.objs.size()=1 2024-03-04T13:00:15.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.442+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.zJox7xbVFEmzHSVj_Cu2Hlrm33MXCe1_0 2024-03-04T13:00:15.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.442+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4809458380428250290', time=2024-03-04T14:54:29.987337+0000, chain.objs.size()=1 2024-03-04T13:00:15.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.442+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.qrytNYC_ZG3g9MxBcSokowtJdcSZdOa_0 2024-03-04T13:00:15.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9849132962698076916', time=2024-03-04T14:54:29.994307+0000, chain.objs.size()=1 2024-03-04T13:00:15.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2rbIVMND7YBxiJhjDfoljeMrrP9qRkT_0 2024-03-04T13:00:15.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11493531810243077350', time=2024-03-04T14:54:30.007430+0000, chain.objs.size()=1 2024-03-04T13:00:15.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.s6SQihKrEX9hyXSPQStd1Lc_LtHGd8K_0 2024-03-04T13:00:15.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6946022090497090178', time=2024-03-04T14:54:30.017513+0000, chain.objs.size()=1 2024-03-04T13:00:15.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.hF8a_wByXXrc00X8X4IH9odiaZxf48H_0 2024-03-04T13:00:15.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18097221708211643934', time=2024-03-04T14:54:30.101405+0000, chain.objs.size()=1 2024-03-04T13:00:15.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.G50prDhF5jBs8uXE82rN2NOeaoxOUUV_0 2024-03-04T13:00:15.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7169881940107452524', time=2024-03-04T14:54:30.104122+0000, chain.objs.size()=1 2024-03-04T13:00:15.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5sEFFS5G8btkVw02pxP_q0dd4rIQNOJ_0 2024-03-04T13:00:15.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10245588186089281051', time=2024-03-04T14:54:30.138336+0000, chain.objs.size()=1 2024-03-04T13:00:15.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.T5pKZg-4DmbDM9qTNaiUmDtbuGvKje5_0 2024-03-04T13:00:15.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.675655972846231882', time=2024-03-04T14:54:30.178190+0000, chain.objs.size()=1 2024-03-04T13:00:15.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.iZs_xFwF5dWi6oQSd6G9lv98Q9QuFfG_0 2024-03-04T13:00:15.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12835706407797494076', time=2024-03-04T14:54:30.261294+0000, chain.objs.size()=1 2024-03-04T13:00:15.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.zKmfD_pu7_F6FsZdIMzCPcYp6mfk9hZ_0 2024-03-04T13:00:15.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15308066914608375600', time=2024-03-04T14:54:30.270210+0000, chain.objs.size()=1 2024-03-04T13:00:15.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yk5iSQNNtE0wV93s4gWS6R43q9GUomF_0 2024-03-04T13:00:15.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11929444777460032949', time=2024-03-04T14:54:30.282382+0000, chain.objs.size()=1 2024-03-04T13:00:15.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.x7tjzzTpnBfOSJnc_6cIG2je7am4fCw_0 2024-03-04T13:00:15.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12207467994434084535', time=2024-03-04T14:54:30.333594+0000, chain.objs.size()=1 2024-03-04T13:00:15.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.445+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.8LjYKp4rslNra2S806e8xQ1onjukFLP_0 2024-03-04T13:00:15.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.447+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15989526288384129896', time=2024-03-04T14:54:30.337138+0000, chain.objs.size()=1 2024-03-04T13:00:15.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.447+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.27_BgtBiJJlKo1se6h70AwzuLJe1TzO_0 2024-03-04T13:00:15.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.448+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5818494608559103454', time=2024-03-04T14:54:30.441402+0000, chain.objs.size()=1 2024-03-04T13:00:15.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.448+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yz41diEDMM1eUhf_bRwTePhD5d-cQf3_0 2024-03-04T13:00:15.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.448+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10873730133732341832', time=2024-03-04T14:54:30.443854+0000, chain.objs.size()=1 2024-03-04T13:00:15.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.448+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ypZR3WXzQYAGzU-nHIRrdtK5HMVS5C5_0 2024-03-04T13:00:15.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.448+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15933174003873569650', time=2024-03-04T14:54:30.464945+0000, chain.objs.size()=1 2024-03-04T13:00:15.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.448+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3mEBS_4pOwk4V3on0tdJEGns8qtpPUj_0 2024-03-04T13:00:15.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3381788740384000025', time=2024-03-04T14:54:30.476360+0000, chain.objs.size()=1 2024-03-04T13:00:15.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.xRgAPbkbVXieGx_TRk7QXBYucJwIN91_0 2024-03-04T13:00:15.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15430385931205700681', time=2024-03-04T14:54:30.584864+0000, chain.objs.size()=1 2024-03-04T13:00:15.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oWXoTeFCaqZaRSQNCcWLSu5RX8FDO_L_0 2024-03-04T13:00:15.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13828201000435498113', time=2024-03-04T14:54:30.589740+0000, chain.objs.size()=1 2024-03-04T13:00:15.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.v51Tc7sRJUi-HT43QGwwzWsDUeIu7Ne_0 2024-03-04T13:00:15.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12032133417252759143', time=2024-03-04T14:54:30.746391+0000, chain.objs.size()=1 2024-03-04T13:00:15.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Hpgvhl3SrpYjpRYVJGAgvJnpsOEkFJc_0 2024-03-04T13:00:15.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10695082122266869290', time=2024-03-04T14:54:30.751316+0000, chain.objs.size()=1 2024-03-04T13:00:15.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Z6xBx6lF9eQfDaZoF6kfPWqBQ1rDY8l_0 2024-03-04T13:00:15.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17756400054616858658', time=2024-03-04T14:54:38.305719+0000, chain.objs.size()=1 2024-03-04T13:00:15.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Rxs3q8UXcHNVvlbUpYAyBZUhdB-8qoV_0 2024-03-04T13:00:15.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11158937390414769439', time=2024-03-04T14:54:38.308788+0000, chain.objs.size()=1 2024-03-04T13:00:15.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.SE3PRbCj6f93BTbOtvXp2nKRBWtWt3W_0 2024-03-04T13:00:15.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1863554850817834032', time=2024-03-04T14:54:38.311964+0000, chain.objs.size()=1 2024-03-04T13:00:15.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zwUpliiNjYwua9ONX_hYUWWCjtHxMTW_0 2024-03-04T13:00:15.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15655593339497888204', time=2024-03-04T14:54:38.373239+0000, chain.objs.size()=1 2024-03-04T13:00:15.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.450+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.K_g2qPfXpcvERxsPwH7GXDVjmMgPdWY_0 2024-03-04T13:00:15.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.451+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18217388585754856087', time=2024-03-04T14:54:38.469592+0000, chain.objs.size()=1 2024-03-04T13:00:15.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.451+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jyRZTJfeHBx0swjD2JEUxKgXBGu2mn3_0 2024-03-04T13:00:15.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.451+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17895211043611539982', time=2024-03-04T14:54:38.487604+0000, chain.objs.size()=1 2024-03-04T13:00:15.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.451+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zAkkJLBv9qwDAgTY2JjtHKPsV9U-dxH_0 2024-03-04T13:00:15.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11686421263023554912', time=2024-03-04T14:54:38.536948+0000, chain.objs.size()=1 2024-03-04T13:00:15.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.DjHlvyZ0wuPb75r0E607AifiRJeGZz__0 2024-03-04T13:00:15.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11301991086532188656', time=2024-03-04T14:54:38.540361+0000, chain.objs.size()=1 2024-03-04T13:00:15.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.vfx7q8P0qzmkK23hBirWO7CFk6KlkmK_0 2024-03-04T13:00:15.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16016052276258729215', time=2024-03-04T14:54:38.622807+0000, chain.objs.size()=1 2024-03-04T13:00:15.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wPKCng-PDibfQCIFocuMPIgo8hJBS5c_0 2024-03-04T13:00:15.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10675360360727993441', time=2024-03-04T14:54:38.636318+0000, chain.objs.size()=1 2024-03-04T13:00:15.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.V15LTPEydvAoWs8Wxk8rlSQ8G1msbCr_0 2024-03-04T13:00:15.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14134870438924031726', time=2024-03-04T14:54:38.668566+0000, chain.objs.size()=1 2024-03-04T13:00:15.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kgBZLZJXyIL3COyvkC4GN36hub7JZH9_0 2024-03-04T13:00:15.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11180468560672928069', time=2024-03-04T14:54:38.705589+0000, chain.objs.size()=1 2024-03-04T13:00:15.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.O7v9AL6saa6IMBe8B0NWyBcVG_vgBt0_0 2024-03-04T13:00:15.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10943700332801344936', time=2024-03-04T14:54:38.831460+0000, chain.objs.size()=1 2024-03-04T13:00:15.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.riGhUt6lnzGQuXFiT6Kjvw29P-GDOjo_0 2024-03-04T13:00:15.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10597174159935378825', time=2024-03-04T14:54:38.836413+0000, chain.objs.size()=1 2024-03-04T13:00:15.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KG4D8x7hEM0SSJ3mmlFPfNDubs_6z-O_0 2024-03-04T13:00:15.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18395206712850219985', time=2024-03-04T14:54:38.844798+0000, chain.objs.size()=1 2024-03-04T13:00:15.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.d_xEzEYVwUzQrW1ws401d1AU-hVrDnO_0 2024-03-04T13:00:15.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8041532187529270180', time=2024-03-04T14:54:38.861239+0000, chain.objs.size()=1 2024-03-04T13:00:15.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.RfbUoQPsHKBI64Lcs452CnA5MCFJU5b_0 2024-03-04T13:00:15.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10840265415126146294', time=2024-03-04T14:54:38.864096+0000, chain.objs.size()=1 2024-03-04T13:00:15.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.453+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jvA-UWY8XvSbGuWDjdOKcDrFoiI0q3u_0 2024-03-04T13:00:15.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.454+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16345896158794659252', time=2024-03-04T14:54:38.957946+0000, chain.objs.size()=1 2024-03-04T13:00:15.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.454+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-ZNr4gJVf55AMIZcDmCYRVh-WKLSF5F_0 2024-03-04T13:00:15.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.454+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17248772821607900605', time=2024-03-04T14:54:39.009789+0000, chain.objs.size()=1 2024-03-04T13:00:15.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.454+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.f9wAshZj0NIozUZBAADc5uNr4-Od_Q9_0 2024-03-04T13:00:15.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.454+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17535251057105999409', time=2024-03-04T14:54:39.018445+0000, chain.objs.size()=1 2024-03-04T13:00:15.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.454+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.BuV4GvMrhCq0853UT6STqI0Wd8XuwnO_0 2024-03-04T13:00:15.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.455+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2957368081039471171', time=2024-03-04T14:54:39.129046+0000, chain.objs.size()=1 2024-03-04T13:00:15.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.455+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.X4Gt6MhJ9hmKQKYZTTPAP6eqdo5sm5r_0 2024-03-04T13:00:15.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.455+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12509708934798172153', time=2024-03-04T14:54:39.133852+0000, chain.objs.size()=1 2024-03-04T13:00:15.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.455+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.3c_C97x9e43ZziazbJoSxH5D5sIGBQc_0 2024-03-04T13:00:15.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.456+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9276079128326341194', time=2024-03-04T14:54:39.144995+0000, chain.objs.size()=1 2024-03-04T13:00:15.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.456+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Wjely8NtPAVrtTCtNHH02EE3lMkJNk-_0 2024-03-04T13:00:15.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.456+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9477550510465136915', time=2024-03-04T14:54:39.185869+0000, chain.objs.size()=1 2024-03-04T13:00:15.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.456+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.nC-voqav90BCUFpuCuj_Sm6GkDZ66BK_0 2024-03-04T13:00:15.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.456+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13943916936327046776', time=2024-03-04T14:54:39.276846+0000, chain.objs.size()=1 2024-03-04T13:00:15.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.456+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7UqahYIXXet70RWSnN5HDSenY2gS5ts_0 2024-03-04T13:00:15.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.458+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/54138 2024-03-04T13:00:15.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-03-04T13:00:15.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16184450298126417277', time=2024-03-04T14:54:39.328403+0000, chain.objs.size()=1 2024-03-04T13:00:15.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gMq-sxxznkhbXKxdzbk__LQyr3hvJHc_0 2024-03-04T13:00:15.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6492503719142823772', time=2024-03-04T14:54:39.336008+0000, chain.objs.size()=1 2024-03-04T13:00:15.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.K_B_NuKMeSUCYvC21Bsih3QhS-Q04L__0 2024-03-04T13:00:15.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3971967494994175075', time=2024-03-04T14:55:41.202499+0000, chain.objs.size()=1 2024-03-04T13:00:15.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.429__shadow_.IgElia_Yyl9Bih5Gw_34GB8Y0mbnrBl_0 2024-03-04T13:00:15.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1509745412985077841', time=2024-03-04T14:55:55.173301+0000, chain.objs.size()=1 2024-03-04T13:00:15.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.461__shadow_.nQ5H5OSOzslzQ-WH2EsyJJwJbtYXqsy_0 2024-03-04T13:00:15.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.463__shadow_.zAjKwFUjDsBbw9Xr5oQHlW-H9eXWt03_1_b42744bb2142ccb81e163531ceb3eab1', time=2024-03-04T14:55:56.213125+0000, chain.objs.size()=1 2024-03-04T13:00:15.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.463__shadow_.zAjKwFUjDsBbw9Xr5oQHlW-H9eXWt03_0 2024-03-04T13:00:15.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.475__shadow:uVjDMegxP6XYWgvybwvxI64cJu5z7Q0_.3EygMS0MkBsJBGyX0Po4m4qYgkDoKJC_1_28bd801beddcef80c4a2566148700707', time=2024-03-04T14:56:01.224937+0000, chain.objs.size()=1 2024-03-04T13:00:15.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.475__shadow:uVjDMegxP6XYWgvybwvxI64cJu5z7Q0_.3EygMS0MkBsJBGyX0Po4m4qYgkDoKJC_0 2024-03-04T13:00:15.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2886413914442856673', time=2024-03-04T14:56:05.822547+0000, chain.objs.size()=1 2024-03-04T13:00:15.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.486__shadow_.nv2DdNAevbz6jBHJTurqH8hmzscAo4S_0 2024-03-04T13:00:15.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15691300602632267064', time=2024-03-04T14:56:13.286793+0000, chain.objs.size()=1 2024-03-04T13:00:15.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.492__shadow:DHtoequIDjO7ZiujjOrj.qXv2JAzH3U_.9_Vs36oyva7SfTWJufNNxEhs1E0cBEb_0 2024-03-04T13:00:15.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~h9fRTe785QJmzH6H1Mi4sDG4Q1cm4wS', time=2024-03-04T14:56:21.249485+0000, chain.objs.size()=1 2024-03-04T13:00:15.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~h9fRTe785QJmzH6H1Mi4sDG4Q1cm4wS.1 2024-03-04T13:00:15.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~h9fRTe785QJmzH6H1Mi4sDG4Q1cm4wS', time=2024-03-04T14:56:21.251117+0000, chain.objs.size()=1 2024-03-04T13:00:15.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~h9fRTe785QJmzH6H1Mi4sDG4Q1cm4wS.2 2024-03-04T13:00:15.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~h9fRTe785QJmzH6H1Mi4sDG4Q1cm4wS', time=2024-03-04T14:56:21.252631+0000, chain.objs.size()=1 2024-03-04T13:00:15.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~h9fRTe785QJmzH6H1Mi4sDG4Q1cm4wS.3 2024-03-04T13:00:15.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~h9fRTe785QJmzH6H1Mi4sDG4Q1cm4wS', time=2024-03-04T14:56:21.254289+0000, chain.objs.size()=1 2024-03-04T13:00:15.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~h9fRTe785QJmzH6H1Mi4sDG4Q1cm4wS.4 2024-03-04T13:00:15.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.461+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~h9fRTe785QJmzH6H1Mi4sDG4Q1cm4wS', time=2024-03-04T14:56:21.255856+0000, chain.objs.size()=1 2024-03-04T13:00:15.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.462+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~h9fRTe785QJmzH6H1Mi4sDG4Q1cm4wS.5 2024-03-04T13:00:15.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.462+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~h9fRTe785QJmzH6H1Mi4sDG4Q1cm4wS', time=2024-03-04T14:56:21.257274+0000, chain.objs.size()=1 2024-03-04T13:00:15.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.462+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~h9fRTe785QJmzH6H1Mi4sDG4Q1cm4wS.6 2024-03-04T13:00:15.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.462+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1306085584001993515', time=2024-03-04T14:56:23.126782+0000, chain.objs.size()=2 2024-03-04T13:00:15.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.462+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~1_xGtNdYwjgWrPbPOlgSL9lsV7tUz8c.1 2024-03-04T13:00:15.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.462+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~1_xGtNdYwjgWrPbPOlgSL9lsV7tUz8c.2 2024-03-04T13:00:15.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.462+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17219758372485726769', time=2024-03-04T14:56:27.772078+0000, chain.objs.size()=4 2024-03-04T13:00:15.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.462+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.499__multipart_mymultipart.2~sHHysIWp_AY_NpQ-k067IqT3JsChCC9.1 2024-03-04T13:00:15.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.462+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.499__multipart_mymultipart.2~sHHysIWp_AY_NpQ-k067IqT3JsChCC9.2 2024-03-04T13:00:15.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.462+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.499__multipart_mymultipart.2~sHHysIWp_AY_NpQ-k067IqT3JsChCC9.3 2024-03-04T13:00:15.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.462+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.499__multipart_mymultipart.2~sHHysIWp_AY_NpQ-k067IqT3JsChCC9.4 2024-03-04T13:00:15.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.463+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~5L3xp9Q2GtdW9wV8OQbbEufNRrxGzX6', time=2024-03-04T14:56:29.955441+0000, chain.objs.size()=2 2024-03-04T13:00:15.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.463+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.503__multipart_mymultipart2.2~5L3xp9Q2GtdW9wV8OQbbEufNRrxGzX6.1 2024-03-04T13:00:15.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.463+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.503__shadow_mymultipart2.2~5L3xp9Q2GtdW9wV8OQbbEufNRrxGzX6.1_1 2024-03-04T13:00:15.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.463+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14408055086119635609', time=2024-03-04T14:56:46.091512+0000, chain.objs.size()=7 2024-03-04T13:00:15.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.463+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.507__multipart_mymultipart.2~cg-IYtwxp66fQOMx1jl1jfieJsJfvnq.1 2024-03-04T13:00:15.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.464+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.507__shadow_mymultipart.2~cg-IYtwxp66fQOMx1jl1jfieJsJfvnq.1_1 2024-03-04T13:00:15.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.464+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.507__multipart_mymultipart.2~cg-IYtwxp66fQOMx1jl1jfieJsJfvnq.2 2024-03-04T13:00:15.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.464+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.507__shadow_mymultipart.2~cg-IYtwxp66fQOMx1jl1jfieJsJfvnq.2_1 2024-03-04T13:00:15.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.464+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.507__multipart_mymultipart.dOX3rMVOQWNCXBa2Xtfdd-vkHo6oWlVu.3 2024-03-04T13:00:15.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.464+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.507__shadow_mymultipart.dOX3rMVOQWNCXBa2Xtfdd-vkHo6oWlVu.3_1 2024-03-04T13:00:15.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.464+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.507__multipart_mymultipart.2~cg-IYtwxp66fQOMx1jl1jfieJsJfvnq.4 2024-03-04T13:00:15.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.464+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11066239925612715812', time=2024-03-04T14:57:02.471794+0000, chain.objs.size()=1 2024-03-04T13:00:15.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.464+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.518__shadow_.ztAHo8i2i5De24RcG8uQk8xgEqDZqMU_0 2024-03-04T13:00:15.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.465+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8906752515796872231', time=2024-03-04T14:57:04.916111+0000, chain.objs.size()=1 2024-03-04T13:00:15.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.465+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.522__shadow_.d3GqqpWVJm1C3NFjtRqnW3mAwPm7S6-_0 2024-03-04T13:00:15.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.465+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12295556669858661006', time=2024-03-04T14:57:07.884114+0000, chain.objs.size()=1 2024-03-04T13:00:15.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.465+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.527__shadow_.NeSmSl5AzDBJbr0NGQTjoMLhCqpQYxa_0 2024-03-04T13:00:15.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.467+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14029849622229198090', time=2024-03-04T14:57:22.899451+0000, chain.objs.size()=1 2024-03-04T13:00:15.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.467+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.537__shadow:KheoEiKa.KB0ZfmkW1jMvv02b5jskSF_.CgX_Q9v7MndDH8D9YDbc4VxMGwjU6Yb_0 2024-03-04T13:00:15.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.467+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4694836669032604560', time=2024-03-04T14:57:25.475565+0000, chain.objs.size()=1 2024-03-04T13:00:15.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.467+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.541__shadow_.wpwz00W5QgARg7V3R7-ce2JDYvTCipN_0 2024-03-04T13:00:15.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11033376023945791961', time=2024-03-04T14:57:25.658683+0000, chain.objs.size()=1 2024-03-04T13:00:15.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.541__shadow:9kjR4DYBhrpdI7vYFekOOJgNdWLIRoV_.vqh50dAmM53QIcAQCXK9vNTH07lwbkA_0 2024-03-04T13:00:15.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4253787252249315209', time=2024-03-04T14:57:29.526685+0000, chain.objs.size()=1 2024-03-04T13:00:15.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.542__shadow:6an5LMpyK9PJspoftkPFAlOIycWeOHz_.ZbNss4-Z9EFpXF87KYzpEE8bsfUhNe1_0 2024-03-04T13:00:15.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5800776095572916331', time=2024-03-04T14:57:43.395738+0000, chain.objs.size()=1 2024-03-04T13:00:15.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:gp0L5ETdSpFd1.9p3W5jKHkXYIVIXsL_.F0voclSAw0aHGFHf5YLQ6_cpS7VSBhq_0 2024-03-04T13:00:15.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7302621485756036174', time=2024-03-04T14:57:47.320317+0000, chain.objs.size()=1 2024-03-04T13:00:15.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.545__shadow:Wr.USyLbNB.49WcolkIgQ2Renzig7.1_.CVL7AjdRsR2ua3k3pgs6SoPPBN5dCbe_0 2024-03-04T13:00:15.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:jdjxZsdu3lo9t.PKiJuUgyq.gocjLZQ_.RSl-pA00LrsZUB1qD19DFPdP3q6UGJ__1_5d6767e26f06dfb6041ed2b77fc752b0', time=2024-03-04T14:57:48.566844+0000, chain.objs.size()=1 2024-03-04T13:00:15.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:jdjxZsdu3lo9t.PKiJuUgyq.gocjLZQ_.RSl-pA00LrsZUB1qD19DFPdP3q6UGJ__0 2024-03-04T13:00:15.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12798336296407248326', time=2024-03-04T14:58:08.336255+0000, chain.objs.size()=12 2024-03-04T13:00:15.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581__multipart_multipart_enc.2~__vgYJlr1mrLra5-HwrPX31IT07aEII.1 2024-03-04T13:00:15.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581__shadow_multipart_enc.2~__vgYJlr1mrLra5-HwrPX31IT07aEII.1_1 2024-03-04T13:00:15.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581__multipart_multipart_enc.2~__vgYJlr1mrLra5-HwrPX31IT07aEII.2 2024-03-04T13:00:15.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581__shadow_multipart_enc.2~__vgYJlr1mrLra5-HwrPX31IT07aEII.2_1 2024-03-04T13:00:15.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581__multipart_multipart_enc.2~__vgYJlr1mrLra5-HwrPX31IT07aEII.3 2024-03-04T13:00:15.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.469+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581__shadow_multipart_enc.2~__vgYJlr1mrLra5-HwrPX31IT07aEII.3_1 2024-03-04T13:00:15.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.472+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581__multipart_multipart_enc.2~__vgYJlr1mrLra5-HwrPX31IT07aEII.4 2024-03-04T13:00:15.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.472+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581__shadow_multipart_enc.2~__vgYJlr1mrLra5-HwrPX31IT07aEII.4_1 2024-03-04T13:00:15.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.473+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581__multipart_multipart_enc.2~__vgYJlr1mrLra5-HwrPX31IT07aEII.5 2024-03-04T13:00:15.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.473+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581__shadow_multipart_enc.2~__vgYJlr1mrLra5-HwrPX31IT07aEII.5_1 2024-03-04T13:00:15.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.473+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581__multipart_multipart_enc.2~__vgYJlr1mrLra5-HwrPX31IT07aEII.6 2024-03-04T13:00:15.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.473+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581__shadow_multipart_enc.2~__vgYJlr1mrLra5-HwrPX31IT07aEII.6_1 2024-03-04T13:00:15.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.475+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12039085194049607337', time=2024-03-04T14:58:38.195056+0000, chain.objs.size()=1 2024-03-04T13:00:15.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.475+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.641__shadow_.vBKY9YCrDkKBC-RFaExSKF2x5Jn5bLC_0 2024-03-04T13:00:15.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.475+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.91352109455676422', time=2024-03-04T14:58:43.719376+0000, chain.objs.size()=1 2024-03-04T13:00:15.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.475+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.656__shadow:MkzLdtYSj5rJ8gQY3oRsiKc5qFHOux._.onzoVy5XK997fvdQFxYlSX24b9d1byr_0 2024-03-04T13:00:15.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.479+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:15.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.482+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T13:00:15.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.483+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:15.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.484+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:15.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44965' 2024-03-04T13:00:15.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4095966569915997388', time=2024-03-04T14:52:57.316098+0000, chain.objs.size()=3 2024-03-04T13:00:15.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.rTglJ53XfMJMM2gkrLrgI_UPVerlpBm_0 2024-03-04T13:00:15.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.rTglJ53XfMJMM2gkrLrgI_UPVerlpBm_1 2024-03-04T13:00:15.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.rTglJ53XfMJMM2gkrLrgI_UPVerlpBm_2 2024-03-04T13:00:15.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5153136553225782912', time=2024-03-04T14:53:30.778429+0000, chain.objs.size()=1 2024-03-04T13:00:15.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.206__shadow_.K2svaErimCtpz5e9lRONCYsjjf3RlUz_0 2024-03-04T13:00:15.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5965583485945467650', time=2024-03-04T14:53:33.625804+0000, chain.objs.size()=1 2024-03-04T13:00:15.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.211__shadow_.HeA1sHzSdF4BWFKBGXqQaiSCJgeA58v_0 2024-03-04T13:00:15.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13130047396227172257', time=2024-03-04T14:53:36.111035+0000, chain.objs.size()=1 2024-03-04T13:00:15.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.216__shadow_.rwQ5YcGVdQuZcUD73w6Fo8WAR75o3zR_0 2024-03-04T13:00:15.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15388632565230552741', time=2024-03-04T14:53:39.996858+0000, chain.objs.size()=1 2024-03-04T13:00:15.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.224__shadow_.ErVwVf6MHj8k-3uGuuhesT0QG2rIDlg_0 2024-03-04T13:00:15.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7368677989804237768', time=2024-03-04T14:53:41.318314+0000, chain.objs.size()=1 2024-03-04T13:00:15.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.227__shadow_.yiFoc4-7sSPKiJOUwJ_Z85rClrP71u6_0 2024-03-04T13:00:15.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14012259819682678328', time=2024-03-04T14:53:52.044336+0000, chain.objs.size()=1 2024-03-04T13:00:15.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.KyrxuI60ZK1nXvSmF546TU6YQE7oPuv_0 2024-03-04T13:00:15.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11342934037376318044', time=2024-03-04T14:53:52.066931+0000, chain.objs.size()=1 2024-03-04T13:00:15.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vbT8Dkv2AVUYFIZ1yTW87w3by1FAX1c_0 2024-03-04T13:00:15.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7965018792952139821', time=2024-03-04T14:53:52.071337+0000, chain.objs.size()=1 2024-03-04T13:00:15.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JGSMsZUci4ChHrClQq26p2k7U9PO4lD_0 2024-03-04T13:00:15.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6032005655633320625', time=2024-03-04T14:53:52.077286+0000, chain.objs.size()=1 2024-03-04T13:00:15.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YRL8rVrjux670Ttpc1qGvAQ6nC-eph5_0 2024-03-04T13:00:15.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5525339744759697081', time=2024-03-04T14:53:52.083697+0000, chain.objs.size()=1 2024-03-04T13:00:15.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LgRJh9p7LPVRBRJ9uMmWV7_Yvm66h74_0 2024-03-04T13:00:15.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1139461685273661797', time=2024-03-04T14:53:52.089418+0000, chain.objs.size()=1 2024-03-04T13:00:15.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zB1hWbG9KcOPj-5v87DbLef6QWoXALK_0 2024-03-04T13:00:15.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11885312298812893605', time=2024-03-04T14:53:52.099998+0000, chain.objs.size()=1 2024-03-04T13:00:15.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.9Xot7_x00I1eY6CtRJy0CA5hs8z2QTK_0 2024-03-04T13:00:15.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12441539818589212355', time=2024-03-04T14:53:52.114732+0000, chain.objs.size()=1 2024-03-04T13:00:15.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.OF_GGuDPIgH3zaGFpLbyKr9eHrJQ1j5_0 2024-03-04T13:00:15.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17064974973058287116', time=2024-03-04T14:53:52.241452+0000, chain.objs.size()=1 2024-03-04T13:00:15.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.E5C-Fr9ZFctKxtHcExykazVj_xp1j4v_0 2024-03-04T13:00:15.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12634440154901985721', time=2024-03-04T14:53:52.265412+0000, chain.objs.size()=1 2024-03-04T13:00:15.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.6Zq_n0TsG6T_OoMl1Qap5X3Bw-KOe-v_0 2024-03-04T13:00:15.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2417112671045847330', time=2024-03-04T14:53:52.276379+0000, chain.objs.size()=1 2024-03-04T13:00:15.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.fsMZvoKbbciaDlScmZ0wegBIcustiUe_0 2024-03-04T13:00:15.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10462730108817124185', time=2024-03-04T14:53:52.420259+0000, chain.objs.size()=1 2024-03-04T13:00:15.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.AN9EW-2IF109XiRXT50pLhYJOPDaItB_0 2024-03-04T13:00:15.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5154980693469908868', time=2024-03-04T14:53:52.430499+0000, chain.objs.size()=1 2024-03-04T13:00:15.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.RnGjvoPOZD5hTsn7XRdxm5fba1oNyo2_0 2024-03-04T13:00:15.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16276158218342166263', time=2024-03-04T14:53:52.436238+0000, chain.objs.size()=1 2024-03-04T13:00:15.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.O-cI7IEARhSPLNar8Ee4VYsLAU_tbvK_0 2024-03-04T13:00:15.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1109713553359189164', time=2024-03-04T14:53:52.454320+0000, chain.objs.size()=1 2024-03-04T13:00:15.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.493+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.XJOOsu5zzUYPm3XDAWrZsX_sHIfLwLm_0 2024-03-04T13:00:15.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15105005357776542962', time=2024-03-04T14:53:52.458582+0000, chain.objs.size()=1 2024-03-04T13:00:15.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.aSOnYCG78dWB--132NHTlV_oVk5vRhe_0 2024-03-04T13:00:15.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4512540513862329869', time=2024-03-04T14:53:52.464940+0000, chain.objs.size()=1 2024-03-04T13:00:15.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.p0FmXGSxbn-YbKIFLjGP_EI6eCYnFc0_0 2024-03-04T13:00:15.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5994396222497574843', time=2024-03-04T14:53:52.583761+0000, chain.objs.size()=1 2024-03-04T13:00:15.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.sniD_VF1BvUPWCSppiA7YVE9Yhw_6f9_0 2024-03-04T13:00:15.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7320409779621943079', time=2024-03-04T14:53:52.628299+0000, chain.objs.size()=1 2024-03-04T13:00:15.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.6UgZfWe6lc9KSDwFW4Z8913n0twyddo_0 2024-03-04T13:00:15.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5902207391030347425', time=2024-03-04T14:53:52.656184+0000, chain.objs.size()=1 2024-03-04T13:00:15.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ancwqv7fUJt6XyyxnVO55eNZ8Eif8j9_0 2024-03-04T13:00:15.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18036639023903441938', time=2024-03-04T14:53:52.745220+0000, chain.objs.size()=1 2024-03-04T13:00:15.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ezEtRPITYJap4YxJP3_-nPKkaaYptho_0 2024-03-04T13:00:15.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14403885600172360010', time=2024-03-04T14:53:52.833891+0000, chain.objs.size()=1 2024-03-04T13:00:15.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.A6muEkPI5KqWYxdMEqV5sdzP_Wbp5Ph_0 2024-03-04T13:00:15.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10986520823964145789', time=2024-03-04T14:53:52.836736+0000, chain.objs.size()=1 2024-03-04T13:00:15.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.AaGi8SjsAfNBTY2-wcjQh5bVz1Tcr_U_0 2024-03-04T13:00:15.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14352235879941541265', time=2024-03-04T14:53:52.915704+0000, chain.objs.size()=1 2024-03-04T13:00:15.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Mz1cPtFxdDzpDPIWxosvA-G_HgCGz3f_0 2024-03-04T13:00:15.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1096087222746470999', time=2024-03-04T14:53:52.956804+0000, chain.objs.size()=1 2024-03-04T13:00:15.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.7WjzcycM0KN8RvzrQ4bEgDeN3zSTycN_0 2024-03-04T13:00:15.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5021080471071404654', time=2024-03-04T14:53:53.098437+0000, chain.objs.size()=1 2024-03-04T13:00:15.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0tvXeuDiN3h3hM-Ux0BAL6KDgVickhV_0 2024-03-04T13:00:15.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.500+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12138120012146367263', time=2024-03-04T14:53:53.102309+0000, chain.objs.size()=1 2024-03-04T13:00:15.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.500+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.lWaTVgS4o5JNTGMqaA_dsz8ybynS7e1_0 2024-03-04T13:00:15.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.500+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18164286865305164157', time=2024-03-04T14:53:53.145144+0000, chain.objs.size()=1 2024-03-04T13:00:15.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.500+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.FiTu9Dz6KV0JWQ9-ODSnSd5GUzs14l3_0 2024-03-04T13:00:15.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.500+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9147744887797260719', time=2024-03-04T14:53:53.148960+0000, chain.objs.size()=1 2024-03-04T13:00:15.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.500+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.I4hXzChjKK3dESHDB4Bo766VniOW3P7_0 2024-03-04T13:00:15.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10872002093805223221', time=2024-03-04T14:53:53.171304+0000, chain.objs.size()=1 2024-03-04T13:00:15.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.oE9LePz1pup_dkLGhnQ1GZDmzKajBwf_0 2024-03-04T13:00:15.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5575085512563772914', time=2024-03-04T14:53:53.276966+0000, chain.objs.size()=1 2024-03-04T13:00:15.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3q1UqogUZra6HQ3_e_usgfIg8KVIPQy_0 2024-03-04T13:00:15.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12053155011423392697', time=2024-03-04T14:53:58.325794+0000, chain.objs.size()=1 2024-03-04T13:00:15.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.244__shadow_.Jg_-HvMad7k4eDcT3rNvaqOrsw3P14R_0 2024-03-04T13:00:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16513002360354762946', time=2024-03-04T14:54:01.439292+0000, chain.objs.size()=1 2024-03-04T13:00:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.251__shadow_.jApZbrL_uSRlNYkMpL5wvb0Lz6wL2Wh_0 2024-03-04T13:00:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3471541728659752332', time=2024-03-04T14:54:08.238509+0000, chain.objs.size()=1 2024-03-04T13:00:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.WijnrUImryCW2MlOeuvZQpSbuagqns-_0 2024-03-04T13:00:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3829949561967809965', time=2024-03-04T14:54:08.239321+0000, chain.objs.size()=1 2024-03-04T13:00:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.JQwvZONZNFZl1b8rqj7Z8Ol6zjJwXLs_0 2024-03-04T13:00:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9600575425493899879', time=2024-03-04T14:54:09.035707+0000, chain.objs.size()=1 2024-03-04T13:00:15.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.jnqRjsKY0xZBZ4nbMslMaaxCkSQ8bxZ_0 2024-03-04T13:00:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7939092874686654545', time=2024-03-04T14:54:29.618507+0000, chain.objs.size()=1 2024-03-04T13:00:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.jS7mnoUWXKcZrCHCz1wzSdnoqVO9dsV_0 2024-03-04T13:00:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3579892835369788715', time=2024-03-04T14:54:29.619196+0000, chain.objs.size()=1 2024-03-04T13:00:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Z4xS3VYMNBzGOfTA_EzbXHPS8X3pptQ_0 2024-03-04T13:00:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9858330773711361363', time=2024-03-04T14:54:29.619987+0000, chain.objs.size()=1 2024-03-04T13:00:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Zm_fWbzRaMqu3Xbk9ctCU6TlBGsYySx_0 2024-03-04T13:00:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10108127809522069070', time=2024-03-04T14:54:29.631383+0000, chain.objs.size()=1 2024-03-04T13:00:15.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.503+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2y0Lm0-74h9HbVJQXr6-1Tlpu8ZODfO_0 2024-03-04T13:00:15.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.504+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15022261894732320472', time=2024-03-04T14:54:29.652099+0000, chain.objs.size()=1 2024-03-04T13:00:15.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.504+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.QMvoQghUX2QaAlQndL1VdriEA4WbFUo_0 2024-03-04T13:00:15.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.504+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12863362642340578143', time=2024-03-04T14:54:29.657293+0000, chain.objs.size()=1 2024-03-04T13:00:15.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.504+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Fs_DLxiAXHKgOxNj7-ZtjjPgIBs_6Yv_0 2024-03-04T13:00:15.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.507+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17550181403681357723', time=2024-03-04T14:54:29.664011+0000, chain.objs.size()=1 2024-03-04T13:00:15.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.507+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tAaj7VLpC2WAs4UTYhu-5en_HJnMjRt_0 2024-03-04T13:00:15.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2741574706991178853', time=2024-03-04T14:54:29.664670+0000, chain.objs.size()=1 2024-03-04T13:00:15.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2uR5bPZNIk_zFqkhyOqK8r-I_zuwhqO_0 2024-03-04T13:00:15.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16791999320606785999', time=2024-03-04T14:54:29.688885+0000, chain.objs.size()=1 2024-03-04T13:00:15.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.6myFoHpTQB-pnjk1vAzv4y0wv98BDHE_0 2024-03-04T13:00:15.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12404704061146718395', time=2024-03-04T14:54:29.701468+0000, chain.objs.size()=1 2024-03-04T13:00:15.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.frsLP0x1PkEi9RfRZX0yqNc0SKdVcc3_0 2024-03-04T13:00:15.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2658306506506249913', time=2024-03-04T14:54:29.783357+0000, chain.objs.size()=1 2024-03-04T13:00:15.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ER9Nr-0WW4rASlHUGh3gtAMydNKZC_2_0 2024-03-04T13:00:15.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589529732728234872', time=2024-03-04T14:54:29.792744+0000, chain.objs.size()=1 2024-03-04T13:00:15.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.hFfdbYeNm-9CGHPCvVSvKKUZxJwR_2w_0 2024-03-04T13:00:15.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6489450016448481966', time=2024-03-04T14:54:29.803262+0000, chain.objs.size()=1 2024-03-04T13:00:15.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.1dURIlq660vQzV2-DxC7OAG_PUQRc69_0 2024-03-04T13:00:15.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12008699518643099005', time=2024-03-04T14:54:29.814725+0000, chain.objs.size()=1 2024-03-04T13:00:15.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.UrFBwAsCYWSJYX00rYlkhLSrDHorlF7_0 2024-03-04T13:00:15.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11024963912480795683', time=2024-03-04T14:54:29.815507+0000, chain.objs.size()=1 2024-03-04T13:00:15.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.B1mcwl7q04STQAO8mF80HN1IdO6rKda_0 2024-03-04T13:00:15.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.510+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8080655657876992217', time=2024-03-04T14:54:29.833812+0000, chain.objs.size()=1 2024-03-04T13:00:15.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.510+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cZXnn17LLNN7ItZsD2E0l3EyMgTx_nr_0 2024-03-04T13:00:15.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.510+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14373751987631539359', time=2024-03-04T14:54:29.834581+0000, chain.objs.size()=1 2024-03-04T13:00:15.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.510+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.WSpxi0YH_ijavGPb8qCTkaB1aw1ejgH_0 2024-03-04T13:00:15.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.513+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14010335863289215721', time=2024-03-04T14:54:29.848352+0000, chain.objs.size()=1 2024-03-04T13:00:15.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.513+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HQ-1s-O83mRaTcSj97DTxJ7DtaKADd7_0 2024-03-04T13:00:15.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.513+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15557784202989761152', time=2024-03-04T14:54:29.851350+0000, chain.objs.size()=1 2024-03-04T13:00:15.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.513+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LUTcA7sawXevRS2lS4MajfjFJlTuLPg_0 2024-03-04T13:00:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2428439520450854978', time=2024-03-04T14:54:29.951774+0000, chain.objs.size()=1 2024-03-04T13:00:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.mbKIvuDZox1glxzHUl6uAkjS5sVtiH2_0 2024-03-04T13:00:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4263830482650985302', time=2024-03-04T14:54:29.984951+0000, chain.objs.size()=1 2024-03-04T13:00:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.k08km968iDTJSq28EJ16Q2MplIed0RQ_0 2024-03-04T13:00:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9679624580016098886', time=2024-03-04T14:54:30.010113+0000, chain.objs.size()=1 2024-03-04T13:00:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.bNWqwo5sgOmRBcIMFusJlBIUAbG7W_t_0 2024-03-04T13:00:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9151735519169291407', time=2024-03-04T14:54:30.147823+0000, chain.objs.size()=1 2024-03-04T13:00:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.s0OhbSUgq3ns_fC0HuuZKAtIp6RKRjS_0 2024-03-04T13:00:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10264237245381810740', time=2024-03-04T14:54:30.158794+0000, chain.objs.size()=1 2024-03-04T13:00:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.hKVukzzuSLW6lqf-bRD9ngPOAUn7GmS_0 2024-03-04T13:00:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9600929284176060666', time=2024-03-04T14:54:30.284086+0000, chain.objs.size()=1 2024-03-04T13:00:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ChdencWaJ9iY3fCkKIo4yrCmrsDHgB-_0 2024-03-04T13:00:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2175649242673559227', time=2024-03-04T14:54:30.284796+0000, chain.objs.size()=1 2024-03-04T13:00:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0XKot0R-ps1QkYnqNVNqcw3a1xZoKGy_0 2024-03-04T13:00:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10355627256072982159', time=2024-03-04T14:54:30.290386+0000, chain.objs.size()=1 2024-03-04T13:00:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.1ZDXoE8JRIGrGuF5eHpZKVVi6RPhAto_0 2024-03-04T13:00:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9680582850553306488', time=2024-03-04T14:54:30.302295+0000, chain.objs.size()=1 2024-03-04T13:00:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RdedLuFMS8K9QEBQFC9jjW3bDxOvNtp_0 2024-03-04T13:00:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.516+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3505181082002802636', time=2024-03-04T14:54:30.304946+0000, chain.objs.size()=1 2024-03-04T13:00:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.516+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.O5Jw9cY0FnL76uWR4WsSITX3gLECRvU_0 2024-03-04T13:00:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.516+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3762896057211730914', time=2024-03-04T14:54:30.314910+0000, chain.objs.size()=1 2024-03-04T13:00:15.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.516+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.J1DAOUT-5f2dupF57L9zl8ve1ZVQbS0_0 2024-03-04T13:00:15.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.519+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17075719544895433826', time=2024-03-04T14:54:30.323627+0000, chain.objs.size()=1 2024-03-04T13:00:15.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.519+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.IMz4M_5pM-xbVn2kqprFSXPT-87NoEr_0 2024-03-04T13:00:15.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.519+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9847468731451918294', time=2024-03-04T14:54:30.444616+0000, chain.objs.size()=1 2024-03-04T13:00:15.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.519+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oaBYh-aSJ0fvrzmjGA4-FUhc1Tk5pG-_0 2024-03-04T13:00:15.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.519+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6303177345426670963', time=2024-03-04T14:54:30.456840+0000, chain.objs.size()=1 2024-03-04T13:00:15.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.519+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.uza11I9XQEQ_pBl1B-6swyThkHgNad__0 2024-03-04T13:00:15.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16961971138181539141', time=2024-03-04T14:54:30.476640+0000, chain.objs.size()=1 2024-03-04T13:00:15.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.DA8B28ffqQ5r-tB9u67qNVrQ45T8kl6_0 2024-03-04T13:00:15.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5141811187743588287', time=2024-03-04T14:54:30.480109+0000, chain.objs.size()=1 2024-03-04T13:00:15.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.V5XiWk7d-gP5OsyPIuH6WU6Oi2zjadr_0 2024-03-04T13:00:15.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16752117782599121350', time=2024-03-04T14:54:30.503211+0000, chain.objs.size()=1 2024-03-04T13:00:15.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lIdncCd8IZ1Fp4bDgt00NAeGqx5touG_0 2024-03-04T13:00:15.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3523665973475685481', time=2024-03-04T14:54:30.579685+0000, chain.objs.size()=1 2024-03-04T13:00:15.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0EVUi8RxdFeBtnIWLNiJlpetm4J3lXx_0 2024-03-04T13:00:15.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5557355323617622830', time=2024-03-04T14:54:30.627911+0000, chain.objs.size()=1 2024-03-04T13:00:15.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3yCKqEYPB0wNT9S97Azlh-y8SxdhQG__0 2024-03-04T13:00:15.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16091977206319210349', time=2024-03-04T14:54:30.653982+0000, chain.objs.size()=1 2024-03-04T13:00:15.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.z7G-PR6_7bWTDZ2doqDPDLuGWMWjTvY_0 2024-03-04T13:00:15.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15995798018359993421', time=2024-03-04T14:54:30.754068+0000, chain.objs.size()=1 2024-03-04T13:00:15.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LAJX3I8jnAIlKlKqCT8pXGcS964Q7-u_0 2024-03-04T13:00:15.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.522+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6178248566018683660', time=2024-03-04T14:54:30.798103+0000, chain.objs.size()=1 2024-03-04T13:00:15.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.523+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oASJGYFuTT4iF2KuwKWbeMppjiO4MJ5_0 2024-03-04T13:00:15.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.524+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4308841031283397704', time=2024-03-04T14:54:30.799417+0000, chain.objs.size()=1 2024-03-04T13:00:15.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.524+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rDfzAFyHjYM5pGfj15iQUIH7zzjfV9O_0 2024-03-04T13:00:15.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.524+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16936755359660903229', time=2024-03-04T14:54:38.352700+0000, chain.objs.size()=1 2024-03-04T13:00:15.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.524+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tbrLMrm0LOyQHvLV1_9-0evrlyvHtW-_0 2024-03-04T13:00:15.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.524+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13300269045414642413', time=2024-03-04T14:54:38.507587+0000, chain.objs.size()=1 2024-03-04T13:00:15.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.524+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._ACAypxI0x1sY29s-u5oXQJauPU_-T5_0 2024-03-04T13:00:15.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.524+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14773141927159469123', time=2024-03-04T14:54:38.544151+0000, chain.objs.size()=1 2024-03-04T13:00:15.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.524+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.3XVj2YTjgkMYwMK3kGXkW3if0L2N6fk_0 2024-03-04T13:00:15.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.525+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.145852720290538394', time=2024-03-04T14:54:38.651528+0000, chain.objs.size()=1 2024-03-04T13:00:15.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.525+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.EsuwwAdoQFGNUUG61vRbkbUmOOzrJ_1_0 2024-03-04T13:00:15.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.525+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11948466084481102464', time=2024-03-04T14:54:38.652337+0000, chain.objs.size()=1 2024-03-04T13:00:15.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.525+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.e4bkPSRnEvXhyuZRJYcOkxKBsnl738h_0 2024-03-04T13:00:15.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.525+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16255269618874586999', time=2024-03-04T14:54:38.662728+0000, chain.objs.size()=1 2024-03-04T13:00:15.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.525+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IYqB2HhruT3eKZeHn39eYAJZ-1xlvVz_0 2024-03-04T13:00:15.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.525+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12004139331495890951', time=2024-03-04T14:54:38.664457+0000, chain.objs.size()=1 2024-03-04T13:00:15.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.525+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5kDp9GqL17kU4L7BwWvp6M4Uk4se01H_0 2024-03-04T13:00:15.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9364474419570612905', time=2024-03-04T14:54:38.675355+0000, chain.objs.size()=1 2024-03-04T13:00:15.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.P2kvr_QFu2A35_NY2lEb_oYJg-F0ept_0 2024-03-04T13:00:15.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14243253904170893913', time=2024-03-04T14:54:38.692208+0000, chain.objs.size()=1 2024-03-04T13:00:15.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.AtCdHHXEAD-ypVL508WH9iSxm3LEof1_0 2024-03-04T13:00:15.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12467319728298881355', time=2024-03-04T14:54:38.700256+0000, chain.objs.size()=1 2024-03-04T13:00:15.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.E7PP6nqBvwCrfV90mPdO5UC9fNwmI2R_0 2024-03-04T13:00:15.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4911931228637956779', time=2024-03-04T14:54:38.707803+0000, chain.objs.size()=1 2024-03-04T13:00:15.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cC0FGihTOiPwNAiwRHoPBm1HGVhVEZM_0 2024-03-04T13:00:15.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11419655009347268995', time=2024-03-04T14:54:38.791282+0000, chain.objs.size()=1 2024-03-04T13:00:15.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.LJBMZo5kYhXu7Tq870fAFf4Hg4t-4dI_0 2024-03-04T13:00:15.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5946981353832836917', time=2024-03-04T14:54:38.806974+0000, chain.objs.size()=1 2024-03-04T13:00:15.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IIEqxHdkNLHnweWJACKsTAiYiWpLBnu_0 2024-03-04T13:00:15.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12760229001798948583', time=2024-03-04T14:54:38.836267+0000, chain.objs.size()=1 2024-03-04T13:00:15.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.AadET2g3Buui1hZHfWqZ8S6895Obl7g_0 2024-03-04T13:00:15.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14591730114823324316', time=2024-03-04T14:54:38.982636+0000, chain.objs.size()=1 2024-03-04T13:00:15.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.528+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.EYaq9cYWr-txVL0xr6tYqKthKBrBvsD_0 2024-03-04T13:00:15.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.530+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6137262012325339754', time=2024-03-04T14:54:38.992303+0000, chain.objs.size()=1 2024-03-04T13:00:15.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.fsm5ptvOaUH6J3cKhobYzVRHv_kdmOj_0 2024-03-04T13:00:15.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.536+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/44965 2024-03-04T13:00:15.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-03-04T13:00:15.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11102906833684575388', time=2024-03-04T14:54:39.002218+0000, chain.objs.size()=1 2024-03-04T13:00:15.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.qI9-1hfUPnE9dUtO0SXVQY8CGA6HltD_0 2024-03-04T13:00:15.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8115860128877777028', time=2024-03-04T14:54:39.002999+0000, chain.objs.size()=1 2024-03-04T13:00:15.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.QydG_juaVH-RDVBjP6xy01rocnHP3It_0 2024-03-04T13:00:15.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2572583210488267911', time=2024-03-04T14:54:39.014399+0000, chain.objs.size()=1 2024-03-04T13:00:15.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.f0EjeJ8QfDC37WCk8CL635u53fF61I2_0 2024-03-04T13:00:15.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6911276323445582520', time=2024-03-04T14:54:39.123117+0000, chain.objs.size()=1 2024-03-04T13:00:15.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.8XZxkB_qMPefbQNkMYfI1jBsGrqyNas_0 2024-03-04T13:00:15.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5936563015232023602', time=2024-03-04T14:54:39.140518+0000, chain.objs.size()=1 2024-03-04T13:00:15.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HzoxCawsNtR0B44xXJSvZ8q1Z3UegqE_0 2024-03-04T13:00:15.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3572664539972094076', time=2024-03-04T14:54:39.169991+0000, chain.objs.size()=1 2024-03-04T13:00:15.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kUM-gfTWJAyMCPa51fCC8yS9S-duoq6_0 2024-03-04T13:00:15.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7467570847383552129', time=2024-03-04T14:54:39.277221+0000, chain.objs.size()=1 2024-03-04T13:00:15.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.WfisYyFLVfGwQAGlTH-gkMPvkA4qKCj_0 2024-03-04T13:00:15.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13179483234618337065', time=2024-03-04T14:54:39.289220+0000, chain.objs.size()=1 2024-03-04T13:00:15.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.srAPp-vs4jZ0MOMKS22Y0oe-Ak4SfFU_0 2024-03-04T13:00:15.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13135185084901250583', time=2024-03-04T14:54:39.300074+0000, chain.objs.size()=1 2024-03-04T13:00:15.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Vmu41hGzh43V_4v7MvTcf8TVUo8v5hC_0 2024-03-04T13:00:15.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12547535858189812769', time=2024-03-04T14:54:39.339664+0000, chain.objs.size()=1 2024-03-04T13:00:15.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.knfJrBVLzPZ785Uw0tcKiahqXWDHTtT_0 2024-03-04T13:00:15.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14626907482220891814', time=2024-03-04T14:54:39.350231+0000, chain.objs.size()=1 2024-03-04T13:00:15.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.YY_azGQ88IRhK1Aw1qm0BIgrvO0Bnxh_0 2024-03-04T13:00:15.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5195233401160885937', time=2024-03-04T14:54:39.444436+0000, chain.objs.size()=1 2024-03-04T13:00:15.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.538+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gH9X3GTIij3nC8q0oHsVDKeYDKjwScK_0 2024-03-04T13:00:15.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5532620750556027411', time=2024-03-04T14:54:39.450326+0000, chain.objs.size()=1 2024-03-04T13:00:15.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.d7JWmCYu1pQjT72odMWyIwf5Rs-FCqN_0 2024-03-04T13:00:15.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7393236422731177674', time=2024-03-04T14:54:39.457627+0000, chain.objs.size()=1 2024-03-04T13:00:15.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ijO3Vvbqn-ziuWGRESW_kPEGl3UtccW_0 2024-03-04T13:00:15.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7070627449894337516', time=2024-03-04T14:54:39.468363+0000, chain.objs.size()=1 2024-03-04T13:00:15.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.FYwTpRxY9r_moyZcbO5dSEXe1bbEKl__0 2024-03-04T13:00:15.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4626708859994841411', time=2024-03-04T14:54:39.470269+0000, chain.objs.size()=1 2024-03-04T13:00:15.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.z32Ka-jvoHGRgOGeoi2TaSLpoRLHLfD_0 2024-03-04T13:00:15.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10108702538625837713', time=2024-03-04T14:54:39.490255+0000, chain.objs.size()=1 2024-03-04T13:00:15.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ZiSUCC1OqLPudrtR3tNUfg777EUmLo9_0 2024-03-04T13:00:15.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12678519504387917845', time=2024-03-04T14:54:43.214799+0000, chain.objs.size()=1 2024-03-04T13:00:15.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.306__shadow_.VSSNOyl7A7onMKBXYlpUm1YvXDApzLq_0 2024-03-04T13:00:15.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17846850095769682941', time=2024-03-04T14:55:00.708186+0000, chain.objs.size()=1 2024-03-04T13:00:15.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.347__shadow_.E_bwxLGaRHFnDpGRCdTXHwvrntX7joL_0 2024-03-04T13:00:15.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2713446436815988603', time=2024-03-04T14:55:02.868794+0000, chain.objs.size()=1 2024-03-04T13:00:15.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.540+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.351__shadow_.afTfErFf_tU2vuxedAiSRK6SGaSVdc5_0 2024-03-04T13:00:15.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.541+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11910984262264775301', time=2024-03-04T14:55:47.130838+0000, chain.objs.size()=1 2024-03-04T13:00:15.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.541+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.438__shadow_.WEGjCGvS2CNaZInC-h56F-4fmu3tg6m_0 2024-03-04T13:00:15.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.541+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15917725005873771882', time=2024-03-04T14:55:52.722990+0000, chain.objs.size()=1 2024-03-04T13:00:15.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.541+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.456__shadow_.R9sgpCYKyWqcMk3CK99qKY5OQoYAyuR_0 2024-03-04T13:00:15.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.541+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12647597817163308007', time=2024-03-04T14:57:05.631635+0000, chain.objs.size()=1 2024-03-04T13:00:15.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.541+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.523__shadow_.yJc79eX_6wqA4D7Nbe-1-N99btVJNYX_0 2024-03-04T13:00:15.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.541+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7999947557107249421', time=2024-03-04T14:57:17.210952+0000, chain.objs.size()=1 2024-03-04T13:00:15.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.541+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:xSG9A0YsZn0MEPrC.qGaOIGGqleAt5e_.ya7Ul3B4Bx75kQYBz76HoCOfjHPuQte_0 2024-03-04T13:00:15.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.542+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4300455020538907188', time=2024-03-04T14:57:48.960264+0000, chain.objs.size()=1 2024-03-04T13:00:15.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.542+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.548__shadow:S.EXt9Fv9LDGeK7ZRuFb0wJj6l7I31s_.WxCUCHZ0qs-GCeMIub44CZCJIJ6EgZY_0 2024-03-04T13:00:15.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.542+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2019429253490480311', time=2024-03-04T14:58:12.640132+0000, chain.objs.size()=12 2024-03-04T13:00:15.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.542+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.587__multipart_multipart_enc.2~hXEYY-xJME6g2AghUJSTWBnrwYgdOcV.1 2024-03-04T13:00:15.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.542+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.587__shadow_multipart_enc.2~hXEYY-xJME6g2AghUJSTWBnrwYgdOcV.1_1 2024-03-04T13:00:15.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.542+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.587__multipart_multipart_enc.2~hXEYY-xJME6g2AghUJSTWBnrwYgdOcV.2 2024-03-04T13:00:15.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.543+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.587__shadow_multipart_enc.2~hXEYY-xJME6g2AghUJSTWBnrwYgdOcV.2_1 2024-03-04T13:00:15.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.543+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.587__multipart_multipart_enc.2~hXEYY-xJME6g2AghUJSTWBnrwYgdOcV.3 2024-03-04T13:00:15.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.543+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.587__shadow_multipart_enc.2~hXEYY-xJME6g2AghUJSTWBnrwYgdOcV.3_1 2024-03-04T13:00:15.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.543+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.587__multipart_multipart_enc.2~hXEYY-xJME6g2AghUJSTWBnrwYgdOcV.4 2024-03-04T13:00:15.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.543+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.587__shadow_multipart_enc.2~hXEYY-xJME6g2AghUJSTWBnrwYgdOcV.4_1 2024-03-04T13:00:15.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.543+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.587__multipart_multipart_enc.2~hXEYY-xJME6g2AghUJSTWBnrwYgdOcV.5 2024-03-04T13:00:15.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.545+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.587__shadow_multipart_enc.2~hXEYY-xJME6g2AghUJSTWBnrwYgdOcV.5_1 2024-03-04T13:00:15.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.545+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.587__multipart_multipart_enc.2~hXEYY-xJME6g2AghUJSTWBnrwYgdOcV.6 2024-03-04T13:00:15.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.545+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.587__shadow_multipart_enc.2~hXEYY-xJME6g2AghUJSTWBnrwYgdOcV.6_1 2024-03-04T13:00:15.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12102376698921883892', time=2024-03-04T14:58:32.246544+0000, chain.objs.size()=1 2024-03-04T13:00:15.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.626__shadow_.ZLI_jxXY_QGc63mWaBTsH6yKoew5kR1_0 2024-03-04T13:00:15.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.549+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:15.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.551+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T13:00:15.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:15.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:15.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52238' 2024-03-04T13:00:15.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8970513621035724461', time=2024-03-04T14:53:28.859856+0000, chain.objs.size()=1 2024-03-04T13:00:15.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.201__shadow_.mkKwHmq_l7_MQTh5vaIs7ObJJHbPjUC_0 2024-03-04T13:00:15.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6484540216227491900', time=2024-03-04T14:53:29.418015+0000, chain.objs.size()=1 2024-03-04T13:00:15.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.203__shadow_.3nNliHrCdD9shaWQo3WM1rqP5PrWMrw_0 2024-03-04T13:00:15.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14722261280528448227', time=2024-03-04T14:53:32.819821+0000, chain.objs.size()=1 2024-03-04T13:00:15.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.210__shadow_.rL1dH5voKxD-wnAjFlu9_HIxHkr8FCW_0 2024-03-04T13:00:15.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11613492267895229884', time=2024-03-04T14:53:33.626558+0000, chain.objs.size()=1 2024-03-04T13:00:15.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.211__shadow_.oUa1XOoCkrDxsI79HobTwOu9ByQJwux_0 2024-03-04T13:00:15.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4528122107130114475', time=2024-03-04T14:53:38.213938+0000, chain.objs.size()=1 2024-03-04T13:00:15.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.220__shadow_.mdfNvw_3izvfnG_WexuBdiG0vk8Ry-r_0 2024-03-04T13:00:15.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11046090156496021186', time=2024-03-04T14:53:42.665649+0000, chain.objs.size()=1 2024-03-04T13:00:15.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.230__shadow_.W2s2U0g2bnGP3pZGOmlBH1Ml6x_uDzg_0 2024-03-04T13:00:15.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2761341233176997487', time=2024-03-04T14:53:43.097552+0000, chain.objs.size()=1 2024-03-04T13:00:15.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.231__shadow_.o66bXLY9FgBeDIGfRnwNVm_aZWJX10h_0 2024-03-04T13:00:15.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1918609033582001691', time=2024-03-04T14:53:52.045425+0000, chain.objs.size()=1 2024-03-04T13:00:15.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yk4SlddpdU1PkqQpBUusnekvVyWXa6n_0 2024-03-04T13:00:15.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12231318031386542913', time=2024-03-04T14:53:52.090064+0000, chain.objs.size()=1 2024-03-04T13:00:15.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.NZGUjLlOQVotaWZFradjPgx3gxtcUpw_0 2024-03-04T13:00:15.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12099918564675706641', time=2024-03-04T14:53:52.098651+0000, chain.objs.size()=1 2024-03-04T13:00:15.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.1V5mQC3ombCteAmLE-Eeu4xIzYpqC_H_0 2024-03-04T13:00:15.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7316693963882899607', time=2024-03-04T14:53:52.128440+0000, chain.objs.size()=1 2024-03-04T13:00:15.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Q5Wip7vyzz-p0rVu6q4h1DujMCvyLlo_0 2024-03-04T13:00:15.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8467369471317709950', time=2024-03-04T14:53:52.132507+0000, chain.objs.size()=1 2024-03-04T13:00:15.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.554+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LwTcA0YLwRMuwwrPLyyX07r-2X4b0S-_0 2024-03-04T13:00:15.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.556+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16653997795400388936', time=2024-03-04T14:53:52.138007+0000, chain.objs.size()=1 2024-03-04T13:00:15.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.556+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.EsgGpuqT7KVJ1znj5lJMvl0tA6iA8uk_0 2024-03-04T13:00:15.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1772047696124451916', time=2024-03-04T14:53:52.220442+0000, chain.objs.size()=1 2024-03-04T13:00:15.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.tUze5p-wIujAXaI8vE5NUx1QzHtZ8Ic_0 2024-03-04T13:00:15.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10818535835153617735', time=2024-03-04T14:53:52.231608+0000, chain.objs.size()=1 2024-03-04T13:00:15.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.IVqqotV7KlExE520N-2kvaGr9gpq7z5_0 2024-03-04T13:00:15.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8551744257311149290', time=2024-03-04T14:53:52.235436+0000, chain.objs.size()=1 2024-03-04T13:00:15.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5FkKV9OXcgAfsDjbXBKJ1FFU72n7_c3_0 2024-03-04T13:00:15.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13841743960785629913', time=2024-03-04T14:53:52.237580+0000, chain.objs.size()=1 2024-03-04T13:00:15.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ivtXF2OJRiQ3EEMlJA2tcYH4en2cu-u_0 2024-03-04T13:00:15.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4805798573648521511', time=2024-03-04T14:53:52.249864+0000, chain.objs.size()=1 2024-03-04T13:00:15.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5qbUknCp34yEQH8abIDABYCe6w1vhIA_0 2024-03-04T13:00:15.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16356159724890307598', time=2024-03-04T14:53:52.271400+0000, chain.objs.size()=1 2024-03-04T13:00:15.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3fQ0wqbP2MV5zpepn0nVeejIc3V0HY2_0 2024-03-04T13:00:15.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17481115787638220415', time=2024-03-04T14:53:52.291552+0000, chain.objs.size()=1 2024-03-04T13:00:15.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.rUzHQSbmcr-TbcI6efdfEQvFKiDQpPo_0 2024-03-04T13:00:15.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.312494273620094225', time=2024-03-04T14:53:52.308107+0000, chain.objs.size()=1 2024-03-04T13:00:15.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.6M-p5LNEfrv1neMuVl3EZBIbhWkRlus_0 2024-03-04T13:00:15.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10516954102266118874', time=2024-03-04T14:53:52.320646+0000, chain.objs.size()=1 2024-03-04T13:00:15.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.uitmX-j5nTWedNB-4qHykXQTWOolL6r_0 2024-03-04T13:00:15.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15269689217480519556', time=2024-03-04T14:53:52.413443+0000, chain.objs.size()=1 2024-03-04T13:00:15.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.557+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.MqPEZ3j-OL5yt7EPo1dC8UhI2qPGvlK_0 2024-03-04T13:00:15.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.558+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15806396671108025476', time=2024-03-04T14:53:52.418292+0000, chain.objs.size()=1 2024-03-04T13:00:15.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.558+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jO7W4arBH-NIksPVDrmF5SscJJNCJLW_0 2024-03-04T13:00:15.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2241692943324043229', time=2024-03-04T14:53:52.421826+0000, chain.objs.size()=1 2024-03-04T13:00:15.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.epVL3P0k8YAVcDqhpdsINmZ30l-j30Y_0 2024-03-04T13:00:15.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15030893667576169567', time=2024-03-04T14:53:52.455448+0000, chain.objs.size()=1 2024-03-04T13:00:15.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.K3nAgjYivlODBnhClZRu8nAGB4LX8gA_0 2024-03-04T13:00:15.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14788312166715464773', time=2024-03-04T14:53:52.485931+0000, chain.objs.size()=1 2024-03-04T13:00:15.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vqod_suxhDWCa9RWaIXmdInJfLTLq5z_0 2024-03-04T13:00:15.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16947665533847999387', time=2024-03-04T14:53:52.577812+0000, chain.objs.size()=1 2024-03-04T13:00:15.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.SZVuBzSNGOsXOyCu2EjQpVvsNdgnkmt_0 2024-03-04T13:00:15.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6082284214004801658', time=2024-03-04T14:53:52.579300+0000, chain.objs.size()=1 2024-03-04T13:00:15.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.22krxR3GHHPJ_yV871DuPDThokMMjSC_0 2024-03-04T13:00:15.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16529979869719590189', time=2024-03-04T14:53:52.590497+0000, chain.objs.size()=1 2024-03-04T13:00:15.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.B0wXjiXrT0HZ0iPOeOK7EQNOj0EkCyK_0 2024-03-04T13:00:15.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6918178643306998124', time=2024-03-04T14:53:52.617838+0000, chain.objs.size()=1 2024-03-04T13:00:15.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.SVEXk0ZNbRTaQERA8ZWwNUXRbrhEOb8_0 2024-03-04T13:00:15.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.560+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14466697690600957068', time=2024-03-04T14:53:52.632845+0000, chain.objs.size()=1 2024-03-04T13:00:15.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.560+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.R29UOm9wLkaLUvRA1Sg0eS1j2WS893K_0 2024-03-04T13:00:15.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.560+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2768407521140517806', time=2024-03-04T14:53:52.637951+0000, chain.objs.size()=1 2024-03-04T13:00:15.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.560+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.TDn3ue5QEp1wse8yVmL1gEwwHkBnsG__0 2024-03-04T13:00:15.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.560+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14392831537012394687', time=2024-03-04T14:53:52.800438+0000, chain.objs.size()=1 2024-03-04T13:00:15.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.560+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.oKJMG5fGrvV-jjPkhdgVfEogpxUJeyR_0 2024-03-04T13:00:15.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.560+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10375007507057301971', time=2024-03-04T14:53:52.803537+0000, chain.objs.size()=1 2024-03-04T13:00:15.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.560+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ai4kMJ0JXjB_qDqswbeOR-ejGzJGOfQ_0 2024-03-04T13:00:15.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.560+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11652864622807969162', time=2024-03-04T14:53:52.807101+0000, chain.objs.size()=1 2024-03-04T13:00:15.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.560+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.1wudF_7RPMB-nn3fyUwvPaSDWkERw9o_0 2024-03-04T13:00:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.561+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17277108299806799919', time=2024-03-04T14:53:52.821986+0000, chain.objs.size()=1 2024-03-04T13:00:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.561+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0bggbB5idYVqjur4KdmAWkpYhhMffAW_0 2024-03-04T13:00:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.561+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15315014366339311452', time=2024-03-04T14:53:52.838680+0000, chain.objs.size()=1 2024-03-04T13:00:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.561+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.L2CSEP3sP_doI2jVQkz4MtmKzC23AHL_0 2024-03-04T13:00:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14984503888925234338', time=2024-03-04T14:53:52.975768+0000, chain.objs.size()=1 2024-03-04T13:00:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vqZkBUm2XG2DIgfugUHrIJbZG-z7MHy_0 2024-03-04T13:00:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15270744005278086790', time=2024-03-04T14:53:53.005598+0000, chain.objs.size()=1 2024-03-04T13:00:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.adytjQAYWMO_sAm0U2jM3xgS5TStLMd_0 2024-03-04T13:00:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16790167380312733536', time=2024-03-04T14:53:53.151373+0000, chain.objs.size()=1 2024-03-04T13:00:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.myrMQ8yYTmxt8j5wg2D4y5Td02IrhMS_0 2024-03-04T13:00:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2803313569035835572', time=2024-03-04T14:53:53.178322+0000, chain.objs.size()=1 2024-03-04T13:00:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.fZd0PcfVbzr_2KydTJOozu0WOzGsRzY_0 2024-03-04T13:00:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6181920415980952863', time=2024-03-04T14:53:53.249216+0000, chain.objs.size()=1 2024-03-04T13:00:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.o_XapWdmYJoHFvZ9zbPgvubaRjZwBfh_0 2024-03-04T13:00:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9677067933481641166', time=2024-03-04T14:54:05.862936+0000, chain.objs.size()=1 2024-03-04T13:00:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.261__shadow_.KGR_nHM_o3T1IiEokezVoU5AkxchPXr_0 2024-03-04T13:00:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9106441863404642756', time=2024-03-04T14:54:07.454729+0000, chain.objs.size()=1 2024-03-04T13:00:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.264__shadow_.Zn3LMgzLRHnAvl4RtTRdgV3t4WIQj_M_0 2024-03-04T13:00:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9195946969998106179', time=2024-03-04T14:54:08.239734+0000, chain.objs.size()=1 2024-03-04T13:00:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.dABpRcxuw8Db0XVUMg0bbkdoaCXY4xW_0 2024-03-04T13:00:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10930019389104606528', time=2024-03-04T14:54:21.821561+0000, chain.objs.size()=1 2024-03-04T13:00:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.562+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.295__shadow_.jRdw1dGI3QWE_0X28nN7at3ph1kMX2E_0 2024-03-04T13:00:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.563+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13784752696105214104', time=2024-03-04T14:54:29.661461+0000, chain.objs.size()=1 2024-03-04T13:00:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.563+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RwFdgejwYt6W8MRIryaNh2euiU2nAeX_0 2024-03-04T13:00:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.563+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3719454944860480808', time=2024-03-04T14:54:29.692702+0000, chain.objs.size()=1 2024-03-04T13:00:15.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.563+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.1q9AGPrGlFc3t4TWH3LJSdEQPzhZOK__0 2024-03-04T13:00:15.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.564+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12831726017855123745', time=2024-03-04T14:54:29.779267+0000, chain.objs.size()=1 2024-03-04T13:00:15.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.564+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Zd46okcq89s65ho3i8Yq7KjeETVEudO_0 2024-03-04T13:00:15.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.564+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1227179253292438985', time=2024-03-04T14:54:29.818943+0000, chain.objs.size()=1 2024-03-04T13:00:15.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.564+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.AtpC-jzjmpoFP4f_51ilU5mIhYa6df6_0 2024-03-04T13:00:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16269247508196480788', time=2024-03-04T14:54:29.836774+0000, chain.objs.size()=1 2024-03-04T13:00:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.BMDx2odhKUScGkBSK43h7VOlG6nM62m_0 2024-03-04T13:00:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18000186217331745556', time=2024-03-04T14:54:29.850149+0000, chain.objs.size()=1 2024-03-04T13:00:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Q3Wn7VLx82t8GXeXAXoGYAz5d_eBvIg_0 2024-03-04T13:00:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.169122618585587022', time=2024-03-04T14:54:29.863190+0000, chain.objs.size()=1 2024-03-04T13:00:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rTGoJ5owv4D_pwqUeLd8KYhLuNz_w_s_0 2024-03-04T13:00:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11689793841617678135', time=2024-03-04T14:54:29.940031+0000, chain.objs.size()=1 2024-03-04T13:00:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.E_CVUQ_Ni45s_QlZMfYoxHo2o5v7tvo_0 2024-03-04T13:00:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16852552519733768305', time=2024-03-04T14:54:29.943105+0000, chain.objs.size()=1 2024-03-04T13:00:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.xa90aq3t-jvnqQXs5DDjfoT2uIlfQas_0 2024-03-04T13:00:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16478212152928880906', time=2024-03-04T14:54:29.982078+0000, chain.objs.size()=1 2024-03-04T13:00:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.CIHUx8ar2oPd_YflGy27CbC1tI7Pw4S_0 2024-03-04T13:00:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15550903377460379625', time=2024-03-04T14:54:29.989865+0000, chain.objs.size()=1 2024-03-04T13:00:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.igT4DaZtbQxVGUJc_RO5SJe8HDhoiMD_0 2024-03-04T13:00:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12833305613960929184', time=2024-03-04T14:54:30.021206+0000, chain.objs.size()=1 2024-03-04T13:00:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.62PY2Vi6dvJgfMp04RSzFg9Ih-sN4Ha_0 2024-03-04T13:00:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.635288079673440446', time=2024-03-04T14:54:30.117061+0000, chain.objs.size()=1 2024-03-04T13:00:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.g5dJI6oKN3kDJb5OC_jplfYn6WpjKzm_0 2024-03-04T13:00:15.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11931902993311227414', time=2024-03-04T14:54:30.152545+0000, chain.objs.size()=1 2024-03-04T13:00:15.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.xyYU9umiRzxq610N2Po8zTKYqHF_4NV_0 2024-03-04T13:00:15.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7575630128109496277', time=2024-03-04T14:54:30.296037+0000, chain.objs.size()=1 2024-03-04T13:00:15.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.567+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.OgpwCVwXrzE40lwZpDuwEHsojaUJ163_0 2024-03-04T13:00:15.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.569+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12006591955255905804', time=2024-03-04T14:54:30.297407+0000, chain.objs.size()=1 2024-03-04T13:00:15.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.569+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Zl3aGXEM1Y9If5OaweCo287V-igb3zg_0 2024-03-04T13:00:15.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.569+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13573239082152458935', time=2024-03-04T14:54:30.306480+0000, chain.objs.size()=1 2024-03-04T13:00:15.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.569+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.AXvzsNBSoAkCJA3NS_WJASvSDTUpG2I_0 2024-03-04T13:00:15.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8184702014028703084', time=2024-03-04T14:54:30.323248+0000, chain.objs.size()=1 2024-03-04T13:00:15.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.pN8vGv4fxfxzUsXDPg0jHK0r_nybPJQ_0 2024-03-04T13:00:15.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4732036322574376629', time=2024-03-04T14:54:30.347475+0000, chain.objs.size()=1 2024-03-04T13:00:15.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wiA_qkO68EYx5aydiEXwjRBmQkIuICi_0 2024-03-04T13:00:15.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3070644179388702142', time=2024-03-04T14:54:30.422873+0000, chain.objs.size()=1 2024-03-04T13:00:15.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ah4fcOLfz7bYRCJZXZ8d_ljdXOMiLnz_0 2024-03-04T13:00:15.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2393811803646765989', time=2024-03-04T14:54:30.436918+0000, chain.objs.size()=1 2024-03-04T13:00:15.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oZwvL0zi2dfia7aKT4KQhRGp0hAM1WJ_0 2024-03-04T13:00:15.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5612692446008991404', time=2024-03-04T14:54:30.457889+0000, chain.objs.size()=1 2024-03-04T13:00:15.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.H1MGaJ4USUoBlVQtVZvEUaw2edDUc3j_0 2024-03-04T13:00:15.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18365277482222529056', time=2024-03-04T14:54:30.491947+0000, chain.objs.size()=1 2024-03-04T13:00:15.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0-Rh4wH1N9MZJ3Az6usgq3JICH78CWp_0 2024-03-04T13:00:15.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4923396600412201545', time=2024-03-04T14:54:30.582109+0000, chain.objs.size()=1 2024-03-04T13:00:15.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.KXd7t7jUTtb_rO9RchNtuRP1wLgGWIe_0 2024-03-04T13:00:15.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14338075025728552329', time=2024-03-04T14:54:30.584837+0000, chain.objs.size()=1 2024-03-04T13:00:15.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.A-G32kJBygH04k11DkMBEUSnhXMQYD2_0 2024-03-04T13:00:15.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11743990744348458229', time=2024-03-04T14:54:30.594527+0000, chain.objs.size()=1 2024-03-04T13:00:15.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Tcu2IuJOi0-6YMPWW6PDBRX1sD8T7gf_0 2024-03-04T13:00:15.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3805231335679645976', time=2024-03-04T14:54:30.597520+0000, chain.objs.size()=1 2024-03-04T13:00:15.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.pXBc3ckD-yccfG54LT3wxWhvPNYNFNu_0 2024-03-04T13:00:15.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5054843101677959423', time=2024-03-04T14:54:30.624173+0000, chain.objs.size()=1 2024-03-04T13:00:15.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.BV7s4gTJuBklzS7wcVgeKJi6S7isV6w_0 2024-03-04T13:00:15.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.572+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16020821526870054531', time=2024-03-04T14:54:30.643846+0000, chain.objs.size()=1 2024-03-04T13:00:15.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.572+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.dxNE8pO-JdT1oKNuyaAibPUD-3YYVKM_0 2024-03-04T13:00:15.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.572+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1614016691891751375', time=2024-03-04T14:54:30.739350+0000, chain.objs.size()=1 2024-03-04T13:00:15.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.572+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.nfs5NQ2AymdWVS1bWu1okyeHHujhhaS_0 2024-03-04T13:00:15.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.572+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7537700796863753450', time=2024-03-04T14:54:30.755060+0000, chain.objs.size()=1 2024-03-04T13:00:15.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.572+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oxVaPk6we6IB_XJJFPTzdIu1O5jyNUZ_0 2024-03-04T13:00:15.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.572+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3620723824130300495', time=2024-03-04T14:54:30.765783+0000, chain.objs.size()=1 2024-03-04T13:00:15.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.572+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.um_llICwhW7ADrmDLs_DBSd72wRRQpD_0 2024-03-04T13:00:15.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.572+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4145283196262015260', time=2024-03-04T14:54:38.322807+0000, chain.objs.size()=1 2024-03-04T13:00:15.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.572+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gCZLLdje3NxfdQ0ua-4CXsAS5hV2l55_0 2024-03-04T13:00:15.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.572+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14284924245631011614', time=2024-03-04T14:54:38.328178+0000, chain.objs.size()=1 2024-03-04T13:00:15.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.572+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.nWwzkRKWOlVxVHUZClalrI8E2-xgHvh_0 2024-03-04T13:00:15.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13439880712773288387', time=2024-03-04T14:54:38.370479+0000, chain.objs.size()=1 2024-03-04T13:00:15.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zPBC_Q7yJH9__HoMUoSDqPFMFM9LRDA_0 2024-03-04T13:00:15.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3783018767822700934', time=2024-03-04T14:54:38.470170+0000, chain.objs.size()=1 2024-03-04T13:00:15.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.dS1-wFvYyxUKKaZDOxVxJdgu6dyzkev_0 2024-03-04T13:00:15.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3654781261451559457', time=2024-03-04T14:54:38.476782+0000, chain.objs.size()=1 2024-03-04T13:00:15.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cUpJQ9QSG9jYSWyzSSat-00p46ukuyY_0 2024-03-04T13:00:15.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10514524866933537644', time=2024-03-04T14:54:38.491012+0000, chain.objs.size()=1 2024-03-04T13:00:15.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.koribHT8PjxPkf4ph3L0nfCe7CX_aG5_0 2024-03-04T13:00:15.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12058218787426879669', time=2024-03-04T14:54:38.533376+0000, chain.objs.size()=1 2024-03-04T13:00:15.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.DCLXtVCPQRg319v1C3B2h3LDiYMYJDY_0 2024-03-04T13:00:15.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14397038073785002701', time=2024-03-04T14:54:38.544118+0000, chain.objs.size()=1 2024-03-04T13:00:15.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gImb1FFL-GiCpfcCWXwlVtXzHrHc2Q-_0 2024-03-04T13:00:15.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9527154581894306096', time=2024-03-04T14:54:38.686416+0000, chain.objs.size()=1 2024-03-04T13:00:15.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.matnGvqHN9aAvON-rWiI_xlC9mb_wuZ_0 2024-03-04T13:00:15.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9699186702813800074', time=2024-03-04T14:54:38.706013+0000, chain.objs.size()=1 2024-03-04T13:00:15.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Sqc7jQc8GlQ2TW5DsXa83lCADVGdIk2_0 2024-03-04T13:00:15.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1572509292028505049', time=2024-03-04T14:54:38.820208+0000, chain.objs.size()=1 2024-03-04T13:00:15.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.AtPkyW5IKPptFsv3oFYJIQk6epgBA6x_0 2024-03-04T13:00:15.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4961944053155866333', time=2024-03-04T14:54:38.829337+0000, chain.objs.size()=1 2024-03-04T13:00:15.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.d5AzIN0s3Nsnjk8RqQVPfejt69eNAXu_0 2024-03-04T13:00:15.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5168830475799762589', time=2024-03-04T14:54:38.853414+0000, chain.objs.size()=1 2024-03-04T13:00:15.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.DBs_6v_JmlATrNMFQ07bc2EqG_Co1xF_0 2024-03-04T13:00:15.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14564267840373671562', time=2024-03-04T14:54:38.861675+0000, chain.objs.size()=1 2024-03-04T13:00:15.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.6V7tOqGUFUGcjd80vPrg4fuNP0qXT6O_0 2024-03-04T13:00:15.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14571042113373076588', time=2024-03-04T14:54:38.949752+0000, chain.objs.size()=1 2024-03-04T13:00:15.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Ka0cYdOs9Uj1YwGoNIW8pjOiChqtrBJ_0 2024-03-04T13:00:15.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11488178551178509172', time=2024-03-04T14:54:38.953209+0000, chain.objs.size()=1 2024-03-04T13:00:15.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tjbDJ-wbWRobGTBIkf_eLb-euhp6ICv_0 2024-03-04T13:00:15.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12160122612441504330', time=2024-03-04T14:54:38.990926+0000, chain.objs.size()=1 2024-03-04T13:00:15.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7iTKKfyPDYty7aQRqjqUAhnsyMMwgvI_0 2024-03-04T13:00:15.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8668917532107697295', time=2024-03-04T14:54:39.000027+0000, chain.objs.size()=1 2024-03-04T13:00:15.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.o7d-kKctZ1qXeWqxvJ5MrTnClM_YTWW_0 2024-03-04T13:00:15.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.581+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1460112436199811280', time=2024-03-04T14:54:39.119463+0000, chain.objs.size()=1 2024-03-04T13:00:15.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.581+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.vtEn2a5AAGSsRkZmH0jiaCSVeCjH9UZ_0 2024-03-04T13:00:15.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.581+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3212198988909857825', time=2024-03-04T14:54:39.136654+0000, chain.objs.size()=1 2024-03-04T13:00:15.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.581+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.L_1In59zsVQ0bWFD55bhPsm5dkXYy0u_0 2024-03-04T13:00:15.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.583+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3991852372077475798', time=2024-03-04T14:54:39.141690+0000, chain.objs.size()=1 2024-03-04T13:00:15.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.583+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.EXF0i_ssYWQFrlwNbeNuQM8T7_PC6Hk_0 2024-03-04T13:00:15.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.585+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/52238 2024-03-04T13:00:15.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-03-04T13:00:15.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16348137812110154579', time=2024-03-04T14:54:39.145878+0000, chain.objs.size()=1 2024-03-04T13:00:15.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.QU1_9XBlxY0p1GUd365QK5ZRZI2dpA9_0 2024-03-04T13:00:15.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3874159642691318917', time=2024-03-04T14:54:39.159292+0000, chain.objs.size()=1 2024-03-04T13:00:15.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.24a-_HQUcABCE08_BdSXRjjBGQBwu6R_0 2024-03-04T13:00:15.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8131307359484718783', time=2024-03-04T14:54:39.182129+0000, chain.objs.size()=1 2024-03-04T13:00:15.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.e2H4gSH5tXVyY3GP_6wCSovxp9KHaVY_0 2024-03-04T13:00:15.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9794649100219247891', time=2024-03-04T14:54:39.183051+0000, chain.objs.size()=1 2024-03-04T13:00:15.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-o8U3brLU_lQ4FCvGZ0UIx9xexkDTRf_0 2024-03-04T13:00:15.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.510153299136981859', time=2024-03-04T14:54:39.310261+0000, chain.objs.size()=1 2024-03-04T13:00:15.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.1dzL62evMFgYUqd9MmRncIK_UUql5z8_0 2024-03-04T13:00:15.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17665529519990283839', time=2024-03-04T14:54:39.316389+0000, chain.objs.size()=1 2024-03-04T13:00:15.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.4hkKU3gY8oGoMmp6WgprEsQL6ZGslkn_0 2024-03-04T13:00:15.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15065296992057907780', time=2024-03-04T14:54:39.330365+0000, chain.objs.size()=1 2024-03-04T13:00:15.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5Jsl34F4HO6RQEwpHcg4o9vyLfTcyUD_0 2024-03-04T13:00:15.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7955748540306074325', time=2024-03-04T14:54:39.349772+0000, chain.objs.size()=1 2024-03-04T13:00:15.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.CTO4zmJe5lxcOoZPiUn43MXcVG0ONy6_0 2024-03-04T13:00:15.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6201909326576198718', time=2024-03-04T14:54:39.423003+0000, chain.objs.size()=1 2024-03-04T13:00:15.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.UKc5SA9XfJWGOacrVhl2zjqT1e59EJN_0 2024-03-04T13:00:15.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4460561843807121490', time=2024-03-04T14:54:39.450948+0000, chain.objs.size()=1 2024-03-04T13:00:15.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.yIV6p6CEtrYLss36w9eLChCSDUxoaRt_0 2024-03-04T13:00:15.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11934734865651258873', time=2024-03-04T14:54:39.486499+0000, chain.objs.size()=1 2024-03-04T13:00:15.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wbQctWqv59ukkAmL05YSwBdog2Gysp2_0 2024-03-04T13:00:15.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8025160623334813194', time=2024-03-04T14:54:41.404210+0000, chain.objs.size()=1 2024-03-04T13:00:15.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.302__shadow_.R7gEfoWN6bQLfBCG0fKBYbkBy5CKx9i_0 2024-03-04T13:00:15.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1778750846056337229', time=2024-03-04T14:54:44.973195+0000, chain.objs.size()=1 2024-03-04T13:00:15.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.310__shadow_.q9ZFwvsZqipGX7tQxAyHIsDRLPJehFf_0 2024-03-04T13:00:15.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12958480447528336674', time=2024-03-04T14:55:27.273648+0000, chain.objs.size()=1 2024-03-04T13:00:15.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.402__shadow_.RBeyOZJI3csW2XUzPqVAGr1knmTenUM_0 2024-03-04T13:00:15.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15374081866670295291', time=2024-03-04T14:55:27.730100+0000, chain.objs.size()=1 2024-03-04T13:00:15.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.403__shadow_.MRPwA8NTYXdoUAkrHgyjpj_I45mYSWA_0 2024-03-04T13:00:15.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12335279286390302296', time=2024-03-04T14:55:41.855856+0000, chain.objs.size()=1 2024-03-04T13:00:15.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.430__shadow_.FGTokMH9tkvCUnzUaV3L9eavCDbxXDh_0 2024-03-04T13:00:15.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14560920252242319900', time=2024-03-04T14:55:43.307835+0000, chain.objs.size()=1 2024-03-04T13:00:15.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.432__shadow_.noTMhDx64OCYwcQu7p1jFEeky_9zaOJ_0 2024-03-04T13:00:15.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13798477195406140258', time=2024-03-04T14:55:43.990545+0000, chain.objs.size()=1 2024-03-04T13:00:15.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.433__shadow_.ouvIvOAFJTKRgHoeNeV8z-IFGyF0zK7_0 2024-03-04T13:00:15.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~600FHJnzxIYDp6fcN6QhbAc9wcTYMVH', time=2024-03-04T14:56:17.542193+0000, chain.objs.size()=1 2024-03-04T13:00:15.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~600FHJnzxIYDp6fcN6QhbAc9wcTYMVH.3 2024-03-04T13:00:15.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4266973151994093992', time=2024-03-04T14:56:26.414756+0000, chain.objs.size()=3 2024-03-04T13:00:15.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.592+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.496__shadow_.q_gDAbZB5H1QyMznTs5DMoMGkUm83LG_0 2024-03-04T13:00:15.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.593+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.496__shadow_.q_gDAbZB5H1QyMznTs5DMoMGkUm83LG_1 2024-03-04T13:00:15.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.593+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.496__shadow_.q_gDAbZB5H1QyMznTs5DMoMGkUm83LG_2 2024-03-04T13:00:15.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.593+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4731859181704493212', time=2024-03-04T14:57:06.643956+0000, chain.objs.size()=1 2024-03-04T13:00:15.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.593+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.525__shadow_.KCkL6cZqQaeUYikclV6VCooA2wyHBkI_0 2024-03-04T13:00:15.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.594+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16620165078969050059', time=2024-03-04T14:57:19.196002+0000, chain.objs.size()=1 2024-03-04T13:00:15.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.594+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:cXHMCAjiFcfXMK9zBeccZOafWymrM3e_.zO63smbfR03CDdcbat7onlcNYs8P7-2_0 2024-03-04T13:00:15.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.595+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16298737418213966536', time=2024-03-04T14:57:32.977686+0000, chain.objs.size()=1 2024-03-04T13:00:15.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.595+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:ZzZ.h96djY05qnqbMHetd-hwz7K8VIB_.Uk5LFRkDAWaUt_Gqe-ceKQVMG2QvLi7_0 2024-03-04T13:00:15.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.595+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10149832360664403061', time=2024-03-04T14:57:37.232581+0000, chain.objs.size()=1 2024-03-04T13:00:15.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.595+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:PbX5kLglrXT7JfNI1Na6gVzywGQQXDw_.RJyQY4p9NsHtrhxz3twAEo8bfbjYfmw_0 2024-03-04T13:00:15.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.595+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10327313003768560297', time=2024-03-04T14:57:40.826618+0000, chain.objs.size()=1 2024-03-04T13:00:15.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.595+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:hHUxWMLUlPyg.y4cvsg64tgyU20jIll_.32O8Q3IxS-BJnXGJkA-5T1MqTa61ZOH_0 2024-03-04T13:00:15.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.595+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12762448370502243129', time=2024-03-04T14:57:46.044401+0000, chain.objs.size()=7 2024-03-04T13:00:15.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.595+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__multipart_testobj.2~ngDso0R8UCTz_Bwy88TRZEIU7WAkgfr.1 2024-03-04T13:00:15.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.595+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__shadow_testobj.2~ngDso0R8UCTz_Bwy88TRZEIU7WAkgfr.1_1 2024-03-04T13:00:15.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.595+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__multipart_testobj.2~ngDso0R8UCTz_Bwy88TRZEIU7WAkgfr.2 2024-03-04T13:00:15.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.595+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__shadow_testobj.2~ngDso0R8UCTz_Bwy88TRZEIU7WAkgfr.2_1 2024-03-04T13:00:15.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.596+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__multipart_testobj.2~ngDso0R8UCTz_Bwy88TRZEIU7WAkgfr.3 2024-03-04T13:00:15.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.596+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__shadow_testobj.2~ngDso0R8UCTz_Bwy88TRZEIU7WAkgfr.3_1 2024-03-04T13:00:15.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.597+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__multipart_testobj.2~ngDso0R8UCTz_Bwy88TRZEIU7WAkgfr.4 2024-03-04T13:00:15.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.597+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8327390778951625846', time=2024-03-04T14:58:09.276339+0000, chain.objs.size()=1 2024-03-04T13:00:15.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.597+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.583__shadow_.uYRzBtCPLB1-3oP3xyJC30Rj6xf_ezv_0 2024-03-04T13:00:15.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.598+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~kb3exwEXxOER18erfaS389hf0mS1zFF', time=2024-03-04T14:58:14.292201+0000, chain.objs.size()=12 2024-03-04T13:00:15.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.598+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589__multipart_multipart_enc.2~kb3exwEXxOER18erfaS389hf0mS1zFF.1 2024-03-04T13:00:15.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.598+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589__shadow_multipart_enc.2~kb3exwEXxOER18erfaS389hf0mS1zFF.1_1 2024-03-04T13:00:15.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.598+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589__multipart_multipart_enc.2~kb3exwEXxOER18erfaS389hf0mS1zFF.2 2024-03-04T13:00:15.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.598+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589__shadow_multipart_enc.2~kb3exwEXxOER18erfaS389hf0mS1zFF.2_1 2024-03-04T13:00:15.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.600+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589__multipart_multipart_enc.2~kb3exwEXxOER18erfaS389hf0mS1zFF.3 2024-03-04T13:00:15.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.600+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589__shadow_multipart_enc.2~kb3exwEXxOER18erfaS389hf0mS1zFF.3_1 2024-03-04T13:00:15.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.600+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589__multipart_multipart_enc.2~kb3exwEXxOER18erfaS389hf0mS1zFF.4 2024-03-04T13:00:15.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.600+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589__shadow_multipart_enc.2~kb3exwEXxOER18erfaS389hf0mS1zFF.4_1 2024-03-04T13:00:15.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.600+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589__multipart_multipart_enc.2~kb3exwEXxOER18erfaS389hf0mS1zFF.5 2024-03-04T13:00:15.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.600+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589__shadow_multipart_enc.2~kb3exwEXxOER18erfaS389hf0mS1zFF.5_1 2024-03-04T13:00:15.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.600+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589__multipart_multipart_enc.2~kb3exwEXxOER18erfaS389hf0mS1zFF.6 2024-03-04T13:00:15.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.600+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.589__shadow_multipart_enc.2~kb3exwEXxOER18erfaS389hf0mS1zFF.6_1 2024-03-04T13:00:15.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.601+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13215474416640123408', time=2024-03-04T14:58:17.578066+0000, chain.objs.size()=1 2024-03-04T13:00:15.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.601+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.597__shadow_.d7s4xRriViR0sZfDXRHfrgwM9fh2Mv8_0 2024-03-04T13:00:15.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.601+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16664528547059914989', time=2024-03-04T14:58:19.905734+0000, chain.objs.size()=1 2024-03-04T13:00:15.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.601+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.603__shadow_.FpJzx65PBB3GHILHSj2wCYCdS71dgX__0 2024-03-04T13:00:15.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.603+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:15.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.608+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T13:00:15.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:15.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:15.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45061' 2024-03-04T13:00:15.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_GXO4s04gbbS7AFShOfQX8Sid0dx7Jop', time=2024-03-04T14:52:59.515834+0000, chain.objs.size()=3 2024-03-04T13:00:15.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.0nILHLsZJEfWlIiT3ryNskGy5U8RKPf_0 2024-03-04T13:00:15.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.0nILHLsZJEfWlIiT3ryNskGy5U8RKPf_1 2024-03-04T13:00:15.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.0nILHLsZJEfWlIiT3ryNskGy5U8RKPf_2 2024-03-04T13:00:15.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7207328283468778868', time=2024-03-04T14:53:25.789492+0000, chain.objs.size()=1 2024-03-04T13:00:15.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.196__shadow_.31Nbya5SvBLdrcauppLa0IUxF1HJCBa_0 2024-03-04T13:00:15.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8533407092394428315', time=2024-03-04T14:53:35.320755+0000, chain.objs.size()=1 2024-03-04T13:00:15.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.215__shadow_.LnM25m4Nit8-8qv2zZ6hpOSdMRPTfiG_0 2024-03-04T13:00:15.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8623842457529173602', time=2024-03-04T14:53:40.433854+0000, chain.objs.size()=1 2024-03-04T13:00:15.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.225__shadow_.wk3jo7XvepQKZZrLLUPxNG94R7GFrMb_0 2024-03-04T13:00:15.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.994054730242188037', time=2024-03-04T14:53:52.046272+0000, chain.objs.size()=1 2024-03-04T13:00:15.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.k5or8cncrCpNwUfQgMrHnxZ8Zoiml0Q_0 2024-03-04T13:00:15.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3732133744585756824', time=2024-03-04T14:53:52.062298+0000, chain.objs.size()=1 2024-03-04T13:00:15.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jRb4Z2RiuM8VSbwWb8_JeVrZw8nTIUh_0 2024-03-04T13:00:15.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7871673884680962165', time=2024-03-04T14:53:52.074003+0000, chain.objs.size()=1 2024-03-04T13:00:15.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.uJxbjYYscu9ErhiFeSZ-LspLVg8kZj3_0 2024-03-04T13:00:15.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1685895462660971794', time=2024-03-04T14:53:52.115468+0000, chain.objs.size()=1 2024-03-04T13:00:15.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.BLcJZ_H5FybQhYuE99QdZfvAd0xIxUD_0 2024-03-04T13:00:15.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7539768687327594735', time=2024-03-04T14:53:52.116440+0000, chain.objs.size()=1 2024-03-04T13:00:15.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VgDEp3wi5ja9e9gTo_3gaB7VrBNJVai_0 2024-03-04T13:00:15.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7634356455043495200', time=2024-03-04T14:53:52.292903+0000, chain.objs.size()=1 2024-03-04T13:00:15.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.611+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._HXXOwoxu4Z-V3uCRBY0SpvHlwU8lR8_0 2024-03-04T13:00:15.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17140824865157922718', time=2024-03-04T14:53:52.296733+0000, chain.objs.size()=1 2024-03-04T13:00:15.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.6cT_n5fANCP41OAlJJfUBB9IbbU5RQo_0 2024-03-04T13:00:15.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2876338194506833143', time=2024-03-04T14:53:52.398199+0000, chain.objs.size()=1 2024-03-04T13:00:15.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.AZ18Pt5J5gQ-bJeDmsOJLrLYgUvjmQJ_0 2024-03-04T13:00:15.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16979861736821543319', time=2024-03-04T14:53:52.462420+0000, chain.objs.size()=1 2024-03-04T13:00:15.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.uakKataDHKeGEuWOuYJL5oPsPF_ANGw_0 2024-03-04T13:00:15.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4332117243229778152', time=2024-03-04T14:53:52.464966+0000, chain.objs.size()=1 2024-03-04T13:00:15.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.49viCF1zCd5DBcufty_eFyqCpZ6yYe5_0 2024-03-04T13:00:15.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14481987865909752315', time=2024-03-04T14:53:52.474065+0000, chain.objs.size()=1 2024-03-04T13:00:15.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HEDY4PqiJnFWyPQC9keIfB4zLE36OYQ_0 2024-03-04T13:00:15.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7229781139446427792', time=2024-03-04T14:53:52.583303+0000, chain.objs.size()=1 2024-03-04T13:00:15.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.dPMgzwgp2dFVGnK10FZ1589tSMFpOQ-_0 2024-03-04T13:00:15.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10563312282595388661', time=2024-03-04T14:53:52.586941+0000, chain.objs.size()=1 2024-03-04T13:00:15.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.EYOD-e1GCxvxgC9l71RtKZup7f4y23Y_0 2024-03-04T13:00:15.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6002678339317632866', time=2024-03-04T14:53:52.761379+0000, chain.objs.size()=1 2024-03-04T13:00:15.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.7kKEWnzEQGeI7JFMkb7MdrzMgQj9WNr_0 2024-03-04T13:00:15.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9030806665515312182', time=2024-03-04T14:53:52.784836+0000, chain.objs.size()=1 2024-03-04T13:00:15.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VxuTqel9nrQzRQa1dIQj2sW_7wQ_SW3_0 2024-03-04T13:00:15.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11169833584373899761', time=2024-03-04T14:53:52.828192+0000, chain.objs.size()=1 2024-03-04T13:00:15.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vZyxcmX0PHSxE4zIdZELHhr7z_UVgHM_0 2024-03-04T13:00:15.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5346781709268221139', time=2024-03-04T14:53:52.926760+0000, chain.objs.size()=1 2024-03-04T13:00:15.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jHkhjtrvUd7hSpPt0hj8hWLflVsQ37F_0 2024-03-04T13:00:15.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.615+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1598699249769704387', time=2024-03-04T14:53:52.929986+0000, chain.objs.size()=1 2024-03-04T13:00:15.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.615+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._AWl3MQQNVwr9lItg9xVfBRK0UmANKR_0 2024-03-04T13:00:15.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.616+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16569165645497955115', time=2024-03-04T14:53:53.164322+0000, chain.objs.size()=1 2024-03-04T13:00:15.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.616+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ebyrvXU_MsVsOwYf0YRkcDaTYyiJn7U_0 2024-03-04T13:00:15.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.616+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4086507691567642637', time=2024-03-04T14:53:53.172617+0000, chain.objs.size()=1 2024-03-04T13:00:15.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.616+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.6Bmh-mD9bgF52T9kgPJMmjdOuf8xyki_0 2024-03-04T13:00:15.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.616+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12149164265524246476', time=2024-03-04T14:53:53.179393+0000, chain.objs.size()=1 2024-03-04T13:00:15.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.616+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.87ZdzxGNtkzhqwKL5-zsZ5JERCnQL4F_0 2024-03-04T13:00:15.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.616+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2674400948652233161', time=2024-03-04T14:53:53.249916+0000, chain.objs.size()=1 2024-03-04T13:00:15.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.616+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yuCwocMhxUE8_uyKeGJ580EiIsDl5zV_0 2024-03-04T13:00:15.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.617+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1184755970255943177', time=2024-03-04T14:53:53.264719+0000, chain.objs.size()=1 2024-03-04T13:00:15.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.617+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.hEimwsa7XG-R2EsWFAcsJZql4Rnma4L_0 2024-03-04T13:00:15.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.617+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.563365094017393210', time=2024-03-04T14:53:53.270963+0000, chain.objs.size()=1 2024-03-04T13:00:15.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.617+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Rdr1pvviuwAkALiyGvxjganHDoofzhH_0 2024-03-04T13:00:15.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.619+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3054741940680762847', time=2024-03-04T14:53:53.283455+0000, chain.objs.size()=1 2024-03-04T13:00:15.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.619+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.bW5RJcl7ljoS7fPzAy6B4e5akGuun4z_0 2024-03-04T13:00:15.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.619+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11082201882013252131', time=2024-03-04T14:53:53.307890+0000, chain.objs.size()=1 2024-03-04T13:00:15.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.619+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.pP8O1v0jnkoeqyepTIsS-qhsmJiFINM_0 2024-03-04T13:00:15.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.619+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14631482547251255058', time=2024-03-04T14:53:59.251384+0000, chain.objs.size()=1 2024-03-04T13:00:15.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.619+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.246__shadow_.Qqkpegaq-6mj1odI9r8GzcRXwlL_dnn_0 2024-03-04T13:00:15.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.619+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17581918176850454582', time=2024-03-04T14:54:02.267767+0000, chain.objs.size()=1 2024-03-04T13:00:15.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.619+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.253__shadow_.fJsQrUAe0Wma7GL-o9tqic-qKK5ISOf_0 2024-03-04T13:00:15.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.619+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15861566565491601681', time=2024-03-04T14:54:02.681345+0000, chain.objs.size()=1 2024-03-04T13:00:15.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.619+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.254__shadow_.Lp4uhD-KKYSwrOOQ9xyd7V2D0O8u1y1_0 2024-03-04T13:00:15.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.623+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13507351528407413016', time=2024-03-04T14:54:09.027364+0000, chain.objs.size()=1 2024-03-04T13:00:15.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.623+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.QvP9BMRzXJ23QjLrxSostN2kFkulO9b_0 2024-03-04T13:00:15.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.623+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.477711746384166324', time=2024-03-04T14:54:13.076958+0000, chain.objs.size()=1 2024-03-04T13:00:15.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.623+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.275__shadow_.I_7hzRnghZhITyxHRZ-5wuI6_Hzbigi_0 2024-03-04T13:00:15.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.623+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16671222424084861054', time=2024-03-04T14:54:13.560966+0000, chain.objs.size()=1 2024-03-04T13:00:15.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.623+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.276__shadow_.sekBN6d-eLpbz5zKezDnmBcDrlmcEJQ_0 2024-03-04T13:00:15.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.623+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6546834720391890998', time=2024-03-04T14:54:13.996239+0000, chain.objs.size()=1 2024-03-04T13:00:15.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.623+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.277__shadow_.p-p7mfQwnuhGlG9uDWrHjNMK35yxwpG_0 2024-03-04T13:00:15.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.623+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3533253293826150968', time=2024-03-04T14:54:13.996957+0000, chain.objs.size()=1 2024-03-04T13:00:15.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.623+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.277__shadow_.hxLd4mSAAXhw2JsAg1ZCriVWDn0UjLx_0 2024-03-04T13:00:15.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.623+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14596651883064338951', time=2024-03-04T14:54:13.997640+0000, chain.objs.size()=1 2024-03-04T13:00:15.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.623+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.277__shadow_.FRfARMp1LgOF2T7GdyjVD0iv_7TVzil_0 2024-03-04T13:00:15.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.625+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4288529018507478928', time=2024-03-04T14:54:14.427720+0000, chain.objs.size()=1 2024-03-04T13:00:15.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.625+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.278__shadow_.EPYrAeMAhHFgJIYmaQBMHOCuZqiIyNw_0 2024-03-04T13:00:15.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.625+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11559591934977042702', time=2024-03-04T14:54:20.801953+0000, chain.objs.size()=1 2024-03-04T13:00:15.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.625+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.292__shadow:9eUO3BYteBcFuaXx5ZPebElG3fJTSAj_.sMMgWSptjunssQ7TDPbYU4sM6NoIvHh_0 2024-03-04T13:00:15.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.625+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12735061795443575431', time=2024-03-04T14:54:21.260700+0000, chain.objs.size()=1 2024-03-04T13:00:15.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.625+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.294__shadow_.ulv7QKiOt4IUXTYXmadyLgSEFdr0MDa_0 2024-03-04T13:00:15.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.625+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7887942559981232274', time=2024-03-04T14:54:21.261526+0000, chain.objs.size()=1 2024-03-04T13:00:15.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.625+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.294__shadow_.y0YrIALamn4aHVyf_Q9qJoGcb5bmPwH_0 2024-03-04T13:00:15.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.625+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10373914558176684927', time=2024-03-04T14:54:29.620474+0000, chain.objs.size()=1 2024-03-04T13:00:15.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.625+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.nK-epeHwGOvcfuqERk0neQujtOPOiW-_0 2024-03-04T13:00:15.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.625+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3608045198352561172', time=2024-03-04T14:54:29.628123+0000, chain.objs.size()=1 2024-03-04T13:00:15.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.625+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.v0kbAhgpf_zeHmmsurEdaFDRosa-oDD_0 2024-03-04T13:00:15.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.628+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1744787617432450924', time=2024-03-04T14:54:29.668771+0000, chain.objs.size()=1 2024-03-04T13:00:15.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.628+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.zCSixIz0irIRPmLHVte7E6ii807Lbcc_0 2024-03-04T13:00:15.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.628+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16185822091350871365', time=2024-03-04T14:54:29.671744+0000, chain.objs.size()=1 2024-03-04T13:00:15.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.628+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.chmvMWPoltD9saAx6aiwxKUSC3RRrcK_0 2024-03-04T13:00:15.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.628+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4305977386674147304', time=2024-03-04T14:54:29.682629+0000, chain.objs.size()=1 2024-03-04T13:00:15.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.628+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.i6-rveC0QJBil2t7cYeN6lNTA7rdJSZ_0 2024-03-04T13:00:15.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.628+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4356431546157686953', time=2024-03-04T14:54:29.806757+0000, chain.objs.size()=1 2024-03-04T13:00:15.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.628+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tNF94Fz6iVm3a77OPiSH42d7IGVd78O_0 2024-03-04T13:00:15.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.631+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4542538820989591996', time=2024-03-04T14:54:29.808852+0000, chain.objs.size()=1 2024-03-04T13:00:15.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.631+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cvtTFT49fJUfiJ9xcAUPnz6WJ5jHgbE_0 2024-03-04T13:00:15.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.631+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8634554209116897113', time=2024-03-04T14:54:29.815230+0000, chain.objs.size()=1 2024-03-04T13:00:15.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.631+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.To3DLdywArhY-PWxHaH9CceJJkKPzLS_0 2024-03-04T13:00:15.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15952064815882112167', time=2024-03-04T14:54:29.825776+0000, chain.objs.size()=1 2024-03-04T13:00:15.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3xDNjk3OGhR0ZDLrUkt5kESkDMH6dc8_0 2024-03-04T13:00:15.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13484336778936203030', time=2024-03-04T14:54:29.848603+0000, chain.objs.size()=1 2024-03-04T13:00:15.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.L7OTkS4FTJD8xqaDqaHVNxA7dtBI8TC_0 2024-03-04T13:00:15.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17410089896673959364', time=2024-03-04T14:54:29.860089+0000, chain.objs.size()=1 2024-03-04T13:00:15.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.omM1zz_pf1w0jILVcXXu1E_eFMlrFp3_0 2024-03-04T13:00:15.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.213448814658589684', time=2024-03-04T14:54:30.010193+0000, chain.objs.size()=1 2024-03-04T13:00:15.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.POV5BNJAV7Rp9N1VGrIPx11hkX4HLXq_0 2024-03-04T13:00:15.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3868890675167031442', time=2024-03-04T14:54:30.102554+0000, chain.objs.size()=1 2024-03-04T13:00:15.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.b_WnNP5sBMY8Jf4frdqXUw0DiMS5fF9_0 2024-03-04T13:00:15.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8684631858083480925', time=2024-03-04T14:54:30.111684+0000, chain.objs.size()=1 2024-03-04T13:00:15.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.DamG5afT5sMffWadlNRHbYZMrpCvg56_0 2024-03-04T13:00:15.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15974602530340161386', time=2024-03-04T14:54:30.259986+0000, chain.objs.size()=1 2024-03-04T13:00:15.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2hHn63V3ohrhIPiAiFJ3AXg-Hg3KHbS_0 2024-03-04T13:00:15.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.274135188878681138', time=2024-03-04T14:54:30.261944+0000, chain.objs.size()=1 2024-03-04T13:00:15.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.BTb2w6fF9Hj_4QDDEahDOZXM34jTdvY_0 2024-03-04T13:00:15.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.747742565824307729', time=2024-03-04T14:54:30.264210+0000, chain.objs.size()=1 2024-03-04T13:00:15.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cGJT1l36k20S8SprF2l-qzERX_HVrJZ_0 2024-03-04T13:00:15.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6112540891206581927', time=2024-03-04T14:54:30.293683+0000, chain.objs.size()=1 2024-03-04T13:00:15.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.72h0QrlA_zzHt1XFH_F1_PsQUSwNtvu_0 2024-03-04T13:00:15.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10267038803605447651', time=2024-03-04T14:54:30.300720+0000, chain.objs.size()=1 2024-03-04T13:00:15.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.634+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_._w2pS70GfsZ1bQESHBe5Hl0U59di37T_0 2024-03-04T13:00:15.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.637+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5570833182491505128', time=2024-03-04T14:54:30.315943+0000, chain.objs.size()=1 2024-03-04T13:00:15.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.637+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.j-8zN_-QPXAEsT5BIOQ7qYSQLC95c5t_0 2024-03-04T13:00:15.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.637+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6973943285793582644', time=2024-03-04T14:54:30.429624+0000, chain.objs.size()=1 2024-03-04T13:00:15.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.637+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FWsDkah4j_is_N8FyEQaR99DmMqk8_d_0 2024-03-04T13:00:15.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4818107550173269138', time=2024-03-04T14:54:30.431680+0000, chain.objs.size()=1 2024-03-04T13:00:15.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.PejkVADTytCUN7dOyC7AeZNADaysUor_0 2024-03-04T13:00:15.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7503001070074474465', time=2024-03-04T14:54:30.439161+0000, chain.objs.size()=1 2024-03-04T13:00:15.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.a2qiGfZ8unlT6l0g3ujEgNwb3Vg-9Yo_0 2024-03-04T13:00:15.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4512820285926362609', time=2024-03-04T14:54:30.500960+0000, chain.objs.size()=1 2024-03-04T13:00:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.msAsu6QV8SkN0vLecWYGp-6C0Cncxgu_0 2024-03-04T13:00:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4192178895954704559', time=2024-03-04T14:54:30.584460+0000, chain.objs.size()=1 2024-03-04T13:00:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oju4uJbPXX48l_6P14PUih6eVxSVJ8y_0 2024-03-04T13:00:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17094272686080230270', time=2024-03-04T14:54:30.632548+0000, chain.objs.size()=1 2024-03-04T13:00:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Y-WQ9cXNOW7a7bN7NsKlZXPDMwylCy0_0 2024-03-04T13:00:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7282763604900946920', time=2024-03-04T14:54:30.639599+0000, chain.objs.size()=1 2024-03-04T13:00:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.dH0g57E0FUevGd6i_EhSldWb0PM6kvA_0 2024-03-04T13:00:15.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7712339169430685801', time=2024-03-04T14:54:30.739065+0000, chain.objs.size()=1 2024-03-04T13:00:15.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rVnj3t6yFHnol3IwuaEOko11o96FqAi_0 2024-03-04T13:00:15.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8216444340633971401', time=2024-03-04T14:54:30.759403+0000, chain.objs.size()=1 2024-03-04T13:00:15.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5ilj_LgQOe-WExm8qukVox-stmrO5HZ_0 2024-03-04T13:00:15.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4192608668777878896', time=2024-03-04T14:54:30.767544+0000, chain.objs.size()=1 2024-03-04T13:00:15.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.WSpyJtD26iBWw3-4TqS2BpSgte5cuik_0 2024-03-04T13:00:15.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.642+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1205395579930983003', time=2024-03-04T14:54:30.780007+0000, chain.objs.size()=1 2024-03-04T13:00:15.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.643+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-xUgc8DBb38MjiXIqlWT-rKUii7G4Hm_0 2024-03-04T13:00:15.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.643+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8126928915300848119', time=2024-03-04T14:54:30.801623+0000, chain.objs.size()=1 2024-03-04T13:00:15.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.643+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.biL-aF-pDS3AiGCxPtFKsOdDrMAcUC-_0 2024-03-04T13:00:15.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10819686128738831238', time=2024-03-04T14:54:38.340647+0000, chain.objs.size()=1 2024-03-04T13:00:15.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-VSpLxrCj99Nn6NoKFHqpyij6M2c39W_0 2024-03-04T13:00:15.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1326539404822842499', time=2024-03-04T14:54:38.375067+0000, chain.objs.size()=1 2024-03-04T13:00:15.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.l3CgSbwPTUFoNcZyyr3s_Xsp5GEUisS_0 2024-03-04T13:00:15.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6245944074625205679', time=2024-03-04T14:54:38.377016+0000, chain.objs.size()=1 2024-03-04T13:00:15.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.XZUJZSgh3TyEuFy08JLq38GEuiRlgsY_0 2024-03-04T13:00:15.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7357196939129185649', time=2024-03-04T14:54:38.456647+0000, chain.objs.size()=1 2024-03-04T13:00:15.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Cs_ImoNKga-M4ps2lg6KtmLK1YDS9Q3_0 2024-03-04T13:00:15.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11660773793961823328', time=2024-03-04T14:54:38.475753+0000, chain.objs.size()=1 2024-03-04T13:00:15.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.mYLq1OGTCbC2-2ZJ0VtbunUstzGBgQ1_0 2024-03-04T13:00:15.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7447594428798441375', time=2024-03-04T14:54:38.483292+0000, chain.objs.size()=1 2024-03-04T13:00:15.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.4UZNgsyA62CKuUpuJKYkCPdFFdYhkir_0 2024-03-04T13:00:15.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16073007806531590297', time=2024-03-04T14:54:38.493486+0000, chain.objs.size()=1 2024-03-04T13:00:15.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.1ZEg1MlaQk_1CoFYwvt2rFYrmv8zf0-_0 2024-03-04T13:00:15.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.571218112329402332', time=2024-03-04T14:54:38.517864+0000, chain.objs.size()=1 2024-03-04T13:00:15.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5C4ZHKw-l8QHOns-Xj4xqti70uqqbte_0 2024-03-04T13:00:15.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3304516313919206851', time=2024-03-04T14:54:38.525012+0000, chain.objs.size()=1 2024-03-04T13:00:15.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._e9AMBTNIfma59toaelquH3c_8dmCE7_0 2024-03-04T13:00:15.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1301635084735423342', time=2024-03-04T14:54:38.536860+0000, chain.objs.size()=1 2024-03-04T13:00:15.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.BtIe35DZ2JH-V7JP1y3RztIrHYBdKOC_0 2024-03-04T13:00:15.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13977601831712203851', time=2024-03-04T14:54:38.633537+0000, chain.objs.size()=1 2024-03-04T13:00:15.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xcMMIGHrhtSmsgoBvGoa-TTxkBwqBBe_0 2024-03-04T13:00:15.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.650+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16460905893457189352', time=2024-03-04T14:54:38.658174+0000, chain.objs.size()=1 2024-03-04T13:00:15.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.650+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.l1xaLe1eIIoH1rBAHaJdmS8HGJb0GRA_0 2024-03-04T13:00:15.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.650+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8295460314126671105', time=2024-03-04T14:54:38.682271+0000, chain.objs.size()=1 2024-03-04T13:00:15.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.650+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.QZeCoVr88fbIIpiguBNcEhnMfCf6kJl_0 2024-03-04T13:00:15.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.651+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14034594372007871935', time=2024-03-04T14:54:38.786368+0000, chain.objs.size()=1 2024-03-04T13:00:15.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.651+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.lEy1kavtfU08w_rXI2xrkQ95-TDQCjK_0 2024-03-04T13:00:15.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.651+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5444657102607824600', time=2024-03-04T14:54:38.810565+0000, chain.objs.size()=1 2024-03-04T13:00:15.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.651+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.RQ97DU9_aX20HK-X5Xmf7IjohN-DkcZ_0 2024-03-04T13:00:15.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.651+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9565445608051362707', time=2024-03-04T14:54:38.812386+0000, chain.objs.size()=1 2024-03-04T13:00:15.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.651+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._EITI1Y6xmkIIFnoSYeiWvr8lVB3iJ3_0 2024-03-04T13:00:15.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.651+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5920510777912426357', time=2024-03-04T14:54:38.871729+0000, chain.objs.size()=1 2024-03-04T13:00:15.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.651+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.43box2DFXzfvpNQIncMJasS-EAVccPo_0 2024-03-04T13:00:15.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.651+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12078171729537038227', time=2024-03-04T14:54:38.978584+0000, chain.objs.size()=1 2024-03-04T13:00:15.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.651+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.1ycn5Uu9hl50Q_1GlYOZbmQpPykm_Jv_0 2024-03-04T13:00:15.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.651+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16047900706566379356', time=2024-03-04T14:54:39.027289+0000, chain.objs.size()=1 2024-03-04T13:00:15.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.651+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.n0DiAWhmaGjG-Aikg0Fh1nDItGCsYHh_0 2024-03-04T13:00:15.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.654+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6063294872527975048', time=2024-03-04T14:54:39.137416+0000, chain.objs.size()=1 2024-03-04T13:00:15.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.654+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.h-kVQj_mZIf-t-waMGurbhaC82vte2w_0 2024-03-04T13:00:15.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.654+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13060200914659283289', time=2024-03-04T14:54:39.142683+0000, chain.objs.size()=1 2024-03-04T13:00:15.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.654+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.GUP_NKnYxa--1dwfQVmOmCYpwP17g2v_0 2024-03-04T13:00:15.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.654+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7218950530151132090', time=2024-03-04T14:54:39.190042+0000, chain.objs.size()=1 2024-03-04T13:00:15.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.654+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.BCRX1vLIByIOgLZIWfuAxF2WKUYtW_A_0 2024-03-04T13:00:15.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.654+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4313602943885675119', time=2024-03-04T14:54:39.191579+0000, chain.objs.size()=1 2024-03-04T13:00:15.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.654+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.djlHiRWAD_B9s6RhPG13oGdiRZxWxDe_0 2024-03-04T13:00:15.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.654+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3328923745351777256', time=2024-03-04T14:54:39.278602+0000, chain.objs.size()=1 2024-03-04T13:00:15.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.654+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rWZO8kyMP0CHKybHZ62mw6H8gUm1SRc_0 2024-03-04T13:00:15.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.654+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11891730700922196577', time=2024-03-04T14:54:39.289287+0000, chain.objs.size()=1 2024-03-04T13:00:15.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.654+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.NGDjuuTYTtamkaDYUpfoViFT_44awms_0 2024-03-04T13:00:15.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.660+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/45061 2024-03-04T13:00:15.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-03-04T13:00:15.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12552519158761307213', time=2024-03-04T14:54:39.296610+0000, chain.objs.size()=1 2024-03-04T13:00:15.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.YOh8-1UNKwJJeRxErJOTikDbhcsx0De_0 2024-03-04T13:00:15.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11013684563638307942', time=2024-03-04T14:54:39.313151+0000, chain.objs.size()=1 2024-03-04T13:00:15.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.JugmSrjiK_hfELt7wdLE01lbsqU7-VH_0 2024-03-04T13:00:15.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11312310017337032601', time=2024-03-04T14:54:39.326741+0000, chain.objs.size()=1 2024-03-04T13:00:15.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.8BBEKzzeDDA-0Dc_FWQZHRss3Mk6uEa_0 2024-03-04T13:00:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11826991321179417050', time=2024-03-04T14:54:39.329671+0000, chain.objs.size()=1 2024-03-04T13:00:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pIsD6ze08oIhQFrWcoIw2pZEnM9-v8C_0 2024-03-04T13:00:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8207015823647004358', time=2024-03-04T14:54:39.350045+0000, chain.objs.size()=1 2024-03-04T13:00:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.g0gdP2NpB53etUau38AIdugQMvLGMWv_0 2024-03-04T13:00:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3036776647680019229', time=2024-03-04T14:54:39.420967+0000, chain.objs.size()=1 2024-03-04T13:00:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.f8FpDuqw8QYHOtQkVPqAnZfGxHv9ESV_0 2024-03-04T13:00:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7640440482742264260', time=2024-03-04T14:54:39.447100+0000, chain.objs.size()=1 2024-03-04T13:00:15.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.f3lzDVGurRs16meTy8HmJP8_Xo2y_-W_0 2024-03-04T13:00:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17466434205367853974', time=2024-03-04T14:54:39.467899+0000, chain.objs.size()=1 2024-03-04T13:00:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.9UBlYrrAgwTPz0WYvz1Fq5N28OCs16N_0 2024-03-04T13:00:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6865183995082409127', time=2024-03-04T14:54:39.476229+0000, chain.objs.size()=1 2024-03-04T13:00:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.loGfYcQK8ggQaA2K1oH1CSlP26dKpfP_0 2024-03-04T13:00:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1529181730911224577', time=2024-03-04T14:54:39.488180+0000, chain.objs.size()=1 2024-03-04T13:00:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jds8q95vsQI0RziYmKUvuhyjRQIoBNd_0 2024-03-04T13:00:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8358599730869348941', time=2024-03-04T14:54:42.676596+0000, chain.objs.size()=1 2024-03-04T13:00:15.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.305__shadow_.DoOAXbWpqzhFuWudlWAzE6ao3mrAF4f_0 2024-03-04T13:00:15.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10451547491985058182', time=2024-03-04T14:55:08.316397+0000, chain.objs.size()=1 2024-03-04T13:00:15.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.363__shadow_.qr_GoBZb_NSAfYKA9DbqXy8JsJkETSl_0 2024-03-04T13:00:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.665+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12822018866979380858', time=2024-03-04T14:55:11.762540+0000, chain.objs.size()=1 2024-03-04T13:00:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.665+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.367__shadow:42tDSXPIONPvl1OdYxAg..FdrMmxIMK_.xUq1qFsRlbZ9v8NJ6sk4YVe2zCjeJOe_0 2024-03-04T13:00:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.665+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18024142508311617468', time=2024-03-04T14:55:37.383963+0000, chain.objs.size()=1 2024-03-04T13:00:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.665+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.422__shadow_.2nIG__vqqw9l8r9hUOvFDm1Z220vSSc_0 2024-03-04T13:00:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1154224520371184752', time=2024-03-04T14:55:46.917691+0000, chain.objs.size()=1 2024-03-04T13:00:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.438__shadow_.vKBSrOk6jnfRKn0Ol_rAHCKGeKLlq3L_0 2024-03-04T13:00:15.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9100651145612778954', time=2024-03-04T14:55:56.630633+0000, chain.objs.size()=1 2024-03-04T13:00:15.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.465__shadow_.nyiD0LPSudi9EsWcdv3eO-x-oEjMsQk_0 2024-03-04T13:00:15.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6570899382834639908', time=2024-03-04T14:56:08.219648+0000, chain.objs.size()=1 2024-03-04T13:00:15.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.490__multipart_mymultipart.2~2cbTX6SZjxaRHamna-fMPxaHyGLdjsK.1 2024-03-04T13:00:15.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10403020188020592690', time=2024-03-04T14:56:08.465907+0000, chain.objs.size()=1 2024-03-04T13:00:15.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.489__shadow_.PQkM8mlhk2Mfv7mbRNyEps7x6Ba_uEu_0 2024-03-04T13:00:15.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12227173024796931061', time=2024-03-04T14:56:25.822463+0000, chain.objs.size()=3 2024-03-04T13:00:15.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~a5nreAyew1JIZ3FhKlxjO3wVp4x5uRs.1 2024-03-04T13:00:15.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~a5nreAyew1JIZ3FhKlxjO3wVp4x5uRs.2 2024-03-04T13:00:15.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~a5nreAyew1JIZ3FhKlxjO3wVp4x5uRs.3 2024-03-04T13:00:15.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9142578867149705964', time=2024-03-04T14:57:18.019007+0000, chain.objs.size()=1 2024-03-04T13:00:15.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:-ElpqfbPuEkefBXrx62TaOkEFnMfHGm_.Rw88eROCjA5_pexQE7Ge3oylDEXn2ym_0 2024-03-04T13:00:15.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14128070009369109160', time=2024-03-04T14:57:22.910952+0000, chain.objs.size()=1 2024-03-04T13:00:15.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.668+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.537__shadow:dRulSqP3F4jd91SGokwuVTZU19DMVOA_.VfoA4WWSF43rrBTG7faPIUgGfPXEB0R_0 2024-03-04T13:00:15.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.670+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15696272113426291344', time=2024-03-04T14:57:47.289961+0000, chain.objs.size()=1 2024-03-04T13:00:15.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.670+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.545__shadow:NrAbkyUF0Gyhw8uLYy7.x9g2.IE8Nee_.gCO4A2m_s3Lhf_KYojnlTM_-3jCU69J_0 2024-03-04T13:00:15.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.671+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8096757876122132584', time=2024-03-04T14:57:51.009805+0000, chain.objs.size()=1 2024-03-04T13:00:15.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.671+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.551__shadow:VE8AfxTFuPT14Y1HSqy.QMXSTxppQT1_.NB2xp0tIavXvV49Z0SzxEofSzm2oemE_0 2024-03-04T13:00:15.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13960512347378756282', time=2024-03-04T14:58:27.292472+0000, chain.objs.size()=1 2024-03-04T13:00:15.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.617__shadow_.kKbMdgtKn8VPuMLqXtt2WVAoGEFOqDI_0 2024-03-04T13:00:15.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8430477236760802543', time=2024-03-04T14:58:31.632081+0000, chain.objs.size()=1 2024-03-04T13:00:15.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.625__shadow_.rSdMWyXUqQfJThTtAg764F71aOCEW2a_0 2024-03-04T13:00:15.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6857248289412940887', time=2024-03-04T14:58:43.397842+0000, chain.objs.size()=1 2024-03-04T13:00:15.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.655__shadow:pEt16VzH7oLBT6z7OUWdOBTjZsS7B3P_.YQBbjOY8daijm62IncBNvcaCBny0nz3_0 2024-03-04T13:00:15.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9317092302435283682', time=2024-03-04T14:58:45.339608+0000, chain.objs.size()=1 2024-03-04T13:00:15.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.660__shadow:Z3m1u0WA2PgXo6oaCGDVTxKHnU.DCuy_.wR1TiNqIOqI63_omMcZX91ENS4pdoE4_0 2024-03-04T13:00:15.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.680+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:15.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.686+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T13:00:15.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.687+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:15.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.688+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:15.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44142' 2024-03-04T13:00:15.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_UwaDhNAOw1k8u68BRUEi9hBYUjsPqxI', time=2024-03-04T14:52:57.413734+0000, chain.objs.size()=3 2024-03-04T13:00:15.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.GXSv8dmEqzTl3uWEHwoI2wBiW7ftkYo_0 2024-03-04T13:00:15.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.GXSv8dmEqzTl3uWEHwoI2wBiW7ftkYo_1 2024-03-04T13:00:15.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.GXSv8dmEqzTl3uWEHwoI2wBiW7ftkYo_2 2024-03-04T13:00:15.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_nDZDlaVcygr8zwchEdLbl0hWI7DPpxz', time=2024-03-04T14:53:01.036674+0000, chain.objs.size()=1 2024-03-04T13:00:15.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.158__shadow_.qYn5ImerFPOYP4hCPANzGsmkTzA-YcY_0 2024-03-04T13:00:15.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10271777664937862564', time=2024-03-04T14:53:11.992665+0000, chain.objs.size()=1 2024-03-04T13:00:15.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.176__shadow_.0KHy6JtIf5jXGsfnhDIwnHrnt9gUShX_0 2024-03-04T13:00:15.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12537336693485249440', time=2024-03-04T14:53:26.271246+0000, chain.objs.size()=1 2024-03-04T13:00:15.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.197__shadow_.5vXrfGk0FR1t5i05-YWbIqQM4wUz_q-_0 2024-03-04T13:00:15.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11806497945547741065', time=2024-03-04T14:53:31.627213+0000, chain.objs.size()=1 2024-03-04T13:00:15.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.208__shadow_.YL-auoAY1ETUY5LckW15cMAAJco7UgD_0 2024-03-04T13:00:15.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16049998099391443955', time=2024-03-04T14:53:34.444663+0000, chain.objs.size()=1 2024-03-04T13:00:15.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.213__shadow_.lFlZbLR2O1OxbYWRDqz6tMaN3r0onmP_0 2024-03-04T13:00:15.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2846051606918743490', time=2024-03-04T14:53:39.997258+0000, chain.objs.size()=1 2024-03-04T13:00:15.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.224__shadow_.IYDZzJw4C9vnWuMic4nAX1Xbf9fsus6_0 2024-03-04T13:00:15.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14017211509047504612', time=2024-03-04T14:53:41.772790+0000, chain.objs.size()=1 2024-03-04T13:00:15.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.228__shadow_.UvUcrScuAdA_cBprvFTcQ9Qr3tLWFGC_0 2024-03-04T13:00:15.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15928423735018748401', time=2024-03-04T14:53:52.046240+0000, chain.objs.size()=1 2024-03-04T13:00:15.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.NfPOuSp8lW0LGgY4_7RGkUMNNzZ6CVR_0 2024-03-04T13:00:15.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17728661824211461339', time=2024-03-04T14:53:52.069654+0000, chain.objs.size()=1 2024-03-04T13:00:15.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.689+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.knwrOsp7WjPZV2WIYMnMr6Fa-ep4bPY_0 2024-03-04T13:00:15.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4575826134583365204', time=2024-03-04T14:53:52.125898+0000, chain.objs.size()=1 2024-03-04T13:00:15.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.szGENamHBFALgORO8UApVn4x5_EHvCt_0 2024-03-04T13:00:15.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8279747701856248969', time=2024-03-04T14:53:52.134194+0000, chain.objs.size()=1 2024-03-04T13:00:15.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.uPCEyu7tsdcmt-CfHjOlnNga43rXeJ0_0 2024-03-04T13:00:15.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16561301569706096690', time=2024-03-04T14:53:52.225714+0000, chain.objs.size()=1 2024-03-04T13:00:15.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.KI_MSNprQ-ylNP_EN1o5PuM6fYYuGMn_0 2024-03-04T13:00:15.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10838918071194349611', time=2024-03-04T14:53:52.274876+0000, chain.objs.size()=1 2024-03-04T13:00:15.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Fdj1SZtm8dbJ2gRwfEBCvGkyk1fJH9y_0 2024-03-04T13:00:15.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15850649983163153771', time=2024-03-04T14:53:52.403548+0000, chain.objs.size()=1 2024-03-04T13:00:15.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.qiaBqx4yFMveRvsWQ-wZaz7qr1S6jsm_0 2024-03-04T13:00:15.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6862251909633738423', time=2024-03-04T14:53:52.438078+0000, chain.objs.size()=1 2024-03-04T13:00:15.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zk5FGnAaTxL7XaYkQaj6UTHF_gJvlOL_0 2024-03-04T13:00:15.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15015852512124920100', time=2024-03-04T14:53:52.487764+0000, chain.objs.size()=1 2024-03-04T13:00:15.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vy8URxmKSBMQiyoew93y7TTK23J3lce_0 2024-03-04T13:00:15.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8696789968406387590', time=2024-03-04T14:53:52.488540+0000, chain.objs.size()=1 2024-03-04T13:00:15.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.9JhRpmL0Rlzgz_NK_xqX_eZt5vDelWz_0 2024-03-04T13:00:15.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17827138326550414901', time=2024-03-04T14:53:52.569358+0000, chain.objs.size()=1 2024-03-04T13:00:15.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.a85emD9qglAMPPCxjiVzP5PDEXv_Yg__0 2024-03-04T13:00:15.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3658706353257265038', time=2024-03-04T14:53:52.571641+0000, chain.objs.size()=1 2024-03-04T13:00:15.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.AdYqZQf8LVUInkXJn9zjR72rmq0DIYx_0 2024-03-04T13:00:15.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14172229467064439543', time=2024-03-04T14:53:52.576939+0000, chain.objs.size()=1 2024-03-04T13:00:15.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.696+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.irchOwVDtt96UA5QBopEzZW8wuniIEy_0 2024-03-04T13:00:15.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.698+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9056448095805753124', time=2024-03-04T14:53:52.618220+0000, chain.objs.size()=1 2024-03-04T13:00:15.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.698+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.hOgtoCyW79VJhb5kC7W9Ep4d3MgQI2q_0 2024-03-04T13:00:15.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.698+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7907833192365730231', time=2024-03-04T14:53:52.624979+0000, chain.objs.size()=1 2024-03-04T13:00:15.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.698+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.iQTYOiP8tF4OM1jQaArCFJFuqNbn9y__0 2024-03-04T13:00:15.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.701+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6724997093957388055', time=2024-03-04T14:53:52.665843+0000, chain.objs.size()=1 2024-03-04T13:00:15.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.701+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mhHaNYSZDGlut4zchwEnLwhwLdraRPR_0 2024-03-04T13:00:15.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.701+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10390910319147862217', time=2024-03-04T14:53:52.740587+0000, chain.objs.size()=1 2024-03-04T13:00:15.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.701+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wzXkAwhk-pk8vAvFK4pToXlzCmabnnh_0 2024-03-04T13:00:15.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.701+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2502680509506003050', time=2024-03-04T14:53:52.747270+0000, chain.objs.size()=1 2024-03-04T13:00:15.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.701+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.hx_kaa_9mFVun3qi_tfoxKaNxFJCQtD_0 2024-03-04T13:00:15.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.702+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16283788676149727824', time=2024-03-04T14:53:52.747952+0000, chain.objs.size()=1 2024-03-04T13:00:15.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.702+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vSue-l58LxJYKWVYz62rcPrxIwRTrEA_0 2024-03-04T13:00:15.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.702+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15314070043817562891', time=2024-03-04T14:53:52.793684+0000, chain.objs.size()=1 2024-03-04T13:00:15.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.702+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.EPurdn5qY6NLdetvrmLFJjRVFWEuNag_0 2024-03-04T13:00:15.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.702+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13939157471875285781', time=2024-03-04T14:53:52.815506+0000, chain.objs.size()=1 2024-03-04T13:00:15.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.702+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3nyUlOPz4zNbpm99BTtc1OMY4OzvoOo_0 2024-03-04T13:00:15.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.702+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8931023580950660330', time=2024-03-04T14:53:52.950769+0000, chain.objs.size()=1 2024-03-04T13:00:15.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.702+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-UsuD1Yr-ilglvvOQTjzi9Dz3N-QE1-_0 2024-03-04T13:00:15.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.702+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18090620261753712248', time=2024-03-04T14:53:52.976775+0000, chain.objs.size()=1 2024-03-04T13:00:15.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.702+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.XMwFujoVAampWkLXflJUt9NzMBgsY14_0 2024-03-04T13:00:15.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.702+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14209693991164617791', time=2024-03-04T14:53:52.985354+0000, chain.objs.size()=1 2024-03-04T13:00:15.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.702+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3XL-dhkZMo3qZirZvxAjWgn8EH2LRlY_0 2024-03-04T13:00:15.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.703+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8219731218927516753', time=2024-03-04T14:53:53.133521+0000, chain.objs.size()=1 2024-03-04T13:00:15.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.703+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CpPptr7w8FXkC-AmiSaNfiDsbOgUq8D_0 2024-03-04T13:00:15.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.703+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4979935625119670118', time=2024-03-04T14:53:53.135864+0000, chain.objs.size()=1 2024-03-04T13:00:15.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.703+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._l_g8DUym32cFojMT2MXY4EN3N5o9RD_0 2024-03-04T13:00:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6176962354982282528', time=2024-03-04T14:53:53.163537+0000, chain.objs.size()=1 2024-03-04T13:00:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CI-UUdADGdJpFE7eNxYxHo03rncEeNR_0 2024-03-04T13:00:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8240479625270506465', time=2024-03-04T14:53:53.250229+0000, chain.objs.size()=1 2024-03-04T13:00:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.07CtdGFVCTvMUilzkksxZ8Tbj8AFsmd_0 2024-03-04T13:00:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18009653123036810427', time=2024-03-04T14:53:53.289384+0000, chain.objs.size()=1 2024-03-04T13:00:15.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zDfT4kXOhvtiGa_zyAUr-HpTKf4YBR-_0 2024-03-04T13:00:15.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16173023793962871358', time=2024-03-04T14:53:53.296740+0000, chain.objs.size()=1 2024-03-04T13:00:15.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.npGfQFfIrXiAUzSCTJrwuG2wS_FH6WS_0 2024-03-04T13:00:15.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5292179444351915959', time=2024-03-04T14:53:53.301976+0000, chain.objs.size()=1 2024-03-04T13:00:15.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._mFObxOMwBCqaeNVNlhqD2LSZx8fqtW_0 2024-03-04T13:00:15.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8087204273676279650', time=2024-03-04T14:53:53.319674+0000, chain.objs.size()=1 2024-03-04T13:00:15.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.goxZthVyoBdX_VWeljI2bHj3wVdtgOu_0 2024-03-04T13:00:15.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12353402781454434324', time=2024-03-04T14:53:53.320754+0000, chain.objs.size()=1 2024-03-04T13:00:15.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jCV52nAFp0rUO9ZvHRqIpHc6KGVMzZ8_0 2024-03-04T13:00:15.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4010966524133130315', time=2024-03-04T14:53:58.816789+0000, chain.objs.size()=1 2024-03-04T13:00:15.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.245__shadow_.z526YVOF7kithE-AtkiWAT2_H4Fv_Xf_0 2024-03-04T13:00:15.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8500442692001304970', time=2024-03-04T14:53:59.697316+0000, chain.objs.size()=1 2024-03-04T13:00:15.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.247__shadow_.g0MttZDd5HJbVrDsWRV9ZI7MeRY4G5o_0 2024-03-04T13:00:15.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4484643847316028375', time=2024-03-04T14:54:04.513358+0000, chain.objs.size()=1 2024-03-04T13:00:15.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.258__shadow_.JY0SBswqPepJsCBAOg40FRA3JX8Bc6K_0 2024-03-04T13:00:15.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5901529427284785360', time=2024-03-04T14:54:08.239527+0000, chain.objs.size()=1 2024-03-04T13:00:15.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.710+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.zlpAjiHy6FdOr2ow_x7sqwwgHid6U_p_0 2024-03-04T13:00:15.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.711+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18346158837595910057', time=2024-03-04T14:54:08.243700+0000, chain.objs.size()=1 2024-03-04T13:00:15.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.711+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.iok8jclQUTwycbSwl2mz3KDXwGmEeGK_0 2024-03-04T13:00:15.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.712+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13225590436569647936', time=2024-03-04T14:54:09.027714+0000, chain.objs.size()=1 2024-03-04T13:00:15.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.712+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.1NjK3lie3DL3CWRC0rE95sr8AMa237C_0 2024-03-04T13:00:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.713+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7712950627234702103', time=2024-03-04T14:54:18.317946+0000, chain.objs.size()=1 2024-03-04T13:00:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.713+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.286__shadow_.6m2vaNt0g1twMHyCVZXQa2498ALebJn_0 2024-03-04T13:00:15.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4567284524546052120', time=2024-03-04T14:54:29.615513+0000, chain.objs.size()=1 2024-03-04T13:00:15.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.iifx44Q0RMt5La7oxo7xNH8MKAFw5dL_0 2024-03-04T13:00:15.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14728894456305572988', time=2024-03-04T14:54:29.639924+0000, chain.objs.size()=1 2024-03-04T13:00:15.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-_2fo99KJdAq-ml3_VufcV-cNrLy0_8_0 2024-03-04T13:00:15.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8511232668440529459', time=2024-03-04T14:54:29.640860+0000, chain.objs.size()=1 2024-03-04T13:00:15.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0cvRnEpreshATO5vHIn2P1VjqDQGZCI_0 2024-03-04T13:00:15.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7676691213816317442', time=2024-03-04T14:54:29.660569+0000, chain.objs.size()=1 2024-03-04T13:00:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.JIwVlb6_NumcNj0iOrC4izNFrz3pXfx_0 2024-03-04T13:00:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17934844362779344626', time=2024-03-04T14:54:29.669220+0000, chain.objs.size()=1 2024-03-04T13:00:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.nkzxfQkz5r8QygpVRNzd99V8ahyCQON_0 2024-03-04T13:00:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6276332668484829638', time=2024-03-04T14:54:29.675089+0000, chain.objs.size()=1 2024-03-04T13:00:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HCpoBKuq-py9rUSMVkD1Dlou9wvHSUE_0 2024-03-04T13:00:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7108971167122525741', time=2024-03-04T14:54:29.695420+0000, chain.objs.size()=1 2024-03-04T13:00:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Oky74A3j-kZVzhfhbyu7CqjNPd5wGFf_0 2024-03-04T13:00:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12837255764949420822', time=2024-03-04T14:54:29.783759+0000, chain.objs.size()=1 2024-03-04T13:00:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.714+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.8PuwObWVqLoVj0-WbfR11hgjEi5Uhwh_0 2024-03-04T13:00:15.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.719+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12539298070074105572', time=2024-03-04T14:54:29.800863+0000, chain.objs.size()=1 2024-03-04T13:00:15.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.719+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-gGAxzm-5eGtrMGPC6KS4ES5XO50Zbw_0 2024-03-04T13:00:15.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.719+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15844699252965036486', time=2024-03-04T14:54:29.805250+0000, chain.objs.size()=1 2024-03-04T13:00:15.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.719+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.p2uIE8TIaiOIcQg26AEfKQ-fbgHFnlh_0 2024-03-04T13:00:15.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.719+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13180045478154471966', time=2024-03-04T14:54:29.837441+0000, chain.objs.size()=1 2024-03-04T13:00:15.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.719+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-ccn5pCoI7vlyVD1MykCHqRuigDqcFg_0 2024-03-04T13:00:15.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.719+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14412820552835162739', time=2024-03-04T14:54:29.858029+0000, chain.objs.size()=1 2024-03-04T13:00:15.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.719+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.P1EHtho3ASHGGjXJAKiG4D6esQ-Fb7Z_0 2024-03-04T13:00:15.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3748182354777088952', time=2024-03-04T14:54:29.953422+0000, chain.objs.size()=1 2024-03-04T13:00:15.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.c1e76O6zU6pk_-3JDyBDp-vdAMetHkw_0 2024-03-04T13:00:15.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10834005764840330894', time=2024-03-04T14:54:29.958659+0000, chain.objs.size()=1 2024-03-04T13:00:15.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.c5_YLXDvXeGVFALd77qGBrajiEAiBum_0 2024-03-04T13:00:15.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8954805752593803002', time=2024-03-04T14:54:29.978226+0000, chain.objs.size()=1 2024-03-04T13:00:15.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.fl6bfsPn4SEYg9Rd3k-ZyMzT4UazVZ7_0 2024-03-04T13:00:15.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10217740038020697380', time=2024-03-04T14:54:29.981248+0000, chain.objs.size()=1 2024-03-04T13:00:15.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.dlyGs4y7rbhOmXVdW7KF-P4jT2bh6a8_0 2024-03-04T13:00:15.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12522554788583703845', time=2024-03-04T14:54:29.981873+0000, chain.objs.size()=1 2024-03-04T13:00:15.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cE0SFavRH8IF2irHYY1xDh8LDzEpI_m_0 2024-03-04T13:00:15.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4787366463441772500', time=2024-03-04T14:54:29.993435+0000, chain.objs.size()=1 2024-03-04T13:00:15.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.mowaDMY8G4MQYVxUXn0rRMqu7lDrn2V_0 2024-03-04T13:00:15.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1220540884859218870', time=2024-03-04T14:54:29.998866+0000, chain.objs.size()=1 2024-03-04T13:00:15.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_._u5Q8g5b2FzSKIJbTTdg-TvuK_wXNLR_0 2024-03-04T13:00:15.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14242307550113716814', time=2024-03-04T14:54:30.101489+0000, chain.objs.size()=1 2024-03-04T13:00:15.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.720+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.c6W-nxpT4DwuooWoAf6VJwkit_iu6M4_0 2024-03-04T13:00:15.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.721+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14080924256871172994', time=2024-03-04T14:54:30.139469+0000, chain.objs.size()=1 2024-03-04T13:00:15.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.721+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-Wi0vcFsLURLuspykabJ9qQDcTrHsDf_0 2024-03-04T13:00:15.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.723+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2510449296407760959', time=2024-03-04T14:54:30.140366+0000, chain.objs.size()=1 2024-03-04T13:00:15.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.723+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.CMlif3x2o2YSuyrsqC7icRPUHXLtF8l_0 2024-03-04T13:00:15.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14443221164107321686', time=2024-03-04T14:54:30.304133+0000, chain.objs.size()=1 2024-03-04T13:00:15.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.a2r8ocxd8zZB5JfSj7ZZE99rzaC21cI_0 2024-03-04T13:00:15.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9082065398928621417', time=2024-03-04T14:54:30.308824+0000, chain.objs.size()=1 2024-03-04T13:00:15.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lNn_jjmikm8vfZq_uxQKcu0CpIaFMUN_0 2024-03-04T13:00:15.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5246143743428187723', time=2024-03-04T14:54:30.313347+0000, chain.objs.size()=1 2024-03-04T13:00:15.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YDrNfmXGcNhpV9fgsoR-dqVBvzFpWJT_0 2024-03-04T13:00:15.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3510371539058012078', time=2024-03-04T14:54:30.420924+0000, chain.objs.size()=1 2024-03-04T13:00:15.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Uu1SkjhEaValNi1QSjjoMQpfLQZqRJd_0 2024-03-04T13:00:15.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3951405925485597269', time=2024-03-04T14:54:30.433962+0000, chain.objs.size()=1 2024-03-04T13:00:15.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.k1Rpur-1GG0Iva-6KNytyWkropqgYzb_0 2024-03-04T13:00:15.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7546987364070760387', time=2024-03-04T14:54:30.443748+0000, chain.objs.size()=1 2024-03-04T13:00:15.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-06OSAEK9_gGBhjhL4T1hPYvnfm0opl_0 2024-03-04T13:00:15.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16703900994315173746', time=2024-03-04T14:54:30.464672+0000, chain.objs.size()=1 2024-03-04T13:00:15.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.8iCXATqSyOn4JFYZaLodjd7W2gi6beS_0 2024-03-04T13:00:15.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8723047892389423925', time=2024-03-04T14:54:30.468555+0000, chain.objs.size()=1 2024-03-04T13:00:15.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2x_hLVU8e6P3BvFr5Ey-Yjb_ONVYlf-_0 2024-03-04T13:00:15.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9030294248284687787', time=2024-03-04T14:54:30.499173+0000, chain.objs.size()=1 2024-03-04T13:00:15.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.b1GC9nC0Scy3X-nv4wiSeSu_C5EyIWO_0 2024-03-04T13:00:15.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8175562080300144246', time=2024-03-04T14:54:30.500617+0000, chain.objs.size()=1 2024-03-04T13:00:15.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.6DSDA8HCFgOydz0sNREdhtHfyv_W6_E_0 2024-03-04T13:00:15.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10185710025812243824', time=2024-03-04T14:54:30.503027+0000, chain.objs.size()=1 2024-03-04T13:00:15.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.725+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7Hm8VDz1T_h6qBGeyBIQDwmUUKPWMXS_0 2024-03-04T13:00:15.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.728+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10405167265416121091', time=2024-03-04T14:54:30.612789+0000, chain.objs.size()=1 2024-03-04T13:00:15.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.728+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.17fEvZD1yXtGgApE5hK-0DXV1K6HO-n_0 2024-03-04T13:00:15.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.728+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17865528882910983509', time=2024-03-04T14:54:30.622111+0000, chain.objs.size()=1 2024-03-04T13:00:15.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.728+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.fnzLg7kyl44jCPlsoB1FI6w-e1UZg_J_0 2024-03-04T13:00:15.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10522799478239512432', time=2024-03-04T14:54:30.630358+0000, chain.objs.size()=1 2024-03-04T13:00:15.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.dLUz1BjwdgT9umKaAuwD7jS1YtAe29K_0 2024-03-04T13:00:15.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2728553174783589043', time=2024-03-04T14:54:30.738136+0000, chain.objs.size()=1 2024-03-04T13:00:15.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.EPXcxFoWpI-4Fm2UqtZsTUPy69-6pPJ_0 2024-03-04T13:00:15.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6457987137634677986', time=2024-03-04T14:54:30.760312+0000, chain.objs.size()=1 2024-03-04T13:00:15.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rE8AhBFHF5DuQt-HgX_L-b4Snriyfba_0 2024-03-04T13:00:15.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9928454439605237206', time=2024-03-04T14:54:30.793166+0000, chain.objs.size()=1 2024-03-04T13:00:15.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cwHslBGN7oKIRnsWsl61Tb-wneDRbJr_0 2024-03-04T13:00:15.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.486168190848514334', time=2024-03-04T14:54:38.310052+0000, chain.objs.size()=1 2024-03-04T13:00:15.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rC2GCzk-mY5abf05pQV7Io1eWHkhMXY_0 2024-03-04T13:00:15.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14788330656694365103', time=2024-03-04T14:54:38.341845+0000, chain.objs.size()=1 2024-03-04T13:00:15.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.3cOsMzip-29OOkP7eOE3j5HeT9uBDP-_0 2024-03-04T13:00:15.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7280965157023976251', time=2024-03-04T14:54:38.377738+0000, chain.objs.size()=1 2024-03-04T13:00:15.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Jwjk8E2MGsbpa6ZvyXjUWtkmRiZEkhQ_0 2024-03-04T13:00:15.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14364564929153023083', time=2024-03-04T14:54:38.379753+0000, chain.objs.size()=1 2024-03-04T13:00:15.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.9BZYFFkvyUYBidMAZv9g_oKmV13xV2y_0 2024-03-04T13:00:15.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17901012045783090007', time=2024-03-04T14:54:38.478124+0000, chain.objs.size()=1 2024-03-04T13:00:15.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cBk4BLBnv2gg3_JaezfJ0O_d04LQbjO_0 2024-03-04T13:00:15.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5087619746106460172', time=2024-03-04T14:54:38.513157+0000, chain.objs.size()=1 2024-03-04T13:00:15.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.9YljsFWYgi9Xb83nSiGDql6KRptUXc8_0 2024-03-04T13:00:15.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17090750220544472653', time=2024-03-04T14:54:38.533168+0000, chain.objs.size()=1 2024-03-04T13:00:15.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.731+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._KVc3C-dJ0JoZcyXV6yEjzArl9e8Cto_0 2024-03-04T13:00:15.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.739+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8583527957660145105', time=2024-03-04T14:54:38.625800+0000, chain.objs.size()=1 2024-03-04T13:00:15.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.739+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xhGuI6TtIz0muC4PxqXOuN2dpeULGO5_0 2024-03-04T13:00:15.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.739+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14447013029279924053', time=2024-03-04T14:54:38.628042+0000, chain.objs.size()=1 2024-03-04T13:00:15.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.739+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.BD9_gsoxC_ahkRnSlQJCGq2IIs59NOI_0 2024-03-04T13:00:15.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.739+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3685034380245089105', time=2024-03-04T14:54:38.660721+0000, chain.objs.size()=1 2024-03-04T13:00:15.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.739+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.D9nY5ofHaXk-H6EmMhVpn3AwA7aorW5_0 2024-03-04T13:00:15.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.739+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11411014747434129191', time=2024-03-04T14:54:38.806203+0000, chain.objs.size()=1 2024-03-04T13:00:15.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.739+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wmoFFqLa1ahROj-6DLwbPC8h9goCUA7_0 2024-03-04T13:00:15.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.739+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18288463766149514394', time=2024-03-04T14:54:38.836494+0000, chain.objs.size()=1 2024-03-04T13:00:15.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.739+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jb7TEfDPdLxX_Dj6xz9QPulaMhcQg8x_0 2024-03-04T13:00:15.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.739+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11365285527037584462', time=2024-03-04T14:54:38.849312+0000, chain.objs.size()=1 2024-03-04T13:00:15.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.739+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kY9MfAsS2OxwvV5ZpSIJ2jD9aLfhPVD_0 2024-03-04T13:00:15.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.743+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/44142 2024-03-04T13:00:15.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-03-04T13:00:15.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2060564231677633312', time=2024-03-04T14:54:38.869891+0000, chain.objs.size()=1 2024-03-04T13:00:15.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Iq5tRauNKgqqEMzaWEg04BjQDa_4hbp_0 2024-03-04T13:00:15.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13504743223749558381', time=2024-03-04T14:54:38.950764+0000, chain.objs.size()=1 2024-03-04T13:00:15.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Ld2-6vKdO2B3WIi2lHX3Uzs4rW5T4_W_0 2024-03-04T13:00:15.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10465371536521982698', time=2024-03-04T14:54:38.961829+0000, chain.objs.size()=1 2024-03-04T13:00:15.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KpTje_PzW8ynmbvzxjV63ETXtAKViu2_0 2024-03-04T13:00:15.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9575162457039168148', time=2024-03-04T14:54:39.013212+0000, chain.objs.size()=1 2024-03-04T13:00:15.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cQrG90ymBdcdS1IeDLFnRcl-7Eiz30M_0 2024-03-04T13:00:15.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7149898284445815160', time=2024-03-04T14:54:39.135838+0000, chain.objs.size()=1 2024-03-04T13:00:15.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cBNE_OpkauPbwRAgVOyMco-ncPrtPJB_0 2024-03-04T13:00:15.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2549516104956013785', time=2024-03-04T14:54:39.148878+0000, chain.objs.size()=1 2024-03-04T13:00:15.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.qALNFkEzoVhJhg40EIvVzKRc1iQztxV_0 2024-03-04T13:00:15.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12443463375547590704', time=2024-03-04T14:54:39.156384+0000, chain.objs.size()=1 2024-03-04T13:00:15.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ZHqci8SnPPD6xPTdAqP88DjZdljeNx9_0 2024-03-04T13:00:15.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10189309640301775466', time=2024-03-04T14:54:39.182437+0000, chain.objs.size()=1 2024-03-04T13:00:15.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.e3ilLPUzM5boR-hRoYrzfrutqU7ipXL_0 2024-03-04T13:00:15.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11133350594683336464', time=2024-03-04T14:54:39.288118+0000, chain.objs.size()=1 2024-03-04T13:00:15.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.JR41yQcE0wQVRvHO9suXF2AK4TGpmWR_0 2024-03-04T13:00:15.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17810369294382081251', time=2024-03-04T14:54:39.424539+0000, chain.objs.size()=1 2024-03-04T13:00:15.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.El6WRHKpe81c-XHlXzCJFnxJQIH9Ai__0 2024-03-04T13:00:15.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4173020629944727710', time=2024-03-04T14:54:39.479645+0000, chain.objs.size()=1 2024-03-04T13:00:15.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-ZIrgwd4LerxLzE69v1QwcA91B6dRY1_0 2024-03-04T13:00:15.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.749881328098082114', time=2024-03-04T14:54:39.489308+0000, chain.objs.size()=1 2024-03-04T13:00:15.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.745+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.sg-MGeDBA9gARg1N3U0cdghOuX295UF_0 2024-03-04T13:00:15.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.749+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14535642099571026603', time=2024-03-04T14:55:04.155078+0000, chain.objs.size()=1 2024-03-04T13:00:15.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.749+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.354__shadow_.P2nQZzIAlINIwWlS-iuKtpmbHayALcR_0 2024-03-04T13:00:15.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.749+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12464062174124021718', time=2024-03-04T14:55:05.285867+0000, chain.objs.size()=1 2024-03-04T13:00:15.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.749+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.356__shadow_.bmko84TjWCedy2VMmGC-26XS6qKyh9t_0 2024-03-04T13:00:15.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.749+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2925139311221574300', time=2024-03-04T14:55:08.316183+0000, chain.objs.size()=1 2024-03-04T13:00:15.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.363__shadow_.tlK1dHloaeFJtLUak65B7MLFKscpCM4_0 2024-03-04T13:00:15.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3727417081965524572', time=2024-03-04T14:55:08.317114+0000, chain.objs.size()=1 2024-03-04T13:00:15.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.363__shadow_.NKmPNqX-UcTvdoCVYMxyTbrBInAq0ZL_0 2024-03-04T13:00:15.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16335172881572004490', time=2024-03-04T14:55:37.772433+0000, chain.objs.size()=1 2024-03-04T13:00:15.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.423__shadow_.kebWQL0Bv04_79v7kqjcQjSb_TlYVlH_0 2024-03-04T13:00:15.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13431028099572854584', time=2024-03-04T14:55:46.551366+0000, chain.objs.size()=1 2024-03-04T13:00:15.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.437__shadow_.nalzbWQsCIIm5XmedhkmfGJmH4BI4zm_0 2024-03-04T13:00:15.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6103795947236360185', time=2024-03-04T14:55:56.096935+0000, chain.objs.size()=1 2024-03-04T13:00:15.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.463__shadow_.zAjKwFUjDsBbw9Xr5oQHlW-H9eXWt03_0 2024-03-04T13:00:15.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9091245104365569815', time=2024-03-04T14:55:59.198792+0000, chain.objs.size()=1 2024-03-04T13:00:15.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.472__shadow_.IaeL8ZwDK82SgvDdjY2QBN-CCoOmj6R_0 2024-03-04T13:00:15.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12044789208658181717', time=2024-03-04T14:56:04.460338+0000, chain.objs.size()=1 2024-03-04T13:00:15.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.483__multipart_mymultipart.2~rd42xghVRiqRewh8o2d2GKVIqogfN93.1 2024-03-04T13:00:15.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7011842040927875657', time=2024-03-04T14:56:06.511327+0000, chain.objs.size()=1 2024-03-04T13:00:15.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.487__shadow_.nlGHV6gmUHovSl7VktVHQLIr2eY0BtS_0 2024-03-04T13:00:15.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1376770905016896943', time=2024-03-04T14:57:03.103468+0000, chain.objs.size()=1 2024-03-04T13:00:15.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.750+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.519__shadow_.wLt67B3z1qrqCoAbX1t5QtR5MevMEmx_0 2024-03-04T13:00:15.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.752+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6435550052900355894', time=2024-03-04T14:57:14.501428+0000, chain.objs.size()=1 2024-03-04T13:00:15.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.752+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.532__shadow_.4a7AGRVV-sI6iJufyl2y8Mi3ZuD1I6C_0 2024-03-04T13:00:15.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.755+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:WPHXa.O.o9ns74ko2wGTzDUk0Ipn3FP_.q-PkcBk83m97JXzaQtec9oYYyJ0LelO_1_50c469f11001b0e234e1997a3b4d10b8', time=2024-03-04T14:57:48.457361+0000, chain.objs.size()=1 2024-03-04T13:00:15.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.755+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:WPHXa.O.o9ns74ko2wGTzDUk0Ipn3FP_.q-PkcBk83m97JXzaQtec9oYYyJ0LelO_0 2024-03-04T13:00:15.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.755+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.376184159153923163', time=2024-03-04T14:57:58.253966+0000, chain.objs.size()=1 2024-03-04T13:00:15.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.755+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.569__shadow_.cTCyQidSFTpq-gTGP4uY2IBtziWd1G0_0 2024-03-04T13:00:15.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.755+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9237034527080256035', time=2024-03-04T14:58:16.342574+0000, chain.objs.size()=1 2024-03-04T13:00:15.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.755+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.594__shadow_.h8bje8J7EEVejpHAOBmgBfT7S9JRSOM_0 2024-03-04T13:00:15.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.755+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7715757410326941163', time=2024-03-04T14:58:20.933412+0000, chain.objs.size()=1 2024-03-04T13:00:15.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.755+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.605__shadow_.Z8xMk64D8C0AGRa6b_F_OWkpCXwdDMY_0 2024-03-04T13:00:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.755+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.114205723377896006', time=2024-03-04T14:58:31.632753+0000, chain.objs.size()=1 2024-03-04T13:00:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.755+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.625__shadow_.7g2gtGPCaO09Wo1j0g0Nc_gjhGR1ffu_0 2024-03-04T13:00:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.755+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7806243823694954713', time=2024-03-04T14:58:50.252090+0000, chain.objs.size()=1 2024-03-04T13:00:15.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.755+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.672__shadow:c8K7jdFDez6WSRVL1wgDW5KJG1wSCew_.VFuChxfKWdzL-oRjjgvEQiEkmAVitGs_0 2024-03-04T13:00:15.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.757+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12476947393740357353', time=2024-03-04T14:58:50.625778+0000, chain.objs.size()=1 2024-03-04T13:00:15.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.757+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.673__shadow:7KLCtBU8v3DNOu6ef13jcmcmFfuFVAO_.B65xZsm_gMmJ2Auidj8ngNbpat1pGRW_0 2024-03-04T13:00:15.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.757+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8425237546110207623', time=2024-03-04T14:59:11.903687+0000, chain.objs.size()=1 2024-03-04T13:00:15.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.757+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.679__shadow_.WRNxZJXovzWJBTE2YBCegXySkoIxcYB_0 2024-03-04T13:00:15.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.757+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10149623627915355561', time=2024-03-04T14:59:31.757615+0000, chain.objs.size()=1 2024-03-04T13:00:15.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.757+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.698__shadow_.WM-SG6SAF8oVeCVr0WRp9gjE9roic9p_0 2024-03-04T13:00:15.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.760+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:15.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.763+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T13:00:15.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.764+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:15.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:15.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45304' 2024-03-04T13:00:15.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17001728189882944286', time=2024-03-04T14:52:58.318088+0000, chain.objs.size()=3 2024-03-04T13:00:15.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__multipart_foo-STANDARD.2~8ifu3ZNFonMH0epT4OFJtFXEoGIe_Jj.1 2024-03-04T13:00:15.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__multipart_foo-STANDARD.2~8ifu3ZNFonMH0epT4OFJtFXEoGIe_Jj.2 2024-03-04T13:00:15.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__multipart_foo-STANDARD.2~8ifu3ZNFonMH0epT4OFJtFXEoGIe_Jj.3 2024-03-04T13:00:15.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16063440457935337710', time=2024-03-04T14:53:30.778769+0000, chain.objs.size()=1 2024-03-04T13:00:15.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.206__shadow_.n0BCo7GOGT-58lX7fVgLWaQcDEUzpvs_0 2024-03-04T13:00:15.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15177152798032454111', time=2024-03-04T14:53:31.213855+0000, chain.objs.size()=1 2024-03-04T13:00:15.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.207__shadow_.0tMJ-8VFIhlmtcDaHdK7Ht2puWLBz2v_0 2024-03-04T13:00:15.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11752582554356360641', time=2024-03-04T14:53:32.035676+0000, chain.objs.size()=1 2024-03-04T13:00:15.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.209__shadow_.ocxbjHiZGgzE0gyOTawSKym6vn4OnRu_0 2024-03-04T13:00:15.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14876385944929398783', time=2024-03-04T14:53:36.110998+0000, chain.objs.size()=1 2024-03-04T13:00:15.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.216__shadow_.sb32j5qQjAr2ojfaoQuo6ytnJBl1ywB_0 2024-03-04T13:00:15.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4895504971901945983', time=2024-03-04T14:53:37.772574+0000, chain.objs.size()=1 2024-03-04T13:00:15.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.219__shadow_.1WmSTexEby49bc9jgYkflsWKURLulVi_0 2024-03-04T13:00:15.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15271234505119087867', time=2024-03-04T14:53:38.669728+0000, chain.objs.size()=1 2024-03-04T13:00:15.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.221__shadow_.MK0agQ33MhLuWzYY1B1_o61sOklDOsB_0 2024-03-04T13:00:15.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11507158022743270600', time=2024-03-04T14:53:39.996225+0000, chain.objs.size()=1 2024-03-04T13:00:15.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.765+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.224__shadow_.sNNJgGH3K-yIG7mx_sH_9l7sPqG9_GH_0 2024-03-04T13:00:15.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.766+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8219636688105059340', time=2024-03-04T14:53:52.121720+0000, chain.objs.size()=1 2024-03-04T13:00:15.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.766+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.oBxrv_m46rMGyL-7S_646eha7XEiP1T_0 2024-03-04T13:00:15.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.766+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16324293066598812393', time=2024-03-04T14:53:52.136034+0000, chain.objs.size()=1 2024-03-04T13:00:15.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.766+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.icmoS2zYdXXi-tCSPZX4y0tITOBF8EH_0 2024-03-04T13:00:15.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.768+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17015895905359897363', time=2024-03-04T14:53:52.219339+0000, chain.objs.size()=1 2024-03-04T13:00:15.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.768+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.1-zXBn_1tcIEZ4YjIQ__d_oGcinWbJc_0 2024-03-04T13:00:15.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.795526035761816287', time=2024-03-04T14:53:52.251124+0000, chain.objs.size()=1 2024-03-04T13:00:15.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.aivkQy2OWO8iHeY4nVA31oH3edt9J5o_0 2024-03-04T13:00:15.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15638884437342238554', time=2024-03-04T14:53:52.280435+0000, chain.objs.size()=1 2024-03-04T13:00:15.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.nLylo4ze0MjXVEIKc_oNk3zcz5SWrO0_0 2024-03-04T13:00:15.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10787863642384153790', time=2024-03-04T14:53:52.310441+0000, chain.objs.size()=1 2024-03-04T13:00:15.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.OTyiTXv_UCArVvEhJnSw2zHpAnYlU0M_0 2024-03-04T13:00:15.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2931819482898612513', time=2024-03-04T14:53:52.311629+0000, chain.objs.size()=1 2024-03-04T13:00:15.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0CaCNE27VU046ugJZ41LTRkA5yZmnRG_0 2024-03-04T13:00:15.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6506494175637368517', time=2024-03-04T14:53:52.396270+0000, chain.objs.size()=1 2024-03-04T13:00:15.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.qMBgpp6Lwf-GfdrFVo1STdxSd8HY4-y_0 2024-03-04T13:00:15.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5720739582619873837', time=2024-03-04T14:53:52.579590+0000, chain.objs.size()=1 2024-03-04T13:00:15.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LeHqsHsoWMkeaQlHrHI24ZN-K1ztngI_0 2024-03-04T13:00:15.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10215572344620820179', time=2024-03-04T14:53:52.588460+0000, chain.objs.size()=1 2024-03-04T13:00:15.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vdpyubu_wTP4kFYSxDfQcUlCxCXlkW-_0 2024-03-04T13:00:15.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3037040854660768625', time=2024-03-04T14:53:52.601797+0000, chain.objs.size()=1 2024-03-04T13:00:15.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.chWt1tfAsTP2xpYlgm4PZFajmeRlDP0_0 2024-03-04T13:00:15.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15835932657895247598', time=2024-03-04T14:53:52.617664+0000, chain.objs.size()=1 2024-03-04T13:00:15.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Qqa2jhoM1H-gCiAIj3AhmnhM_ElbpUS_0 2024-03-04T13:00:15.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10730255531821101909', time=2024-03-04T14:53:52.656842+0000, chain.objs.size()=1 2024-03-04T13:00:15.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.64VHmF1ZCw8M5GsfWfasvSCAeys1o1u_0 2024-03-04T13:00:15.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17663064277517607158', time=2024-03-04T14:53:52.768537+0000, chain.objs.size()=1 2024-03-04T13:00:15.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.772+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.J6ibacqLv1rgjWjbYdr_ZhRvxWN74P9_0 2024-03-04T13:00:15.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.774+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15358288877752918271', time=2024-03-04T14:53:52.776299+0000, chain.objs.size()=1 2024-03-04T13:00:15.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.774+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LfgW--vPsTw9SHCrS7qvWHFEB1GHDAn_0 2024-03-04T13:00:15.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.774+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5728303122165819465', time=2024-03-04T14:53:52.778840+0000, chain.objs.size()=1 2024-03-04T13:00:15.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.774+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ia7wKZtudpQCbpVkLl_jQ7IqtL_SqOp_0 2024-03-04T13:00:15.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.774+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9877293198417510071', time=2024-03-04T14:53:52.801842+0000, chain.objs.size()=1 2024-03-04T13:00:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.774+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.q3s3Dq5scrBfakh-nIbnZ2eob1iu-sz_0 2024-03-04T13:00:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.775+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10922984740265277064', time=2024-03-04T14:53:52.812299+0000, chain.objs.size()=1 2024-03-04T13:00:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.775+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.6qAP_hhR-8nEZSFFBqIEeXmaI1foJ4v_0 2024-03-04T13:00:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.775+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17592150891954595130', time=2024-03-04T14:53:52.911110+0000, chain.objs.size()=1 2024-03-04T13:00:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.775+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JD69QmjVZTO6raYcegI5eHnSjj2bQLb_0 2024-03-04T13:00:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.775+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2032506811837405244', time=2024-03-04T14:53:53.081638+0000, chain.objs.size()=1 2024-03-04T13:00:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.775+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.SgjUarGTTaYtS2pKKXXlXtPdqJoTe67_0 2024-03-04T13:00:15.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.775+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5196514967153807230', time=2024-03-04T14:53:53.100519+0000, chain.objs.size()=1 2024-03-04T13:00:15.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.775+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VnPEQxC3HiXoTqut4khzZYs2TbqGthS_0 2024-03-04T13:00:15.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.567795041704628173', time=2024-03-04T14:53:53.112132+0000, chain.objs.size()=1 2024-03-04T13:00:15.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.W5ODLhCmhVfzKUmRNO1OO6tubFvkMCj_0 2024-03-04T13:00:15.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14919659816387853802', time=2024-03-04T14:53:53.130904+0000, chain.objs.size()=1 2024-03-04T13:00:15.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.fl8T_3W_punfJktpKa9QeO8iJLKGD8B_0 2024-03-04T13:00:15.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3224175238156902185', time=2024-03-04T14:53:53.159344+0000, chain.objs.size()=1 2024-03-04T13:00:15.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.C3BvqB8dvog0TW8L207Hz5BxClS-3js_0 2024-03-04T13:00:15.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4405619483539058800', time=2024-03-04T14:53:53.176135+0000, chain.objs.size()=1 2024-03-04T13:00:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JpwywBoWTmIWvI7nBLRlWNeQjBhv_Eb_0 2024-03-04T13:00:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1627137015562680544', time=2024-03-04T14:53:53.260165+0000, chain.objs.size()=1 2024-03-04T13:00:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wptutHZENBcoUu9VRrNam-OckBhorBI_0 2024-03-04T13:00:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11870468412753273524', time=2024-03-04T14:53:53.294541+0000, chain.objs.size()=1 2024-03-04T13:00:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.z6eXSI2xIzeUUoVwAGlU8BrR4lcHWRN_0 2024-03-04T13:00:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5622032447322269887', time=2024-03-04T14:53:53.322488+0000, chain.objs.size()=1 2024-03-04T13:00:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.776+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.DVH96TnBAlX6CHYRFlAsKlKfhXVUx2Y_0 2024-03-04T13:00:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.778+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3635735447167908', time=2024-03-04T14:54:04.959918+0000, chain.objs.size()=1 2024-03-04T13:00:15.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.778+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.259__shadow_.pKggl7La4NX6VnFZqINGmESRwagTwsI_0 2024-03-04T13:00:15.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.778+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7681282979957686861', time=2024-03-04T14:54:13.077246+0000, chain.objs.size()=1 2024-03-04T13:00:15.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.778+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.275__shadow_.1VGFPlTPZoIMYxci4TnT82kqXnHvH2M_0 2024-03-04T13:00:15.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.778+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10176417937381572224', time=2024-03-04T14:54:20.805776+0000, chain.objs.size()=1 2024-03-04T13:00:15.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.778+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.292__shadow:topp9YTjiLbxGNepQCviG2pPYkmVCqi_.jg7LZItT5MTRXhagxiaN7CHl_MznKH-_0 2024-03-04T13:00:15.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.778+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1050776449255711485', time=2024-03-04T14:54:21.260870+0000, chain.objs.size()=1 2024-03-04T13:00:15.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.778+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.294__shadow_.3WVSnKhRMLPq4wiNdYzkxLVBMUMphkL_0 2024-03-04T13:00:15.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.778+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13240956775129509281', time=2024-03-04T14:54:29.617312+0000, chain.objs.size()=1 2024-03-04T13:00:15.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.778+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.SbDpKrpiR3w4kOVa-pL9ZxCQErsiUwQ_0 2024-03-04T13:00:15.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.778+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4557105842700809505', time=2024-03-04T14:54:29.679506+0000, chain.objs.size()=1 2024-03-04T13:00:15.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.778+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7R-orB_O-05R1TpQ1TorxQwP1izd2oK_0 2024-03-04T13:00:15.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.779+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11580837766849994416', time=2024-03-04T14:54:29.694262+0000, chain.objs.size()=1 2024-03-04T13:00:15.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.779+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.gFQVJh5uXr5NTtzKnk7wmk_RA1nyngN_0 2024-03-04T13:00:15.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.779+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6832836618814476260', time=2024-03-04T14:54:29.778793+0000, chain.objs.size()=1 2024-03-04T13:00:15.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.779+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.fde1uWUQ43tF3J8mojaUutQ7r5PQTcZ_0 2024-03-04T13:00:15.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.779+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5051159446905683273', time=2024-03-04T14:54:29.779465+0000, chain.objs.size()=1 2024-03-04T13:00:15.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.779+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.90fjlS2ohujJkJBJ0mH10y-gMyPwgAY_0 2024-03-04T13:00:15.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.779+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1914904240962766662', time=2024-03-04T14:54:29.858578+0000, chain.objs.size()=1 2024-03-04T13:00:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.779+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YPq8T68MFY6ixjfUePumwr9L8lx5Mvp_0 2024-03-04T13:00:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.779+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.171343183446633889', time=2024-03-04T14:54:30.157948+0000, chain.objs.size()=1 2024-03-04T13:00:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.779+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5lrevTGPmPFKaPwXIymhrJUN_Q4X9oZ_0 2024-03-04T13:00:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.780+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7721806238345768294', time=2024-03-04T14:54:30.159730+0000, chain.objs.size()=1 2024-03-04T13:00:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.780+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rrUo-ngfAkeWcA-x3kjfmqv30oecwIG_0 2024-03-04T13:00:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.780+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15739226093217250677', time=2024-03-04T14:54:30.172028+0000, chain.objs.size()=1 2024-03-04T13:00:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.780+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wnQLDZyCrFlk-4iMmVhuJ1H7YD_hAoN_0 2024-03-04T13:00:15.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.780+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7135429347670304779', time=2024-03-04T14:54:30.264283+0000, chain.objs.size()=1 2024-03-04T13:00:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.780+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.9ZtZWgqxy_qPwengZ1FvuUMPhSZWeqk_0 2024-03-04T13:00:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.780+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8656056884191544886', time=2024-03-04T14:54:30.284562+0000, chain.objs.size()=1 2024-03-04T13:00:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.780+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VmnBBcmYs2t0mHmqUO_YlUk4tw_HD1P_0 2024-03-04T13:00:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.780+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17319654578784240849', time=2024-03-04T14:54:30.308256+0000, chain.objs.size()=1 2024-03-04T13:00:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.780+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Xr4bDg00WNtNZdpbjlwazOgpgQ9nUSQ_0 2024-03-04T13:00:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.781+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.695956670442263801', time=2024-03-04T14:54:30.428452+0000, chain.objs.size()=1 2024-03-04T13:00:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.781+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FRWgfRWotj-3PycvUDrfnS-copkL6gO_0 2024-03-04T13:00:15.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.781+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7761071132335822646', time=2024-03-04T14:54:30.432071+0000, chain.objs.size()=1 2024-03-04T13:00:15.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.781+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.q8czz4k2Sux7ZCP1XuiMjQGJdb8LEuz_0 2024-03-04T13:00:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7013412986901839606', time=2024-03-04T14:54:30.441859+0000, chain.objs.size()=1 2024-03-04T13:00:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5IPec-0ocD0NzHM3eMDWQltJC0oYZc3_0 2024-03-04T13:00:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9807565207334615831', time=2024-03-04T14:54:30.442490+0000, chain.objs.size()=1 2024-03-04T13:00:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.NgLWm9aRZZBsdb_z5d-3im-rw0MHruG_0 2024-03-04T13:00:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7902074901830706729', time=2024-03-04T14:54:30.457278+0000, chain.objs.size()=1 2024-03-04T13:00:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.zYTCceZ9gzMsqfG4CxE-Hm3JCjpack7_0 2024-03-04T13:00:15.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6590908926614238187', time=2024-03-04T14:54:30.504161+0000, chain.objs.size()=1 2024-03-04T13:00:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.nU7LxY8jr3Y1MxHEXuPBdwi44z6dkpr_0 2024-03-04T13:00:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17774378380797851533', time=2024-03-04T14:54:30.582372+0000, chain.objs.size()=1 2024-03-04T13:00:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.T7wsKaHP3zjbFGCQCzwvF-ao0_BfFyW_0 2024-03-04T13:00:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13071029198211588392', time=2024-03-04T14:54:30.647973+0000, chain.objs.size()=1 2024-03-04T13:00:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.t8iwff7D_GkepLiemeFdbOa7QUURPZY_0 2024-03-04T13:00:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15892840185090465965', time=2024-03-04T14:54:30.656154+0000, chain.objs.size()=1 2024-03-04T13:00:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.fi0WHJvq-3t2dRbhtG6WUbyozQI-sdM_0 2024-03-04T13:00:15.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.350553930225845069', time=2024-03-04T14:54:30.737070+0000, chain.objs.size()=1 2024-03-04T13:00:15.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.an-T4RQCNpjsmtZ2LPI49a84uc05QBZ_0 2024-03-04T13:00:15.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2992491496783157950', time=2024-03-04T14:54:30.804660+0000, chain.objs.size()=1 2024-03-04T13:00:15.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VIBcrliDj1v2qGKWbeQOfcX5FHvzguz_0 2024-03-04T13:00:15.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11387257744496312485', time=2024-03-04T14:54:38.308720+0000, chain.objs.size()=1 2024-03-04T13:00:15.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5XlH9l3Ia7ey2Rpxv6b1UYA82agNFr5_0 2024-03-04T13:00:15.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3883243760735603832', time=2024-03-04T14:54:38.315880+0000, chain.objs.size()=1 2024-03-04T13:00:15.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.785+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.hBiIDdCf0iUfMxxAPaQnEHHfgQ_KdtR_0 2024-03-04T13:00:15.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.787+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4915880469086256345', time=2024-03-04T14:54:38.330953+0000, chain.objs.size()=1 2024-03-04T13:00:15.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.787+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zwYelctJ8kjX1_d_IFE7xi98tWi-YIR_0 2024-03-04T13:00:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4941887638031380876', time=2024-03-04T14:54:38.341108+0000, chain.objs.size()=1 2024-03-04T13:00:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.QpRBAHToUHXoN5SqL89Xin4Ev5R3oO1_0 2024-03-04T13:00:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15129477637280292608', time=2024-03-04T14:54:38.356312+0000, chain.objs.size()=1 2024-03-04T13:00:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.RoXAi21ErhfNVkTAM0-psgRpv43e1t7_0 2024-03-04T13:00:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3024990604695614338', time=2024-03-04T14:54:38.488443+0000, chain.objs.size()=1 2024-03-04T13:00:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ki8yLoQN0fNMjCTtiOWr1-b7CZILVS__0 2024-03-04T13:00:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4847710929819707306', time=2024-03-04T14:54:38.541755+0000, chain.objs.size()=1 2024-03-04T13:00:15.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7a6oK_KNOGeEQ3bOXS4KSAFF8fc_N0X_0 2024-03-04T13:00:15.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3739484256381748952', time=2024-03-04T14:54:38.545343+0000, chain.objs.size()=1 2024-03-04T13:00:15.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Uyd0e391MriW4YXvQspFbuBpAdLr6z__0 2024-03-04T13:00:15.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7317272083889883537', time=2024-03-04T14:54:38.645463+0000, chain.objs.size()=1 2024-03-04T13:00:15.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.DbpL2OHKo8UqeckmmCZeii9FrO5TKdq_0 2024-03-04T13:00:15.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17393022460727662746', time=2024-03-04T14:54:38.649803+0000, chain.objs.size()=1 2024-03-04T13:00:15.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.dzAtsFM9n5uvCgo0pvKbVFk_yv1qfkW_0 2024-03-04T13:00:15.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1485682571622713075', time=2024-03-04T14:54:38.651808+0000, chain.objs.size()=1 2024-03-04T13:00:15.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HY3ANd9uDPXqJ6HuRDvdiM3-rmYJxUT_0 2024-03-04T13:00:15.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11171966185468891295', time=2024-03-04T14:54:38.666452+0000, chain.objs.size()=1 2024-03-04T13:00:15.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.UwZg1saWurdzQQgIvRdF-QsZR4_HtL5_0 2024-03-04T13:00:15.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2153370437312625047', time=2024-03-04T14:54:38.807023+0000, chain.objs.size()=1 2024-03-04T13:00:15.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.p6TeenzIgZkzMwxC726urQKMuFYwBwU_0 2024-03-04T13:00:15.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.74930033903064423', time=2024-03-04T14:54:38.811852+0000, chain.objs.size()=1 2024-03-04T13:00:15.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.w6oC0Db5zlWSLtcm2TGklX6Lcmjvv5r_0 2024-03-04T13:00:15.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.789+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4681759765673317792', time=2024-03-04T14:54:38.821027+0000, chain.objs.size()=1 2024-03-04T13:00:15.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.789+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-IwL07nUMIBVFne7E8esfqrRYC4Yz1t_0 2024-03-04T13:00:15.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.790+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10186934569225619802', time=2024-03-04T14:54:38.821952+0000, chain.objs.size()=1 2024-03-04T13:00:15.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.790+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.RvxFdyvN-q9sOuwHu4wGe7XO50XuNKp_0 2024-03-04T13:00:15.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15418773794955480183', time=2024-03-04T14:54:38.844751+0000, chain.objs.size()=1 2024-03-04T13:00:15.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.4QrjESXMmV57PXBoKQbcSzh29bt85B4_0 2024-03-04T13:00:15.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15337286615381345817', time=2024-03-04T14:54:38.867745+0000, chain.objs.size()=1 2024-03-04T13:00:15.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gIGj3QDlmK5KRDYCW9y_4dU7xOQ_M1k_0 2024-03-04T13:00:15.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3026037798931579764', time=2024-03-04T14:54:38.946978+0000, chain.objs.size()=1 2024-03-04T13:00:15.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.agx-JftCs0TxJhRSsmIJ-eUnxUzAK-G_0 2024-03-04T13:00:15.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2077220421287163624', time=2024-03-04T14:54:38.970397+0000, chain.objs.size()=1 2024-03-04T13:00:15.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.D9oAgbL0HUengrsRCsTtTCPHNaRyE-r_0 2024-03-04T13:00:15.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4989599314881245191', time=2024-03-04T14:54:38.971093+0000, chain.objs.size()=1 2024-03-04T13:00:15.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.OfEfS0ofaRm8IgXiDl56IK24D0bDkPK_0 2024-03-04T13:00:15.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15132209728159275875', time=2024-03-04T14:54:39.157518+0000, chain.objs.size()=1 2024-03-04T13:00:15.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._AnVEmXXIx-Ye_L7pU8REt-e_3o9UJ2_0 2024-03-04T13:00:15.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1855284403515237611', time=2024-03-04T14:54:39.162115+0000, chain.objs.size()=1 2024-03-04T13:00:15.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Q3TmO73ZV9SxspIxC_QxEg8TEMAZ4Ew_0 2024-03-04T13:00:15.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14964001994159244496', time=2024-03-04T14:54:39.172655+0000, chain.objs.size()=1 2024-03-04T13:00:15.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.o8rCsCnNx8afzsNEBkfcXYlFLj0ygRS_0 2024-03-04T13:00:15.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4551545970470140938', time=2024-03-04T14:54:39.304973+0000, chain.objs.size()=1 2024-03-04T13:00:15.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.axahZBIKReisYx_IpYUx9aQoJWvs6Lt_0 2024-03-04T13:00:15.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11815468394245531431', time=2024-03-04T14:54:39.317366+0000, chain.objs.size()=1 2024-03-04T13:00:15.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.792+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.qWZpDdLW7TYIB_KlFC4iUMthrIBP80I_0 2024-03-04T13:00:15.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9130888473835477693', time=2024-03-04T14:54:39.339199+0000, chain.objs.size()=1 2024-03-04T13:00:15.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.hQeVo0bvQ2dn-pYd0DpRlp2tTs_aPiF_0 2024-03-04T13:00:15.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12570186812494265937', time=2024-03-04T14:54:39.340466+0000, chain.objs.size()=1 2024-03-04T13:00:15.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.a0Jv9u6-bAOfFti15SG5tGfzKJELty0_0 2024-03-04T13:00:15.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.794+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12089968544383715366', time=2024-03-04T14:54:39.422764+0000, chain.objs.size()=1 2024-03-04T13:00:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.794+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.y6KwuQ_L1Yh_qmegQSmzEz-7N4zDDNY_0 2024-03-04T13:00:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14723953351970479541', time=2024-03-04T14:54:39.424207+0000, chain.objs.size()=1 2024-03-04T13:00:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.dXzpPm-CTc8zm0qNLRiSG9ldsxBxOsT_0 2024-03-04T13:00:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3603545952973191546', time=2024-03-04T14:54:39.449058+0000, chain.objs.size()=1 2024-03-04T13:00:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.QUuW2K1QSMwLnYiDyGbFdv4v0i09dss_0 2024-03-04T13:00:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17143336777110443995', time=2024-03-04T14:54:39.454584+0000, chain.objs.size()=1 2024-03-04T13:00:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.hu2O3uY-a37jcf4UJo-kQhg5xxHV5AN_0 2024-03-04T13:00:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2847358021639406446', time=2024-03-04T14:54:39.476794+0000, chain.objs.size()=1 2024-03-04T13:00:15.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wyk3b_-rhIzaXGfhGlPiXzyi7z7U3gA_0 2024-03-04T13:00:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9310440969542938', time=2024-03-04T14:54:59.279886+0000, chain.objs.size()=1 2024-03-04T13:00:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.346__shadow_.w4cEHhtkUJ7gAF7LNXjxC6IXyxpFwes_0 2024-03-04T13:00:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7407859215029142787', time=2024-03-04T14:55:03.383488+0000, chain.objs.size()=1 2024-03-04T13:00:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.352__shadow_.SkwN0osU6m72xW2Fm5Jz-b0aL4ju89X_0 2024-03-04T13:00:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13400640897293524169', time=2024-03-04T14:55:36.985889+0000, chain.objs.size()=1 2024-03-04T13:00:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.795+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.421__shadow_.iuFz3Abjwih-6f2LfKaZOvt02CvTFKl_0 2024-03-04T13:00:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.796+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9253084133711798355', time=2024-03-04T14:55:42.618666+0000, chain.objs.size()=1 2024-03-04T13:00:15.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.796+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.431__shadow_.2JbVmKRVs9I7-kCZwfEo0Ug_Ku19ARW_0 2024-03-04T13:00:15.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.797+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/45304 2024-03-04T13:00:15.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-03-04T13:00:15.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14607109039883340694', time=2024-03-04T14:55:52.722254+0000, chain.objs.size()=1 2024-03-04T13:00:15.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.456__shadow_.EXK8GHh2vi0LtNMu5X_AB7xmgv83Zpp_0 2024-03-04T13:00:15.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15152299706568341269', time=2024-03-04T14:56:05.233982+0000, chain.objs.size()=1 2024-03-04T13:00:15.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.484__shadow_.p0IlsDlFrvF172Z6kGkelp9WFZG03Ab_0 2024-03-04T13:00:15.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17187687108941054730', time=2024-03-04T14:57:05.467728+0000, chain.objs.size()=1 2024-03-04T13:00:15.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.523__shadow_.9-gNIgtmY11Fuc4JLV-jnb_Jn0PqoOI_0 2024-03-04T13:00:15.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7611171675076418486', time=2024-03-04T14:57:21.492185+0000, chain.objs.size()=1 2024-03-04T13:00:15.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:EElkeAakK2ijpW1tkkXyoJE7z5jQFLK_.QAysgTKjykbSb1jpH00lT0CKXkowDPQ_0 2024-03-04T13:00:15.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9323323683025135790', time=2024-03-04T14:57:22.181967+0000, chain.objs.size()=1 2024-03-04T13:00:15.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:tj544EJsAO2DaSYufFsO6FQQmjrU4.S_.CXTsqtOfa6mnVxx0OMO_sUByhJUURri_0 2024-03-04T13:00:15.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1041906980324222085', time=2024-03-04T14:57:24.751074+0000, chain.objs.size()=1 2024-03-04T13:00:15.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.540__shadow_.PuOeSyshwbgOQnr2GZAJ43OtaZgw3EV_0 2024-03-04T13:00:15.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1562251530626581162', time=2024-03-04T14:57:26.061107+0000, chain.objs.size()=1 2024-03-04T13:00:15.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.541__shadow:CPY80R9hr4w4NHZXNlp5Stko1Djg-Y5_.qpofsmxa7U6Ct7SWogfUcCbDY_PPOWE_0 2024-03-04T13:00:15.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4467587932709645296', time=2024-03-04T14:57:57.797127+0000, chain.objs.size()=1 2024-03-04T13:00:15.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.568__shadow_.trFjOMa6g6KeUrB2V1u8AW_lAIYuCEQ_0 2024-03-04T13:00:15.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5776330022017194644', time=2024-03-04T14:58:33.464496+0000, chain.objs.size()=1 2024-03-04T13:00:15.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.799+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.628__shadow_.to6wk0U_jvgtKmiqsubfabyqxBezPRG_0 2024-03-04T13:00:15.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.803+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:15.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.807+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T13:00:15.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.808+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:15.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.809+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:15.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45729' 2024-03-04T13:00:15.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_tn67-wO-skB6J9H5OTbYcY-UJUWeY5Q', time=2024-03-04T14:52:57.091690+0000, chain.objs.size()=1 2024-03-04T13:00:15.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.H6AbCGC3BES0rzhONscCEOsXI9m8B10_0 2024-03-04T13:00:15.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_RHEnosx7vvhaXmTg_Hf1VUocjbPuGtJ', time=2024-03-04T14:52:57.920158+0000, chain.objs.size()=3 2024-03-04T13:00:15.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.y6bFQEUon7ZlgkvpT8xqEhQ-d-5M-f5_0 2024-03-04T13:00:15.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.y6bFQEUon7ZlgkvpT8xqEhQ-d-5M-f5_1 2024-03-04T13:00:15.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.y6bFQEUon7ZlgkvpT8xqEhQ-d-5M-f5_2 2024-03-04T13:00:15.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4555590583561075493', time=2024-03-04T14:53:00.964574+0000, chain.objs.size()=2 2024-03-04T13:00:15.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.157__multipart_foo.2~r-JAcQEXN4fEStOKvG5bGEVJZys7Wmi.1 2024-03-04T13:00:15.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.157__multipart_foo.2~r-JAcQEXN4fEStOKvG5bGEVJZys7Wmi.2 2024-03-04T13:00:15.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11990958798354744215', time=2024-03-04T14:53:34.884425+0000, chain.objs.size()=1 2024-03-04T13:00:15.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.214__shadow_.s2APGXLnnkhg-idQbymVNOVl7mSLYvT_0 2024-03-04T13:00:15.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1276676836616628449', time=2024-03-04T14:53:36.937732+0000, chain.objs.size()=1 2024-03-04T13:00:15.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.217__shadow_.xx_qgCS4EmhUjnUE_WTtlavFjh0PLqU_0 2024-03-04T13:00:15.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6955499171059284557', time=2024-03-04T14:53:39.081131+0000, chain.objs.size()=1 2024-03-04T13:00:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.222__shadow_.8BajrYf4kDAVvc-xVq7p9TiFn-mZByh_0 2024-03-04T13:00:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6098783079878628837', time=2024-03-04T14:53:52.054404+0000, chain.objs.size()=1 2024-03-04T13:00:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.eDkGKSOhQN70W-fIuFj8AgtwFb-AMzu_0 2024-03-04T13:00:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15332278685127155916', time=2024-03-04T14:53:52.060026+0000, chain.objs.size()=1 2024-03-04T13:00:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ZokGdtAej-nzoCKDDXxwOU_bcHi4v0S_0 2024-03-04T13:00:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11928149452431709285', time=2024-03-04T14:53:52.101770+0000, chain.objs.size()=1 2024-03-04T13:00:15.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.810+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ghRJqpXZ9p2vt5RKAWleBOY_xzyDZ9r_0 2024-03-04T13:00:15.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.812+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15837834941714121723', time=2024-03-04T14:53:52.115810+0000, chain.objs.size()=1 2024-03-04T13:00:15.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.812+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.RZ_0dS0U7r8sWOJK3Usu2wRfPJUfx8a_0 2024-03-04T13:00:15.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3111684012568284978', time=2024-03-04T14:53:52.126415+0000, chain.objs.size()=1 2024-03-04T13:00:15.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8JyNrir44lSIw__Ezs6Mw8eQQ6LZ_cU_0 2024-03-04T13:00:15.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8490115587809736907', time=2024-03-04T14:53:52.133889+0000, chain.objs.size()=1 2024-03-04T13:00:15.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.W9a5R57WhnXvYUSNDTcrQvYSbf6wIr4_0 2024-03-04T13:00:15.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14706189107962145783', time=2024-03-04T14:53:52.222259+0000, chain.objs.size()=1 2024-03-04T13:00:15.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JOBkYTOgrR6Wmtg7PxBw0cJTiJvH5tg_0 2024-03-04T13:00:15.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7390039522559112569', time=2024-03-04T14:53:52.255181+0000, chain.objs.size()=1 2024-03-04T13:00:15.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CWrIsWzEW8E5gkBS52Cxdh9V4JFCrVl_0 2024-03-04T13:00:15.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12631384519457236215', time=2024-03-04T14:53:52.283261+0000, chain.objs.size()=1 2024-03-04T13:00:15.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YfW4aiSY9vQObzxelhq3pW321S4k3Dw_0 2024-03-04T13:00:15.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11367395459117777322', time=2024-03-04T14:53:52.306470+0000, chain.objs.size()=1 2024-03-04T13:00:15.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.s6miM-pRNQk_EWPpSV5A_0kQeQfgUEh_0 2024-03-04T13:00:15.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7116975425301454647', time=2024-03-04T14:53:52.319308+0000, chain.objs.size()=1 2024-03-04T13:00:15.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.p3i0lt6nx-6vDDbNcxhD2BXFZgiprzf_0 2024-03-04T13:00:15.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2350753337221249135', time=2024-03-04T14:53:52.399773+0000, chain.objs.size()=1 2024-03-04T13:00:15.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.u112VwQQVPitquf_uG1g7vkh0bx2bwM_0 2024-03-04T13:00:15.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4727243870368157101', time=2024-03-04T14:53:52.424416+0000, chain.objs.size()=1 2024-03-04T13:00:15.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jpVT1jyZPUTSp0AFNlLflB8UJARBwiZ_0 2024-03-04T13:00:15.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7468689149654517291', time=2024-03-04T14:53:52.446589+0000, chain.objs.size()=1 2024-03-04T13:00:15.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.p8xrLmxdr1QPTSBJAZ3X91RXZQ6sKO0_0 2024-03-04T13:00:15.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17233857750203247674', time=2024-03-04T14:53:52.453980+0000, chain.objs.size()=1 2024-03-04T13:00:15.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.815+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.iE07U8aZ1MlJJi_2BGi86m3itQgC3ha_0 2024-03-04T13:00:15.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17082967769097332305', time=2024-03-04T14:53:52.605237+0000, chain.objs.size()=1 2024-03-04T13:00:15.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.nG1yldDvUlvMP_N9PsSJRteQaOAlXZC_0 2024-03-04T13:00:15.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11431164316833281688', time=2024-03-04T14:53:52.611282+0000, chain.objs.size()=1 2024-03-04T13:00:15.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.oa7aHKAIB1Z0z440WnzBksYfoRDWOPV_0 2024-03-04T13:00:15.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4924632158355400960', time=2024-03-04T14:53:52.663245+0000, chain.objs.size()=1 2024-03-04T13:00:15.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.9lHgcMNJfX3tM3puQGH6NqZhJHJdv0L_0 2024-03-04T13:00:15.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4094138102130177426', time=2024-03-04T14:53:52.750026+0000, chain.objs.size()=1 2024-03-04T13:00:15.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.f44_84YEbhfAzxLc1yBzHBlYtqhoFF3_0 2024-03-04T13:00:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3621800260879934422', time=2024-03-04T14:53:52.772617+0000, chain.objs.size()=1 2024-03-04T13:00:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.h4SjwjAU5sxgAQrFMxdWLeks8DGY_Ni_0 2024-03-04T13:00:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18273911328113890014', time=2024-03-04T14:53:52.923688+0000, chain.objs.size()=1 2024-03-04T13:00:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.b4hnFMcE15ClyvUneT4XW444kvlKG9s_0 2024-03-04T13:00:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11984570405416771465', time=2024-03-04T14:53:52.924387+0000, chain.objs.size()=1 2024-03-04T13:00:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ArJGAG0_ZRgl3LUv2Kco4zpAWBhOYQA_0 2024-03-04T13:00:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16021735612585441658', time=2024-03-04T14:53:52.996256+0000, chain.objs.size()=1 2024-03-04T13:00:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xK0zuq8Ti0p32EXVjRFOw8EWm3gran7_0 2024-03-04T13:00:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1521193220353100714', time=2024-03-04T14:53:53.004239+0000, chain.objs.size()=1 2024-03-04T13:00:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.tOIH-OqK8ty7Njqqr4zxN0NK2QV8o0u_0 2024-03-04T13:00:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5823847420943560602', time=2024-03-04T14:53:53.084074+0000, chain.objs.size()=1 2024-03-04T13:00:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Gin76Y8y3rDIMdoJzXG7bMoqSXRA1sY_0 2024-03-04T13:00:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4282856664498083127', time=2024-03-04T14:53:53.103973+0000, chain.objs.size()=1 2024-03-04T13:00:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5IgdQBmbM7fJofkmMWTinrCGYHlR8lI_0 2024-03-04T13:00:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.820+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1813415334510682937', time=2024-03-04T14:53:53.113396+0000, chain.objs.size()=1 2024-03-04T13:00:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.820+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.FXS-FickjX3tDpg518lV9UqnZSLZn0l_0 2024-03-04T13:00:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.820+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13084595138964050938', time=2024-03-04T14:53:53.133720+0000, chain.objs.size()=1 2024-03-04T13:00:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.820+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mxjdEAF2jF2QTg4gO_TpMCw2oAowCR3_0 2024-03-04T13:00:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.822+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15398060652717429184', time=2024-03-04T14:53:53.166111+0000, chain.objs.size()=1 2024-03-04T13:00:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.822+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.IWlthPkPilbN1NOe8TlSywxyxJjx8cj_0 2024-03-04T13:00:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3627893709663173987', time=2024-03-04T14:53:53.168577+0000, chain.objs.size()=1 2024-03-04T13:00:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vkx8COkRHEJXi_st1OM10dMC4cGNmyD_0 2024-03-04T13:00:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13475767947183147718', time=2024-03-04T14:53:53.169939+0000, chain.objs.size()=1 2024-03-04T13:00:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0wTx7AQshpEXs0QrfQ8psWN-qVDpwxD_0 2024-03-04T13:00:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1070389235884083043', time=2024-03-04T14:53:53.285941+0000, chain.objs.size()=1 2024-03-04T13:00:15.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CsGSt1ir_w-E05tMWIKdqFBx3HAIyhb_0 2024-03-04T13:00:15.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16035024762004500228', time=2024-03-04T14:53:54.854143+0000, chain.objs.size()=1 2024-03-04T13:00:15.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.236__shadow_.bah23rQ0QZIiHpU09EyPvptO45Ov7XE_0 2024-03-04T13:00:15.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18342176055338018278', time=2024-03-04T14:53:55.257814+0000, chain.objs.size()=1 2024-03-04T13:00:15.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.237__shadow_.OoklxmAxut4gaCi4yGq31iUl4hsa49y_0 2024-03-04T13:00:15.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6996048897390449215', time=2024-03-04T14:54:02.680434+0000, chain.objs.size()=1 2024-03-04T13:00:15.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.254__shadow_.K1adI6U_cna6MzysfjdASQRzITgqrmj_0 2024-03-04T13:00:15.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8320273550129859914', time=2024-03-04T14:54:03.124666+0000, chain.objs.size()=1 2024-03-04T13:00:15.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.255__shadow_.4JQ8R407WM-Gs5TE_HDT7IhJ9sCVIYk_0 2024-03-04T13:00:15.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2678453509642344269', time=2024-03-04T14:54:06.752293+0000, chain.objs.size()=1 2024-03-04T13:00:15.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.263__shadow_.QNk2vmZu4gi0lPXbioAG8Ud3U3J4Yrt_0 2024-03-04T13:00:15.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1779395815604922596', time=2024-03-04T14:54:09.025405+0000, chain.objs.size()=1 2024-03-04T13:00:15.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.g-v3HGsHwtarMNZBJS_tRaUVBxpcr6L_0 2024-03-04T13:00:15.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15733556376338411160', time=2024-03-04T14:54:09.029305+0000, chain.objs.size()=1 2024-03-04T13:00:15.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.823+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.eN4Q0mhZoa4gIa1JR4Sw2ED9yGidJnL_0 2024-03-04T13:00:15.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.824+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5171358633593210811', time=2024-03-04T14:54:21.821955+0000, chain.objs.size()=1 2024-03-04T13:00:15.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.824+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.295__shadow_.Yg5yHPSWVfy0kfgcliZsT8JcNX-Vh9U_0 2024-03-04T13:00:15.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.824+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5861834442641489627', time=2024-03-04T14:54:29.635110+0000, chain.objs.size()=1 2024-03-04T13:00:15.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.824+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_._DTlv6MfxNEMFs1RiSoicYOxFkx3ZCt_0 2024-03-04T13:00:15.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.825+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10132516033710587843', time=2024-03-04T14:54:29.664046+0000, chain.objs.size()=1 2024-03-04T13:00:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.825+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.zKPmxQZURjp0g0Neo3P0mOrFnvLJWu-_0 2024-03-04T13:00:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.825+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6234207144976177704', time=2024-03-04T14:54:29.677781+0000, chain.objs.size()=1 2024-03-04T13:00:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.825+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.m-P37Ows0QZeuP5XAOdpHYai6RbRY7__0 2024-03-04T13:00:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.828+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16698856593060773740', time=2024-03-04T14:54:29.697200+0000, chain.objs.size()=1 2024-03-04T13:00:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.828+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.D7qU4Fd_KfP-8_1W_yRB-9c8J9w4fjq_0 2024-03-04T13:00:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.828+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15859606715775567632', time=2024-03-04T14:54:29.797414+0000, chain.objs.size()=1 2024-03-04T13:00:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.828+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YjoYq00MsW9iKAKvVMcQLLjDIMqVVD__0 2024-03-04T13:00:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.828+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11746827156504447330', time=2024-03-04T14:54:29.803942+0000, chain.objs.size()=1 2024-03-04T13:00:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.828+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.p2q8AztVbUeSKgNrbtGGzLbwFrkqcE8_0 2024-03-04T13:00:15.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17406707113157683485', time=2024-03-04T14:54:29.809156+0000, chain.objs.size()=1 2024-03-04T13:00:15.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.vhXMztA7MjmY1XQ-Hfs81KlkvDjW3Lj_0 2024-03-04T13:00:15.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13908060063278608765', time=2024-03-04T14:54:29.821402+0000, chain.objs.size()=1 2024-03-04T13:00:15.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.42iCeWNUdjiwrP4dWJXeyxWQ6rc2pO8_0 2024-03-04T13:00:15.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6422621801669943045', time=2024-03-04T14:54:29.824572+0000, chain.objs.size()=1 2024-03-04T13:00:15.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.quDV-_UdyX-IPZFhqa5Ptrb2BT7Z49i_0 2024-03-04T13:00:15.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15152938255090572166', time=2024-03-04T14:54:29.839065+0000, chain.objs.size()=1 2024-03-04T13:00:15.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.IEgusG3dYJei07un7nx0NRz2ybYTRvf_0 2024-03-04T13:00:15.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6341456880308820377', time=2024-03-04T14:54:29.839721+0000, chain.objs.size()=1 2024-03-04T13:00:15.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2LGFWV_JfwxDwsc_V3xR2maTKaarmvC_0 2024-03-04T13:00:15.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12339626533835075423', time=2024-03-04T14:54:29.967904+0000, chain.objs.size()=1 2024-03-04T13:00:15.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.N07lux1zDlVOI0e_5PTnUCW98-hnfIJ_0 2024-03-04T13:00:15.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13523715316502746495', time=2024-03-04T14:54:30.000996+0000, chain.objs.size()=1 2024-03-04T13:00:15.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.EpgfZGBRU6L6jtEhYRkj1be_9Hh_N5V_0 2024-03-04T13:00:15.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6544859629865142008', time=2024-03-04T14:54:30.004083+0000, chain.objs.size()=1 2024-03-04T13:00:15.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.831+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.n8hD39sxcNspCCVxpitiZExYzHe3Z8D_0 2024-03-04T13:00:15.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.832+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10517948566775961338', time=2024-03-04T14:54:30.006000+0000, chain.objs.size()=1 2024-03-04T13:00:15.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.832+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.JVkFPT4o4hV2L_FhB7BqydzYspaKFUb_0 2024-03-04T13:00:15.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.832+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2481027155062053726', time=2024-03-04T14:54:30.010417+0000, chain.objs.size()=1 2024-03-04T13:00:15.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.832+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0EetRfZGK5sU-lPWMbA3nZnPa59q6Ld_0 2024-03-04T13:00:15.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.832+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2294654021821550930', time=2024-03-04T14:54:30.013583+0000, chain.objs.size()=1 2024-03-04T13:00:15.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.832+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.02i_bLzRcvd3dNUr_QluC1V6BwcIDGV_0 2024-03-04T13:00:15.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9521044865795118250', time=2024-03-04T14:54:30.015473+0000, chain.objs.size()=1 2024-03-04T13:00:15.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.dIqpw5l0mAeps6YlxSpJfyCpFVsIJox_0 2024-03-04T13:00:15.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3291998087097802551', time=2024-03-04T14:54:30.024563+0000, chain.objs.size()=1 2024-03-04T13:00:15.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RP70tXn4tyqw0mjMHt8IegmRGu2VKRY_0 2024-03-04T13:00:15.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1418102392380518968', time=2024-03-04T14:54:30.104146+0000, chain.objs.size()=1 2024-03-04T13:00:15.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.8wn_yFII3QCoGf5hFbUqLGW2tlhGwEm_0 2024-03-04T13:00:15.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12113447059462770226', time=2024-03-04T14:54:30.153276+0000, chain.objs.size()=1 2024-03-04T13:00:15.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ixRO4D9GJ3LbOuEsMgg_FqFxw2xn91u_0 2024-03-04T13:00:15.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18289544298182512192', time=2024-03-04T14:54:30.181899+0000, chain.objs.size()=1 2024-03-04T13:00:15.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yKjYP1wbnvaIFo3P6SCCHkN3hl5HfJP_0 2024-03-04T13:00:15.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14161799905626258850', time=2024-03-04T14:54:30.293967+0000, chain.objs.size()=1 2024-03-04T13:00:15.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Rr0DHPQVieMwKJq5w6_ZDF-E5M0ZRKn_0 2024-03-04T13:00:15.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10296547244404359142', time=2024-03-04T14:54:30.326850+0000, chain.objs.size()=1 2024-03-04T13:00:15.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.gF5UvJJlwWDKNlCNGAFiWI1RwoVLQCw_0 2024-03-04T13:00:15.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.932597484964453185', time=2024-03-04T14:54:30.328941+0000, chain.objs.size()=1 2024-03-04T13:00:15.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.bFE4lHmBkjY-zPxajCena4GJrJYanpT_0 2024-03-04T13:00:15.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12204908929814116737', time=2024-03-04T14:54:30.347047+0000, chain.objs.size()=1 2024-03-04T13:00:15.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HW25XtPJOJYVHbQiSvrOIDBYZfuae5n_0 2024-03-04T13:00:15.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3586220743957502720', time=2024-03-04T14:54:30.422203+0000, chain.objs.size()=1 2024-03-04T13:00:15.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.U5g_d4qj5gDzVtEhj-Gyb-wSjD5m34I_0 2024-03-04T13:00:15.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.836+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12331871065731143826', time=2024-03-04T14:54:30.486110+0000, chain.objs.size()=1 2024-03-04T13:00:15.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.836+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.n_AJztV_IFW2JjevEcWR3GqzrX-EGvD_0 2024-03-04T13:00:15.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.841+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15502190372689225058', time=2024-03-04T14:54:30.580708+0000, chain.objs.size()=1 2024-03-04T13:00:15.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.841+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Pb-wxkfuJU8v7yJB9xEHJoccBgB2rhu_0 2024-03-04T13:00:15.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.841+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6917038397876404208', time=2024-03-04T14:54:30.583433+0000, chain.objs.size()=1 2024-03-04T13:00:15.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.841+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ZcyOebSPE7KhuwEECUYTaAqchL4fSD2_0 2024-03-04T13:00:15.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7822281956231559848', time=2024-03-04T14:54:30.622175+0000, chain.objs.size()=1 2024-03-04T13:00:15.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Qj4z_6JTRwCehLKFF3BikUD3Ntd78JL_0 2024-03-04T13:00:15.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10429609005315945430', time=2024-03-04T14:54:30.664022+0000, chain.objs.size()=1 2024-03-04T13:00:15.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.aeCgf6nwvbV-IEfuhrdqSeaOPV00cy4_0 2024-03-04T13:00:15.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6784613826119278874', time=2024-03-04T14:54:30.735953+0000, chain.objs.size()=1 2024-03-04T13:00:15.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.AXmpO4wg58I3TO1_hAKx4CHKMr6n4WL_0 2024-03-04T13:00:15.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11564922194311742444', time=2024-03-04T14:54:30.773639+0000, chain.objs.size()=1 2024-03-04T13:00:15.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.54JKFcDlnNHcdG3D9P-fZatUt7OFv7j_0 2024-03-04T13:00:15.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10167923703351752773', time=2024-03-04T14:54:38.294872+0000, chain.objs.size()=1 2024-03-04T13:00:15.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._9ovZkzmmSKohynMkH52uw-_7xUp2BB_0 2024-03-04T13:00:15.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7922739763963573382', time=2024-03-04T14:54:38.328984+0000, chain.objs.size()=1 2024-03-04T13:00:15.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.BYGdZuNtRvY0l_UQPPWTKiaRrklT_jv_0 2024-03-04T13:00:15.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15724273367539671650', time=2024-03-04T14:54:38.344625+0000, chain.objs.size()=1 2024-03-04T13:00:15.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.u1rjWLmy2DgXKf2gjXBAoeJ7KPn74Ah_0 2024-03-04T13:00:15.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1712148393705438098', time=2024-03-04T14:54:38.346096+0000, chain.objs.size()=1 2024-03-04T13:00:15.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.TqtbZCzctzBV54pAs7_XL8pLquohEcp_0 2024-03-04T13:00:15.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5323854923563066486', time=2024-03-04T14:54:38.460955+0000, chain.objs.size()=1 2024-03-04T13:00:15.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.6bCHXufLYmoc6tfyzK7InsEw19cyIbv_0 2024-03-04T13:00:15.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12461092251864852801', time=2024-03-04T14:54:38.511434+0000, chain.objs.size()=1 2024-03-04T13:00:15.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tBjmxZk0GEjYSlG9zJwc8EClJu19JWN_0 2024-03-04T13:00:15.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2478048634211087803', time=2024-03-04T14:54:38.519382+0000, chain.objs.size()=1 2024-03-04T13:00:15.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.4gb58QyJDX_NeHZKr5H8SFZfAI5GxRs_0 2024-03-04T13:00:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.846+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1841398498080247171', time=2024-03-04T14:54:38.626394+0000, chain.objs.size()=1 2024-03-04T13:00:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.846+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.8BWWmlqYUDgCEzXkhXa3qz2cnoCXeJJ_0 2024-03-04T13:00:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.846+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3459178476208555583', time=2024-03-04T14:54:38.784514+0000, chain.objs.size()=1 2024-03-04T13:00:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.846+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.E8Bm00KOSLWJpbuJE2wAAoy1iqy1vF4_0 2024-03-04T13:00:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.846+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15501027986528960712', time=2024-03-04T14:54:38.830043+0000, chain.objs.size()=1 2024-03-04T13:00:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.846+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.D6rORGc9Se5FKX9C7uZYygQE0eXo3tT_0 2024-03-04T13:00:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.846+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13325405437286032274', time=2024-03-04T14:54:38.847084+0000, chain.objs.size()=1 2024-03-04T13:00:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.846+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.FoRO0OC1NMON9YBCV6_FBjDRXhr2cZK_0 2024-03-04T13:00:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.846+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16151127638822688142', time=2024-03-04T14:54:38.958292+0000, chain.objs.size()=1 2024-03-04T13:00:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.846+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.9y3rY6QtPKM2qelO0fExWRVmuHz-Xkg_0 2024-03-04T13:00:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.846+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6030600773721886713', time=2024-03-04T14:54:38.967992+0000, chain.objs.size()=1 2024-03-04T13:00:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.846+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.1PA2ZGkqS7qdN0ukpvfL7jtcd3p6zvc_0 2024-03-04T13:00:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.849+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7193866277443240616', time=2024-03-04T14:54:38.970118+0000, chain.objs.size()=1 2024-03-04T13:00:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.849+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IlzNrB9_1txUNmaWRqK3nFjLqQQDyp2_0 2024-03-04T13:00:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.849+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8737108028831167161', time=2024-03-04T14:54:38.987735+0000, chain.objs.size()=1 2024-03-04T13:00:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.849+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7PN01q-sn2lLP-oBs9Lvogt9Q2O6VYH_0 2024-03-04T13:00:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.849+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.598922165265073350', time=2024-03-04T14:54:39.004984+0000, chain.objs.size()=1 2024-03-04T13:00:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.849+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.r_0WJPodBMIcYOm4-1bQ8QdQrVWBcjI_0 2024-03-04T13:00:15.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.849+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3282033412262720004', time=2024-03-04T14:54:39.026224+0000, chain.objs.size()=1 2024-03-04T13:00:15.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.849+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0iT8h_38xJoMSXfrhe9t5nGFlSsMvGC_0 2024-03-04T13:00:15.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.849+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8703144873222313064', time=2024-03-04T14:54:39.030877+0000, chain.objs.size()=1 2024-03-04T13:00:15.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.849+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.t507-Klx1lQYYosB0bcd3Mqu_Auii8C_0 2024-03-04T13:00:15.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.852+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7275076296313893090', time=2024-03-04T14:54:39.108347+0000, chain.objs.size()=1 2024-03-04T13:00:15.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.852+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.MchCwNgW7WSGbv1CzoF0FU_tHdRWsas_0 2024-03-04T13:00:15.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.852+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11546139154613450538', time=2024-03-04T14:54:39.127118+0000, chain.objs.size()=1 2024-03-04T13:00:15.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.852+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.C8ae-suYytPRBzkAXW_I2hJmwr7Ye35_0 2024-03-04T13:00:15.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.858+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/45729 2024-03-04T13:00:15.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-03-04T13:00:15.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2985964963731045522', time=2024-03-04T14:54:39.133524+0000, chain.objs.size()=1 2024-03-04T13:00:15.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.1J2rXg-ADgS-JbsFJadP5CtTCHcT6HJ_0 2024-03-04T13:00:15.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3795219920497203884', time=2024-03-04T14:54:39.159236+0000, chain.objs.size()=1 2024-03-04T13:00:15.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.OmSrSAAa-2ptDoGMZl3CCW_ATORtXJf_0 2024-03-04T13:00:15.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7118981167102169306', time=2024-03-04T14:54:39.188691+0000, chain.objs.size()=1 2024-03-04T13:00:15.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.dRC4KF4IT43lVGIZT9zPPkDXdlJeaPJ_0 2024-03-04T13:00:15.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3298125971050805971', time=2024-03-04T14:54:39.262444+0000, chain.objs.size()=1 2024-03-04T13:00:15.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ch7G87x_M--3y9_oPS_xIpE3RO12HPp_0 2024-03-04T13:00:15.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.559016783559879042', time=2024-03-04T14:54:39.263560+0000, chain.objs.size()=1 2024-03-04T13:00:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cYcXQsiatw9jKsJ9y1OmGIoZIRp0C9w_0 2024-03-04T13:00:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10265953147636368995', time=2024-03-04T14:54:39.301471+0000, chain.objs.size()=1 2024-03-04T13:00:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.OwQ6pn58M5gZt1Jo-e5mDvJ0qriODAd_0 2024-03-04T13:00:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17852978757117867153', time=2024-03-04T14:54:39.318182+0000, chain.objs.size()=1 2024-03-04T13:00:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.16ltnxo152OjhGB-JGIfiakg3yCpHlH_0 2024-03-04T13:00:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4700864415039484590', time=2024-03-04T14:54:39.341587+0000, chain.objs.size()=1 2024-03-04T13:00:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7F-soA4NrIBBnlCqQfGpenHUAdOTTd8_0 2024-03-04T13:00:15.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14852158978697396233', time=2024-03-04T14:54:39.342983+0000, chain.objs.size()=1 2024-03-04T13:00:15.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.lxL5DbOOTALAutb3Vx9gP0Ym_LQVHjZ_0 2024-03-04T13:00:15.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3483629044482725399', time=2024-03-04T14:54:39.431793+0000, chain.objs.size()=1 2024-03-04T13:00:15.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VRgEu08Gzu8gOM8QzvthwfmA1OmK5C-_0 2024-03-04T13:00:15.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14471801199657825446', time=2024-03-04T14:54:39.460150+0000, chain.objs.size()=1 2024-03-04T13:00:15.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.SGYXyT2BbDf0AgwpqMZ4OP7C0i3hc2K_0 2024-03-04T13:00:15.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8056205538430417078', time=2024-03-04T14:54:39.485915+0000, chain.objs.size()=1 2024-03-04T13:00:15.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.t8x1D9hXRIyDsik-KQlDVMwY120EC0m_0 2024-03-04T13:00:15.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.864+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.581714327886660045', time=2024-03-04T14:55:40.529702+0000, chain.objs.size()=1 2024-03-04T13:00:15.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.864+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.428__shadow_.nAEQuHxxCZm7fygM8ipwHbIKVy1y1bK_0 2024-03-04T13:00:15.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.865+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1021963414201041325', time=2024-03-04T14:55:52.265094+0000, chain.objs.size()=1 2024-03-04T13:00:15.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.865+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.455__shadow_.nb9EsKPDWTQX-BS9V4luc2OX4GnBGqu_0 2024-03-04T13:00:15.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.865+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.907426219833223863', time=2024-03-04T14:55:52.268794+0000, chain.objs.size()=1 2024-03-04T13:00:15.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.865+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.455__shadow_.NvFiAPDWvc3AIi9ji4FbAhkVvR7n_cA_0 2024-03-04T13:00:15.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.865+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.32982095796872871', time=2024-03-04T14:56:15.952916+0000, chain.objs.size()=12 2024-03-04T13:00:15.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.865+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.8Aqzoj6bcKev-JZ_gJ2T2N4ZnWuXXtAu.1 2024-03-04T13:00:15.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.865+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.8Aqzoj6bcKev-JZ_gJ2T2N4ZnWuXXtAu.1_1 2024-03-04T13:00:15.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.867+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P.2 2024-03-04T13:00:15.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.867+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P.2_1 2024-03-04T13:00:15.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.867+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P.3 2024-03-04T13:00:15.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.867+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P.3_1 2024-03-04T13:00:15.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.867+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P.4 2024-03-04T13:00:15.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.867+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P.4_1 2024-03-04T13:00:15.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.867+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P.5 2024-03-04T13:00:15.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.867+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P.5_1 2024-03-04T13:00:15.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.869+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P.6 2024-03-04T13:00:15.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.869+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P.6_1 2024-03-04T13:00:15.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.869+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14664686419714910145', time=2024-03-04T14:57:27.438341+0000, chain.objs.size()=1 2024-03-04T13:00:15.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.869+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.541__shadow:0QE4kbNdDCaOhW8bRsMNyW6Symvv-jh_.KULc7-8j-Fpa5GdoyHY2RgvaE9PKxsy_0 2024-03-04T13:00:15.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.869+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11008999574502256987', time=2024-03-04T14:57:52.026043+0000, chain.objs.size()=1 2024-03-04T13:00:15.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.869+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.553__shadow:8YqssVE0dobEBJPldlVGLLOYJuaXSe2_.Pv5HpWw6FwoPEKOnKZgYifgnq2iw-8c_0 2024-03-04T13:00:15.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.869+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9892473133938034210', time=2024-03-04T14:57:59.815991+0000, chain.objs.size()=1 2024-03-04T13:00:15.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.869+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.573__shadow_.dKRbfLIQNbgWMO1_pwtPKpzZKAG8lF7_0 2024-03-04T13:00:15.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.869+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9534197571625395012', time=2024-03-04T14:58:19.119467+0000, chain.objs.size()=1 2024-03-04T13:00:15.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.869+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.600__shadow_.YaWWaG5yZ5S0ZGkG3QXj-F37ttIbiYT_0 2024-03-04T13:00:15.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.877+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:15.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.879+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T13:00:15.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.881+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:15.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.881+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:15.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45870' 2024-03-04T13:00:15.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15000256270756545581', time=2024-03-04T14:52:50.849443+0000, chain.objs.size()=1 2024-03-04T13:00:15.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.136__shadow_.rROvSwyi_ZPQNq1VV3J3ewx3lY43Caa_0 2024-03-04T13:00:15.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11244928685899284029', time=2024-03-04T14:53:31.628648+0000, chain.objs.size()=1 2024-03-04T13:00:15.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.208__shadow_.iJPgqnlydbKKt2_CqW3n6z0ui07myJt_0 2024-03-04T13:00:15.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7267153020377046814', time=2024-03-04T14:53:34.885543+0000, chain.objs.size()=1 2024-03-04T13:00:15.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.214__shadow_.7LkbAwBq2bybisLSKnqLzMELxWI3THp_0 2024-03-04T13:00:15.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.224913052552595266', time=2024-03-04T14:53:35.320865+0000, chain.objs.size()=1 2024-03-04T13:00:15.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.215__shadow_.ScOhrx4A7NOVEBkSR770csLwDUdo2kv_0 2024-03-04T13:00:15.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5754497868833012187', time=2024-03-04T14:53:36.938277+0000, chain.objs.size()=1 2024-03-04T13:00:15.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.217__shadow_.woHM8OYp5lkiIKbsfiAzXlg5FvJyy9z_0 2024-03-04T13:00:15.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16218944148342251252', time=2024-03-04T14:53:37.361955+0000, chain.objs.size()=1 2024-03-04T13:00:15.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.218__shadow_.JR9Y6GUY70jrxm9nc60fAtDPDQmYjkg_0 2024-03-04T13:00:15.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12219243652106298718', time=2024-03-04T14:53:37.774155+0000, chain.objs.size()=1 2024-03-04T13:00:15.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.219__shadow_.hSCdQ8Ru5mC1bR41UC9Fa6mj3wrZa08_0 2024-03-04T13:00:15.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12239279434046431751', time=2024-03-04T14:53:41.318481+0000, chain.objs.size()=1 2024-03-04T13:00:15.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.227__shadow_.cbN5qdh1HTCI9I_uYFAU-6Ew9iUU0-D_0 2024-03-04T13:00:15.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13079989682507293644', time=2024-03-04T14:53:42.226812+0000, chain.objs.size()=1 2024-03-04T13:00:15.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.229__shadow_.JMS155tV9IBVvuD4WHHfGPGzOM47U9__0 2024-03-04T13:00:15.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10689106577701000784', time=2024-03-04T14:53:52.094408+0000, chain.objs.size()=1 2024-03-04T13:00:15.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HyRGNbX0hkwx_yTphoGYtEclWH8kZui_0 2024-03-04T13:00:15.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12586202752761189770', time=2024-03-04T14:53:52.133791+0000, chain.objs.size()=1 2024-03-04T13:00:15.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.sc6Z6kqOG4qe0YssqnvSGDKz3mWXEhc_0 2024-03-04T13:00:15.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9841784789530078105', time=2024-03-04T14:53:52.139538+0000, chain.objs.size()=1 2024-03-04T13:00:15.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.883+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.WmdEWrQ6izRgpzaNVD4wvXXcIsDeYYG_0 2024-03-04T13:00:15.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11873760490145415589', time=2024-03-04T14:53:52.294172+0000, chain.objs.size()=1 2024-03-04T13:00:15.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.hvsH56fuJYoo_W18foJo0a9zD76Ou0Y_0 2024-03-04T13:00:15.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2472124567378578160', time=2024-03-04T14:53:52.409874+0000, chain.objs.size()=1 2024-03-04T13:00:15.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.T8zxZLV22Z-YH2fdD9X7a5RIwqC5nLr_0 2024-03-04T13:00:15.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.886+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8205443816807816627', time=2024-03-04T14:53:52.425633+0000, chain.objs.size()=1 2024-03-04T13:00:15.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.886+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.auEIkk64zi0mL39DhkrXtXY7e_vhosu_0 2024-03-04T13:00:15.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.886+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3573682654904425429', time=2024-03-04T14:53:52.434092+0000, chain.objs.size()=1 2024-03-04T13:00:15.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.886+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yYNa486Ev1vjivGCn9Woli8Y-0rjh47_0 2024-03-04T13:00:15.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7982005798563953424', time=2024-03-04T14:53:52.461869+0000, chain.objs.size()=1 2024-03-04T13:00:15.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.RtGo8hHxrhmFv40DJAZ_tsCRba6JUnZ_0 2024-03-04T13:00:15.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.276843887035213070', time=2024-03-04T14:53:52.583300+0000, chain.objs.size()=1 2024-03-04T13:00:15.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ivv_ZYgeRKOYi2yzxIeUUwiFKW6-56h_0 2024-03-04T13:00:15.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2360032755399231229', time=2024-03-04T14:53:52.590706+0000, chain.objs.size()=1 2024-03-04T13:00:15.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.i_hhPWDrM0qghwmf-GbZMiDNQCMTMcg_0 2024-03-04T13:00:15.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1398843273306751074', time=2024-03-04T14:53:52.591485+0000, chain.objs.size()=1 2024-03-04T13:00:15.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.idYPzUQVosSQnJntK9Myh9AxAlcq8_Y_0 2024-03-04T13:00:15.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5851172330526737211', time=2024-03-04T14:53:52.607781+0000, chain.objs.size()=1 2024-03-04T13:00:15.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.M1GhFuFWYmSm43re_b_LdbllObob-Tz_0 2024-03-04T13:00:15.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15958761731620182421', time=2024-03-04T14:53:52.623789+0000, chain.objs.size()=1 2024-03-04T13:00:15.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yaBRvz4HC8SJVTpp9QqOXZ1wsS9C0dD_0 2024-03-04T13:00:15.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.237091527622314536', time=2024-03-04T14:53:52.647666+0000, chain.objs.size()=1 2024-03-04T13:00:15.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.g-J1V_lC1Pb30dtvjp3bkwNnwrEY6wG_0 2024-03-04T13:00:15.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9263591484058888067', time=2024-03-04T14:53:52.658814+0000, chain.objs.size()=1 2024-03-04T13:00:15.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.QUunjuB5-aRNH6k-qQDFYZypGA6ly0W_0 2024-03-04T13:00:15.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10604783739743536320', time=2024-03-04T14:53:52.744163+0000, chain.objs.size()=1 2024-03-04T13:00:15.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.UU27RP9CTW1Aj8AXxUqiT-jbEy5OSSu_0 2024-03-04T13:00:15.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1712007949323312351', time=2024-03-04T14:53:52.755206+0000, chain.objs.size()=1 2024-03-04T13:00:15.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ZRFCq2opfxd20SoC-6x069wmuVSzRr4_0 2024-03-04T13:00:15.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15427084641036615246', time=2024-03-04T14:53:52.914988+0000, chain.objs.size()=1 2024-03-04T13:00:15.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.889+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.6peawwNNkMdtwl6vXwgt1sMXR4n6kQb_0 2024-03-04T13:00:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14110030210987649160', time=2024-03-04T14:53:52.996168+0000, chain.objs.size()=1 2024-03-04T13:00:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.v6ARm2JhjCNKfLtei7tmEDqf3zjLzrY_0 2024-03-04T13:00:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18062895513356175669', time=2024-03-04T14:53:53.008399+0000, chain.objs.size()=1 2024-03-04T13:00:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.2ehzUEVdimBnLkbRkRCdfLCV1rM9AvV_0 2024-03-04T13:00:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.893+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4961968158848451258', time=2024-03-04T14:53:53.008883+0000, chain.objs.size()=1 2024-03-04T13:00:15.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.893+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.fq8oW6KIho7o_-ogRvggqYgF61Ijg1d_0 2024-03-04T13:00:15.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.893+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4223292000632192552', time=2024-03-04T14:53:53.088452+0000, chain.objs.size()=1 2024-03-04T13:00:15.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.893+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.AuCbl8SQdI3qK3HVEZKadfcHU9M8GIg_0 2024-03-04T13:00:15.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.893+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11240160676543220547', time=2024-03-04T14:53:53.099661+0000, chain.objs.size()=1 2024-03-04T13:00:15.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.893+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Cj8139rq_ixI1h09C_cuqXnGXGfg9eM_0 2024-03-04T13:00:15.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.898452238497171506', time=2024-03-04T14:53:53.110916+0000, chain.objs.size()=1 2024-03-04T13:00:15.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-mkFvZl9ZZZ5tyilRxnJTc8rm6ql9P5_0 2024-03-04T13:00:15.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1332340346864363034', time=2024-03-04T14:53:53.111489+0000, chain.objs.size()=1 2024-03-04T13:00:15.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.MwF2U0HFPHTlAGgTt2rWSsObmUCqpbm_0 2024-03-04T13:00:15.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13144549136072102213', time=2024-03-04T14:53:53.273628+0000, chain.objs.size()=1 2024-03-04T13:00:15.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.V7LP-_Y123rxyySw-WFTzQ14jdmpDPl_0 2024-03-04T13:00:15.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6796983175324261690', time=2024-03-04T14:53:53.289803+0000, chain.objs.size()=1 2024-03-04T13:00:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.D3fFG9cofvBhXJfLPHUax3rFXPT-pvl_0 2024-03-04T13:00:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6719811662053238633', time=2024-03-04T14:53:53.292865+0000, chain.objs.size()=1 2024-03-04T13:00:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.QCl5qC3P_ikHhuQ2yn-VZDrRf6yZPrq_0 2024-03-04T13:00:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2497527086096122399', time=2024-03-04T14:53:53.323145+0000, chain.objs.size()=1 2024-03-04T13:00:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YVr8fKutvoA88Uh9IFnZwwKdpIqCO1o_0 2024-03-04T13:00:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.157722114210025574', time=2024-03-04T14:54:03.563012+0000, chain.objs.size()=1 2024-03-04T13:00:15.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.256__shadow_.iVVNE7qROZq3kbzpMbT__og9UucUyfR_0 2024-03-04T13:00:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.897+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5811711178617766836', time=2024-03-04T14:54:06.307492+0000, chain.objs.size()=1 2024-03-04T13:00:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.897+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.262__shadow_.PAksu1mZtT0t126lIjcvYZ5J7p6Recw_0 2024-03-04T13:00:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.897+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4423497641708921943', time=2024-03-04T14:54:06.752297+0000, chain.objs.size()=1 2024-03-04T13:00:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.897+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.263__shadow_.U7G8Uif82qxMWxBD53bfniMi4tLA6Xr_0 2024-03-04T13:00:15.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.897+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5569490631780719541', time=2024-03-04T14:54:10.808656+0000, chain.objs.size()=1 2024-03-04T13:00:15.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.897+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.270__shadow_.fGTRIanH8C7OkLufYKb8BVH8soUCjbE_0 2024-03-04T13:00:15.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.897+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12583255694939343944', time=2024-03-04T14:54:14.428072+0000, chain.objs.size()=1 2024-03-04T13:00:15.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.897+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.278__shadow_.W3pPuZ4RbkVMa879TtM_-xTYHZvwn3K_0 2024-03-04T13:00:15.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3557944261891048222', time=2024-03-04T14:54:15.738028+0000, chain.objs.size()=1 2024-03-04T13:00:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.280__shadow:6cvQrRhVd30JeQi3l3p5u9SWUbcaSdg_.hkK1ZW5G56aJ_7lyW4cTDcSx6uuNJY6_0 2024-03-04T13:00:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3911126582346484835', time=2024-03-04T14:54:29.617290+0000, chain.objs.size()=1 2024-03-04T13:00:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rZZsCRVje28EKwjM1t-rFZ7Qo-5_L8r_0 2024-03-04T13:00:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13877606690067820061', time=2024-03-04T14:54:29.632044+0000, chain.objs.size()=1 2024-03-04T13:00:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.hvbc8Fpyf0TitE7TQeWdPtiE8QK63_y_0 2024-03-04T13:00:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9836656985800601744', time=2024-03-04T14:54:29.641886+0000, chain.objs.size()=1 2024-03-04T13:00:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.TH3k9xLA8Jl7wd1umi0q1NV7nXqhRS5_0 2024-03-04T13:00:15.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13590408773480342407', time=2024-03-04T14:54:29.694163+0000, chain.objs.size()=1 2024-03-04T13:00:15.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lrcrzgxWE461eVPTUTjeodriIcucHZQ_0 2024-03-04T13:00:15.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12396190347140289781', time=2024-03-04T14:54:29.803588+0000, chain.objs.size()=1 2024-03-04T13:00:15.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lzlhZ_-zr2_76SO3gfhlskyc99oG60a_0 2024-03-04T13:00:15.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.806011629781816656', time=2024-03-04T14:54:29.818803+0000, chain.objs.size()=1 2024-03-04T13:00:15.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tYw2a0D-kIaiwIyRDbSiqA_t7DroXHH_0 2024-03-04T13:00:15.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3619023012361425471', time=2024-03-04T14:54:29.942184+0000, chain.objs.size()=1 2024-03-04T13:00:15.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.900+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5HTyTwPuNyJGqPI8NrN7kwOjYlOg-wI_0 2024-03-04T13:00:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.903+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7150475594845128309', time=2024-03-04T14:54:29.955945+0000, chain.objs.size()=1 2024-03-04T13:00:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.903+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5ijxHR6RFznfsCgS06mv21cdnr762vr_0 2024-03-04T13:00:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.903+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6119756262946567218', time=2024-03-04T14:54:29.962222+0000, chain.objs.size()=1 2024-03-04T13:00:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.903+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.z3M2gbEed5nHuPQO9afa4M78Sx5Uzz5_0 2024-03-04T13:00:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.903+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1744468934807710277', time=2024-03-04T14:54:30.015424+0000, chain.objs.size()=1 2024-03-04T13:00:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.903+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.caPgJCEvBU54CLc_e933YVhBrjIrAmO_0 2024-03-04T13:00:15.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.903+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13967852637072575324', time=2024-03-04T14:54:30.025669+0000, chain.objs.size()=1 2024-03-04T13:00:15.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.903+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ioLEOs1gIoyIpWHhtMXn-iADA1pN-n9_0 2024-03-04T13:00:15.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16906835885127770279', time=2024-03-04T14:54:30.027407+0000, chain.objs.size()=1 2024-03-04T13:00:15.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.nVuL8RTwMsm0XiEGAA_MYAMEC_ik2-k_0 2024-03-04T13:00:15.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6775637357977701943', time=2024-03-04T14:54:30.103197+0000, chain.objs.size()=1 2024-03-04T13:00:15.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.xsjsA_RCerZvLwUb5-kQ4W5ANlTI0nr_0 2024-03-04T13:00:15.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7178341296582414802', time=2024-03-04T14:54:30.114081+0000, chain.objs.size()=1 2024-03-04T13:00:15.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.txWXjtY6wnmSe7_uf5oZQfTTOdrfWYT_0 2024-03-04T13:00:15.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11123597594672922027', time=2024-03-04T14:54:30.122697+0000, chain.objs.size()=1 2024-03-04T13:00:15.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.pGYxs8ZgT5_ekhCR6LT6jYU8vzZcIV9_0 2024-03-04T13:00:15.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7775333344275209082', time=2024-03-04T14:54:30.275072+0000, chain.objs.size()=1 2024-03-04T13:00:15.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.C-DbbzMQuQS7rSRKnI0np4eXGWUbva8_0 2024-03-04T13:00:15.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7403364344108212728', time=2024-03-04T14:54:30.297199+0000, chain.objs.size()=1 2024-03-04T13:00:15.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FNhYk-nV1K3FRL1TGf9DuH0o2TFm0jq_0 2024-03-04T13:00:15.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12938387621533670602', time=2024-03-04T14:54:30.333210+0000, chain.objs.size()=1 2024-03-04T13:00:15.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.scHyrm5pe89UfQT9JIejb353zmRS4lo_0 2024-03-04T13:00:15.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3536015718149032860', time=2024-03-04T14:54:30.341232+0000, chain.objs.size()=1 2024-03-04T13:00:15.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.UwxJ1NcMkwW5-meg61OOgnOgt27McNa_0 2024-03-04T13:00:15.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10030582152279606188', time=2024-03-04T14:54:30.445874+0000, chain.objs.size()=1 2024-03-04T13:00:15.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_._-Vz5ios53Bkqbct9JyJnC0PVRUZU7V_0 2024-03-04T13:00:15.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5022669052319088639', time=2024-03-04T14:54:30.505788+0000, chain.objs.size()=1 2024-03-04T13:00:15.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.vGbKyK0ccMNNJFXXJx_nW81gtmmTAxl_0 2024-03-04T13:00:15.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15442563396950190235', time=2024-03-04T14:54:30.506406+0000, chain.objs.size()=1 2024-03-04T13:00:15.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.QGvafuOSwoX5S_cmppeef96QYG7I0cw_0 2024-03-04T13:00:15.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14447471222124093392', time=2024-03-04T14:54:30.590851+0000, chain.objs.size()=1 2024-03-04T13:00:15.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ET6YIDoy55KMakYh8Ra-6pyLGkYrSaG_0 2024-03-04T13:00:15.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5948693111411520882', time=2024-03-04T14:54:30.636178+0000, chain.objs.size()=1 2024-03-04T13:00:15.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.mQ_ZxBYUD6Hc1jVbso4HeXVAHEz5UAp_0 2024-03-04T13:00:15.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10072544427098821968', time=2024-03-04T14:54:30.650709+0000, chain.objs.size()=1 2024-03-04T13:00:15.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.CVhSkBKGHmKunEkbTPxqua1qOTxiB7x_0 2024-03-04T13:00:15.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14423642731043696769', time=2024-03-04T14:54:30.665764+0000, chain.objs.size()=1 2024-03-04T13:00:15.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.atzYYntnaSVb7bZqjB9KfJfFALhvlDs_0 2024-03-04T13:00:15.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4145536886933046315', time=2024-03-04T14:54:30.794778+0000, chain.objs.size()=1 2024-03-04T13:00:15.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FGKDFxmmmw4eHFu8DSDPtmNzTPB5LXT_0 2024-03-04T13:00:15.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9823944712985748011', time=2024-03-04T14:54:38.297755+0000, chain.objs.size()=1 2024-03-04T13:00:15.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.mmGf3RAEfFbXEjEiX3GzvZhuHum8HtP_0 2024-03-04T13:00:15.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5937667584237591829', time=2024-03-04T14:54:38.324256+0000, chain.objs.size()=1 2024-03-04T13:00:15.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Vdc9DkduGG-kO5oJp863128phXP-3lF_0 2024-03-04T13:00:15.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13417053463714147090', time=2024-03-04T14:54:38.351115+0000, chain.objs.size()=1 2024-03-04T13:00:15.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ViHveVmHI0zYHTkL0a1Rf0mkMyFtMJR_0 2024-03-04T13:00:15.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13398438004213705039', time=2024-03-04T14:54:38.369669+0000, chain.objs.size()=1 2024-03-04T13:00:15.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._MVZZp9pmtF_70u5OgXEmMeIHWBeVFe_0 2024-03-04T13:00:15.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16559379191725467038', time=2024-03-04T14:54:38.513263+0000, chain.objs.size()=1 2024-03-04T13:00:15.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.30UOGmuHsyFagOSJMedETBjVlq6Zpfl_0 2024-03-04T13:00:15.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3841052150047994470', time=2024-03-04T14:54:38.513889+0000, chain.objs.size()=1 2024-03-04T13:00:15.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.908+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.OmlqZrk3Q1DZmKIhkErD4s7fY5FnoCb_0 2024-03-04T13:00:15.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.910+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7323650297675709067', time=2024-03-04T14:54:38.635710+0000, chain.objs.size()=1 2024-03-04T13:00:15.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.910+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.--6JkOViGOcqMquq4EUMHIVUhjVfwDl_0 2024-03-04T13:00:15.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.910+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17128049698497318780', time=2024-03-04T14:54:38.647843+0000, chain.objs.size()=1 2024-03-04T13:00:15.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.910+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7w2xDogvLPi_MGx0lC_2p0tcOWNFyKg_0 2024-03-04T13:00:15.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.910+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3580385323796209270', time=2024-03-04T14:54:38.650410+0000, chain.objs.size()=1 2024-03-04T13:00:15.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.910+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.157oH2mUBfmijXL_1bBI6e1hv7DMUZU_0 2024-03-04T13:00:15.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.910+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11472737969232986711', time=2024-03-04T14:54:38.658207+0000, chain.objs.size()=1 2024-03-04T13:00:15.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.910+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.DyhC4Fy2kpVpKHavEkd9-YPolVJCP34_0 2024-03-04T13:00:15.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.910+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2864532465385775601', time=2024-03-04T14:54:38.707590+0000, chain.objs.size()=1 2024-03-04T13:00:15.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.910+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.TUd8BJ660bM_vlwATGmtHsP_3ob3sAC_0 2024-03-04T13:00:15.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.911+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5256793468760327235', time=2024-03-04T14:54:38.708946+0000, chain.objs.size()=1 2024-03-04T13:00:15.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.911+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.97HgBuQhJZhNwTwL81jJn5WjjwgpaYH_0 2024-03-04T13:00:15.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.911+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16810745189219736928', time=2024-03-04T14:54:38.811158+0000, chain.objs.size()=1 2024-03-04T13:00:15.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.911+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.x197fESWaN7g4KIZAq0SBajlcc7zNZk_0 2024-03-04T13:00:15.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.911+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10506207075835954385', time=2024-03-04T14:54:38.855356+0000, chain.objs.size()=1 2024-03-04T13:00:15.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.911+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wUFDrOBo6Wkl63qaYdRXRONlRrfNG7H_0 2024-03-04T13:00:15.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.911+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3655925041667899011', time=2024-03-04T14:54:38.871545+0000, chain.objs.size()=1 2024-03-04T13:00:15.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.911+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HZNu_o9uHwUUZSiZXqD24pYHraXHEEz_0 2024-03-04T13:00:15.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.911+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8287323293174720027', time=2024-03-04T14:54:38.945473+0000, chain.objs.size()=1 2024-03-04T13:00:15.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.911+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.BlF8a4GyjCbPzpeyvr_VgJMuNd-yfg4_0 2024-03-04T13:00:15.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.911+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11899727417079534547', time=2024-03-04T14:54:38.947437+0000, chain.objs.size()=1 2024-03-04T13:00:15.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.911+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Z7yLVfSeqBqsPb01naCIKKt9bcTkMku_0 2024-03-04T13:00:15.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13327081164102115805', time=2024-03-04T14:54:38.970857+0000, chain.objs.size()=1 2024-03-04T13:00:15.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.V-cwR5eFa1-vhZ9GShfmYHqikBCEOxd_0 2024-03-04T13:00:15.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17036265784683022677', time=2024-03-04T14:54:38.993077+0000, chain.objs.size()=1 2024-03-04T13:00:15.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cVzTRTB_CVtDdWMOwBtsH_ZaCQF5esG_0 2024-03-04T13:00:15.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14050541012435177458', time=2024-03-04T14:54:39.005207+0000, chain.objs.size()=1 2024-03-04T13:00:15.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.B3oFzjlbxPwJp5GQO4SEkqNK8pB3tKB_0 2024-03-04T13:00:15.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17384485388358806851', time=2024-03-04T14:54:39.008135+0000, chain.objs.size()=1 2024-03-04T13:00:15.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ZEAfhiGqtaKH-12pw5r9MKb1M3d1oTy_0 2024-03-04T13:00:15.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8151904618303324996', time=2024-03-04T14:54:39.104206+0000, chain.objs.size()=1 2024-03-04T13:00:15.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gqLOUIl1GzKm-9gwqUp9GF5Vee3swHP_0 2024-03-04T13:00:15.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16171171935602117320', time=2024-03-04T14:54:39.107894+0000, chain.objs.size()=1 2024-03-04T13:00:15.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KuouBcKP9C_tDqv6BsNdS1O2IfrcrkI_0 2024-03-04T13:00:15.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12126296510311560693', time=2024-03-04T14:54:39.109157+0000, chain.objs.size()=1 2024-03-04T13:00:15.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.XnGfSoXz1HWzHEFjtET0pUYxp4oijQ-_0 2024-03-04T13:00:15.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5357881866377892848', time=2024-03-04T14:54:39.266595+0000, chain.objs.size()=1 2024-03-04T13:00:15.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jPS7rFlQZH49bQfA3bCdmzplSHIfyle_0 2024-03-04T13:00:15.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.637822596215730001', time=2024-03-04T14:54:39.267583+0000, chain.objs.size()=1 2024-03-04T13:00:15.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0yZGUmP5NTRwSSVjH1tCzYJ1h_npTil_0 2024-03-04T13:00:15.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1179686426066256253', time=2024-03-04T14:54:39.298058+0000, chain.objs.size()=1 2024-03-04T13:00:15.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kvsR72U3VFfPU0A6r8xc-Emu7Zhpyed_0 2024-03-04T13:00:15.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5067369583491088249', time=2024-03-04T14:54:39.304801+0000, chain.objs.size()=1 2024-03-04T13:00:15.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.6M8MTyIw43eeuGifHvBvpKmc2o9SSoD_0 2024-03-04T13:00:15.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4009915470838850848', time=2024-03-04T14:54:39.323249+0000, chain.objs.size()=1 2024-03-04T13:00:15.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.QkX4z4JSH6CvG7ezoFwTyLPc1ZfyFNv_0 2024-03-04T13:00:15.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.916+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/45870 2024-03-04T13:00:15.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-03-04T13:00:15.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3996198964534610760', time=2024-03-04T14:54:39.461915+0000, chain.objs.size()=1 2024-03-04T13:00:15.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.39fkV281AbVtGDY-8rMU4zCvEnBxpOK_0 2024-03-04T13:00:15.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18251537085685324061', time=2024-03-04T14:54:44.086175+0000, chain.objs.size()=1 2024-03-04T13:00:15.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.308__shadow_.oq8mdJMp4lfxKv7IUSZvlDk6QDiy7Ty_0 2024-03-04T13:00:15.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5263734069964818017', time=2024-03-04T14:55:03.231781+0000, chain.objs.size()=1 2024-03-04T13:00:15.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.352__shadow_.xPwEUNmx3LXKOUXm2IE4vbFgYa15R35_0 2024-03-04T13:00:15.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8172128020915535280', time=2024-03-04T14:55:45.378820+0000, chain.objs.size()=1 2024-03-04T13:00:15.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.435__shadow_.2UHKJIhGPr_tPOaPWcA7VhoJYhAm8fm_0 2024-03-04T13:00:15.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.472__shadow_.IaeL8ZwDK82SgvDdjY2QBN-CCoOmj6R_1_b09a2f991abe051869139e2829455e1f', time=2024-03-04T14:55:59.198817+0000, chain.objs.size()=1 2024-03-04T13:00:15.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.472__shadow_.IaeL8ZwDK82SgvDdjY2QBN-CCoOmj6R_0 2024-03-04T13:00:15.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2137538655947065035', time=2024-03-04T14:56:07.450003+0000, chain.objs.size()=1 2024-03-04T13:00:15.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.490__multipart_mymultipart.2~FAQg3u7yVj7ODDjD0seh1lRa2Gj1ZhO.1 2024-03-04T13:00:15.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1139691555869668176', time=2024-03-04T14:56:19.316737+0000, chain.objs.size()=6 2024-03-04T13:00:15.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~600FHJnzxIYDp6fcN6QhbAc9wcTYMVH.1 2024-03-04T13:00:15.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~600FHJnzxIYDp6fcN6QhbAc9wcTYMVH.2 2024-03-04T13:00:15.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.L85VhW_zP2HtdTZF1KpjDCnhCuNN3nIY.3 2024-03-04T13:00:15.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~600FHJnzxIYDp6fcN6QhbAc9wcTYMVH.4 2024-03-04T13:00:15.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~600FHJnzxIYDp6fcN6QhbAc9wcTYMVH.5 2024-03-04T13:00:15.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.918+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~600FHJnzxIYDp6fcN6QhbAc9wcTYMVH.6 2024-03-04T13:00:15.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.920+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6991880551765914159', time=2024-03-04T14:57:19.499510+0000, chain.objs.size()=1 2024-03-04T13:00:15.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.920+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:SHzuKXdrl66ekgtQWrFWtsO8NsOqdmv_.MawE5yP7P_qoLEQU6TpBxAIcBuPNtFT_0 2024-03-04T13:00:15.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.920+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11387675555741963612', time=2024-03-04T14:57:30.898199+0000, chain.objs.size()=1 2024-03-04T13:00:15.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.920+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.542__shadow:WaqMo5u6ULaywAjOyRs-uPyzBFuBD5k_.HGhHzDxjnEeQiGZ1ravv5_bmvy9w0m3_0 2024-03-04T13:00:15.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.920+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7989936966564964475', time=2024-03-04T14:58:24.230943+0000, chain.objs.size()=1 2024-03-04T13:00:15.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.920+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.611__shadow_.RFD64nZkf4LgLhLbgXBnMX_ZU9IXiqw_0 2024-03-04T13:00:15.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.921+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.628__shadow_.i_fQgbwqCj6WX593wdsPLuTd9fEElaj_1_91ab59ac3b219bf48318f3aaa0ab378e', time=2024-03-04T14:58:33.577810+0000, chain.objs.size()=1 2024-03-04T13:00:15.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.921+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.628__shadow_.i_fQgbwqCj6WX593wdsPLuTd9fEElaj_0 2024-03-04T13:00:15.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.921+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17476927225444420817', time=2024-03-04T14:59:11.469050+0000, chain.objs.size()=1 2024-03-04T13:00:15.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.921+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.678__shadow_.BNdv2mURV5upeoSFwQz6Tr33SZA7Boe_0 2024-03-04T13:00:15.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:15.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.924+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T13:00:15.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:15.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:15.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43455' 2024-03-04T13:00:15.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4681854897795885239', time=2024-03-04T14:52:56.861678+0000, chain.objs.size()=3 2024-03-04T13:00:15.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__multipart_mymultipart-STANDARD.2~qxqiqfUBcB7iLaz-b1TBr4js0uPfozP.1 2024-03-04T13:00:15.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__multipart_mymultipart-STANDARD.2~qxqiqfUBcB7iLaz-b1TBr4js0uPfozP.2 2024-03-04T13:00:15.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__multipart_mymultipart-STANDARD.2~qxqiqfUBcB7iLaz-b1TBr4js0uPfozP.3 2024-03-04T13:00:15.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_JTni96o3YKN9t43yXaQRAvVL-JGat3E', time=2024-03-04T14:52:57.926935+0000, chain.objs.size()=3 2024-03-04T13:00:15.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.UEljAbyitbifAupLGwG2szR0DkmXSjh_0 2024-03-04T13:00:15.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.UEljAbyitbifAupLGwG2szR0DkmXSjh_1 2024-03-04T13:00:15.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.UEljAbyitbifAupLGwG2szR0DkmXSjh_2 2024-03-04T13:00:15.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1590687735186744794', time=2024-03-04T14:53:30.778737+0000, chain.objs.size()=1 2024-03-04T13:00:15.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.206__shadow_.t-5oNU_XBWpfWZa49KiYoVbJWf89Khr_0 2024-03-04T13:00:15.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2231461892532753756', time=2024-03-04T14:53:31.216830+0000, chain.objs.size()=1 2024-03-04T13:00:15.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.207__shadow_.vwUile-vX3mwBqg6y2y533iMwFEF6PM_0 2024-03-04T13:00:15.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10632476984309427389', time=2024-03-04T14:53:39.997224+0000, chain.objs.size()=1 2024-03-04T13:00:15.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.224__shadow_.L_Fzm_8-su0X3niVmNhog4DNmaMRuzg_0 2024-03-04T13:00:15.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5199860012644622540', time=2024-03-04T14:53:40.434217+0000, chain.objs.size()=1 2024-03-04T13:00:15.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.225__shadow_.yZ75y3OK9lIB6o_4w8kdl300XsEMZzm_0 2024-03-04T13:00:15.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3365132286631930800', time=2024-03-04T14:53:41.319182+0000, chain.objs.size()=1 2024-03-04T13:00:15.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.227__shadow_.Ysi8iXpllPNk860AyqH0GkmBwFLEYka_0 2024-03-04T13:00:15.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13644121485726452338', time=2024-03-04T14:53:52.107106+0000, chain.objs.size()=1 2024-03-04T13:00:15.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PZV0IqHsxX1NMzZ4QBMFhji314_OAPh_0 2024-03-04T13:00:15.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.930+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9781551299533069786', time=2024-03-04T14:53:52.119486+0000, chain.objs.size()=1 2024-03-04T13:00:15.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.930+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ru8Qeox3ash4A_Hs8fv3TNF1C9ufj5M_0 2024-03-04T13:00:15.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.930+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14946821187369016296', time=2024-03-04T14:53:52.133699+0000, chain.objs.size()=1 2024-03-04T13:00:15.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.930+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LzfU_vlVU7efNfraGs8Q-vFJ8uOWetI_0 2024-03-04T13:00:15.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.930+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14531132363651944072', time=2024-03-04T14:53:52.243481+0000, chain.objs.size()=1 2024-03-04T13:00:15.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.930+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.EmXcTuR9XvvT-aUtX_LEV2qL_Kk1iqs_0 2024-03-04T13:00:15.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8368985867700869521', time=2024-03-04T14:53:52.245912+0000, chain.objs.size()=1 2024-03-04T13:00:15.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.iKXD6EwjQhWjWwYRtXwhDs3XWiczg27_0 2024-03-04T13:00:15.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4330785359153742616', time=2024-03-04T14:53:52.274950+0000, chain.objs.size()=1 2024-03-04T13:00:15.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-IqA3kYP0votfFgzVNgLp-cfkQKqgsm_0 2024-03-04T13:00:15.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11017778049544551871', time=2024-03-04T14:53:52.284827+0000, chain.objs.size()=1 2024-03-04T13:00:15.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.UoHcfyCCh4p1Jllc3OHnS1t3BWFPVql_0 2024-03-04T13:00:15.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7723888222855082618', time=2024-03-04T14:53:52.285320+0000, chain.objs.size()=1 2024-03-04T13:00:15.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YrLLFqPxotzrNorItzUD4KnTNgb1Dng_0 2024-03-04T13:00:15.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10049371073981655667', time=2024-03-04T14:53:52.412349+0000, chain.objs.size()=1 2024-03-04T13:00:15.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.pLypGeBtNbEBBxfzNRRFySXbozYJdCR_0 2024-03-04T13:00:15.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5410356484482751565', time=2024-03-04T14:53:52.431536+0000, chain.objs.size()=1 2024-03-04T13:00:15.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.cBnYv-_wsT-R6W3wwCt5vyQYIn_G1SD_0 2024-03-04T13:00:15.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1690103822661447599', time=2024-03-04T14:53:52.436430+0000, chain.objs.size()=1 2024-03-04T13:00:15.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JMlz3wPknEKJDjeu3I8u6mY818_QsUB_0 2024-03-04T13:00:15.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8932347923005104930', time=2024-03-04T14:53:52.470688+0000, chain.objs.size()=1 2024-03-04T13:00:15.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.lSLFUABFHmId8146IbM_qhrW9nYiIsl_0 2024-03-04T13:00:15.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7941317004398453392', time=2024-03-04T14:53:52.490467+0000, chain.objs.size()=1 2024-03-04T13:00:15.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Zgm54AfNzyVtZ0082GEQ5VifTNBOViq_0 2024-03-04T13:00:15.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.932+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7367184970179211830', time=2024-03-04T14:53:52.579974+0000, chain.objs.size()=1 2024-03-04T13:00:15.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.932+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Cnv3uH5FSnPlHZphNyEIMDNrDNO-QpH_0 2024-03-04T13:00:15.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.932+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9008940669871490898', time=2024-03-04T14:53:52.581075+0000, chain.objs.size()=1 2024-03-04T13:00:15.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.932+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.SmUVCb2yt-3SSt9OeP9MlCWSED02l17_0 2024-03-04T13:00:15.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.933+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12523630926830774805', time=2024-03-04T14:53:52.582263+0000, chain.objs.size()=1 2024-03-04T13:00:15.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.933+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.pQTRZFY4ARky-S2e6zF7f3Uau5CWAQU_0 2024-03-04T13:00:15.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10923845656016931558', time=2024-03-04T14:53:52.650691+0000, chain.objs.size()=1 2024-03-04T13:00:15.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._ampZSq8a5n2X2cdSDm8u3eDvT0nx7g_0 2024-03-04T13:00:15.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7689908823552785223', time=2024-03-04T14:53:52.798098+0000, chain.objs.size()=1 2024-03-04T13:00:15.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GpfjA0ITZqrLqXpX5CRnVmoulnQDJ4V_0 2024-03-04T13:00:15.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17374931012812790837', time=2024-03-04T14:53:52.801312+0000, chain.objs.size()=1 2024-03-04T13:00:15.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.gHpCja6IZhJXF6OPQB8WAZnGowWAMHg_0 2024-03-04T13:00:15.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7297370943785652245', time=2024-03-04T14:53:52.817340+0000, chain.objs.size()=1 2024-03-04T13:00:15.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ExT5cxJJCGXPLHRC8ndZLNGUkqo3wVm_0 2024-03-04T13:00:15.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18397985456029044224', time=2024-03-04T14:53:52.936097+0000, chain.objs.size()=1 2024-03-04T13:00:15.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.fV3k33AlTKMOjvwgLz817HxFXlz0W4Z_0 2024-03-04T13:00:15.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18431913454907982258', time=2024-03-04T14:53:52.946393+0000, chain.objs.size()=1 2024-03-04T13:00:15.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Mp3v5XE-g9L4FaCx0rxrBZtRAms4Ny6_0 2024-03-04T13:00:15.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1090570154494848434', time=2024-03-04T14:53:52.971258+0000, chain.objs.size()=1 2024-03-04T13:00:15.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jwiZPSugc78rYk1IkGGi0n1hoXG1Vnq_0 2024-03-04T13:00:15.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9105279421409366632', time=2024-03-04T14:53:52.993891+0000, chain.objs.size()=1 2024-03-04T13:00:15.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.i22hEHHFtTXU_Mw44n1mUOOt_5qI3rq_0 2024-03-04T13:00:15.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14441238318956436913', time=2024-03-04T14:53:53.086008+0000, chain.objs.size()=1 2024-03-04T13:00:15.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.SguBsC_ThR9wCDVeOJJjkcs-jdiNHpF_0 2024-03-04T13:00:15.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2183864847109570128', time=2024-03-04T14:53:53.104476+0000, chain.objs.size()=1 2024-03-04T13:00:15.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.4xTYDf0wZuP8pqhAwzi7YuIj6Hklghp_0 2024-03-04T13:00:15.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.935+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10797473636044402051', time=2024-03-04T14:53:53.123142+0000, chain.objs.size()=1 2024-03-04T13:00:15.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.935+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jHVrxlCPhAtv-yYJDt7dVUTcc94-lsG_0 2024-03-04T13:00:15.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14555934956642904619', time=2024-03-04T14:53:53.146894+0000, chain.objs.size()=1 2024-03-04T13:00:15.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Msg0kEj-XsGoekXX_f068GaqiHDC1Vc_0 2024-03-04T13:00:15.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5456574070104863895', time=2024-03-04T14:53:53.150002+0000, chain.objs.size()=1 2024-03-04T13:00:15.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xUB15rLYB99aYjQh241z2mwFGGLw3FI_0 2024-03-04T13:00:15.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10782937274197168829', time=2024-03-04T14:53:53.156704+0000, chain.objs.size()=1 2024-03-04T13:00:15.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5Jnph_pUsBgOJSWdte2L9PPoy3oP5aR_0 2024-03-04T13:00:15.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4929708718429084641', time=2024-03-04T14:53:53.248337+0000, chain.objs.size()=1 2024-03-04T13:00:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ws8KTzaMy3SBzTAmr_m-RgDtRzwoLmk_0 2024-03-04T13:00:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16622591374373494326', time=2024-03-04T14:53:53.259934+0000, chain.objs.size()=1 2024-03-04T13:00:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PfjuFznzcUs76gcGa-GV4pXp9AUr-Qy_0 2024-03-04T13:00:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11937852819411653986', time=2024-03-04T14:53:53.264275+0000, chain.objs.size()=1 2024-03-04T13:00:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-u2mHgMMWLHwFOg015NrSsTOPAlfUgo_0 2024-03-04T13:00:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2031965495693184828', time=2024-03-04T14:53:53.293640+0000, chain.objs.size()=1 2024-03-04T13:00:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.936+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mLO4jjTVyeG0Amwz0JwAs0p3UVUStBM_0 2024-03-04T13:00:15.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.937+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12856917527473140304', time=2024-03-04T14:53:53.313069+0000, chain.objs.size()=1 2024-03-04T13:00:15.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.937+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-sMcm505AkWmSse_oOie8NImxniTXQI_0 2024-03-04T13:00:15.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.937+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2179508449165366768', time=2024-03-04T14:53:53.320746+0000, chain.objs.size()=1 2024-03-04T13:00:15.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.937+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ux3uN_QAokkZUVVDf8jZZ_jNswbdSAn_0 2024-03-04T13:00:15.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.937+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8008481799070508262', time=2024-03-04T14:54:04.962679+0000, chain.objs.size()=1 2024-03-04T13:00:15.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.937+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.259__shadow_.Ic0EiAiL7_BjKSa6B254CB8USXi-gyj_0 2024-03-04T13:00:15.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6916092754641877052', time=2024-03-04T14:54:05.413008+0000, chain.objs.size()=1 2024-03-04T13:00:15.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.260__shadow_.zouxSkZm7zOdB8EUzGcyI15O6ihCq8H_0 2024-03-04T13:00:15.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17615929279701939616', time=2024-03-04T14:54:06.307277+0000, chain.objs.size()=1 2024-03-04T13:00:15.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.262__shadow_.7F6zsKwPxlL2B0yPwpzV_ekb-gpqJhL_0 2024-03-04T13:00:15.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6475714440340219238', time=2024-03-04T14:54:08.249023+0000, chain.objs.size()=1 2024-03-04T13:00:15.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.e113QkBYmj-TU-5OfVbM0n-zcnkhsM9_0 2024-03-04T13:00:15.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10176355986288504080', time=2024-03-04T14:54:09.030073+0000, chain.objs.size()=1 2024-03-04T13:00:15.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.x7r8nlf9fM_czb6N5nDXmpm0Fs9ekHk_0 2024-03-04T13:00:15.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12034729571353050704', time=2024-03-04T14:54:09.470490+0000, chain.objs.size()=1 2024-03-04T13:00:15.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.267__shadow_.kiIM6ik14ch1bptKB65k2gpJGie5xsP_0 2024-03-04T13:00:15.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.253525072974846008', time=2024-03-04T14:54:29.627347+0000, chain.objs.size()=1 2024-03-04T13:00:15.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.nKwettH07r-bYvm74Rw7dXmgm6-DvLc_0 2024-03-04T13:00:15.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.939+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12866230045075621293', time=2024-03-04T14:54:29.671981+0000, chain.objs.size()=1 2024-03-04T13:00:15.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.939+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-V50n7tzMuOroU9rpvmNHr-GKlOYaIN_0 2024-03-04T13:00:15.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.939+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9155038754973787260', time=2024-03-04T14:54:29.694830+0000, chain.objs.size()=1 2024-03-04T13:00:15.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.939+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rSf9oKnkX7lxR-qjL25niJtQ56V6C7E_0 2024-03-04T13:00:15.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.939+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7115624795693964874', time=2024-03-04T14:54:29.701716+0000, chain.objs.size()=1 2024-03-04T13:00:15.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.939+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.615sWsXWuMftCJUB91Awjoa4uArtoUg_0 2024-03-04T13:00:15.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.942+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18418860148283689860', time=2024-03-04T14:54:29.800302+0000, chain.objs.size()=1 2024-03-04T13:00:15.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.942+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.306mRZ5S4Tn6fNxlSnsJeMml7H8tA1d_0 2024-03-04T13:00:15.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.942+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9163123937412303371', time=2024-03-04T14:54:29.801598+0000, chain.objs.size()=1 2024-03-04T13:00:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.942+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5bm1GrzxsPsWHnSkn5zy3LsBx2L5s9h_0 2024-03-04T13:00:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.942+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5643926128541914441', time=2024-03-04T14:54:29.811707+0000, chain.objs.size()=1 2024-03-04T13:00:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.942+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.r2eyF1OwlP0FM9TWhMKIn9858cWIYf__0 2024-03-04T13:00:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.942+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6306581784337514894', time=2024-03-04T14:54:29.844342+0000, chain.objs.size()=1 2024-03-04T13:00:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.942+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Q8CT3rsHOx3UJwU9G9ww7lDFdBADMmG_0 2024-03-04T13:00:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.942+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.872127503627541888', time=2024-03-04T14:54:29.860369+0000, chain.objs.size()=1 2024-03-04T13:00:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.942+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ZUcdh7vB1sxJ9r-iF7UZWvsPso9wyQg_0 2024-03-04T13:00:15.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.943+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7526297348265087745', time=2024-03-04T14:54:29.864875+0000, chain.objs.size()=1 2024-03-04T13:00:15.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.943+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.sV6SZbq5ezuZXEvN-DjYT3ny5fADRKL_0 2024-03-04T13:00:15.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16074903407329054686', time=2024-03-04T14:54:29.979990+0000, chain.objs.size()=1 2024-03-04T13:00:15.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.CEHiuZqIDWUQtqJ9NVQzdHWQ1ZeB8TE_0 2024-03-04T13:00:15.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18243932466603212996', time=2024-03-04T14:54:29.982801+0000, chain.objs.size()=1 2024-03-04T13:00:15.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LABDymCuWFlcx_QGCoDqMYjwxu_fcMY_0 2024-03-04T13:00:15.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1658521630869975392', time=2024-03-04T14:54:29.985406+0000, chain.objs.size()=1 2024-03-04T13:00:15.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Qn4Ajvm-P-GDWm8-01xgrlnJ6RqdUOQ_0 2024-03-04T13:00:15.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9508635476444189249', time=2024-03-04T14:54:30.129712+0000, chain.objs.size()=1 2024-03-04T13:00:15.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.WJo4LY_cPw5RHlnFT_jqcQf6B3OUSs9_0 2024-03-04T13:00:15.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7650881818925428752', time=2024-03-04T14:54:30.137192+0000, chain.objs.size()=1 2024-03-04T13:00:15.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wPr_TmseqYdN3XnU32bgIoQ_prSANDY_0 2024-03-04T13:00:15.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14516161560315551691', time=2024-03-04T14:54:30.148666+0000, chain.objs.size()=1 2024-03-04T13:00:15.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.MNHwdM3fAgK4KOljc6j2ztILndz2tGK_0 2024-03-04T13:00:15.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13535301573224991084', time=2024-03-04T14:54:30.150741+0000, chain.objs.size()=1 2024-03-04T13:00:15.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.azsc_QaurYTRHfjnzlANfc_hpLEwt8F_0 2024-03-04T13:00:15.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.167713529720765683', time=2024-03-04T14:54:30.171388+0000, chain.objs.size()=1 2024-03-04T13:00:15.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.944+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.krqFb38CPcSWilLt5RPN2EfPHcX94Cu_0 2024-03-04T13:00:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.946+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8513119329193624815', time=2024-03-04T14:54:30.261304+0000, chain.objs.size()=1 2024-03-04T13:00:15.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.946+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0yg8AoNPk-6y8Z7FreIm37T-rkgb3vM_0 2024-03-04T13:00:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.946+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8339406164246925678', time=2024-03-04T14:54:30.272981+0000, chain.objs.size()=1 2024-03-04T13:00:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.946+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lnXugdSG9EB9i3HaTNfrdab-DmfqDfr_0 2024-03-04T13:00:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.946+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15608040038658948992', time=2024-03-04T14:54:30.279876+0000, chain.objs.size()=1 2024-03-04T13:00:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.946+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ijdVLbbJTcM0B8KcWFmF65fM3IEzXQ9_0 2024-03-04T13:00:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.946+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2112506585352681008', time=2024-03-04T14:54:30.290748+0000, chain.objs.size()=1 2024-03-04T13:00:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.946+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Q_Ax7bLr9Kmr2SpqpWOGip17QMv8Zhe_0 2024-03-04T13:00:15.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.948+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9255133680226753308', time=2024-03-04T14:54:30.312241+0000, chain.objs.size()=1 2024-03-04T13:00:15.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.948+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lMkoYqr_7ZcbpFjk-IDspH3XI1O1wLf_0 2024-03-04T13:00:15.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.948+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17964183348612493987', time=2024-03-04T14:54:30.337443+0000, chain.objs.size()=1 2024-03-04T13:00:15.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.948+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.i9ELIZzmbxqjlWTxENqTK6yB9fBE1xu_0 2024-03-04T13:00:15.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.948+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6807350345431764568', time=2024-03-04T14:54:30.474284+0000, chain.objs.size()=1 2024-03-04T13:00:15.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.948+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.trnfG-bJ7ESHC2Le0Ay9apLkwsyBY4Y_0 2024-03-04T13:00:15.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.950+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12379619720391308348', time=2024-03-04T14:54:30.480367+0000, chain.objs.size()=1 2024-03-04T13:00:15.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.950+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yCltP80unLhAzc5AT-Ajr7MypsFYU5m_0 2024-03-04T13:00:15.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.950+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16296998232759496855', time=2024-03-04T14:54:30.482526+0000, chain.objs.size()=1 2024-03-04T13:00:15.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.950+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HjqZLjZ56hl7gfTaFTphbGQ9KkeuiZF_0 2024-03-04T13:00:15.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.950+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15802263003320805464', time=2024-03-04T14:54:30.617605+0000, chain.objs.size()=1 2024-03-04T13:00:15.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.950+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.xkJPN4tR6lJ99ES-ayvFZAtx-KGCk_x_0 2024-03-04T13:00:15.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.950+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9988721995401948270', time=2024-03-04T14:54:30.620315+0000, chain.objs.size()=1 2024-03-04T13:00:15.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.950+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.OBMypgcxwIhr1lokhXspPqoOgmmjK7Y_0 2024-03-04T13:00:15.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4016234471594685809', time=2024-03-04T14:54:30.657773+0000, chain.objs.size()=1 2024-03-04T13:00:15.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.mqYQAVaK27U3Dllpzu_V35gN8Q41CWm_0 2024-03-04T13:00:15.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8083347989932588642', time=2024-03-04T14:54:30.668529+0000, chain.objs.size()=1 2024-03-04T13:00:15.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_._td2PjpBVQ8NZfUhACvhXEKnxq_winj_0 2024-03-04T13:00:15.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2893288325388385089', time=2024-03-04T14:54:30.767407+0000, chain.objs.size()=1 2024-03-04T13:00:15.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.doMr-or4gCq1LLKnk5NNpFejLLyRFly_0 2024-03-04T13:00:15.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14016786162222763908', time=2024-03-04T14:54:38.295598+0000, chain.objs.size()=1 2024-03-04T13:00:15.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.D2KeT9tiDgOvq7mH5b2WIrPyovUc-PG_0 2024-03-04T13:00:15.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5145603546841278038', time=2024-03-04T14:54:38.305410+0000, chain.objs.size()=1 2024-03-04T13:00:15.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.YJz4K1czzS7FdZD8RV2pXEx_X_Iy-x2_0 2024-03-04T13:00:15.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5305474265319670902', time=2024-03-04T14:54:38.306597+0000, chain.objs.size()=1 2024-03-04T13:00:15.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.lSAWT1MhUvPk1Qd1Wd4wvpyr1kxLoPz_0 2024-03-04T13:00:15.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17526333890041931620', time=2024-03-04T14:54:38.318820+0000, chain.objs.size()=1 2024-03-04T13:00:15.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.954+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.aSt4odJZG84lIT2GT0GZIgOsu3Lzjwl_0 2024-03-04T13:00:15.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.957+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7319718449833578348', time=2024-03-04T14:54:38.349745+0000, chain.objs.size()=1 2024-03-04T13:00:15.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.957+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.84ew7piTbYZ-9HqFLcmDcxI1wZ9Dc0j_0 2024-03-04T13:00:15.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.957+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1798927824003771365', time=2024-03-04T14:54:38.463456+0000, chain.objs.size()=1 2024-03-04T13:00:15.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.957+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Vc_disMT0XtMX-Tc2sFcWuou0DXLBbp_0 2024-03-04T13:00:15.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.957+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9357121427411597562', time=2024-03-04T14:54:38.481462+0000, chain.objs.size()=1 2024-03-04T13:00:15.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.957+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ANEMBMoqIeF7OG-o3P41XtsZWpbZTYo_0 2024-03-04T13:00:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.957+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16833968521114962704', time=2024-03-04T14:54:38.532318+0000, chain.objs.size()=1 2024-03-04T13:00:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.957+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.4WLSbyQPRvjjioo1eGA_oURANQdgAZy_0 2024-03-04T13:00:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.957+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6815696803512911730', time=2024-03-04T14:54:38.538425+0000, chain.objs.size()=1 2024-03-04T13:00:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.957+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.J0GoXMUhq7BSLwYSrnRRXg2VBwkLonC_0 2024-03-04T13:00:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.957+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15133351045192595838', time=2024-03-04T14:54:38.623815+0000, chain.objs.size()=1 2024-03-04T13:00:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.957+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.g2JbIml9yiFEpOkWMAuF72_84-fG3Xc_0 2024-03-04T13:00:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.958+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3043113663817154407', time=2024-03-04T14:54:38.636620+0000, chain.objs.size()=1 2024-03-04T13:00:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.958+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.9WwE7yBKKjqBb875YjnMmAwXAITiiO7_0 2024-03-04T13:00:15.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.958+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8331265788899267014', time=2024-03-04T14:54:38.655158+0000, chain.objs.size()=1 2024-03-04T13:00:15.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.958+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gcYxoadGbVBSjSlyDw4ZwK3M0uRfGXU_0 2024-03-04T13:00:15.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.958+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14850394173562522262', time=2024-03-04T14:54:38.671917+0000, chain.objs.size()=1 2024-03-04T13:00:15.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.958+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.amfAtA-zkARXtbjTYCaLazZCkPL8T6a_0 2024-03-04T13:00:15.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.958+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8323957254294646483', time=2024-03-04T14:54:38.707786+0000, chain.objs.size()=1 2024-03-04T13:00:15.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.958+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.s7tAKJPbOHMwgsS95pWhbOUqa3R58NT_0 2024-03-04T13:00:15.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.958+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.636270153105652294', time=2024-03-04T14:54:38.788748+0000, chain.objs.size()=1 2024-03-04T13:00:15.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.958+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-AsLn0Z36Ohi_-7buWmzH9V5rglDGQj_0 2024-03-04T13:00:15.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.961+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15161299625414864960', time=2024-03-04T14:54:38.817138+0000, chain.objs.size()=1 2024-03-04T13:00:15.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.961+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Ia8xS1tDiYlvztw2wGiOjnjUoEiNoM6_0 2024-03-04T13:00:15.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.961+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14502189580914904558', time=2024-03-04T14:54:38.819204+0000, chain.objs.size()=1 2024-03-04T13:00:15.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.961+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.bjcmkQUtUoYPKjRPoupiKqogsUxAVYA_0 2024-03-04T13:00:15.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.961+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15569254636422573639', time=2024-03-04T14:54:38.827465+0000, chain.objs.size()=1 2024-03-04T13:00:15.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.961+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.6CCX0ks8jfWKejtAo3GKWvHVV1Ojyrx_0 2024-03-04T13:00:15.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.961+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7659882444299584674', time=2024-03-04T14:54:38.836038+0000, chain.objs.size()=1 2024-03-04T13:00:15.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.961+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.o3vv1KgC1TxWKM9FsDF9cEpOdlztzyr_0 2024-03-04T13:00:15.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.968+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/43455 2024-03-04T13:00:15.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-03-04T13:00:15.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8595128744370454692', time=2024-03-04T14:54:38.946415+0000, chain.objs.size()=1 2024-03-04T13:00:15.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ODf8Zvt0fSEWYVYTAnFywQyWeTPr-sW_0 2024-03-04T13:00:15.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7041634692674239433', time=2024-03-04T14:54:38.982146+0000, chain.objs.size()=1 2024-03-04T13:00:15.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.JfCU-OSv2FunlbRVuUfURFOfc1sV5I1_0 2024-03-04T13:00:15.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10311667528804800300', time=2024-03-04T14:54:38.987082+0000, chain.objs.size()=1 2024-03-04T13:00:15.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Mg9ySmSUCZnk-FQeV954__3CEAEWC4J_0 2024-03-04T13:00:15.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3718787055039543766', time=2024-03-04T14:54:38.997259+0000, chain.objs.size()=1 2024-03-04T13:00:15.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jS6gaLnElaZFA0s5Az5MjmhlYP_yeTz_0 2024-03-04T13:00:15.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7606614782194888528', time=2024-03-04T14:54:39.027606+0000, chain.objs.size()=1 2024-03-04T13:00:15.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.roedngeCe2TcanP-l3A8kGC67kjxod5_0 2024-03-04T13:00:15.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13986007597313361514', time=2024-03-04T14:54:39.028512+0000, chain.objs.size()=1 2024-03-04T13:00:15.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.BqWXIDgTgT5zkNONy4vKCG8R2bXr1lJ_0 2024-03-04T13:00:15.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6778568650998722296', time=2024-03-04T14:54:39.031273+0000, chain.objs.size()=1 2024-03-04T13:00:15.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.hqoxL_kDoicwbSkfPhe-NK2op0MdYVy_0 2024-03-04T13:00:15.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11710296391371306142', time=2024-03-04T14:54:39.117502+0000, chain.objs.size()=1 2024-03-04T13:00:15.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.yPJi_O28rbGZw9tAOv5bD7cXqOrkqul_0 2024-03-04T13:00:15.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2386862142137847194', time=2024-03-04T14:54:39.147236+0000, chain.objs.size()=1 2024-03-04T13:00:15.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.o3Mz2rlI_6x-bnov2NaCxwJISEUEC2U_0 2024-03-04T13:00:15.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17743538777483073520', time=2024-03-04T14:54:39.167992+0000, chain.objs.size()=1 2024-03-04T13:00:15.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.aTuWSq0N3LrG-ThEuT01DY1GUIL7vBE_0 2024-03-04T13:00:15.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17802469842815260557', time=2024-03-04T14:54:39.193067+0000, chain.objs.size()=1 2024-03-04T13:00:15.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eVtwJBF6kJ6rwn0feQOM60oJEmaOGgB_0 2024-03-04T13:00:15.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17058313811055242053', time=2024-03-04T14:54:39.270474+0000, chain.objs.size()=1 2024-03-04T13:00:15.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7fakuz2Q1W07A392R-bkGzhK6osLTNm_0 2024-03-04T13:00:15.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.972+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18212980027172133004', time=2024-03-04T14:54:39.290474+0000, chain.objs.size()=1 2024-03-04T13:00:15.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.972+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eO3GzqBD6e4VmTdnNyVL2BBQYuSshO5_0 2024-03-04T13:00:15.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.972+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18045087608516131968', time=2024-03-04T14:54:39.304230+0000, chain.objs.size()=1 2024-03-04T13:00:15.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.972+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.MeZLHG2aDyYD8nL_quK4-lJ-nqdc0zc_0 2024-03-04T13:00:15.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7127726841222545068', time=2024-03-04T14:54:39.331567+0000, chain.objs.size()=1 2024-03-04T13:00:15.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eO3u-lXFXXckJgZE0q95jXFESw502m4_0 2024-03-04T13:00:15.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.122226725617856953', time=2024-03-04T14:54:39.344598+0000, chain.objs.size()=1 2024-03-04T13:00:15.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HJPGL7jPzgGznc6RjCxrFTIQcTgcloA_0 2024-03-04T13:00:15.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3724864245096870474', time=2024-03-04T14:54:39.352237+0000, chain.objs.size()=1 2024-03-04T13:00:15.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pTrHZ-8dpf6o8ezPZ9KKIPd6QKGHUO4_0 2024-03-04T13:00:15.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12438171361048458439', time=2024-03-04T14:54:39.353191+0000, chain.objs.size()=1 2024-03-04T13:00:15.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Y-prq4L9RRpIZ18uVdwwDMPdUeYy_q5_0 2024-03-04T13:00:15.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11955545257447340783', time=2024-03-04T14:54:39.433022+0000, chain.objs.size()=1 2024-03-04T13:00:15.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.yHC2IsIrq6nsKArv7aVPvTZ6cL6Xc7T_0 2024-03-04T13:00:15.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7680028216917936267', time=2024-03-04T14:54:39.473295+0000, chain.objs.size()=1 2024-03-04T13:00:15.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KBr-5BFdBpiSR0vx919a2SHlfpbIUuW_0 2024-03-04T13:00:15.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15293438528071713616', time=2024-03-04T14:54:42.309061+0000, chain.objs.size()=1 2024-03-04T13:00:15.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.304__shadow_.g32xeYke0t8v4aPzRt_2sxuHq1JDG27_0 2024-03-04T13:00:15.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15173623767587811673', time=2024-03-04T14:54:42.787380+0000, chain.objs.size()=1 2024-03-04T13:00:15.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.305__shadow_.DyiXhSyGXn5qzkFgYwerWT8rAnGRWe2_0 2024-03-04T13:00:15.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16827789872398734011', time=2024-03-04T14:54:46.219390+0000, chain.objs.size()=1 2024-03-04T13:00:15.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.313__shadow_.OProM3wiDFbbXdt5hKdsA-I7fdYOMss_0 2024-03-04T13:00:15.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9615201645202587980', time=2024-03-04T14:54:47.522776+0000, chain.objs.size()=1 2024-03-04T13:00:15.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.316__shadow_.Iki7IOqjOC4GA5OOrwjo603-mpDjSpP_0 2024-03-04T13:00:15.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18020429329703130280', time=2024-03-04T14:54:48.917819+0000, chain.objs.size()=1 2024-03-04T13:00:15.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.319__shadow_.WGNzvqs_CzwflekKF9lagX8-Gz6cl-2_0 2024-03-04T13:00:15.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.978+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10020708763393779765', time=2024-03-04T14:54:51.727134+0000, chain.objs.size()=1 2024-03-04T13:00:15.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.978+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.326__shadow_.1d8HgsV9RX-SnE20odqBOkiiTbEaGzt_0 2024-03-04T13:00:15.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8105443428819809352', time=2024-03-04T14:54:57.657688+0000, chain.objs.size()=1 2024-03-04T13:00:15.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.342__shadow_.3AV98unqzYdV7R3u8XytBJohnaP2M1a_0 2024-03-04T13:00:15.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18070533178175240692', time=2024-03-04T14:55:39.181084+0000, chain.objs.size()=1 2024-03-04T13:00:15.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.426__shadow_.0b3df84iI2I7BBC95lvdp7jFzmTqElN_0 2024-03-04T13:00:15.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6408516838303743887', time=2024-03-04T14:55:46.551660+0000, chain.objs.size()=1 2024-03-04T13:00:15.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.437__shadow_.sJBMSCTcAhcfvi-6a1H9dgM1HkkhmMz_0 2024-03-04T13:00:15.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~cg-IYtwxp66fQOMx1jl1jfieJsJfvnq', time=2024-03-04T14:56:31.975259+0000, chain.objs.size()=2 2024-03-04T13:00:15.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.507__multipart_mymultipart.2~cg-IYtwxp66fQOMx1jl1jfieJsJfvnq.3 2024-03-04T13:00:15.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.507__shadow_mymultipart.2~cg-IYtwxp66fQOMx1jl1jfieJsJfvnq.3_1 2024-03-04T13:00:15.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15484271908083359558', time=2024-03-04T14:57:17.021639+0000, chain.objs.size()=1 2024-03-04T13:00:15.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:0L3Xmo6wqAL2xLPd4vtQttocLDR0hyd_.9VyqRMCRv_ZwNignRxWLl1mwrj84jHP_0 2024-03-04T13:00:15.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6910487157831563209', time=2024-03-04T14:57:22.775887+0000, chain.objs.size()=1 2024-03-04T13:00:15.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.537__shadow:uGtmn6enHYBSmON.rQG7WNhQI2SA2Jc_.rNEP6uj0sDMlSx13GB2juPaq1DjvAPm_0 2024-03-04T13:00:15.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1537440545203867097', time=2024-03-04T14:57:36.719877+0000, chain.objs.size()=1 2024-03-04T13:00:15.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:9zd01.HRe-w4AAMoJ6zrMC.3Anf0XXn_.Bc058kxvwFk7yKAZXwkiK0-K6QKlUD6_0 2024-03-04T13:00:15.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11319670304555069979', time=2024-03-04T14:57:47.318375+0000, chain.objs.size()=1 2024-03-04T13:00:15.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.545__shadow:l99oYgdKFc6FUKtZaiUpjsxRoxr1HMr_.RhSh7jFr-q_lF-XP4HUSFHJYpZ4cb3l_0 2024-03-04T13:00:15.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7831445351402584517', time=2024-03-04T14:58:26.837653+0000, chain.objs.size()=1 2024-03-04T13:00:15.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.616__shadow_.aSO-13q4NzjdQ9DYHcveZYC5qx3WzUp_0 2024-03-04T13:00:15.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12511811009174224292', time=2024-03-04T14:58:43.101443+0000, chain.objs.size()=1 2024-03-04T13:00:15.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.654__shadow:CYg2mUUMcNS7VaOvMTjMHU8.0wUvMRV_.CT03GLxT3tMqARtT5YoRdflX_GbmH8z_0 2024-03-04T13:00:15.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.983+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11627787437524068511', time=2024-03-04T14:58:45.751382+0000, chain.objs.size()=1 2024-03-04T13:00:15.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.983+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.661__shadow:dxbkeaWnohShYiqBRb2AtMcETDh9r.U_.OdLKS6XA0AHI1Aw4qc1iTmqULD-QRoB_0 2024-03-04T13:00:15.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.986+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17202762854182100668', time=2024-03-04T14:58:46.178382+0000, chain.objs.size()=1 2024-03-04T13:00:15.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.986+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.662__shadow:3kPZ5wrAt4E9BOIkNLPKtfGjw2xRNjA_.ab6ug7zRhNJ3Di9WGXvSTZlbkx7pYoi_0 2024-03-04T13:00:15.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.986+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4242616057972141907', time=2024-03-04T14:59:01.726217+0000, chain.objs.size()=1 2024-03-04T13:00:15.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.986+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.676__shadow:PFeFNII1.B-L4ifyriyJ.vsDNjvlAtI_.Lx302pU_kwXmJ4iIqLvISNYoxzH3mJe_0 2024-03-04T13:00:15.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.989+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:15.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.992+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T13:00:16.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.993+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.993+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43297' 2024-03-04T13:00:16.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13548975889735331534', time=2024-03-04T14:52:50.489551+0000, chain.objs.size()=1 2024-03-04T13:00:16.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.134__shadow_.aQ3O8IV6wQ7z7r54HZUAejZT6Gb18J0_0 2024-03-04T13:00:16.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7321107927724262891', time=2024-03-04T14:53:11.276774+0000, chain.objs.size()=1 2024-03-04T13:00:16.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.174__shadow_.WQMUVpK0gTvQNEztC0NM9mSG8ZAyZWT_0 2024-03-04T13:00:16.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10447833037761285106', time=2024-03-04T14:53:36.110646+0000, chain.objs.size()=1 2024-03-04T13:00:16.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.216__shadow_._E9uFx2nmxODgvdMqk3EaxBeR-drfpz_0 2024-03-04T13:00:16.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17879295352960763095', time=2024-03-04T14:53:36.938423+0000, chain.objs.size()=1 2024-03-04T13:00:16.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.217__shadow_.cZ_8CoG1c6ewJM4Dgooym86ms1oOezX_0 2024-03-04T13:00:16.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10845483093897097964', time=2024-03-04T14:53:41.772888+0000, chain.objs.size()=1 2024-03-04T13:00:16.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.228__shadow_.Bdej0Qo6krJJ0jTk8TJ2RBr2sGSS8pu_0 2024-03-04T13:00:16.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14330421510208626907', time=2024-03-04T14:53:52.042113+0000, chain.objs.size()=1 2024-03-04T13:00:16.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.z1zBkhumlpKtFxCiisn7PJ_Y2D6tk8u_0 2024-03-04T13:00:16.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14191344944127890367', time=2024-03-04T14:53:52.048187+0000, chain.objs.size()=1 2024-03-04T13:00:16.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.dThURC1undkvzNUPa0Zco8nCPWaiUOg_0 2024-03-04T13:00:16.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15800958272240497660', time=2024-03-04T14:53:52.060054+0000, chain.objs.size()=1 2024-03-04T13:00:16.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yeZsvYDXEsJsz7zetl2M59qv8eeUTRp_0 2024-03-04T13:00:16.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2101483053206672792', time=2024-03-04T14:53:52.069250+0000, chain.objs.size()=1 2024-03-04T13:00:16.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ah0FPsrxL-5AE67gonFDt5jJJHsF7zG_0 2024-03-04T13:00:16.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15027276121457838569', time=2024-03-04T14:53:52.076633+0000, chain.objs.size()=1 2024-03-04T13:00:16.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.T7_Oz3pgF5Ft3dN7WtcDUu1XjPYxuiX_0 2024-03-04T13:00:16.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7863129414173045685', time=2024-03-04T14:53:52.082356+0000, chain.objs.size()=1 2024-03-04T13:00:16.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.fSppq55Mvx1eBeXXbPaaP8NR0R77kiJ_0 2024-03-04T13:00:16.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9094899823716725437', time=2024-03-04T14:53:52.217455+0000, chain.objs.size()=1 2024-03-04T13:00:16.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.994+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.nPSx0NS_zcojT5ojitgiEQhaUH44dO5_0 2024-03-04T13:00:16.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15114956312231231292', time=2024-03-04T14:53:52.264789+0000, chain.objs.size()=1 2024-03-04T13:00:16.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.XZQoq2H_bJhG3d3PrAyAx_SVL6FRpSv_0 2024-03-04T13:00:16.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5995004302283378576', time=2024-03-04T14:53:52.289275+0000, chain.objs.size()=1 2024-03-04T13:00:16.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.fQuNvMShCiNjQYbsX2-aJ9MKoPzkmhy_0 2024-03-04T13:00:16.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5775230856122766165', time=2024-03-04T14:53:52.295334+0000, chain.objs.size()=1 2024-03-04T13:00:16.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GDlnOXYen1KKS_QQaKAdEixxQLz7QhC_0 2024-03-04T13:00:16.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10503922311448848277', time=2024-03-04T14:53:52.296608+0000, chain.objs.size()=1 2024-03-04T13:00:16.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.uL4zzWlzG6J3_iBrXXqHBqXiGfXgYeW_0 2024-03-04T13:00:16.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8057603151052817585', time=2024-03-04T14:53:52.309418+0000, chain.objs.size()=1 2024-03-04T13:00:16.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.MpyFt5MgSwEW3guc5KKYcv9YyOaQPLH_0 2024-03-04T13:00:16.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2900458915301407165', time=2024-03-04T14:53:52.400561+0000, chain.objs.size()=1 2024-03-04T13:00:16.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.43TA9kQhrhpU_ANfcGJ6kvbAmq0qdQc_0 2024-03-04T13:00:16.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16180725832255532315', time=2024-03-04T14:53:52.422524+0000, chain.objs.size()=1 2024-03-04T13:00:16.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.IP5cPr0ao0QoiKq0u71o9-9aMrGmtGy_0 2024-03-04T13:00:16.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3557185803386006358', time=2024-03-04T14:53:52.449223+0000, chain.objs.size()=1 2024-03-04T13:00:16.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ufwXruehZpFJAw_cQK6NMnVnt4GQDpQ_0 2024-03-04T13:00:16.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4908889631403668534', time=2024-03-04T14:53:52.474328+0000, chain.objs.size()=1 2024-03-04T13:00:16.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.996+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.enN5hpg62rdDt_v3gUbedMserhk6glL_0 2024-03-04T13:00:16.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.997+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10743393200853206765', time=2024-03-04T14:53:52.485290+0000, chain.objs.size()=1 2024-03-04T13:00:16.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.997+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.z1aZp_I-7hUyHu4qU9s8Bkehfzg5EtR_0 2024-03-04T13:00:16.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.997+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8686368219574854911', time=2024-03-04T14:53:52.568402+0000, chain.objs.size()=1 2024-03-04T13:00:16.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.997+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._VZIizsTJLBAiktwHsl8ixjrrdBFxHE_0 2024-03-04T13:00:16.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6167461115039975093', time=2024-03-04T14:53:52.619767+0000, chain.objs.size()=1 2024-03-04T13:00:16.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.lJoCo84K8Y6hGaml7rg3gJqgAf2tWoB_0 2024-03-04T13:00:16.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10078548086740621150', time=2024-03-04T14:53:52.643608+0000, chain.objs.size()=1 2024-03-04T13:00:16.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HMbTcZYxU_XTizVkmVaq2psHy-5H_bN_0 2024-03-04T13:00:16.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1546655177588183087', time=2024-03-04T14:53:52.792924+0000, chain.objs.size()=1 2024-03-04T13:00:16.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zBfTcMHd-KNRtaQj7BnpxfEnWqn84Sg_0 2024-03-04T13:00:16.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14847450332696355030', time=2024-03-04T14:53:52.801587+0000, chain.objs.size()=1 2024-03-04T13:00:16.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.younNvGEXBUo5ybF9YlGV5b15JDJxIB_0 2024-03-04T13:00:16.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2962215631664830126', time=2024-03-04T14:53:52.824896+0000, chain.objs.size()=1 2024-03-04T13:00:16.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PvvHgNxCZlzSx--vXeYsp6M1s87Su0t_0 2024-03-04T13:00:16.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16846905705947260033', time=2024-03-04T14:53:52.953158+0000, chain.objs.size()=1 2024-03-04T13:00:16.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8wYv0MnfmDYyvpYkw14NmDpQloLNDfv_0 2024-03-04T13:00:16.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.512467132090202969', time=2024-03-04T14:53:52.993237+0000, chain.objs.size()=1 2024-03-04T13:00:16.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HAou2dp0RKxI4-sKgUDvTipw7WUrFSw_0 2024-03-04T13:00:16.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9936268558094057492', time=2024-03-04T14:53:52.999871+0000, chain.objs.size()=1 2024-03-04T13:00:16.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.hKQ1F--lEAFaejl1I4uMsU0R4Nv3yTC_0 2024-03-04T13:00:16.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3506122020063837269', time=2024-03-04T14:53:53.102547+0000, chain.objs.size()=1 2024-03-04T13:00:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.w5BfiZ-a85YEHjKITMPROeTJ6Snz1Wg_0 2024-03-04T13:00:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8788578812881723781', time=2024-03-04T14:53:53.145262+0000, chain.objs.size()=1 2024-03-04T13:00:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.DcNpXf0-PYCJIoDgm2hSnWJ6ubYimFD_0 2024-03-04T13:00:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6172094714490185758', time=2024-03-04T14:53:53.145968+0000, chain.objs.size()=1 2024-03-04T13:00:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:15.999+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YUSsaslGnbWud9PbYEQOd-Ue0CwnN26_0 2024-03-04T13:00:16.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.001+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17612508403822611617', time=2024-03-04T14:53:53.150295+0000, chain.objs.size()=1 2024-03-04T13:00:16.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.001+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wm9Mg9tmh8D-vjPCQnDNfq2fx2TELSM_0 2024-03-04T13:00:16.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.001+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12123396418324621977', time=2024-03-04T14:53:53.151248+0000, chain.objs.size()=1 2024-03-04T13:00:16.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.001+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.XH-M_37PpXj7YpLW8bNh3RfYGuiY-ra_0 2024-03-04T13:00:16.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.001+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9839888804330015823', time=2024-03-04T14:53:53.168781+0000, chain.objs.size()=1 2024-03-04T13:00:16.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.001+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3IrNpitQWngKElEcrtuIsjjKx1Z9K3v_0 2024-03-04T13:00:16.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17409683711995760779', time=2024-03-04T14:53:53.250055+0000, chain.objs.size()=1 2024-03-04T13:00:16.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-iyZSy3YgQ2DVky36OjK5o2sosjUElZ_0 2024-03-04T13:00:16.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1417023760885422075', time=2024-03-04T14:53:53.266223+0000, chain.objs.size()=1 2024-03-04T13:00:16.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.y1aIDgQOnh5JfSDoFVpoQSgSaAVcAmy_0 2024-03-04T13:00:16.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7765156850732928074', time=2024-03-04T14:53:53.285771+0000, chain.objs.size()=1 2024-03-04T13:00:16.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LPVMU1sbLSSFaWEUso3HDssYnMnYdOh_0 2024-03-04T13:00:16.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4278346028776327595', time=2024-03-04T14:53:56.132224+0000, chain.objs.size()=1 2024-03-04T13:00:16.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.239__shadow_.lnkncI7eT_GK3xsuZXm5pMEho9ohRUe_0 2024-03-04T13:00:16.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8518551107317256032', time=2024-03-04T14:53:56.132984+0000, chain.objs.size()=1 2024-03-04T13:00:16.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.239__shadow_.Q6Andq_UGpwF7wyICpG0NNd0DA9_3Wf_0 2024-03-04T13:00:16.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13615437811804069992', time=2024-03-04T14:53:56.993210+0000, chain.objs.size()=1 2024-03-04T13:00:16.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.241__shadow_.NXFH3mt3VnAhyQJRPT1J1CxRgfhdIcM_0 2024-03-04T13:00:16.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17159885342587271759', time=2024-03-04T14:53:59.696865+0000, chain.objs.size()=1 2024-03-04T13:00:16.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.247__shadow_.VPGMqySvnVGKHsCMtRRZMHLl6cTNdeH_0 2024-03-04T13:00:16.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15075074007565904922', time=2024-03-04T14:54:09.039483+0000, chain.objs.size()=1 2024-03-04T13:00:16.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.7TKr11lY2dJREnpV5f6svT7pJsY7CZv_0 2024-03-04T13:00:16.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.004+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7749052624574864152', time=2024-03-04T14:54:10.807906+0000, chain.objs.size()=1 2024-03-04T13:00:16.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.004+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.270__shadow_.0G3L6FxIHAzfh86KrJuIuZrC4uuBDrj_0 2024-03-04T13:00:16.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.004+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11033064952062656746', time=2024-03-04T14:54:13.561331+0000, chain.objs.size()=1 2024-03-04T13:00:16.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.004+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.276__shadow_.s5YwnL-M7HCi6oYy6GfUvii1BUfu2lM_0 2024-03-04T13:00:16.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.004+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1859069604993934319', time=2024-03-04T14:54:29.618582+0000, chain.objs.size()=1 2024-03-04T13:00:16.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.004+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cv32fenw4ig22lcni1k8E_kwi9EdlZ8_0 2024-03-04T13:00:16.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.004+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16088148563053849904', time=2024-03-04T14:54:29.651540+0000, chain.objs.size()=1 2024-03-04T13:00:16.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.004+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.9nph6g1cUg1I7TPUQhx_2zEOAICdPUa_0 2024-03-04T13:00:16.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3169222842619222626', time=2024-03-04T14:54:29.679363+0000, chain.objs.size()=1 2024-03-04T13:00:16.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.c08_by9IUhFROReFn6Wr-Vt6nE6LM0L_0 2024-03-04T13:00:16.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10177809708802740571', time=2024-03-04T14:54:29.691128+0000, chain.objs.size()=1 2024-03-04T13:00:16.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.BpsFm3rWUpIc1gASG-0e1fOfetrYfbT_0 2024-03-04T13:00:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11132371194889188601', time=2024-03-04T14:54:29.805783+0000, chain.objs.size()=1 2024-03-04T13:00:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.EXGVarE8RHAOeBjIa3YvdRvlA0pTpQK_0 2024-03-04T13:00:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9360492908632989302', time=2024-03-04T14:54:29.814861+0000, chain.objs.size()=1 2024-03-04T13:00:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.d37WjMiVpj3b7rxBY6PdjSkAU-6__TJ_0 2024-03-04T13:00:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15825804955563258750', time=2024-03-04T14:54:29.838231+0000, chain.objs.size()=1 2024-03-04T13:00:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ym_O8Szwc6pFHpPRwcxXHlhEzksCzYD_0 2024-03-04T13:00:16.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10225264959065996709', time=2024-03-04T14:54:29.862061+0000, chain.objs.size()=1 2024-03-04T13:00:16.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ZLyG8_gDM03pcFEMWnucF0Ixf1nqStN_0 2024-03-04T13:00:16.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8894662601498351034', time=2024-03-04T14:54:29.862931+0000, chain.objs.size()=1 2024-03-04T13:00:16.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.MTDk44V7xRKzUHSZH8a9n-Qs73PkapD_0 2024-03-04T13:00:16.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2754354858000351010', time=2024-03-04T14:54:29.944577+0000, chain.objs.size()=1 2024-03-04T13:00:16.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.005+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.8NAY6i-bO-nMKAT8WDxcbOxEAH5gwYa_0 2024-03-04T13:00:16.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7570388717311038504', time=2024-03-04T14:54:29.951560+0000, chain.objs.size()=1 2024-03-04T13:00:16.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Fd7X4BMKC_YQjic_O2iwPByNmUqsASp_0 2024-03-04T13:00:16.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.338551468588271391', time=2024-03-04T14:54:29.978419+0000, chain.objs.size()=1 2024-03-04T13:00:16.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ekMWI0rwbI2E_wTOCe7CsSGgTjPoiw-_0 2024-03-04T13:00:16.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14453848611269761776', time=2024-03-04T14:54:30.007477+0000, chain.objs.size()=1 2024-03-04T13:00:16.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.AFdhQUgj9Y2DIYQGROzPpYVBbibrvkq_0 2024-03-04T13:00:16.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.007+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13309106452164385329', time=2024-03-04T14:54:30.146514+0000, chain.objs.size()=1 2024-03-04T13:00:16.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.007+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.bpxeWNuj9Hhna9xcewoJryOEz9mB6l1_0 2024-03-04T13:00:16.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13374831551795145898', time=2024-03-04T14:54:30.161794+0000, chain.objs.size()=1 2024-03-04T13:00:16.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.DP_0Cxy2uxPjowSU0n_CGdL3L794HS5_0 2024-03-04T13:00:16.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8116488197597814091', time=2024-03-04T14:54:30.168872+0000, chain.objs.size()=1 2024-03-04T13:00:16.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HLB1VnLXQ58zMKQRHrqgayQV8wX2W2p_0 2024-03-04T13:00:16.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11193525423557987441', time=2024-03-04T14:54:30.183662+0000, chain.objs.size()=1 2024-03-04T13:00:16.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.A04GfBBZQYbaqN_Jhvn5p9zwWCCWPcL_0 2024-03-04T13:00:16.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13787309903137290057', time=2024-03-04T14:54:30.186707+0000, chain.objs.size()=1 2024-03-04T13:00:16.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5MfiAxahgVSjP9MobilMi5MwengYOeu_0 2024-03-04T13:00:16.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6327494218912638811', time=2024-03-04T14:54:30.274605+0000, chain.objs.size()=1 2024-03-04T13:00:16.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cW5vh96ejY3lms4wqRyJy1eXu3QAbMf_0 2024-03-04T13:00:16.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2871290337924221066', time=2024-03-04T14:54:30.293089+0000, chain.objs.size()=1 2024-03-04T13:00:16.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.AZEvVnLiFpLeezhGGjzUcwTdv_Oyy91_0 2024-03-04T13:00:16.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2360996300197551399', time=2024-03-04T14:54:30.295949+0000, chain.objs.size()=1 2024-03-04T13:00:16.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4YNdmp7E02wguU5S4JowUfPfYlVN0WE_0 2024-03-04T13:00:16.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.010+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14873931375533973512', time=2024-03-04T14:54:30.302929+0000, chain.objs.size()=1 2024-03-04T13:00:16.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.010+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.T60Z1JY7JmReq01CsmmflM5EXGq5OKx_0 2024-03-04T13:00:16.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.010+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17626592538581933934', time=2024-03-04T14:54:30.332630+0000, chain.objs.size()=1 2024-03-04T13:00:16.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.010+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.BH3WiAkkXAMJj8E_30pxi8D21FPqd3l_0 2024-03-04T13:00:16.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.010+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6387461876271054813', time=2024-03-04T14:54:30.421098+0000, chain.objs.size()=1 2024-03-04T13:00:16.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.010+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FfwnoDm_v8kOPKKS0Dqn1QIu9zKBPa__0 2024-03-04T13:00:16.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.010+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8904783629398915152', time=2024-03-04T14:54:30.477589+0000, chain.objs.size()=1 2024-03-04T13:00:16.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.010+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.biaiKJnKeddPOoUd7FBGrf-SVQsU565_0 2024-03-04T13:00:16.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.011+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3557540314908321663', time=2024-03-04T14:54:30.632565+0000, chain.objs.size()=1 2024-03-04T13:00:16.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.011+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.u3UiQYEMrj90Dtp5U2yH-xeMat6ZLeE_0 2024-03-04T13:00:16.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.011+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12987306305308211697', time=2024-03-04T14:54:30.634012+0000, chain.objs.size()=1 2024-03-04T13:00:16.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.011+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.1Heq8nKpo5Y2xGqzW54i36YUT9DRRQb_0 2024-03-04T13:00:16.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12323112169450478943', time=2024-03-04T14:54:30.642609+0000, chain.objs.size()=1 2024-03-04T13:00:16.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.e29HqgTvFLwYMN1PNWkQ04sETMosBkH_0 2024-03-04T13:00:16.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16393156190529218619', time=2024-03-04T14:54:30.751936+0000, chain.objs.size()=1 2024-03-04T13:00:16.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.6qpT7S1WKyWjp3HCMV5dwDFVQOHdKpG_0 2024-03-04T13:00:16.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1656740332931605575', time=2024-03-04T14:54:38.295333+0000, chain.objs.size()=1 2024-03-04T13:00:16.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.dWbw7EPkJnKGPBSnnApDkue61Col5eP_0 2024-03-04T13:00:16.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1310797975243841556', time=2024-03-04T14:54:38.301346+0000, chain.objs.size()=1 2024-03-04T13:00:16.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.CrKQEgVz_AqJNaHpBGQWAPZVtU2n7y-_0 2024-03-04T13:00:16.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.982680934329777356', time=2024-03-04T14:54:38.333010+0000, chain.objs.size()=1 2024-03-04T13:00:16.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.yL3UcTyKgy9lMLaI_P2Ac8x1fqZBNmy_0 2024-03-04T13:00:16.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7704118249931036919', time=2024-03-04T14:54:38.359118+0000, chain.objs.size()=1 2024-03-04T13:00:16.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ecFFJ1VxLUY5n6DZE9CyeNvcBP3FR00_0 2024-03-04T13:00:16.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17867776409640217791', time=2024-03-04T14:54:38.366270+0000, chain.objs.size()=1 2024-03-04T13:00:16.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eiU-gqB6VaxTO5eprDsKPWmbZULclhi_0 2024-03-04T13:00:16.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17313256249361672068', time=2024-03-04T14:54:38.470055+0000, chain.objs.size()=1 2024-03-04T13:00:16.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VZXcpgg45RAgK4s6jXfI0e4Q8kPo6eP_0 2024-03-04T13:00:16.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18369618701633530612', time=2024-03-04T14:54:38.474964+0000, chain.objs.size()=1 2024-03-04T13:00:16.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pghD3ByKg7H13RFiJu3I1a5AoRDqlS6_0 2024-03-04T13:00:16.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8481268261755418390', time=2024-03-04T14:54:38.493430+0000, chain.objs.size()=1 2024-03-04T13:00:16.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.012+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eVgnDom-9t9jQqtEu0TdaoY6lS7KskX_0 2024-03-04T13:00:16.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.013+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4084287079461568998', time=2024-03-04T14:54:38.500899+0000, chain.objs.size()=1 2024-03-04T13:00:16.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.013+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cvpd1WYINw-FU6_gGtK2vC64YMOHq9x_0 2024-03-04T13:00:16.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.014+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6150311163536272403', time=2024-03-04T14:54:38.789038+0000, chain.objs.size()=1 2024-03-04T13:00:16.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.014+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Y9sc3uRP1CBu_-UC8rJzre_4tjGp6BJ_0 2024-03-04T13:00:16.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.014+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5989753154717866901', time=2024-03-04T14:54:38.957520+0000, chain.objs.size()=1 2024-03-04T13:00:16.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.014+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.vsxzrZJlL6wuY7S52PLsGI1koQFUCz5_0 2024-03-04T13:00:16.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.018+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12797744181139812195', time=2024-03-04T14:54:38.966734+0000, chain.objs.size()=1 2024-03-04T13:00:16.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.018+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.RYdgMhKyi2ufz6Z6Pnwa5waf1AYVe4e_0 2024-03-04T13:00:16.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.018+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9878417846552313848', time=2024-03-04T14:54:38.970345+0000, chain.objs.size()=1 2024-03-04T13:00:16.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.018+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.JpBOOdcXEPPsG2dehzaBk6LXd8PNKHi_0 2024-03-04T13:00:16.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2708747222636936976', time=2024-03-04T14:54:39.021264+0000, chain.objs.size()=1 2024-03-04T13:00:16.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.9s4JZIW6FAPdR9Ch5yTWmn-2MiOsnD7_0 2024-03-04T13:00:16.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8176094520824992413', time=2024-03-04T14:54:39.170644+0000, chain.objs.size()=1 2024-03-04T13:00:16.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.9HTrojI1FzcuA1zNwIggdKuE-WNja7X_0 2024-03-04T13:00:16.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12577752864615724769', time=2024-03-04T14:54:39.189027+0000, chain.objs.size()=1 2024-03-04T13:00:16.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.6rAfdTCxXndDJ0_yqVyuEEsnkUppDxq_0 2024-03-04T13:00:16.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12797188496070060756', time=2024-03-04T14:54:39.322636+0000, chain.objs.size()=1 2024-03-04T13:00:16.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.sMb2emGaKL1Om7ZuzMR0HGz73Msq27m_0 2024-03-04T13:00:16.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2237624417815564519', time=2024-03-04T14:54:39.324999+0000, chain.objs.size()=1 2024-03-04T13:00:16.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-BK1Stvv-o_w3NnyV1FcR0N-gv_8yRO_0 2024-03-04T13:00:16.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8319800797232602429', time=2024-03-04T14:54:39.334901+0000, chain.objs.size()=1 2024-03-04T13:00:16.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.AqTLLugT1kRwEV4bQErLGvDc5UDNjQJ_0 2024-03-04T13:00:16.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2685062487384364626', time=2024-03-04T14:54:39.335944+0000, chain.objs.size()=1 2024-03-04T13:00:16.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.OPd_Q3GHG-YJvMeF8e8tr9j8RNufObo_0 2024-03-04T13:00:16.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12710019618712059586', time=2024-03-04T14:54:39.422644+0000, chain.objs.size()=1 2024-03-04T13:00:16.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.txWRZ4ZSQ1U_9ovaRE8AyLPCY-f3M4X_0 2024-03-04T13:00:16.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5809901915928498053', time=2024-03-04T14:54:39.441567+0000, chain.objs.size()=1 2024-03-04T13:00:16.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.020+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Wbh6qJQOsWvKiqpWrfZieNogJOThxEM_0 2024-03-04T13:00:16.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10634058974878237923', time=2024-03-04T14:54:39.444432+0000, chain.objs.size()=1 2024-03-04T13:00:16.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VEUE-HfLLbRdCHDW9YYWpsNRlthoL-V_0 2024-03-04T13:00:16.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5640981325595561071', time=2024-03-04T14:54:39.467049+0000, chain.objs.size()=1 2024-03-04T13:00:16.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.yh5Tz9nw-Zl1eWK2q161RxMU3ArTWdT_0 2024-03-04T13:00:16.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.024+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/43297 2024-03-04T13:00:16.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-03-04T13:00:16.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11803871060715950268', time=2024-03-04T14:54:39.484459+0000, chain.objs.size()=1 2024-03-04T13:00:16.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.f42E7uz1dnsWll2ebxOGn1x2LYX3YDA_0 2024-03-04T13:00:16.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7467505851134824825', time=2024-03-04T14:54:44.535165+0000, chain.objs.size()=1 2024-03-04T13:00:16.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.309__shadow_.-yBGEtP28LnI3fhx1cywgadxZTqJA8Q_0 2024-03-04T13:00:16.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11065165277730959234', time=2024-03-04T14:55:51.136474+0000, chain.objs.size()=1 2024-03-04T13:00:16.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.453__shadow_.nPNiIIw7M5gtqw5ZLSlBKrV5JdqPNaH_0 2024-03-04T13:00:16.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P', time=2024-03-04T14:56:14.114246+0000, chain.objs.size()=2 2024-03-04T13:00:16.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P.1 2024-03-04T13:00:16.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.2~HuiYUhIUSDN-_AX_OACQI0NcDSUr25P.1_1 2024-03-04T13:00:16.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10172400084293782502', time=2024-03-04T14:57:03.653211+0000, chain.objs.size()=1 2024-03-04T13:00:16.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.520__shadow_.7-SlhHTLqT_c87ZFTV3lp8xaDVMQfja_0 2024-03-04T13:00:16.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7243255021149471134', time=2024-03-04T14:57:08.989053+0000, chain.objs.size()=1 2024-03-04T13:00:16.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.529__shadow_.WKv1IArgpbBHWtsmCazgsvJsT9-bnSN_0 2024-03-04T13:00:16.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5220820716587411732', time=2024-03-04T14:57:18.782197+0000, chain.objs.size()=1 2024-03-04T13:00:16.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:PCWzkLakt-3.0w5lQo0JD.euhWaqhK2_.vZ-_wB_y8P_pPh-lpW54d85wEgJZiix_0 2024-03-04T13:00:16.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12006110133464235300', time=2024-03-04T14:57:20.768860+0000, chain.objs.size()=1 2024-03-04T13:00:16.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:UfjGOq1HTHL4v9zKj5Zk.RM0feXfV7E_.MggWk5UpCC3PVb9DQWGv7Rh7uIOmhz-_0 2024-03-04T13:00:16.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10649646989172360193', time=2024-03-04T14:57:25.449111+0000, chain.objs.size()=1 2024-03-04T13:00:16.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.541__shadow_.c5fznFpdu-ZH9oGFx6hcI_XsSC4i9Nh_0 2024-03-04T13:00:16.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3879135207966181655', time=2024-03-04T14:58:25.324433+0000, chain.objs.size()=1 2024-03-04T13:00:16.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.613__shadow_.JaRROLXT6obHpP2TflSCgYxrGjbCIjN_0 2024-03-04T13:00:16.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1175090665574027448', time=2024-03-04T14:58:30.776130+0000, chain.objs.size()=6 2024-03-04T13:00:16.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.622__multipart_bar.2~mEKa5zKAd-RScPOoYpALZ88uU_IAAk_.1 2024-03-04T13:00:16.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.029+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.622__multipart_bar.2~mEKa5zKAd-RScPOoYpALZ88uU_IAAk_.2 2024-03-04T13:00:16.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.029+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.622__multipart_bar.2~mEKa5zKAd-RScPOoYpALZ88uU_IAAk_.3 2024-03-04T13:00:16.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.029+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.622__multipart_bar.2~mEKa5zKAd-RScPOoYpALZ88uU_IAAk_.4 2024-03-04T13:00:16.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.029+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.622__multipart_bar.2~mEKa5zKAd-RScPOoYpALZ88uU_IAAk_.5 2024-03-04T13:00:16.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.622__multipart_bar.2~mEKa5zKAd-RScPOoYpALZ88uU_IAAk_.6 2024-03-04T13:00:16.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6737183716643826007', time=2024-03-04T14:59:01.294336+0000, chain.objs.size()=1 2024-03-04T13:00:16.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.675__shadow:D18nJS.fStC4A7QTP0JVepLkeqff7l6_.eRcmVGJn9wfhkGHOWMJ6BB8FD9HB0pq_0 2024-03-04T13:00:16.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.231574517353187396', time=2024-03-04T14:59:18.357113+0000, chain.objs.size()=20 2024-03-04T13:00:16.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__multipart_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.1 2024-03-04T13:00:16.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__shadow_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.1_1 2024-03-04T13:00:16.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__multipart_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.2 2024-03-04T13:00:16.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__shadow_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.2_1 2024-03-04T13:00:16.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__multipart_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.3 2024-03-04T13:00:16.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__shadow_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.3_1 2024-03-04T13:00:16.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__multipart_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.4 2024-03-04T13:00:16.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__shadow_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.4_1 2024-03-04T13:00:16.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.031+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__multipart_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.5 2024-03-04T13:00:16.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.033+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__shadow_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.5_1 2024-03-04T13:00:16.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.036+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__multipart_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.6 2024-03-04T13:00:16.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.036+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__shadow_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.6_1 2024-03-04T13:00:16.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.036+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__multipart_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.7 2024-03-04T13:00:16.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.036+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__shadow_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.7_1 2024-03-04T13:00:16.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.036+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__multipart_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.8 2024-03-04T13:00:16.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.036+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__shadow_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.8_1 2024-03-04T13:00:16.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.036+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__multipart_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.9 2024-03-04T13:00:16.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.037+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__shadow_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.9_1 2024-03-04T13:00:16.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.037+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__multipart_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.10 2024-03-04T13:00:16.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.037+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.692__shadow_foo.2~0wFIeo8MTEsE1cYLypnJ86ilpq70RyC.10_1 2024-03-04T13:00:16.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.040+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.042+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T13:00:16.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.044+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.044+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47142' 2024-03-04T13:00:16.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='__cCrWQC8WMZbUr9aEZtj7V8W0dINfMv', time=2024-03-04T14:52:58.398325+0000, chain.objs.size()=1 2024-03-04T13:00:16.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.ucdeaDr4UQuVlg84-7yoPg00KEqAgMj_0 2024-03-04T13:00:16.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4633183326898487660', time=2024-03-04T14:53:32.818872+0000, chain.objs.size()=1 2024-03-04T13:00:16.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.210__shadow_.H-9DJoKkHT4L19FQRR-YhhYGNtTq2Rs_0 2024-03-04T13:00:16.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16282354128667036170', time=2024-03-04T14:53:39.081144+0000, chain.objs.size()=1 2024-03-04T13:00:16.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.222__shadow_.Qu8LK6wkhIaazZh04EDWtpw4NFID5Eg_0 2024-03-04T13:00:16.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16785501527553219264', time=2024-03-04T14:53:41.772292+0000, chain.objs.size()=1 2024-03-04T13:00:16.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.228__shadow_.JIjpfo5juC7vBcL8JaggzbzSNiNrcXi_0 2024-03-04T13:00:16.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8428343725125618937', time=2024-03-04T14:53:42.665830+0000, chain.objs.size()=1 2024-03-04T13:00:16.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.230__shadow_.M_z-cPVI06XquH3JhFVQklqMgvZT0Wr_0 2024-03-04T13:00:16.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18112238160965165736', time=2024-03-04T14:53:44.380402+0000, chain.objs.size()=1 2024-03-04T13:00:16.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.234__shadow_.qwEHrClFtGYyn5FZGKQ244sZ9k_A91-_0 2024-03-04T13:00:16.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10645423935973784962', time=2024-03-04T14:53:52.044364+0000, chain.objs.size()=1 2024-03-04T13:00:16.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._TpzMRgBSlj4nl6jLJvCOQIGx_Qi5Ly_0 2024-03-04T13:00:16.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11204915364378803776', time=2024-03-04T14:53:52.068732+0000, chain.objs.size()=1 2024-03-04T13:00:16.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.qCOWwjkKaLJbZOrD_WYTzBV7wB7_70o_0 2024-03-04T13:00:16.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2253133960295650522', time=2024-03-04T14:53:52.099256+0000, chain.objs.size()=1 2024-03-04T13:00:16.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.NL4bsostkbSUkpKGv3Vrd1qMM-Fiqn9_0 2024-03-04T13:00:16.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16414850618066832021', time=2024-03-04T14:53:52.119311+0000, chain.objs.size()=1 2024-03-04T13:00:16.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._Or2ojMh4RIT5c6ywrNcTXO8lWg4Ohl_0 2024-03-04T13:00:16.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11794168853386250187', time=2024-03-04T14:53:52.135033+0000, chain.objs.size()=1 2024-03-04T13:00:16.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.fumD_IMjEoRh5NzXjQ07BRG4LpR0aHf_0 2024-03-04T13:00:16.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11037274553318394385', time=2024-03-04T14:53:52.244328+0000, chain.objs.size()=1 2024-03-04T13:00:16.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.9CFljWJLr5kY0ecT0bd_pRNFzZJ6s4z_0 2024-03-04T13:00:16.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.047+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8113421268448165452', time=2024-03-04T14:53:52.249995+0000, chain.objs.size()=1 2024-03-04T13:00:16.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.047+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.sbwKzDCEka_I85ev85TaEURjEZbJUGB_0 2024-03-04T13:00:16.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.047+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14904166010791104189', time=2024-03-04T14:53:52.251139+0000, chain.objs.size()=1 2024-03-04T13:00:16.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.047+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.m4aBmnBooL4kG8ldir1USIiumzwWqi2_0 2024-03-04T13:00:16.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.050+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1039698022703123683', time=2024-03-04T14:53:52.256908+0000, chain.objs.size()=1 2024-03-04T13:00:16.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.050+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0iAbg-G8a9_SjL2Du5McgUmSfj9jyXs_0 2024-03-04T13:00:16.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7699152191640679612', time=2024-03-04T14:53:52.283803+0000, chain.objs.size()=1 2024-03-04T13:00:16.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Sa5zcXbDoPweQbo3jCt3oLf_HJL1Nlp_0 2024-03-04T13:00:16.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6738196104192432403', time=2024-03-04T14:53:52.295801+0000, chain.objs.size()=1 2024-03-04T13:00:16.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.BS3Q9Q0VZBNWL8DX_t2EQOLeYtIZ6TS_0 2024-03-04T13:00:16.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.30348796381228963', time=2024-03-04T14:53:52.412216+0000, chain.objs.size()=1 2024-03-04T13:00:16.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.kvUzOGJ42ivHYdsiADCHeg0dWZ6_Al8_0 2024-03-04T13:00:16.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5657374695509617819', time=2024-03-04T14:53:52.474615+0000, chain.objs.size()=1 2024-03-04T13:00:16.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.uArkJVStU5Dpm2ovV_Qmwezby8nDtMG_0 2024-03-04T13:00:16.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5297779912931131232', time=2024-03-04T14:53:52.477345+0000, chain.objs.size()=1 2024-03-04T13:00:16.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.E2hcuFY0uxvYJNsGWIZhr1vWb37Zdua_0 2024-03-04T13:00:16.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11614233552839149107', time=2024-03-04T14:53:52.597331+0000, chain.objs.size()=1 2024-03-04T13:00:16.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.q7rGc9fFTmXchfX8w_rkdjnQ15Wm81l_0 2024-03-04T13:00:16.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8320384582345798179', time=2024-03-04T14:53:52.646329+0000, chain.objs.size()=1 2024-03-04T13:00:16.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5KHu00THc3Xvyymvy2O_AK7XE1bsstx_0 2024-03-04T13:00:16.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.798097579506916468', time=2024-03-04T14:53:52.740040+0000, chain.objs.size()=1 2024-03-04T13:00:16.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.4MGEtBkqFc4VLZbeHLb-ygEwBKEcu8S_0 2024-03-04T13:00:16.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5564731098608944050', time=2024-03-04T14:53:52.755206+0000, chain.objs.size()=1 2024-03-04T13:00:16.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ROAx0crma2h1nyegOz7gMF-Hau4mHHS_0 2024-03-04T13:00:16.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.50749146588281894', time=2024-03-04T14:53:52.766929+0000, chain.objs.size()=1 2024-03-04T13:00:16.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.052+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.sg7fMhGgywUeT8Nca1UwjgaCTeEwo4s_0 2024-03-04T13:00:16.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.053+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.361730965704250531', time=2024-03-04T14:53:52.804280+0000, chain.objs.size()=1 2024-03-04T13:00:16.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.053+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5GIpjLbnLpnn-9fMyo74PSMBEOS9tWX_0 2024-03-04T13:00:16.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.054+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16225160049748838136', time=2024-03-04T14:53:52.823267+0000, chain.objs.size()=1 2024-03-04T13:00:16.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.054+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.e27MddFosmmiA54yjaQY2Oj5RNrqq5G_0 2024-03-04T13:00:16.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.054+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12032307199431917262', time=2024-03-04T14:53:52.934575+0000, chain.objs.size()=1 2024-03-04T13:00:16.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.054+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.qDwX_Unc2GWh8kukolPdhJK6H2XialY_0 2024-03-04T13:00:16.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3147006235313925491', time=2024-03-04T14:53:52.948351+0000, chain.objs.size()=1 2024-03-04T13:00:16.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.R-uyH5Ons1vwlsStzzZ35rPglLCq_it_0 2024-03-04T13:00:16.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11629734788787466100', time=2024-03-04T14:53:52.951133+0000, chain.objs.size()=1 2024-03-04T13:00:16.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CCjc7E9BEX2JDibge_29QlWmm1brjqu_0 2024-03-04T13:00:16.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13803911984325406581', time=2024-03-04T14:53:52.978030+0000, chain.objs.size()=1 2024-03-04T13:00:16.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.rLbP_-1FYfC4TD7Dk-a7bRRyueUkL6L_0 2024-03-04T13:00:16.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14121464199190256978', time=2024-03-04T14:53:52.980807+0000, chain.objs.size()=1 2024-03-04T13:00:16.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.aMDLbMqBKloqXgKlChbxZZPm4A-gXcA_0 2024-03-04T13:00:16.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6363874772831577202', time=2024-03-04T14:53:53.093049+0000, chain.objs.size()=1 2024-03-04T13:00:16.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.w8tUz0K0CzzNf_n6HAnlw7gqWz-Ujn5_0 2024-03-04T13:00:16.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3739377388169189054', time=2024-03-04T14:53:53.125253+0000, chain.objs.size()=1 2024-03-04T13:00:16.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Mg5yeXBab6b-YEC6VyV0mjL7P-T_iUy_0 2024-03-04T13:00:16.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7079834450062060350', time=2024-03-04T14:53:53.145009+0000, chain.objs.size()=1 2024-03-04T13:00:16.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.kl_8jLRkFyraFCtyVRRge6ra7EXPvSF_0 2024-03-04T13:00:16.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15588099090338820439', time=2024-03-04T14:53:53.162880+0000, chain.objs.size()=1 2024-03-04T13:00:16.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.knuqkgxDXlnwMK9M5sqZEHDKJIl2skj_0 2024-03-04T13:00:16.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16874569400906917822', time=2024-03-04T14:53:53.176293+0000, chain.objs.size()=1 2024-03-04T13:00:16.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.055+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.RICvJZkjV832xPl4Zcazr6EtDrOrXec_0 2024-03-04T13:00:16.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.057+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12136200750188894914', time=2024-03-04T14:53:53.178661+0000, chain.objs.size()=1 2024-03-04T13:00:16.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.057+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.dB4GIHJ5BwInXRi39_I7fT151PFp2R0_0 2024-03-04T13:00:16.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.057+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9305772922036851568', time=2024-03-04T14:53:53.257176+0000, chain.objs.size()=1 2024-03-04T13:00:16.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.057+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8K7p4_XcLPXyma7ckIuwt1cDiLu_aIx_0 2024-03-04T13:00:16.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.128415491208719729', time=2024-03-04T14:53:53.259763+0000, chain.objs.size()=1 2024-03-04T13:00:16.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jqEbWek_1-t6D_ipteTm6P533Aq27x7_0 2024-03-04T13:00:16.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17379413924303714945', time=2024-03-04T14:53:53.293250+0000, chain.objs.size()=1 2024-03-04T13:00:16.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ZFSXz-H4TBv7uWW5dmcISC2SiqsY4_8_0 2024-03-04T13:00:16.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1181447698562885039', time=2024-03-04T14:53:53.323273+0000, chain.objs.size()=1 2024-03-04T13:00:16.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xm-NqoFd04TfqCYRYuM8DCzWc2j5lAZ_0 2024-03-04T13:00:16.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17607012043917857331', time=2024-03-04T14:53:55.735254+0000, chain.objs.size()=1 2024-03-04T13:00:16.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.238__shadow_.s79jUCbSFBgy4GmCcgP9SCYk2g1fR-s_0 2024-03-04T13:00:16.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3741111434655091512', time=2024-03-04T14:54:06.307069+0000, chain.objs.size()=1 2024-03-04T13:00:16.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.262__shadow_.yCxL6_DCjVx0hqZfbrfD8VTehF2qOPJ_0 2024-03-04T13:00:16.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14218051092257993215', time=2024-03-04T14:54:09.027734+0000, chain.objs.size()=1 2024-03-04T13:00:16.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.Dl89bc690mo7DsWoqV9z8McHfrgPdxo_0 2024-03-04T13:00:16.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11384272257153860224', time=2024-03-04T14:54:13.077486+0000, chain.objs.size()=1 2024-03-04T13:00:16.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.275__shadow_.jE8fZugVSO5J7Z749BBhDn3qTpnzKh6_0 2024-03-04T13:00:16.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1312706265621499528', time=2024-03-04T14:54:29.640937+0000, chain.objs.size()=1 2024-03-04T13:00:16.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.q02E3lS2TEt2rbFWplk6P7N9UV1TItF_0 2024-03-04T13:00:16.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.471375677294730919', time=2024-03-04T14:54:29.649498+0000, chain.objs.size()=1 2024-03-04T13:00:16.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.V_Dw6fL9wlUV7B5_-7cX0njBPnH8O9A_0 2024-03-04T13:00:16.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.242478706456521043', time=2024-03-04T14:54:29.652330+0000, chain.objs.size()=1 2024-03-04T13:00:16.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.egICQr4n2JXzNlyuntCU2Sfun7Fel-B_0 2024-03-04T13:00:16.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7944495242791581927', time=2024-03-04T14:54:29.664003+0000, chain.objs.size()=1 2024-03-04T13:00:16.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.OO01B64chJnXzwbMUUN2Mn6PmiAW7Vh_0 2024-03-04T13:00:16.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.060+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7344415164609687830', time=2024-03-04T14:54:29.691183+0000, chain.objs.size()=1 2024-03-04T13:00:16.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.060+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-FzayNUh0yUHsRMuzDCfo-MIoQdowHo_0 2024-03-04T13:00:16.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.060+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2154396051316538276', time=2024-03-04T14:54:29.782352+0000, chain.objs.size()=1 2024-03-04T13:00:16.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.060+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.TneOLdIBwc8RKUqrOUKtEnbQDgooMXk_0 2024-03-04T13:00:16.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.062+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5611660417421225064', time=2024-03-04T14:54:29.790051+0000, chain.objs.size()=1 2024-03-04T13:00:16.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.062+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FM7ZwFGb22wKBn5yigq6x6IKKLJLb0G_0 2024-03-04T13:00:16.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.062+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1319171358685651626', time=2024-03-04T14:54:29.997886+0000, chain.objs.size()=1 2024-03-04T13:00:16.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.062+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7jQnQ8wwlvY196W3GN1dxViI9DaViSl_0 2024-03-04T13:00:16.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.062+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11052828529730353411', time=2024-03-04T14:54:29.999780+0000, chain.objs.size()=1 2024-03-04T13:00:16.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.062+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.--ksOvFsC-IV3sdaZCNfcOxKUJYF5PE_0 2024-03-04T13:00:16.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10036881666616330627', time=2024-03-04T14:54:30.105991+0000, chain.objs.size()=1 2024-03-04T13:00:16.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.eAHydVdUpzyJNOgAYkz2BAE1oKhcJ5Q_0 2024-03-04T13:00:16.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10376508143866434700', time=2024-03-04T14:54:30.126710+0000, chain.objs.size()=1 2024-03-04T13:00:16.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FB8KEkMyVtk7wLiS6ycKJR6oFbTDb1F_0 2024-03-04T13:00:16.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.412145933304522930', time=2024-03-04T14:54:30.260654+0000, chain.objs.size()=1 2024-03-04T13:00:16.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Sl_a1iyt_xkW_A055aWR4yPj7LHeje0_0 2024-03-04T13:00:16.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17861042041494247217', time=2024-03-04T14:54:30.295670+0000, chain.objs.size()=1 2024-03-04T13:00:16.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.vEJrry3w666FJ7Gdm0P-yAeNIqqUwlj_0 2024-03-04T13:00:16.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12309766630964525499', time=2024-03-04T14:54:30.508621+0000, chain.objs.size()=1 2024-03-04T13:00:16.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ccEVwqxZJZy6dYs3duBPYXxSCGGXJhE_0 2024-03-04T13:00:16.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6097349043501044997', time=2024-03-04T14:54:30.593319+0000, chain.objs.size()=1 2024-03-04T13:00:16.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.avvFPbSQaEkQrU6U5Po-JRl-3zVCLlt_0 2024-03-04T13:00:16.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18109965250780576994', time=2024-03-04T14:54:30.604756+0000, chain.objs.size()=1 2024-03-04T13:00:16.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4YZhafh8HWh8kjgc4Q97BueFFY_fFVE_0 2024-03-04T13:00:16.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16833387901417451482', time=2024-03-04T14:54:30.612480+0000, chain.objs.size()=1 2024-03-04T13:00:16.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5agN52Da37B06XRL5ntMH-VGoekUxtU_0 2024-03-04T13:00:16.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.068+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13546664053957514908', time=2024-03-04T14:54:30.617162+0000, chain.objs.size()=1 2024-03-04T13:00:16.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.068+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.pEP6zI8LEzIGZDG8AYllV_sUEHTSW3g_0 2024-03-04T13:00:16.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.068+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4356874382226133695', time=2024-03-04T14:54:30.633667+0000, chain.objs.size()=1 2024-03-04T13:00:16.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.068+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.jYyq0IYSbZUu2uZNDDE4AnHB_C-cqVf_0 2024-03-04T13:00:16.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.068+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5538719896657968785', time=2024-03-04T14:54:30.769384+0000, chain.objs.size()=1 2024-03-04T13:00:16.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.068+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.EvJMX6WI14qeUilMAWT1mYXI_R9NzKU_0 2024-03-04T13:00:16.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18033990775737144697', time=2024-03-04T14:54:30.780281+0000, chain.objs.size()=1 2024-03-04T13:00:16.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.9rZSVxDhOtfT6yIH6jiw2zajTfyJyRr_0 2024-03-04T13:00:16.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7092407871940090850', time=2024-03-04T14:54:30.785815+0000, chain.objs.size()=1 2024-03-04T13:00:16.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.1wvpu4EacfWEqY2u3H2sFAYxqnX_IEA_0 2024-03-04T13:00:16.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5975294508764527296', time=2024-03-04T14:54:38.319733+0000, chain.objs.size()=1 2024-03-04T13:00:16.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.TdcleCU1ZtcylOcrcCuDckISfQpFN51_0 2024-03-04T13:00:16.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17516939911304766982', time=2024-03-04T14:54:38.484599+0000, chain.objs.size()=1 2024-03-04T13:00:16.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.PYXRwql_B4Wid0dX2ZMqKJBZOUUiafe_0 2024-03-04T13:00:16.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4443936646924128874', time=2024-03-04T14:54:38.513556+0000, chain.objs.size()=1 2024-03-04T13:00:16.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tK009hJbjmaUMfq4k-c-imBtu3Muz9v_0 2024-03-04T13:00:16.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10115494751844027101', time=2024-03-04T14:54:38.545943+0000, chain.objs.size()=1 2024-03-04T13:00:16.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kiISmS4ctF6MtegSoZY4sq4EBTsyinZ_0 2024-03-04T13:00:16.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2315811398150843574', time=2024-03-04T14:54:38.634115+0000, chain.objs.size()=1 2024-03-04T13:00:16.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kquFcj5JDZ7W_KkT5dOoAlxkjgWRjLm_0 2024-03-04T13:00:16.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1982372763066407487', time=2024-03-04T14:54:38.642124+0000, chain.objs.size()=1 2024-03-04T13:00:16.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wxQ3es_FRlYhDTo2g5vukfmyMobfdJx_0 2024-03-04T13:00:16.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4261046727206103761', time=2024-03-04T14:54:38.644567+0000, chain.objs.size()=1 2024-03-04T13:00:16.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.aMIlADkij7ppfc0daMF0hzXhCRi0li9_0 2024-03-04T13:00:16.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.073+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1428280580300657393', time=2024-03-04T14:54:38.663480+0000, chain.objs.size()=1 2024-03-04T13:00:16.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.073+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._crQweVb2jHPDPqOGNh04Dh-WFLSG-d_0 2024-03-04T13:00:16.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.073+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11130066228965321122', time=2024-03-04T14:54:38.675915+0000, chain.objs.size()=1 2024-03-04T13:00:16.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.073+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zACDhyGSd0j-O_JBI-KIo4JgYw0COIc_0 2024-03-04T13:00:16.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.073+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12688004077579192741', time=2024-03-04T14:54:38.698989+0000, chain.objs.size()=1 2024-03-04T13:00:16.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.073+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Bx0KETy9ixpdeUmL5mtIUNNqvACwHQo_0 2024-03-04T13:00:16.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4405487637748730059', time=2024-03-04T14:54:38.711463+0000, chain.objs.size()=1 2024-03-04T13:00:16.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.B7kllseYGMIsoKdI-gJv4G33ZVZUOTw_0 2024-03-04T13:00:16.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13138619133548340478', time=2024-03-04T14:54:38.809347+0000, chain.objs.size()=1 2024-03-04T13:00:16.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.JkORqFA3WN4hbFh6sqJ4Fm3Ro7VUZUD_0 2024-03-04T13:00:16.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16834429254452184748', time=2024-03-04T14:54:38.811170+0000, chain.objs.size()=1 2024-03-04T13:00:16.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.6Eqaq1Dw5yVX3EBj_O5s3X_fp3KlfV3_0 2024-03-04T13:00:16.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4899381452887397456', time=2024-03-04T14:54:38.842880+0000, chain.objs.size()=1 2024-03-04T13:00:16.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.C_MX0m4r0qT4U-MN17q3ZSJraauUmvS_0 2024-03-04T13:00:16.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10903599159184832906', time=2024-03-04T14:54:38.962085+0000, chain.objs.size()=1 2024-03-04T13:00:16.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ilhLX6LRV10nXwaF6MSGrXrpjV-cPbf_0 2024-03-04T13:00:16.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12136461098111330269', time=2024-03-04T14:54:39.012919+0000, chain.objs.size()=1 2024-03-04T13:00:16.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.k_jEyhZkhTl-oxBg3fFNY2icOFJqaiy_0 2024-03-04T13:00:16.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6533964997138824211', time=2024-03-04T14:54:39.017823+0000, chain.objs.size()=1 2024-03-04T13:00:16.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.LZfWGfAEtfSGGS09iS4JUZ-cba8EVTM_0 2024-03-04T13:00:16.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13454383842051011434', time=2024-03-04T14:54:39.019790+0000, chain.objs.size()=1 2024-03-04T13:00:16.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ASPtQ8Qsuglpi9FPjZkhC4oiWr7OZTm_0 2024-03-04T13:00:16.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.079+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5028585763962546757', time=2024-03-04T14:54:39.023123+0000, chain.objs.size()=1 2024-03-04T13:00:16.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.079+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pvkIVhcumSL6-qVeVbuYGb6FurXNFTm_0 2024-03-04T13:00:16.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.079+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3860911826213462432', time=2024-03-04T14:54:39.106303+0000, chain.objs.size()=1 2024-03-04T13:00:16.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.079+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Wa9sPJ-yycpFrms7mgOdxkdeCDhqpx__0 2024-03-04T13:00:16.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.079+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.912418920014201088', time=2024-03-04T14:54:39.116291+0000, chain.objs.size()=1 2024-03-04T13:00:16.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.079+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ppoXPreQDu8swtRDW2RUSqp3nLMdGZ0_0 2024-03-04T13:00:16.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7990522467531005366', time=2024-03-04T14:54:39.126890+0000, chain.objs.size()=1 2024-03-04T13:00:16.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KEPD43MTnRUxXRkw8doys9s1oZqjjRc_0 2024-03-04T13:00:16.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2354694934715436474', time=2024-03-04T14:54:39.159180+0000, chain.objs.size()=1 2024-03-04T13:00:16.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Rrs7ayrG10q1ZadNKr-dbb_NiuHThzd_0 2024-03-04T13:00:16.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10966809634570000059', time=2024-03-04T14:54:39.184233+0000, chain.objs.size()=1 2024-03-04T13:00:16.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.BHdFZv1KmXW8OdHY7eBA9qIzrWlPXPb_0 2024-03-04T13:00:16.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4048155865377743884', time=2024-03-04T14:54:39.347462+0000, chain.objs.size()=1 2024-03-04T13:00:16.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.LcFd1N-v3_XAR0SJ5XQ_ApMdFVinqDR_0 2024-03-04T13:00:16.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1525514053542318747', time=2024-03-04T14:54:39.424883+0000, chain.objs.size()=1 2024-03-04T13:00:16.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.8jjtY3B6eC_UsG_3khNCdQEfUaZG6QY_0 2024-03-04T13:00:16.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15570301970246051704', time=2024-03-04T14:54:39.464875+0000, chain.objs.size()=1 2024-03-04T13:00:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ijKxjMemg36Z53cUEDu7fmjM8N7Z_UP_0 2024-03-04T13:00:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3339918565416728862', time=2024-03-04T14:54:47.104275+0000, chain.objs.size()=1 2024-03-04T13:00:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.315__shadow_.9SuT7x-nPsylD74jRAWqPdpYhJphfbm_0 2024-03-04T13:00:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15428598094128451479', time=2024-03-04T14:55:52.267184+0000, chain.objs.size()=1 2024-03-04T13:00:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.455__shadow_.7cAa9wZo5Ms0JLfUNTTDD7QeuE0KOhQ_0 2024-03-04T13:00:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.085+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6917286552291267429', time=2024-03-04T14:55:52.269801+0000, chain.objs.size()=1 2024-03-04T13:00:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.085+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.455__shadow_.7VdPq_zbyY_wOlAig9bKIzgP_iWACUj_0 2024-03-04T13:00:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.085+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.2_774481bcb38492997ca1517cb6945af8', time=2024-03-04T14:56:03.320205+0000, chain.objs.size()=6 2024-03-04T13:00:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.085+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.1 2024-03-04T13:00:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.085+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.2 2024-03-04T13:00:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.086+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.3 2024-03-04T13:00:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.088+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.4 2024-03-04T13:00:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.088+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.5 2024-03-04T13:00:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.088+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.6 2024-03-04T13:00:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.088+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.308802681686160593', time=2024-03-04T14:56:13.397330+0000, chain.objs.size()=3 2024-03-04T13:00:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.088+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.493__multipart_mymultipart.2~MgyH7ljkVPsoa1_-51jpcU07LjCNxpI.1 2024-03-04T13:00:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.088+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.493__multipart_mymultipart.2~MgyH7ljkVPsoa1_-51jpcU07LjCNxpI.2 2024-03-04T13:00:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.088+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.493__multipart_mymultipart.2~MgyH7ljkVPsoa1_-51jpcU07LjCNxpI.3 2024-03-04T13:00:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.094+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/47142 2024-03-04T13:00:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T13:00:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12171752888628051319', time=2024-03-04T14:56:28.174738+0000, chain.objs.size()=1 2024-03-04T13:00:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.500__shadow_.UkaCeIZagy8xPNTxdvT7Mq0puR09a9j_0 2024-03-04T13:00:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17451517587762874883', time=2024-03-04T14:57:08.270427+0000, chain.objs.size()=1 2024-03-04T13:00:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.528__multipart_mymultipart.2~9GZ93Aeo1Ey6Y8tOxZJCwnRvdniGlZk.1 2024-03-04T13:00:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10121446094079773491', time=2024-03-04T14:57:20.496012+0000, chain.objs.size()=1 2024-03-04T13:00:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:6qeP5MWvveLs-L0yB8lTKVJYlI5W3.D_.BJ3vXZVRSIFs5bi1eonxI-2zch8GMD5_0 2024-03-04T13:00:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16606136023301363092', time=2024-03-04T14:57:21.767296+0000, chain.objs.size()=1 2024-03-04T13:00:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:EC9vRu3xqOk4g.vvu6jPkk1W9G1QWdH_.86RtdgfeORLLwVpZd20WZArBEu3jjFX_0 2024-03-04T13:00:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6236347921605377003', time=2024-03-04T14:57:52.139859+0000, chain.objs.size()=1 2024-03-04T13:00:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.553__shadow:wc54Y5E5B.vTDkdtZ0mnZQhsMiXjUjO_.mgUaWM67ek_SjbCjxc3I_y4a-UrewI2_0 2024-03-04T13:00:16.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13500089577382618961', time=2024-03-04T14:58:35.389157+0000, chain.objs.size()=1 2024-03-04T13:00:16.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.096+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.634__shadow_.ZDGtbn6gpVAZe2gFo59xTLkhTC3lVrM_0 2024-03-04T13:00:16.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.098+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.101+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T13:00:16.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.102+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.103+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/69459' 2024-03-04T13:00:16.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7342025039555356636', time=2024-03-04T14:53:32.818102+0000, chain.objs.size()=1 2024-03-04T13:00:16.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.210__shadow_.-pEtMwY-SFdCUp94nNK2ekIflalYfzn_0 2024-03-04T13:00:16.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12390147252947672160', time=2024-03-04T14:53:43.096941+0000, chain.objs.size()=1 2024-03-04T13:00:16.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.231__shadow_.AHj-_mL9upuRLoClSEf-q_PiaritQpu_0 2024-03-04T13:00:16.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1598602148389221539', time=2024-03-04T14:53:43.097760+0000, chain.objs.size()=1 2024-03-04T13:00:16.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.231__shadow_.UBxltclBZv5I5rZ9o5m5MrgTLBJK2XK_0 2024-03-04T13:00:16.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10657570533546763094', time=2024-03-04T14:53:52.098104+0000, chain.objs.size()=1 2024-03-04T13:00:16.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CJhE6zfSQuj7t2d375j0ciwRK9V09Lm_0 2024-03-04T13:00:16.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8842465356699502250', time=2024-03-04T14:53:52.108096+0000, chain.objs.size()=1 2024-03-04T13:00:16.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.N9K1dt1TIgUS1fW84PiPhdHuTLJf8dD_0 2024-03-04T13:00:16.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4258212230620501930', time=2024-03-04T14:53:52.214184+0000, chain.objs.size()=1 2024-03-04T13:00:16.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.FjPm0wDwp7CYQuQnpqd7q5FCSB3QAD-_0 2024-03-04T13:00:16.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15630431686578686510', time=2024-03-04T14:53:52.236787+0000, chain.objs.size()=1 2024-03-04T13:00:16.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.RoNUEijOkjIrW9gR7eZ9o0uaVTigWek_0 2024-03-04T13:00:16.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.171567887156550350', time=2024-03-04T14:53:52.269698+0000, chain.objs.size()=1 2024-03-04T13:00:16.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VxGalk-ItJP6ykb09ZuNU7Jl5_LO6BD_0 2024-03-04T13:00:16.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9335080277335828692', time=2024-03-04T14:53:52.285009+0000, chain.objs.size()=1 2024-03-04T13:00:16.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.FjaqfGBdcpvVtEuqZNnUpd2yO3O-Lr6_0 2024-03-04T13:00:16.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1755563559956231864', time=2024-03-04T14:53:52.412093+0000, chain.objs.size()=1 2024-03-04T13:00:16.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ZXw-Gl0nt9l-HznNLSjjyHtzaOfsbxA_0 2024-03-04T13:00:16.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1188722188842840967', time=2024-03-04T14:53:52.422929+0000, chain.objs.size()=1 2024-03-04T13:00:16.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.33U6m6LLNLXopZCyKWTfRJkrcZNIWmf_0 2024-03-04T13:00:16.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17953853596552867375', time=2024-03-04T14:53:52.567883+0000, chain.objs.size()=1 2024-03-04T13:00:16.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.QsOk0WhuoTJJZUrM-G4JFPEFBibGkrv_0 2024-03-04T13:00:16.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.260936318231149429', time=2024-03-04T14:53:52.612911+0000, chain.objs.size()=1 2024-03-04T13:00:16.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.lAZpZ6VmIv_4VLL19KU0TOHMy8nU1Re_0 2024-03-04T13:00:16.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1741466497244182487', time=2024-03-04T14:53:52.624069+0000, chain.objs.size()=1 2024-03-04T13:00:16.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ist3EiZL-yunh4iMro_HqFJqiJ8xVOF_0 2024-03-04T13:00:16.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.694413927591732295', time=2024-03-04T14:53:52.744898+0000, chain.objs.size()=1 2024-03-04T13:00:16.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.bwbYm6yRLiVzx-C3oqK6eMSWjWEVkea_0 2024-03-04T13:00:16.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10695516413431013545', time=2024-03-04T14:53:52.780691+0000, chain.objs.size()=1 2024-03-04T13:00:16.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GYUaQGzXnrbO0sxAgwxkQYelIMi9wb7_0 2024-03-04T13:00:16.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10668729042538760525', time=2024-03-04T14:53:52.802428+0000, chain.objs.size()=1 2024-03-04T13:00:16.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5fYvCo_ZEuDleBwRDPf2plzi59AM038_0 2024-03-04T13:00:16.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8851245496054648209', time=2024-03-04T14:53:52.805631+0000, chain.objs.size()=1 2024-03-04T13:00:16.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xi8vQnhREZqTNWrI1GvtpWThYyb9bKo_0 2024-03-04T13:00:16.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13748733931587609429', time=2024-03-04T14:53:52.807176+0000, chain.objs.size()=1 2024-03-04T13:00:16.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.uLgfni5I-G3RyUVzibGq2MSu30kcR-O_0 2024-03-04T13:00:16.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2704065231411518409', time=2024-03-04T14:53:52.943901+0000, chain.objs.size()=1 2024-03-04T13:00:16.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.W9O30Y_rfNMxqdqnRTVi04KZNYwlhY6_0 2024-03-04T13:00:16.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11960467680675993583', time=2024-03-04T14:53:52.956268+0000, chain.objs.size()=1 2024-03-04T13:00:16.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._G82M2JDoP5S8zexMQW8HXdE1RzCGqj_0 2024-03-04T13:00:16.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1204218612242642787', time=2024-03-04T14:53:52.958072+0000, chain.objs.size()=1 2024-03-04T13:00:16.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.106+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GyakYScvev_4kunf5UNGEzEHxUcK9HK_0 2024-03-04T13:00:16.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.108+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1748092367224766142', time=2024-03-04T14:53:52.959399+0000, chain.objs.size()=1 2024-03-04T13:00:16.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.108+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.XdqjF8_HrIiEHl5V5iZI50vSQAx-eAt_0 2024-03-04T13:00:16.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.110+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8645572286611754709', time=2024-03-04T14:53:52.981361+0000, chain.objs.size()=1 2024-03-04T13:00:16.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.110+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.QDnuICBCtyqOYrUzGfGsWTkA1o0Mq1I_0 2024-03-04T13:00:16.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1696280416219725965', time=2024-03-04T14:53:53.000127+0000, chain.objs.size()=1 2024-03-04T13:00:16.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CBHekYhuXHbDPGRzzn-QuIueRf9OF5w_0 2024-03-04T13:00:16.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2912884400168231401', time=2024-03-04T14:53:53.117434+0000, chain.objs.size()=1 2024-03-04T13:00:16.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.E83h7HPLXJdR5PY_AfOSm3S3gA6djbm_0 2024-03-04T13:00:16.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17907900638821610035', time=2024-03-04T14:53:53.144019+0000, chain.objs.size()=1 2024-03-04T13:00:16.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.bhX88TPgQTAx6Xivcbb58F1Xo-arroh_0 2024-03-04T13:00:16.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15110240016833576503', time=2024-03-04T14:53:53.268596+0000, chain.objs.size()=1 2024-03-04T13:00:16.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.1AzKeLioeHcqT4jIACY35cWT7JaQNDl_0 2024-03-04T13:00:16.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3092744029241870120', time=2024-03-04T14:53:53.318844+0000, chain.objs.size()=1 2024-03-04T13:00:16.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.4NqPTbaxbrp_ROuXs1EXokKvsuBr9hh_0 2024-03-04T13:00:16.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9650016319101131049', time=2024-03-04T14:53:53.327086+0000, chain.objs.size()=1 2024-03-04T13:00:16.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Wy6TlVR-HdAB2KiWaXj9fPJ0NVQGxnO_0 2024-03-04T13:00:16.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4039596420349168635', time=2024-03-04T14:53:57.880537+0000, chain.objs.size()=1 2024-03-04T13:00:16.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.243__shadow_.ikE4A0d_BHVaCDWXoHCD9RfWwlB6BgE_0 2024-03-04T13:00:16.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.889329366659711753', time=2024-03-04T14:54:01.860084+0000, chain.objs.size()=1 2024-03-04T13:00:16.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.252__shadow_.eGXJpfitgAoox-FwMJUJxlfgvYurGjn_0 2024-03-04T13:00:16.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16651524368803485872', time=2024-03-04T14:54:04.513797+0000, chain.objs.size()=1 2024-03-04T13:00:16.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.258__shadow_.6rSvfLyxuHSIUEgsO1QUdfEwvBs5SEH_0 2024-03-04T13:00:16.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11087638361015374965', time=2024-03-04T14:54:06.306905+0000, chain.objs.size()=1 2024-03-04T13:00:16.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.262__shadow_.6jdAAYP8TVF-KLonFia6phPznpTKbLo_0 2024-03-04T13:00:16.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5618866003001629228', time=2024-03-04T14:54:08.243502+0000, chain.objs.size()=1 2024-03-04T13:00:16.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.e_YRucQ6ow8IksLlWZLENx11jn-PS7T_0 2024-03-04T13:00:16.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18235507530265528208', time=2024-03-04T14:54:11.288197+0000, chain.objs.size()=1 2024-03-04T13:00:16.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.271__shadow_.eUyEzomyTXY2WuOjMlIrm3f7Er3DLIh_0 2024-03-04T13:00:16.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.796329688413891536', time=2024-03-04T14:54:14.427322+0000, chain.objs.size()=1 2024-03-04T13:00:16.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.278__shadow_.tTg6tjsrC1wwA5IHNNlUzhhrPe67MsV_0 2024-03-04T13:00:16.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10469270632834704714', time=2024-03-04T14:54:21.821174+0000, chain.objs.size()=1 2024-03-04T13:00:16.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.295__shadow_.0pwys4wpi0OEGk5WbhduSwVPZrGY_qn_0 2024-03-04T13:00:16.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15270993113183151143', time=2024-03-04T14:54:29.637200+0000, chain.objs.size()=1 2024-03-04T13:00:16.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tIZgcoOd8a2AJ0DxpBa82uFB8uwjeVC_0 2024-03-04T13:00:16.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15144684813844063052', time=2024-03-04T14:54:29.652346+0000, chain.objs.size()=1 2024-03-04T13:00:16.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7cc7Sxx3cKSRCuzeWfTuE5BZK-rZ7aE_0 2024-03-04T13:00:16.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3732522568870293357', time=2024-03-04T14:54:29.666228+0000, chain.objs.size()=1 2024-03-04T13:00:16.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.DfudTMG-8dTT4Tb6P_XF10Cn7DVwDUZ_0 2024-03-04T13:00:16.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4990322105551246372', time=2024-03-04T14:54:29.780449+0000, chain.objs.size()=1 2024-03-04T13:00:16.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.GAXuqi_tRO2YgUzRUTuqrXKEkFLRg4F_0 2024-03-04T13:00:16.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15523905796338767441', time=2024-03-04T14:54:29.788135+0000, chain.objs.size()=1 2024-03-04T13:00:16.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.M8NGFU4bRPGmDX2khdxLXQrGk0fJ_C5_0 2024-03-04T13:00:16.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.114+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17667054453619558616', time=2024-03-04T14:54:29.817256+0000, chain.objs.size()=1 2024-03-04T13:00:16.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.114+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.kuU1pUgqAGjYgf_5Mn1BeA0g4eZqetp_0 2024-03-04T13:00:16.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.114+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16945002661203617216', time=2024-03-04T14:54:29.941887+0000, chain.objs.size()=1 2024-03-04T13:00:16.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.114+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2IzXi7uoO4ngOZiIwdHOvPidP5hagnz_0 2024-03-04T13:00:16.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4512589118240082618', time=2024-03-04T14:54:29.942577+0000, chain.objs.size()=1 2024-03-04T13:00:16.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.EdNdQKhtuWbkUq4lTBOHoZ8OAOreTsI_0 2024-03-04T13:00:16.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6147832114783183385', time=2024-03-04T14:54:29.995850+0000, chain.objs.size()=1 2024-03-04T13:00:16.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.KU495Jf4Qx2kzlVwS3t9z7h2NETFW7-_0 2024-03-04T13:00:16.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5212236860921187232', time=2024-03-04T14:54:30.018565+0000, chain.objs.size()=1 2024-03-04T13:00:16.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7h8UnU5whQDTS3m4_1ULyrzrg093TZ0_0 2024-03-04T13:00:16.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7355081260337780561', time=2024-03-04T14:54:30.118474+0000, chain.objs.size()=1 2024-03-04T13:00:16.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.x7vfLT9HHcvkm7ZPWmVbLgBolcociIN_0 2024-03-04T13:00:16.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3013030811744541317', time=2024-03-04T14:54:30.125440+0000, chain.objs.size()=1 2024-03-04T13:00:16.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cYqH3bOP9JMy87nEkK5V1H8BBxKASIx_0 2024-03-04T13:00:16.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4989113621146257928', time=2024-03-04T14:54:30.137958+0000, chain.objs.size()=1 2024-03-04T13:00:16.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.sbTicZ0ADt5X176BCcBkpMT8cYJKvX-_0 2024-03-04T13:00:16.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12932308835883507315', time=2024-03-04T14:54:30.141096+0000, chain.objs.size()=1 2024-03-04T13:00:16.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.TXBVpKzXLFkHqa-tKI82Quk5i3ezUI6_0 2024-03-04T13:00:16.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2761941444521141428', time=2024-03-04T14:54:30.143135+0000, chain.objs.size()=1 2024-03-04T13:00:16.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.115+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tC_6AfKWfVBt47ibiqetHgmQK5yyQs7_0 2024-03-04T13:00:16.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.116+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.350531570451128433', time=2024-03-04T14:54:30.147657+0000, chain.objs.size()=1 2024-03-04T13:00:16.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.116+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VzqjpUlfIDCmsjd7RWvSMGxJMfEmlaT_0 2024-03-04T13:00:16.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.116+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15757687164615108846', time=2024-03-04T14:54:30.152595+0000, chain.objs.size()=1 2024-03-04T13:00:16.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.116+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.bUJw0yfwcB0p1xRux9zqaFPbHXiTPPZ_0 2024-03-04T13:00:16.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.116+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7396787488677968345', time=2024-03-04T14:54:30.335538+0000, chain.objs.size()=1 2024-03-04T13:00:16.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.116+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.OxUrVjRbYA2A_ze-WViso0cl7zss06k_0 2024-03-04T13:00:16.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.116+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17694676021062829904', time=2024-03-04T14:54:30.419430+0000, chain.objs.size()=1 2024-03-04T13:00:16.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.116+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-Mew0czMEm3-SK8KpBSfpWOhm9c7hZF_0 2024-03-04T13:00:16.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.117+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8021341336728926470', time=2024-03-04T14:54:30.420526+0000, chain.objs.size()=1 2024-03-04T13:00:16.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.117+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yTY1KHAuVT8hgD7dLxt0jwCkfjc_le4_0 2024-03-04T13:00:16.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.117+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2127431881006990672', time=2024-03-04T14:54:30.429865+0000, chain.objs.size()=1 2024-03-04T13:00:16.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.117+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.SMf8z51xl29QKq5eGUAtJpVT5Jy4huR_0 2024-03-04T13:00:16.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1898318259585563085', time=2024-03-04T14:54:30.432227+0000, chain.objs.size()=1 2024-03-04T13:00:16.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.WW45Pg-UjAzI9uhmx2wLO6PKtgT2eeq_0 2024-03-04T13:00:16.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7764443846222491214', time=2024-03-04T14:54:30.465096+0000, chain.objs.size()=1 2024-03-04T13:00:16.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ZaGhnxjkIw8l870F4oZ7vfOnofxwehx_0 2024-03-04T13:00:16.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10270959551017736813', time=2024-03-04T14:54:30.467114+0000, chain.objs.size()=1 2024-03-04T13:00:16.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.m874iJDk3pCKPufXG1z3W0e7lZU_qKa_0 2024-03-04T13:00:16.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1218854897285970905', time=2024-03-04T14:54:30.593016+0000, chain.objs.size()=1 2024-03-04T13:00:16.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.1mS9aoNGDVRF9fL89kp5u9oBfUIVhPL_0 2024-03-04T13:00:16.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13595810407140114863', time=2024-03-04T14:54:30.597944+0000, chain.objs.size()=1 2024-03-04T13:00:16.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.gjKTq551T-0ihIF7Fmp4DPGssnKPAXe_0 2024-03-04T13:00:16.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8942034752084061078', time=2024-03-04T14:54:30.621453+0000, chain.objs.size()=1 2024-03-04T13:00:16.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Rc8NlJCK-R01rVAlxnq43eXv2U2A9ly_0 2024-03-04T13:00:16.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16742464853962299454', time=2024-03-04T14:54:30.738617+0000, chain.objs.size()=1 2024-03-04T13:00:16.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.xXFZyglM5vg7ZzJ0yrCKHUADN5BG1JB_0 2024-03-04T13:00:16.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6619304571333329202', time=2024-03-04T14:54:30.780997+0000, chain.objs.size()=1 2024-03-04T13:00:16.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.okQ7nKqGWfxknC-JOYb_giS-IhiHfOc_0 2024-03-04T13:00:16.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13953714978011979241', time=2024-03-04T14:54:38.292512+0000, chain.objs.size()=1 2024-03-04T13:00:16.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.X5T6nRNwDpkUFQ0FeCwm9pKW09LO9iZ_0 2024-03-04T13:00:16.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.119+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12791975187462530941', time=2024-03-04T14:54:38.298939+0000, chain.objs.size()=1 2024-03-04T13:00:16.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.119+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7RSc0aTigT2qJsPzzrGYQorgL9IGilQ_0 2024-03-04T13:00:16.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9962078670250097484', time=2024-03-04T14:54:38.325577+0000, chain.objs.size()=1 2024-03-04T13:00:16.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.dIgvJ49Pu3owD7W08jZj1OVhulxwsgG_0 2024-03-04T13:00:16.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15935267975730412620', time=2024-03-04T14:54:38.364709+0000, chain.objs.size()=1 2024-03-04T13:00:16.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gjdsFa9f_6Ool0qfOZXO5wYB9985p-W_0 2024-03-04T13:00:16.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18324368062450472810', time=2024-03-04T14:54:38.459302+0000, chain.objs.size()=1 2024-03-04T13:00:16.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iclESOB4FS5zdbQUjtGbKfpA2gjBF-K_0 2024-03-04T13:00:16.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17625975117169142845', time=2024-03-04T14:54:38.487877+0000, chain.objs.size()=1 2024-03-04T13:00:16.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.1KlAA40-oOxPFJRaDQ_WPCtGRJO8VaX_0 2024-03-04T13:00:16.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10634253920674360357', time=2024-03-04T14:54:38.501995+0000, chain.objs.size()=1 2024-03-04T13:00:16.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.qdQ6HZNeIzqAinhyDq3EoVortcfX8mC_0 2024-03-04T13:00:16.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5848606280087778998', time=2024-03-04T14:54:38.534614+0000, chain.objs.size()=1 2024-03-04T13:00:16.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.S600xVovRNXC8DF5g6fqjqG5AX8zKQ0_0 2024-03-04T13:00:16.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15665023291015157851', time=2024-03-04T14:54:38.670650+0000, chain.objs.size()=1 2024-03-04T13:00:16.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Oopmj5gKw72NcqdzbWGiZjWLPYcu1UK_0 2024-03-04T13:00:16.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.121+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16926967681813173748', time=2024-03-04T14:54:38.793596+0000, chain.objs.size()=1 2024-03-04T13:00:16.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.121+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.l--7ng3f2M1coXle75OuZjPrAH5xLaP_0 2024-03-04T13:00:16.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.121+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12386895127653957707', time=2024-03-04T14:54:38.795649+0000, chain.objs.size()=1 2024-03-04T13:00:16.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.121+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5CpfGywZ2Ipa1MZv7jJ5uGvwK6wTW6t_0 2024-03-04T13:00:16.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.121+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.393912503397184120', time=2024-03-04T14:54:38.835549+0000, chain.objs.size()=1 2024-03-04T13:00:16.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.121+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.qoIw2TRh3r1elvxtt1tTJGWzjUdHsjQ_0 2024-03-04T13:00:16.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.121+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9710019431692042887', time=2024-03-04T14:54:38.947249+0000, chain.objs.size()=1 2024-03-04T13:00:16.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.121+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.RSZ3nV58eyXlWxXMj2kpZtMD6arTdez_0 2024-03-04T13:00:16.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6963758921662124585', time=2024-03-04T14:54:38.985024+0000, chain.objs.size()=1 2024-03-04T13:00:16.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wSCsYUfa_Bqe7Kt0sutFf1gBCD624u9_0 2024-03-04T13:00:16.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11013493796878050240', time=2024-03-04T14:54:38.991093+0000, chain.objs.size()=1 2024-03-04T13:00:16.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.C8TrocJmWZLXHsg4Js97T7ezIrrGjsG_0 2024-03-04T13:00:16.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14872651392248886080', time=2024-03-04T14:54:39.003366+0000, chain.objs.size()=1 2024-03-04T13:00:16.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.z5fzfmbMEDhM-HUma5Rf4wD9sINsNCf_0 2024-03-04T13:00:16.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18398420964825928524', time=2024-03-04T14:54:39.012733+0000, chain.objs.size()=1 2024-03-04T13:00:16.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.bSAlwaAvcxFdgpWuWcOeXKB0Q2zr15x_0 2024-03-04T13:00:16.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11526627128706333740', time=2024-03-04T14:54:39.029523+0000, chain.objs.size()=1 2024-03-04T13:00:16.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.epM9mRLHDFjkXIfsZ0NS3U-eJrf7M59_0 2024-03-04T13:00:16.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6390494552788461296', time=2024-03-04T14:54:39.107660+0000, chain.objs.size()=1 2024-03-04T13:00:16.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.yvfGFd4xjMCf55tzXcuRly52PGMnvsM_0 2024-03-04T13:00:16.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4483595611542343244', time=2024-03-04T14:54:39.117989+0000, chain.objs.size()=1 2024-03-04T13:00:16.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iu26bmhMAs3DcRBj4Dgw9AmIKBWUXcC_0 2024-03-04T13:00:16.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16846534890601522358', time=2024-03-04T14:54:39.135209+0000, chain.objs.size()=1 2024-03-04T13:00:16.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.1AEDtPT1PDmmsWqy_Qvoy9jSEGYhZmd_0 2024-03-04T13:00:16.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3704532535446779976', time=2024-03-04T14:54:39.138061+0000, chain.objs.size()=1 2024-03-04T13:00:16.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.125+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.muJ_6ooK1wN2vAotIz1EwpWrOFS6m3V_0 2024-03-04T13:00:16.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.126+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18238174644223288248', time=2024-03-04T14:54:39.149511+0000, chain.objs.size()=1 2024-03-04T13:00:16.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.126+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.RzmRXHgM5UariLbJlo727rivWhtYSja_0 2024-03-04T13:00:16.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.126+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2087005462004336821', time=2024-03-04T14:54:39.175721+0000, chain.objs.size()=1 2024-03-04T13:00:16.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.126+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.co2u9CMjt5agyNz75YVJa1RppdJs0B2_0 2024-03-04T13:00:16.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.492027995877468405', time=2024-03-04T14:54:39.178962+0000, chain.objs.size()=1 2024-03-04T13:00:16.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pitZ9QI3HWTaKUjRG_I06tIoqU3lwId_0 2024-03-04T13:00:16.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6528169715908497784', time=2024-03-04T14:54:39.264857+0000, chain.objs.size()=1 2024-03-04T13:00:16.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.XqsJjAilP-mgVhB6EVpCSuSFKMU2ZSP_0 2024-03-04T13:00:16.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6454207521804659531', time=2024-03-04T14:54:39.281428+0000, chain.objs.size()=1 2024-03-04T13:00:16.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.RThFTEFyLc5MBd9tW44lsBeJ-E51WeM_0 2024-03-04T13:00:16.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9935455873055076925', time=2024-03-04T14:54:39.287898+0000, chain.objs.size()=1 2024-03-04T13:00:16.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.64AdigDEqvaSP9Pwar-b7cZTX14zoay_0 2024-03-04T13:00:16.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.441829129100297749', time=2024-03-04T14:54:39.331595+0000, chain.objs.size()=1 2024-03-04T13:00:16.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KWdK4R6HTLxkgxwbST6EdwD9zB0Ji0D_0 2024-03-04T13:00:16.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10731288756566620570', time=2024-03-04T14:54:39.340546+0000, chain.objs.size()=1 2024-03-04T13:00:16.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HRbIuKnzhQtlHNhd7UMdIeVzLT9cYOi_0 2024-03-04T13:00:16.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6882092971265279781', time=2024-03-04T14:54:39.467138+0000, chain.objs.size()=1 2024-03-04T13:00:16.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.BSNRLiKlbuLg045KoyVvgmhxVBnpFgF_0 2024-03-04T13:00:16.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5872111729117532190', time=2024-03-04T14:54:43.106012+0000, chain.objs.size()=1 2024-03-04T13:00:16.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.306__shadow_.HJHYCy3hWTLlIimPbjn9y66N16qtCyT_0 2024-03-04T13:00:16.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.446994675150252391', time=2024-03-04T14:54:48.441503+0000, chain.objs.size()=1 2024-03-04T13:00:16.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.134+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.318__shadow_.uSAk9brONirz3x6HZCkPE_hTkOD4PM4_0 2024-03-04T13:00:16.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.141+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/69459 2024-03-04T13:00:16.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-03-04T13:00:16.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3327260980848411227', time=2024-03-04T14:54:56.902395+0000, chain.objs.size()=2 2024-03-04T13:00:16.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.340__shadow_.NgEDFk5_T8PC2siQJGmV_mPeE8u_bto_0 2024-03-04T13:00:16.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.340__shadow_.NgEDFk5_T8PC2siQJGmV_mPeE8u_bto_1 2024-03-04T13:00:16.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1571242361251187757', time=2024-03-04T14:55:52.265859+0000, chain.objs.size()=1 2024-03-04T13:00:16.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.455__shadow_.Vwt2oSgNfpwhdYelQ3rVFxtZSoHCB1N_0 2024-03-04T13:00:16.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2181909672502022260', time=2024-03-04T14:56:08.467312+0000, chain.objs.size()=2 2024-03-04T13:00:16.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.489__shadow_.sfaxvK2dbwmQenLwRmt3HaRTYnYSSs__0 2024-03-04T13:00:16.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.489__shadow_.sfaxvK2dbwmQenLwRmt3HaRTYnYSSs__1 2024-03-04T13:00:16.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12129430185922772219', time=2024-03-04T14:56:10.881792+0000, chain.objs.size()=12 2024-03-04T13:00:16.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.491__multipart_mymultipart.2~oLD4oDUvrnXk8l9toZmdsW-f8Wgfy-e.1 2024-03-04T13:00:16.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.491__shadow_mymultipart.2~oLD4oDUvrnXk8l9toZmdsW-f8Wgfy-e.1_1 2024-03-04T13:00:16.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.491__multipart_mymultipart.2~oLD4oDUvrnXk8l9toZmdsW-f8Wgfy-e.2 2024-03-04T13:00:16.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.491__shadow_mymultipart.2~oLD4oDUvrnXk8l9toZmdsW-f8Wgfy-e.2_1 2024-03-04T13:00:16.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.491__multipart_mymultipart.2~oLD4oDUvrnXk8l9toZmdsW-f8Wgfy-e.3 2024-03-04T13:00:16.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.491__shadow_mymultipart.2~oLD4oDUvrnXk8l9toZmdsW-f8Wgfy-e.3_1 2024-03-04T13:00:16.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.143+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.491__multipart_mymultipart.2~oLD4oDUvrnXk8l9toZmdsW-f8Wgfy-e.4 2024-03-04T13:00:16.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.146+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.491__shadow_mymultipart.2~oLD4oDUvrnXk8l9toZmdsW-f8Wgfy-e.4_1 2024-03-04T13:00:16.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.146+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.491__multipart_mymultipart.2~oLD4oDUvrnXk8l9toZmdsW-f8Wgfy-e.5 2024-03-04T13:00:16.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.146+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.491__shadow_mymultipart.2~oLD4oDUvrnXk8l9toZmdsW-f8Wgfy-e.5_1 2024-03-04T13:00:16.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.146+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.491__multipart_mymultipart.2~oLD4oDUvrnXk8l9toZmdsW-f8Wgfy-e.6 2024-03-04T13:00:16.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.146+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.491__shadow_mymultipart.2~oLD4oDUvrnXk8l9toZmdsW-f8Wgfy-e.6_1 2024-03-04T13:00:16.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.153+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14879690196501608905', time=2024-03-04T14:57:07.190601+0000, chain.objs.size()=1 2024-03-04T13:00:16.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.153+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.526__shadow_.EQC7Rzwtg9SbDL8VCz3yebSjWrLxOKQ_0 2024-03-04T13:00:16.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.153+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12217014913858527733', time=2024-03-04T14:57:19.338012+0000, chain.objs.size()=1 2024-03-04T13:00:16.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.153+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:wTuAQX3pTqBzc8HfKxj.RiJlHqmMNlP_.d4wJ-VBS4k3tmxHXxMR9NUd-bXWo-TD_0 2024-03-04T13:00:16.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11750992229338292014', time=2024-03-04T14:57:22.886286+0000, chain.objs.size()=1 2024-03-04T13:00:16.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.537__shadow:cnYrqsfWPnpAo2DtHQjOIQeZJ73.jT0_.T9bOeZPwcyivtS3hCLm8VHwAg67Hdax_0 2024-03-04T13:00:16.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1060438841927012946', time=2024-03-04T14:57:22.921840+0000, chain.objs.size()=1 2024-03-04T13:00:16.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.537__shadow:2CWxb1pi8-mloLd1sCO2YEzttw1OdmT_.S4tI5YPBFon-D9-6yOpR9ysbLAd1sTQ_0 2024-03-04T13:00:16.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10089249476638658936', time=2024-03-04T14:57:32.574927+0000, chain.objs.size()=1 2024-03-04T13:00:16.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:3xozPxPyrikaBZmB1ZpvA.4ATxvJ-VR_.j8SIE-neIo-OGZCQSRVwytOltluw3Nn_0 2024-03-04T13:00:16.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4845104989559834618', time=2024-03-04T14:57:51.597832+0000, chain.objs.size()=1 2024-03-04T13:00:16.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.552__shadow:tLLDAy7Pap9gkipnin3R3-ZOsbFHye2_.i1sjU5a2ymSRjdCfeRCtbA-wHwENOp-_0 2024-03-04T13:00:16.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13070395243192826462', time=2024-03-04T14:58:21.453439+0000, chain.objs.size()=1 2024-03-04T13:00:16.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.606__shadow_.0nfcc2OerNOsDTMLR2xjWjkp0hE-t9v_0 2024-03-04T13:00:16.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7125760969915240807', time=2024-03-04T14:58:38.196872+0000, chain.objs.size()=1 2024-03-04T13:00:16.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.641__shadow_.IOKj7cTiPsWTqj6VEyK1hJPD9k6LTa1_0 2024-03-04T13:00:16.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10522080763525371045', time=2024-03-04T14:58:42.615530+0000, chain.objs.size()=1 2024-03-04T13:00:16.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.653__shadow_.PfgVGhjl7SDhyA8x7-AcnygzyTycGky_0 2024-03-04T13:00:16.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13647676883181656710', time=2024-03-04T14:58:47.352050+0000, chain.objs.size()=1 2024-03-04T13:00:16.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.665__shadow:K6pV8pps-GC9ce.AZf-dZbPbn9u-3fN_.xFyr6EcZXQ614UZumIloDQ7iscHhJYp_0 2024-03-04T13:00:16.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14521066341827983096', time=2024-03-04T14:58:47.843850+0000, chain.objs.size()=1 2024-03-04T13:00:16.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.154+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.666__shadow:H-90Fr8DMiUEfNtkfq9j8qNKMn8jPTf_.uyN5wQh9PnUlHvAjsVYku4O8FrcrjCD_0 2024-03-04T13:00:16.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.156+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15933999180922685318', time=2024-03-04T14:58:49.526305+0000, chain.objs.size()=1 2024-03-04T13:00:16.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.156+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.670__shadow_.K7-3z5Fenons-LDep-xxIWVFHp-KHaK_0 2024-03-04T13:00:16.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.156+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9015530640087001752', time=2024-03-04T14:59:17.224461+0000, chain.objs.size()=1 2024-03-04T13:00:16.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.156+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.691__shadow_.FMZAT0FB7BSwG_79HAI4MLABX9WT5FQ_0 2024-03-04T13:00:16.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.159+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.163+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T13:00:16.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.164+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.165+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51940' 2024-03-04T13:00:16.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3732658984541586082', time=2024-03-04T14:52:52.066483+0000, chain.objs.size()=1 2024-03-04T13:00:16.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.144__shadow_.WJ_lXuuBROBCOJ7mxmD3UE9efuMZGr1_0 2024-03-04T13:00:16.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15417023388811143577', time=2024-03-04T14:53:36.940542+0000, chain.objs.size()=1 2024-03-04T13:00:16.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.217__shadow_.-MIls5s8UTMVYxqG57Fn8T_AJpz3F_F_0 2024-03-04T13:00:16.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12667548122142910281', time=2024-03-04T14:53:52.042998+0000, chain.objs.size()=1 2024-03-04T13:00:16.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ZJxH1gG3ws72_tNOsDJZoFZb2zK3693_0 2024-03-04T13:00:16.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13470747125483738458', time=2024-03-04T14:53:52.059454+0000, chain.objs.size()=1 2024-03-04T13:00:16.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Zi7OQLMdXPhmgEQsKH-EyqkENx4FTC__0 2024-03-04T13:00:16.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8791863253762254978', time=2024-03-04T14:53:52.110654+0000, chain.objs.size()=1 2024-03-04T13:00:16.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Y6rtIepUGLmKKqXu1FaKSUyiNQQpfY2_0 2024-03-04T13:00:16.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9020076138331128092', time=2024-03-04T14:53:52.270370+0000, chain.objs.size()=1 2024-03-04T13:00:16.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.tXyKwXKH2EXLc5aMWd_QpagolfG_4YL_0 2024-03-04T13:00:16.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1451322633092626821', time=2024-03-04T14:53:52.308241+0000, chain.objs.size()=1 2024-03-04T13:00:16.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ewoq9TeNCx5L2j8o-iKbtp9NA-_l7K1_0 2024-03-04T13:00:16.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6776376267786120148', time=2024-03-04T14:53:52.396510+0000, chain.objs.size()=1 2024-03-04T13:00:16.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.bbdjxtraxxxSBL31HhbiAvqL1G1AvQ5_0 2024-03-04T13:00:16.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14857745419803669316', time=2024-03-04T14:53:52.399422+0000, chain.objs.size()=1 2024-03-04T13:00:16.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JjSN7X3ICnv2QREBbm4jW85wtdJMibg_0 2024-03-04T13:00:16.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6921849063033982435', time=2024-03-04T14:53:52.408483+0000, chain.objs.size()=1 2024-03-04T13:00:16.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.V2Qi9D2_HztSD1CbcDyW0tE4fiquetd_0 2024-03-04T13:00:16.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2941742174099838910', time=2024-03-04T14:53:52.412026+0000, chain.objs.size()=1 2024-03-04T13:00:16.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vGXHrOVRNnFytCAjl0nDtNDNvvSOt9c_0 2024-03-04T13:00:16.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.566847192987118980', time=2024-03-04T14:53:52.414206+0000, chain.objs.size()=1 2024-03-04T13:00:16.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.166+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.E7kne0rL-Zn8Un7JlPzs54fj_VjDqlK_0 2024-03-04T13:00:16.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17870182031057817833', time=2024-03-04T14:53:52.451962+0000, chain.objs.size()=1 2024-03-04T13:00:16.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0VVp_wEKoQdKRb36n5L-ngFKlxnKRC0_0 2024-03-04T13:00:16.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18141074358959738760', time=2024-03-04T14:53:52.456481+0000, chain.objs.size()=1 2024-03-04T13:00:16.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.aDi_fvriqTvWNcx6gnk4vPGU8UINwt4_0 2024-03-04T13:00:16.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15281991811633920867', time=2024-03-04T14:53:52.465127+0000, chain.objs.size()=1 2024-03-04T13:00:16.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.irV--IPnfB_0JXBeo4rrmNAd0JY6TRj_0 2024-03-04T13:00:16.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13442775362994079201', time=2024-03-04T14:53:52.567147+0000, chain.objs.size()=1 2024-03-04T13:00:16.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.o6rPrquXt8itR5t4lHiR0YxSS0kCnQP_0 2024-03-04T13:00:16.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17921788590824515378', time=2024-03-04T14:53:52.568274+0000, chain.objs.size()=1 2024-03-04T13:00:16.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PKQtlAXUFoBZnYhuBxFMbV-W0JQlEfS_0 2024-03-04T13:00:16.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15020915573010739417', time=2024-03-04T14:53:52.570468+0000, chain.objs.size()=1 2024-03-04T13:00:16.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.1WU51QxgofX3_MGgCzPl0cnFg8Pkvos_0 2024-03-04T13:00:16.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3651179353431544011', time=2024-03-04T14:53:52.624699+0000, chain.objs.size()=1 2024-03-04T13:00:16.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Kh1RKuubGe040g8HOQjE5SsSxywiYC2_0 2024-03-04T13:00:16.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16302567345684597875', time=2024-03-04T14:53:52.628714+0000, chain.objs.size()=1 2024-03-04T13:00:16.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.qLH5Fxv0u0Vq9lk7hVIrVEohXPlNhUg_0 2024-03-04T13:00:16.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16107096543671951734', time=2024-03-04T14:53:52.635042+0000, chain.objs.size()=1 2024-03-04T13:00:16.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.568-3Mjy2v8DyPHIfEerd90FJJ8CXof_0 2024-03-04T13:00:16.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17499433957913434605', time=2024-03-04T14:53:52.768067+0000, chain.objs.size()=1 2024-03-04T13:00:16.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.sFkiKWIx0cyPI-a_phSTh8vQLr2VvNu_0 2024-03-04T13:00:16.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4702747199554245475', time=2024-03-04T14:53:52.779750+0000, chain.objs.size()=1 2024-03-04T13:00:16.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.176+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.BQ2Te8jGjwzczENlGxQeCTyFuZDrLxb_0 2024-03-04T13:00:16.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11497391890767569262', time=2024-03-04T14:53:52.783342+0000, chain.objs.size()=1 2024-03-04T13:00:16.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CMsXcxKUHkE4TOPpclEVzBBQQt9M9Hj_0 2024-03-04T13:00:16.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15465901336649591715', time=2024-03-04T14:53:52.790914+0000, chain.objs.size()=1 2024-03-04T13:00:16.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.XJ1GfVOQN0INPj0NuzsncdBptazxgSM_0 2024-03-04T13:00:16.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4417062291526027089', time=2024-03-04T14:53:52.791733+0000, chain.objs.size()=1 2024-03-04T13:00:16.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8EoYMf3Wor5jvw8e5b_a7lj5B_OXt7u_0 2024-03-04T13:00:16.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15022072199574788817', time=2024-03-04T14:53:52.912746+0000, chain.objs.size()=1 2024-03-04T13:00:16.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0PakH84vNY-yFq7hLV66ZL7L8QrnBoU_0 2024-03-04T13:00:16.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.548243856126750920', time=2024-03-04T14:53:52.932232+0000, chain.objs.size()=1 2024-03-04T13:00:16.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.4L_RC1-UPZKgcqXR-LDrR-pOhQRjA8X_0 2024-03-04T13:00:16.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10819163768581109453', time=2024-03-04T14:53:52.970119+0000, chain.objs.size()=1 2024-03-04T13:00:16.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.gasG3UYhueTnapai9vIEFghBVeDujN8_0 2024-03-04T13:00:16.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5843001149285080262', time=2024-03-04T14:53:52.971217+0000, chain.objs.size()=1 2024-03-04T13:00:16.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.181+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.QZK3QWLavEVhAGKywyZKYYT6RlKZ09W_0 2024-03-04T13:00:16.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.183+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15246361514915777527', time=2024-03-04T14:53:52.983120+0000, chain.objs.size()=1 2024-03-04T13:00:16.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.183+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.7VaGOZPqgiRjVFpkbO0fxuni9B5ZG2s_0 2024-03-04T13:00:16.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.183+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8888545029842506114', time=2024-03-04T14:53:53.082041+0000, chain.objs.size()=1 2024-03-04T13:00:16.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.183+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YTy916I7t3OOpBBbijp354T9zn8Axjj_0 2024-03-04T13:00:16.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.183+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6784380420737526857', time=2024-03-04T14:53:53.087339+0000, chain.objs.size()=1 2024-03-04T13:00:16.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.183+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.rmOWYKpNigXurcoinvutORwJr_2wTZB_0 2024-03-04T13:00:16.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.183+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8795016334187559812', time=2024-03-04T14:53:53.138342+0000, chain.objs.size()=1 2024-03-04T13:00:16.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.183+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wYO32We2GfEr_lW356LDbi3Yn2efGDQ_0 2024-03-04T13:00:16.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2809547797211288358', time=2024-03-04T14:53:53.144984+0000, chain.objs.size()=1 2024-03-04T13:00:16.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.UuC-YZUbZ68SQlB1cYXMjJRWyeLWvMr_0 2024-03-04T13:00:16.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17660131756126344495', time=2024-03-04T14:53:53.157425+0000, chain.objs.size()=1 2024-03-04T13:00:16.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GfuyCFKkEavCg_ZLSemGVinQ7wC14KZ_0 2024-03-04T13:00:16.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15778034950453590502', time=2024-03-04T14:53:53.311547+0000, chain.objs.size()=1 2024-03-04T13:00:16.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.uDKDIdZ5Mpkvl24Tp3vSd2Lz30eg58G_0 2024-03-04T13:00:16.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8794551795479551858', time=2024-03-04T14:53:53.316905+0000, chain.objs.size()=1 2024-03-04T13:00:16.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ycOWa4qgtqyqIEHJgQ9yWdkQsiud48-_0 2024-03-04T13:00:16.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6213583768257062105', time=2024-03-04T14:54:01.440285+0000, chain.objs.size()=1 2024-03-04T13:00:16.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.251__shadow_.dPINTkE3N1-p4T1H7bp2kjxvkbs6tDv_0 2024-03-04T13:00:16.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16860017473976401256', time=2024-03-04T14:54:03.124425+0000, chain.objs.size()=1 2024-03-04T13:00:16.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.255__shadow_.pedermSnPAICUBJSbGC8YYBNmpPZie-_0 2024-03-04T13:00:16.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18028135364494134270', time=2024-03-04T14:54:09.026960+0000, chain.objs.size()=1 2024-03-04T13:00:16.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.186+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.TZ2g0nVYzM4f-VLZdwNt_Yj4h8Eh6h8_0 2024-03-04T13:00:16.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.188+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8318204523638295798', time=2024-03-04T14:54:09.037122+0000, chain.objs.size()=1 2024-03-04T13:00:16.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.188+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.UOKOBJ8qsD6KJgJHNIMbwhtRfCxZi7D_0 2024-03-04T13:00:16.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.188+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12099725085622376800', time=2024-03-04T14:54:10.347855+0000, chain.objs.size()=1 2024-03-04T13:00:16.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.188+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.269__shadow_.i7RFSGkRn93AZGJB99aZ32aMtTPJVYp_0 2024-03-04T13:00:16.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.449916918604346996', time=2024-03-04T14:54:29.631259+0000, chain.objs.size()=1 2024-03-04T13:00:16.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.XaklwmWSni6oxHOPi4TGXjVmkpmr0YH_0 2024-03-04T13:00:16.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2480496608632621911', time=2024-03-04T14:54:29.632754+0000, chain.objs.size()=1 2024-03-04T13:00:16.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.39y7UjYwvf0j4Bip-KI3ClM-MKNvUfL_0 2024-03-04T13:00:16.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16184591210663641778', time=2024-03-04T14:54:29.674262+0000, chain.objs.size()=1 2024-03-04T13:00:16.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.6R3RnJkS4scIUmelM3ZeFNuSNiIkkNk_0 2024-03-04T13:00:16.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10451411993296458888', time=2024-03-04T14:54:29.700256+0000, chain.objs.size()=1 2024-03-04T13:00:16.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.mYv--ZK5irgXi9ckMq8iOEVuIfn6_4n_0 2024-03-04T13:00:16.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11536896080733118210', time=2024-03-04T14:54:29.854389+0000, chain.objs.size()=1 2024-03-04T13:00:16.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lp_Ld51iqiQ2PWeGDtahI2ETSvKkrnZ_0 2024-03-04T13:00:16.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.675665054625647619', time=2024-03-04T14:54:29.951434+0000, chain.objs.size()=1 2024-03-04T13:00:16.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RoRnueBJHgVqYdfA_YoGxwjgIh6r1vK_0 2024-03-04T13:00:16.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2603785754264639254', time=2024-03-04T14:54:29.965495+0000, chain.objs.size()=1 2024-03-04T13:00:16.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RkKpN01gwUNeKvDBw0nviz-imDQenwh_0 2024-03-04T13:00:16.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16843259986770502934', time=2024-03-04T14:54:29.971966+0000, chain.objs.size()=1 2024-03-04T13:00:16.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rtbL5IdiVS5HdpOi1otQRTGqcDlGuf1_0 2024-03-04T13:00:16.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10213199524125139259', time=2024-03-04T14:54:30.026396+0000, chain.objs.size()=1 2024-03-04T13:00:16.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.191+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.hVmIKsjGKcuJgUuhiJVX70HoQb1G8kC_0 2024-03-04T13:00:16.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.194+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5344861785880609266', time=2024-03-04T14:54:30.029564+0000, chain.objs.size()=1 2024-03-04T13:00:16.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.194+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4PLTDWtJBmJXqUfqU_4bMOsktwK30a3_0 2024-03-04T13:00:16.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.194+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5336713039576184808', time=2024-03-04T14:54:30.112090+0000, chain.objs.size()=1 2024-03-04T13:00:16.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.194+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.SfNErpSvuUmM9QEoS6mLPKI-F1_Iili_0 2024-03-04T13:00:16.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.194+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10954957296099110605', time=2024-03-04T14:54:30.115213+0000, chain.objs.size()=1 2024-03-04T13:00:16.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.194+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.F08kcXOKat6ShsoEI8pq-_e6H9Y0Pl1_0 2024-03-04T13:00:16.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.195+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18209433187506233837', time=2024-03-04T14:54:30.117074+0000, chain.objs.size()=1 2024-03-04T13:00:16.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.195+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rqN7mePXH5fjj_vb25LartbDI1oFHR9_0 2024-03-04T13:00:16.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.195+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5903728330308762816', time=2024-03-04T14:54:30.125478+0000, chain.objs.size()=1 2024-03-04T13:00:16.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.195+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cSkoHG5zGz1y8Zktafb7nICAxPAlhLA_0 2024-03-04T13:00:16.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.195+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15657780510726890921', time=2024-03-04T14:54:30.129372+0000, chain.objs.size()=1 2024-03-04T13:00:16.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.195+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ziZsuKqZIqIG6a1ZqhBFaURB185gTYg_0 2024-03-04T13:00:16.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.195+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16909957489638952298', time=2024-03-04T14:54:30.136094+0000, chain.objs.size()=1 2024-03-04T13:00:16.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.195+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.i6ZoyLIkWXw2f2e5XM2Y4QdCtfXdDcx_0 2024-03-04T13:00:16.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.197+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1427028057103862472', time=2024-03-04T14:54:30.139276+0000, chain.objs.size()=1 2024-03-04T13:00:16.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.197+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wBFPslbooRGrIXnyhGErZ4kBFsjkwSj_0 2024-03-04T13:00:16.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3987166792378783462', time=2024-03-04T14:54:30.149807+0000, chain.objs.size()=1 2024-03-04T13:00:16.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Tc2VntTR9MqxOl_LVCsdkPX5c-xWgkZ_0 2024-03-04T13:00:16.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1101417965268789472', time=2024-03-04T14:54:30.160568+0000, chain.objs.size()=1 2024-03-04T13:00:16.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.39FdqtWLHeB8uVvmtsiDBd_LY3y9hR0_0 2024-03-04T13:00:16.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10779377424973525388', time=2024-03-04T14:54:30.265697+0000, chain.objs.size()=1 2024-03-04T13:00:16.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.kSzGNQ6aHOM2gLJHZpIXbJf3_ZuPEWB_0 2024-03-04T13:00:16.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12507335961829975876', time=2024-03-04T14:54:30.270837+0000, chain.objs.size()=1 2024-03-04T13:00:16.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3OhUdZWWQ8hZvbXDkGFecWg4MQRaOSu_0 2024-03-04T13:00:16.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9225733598005716097', time=2024-03-04T14:54:30.323194+0000, chain.objs.size()=1 2024-03-04T13:00:16.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.G3MpwFjzztczibMH1tXbTLZOqDZpTWC_0 2024-03-04T13:00:16.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8090321958999118138', time=2024-03-04T14:54:30.462781+0000, chain.objs.size()=1 2024-03-04T13:00:16.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7Zo-2K27zUgXajlN5iQuMtHGAEvniuU_0 2024-03-04T13:00:16.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5297169470894829199', time=2024-03-04T14:54:30.478227+0000, chain.objs.size()=1 2024-03-04T13:00:16.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.KSZEIj4lHmJwvAO4S3J-67ilQwKAjlE_0 2024-03-04T13:00:16.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10417633080341469473', time=2024-03-04T14:54:30.492425+0000, chain.objs.size()=1 2024-03-04T13:00:16.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VVq0-JRP5y9WnbEp_S3LDWy-O9zinTi_0 2024-03-04T13:00:16.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.895573215637177173', time=2024-03-04T14:54:30.612763+0000, chain.objs.size()=1 2024-03-04T13:00:16.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.15FHWvpbMyMwzb4TROwllgxRGoz2ZLA_0 2024-03-04T13:00:16.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4670728079468089535', time=2024-03-04T14:54:30.642387+0000, chain.objs.size()=1 2024-03-04T13:00:16.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.erlXi6s3Nj0SYDAZug7OMH7Zye90gfq_0 2024-03-04T13:00:16.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6351286941225490266', time=2024-03-04T14:54:30.654619+0000, chain.objs.size()=1 2024-03-04T13:00:16.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.200+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4qCMuhSH9FNMQ1yhKdvHVUI_yUnRT9n_0 2024-03-04T13:00:16.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.202+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6393873432148930427', time=2024-03-04T14:54:30.659640+0000, chain.objs.size()=1 2024-03-04T13:00:16.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.202+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.GlBhg7dz2bNx7fPxCwuuulRao_0QiS3_0 2024-03-04T13:00:16.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.202+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.824011087367283857', time=2024-03-04T14:54:30.764676+0000, chain.objs.size()=1 2024-03-04T13:00:16.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.202+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0hv1TS4_FhsCd58rzB5d14bA9xvFjC7_0 2024-03-04T13:00:16.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.202+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15968305004588856425', time=2024-03-04T14:54:30.778799+0000, chain.objs.size()=1 2024-03-04T13:00:16.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.202+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.IH3kCL50QI76VG2e9Qk2fQmm997SWLh_0 2024-03-04T13:00:16.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.202+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3310616619671392845', time=2024-03-04T14:54:30.784700+0000, chain.objs.size()=1 2024-03-04T13:00:16.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.202+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.TcnER06wioaBAwQrWjLu87s6NgDpTpf_0 2024-03-04T13:00:16.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.202+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11978844123375999928', time=2024-03-04T14:54:30.796676+0000, chain.objs.size()=1 2024-03-04T13:00:16.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.202+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cOj261exfQqjDIG1r1LXXixZ8SGrsFU_0 2024-03-04T13:00:16.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16843975173141400042', time=2024-03-04T14:54:30.797810+0000, chain.objs.size()=1 2024-03-04T13:00:16.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wlNw15gNMW3ZPRF6ZvbonhiAAvL4h9I_0 2024-03-04T13:00:16.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13479566201169597760', time=2024-03-04T14:54:38.311575+0000, chain.objs.size()=1 2024-03-04T13:00:16.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iB6qWc53iUrq-4yhLNBD8OAoXpb8iFB_0 2024-03-04T13:00:16.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16561427363840148877', time=2024-03-04T14:54:38.317772+0000, chain.objs.size()=1 2024-03-04T13:00:16.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.RqtKJBPIjK9F3WBE693vdbrP9FB43c3_0 2024-03-04T13:00:16.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3887318183280326480', time=2024-03-04T14:54:38.336493+0000, chain.objs.size()=1 2024-03-04T13:00:16.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.e08qBGkbSZbbNAGONJxdAJoRUF2mzwG_0 2024-03-04T13:00:16.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7798289192103994184', time=2024-03-04T14:54:38.362187+0000, chain.objs.size()=1 2024-03-04T13:00:16.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kWMPMXjn-8bGykzvUCmdqcHABoDtLC-_0 2024-03-04T13:00:16.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17394649389890952758', time=2024-03-04T14:54:38.458374+0000, chain.objs.size()=1 2024-03-04T13:00:16.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.LdPQYMeIfbhMBrzaKiEFK-N31n6gEUD_0 2024-03-04T13:00:16.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12153678470391771700', time=2024-03-04T14:54:38.462696+0000, chain.objs.size()=1 2024-03-04T13:00:16.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zPrl8-t4X_GHivrIkLpQ0lMi4zO4z0b_0 2024-03-04T13:00:16.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18042449329046937553', time=2024-03-04T14:54:38.468030+0000, chain.objs.size()=1 2024-03-04T13:00:16.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VKCiw03MJu61ni9MOO0B33py16SzbAI_0 2024-03-04T13:00:16.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12452448483083490054', time=2024-03-04T14:54:38.487923+0000, chain.objs.size()=1 2024-03-04T13:00:16.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Dok5g0Mfw7NNVK-GU2ZaY6tTW8533gF_0 2024-03-04T13:00:16.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13481022092659291781', time=2024-03-04T14:54:38.490333+0000, chain.objs.size()=1 2024-03-04T13:00:16.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.BUeQIaiqQwll0QcqNgB-omjXLrsL81c_0 2024-03-04T13:00:16.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3181832039707299653', time=2024-03-04T14:54:38.626859+0000, chain.objs.size()=1 2024-03-04T13:00:16.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.208+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Q_OawSMV9AXrHELB_FabwRqFNQ4rJBw_0 2024-03-04T13:00:16.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.211+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13462463213353301727', time=2024-03-04T14:54:38.646145+0000, chain.objs.size()=1 2024-03-04T13:00:16.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.211+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.3CzXGgOWYpd5NN2TWm8hvJ97UB4oMtD_0 2024-03-04T13:00:16.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.211+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14881762014743761921', time=2024-03-04T14:54:38.669664+0000, chain.objs.size()=1 2024-03-04T13:00:16.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.211+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.nNCvt4OQuu7mxZGhBdRwJhBbpHrcu1Y_0 2024-03-04T13:00:16.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.211+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3417929564532369120', time=2024-03-04T14:54:38.696091+0000, chain.objs.size()=1 2024-03-04T13:00:16.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.211+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.oo_AnMW6HkshyrHxmmNyXJMmkOvItI3_0 2024-03-04T13:00:16.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6010978825856565851', time=2024-03-04T14:54:38.700348+0000, chain.objs.size()=1 2024-03-04T13:00:16.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.84jywCJ-FrP4qmnKM4gw7S3w9qFS-Hh_0 2024-03-04T13:00:16.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15272233795062431416', time=2024-03-04T14:54:38.711415+0000, chain.objs.size()=1 2024-03-04T13:00:16.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.acZgbD-TI0tlMegqTXzUidZ_utH8KB6_0 2024-03-04T13:00:16.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6906805764377280874', time=2024-03-04T14:54:38.815068+0000, chain.objs.size()=1 2024-03-04T13:00:16.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.G-XDJACUwaBtm5t6VacS0eaX0hK47Qd_0 2024-03-04T13:00:16.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16839992732336097096', time=2024-03-04T14:54:38.844815+0000, chain.objs.size()=1 2024-03-04T13:00:16.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.af0GMgJ0bJ_v0A4DnKa9nTgollyusms_0 2024-03-04T13:00:16.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17311053150121809450', time=2024-03-04T14:54:38.971549+0000, chain.objs.size()=1 2024-03-04T13:00:16.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.UnmRxsbfDpj3E3rkTvCTwTRcRVKr1Rw_0 2024-03-04T13:00:16.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9664114996733521082', time=2024-03-04T14:54:39.013803+0000, chain.objs.size()=1 2024-03-04T13:00:16.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.r-eKZr9D9HvVdYF8fu33hgafq07uZSg_0 2024-03-04T13:00:16.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11292157705579801623', time=2024-03-04T14:54:39.121315+0000, chain.objs.size()=1 2024-03-04T13:00:16.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0WI7_jx74yosYbVTKBV4sBeuGofrIW9_0 2024-03-04T13:00:16.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1837355534269677326', time=2024-03-04T14:54:39.139131+0000, chain.objs.size()=1 2024-03-04T13:00:16.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.CBhgkU9SToqaTo6D8WITLCANOribmnW_0 2024-03-04T13:00:16.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8103250036281994294', time=2024-03-04T14:54:39.143995+0000, chain.objs.size()=1 2024-03-04T13:00:16.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2e4xkvp_bndkvsYOGhxVpugQgRWvkCA_0 2024-03-04T13:00:16.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9818508912593768325', time=2024-03-04T14:54:39.147609+0000, chain.objs.size()=1 2024-03-04T13:00:16.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.216+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ka4iZDcm1GhsTKlPlR7OOzQ2ZVNAnpw_0 2024-03-04T13:00:16.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.224+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/51940 2024-03-04T13:00:16.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-03-04T13:00:16.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16957178374587753928', time=2024-03-04T14:54:39.157517+0000, chain.objs.size()=1 2024-03-04T13:00:16.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.45kcAkBSLzitxHpSIgmu2ZJVwTUYWu5_0 2024-03-04T13:00:16.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18424731176149994503', time=2024-03-04T14:54:39.190803+0000, chain.objs.size()=1 2024-03-04T13:00:16.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.SIWrk_GM8RlLbTndnOL3Z3bLfUDBao4_0 2024-03-04T13:00:16.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6850824138444925234', time=2024-03-04T14:54:39.297398+0000, chain.objs.size()=1 2024-03-04T13:00:16.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._83ZXeKTXu0A3s_RNcV884tzNbkKyKs_0 2024-03-04T13:00:16.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12617587299348470122', time=2024-03-04T14:54:39.309473+0000, chain.objs.size()=1 2024-03-04T13:00:16.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.v8p9htBk2lkyoWAi89jrjlO263hhcAH_0 2024-03-04T13:00:16.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2533186213007847264', time=2024-03-04T14:54:39.326652+0000, chain.objs.size()=1 2024-03-04T13:00:16.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Ny9vtapfpBzq3vrQxdyYVkLZGtwLyDk_0 2024-03-04T13:00:16.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.974972313948227954', time=2024-03-04T14:54:39.444669+0000, chain.objs.size()=1 2024-03-04T13:00:16.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.vYs4W3B3mWj0erkm0CFqFUjotfpNGCr_0 2024-03-04T13:00:16.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10231850546233082990', time=2024-03-04T14:54:39.479831+0000, chain.objs.size()=1 2024-03-04T13:00:16.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.B_ht8OwnEPRD3XTLzlXlfbLd3VyKzhD_0 2024-03-04T13:00:16.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8757220994085098273', time=2024-03-04T14:54:39.481286+0000, chain.objs.size()=1 2024-03-04T13:00:16.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jlLgTyEVaiaFRIrPhoc7I12Q9yWWtat_0 2024-03-04T13:00:16.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7856096822639150195', time=2024-03-04T14:54:46.640808+0000, chain.objs.size()=1 2024-03-04T13:00:16.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.314__shadow_.9rnTynHyhrF1_8SM38u43ZeUS9QxlAb_0 2024-03-04T13:00:16.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2276682408726974133', time=2024-03-04T14:55:51.136752+0000, chain.objs.size()=1 2024-03-04T13:00:16.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.453__shadow_.nAm5avXFHwn_Tl_kOJUMlqZ7V4EtNVr_0 2024-03-04T13:00:16.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6998692831228336379', time=2024-03-04T14:55:53.668342+0000, chain.objs.size()=1 2024-03-04T13:00:16.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.458__shadow_.PV_OUUal7K9Tq-gjmgyrz889MQDQuJd_0 2024-03-04T13:00:16.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7236892726784503693', time=2024-03-04T14:55:58.509653+0000, chain.objs.size()=1 2024-03-04T13:00:16.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.228+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.470__shadow_.N5OLFb8yJJqPc6dCYq2IIqJKGfSEwBz_0 2024-03-04T13:00:16.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.229+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4746863133857894907', time=2024-03-04T14:56:24.654210+0000, chain.objs.size()=2 2024-03-04T13:00:16.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.229+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~D4NmHCijjTY2tR_Kue-FfhZeWD9BzWx.1 2024-03-04T13:00:16.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.229+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__shadow_mymultipart.2~D4NmHCijjTY2tR_Kue-FfhZeWD9BzWx.1_1 2024-03-04T13:00:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17826744820714890828', time=2024-03-04T14:57:01.819282+0000, chain.objs.size()=1 2024-03-04T13:00:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.517__shadow_.yQb4n9MFCAJZEw2Gbc0mTUw4iU0Dwv5_0 2024-03-04T13:00:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15224929535556042514', time=2024-03-04T14:57:02.926562+0000, chain.objs.size()=1 2024-03-04T13:00:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.519__shadow_.yV0tE_sfY-LnxlCjcFn6WgtXb4NEzfv_0 2024-03-04T13:00:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11598206125592285371', time=2024-03-04T14:57:20.005228+0000, chain.objs.size()=1 2024-03-04T13:00:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:9Yt8i1CNm8IXAuxmj7K..V4UrjujT-y_.CJDQKGBAUBYezUp39JK_GmbysrGnrof_0 2024-03-04T13:00:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7031317368199751138', time=2024-03-04T14:57:27.249064+0000, chain.objs.size()=1 2024-03-04T13:00:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.541__shadow:dzZ5-iqiTc5MEvmB-uizM2HrBI.e10d_.ed7O1oTQPWPHkgWe9p9hKhNBAhE8T70_0 2024-03-04T13:00:16.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10353417138801639137', time=2024-03-04T14:57:38.242622+0000, chain.objs.size()=1 2024-03-04T13:00:16.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:hWTtnbOBKFqjcApT4OGgMI3pIehKjBA_.j_HKTo9vy5gundeUfps4k0DeKThwn-0_0 2024-03-04T13:00:16.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2668588006378181262', time=2024-03-04T14:57:41.770166+0000, chain.objs.size()=1 2024-03-04T13:00:16.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:j-CxJQKuXzeTxNl7UTAF2FBc0GmOMPb_.f_o_Qtizm92ldkf3iCbGo-QyL3Z5Yf0_0 2024-03-04T13:00:16.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3565760761957870885', time=2024-03-04T14:57:48.964524+0000, chain.objs.size()=1 2024-03-04T13:00:16.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.548__shadow:d2orBnrJ7ZlJ5LlysXeHGszI4Se9UvW_.XoWBQB8aTvRUEB6rOWA7ckvqR5EcXda_0 2024-03-04T13:00:16.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18329190180227950080', time=2024-03-04T14:57:52.012550+0000, chain.objs.size()=1 2024-03-04T13:00:16.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.553__shadow:c0MrWidl.E09wnKNB-Q7AbQjsnKYX12_.3xJ-sXOkhGgWEcauPb19CqM1MChm4Wd_0 2024-03-04T13:00:16.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14981967821887600911', time=2024-03-04T14:58:18.530902+0000, chain.objs.size()=1 2024-03-04T13:00:16.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.599__shadow_.S0d5VqoqO5xYT0-nHUlpT8Shf57-cus_0 2024-03-04T13:00:16.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2932607065804797963', time=2024-03-04T14:58:32.246151+0000, chain.objs.size()=1 2024-03-04T13:00:16.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.232+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.626__shadow_.KytW28nlLX99pLIVJqLglBSxuwVRmIt_0 2024-03-04T13:00:16.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.237+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.242+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T13:00:16.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.243+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.243+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51312' 2024-03-04T13:00:16.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12430867645434837634', time=2024-03-04T14:52:51.499352+0000, chain.objs.size()=1 2024-03-04T13:00:16.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.140__shadow_.h0skjCBvfh7yMJWuZNHZFisXMc4uW1E_0 2024-03-04T13:00:16.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4210355490115037465', time=2024-03-04T14:52:56.851710+0000, chain.objs.size()=5 2024-03-04T13:00:16.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__multipart_mymultipart-FROZEN.2~SJ4qW0926PVTcu6ePYclhgC8Lp-WPPf.1 2024-03-04T13:00:16.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__shadow_mymultipart-FROZEN.2~SJ4qW0926PVTcu6ePYclhgC8Lp-WPPf.1_1 2024-03-04T13:00:16.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__multipart_mymultipart-FROZEN.2~SJ4qW0926PVTcu6ePYclhgC8Lp-WPPf.2 2024-03-04T13:00:16.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__shadow_mymultipart-FROZEN.2~SJ4qW0926PVTcu6ePYclhgC8Lp-WPPf.2_1 2024-03-04T13:00:16.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__multipart_mymultipart-FROZEN.2~SJ4qW0926PVTcu6ePYclhgC8Lp-WPPf.3 2024-03-04T13:00:16.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9717089447716349614', time=2024-03-04T14:53:35.320168+0000, chain.objs.size()=1 2024-03-04T13:00:16.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.215__shadow_.Ur7g3YAAAr6gJZwJmnRp3MG7hCYmqaT_0 2024-03-04T13:00:16.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5751012971670196158', time=2024-03-04T14:53:37.774295+0000, chain.objs.size()=1 2024-03-04T13:00:16.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.219__shadow_.mXbw-BoFbsckpiREWV4_0G1SGpAlK1A_0 2024-03-04T13:00:16.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13300119156325524372', time=2024-03-04T14:53:43.515800+0000, chain.objs.size()=1 2024-03-04T13:00:16.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.232__shadow_.mTLlaT6Z7-sgR56U8AftVH7MXX0PQ0Y_0 2024-03-04T13:00:16.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3051212392688511236', time=2024-03-04T14:53:43.969633+0000, chain.objs.size()=1 2024-03-04T13:00:16.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.233__shadow_.T6OfHdRNE-ZkIH6xv6qWgAevh2046MY_0 2024-03-04T13:00:16.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4297574249613560919', time=2024-03-04T14:53:52.089656+0000, chain.objs.size()=1 2024-03-04T13:00:16.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.pI9bzorvdz7yHw_KmnboqpXjzr8tBUE_0 2024-03-04T13:00:16.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4750057815661992063', time=2024-03-04T14:53:52.221509+0000, chain.objs.size()=1 2024-03-04T13:00:16.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.245+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.cW_Yi3_gTNz9SpRBD5bL4EBUDcn-rpV_0 2024-03-04T13:00:16.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.246+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5487406000400523339', time=2024-03-04T14:53:52.231697+0000, chain.objs.size()=1 2024-03-04T13:00:16.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.246+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.AB5G8RE4dQI1sI7qYSOph74T5H7cZBR_0 2024-03-04T13:00:16.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.247+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5797410934445357770', time=2024-03-04T14:53:52.263805+0000, chain.objs.size()=1 2024-03-04T13:00:16.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.247+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.dj3RLOHRD9viY9vbzpgJ8MLvc8INxiu_0 2024-03-04T13:00:16.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.247+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13062137032347811235', time=2024-03-04T14:53:52.395351+0000, chain.objs.size()=1 2024-03-04T13:00:16.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.247+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.dy2-giWuhgW2Gsq21x556zuySHCeMMy_0 2024-03-04T13:00:16.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.249+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17132464265786309357', time=2024-03-04T14:53:52.410282+0000, chain.objs.size()=1 2024-03-04T13:00:16.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.249+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.bVtkCBzSLv7eDNAAPCH0uawpiOVVe_u_0 2024-03-04T13:00:16.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15676557045646327496', time=2024-03-04T14:53:52.418132+0000, chain.objs.size()=1 2024-03-04T13:00:16.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.FfSDlk_0_c9pkDNYb3jzZ4u8gsMbcE8_0 2024-03-04T13:00:16.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14317081402751302294', time=2024-03-04T14:53:52.425672+0000, chain.objs.size()=1 2024-03-04T13:00:16.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zFhLyw8s9GYHTWID9Ms02YaxbG53Ya0_0 2024-03-04T13:00:16.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11000485536223259970', time=2024-03-04T14:53:52.432506+0000, chain.objs.size()=1 2024-03-04T13:00:16.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.OffH7u5QuRc-WwL8QRE39dsFoUpVoGD_0 2024-03-04T13:00:16.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5909769878301054277', time=2024-03-04T14:53:52.468791+0000, chain.objs.size()=1 2024-03-04T13:00:16.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.7gi3eTt2HocQTCUCENJJcmRHecriDDL_0 2024-03-04T13:00:16.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4718783796628043521', time=2024-03-04T14:53:52.570146+0000, chain.objs.size()=1 2024-03-04T13:00:16.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.oxV3shYgptWsdmtsdb1YhjXKaYbstY9_0 2024-03-04T13:00:16.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10609509971625787140', time=2024-03-04T14:53:52.626616+0000, chain.objs.size()=1 2024-03-04T13:00:16.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LVm4QP-hEk32LS70GUJWGkdRcZmbmJ9_0 2024-03-04T13:00:16.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18181598553658000895', time=2024-03-04T14:53:52.649771+0000, chain.objs.size()=1 2024-03-04T13:00:16.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.2LilO5ZMFq74Dswo5IJRRCnywrKnwQ5_0 2024-03-04T13:00:16.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16342993171977126698', time=2024-03-04T14:53:52.783999+0000, chain.objs.size()=1 2024-03-04T13:00:16.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.rvnEteb-hgHDyl5i_6esavp1tZrWrFz_0 2024-03-04T13:00:16.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1760398788223974699', time=2024-03-04T14:53:52.797474+0000, chain.objs.size()=1 2024-03-04T13:00:16.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.OVZjsa3ZiEjmjrNOSFHDzx5VxPD1n0b_0 2024-03-04T13:00:16.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3154815156851632711', time=2024-03-04T14:53:52.831885+0000, chain.objs.size()=1 2024-03-04T13:00:16.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.252+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Mp2jY_HVPGXFNHNqj-gNkvZoowHbHgO_0 2024-03-04T13:00:16.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.253+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14430205973468552779', time=2024-03-04T14:53:52.916226+0000, chain.objs.size()=1 2024-03-04T13:00:16.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.253+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.85PU-kKKdKEs_WlA3bGTRM7aVHbNSAp_0 2024-03-04T13:00:16.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.255+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17563330244010819085', time=2024-03-04T14:53:52.946193+0000, chain.objs.size()=1 2024-03-04T13:00:16.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.255+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8bamXt32iO45Zg2m_oTxQRnZZ0jnEIW_0 2024-03-04T13:00:16.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.255+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9233425581701256108', time=2024-03-04T14:53:52.950312+0000, chain.objs.size()=1 2024-03-04T13:00:16.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.255+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PrTM1uKrjbgUzyyMD_eXunC0G_XoVye_0 2024-03-04T13:00:16.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.255+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10695148686190910478', time=2024-03-04T14:53:52.960767+0000, chain.objs.size()=1 2024-03-04T13:00:16.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.255+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.t78hKnbiH6wZ05s87HVvh__9U2DEcXT_0 2024-03-04T13:00:16.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3262768939470322781', time=2024-03-04T14:53:52.964191+0000, chain.objs.size()=1 2024-03-04T13:00:16.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.59PzsSAV6Mq_Pt6Gbz5bShrAdvDJ6Wx_0 2024-03-04T13:00:16.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16699518815628015315', time=2024-03-04T14:53:52.965387+0000, chain.objs.size()=1 2024-03-04T13:00:16.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GuKTLyr7eO5a7HfTrZsLNoOu7cstAaC_0 2024-03-04T13:00:16.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2944740441217486974', time=2024-03-04T14:53:53.003361+0000, chain.objs.size()=1 2024-03-04T13:00:16.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.rGR2IR71ERWMELsWrN6KhotGqXSffs7_0 2024-03-04T13:00:16.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3835419312194434322', time=2024-03-04T14:53:53.129108+0000, chain.objs.size()=1 2024-03-04T13:00:16.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.lcJKYRIiGyAg79Wvi4gG8_Jnz6Yrgka_0 2024-03-04T13:00:16.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8890416342409863879', time=2024-03-04T14:53:53.287528+0000, chain.objs.size()=1 2024-03-04T13:00:16.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.MMviuCClBH85p5ooAq_OTqOoiZ_C0xI_0 2024-03-04T13:00:16.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2906542440485053417', time=2024-03-04T14:53:53.295944+0000, chain.objs.size()=1 2024-03-04T13:00:16.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ut_k0baNLfCW92SEgOsg3hbKLAGk5Dn_0 2024-03-04T13:00:16.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2090451472228966732', time=2024-03-04T14:53:53.317262+0000, chain.objs.size()=1 2024-03-04T13:00:16.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.sbgKGPDv9U8a5DzRdR7J5G-5bXsTM6V_0 2024-03-04T13:00:16.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9630785680178387647', time=2024-03-04T14:53:53.320927+0000, chain.objs.size()=1 2024-03-04T13:00:16.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.lavDMsTXw3kvDicZSAyaf6SQamIN7Nn_0 2024-03-04T13:00:16.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1493580676706749738', time=2024-03-04T14:53:55.735458+0000, chain.objs.size()=1 2024-03-04T13:00:16.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.238__shadow_._NMK6SLPB73OzDWooKlz4_gaxvhpF0n_0 2024-03-04T13:00:16.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10922320398115088378', time=2024-03-04T14:53:55.736386+0000, chain.objs.size()=1 2024-03-04T13:00:16.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.238__shadow_.ERJ4lbDmCp52FdL3OnXXUAEsrcxDL7e_0 2024-03-04T13:00:16.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12854546495845336733', time=2024-03-04T14:54:03.562968+0000, chain.objs.size()=1 2024-03-04T13:00:16.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.259+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.256__shadow_.Q6WPv0eGHHJFwa1gatqpW3sB_HzRBX__0 2024-03-04T13:00:16.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.262+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15674000515076877432', time=2024-03-04T14:54:06.752689+0000, chain.objs.size()=1 2024-03-04T13:00:16.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.262+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.263__shadow_.m_J0hnYl858ctNsGDkBbzE_RHzm2Ce3_0 2024-03-04T13:00:16.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.262+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4757228886615115611', time=2024-03-04T14:54:09.025232+0000, chain.objs.size()=1 2024-03-04T13:00:16.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.262+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.S0HkQZk2HMrPJBjIttmw4D7CqEllCb4_0 2024-03-04T13:00:16.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.262+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3905890183814084364', time=2024-03-04T14:54:09.032281+0000, chain.objs.size()=1 2024-03-04T13:00:16.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.262+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.YOag6XDVw21UVZOE3eMfQex5_OTytm1_0 2024-03-04T13:00:16.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15308272119014178821', time=2024-03-04T14:54:11.753944+0000, chain.objs.size()=1 2024-03-04T13:00:16.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.272__shadow_.7m314vx6onQT5HIrYiK2IqWaAsfOQKH_0 2024-03-04T13:00:16.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10425051556231798145', time=2024-03-04T14:54:13.561597+0000, chain.objs.size()=1 2024-03-04T13:00:16.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.276__shadow_.i1hjdypqSzpmWdnIqIKdvg5rdz1AQ0G_0 2024-03-04T13:00:16.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12772242772173907759', time=2024-03-04T14:54:15.038538+0000, chain.objs.size()=1 2024-03-04T13:00:16.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.279__shadow_.vub4MTaD66P8VWu-4qOeFP-2PcrU5sn_0 2024-03-04T13:00:16.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8842432248685018349', time=2024-03-04T14:54:20.807078+0000, chain.objs.size()=1 2024-03-04T13:00:16.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.292__shadow:VX0x223LXakoPO6A-LP3mpXgHQgdh6C_.DmEnG1K1k3JAlNqH8o1_5Y3lPszrjPB_0 2024-03-04T13:00:16.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4617444510827521212', time=2024-03-04T14:54:29.616681+0000, chain.objs.size()=1 2024-03-04T13:00:16.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.IBgEuGzS5qQkRLKXu4AyGrNPpLT-F5l_0 2024-03-04T13:00:16.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17693277399115216487', time=2024-03-04T14:54:29.653845+0000, chain.objs.size()=1 2024-03-04T13:00:16.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.R3H-tCNnjdC0je6vC1H2obrA7wYjOke_0 2024-03-04T13:00:16.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8391989278369687667', time=2024-03-04T14:54:29.678645+0000, chain.objs.size()=1 2024-03-04T13:00:16.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.hS0ezgx7OD0TjtheF74zW9GdT1D87-d_0 2024-03-04T13:00:16.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16288247958693150767', time=2024-03-04T14:54:29.690306+0000, chain.objs.size()=1 2024-03-04T13:00:16.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.SttPZptFtY6ipRqkhEMALjMmoiMHycZ_0 2024-03-04T13:00:16.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11098347088922460652', time=2024-03-04T14:54:29.701929+0000, chain.objs.size()=1 2024-03-04T13:00:16.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.265+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Xmm8iPPxy2ikm1LxVlxjf_OB0SPNZ2o_0 2024-03-04T13:00:16.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1948370574489302856', time=2024-03-04T14:54:29.783747+0000, chain.objs.size()=1 2024-03-04T13:00:16.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Chwu1FLjF5oVNDciC2ZUOipJtS8XR6G_0 2024-03-04T13:00:16.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10939732421984106988', time=2024-03-04T14:54:29.813170+0000, chain.objs.size()=1 2024-03-04T13:00:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ojNXkYzAxJUmq_K04kgsLbEykLHGosz_0 2024-03-04T13:00:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17906582885298555239', time=2024-03-04T14:54:29.963771+0000, chain.objs.size()=1 2024-03-04T13:00:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.80ecjCPJ1XrXBCNduOpRdcQfJz3MMNs_0 2024-03-04T13:00:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2374189194351305603', time=2024-03-04T14:54:29.971718+0000, chain.objs.size()=1 2024-03-04T13:00:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.8YxhM8EoLRxEpFBLCRPvIo7oN3NyBd2_0 2024-03-04T13:00:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4823730148744652576', time=2024-03-04T14:54:29.988537+0000, chain.objs.size()=1 2024-03-04T13:00:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rN4fUwgxPg8TGBINK4gK07_i5oZvG3H_0 2024-03-04T13:00:16.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.389536178796260567', time=2024-03-04T14:54:29.997219+0000, chain.objs.size()=1 2024-03-04T13:00:16.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.GLorFzpbTWKu45CD-xL8gNKDc5t14Vr_0 2024-03-04T13:00:16.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4455071698768678186', time=2024-03-04T14:54:30.019808+0000, chain.objs.size()=1 2024-03-04T13:00:16.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yKVoJMdtw5xCawnmiG611P9g_wN93Y0_0 2024-03-04T13:00:16.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7018163466211722055', time=2024-03-04T14:54:30.104407+0000, chain.objs.size()=1 2024-03-04T13:00:16.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.267+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3LWZ8sVVD6DpBfRW0X7ONaXoIwSPXnf_0 2024-03-04T13:00:16.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.270+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10752211696713943757', time=2024-03-04T14:54:30.112307+0000, chain.objs.size()=1 2024-03-04T13:00:16.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.270+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2vv1dD916E9-QEjUH-8niyQxpYdZ_85_0 2024-03-04T13:00:16.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.270+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17876233066707110648', time=2024-03-04T14:54:30.132028+0000, chain.objs.size()=1 2024-03-04T13:00:16.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.270+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.1O20xBwuLZSY-aKBOdJXR8KXsKVck41_0 2024-03-04T13:00:16.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.270+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9091165481491273934', time=2024-03-04T14:54:30.136184+0000, chain.objs.size()=1 2024-03-04T13:00:16.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.270+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RyMTgtAhZz4aiS-teMPF3_KOl73VVNi_0 2024-03-04T13:00:16.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12734395009437871231', time=2024-03-04T14:54:30.173256+0000, chain.objs.size()=1 2024-03-04T13:00:16.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2p9iF4yhgrsl108C8XMOkeyk1m7mg2Y_0 2024-03-04T13:00:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9703860054644896222', time=2024-03-04T14:54:30.182964+0000, chain.objs.size()=1 2024-03-04T13:00:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VYi5B1YQB43IR9igfAMM1oH36kt4Cl8_0 2024-03-04T13:00:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14436311613611880831', time=2024-03-04T14:54:30.286266+0000, chain.objs.size()=1 2024-03-04T13:00:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.KrqBZQiEOFPonH01Zc1GRARpoqgteK4_0 2024-03-04T13:00:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1526296847522494007', time=2024-03-04T14:54:30.302269+0000, chain.objs.size()=1 2024-03-04T13:00:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.xOOS8Dq063Ik13gd5k9LBpzY3U4-JAc_0 2024-03-04T13:00:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.160266165654343255', time=2024-03-04T14:54:30.309791+0000, chain.objs.size()=1 2024-03-04T13:00:16.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4zQVr4k1rrZ7cmi9my5XP9ULKHmFynZ_0 2024-03-04T13:00:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12318147532805421522', time=2024-03-04T14:54:30.328709+0000, chain.objs.size()=1 2024-03-04T13:00:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.jhaEpxRu9F7j0nkNID7wBMKzWMM4ihh_0 2024-03-04T13:00:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17062838096289893659', time=2024-03-04T14:54:30.423108+0000, chain.objs.size()=1 2024-03-04T13:00:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.JQKyvi3MqpBV1rC19qrpeGrl-2StBf0_0 2024-03-04T13:00:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13282647071163836258', time=2024-03-04T14:54:30.424920+0000, chain.objs.size()=1 2024-03-04T13:00:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.CQgYHzo_NDKxNVAtZ2tcvIghCSk-Qa2_0 2024-03-04T13:00:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12269465645315847731', time=2024-03-04T14:54:30.462214+0000, chain.objs.size()=1 2024-03-04T13:00:16.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.QXE1nI8uo9mgvWp6q0ubuDbXSXsTX9E_0 2024-03-04T13:00:16.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9039171252795266764', time=2024-03-04T14:54:30.465168+0000, chain.objs.size()=1 2024-03-04T13:00:16.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.73kSrR0hdMbFxYYbjSg9T29EdFeA20U_0 2024-03-04T13:00:16.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10955985203633507638', time=2024-03-04T14:54:30.471800+0000, chain.objs.size()=1 2024-03-04T13:00:16.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.273+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Ls05JunmS0Xl-sKlbZJpRn1rLJsi2nf_0 2024-03-04T13:00:16.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.275+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13903114919495163225', time=2024-03-04T14:54:30.601456+0000, chain.objs.size()=1 2024-03-04T13:00:16.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.275+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cefpCFqZMOif66vHH8GASx58ZXtV2gU_0 2024-03-04T13:00:16.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.276+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1800398900469168549', time=2024-03-04T14:54:30.652859+0000, chain.objs.size()=1 2024-03-04T13:00:16.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.276+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HVkzTA8PeYDsWDl_LyfAH0qmb-fFmjJ_0 2024-03-04T13:00:16.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16604199720927779382', time=2024-03-04T14:54:30.667959+0000, chain.objs.size()=1 2024-03-04T13:00:16.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.d10CtefWtUCtPyp89erlav_NcCNxAXa_0 2024-03-04T13:00:16.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18150999455361472517', time=2024-03-04T14:54:30.737216+0000, chain.objs.size()=1 2024-03-04T13:00:16.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ARKI4Bog8UTqU7gg12DDsPIEZ-wdoQ7_0 2024-03-04T13:00:16.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13889687372261893811', time=2024-03-04T14:54:30.751341+0000, chain.objs.size()=1 2024-03-04T13:00:16.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5U3kWd2gw6UJHa2wYgzPsc7kKXVfnAH_0 2024-03-04T13:00:16.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4091041947646880716', time=2024-03-04T14:54:30.763566+0000, chain.objs.size()=1 2024-03-04T13:00:16.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.dnhwK_DK-XT_JHlAIeBdzYipxpBxTQv_0 2024-03-04T13:00:16.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4176449013485622591', time=2024-03-04T14:54:38.328509+0000, chain.objs.size()=1 2024-03-04T13:00:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ZYz5Qkr58PP-Pobf04gM7tvr0fOEL43_0 2024-03-04T13:00:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15215545735971025096', time=2024-03-04T14:54:38.339345+0000, chain.objs.size()=1 2024-03-04T13:00:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7tw_nuhaj-50kkPxdYcq1TK7Es1v1BB_0 2024-03-04T13:00:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8187756453315700269', time=2024-03-04T14:54:38.357803+0000, chain.objs.size()=1 2024-03-04T13:00:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jgiILcMxfDpaDbdaeB5WrbQSkrCLIJe_0 2024-03-04T13:00:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9402741445262606788', time=2024-03-04T14:54:38.375599+0000, chain.objs.size()=1 2024-03-04T13:00:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jJNxtHoOBc24hoqLQAbcj-hWLv4XecW_0 2024-03-04T13:00:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7542960871588648246', time=2024-03-04T14:54:38.380388+0000, chain.objs.size()=1 2024-03-04T13:00:16.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.V9wgYNGHeI0Frl4NaQ2mPKmflR3w6T0_0 2024-03-04T13:00:16.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11298519961289760910', time=2024-03-04T14:54:38.488780+0000, chain.objs.size()=1 2024-03-04T13:00:16.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.278+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.QDlXw5Z2NdJUxqKdzXxnA76tblOW2dL_0 2024-03-04T13:00:16.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.279+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8354800654390225400', time=2024-03-04T14:54:38.508602+0000, chain.objs.size()=1 2024-03-04T13:00:16.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.279+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7ohBlu_q01WpF14aZ6-SU_V9MOB7-Bu_0 2024-03-04T13:00:16.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.281+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.348863486589157129', time=2024-03-04T14:54:38.523427+0000, chain.objs.size()=1 2024-03-04T13:00:16.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.281+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.e3WJ3MhtwOhPzxUPjtGI1eZebi2Seor_0 2024-03-04T13:00:16.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.281+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2621601718673883064', time=2024-03-04T14:54:38.539307+0000, chain.objs.size()=1 2024-03-04T13:00:16.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.281+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.C9x87Yc4QsExOt8p21sjU2u-7YAGDXD_0 2024-03-04T13:00:16.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.281+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6597585252117965077', time=2024-03-04T14:54:38.660806+0000, chain.objs.size()=1 2024-03-04T13:00:16.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.281+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.e0eAs-xV4U_SG95qASgp9hXKkXn13VS_0 2024-03-04T13:00:16.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.281+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11828176745724557986', time=2024-03-04T14:54:38.671979+0000, chain.objs.size()=1 2024-03-04T13:00:16.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.281+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zdnnG9llBgRBW20jXKNH8uEMR4QH6q3_0 2024-03-04T13:00:16.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8923724061552924687', time=2024-03-04T14:54:38.693086+0000, chain.objs.size()=1 2024-03-04T13:00:16.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.fJZ0geTQbT_qL_MrRQx5u5mbJK1umE0_0 2024-03-04T13:00:16.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11488690319863996761', time=2024-03-04T14:54:38.702635+0000, chain.objs.size()=1 2024-03-04T13:00:16.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xFq2Juksz2uBSZTTrkbs_5dJFCMlcEg_0 2024-03-04T13:00:16.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6103621166469491421', time=2024-03-04T14:54:38.801324+0000, chain.objs.size()=1 2024-03-04T13:00:16.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.YqPSPYB58CJK1o50PWT9OR_ZFIdn9oc_0 2024-03-04T13:00:16.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2512457026793895096', time=2024-03-04T14:54:38.833829+0000, chain.objs.size()=1 2024-03-04T13:00:16.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zWrnfyIw4lKik_fRIWqFHcCyMpD_Wdg_0 2024-03-04T13:00:16.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10591913138162784256', time=2024-03-04T14:54:38.841708+0000, chain.objs.size()=1 2024-03-04T13:00:16.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.aJhYEQk7RA7oVJ9Kv_s2TcWh1XZL1m4_0 2024-03-04T13:00:16.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12791872743100921029', time=2024-03-04T14:54:38.845674+0000, chain.objs.size()=1 2024-03-04T13:00:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.UptXZoHUFP8Dktk_0Lc0O7OlSOHRbw7_0 2024-03-04T13:00:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10121423272592459460', time=2024-03-04T14:54:38.857598+0000, chain.objs.size()=1 2024-03-04T13:00:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.3p7GUbHI2c5Iay7SlhZJuTjoh8oR5Gq_0 2024-03-04T13:00:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10479543248497278808', time=2024-03-04T14:54:38.859897+0000, chain.objs.size()=1 2024-03-04T13:00:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wAXgzJLIKQiBlB-XD-8pUwUMxKAJnJY_0 2024-03-04T13:00:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9723404844966424441', time=2024-03-04T14:54:38.869860+0000, chain.objs.size()=1 2024-03-04T13:00:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.uUFeF-uTorNHRVi0h4nlPXYIxwum4L-_0 2024-03-04T13:00:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7280096239685617073', time=2024-03-04T14:54:38.945225+0000, chain.objs.size()=1 2024-03-04T13:00:16.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.284+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.36L0R4Kr3pZmPmRcwVHeVWj2iIVRSl6_0 2024-03-04T13:00:16.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.287+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17872774300329806723', time=2024-03-04T14:54:38.966448+0000, chain.objs.size()=1 2024-03-04T13:00:16.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.287+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Y6BipuAZIuQWXegRBa8nQHi6Xf5phw7_0 2024-03-04T13:00:16.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.289+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10339184710546035358', time=2024-03-04T14:54:39.016641+0000, chain.objs.size()=1 2024-03-04T13:00:16.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.289+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.z82LAaZpjnkdRY7mEHJdSHGDuCAsjbj_0 2024-03-04T13:00:16.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.292+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/51312 2024-03-04T13:00:16.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.294+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-03-04T13:00:16.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.294+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14259503032922024010', time=2024-03-04T14:54:39.023025+0000, chain.objs.size()=1 2024-03-04T13:00:16.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.294+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.544rwhZkC4g1wGZq14NsYBuNidcbkrZ_0 2024-03-04T13:00:16.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.294+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2864715608519425153', time=2024-03-04T14:54:39.024672+0000, chain.objs.size()=1 2024-03-04T13:00:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.294+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.RoNcbf_PrM6MHBsOPiKTO63_jEDuG9L_0 2024-03-04T13:00:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.294+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10960766896862457636', time=2024-03-04T14:54:39.147271+0000, chain.objs.size()=1 2024-03-04T13:00:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.294+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-d-jEiX72egi9McCpYyWmINi3vn16AO_0 2024-03-04T13:00:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.294+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8569878238619993317', time=2024-03-04T14:54:39.152317+0000, chain.objs.size()=1 2024-03-04T13:00:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.294+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Fl_1IneQn68n5djwgLT3ua2U9A4zi70_0 2024-03-04T13:00:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12698824247874803216', time=2024-03-04T14:54:39.179936+0000, chain.objs.size()=1 2024-03-04T13:00:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gbh60FRdJr9tHpU0E0D-LqE08RvGljx_0 2024-03-04T13:00:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9353260206564365107', time=2024-03-04T14:54:39.266935+0000, chain.objs.size()=1 2024-03-04T13:00:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Lcb62Ka2J2tyFKFTFcBx9dKLCPsz4nP_0 2024-03-04T13:00:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15715903213938526086', time=2024-03-04T14:54:39.280306+0000, chain.objs.size()=1 2024-03-04T13:00:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rUz4eQPHpKqh_FXL3SVaX-pB3m84g61_0 2024-03-04T13:00:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17991072246883663488', time=2024-03-04T14:54:39.305439+0000, chain.objs.size()=1 2024-03-04T13:00:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.bjylsm-4h0LLULx5jLiEcEr3I8ct3a6_0 2024-03-04T13:00:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9773159365982329896', time=2024-03-04T14:54:39.314101+0000, chain.objs.size()=1 2024-03-04T13:00:16.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Fi3-tLXtOUaoiT41ksDp57djjsBV_C__0 2024-03-04T13:00:16.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9875247588270868661', time=2024-03-04T14:54:39.341310+0000, chain.objs.size()=1 2024-03-04T13:00:16.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.R-FUbmd9QWcuKPjRzKq8CqZYw5GWsh9_0 2024-03-04T13:00:16.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17882810663025011316', time=2024-03-04T14:54:39.422787+0000, chain.objs.size()=1 2024-03-04T13:00:16.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HkWBFjBxuO2MCPkwVUrfF2loXpJpOBj_0 2024-03-04T13:00:16.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8042860362872023385', time=2024-03-04T14:54:39.438788+0000, chain.objs.size()=1 2024-03-04T13:00:16.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.295+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.a1oPSVVTEJxwu_sTGCpqH1vWP8f1gy8_0 2024-03-04T13:00:16.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.296+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16215035433375000249', time=2024-03-04T14:54:39.483890+0000, chain.objs.size()=1 2024-03-04T13:00:16.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.296+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.PFCHq2c-Q2ZYnJ4XXTmovu1hOAYkVTU_0 2024-03-04T13:00:16.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.296+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12598757177850229838', time=2024-03-04T14:55:30.836356+0000, chain.objs.size()=1 2024-03-04T13:00:16.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.296+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.410__shadow_.1tEa8FtdGlIz8QXnCYWc-gywA4wn9Tx_0 2024-03-04T13:00:16.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.296+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11941896704499934974', time=2024-03-04T14:55:39.854429+0000, chain.objs.size()=1 2024-03-04T13:00:16.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.296+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.427__shadow_.jCq-iD6k6ubSufhOsbTKcSUZPHwDMai_0 2024-03-04T13:00:16.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.296+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18217240139786025656', time=2024-03-04T14:55:43.989696+0000, chain.objs.size()=1 2024-03-04T13:00:16.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.296+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.433__shadow_.cJp8x24X_WFIo00u3_dM_9VIPHHAvRN_0 2024-03-04T13:00:16.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6235535644591499312', time=2024-03-04T14:55:46.551383+0000, chain.objs.size()=1 2024-03-04T13:00:16.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.437__shadow_.FZYshdQB0Wuzb277C7zNkxyLBKuLk2g_0 2024-03-04T13:00:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.467__shadow_.IpbOVwvq1aBu8OB58sacNB1r-FcitgY_1_88d128e96abb58da8f0375837bb51b5f', time=2024-03-04T14:55:57.333845+0000, chain.objs.size()=1 2024-03-04T13:00:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.467__shadow_.IpbOVwvq1aBu8OB58sacNB1r-FcitgY_0 2024-03-04T13:00:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.471__shadow_.dtEaJqaVcIi7WQMXzqmwRFwUV188M8M_1_e4621afae4ef111dca7fbcffd8c47423', time=2024-03-04T14:55:59.081966+0000, chain.objs.size()=1 2024-03-04T13:00:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.471__shadow_.dtEaJqaVcIi7WQMXzqmwRFwUV188M8M_0 2024-03-04T13:00:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.299+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6708345085531256540', time=2024-03-04T14:56:03.319603+0000, chain.objs.size()=6 2024-03-04T13:00:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.1 2024-03-04T13:00:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.2 2024-03-04T13:00:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.3 2024-03-04T13:00:16.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.299+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.4 2024-03-04T13:00:16.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.301+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.5 2024-03-04T13:00:16.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.301+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.6 2024-03-04T13:00:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.301+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14085179986436641073', time=2024-03-04T14:56:21.262736+0000, chain.objs.size()=12 2024-03-04T13:00:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.301+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw.1 2024-03-04T13:00:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.301+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw.1_1 2024-03-04T13:00:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.301+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.6kCn9rrqA6mTOqzLllGB1dfaPkpQcRHK.2 2024-03-04T13:00:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.6kCn9rrqA6mTOqzLllGB1dfaPkpQcRHK.2_1 2024-03-04T13:00:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.wamNdL6XYUnhLEu48fTgfHnIa4VvTklf.3 2024-03-04T13:00:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.wamNdL6XYUnhLEu48fTgfHnIa4VvTklf.3_1 2024-03-04T13:00:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw.4 2024-03-04T13:00:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw.4_1 2024-03-04T13:00:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw.5 2024-03-04T13:00:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw.5_1 2024-03-04T13:00:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw.6 2024-03-04T13:00:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.304+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__shadow_mymultipart.2~aDkmXjBaTR8B56y26DW9iKdzlkyxxHw.6_1 2024-03-04T13:00:16.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.306+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9980233520968343765', time=2024-03-04T14:57:08.588693+0000, chain.objs.size()=1 2024-03-04T13:00:16.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.306+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.528__multipart_mymultipart.8Tbz0Dhb8YHmJ9TvGc8IBQGTl8SAtHfx.1 2024-03-04T13:00:16.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.306+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6913818794329549987', time=2024-03-04T14:57:27.583798+0000, chain.objs.size()=1 2024-03-04T13:00:16.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.306+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.541__shadow:KtSZTM8d36t8Y9azDrgL4ADaLWufL-C_.ZO6P4rNtXA9omezWb6Y-1sUSHr7Xo2d_0 2024-03-04T13:00:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.308+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9550945620566802399', time=2024-03-04T14:57:37.423481+0000, chain.objs.size()=1 2024-03-04T13:00:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.308+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:PhWRpQGtu8b8Ujbe.uEicQSBFaHQu.S_.ZYGDqemFCMLqmNvW9scyXdpM-MEOqz3_0 2024-03-04T13:00:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.308+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10912199241364480274', time=2024-03-04T14:57:43.587808+0000, chain.objs.size()=1 2024-03-04T13:00:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.308+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:cELxucGHciqe5Ab7XOE3r1LM8qEXuEW_.6MXyJXcjyMZh1Z_MD03l13ZDcAZ163U_0 2024-03-04T13:00:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.308+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10853727801259264727', time=2024-03-04T14:57:45.844928+0000, chain.objs.size()=4 2024-03-04T13:00:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.308+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__multipart_testobj.2~kchVDAgobfBjJcwP1AZuoBsH0FYTLUq.1 2024-03-04T13:00:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.309+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__multipart_testobj.2~kchVDAgobfBjJcwP1AZuoBsH0FYTLUq.2 2024-03-04T13:00:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.312+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__multipart_testobj.2~kchVDAgobfBjJcwP1AZuoBsH0FYTLUq.3 2024-03-04T13:00:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.312+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__multipart_testobj.2~kchVDAgobfBjJcwP1AZuoBsH0FYTLUq.4 2024-03-04T13:00:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.312+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5940198130051543787', time=2024-03-04T14:57:49.602270+0000, chain.objs.size()=1 2024-03-04T13:00:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.312+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.549__shadow:W1gKWP2TftDZIOXbJlbbkWF7FaIRfvs_.rAFc10J1P9bp-SK7t-Pz8lbZ2sA5_7K_0 2024-03-04T13:00:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.312+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9938640882517116963', time=2024-03-04T14:58:14.704892+0000, chain.objs.size()=1 2024-03-04T13:00:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.312+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.590__shadow_.DgnN5JmwxxmZ5AdJcSW6WEqr02glTxO_0 2024-03-04T13:00:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.312+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17604271955747187092', time=2024-03-04T14:58:32.793744+0000, chain.objs.size()=1 2024-03-04T13:00:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.312+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.627__shadow_.SxIeQiGCIXzb8ICYCd03AflPzgP07J0_0 2024-03-04T13:00:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.312+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6128805353110963250', time=2024-03-04T14:58:49.104121+0000, chain.objs.size()=1 2024-03-04T13:00:16.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.312+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.669__shadow:yq1RDtMjAQrraF67A9vv1RWWdLo-AkZ_.DDnioObTXyPJyXrWGpqMCP_T0oF60ti_0 2024-03-04T13:00:16.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.314+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.318+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T13:00:16.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.319+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51487' 2024-03-04T13:00:16.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5680921584855612552', time=2024-03-04T14:52:51.024507+0000, chain.objs.size()=1 2024-03-04T13:00:16.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.137__shadow_.UvRddhAGfzRqLrde9pA1lDIYuGT1OFY_0 2024-03-04T13:00:16.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2047039009681260099', time=2024-03-04T14:52:56.856142+0000, chain.objs.size()=5 2024-03-04T13:00:16.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__multipart_mymultipart-LUKEWARM.2~mtXeveZl3XqamzFkedS9aGGLtYQOZvI.1 2024-03-04T13:00:16.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__shadow_mymultipart-LUKEWARM.2~mtXeveZl3XqamzFkedS9aGGLtYQOZvI.1_1 2024-03-04T13:00:16.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__multipart_mymultipart-LUKEWARM.2~mtXeveZl3XqamzFkedS9aGGLtYQOZvI.2 2024-03-04T13:00:16.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__shadow_mymultipart-LUKEWARM.2~mtXeveZl3XqamzFkedS9aGGLtYQOZvI.2_1 2024-03-04T13:00:16.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.152__multipart_mymultipart-LUKEWARM.2~mtXeveZl3XqamzFkedS9aGGLtYQOZvI.3 2024-03-04T13:00:16.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.171891513327333803', time=2024-03-04T14:53:29.873088+0000, chain.objs.size()=1 2024-03-04T13:00:16.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.204__shadow_.3TOQAtvBo1-ZPveNL8yaC0CRLHYC3yP_0 2024-03-04T13:00:16.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13615113848475715418', time=2024-03-04T14:53:52.079580+0000, chain.objs.size()=1 2024-03-04T13:00:16.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.4H1lNvN2JeDLkL78HtbgWSKREOEQ21L_0 2024-03-04T13:00:16.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2766397218048824169', time=2024-03-04T14:53:52.090068+0000, chain.objs.size()=1 2024-03-04T13:00:16.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.z--az756Hh2Yggpx4A83I9lAPb4fi0q_0 2024-03-04T13:00:16.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.577632767050431625', time=2024-03-04T14:53:52.111406+0000, chain.objs.size()=1 2024-03-04T13:00:16.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zRIW2BtAWvtB1HFoWFgCuAOhSnnzzq-_0 2024-03-04T13:00:16.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12447737333096903847', time=2024-03-04T14:53:52.120062+0000, chain.objs.size()=1 2024-03-04T13:00:16.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.DSs3XVmN8aJkGczqBGAhv4WXcUiJHNl_0 2024-03-04T13:00:16.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15622233861298909190', time=2024-03-04T14:53:52.224807+0000, chain.objs.size()=1 2024-03-04T13:00:16.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.320+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.bSzZafQuIPtQ97JEENvMVz0MF4MYp2e_0 2024-03-04T13:00:16.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.324+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14431065547032440954', time=2024-03-04T14:53:52.226038+0000, chain.objs.size()=1 2024-03-04T13:00:16.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.324+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.OIr3xROMxpbja7Kh7Brbs1Nfi9HZSGF_0 2024-03-04T13:00:16.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12141085658732134257', time=2024-03-04T14:53:52.230767+0000, chain.objs.size()=1 2024-03-04T13:00:16.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._R5t8M0D55cKtS6INm9gBk_VYnKvR5O_0 2024-03-04T13:00:16.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8221690737928481040', time=2024-03-04T14:53:52.240424+0000, chain.objs.size()=1 2024-03-04T13:00:16.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.cxfcvhUETb3ft9hpDGJuhopWbPX86JO_0 2024-03-04T13:00:16.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11787940142139461158', time=2024-03-04T14:53:52.276748+0000, chain.objs.size()=1 2024-03-04T13:00:16.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.bzi1LChS6E2gcDOBcDoryGg9JE0tYdy_0 2024-03-04T13:00:16.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5015987422489242839', time=2024-03-04T14:53:52.401949+0000, chain.objs.size()=1 2024-03-04T13:00:16.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.MXp_b7eWmzp-JWlaPtqfGrFxKYiq28Z_0 2024-03-04T13:00:16.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15903848905925849840', time=2024-03-04T14:53:52.410068+0000, chain.objs.size()=1 2024-03-04T13:00:16.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LvVdJcN3OPTJi1gYQhU-R-c6LHflzl__0 2024-03-04T13:00:16.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2202008743428022462', time=2024-03-04T14:53:52.469423+0000, chain.objs.size()=1 2024-03-04T13:00:16.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-_whdYxKOorfLHfvF7eU7fm59K2ildb_0 2024-03-04T13:00:16.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9986136445658876817', time=2024-03-04T14:53:52.620353+0000, chain.objs.size()=1 2024-03-04T13:00:16.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.MGa_wvDkgfds7usKlDZiKtAUqQ8RFBu_0 2024-03-04T13:00:16.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10738086355715946082', time=2024-03-04T14:53:52.634507+0000, chain.objs.size()=1 2024-03-04T13:00:16.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.qmFKQSkzsmd7Hj850rvRlCVM0Dq0Qhp_0 2024-03-04T13:00:16.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6862875984002916100', time=2024-03-04T14:53:52.740598+0000, chain.objs.size()=1 2024-03-04T13:00:16.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.45wSeFqcPyqO0AdEhoXJfsuR2rKviMJ_0 2024-03-04T13:00:16.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.68757885670706961', time=2024-03-04T14:53:52.810458+0000, chain.objs.size()=1 2024-03-04T13:00:16.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mxM32eLkNtVNyR-byUNacSEncEs_MI5_0 2024-03-04T13:00:16.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9565002694672916463', time=2024-03-04T14:53:52.948297+0000, chain.objs.size()=1 2024-03-04T13:00:16.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.327+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yAaKzFWtR_TYMfAUwDVT5JYxqmSFKf2_0 2024-03-04T13:00:16.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.330+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4767688710629679980', time=2024-03-04T14:53:52.953428+0000, chain.objs.size()=1 2024-03-04T13:00:16.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.330+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jgs1nKrMyJ340EBkX-pQck68F2lAD-F_0 2024-03-04T13:00:16.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.330+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4793268035207020162', time=2024-03-04T14:53:53.001305+0000, chain.objs.size()=1 2024-03-04T13:00:16.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.330+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.guSkhDNU1_Ylu-MwiSAAtXcW6bIaIL__0 2024-03-04T13:00:16.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.330+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9098518924625367601', time=2024-03-04T14:53:53.002878+0000, chain.objs.size()=1 2024-03-04T13:00:16.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.330+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ulfFq5mBbq1RUBPenzmr8X0Sz-dmSkp_0 2024-03-04T13:00:16.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.330+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15731332925236755461', time=2024-03-04T14:53:53.005234+0000, chain.objs.size()=1 2024-03-04T13:00:16.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.330+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.nYy1PFeXV_Es3kbG9GHNSanWmetvLbs_0 2024-03-04T13:00:16.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.330+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16645653291544670810', time=2024-03-04T14:53:53.108312+0000, chain.objs.size()=1 2024-03-04T13:00:16.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.330+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PTcUW55F4jBvBilnda-uYIz9i7zIVZy_0 2024-03-04T13:00:16.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.330+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17502739644015947331', time=2024-03-04T14:53:53.128043+0000, chain.objs.size()=1 2024-03-04T13:00:16.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.331+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.WTfjSgx2Cw2wu5Xb-9WIuGlmtXHc4Z9_0 2024-03-04T13:00:16.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.331+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7599057674412816441', time=2024-03-04T14:53:53.132095+0000, chain.objs.size()=1 2024-03-04T13:00:16.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.331+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3PkKak3Mnj00TXNrwcLVHUuuYlH8p-J_0 2024-03-04T13:00:16.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.331+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6553263615188407328', time=2024-03-04T14:53:53.171809+0000, chain.objs.size()=1 2024-03-04T13:00:16.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.331+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wuJPDpmdgYPrPrjj7pJFTNSBFdqy2jq_0 2024-03-04T13:00:16.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.331+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11131297064555041196', time=2024-03-04T14:53:53.179218+0000, chain.objs.size()=1 2024-03-04T13:00:16.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.331+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._k_sriDUf5obSvvTUYUkinkA3f62kgo_0 2024-03-04T13:00:16.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.331+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16164223549708484413', time=2024-03-04T14:53:53.329039+0000, chain.objs.size()=1 2024-03-04T13:00:16.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.331+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.tEora1FVm9lz_F2_la6F8fF-pfXdiUf_0 2024-03-04T13:00:16.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.331+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1561048986207845716', time=2024-03-04T14:54:00.989881+0000, chain.objs.size()=1 2024-03-04T13:00:16.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.331+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.250__shadow_.9RKrFmvR3HEB_AeW1rpsHWrFej2A7te_0 2024-03-04T13:00:16.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.332+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11287967279355608821', time=2024-03-04T14:54:02.266989+0000, chain.objs.size()=1 2024-03-04T13:00:16.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.332+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.253__shadow_.vdpXUa9cX5GGqui3TQPBSaPle6y_ZRk_0 2024-03-04T13:00:16.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8537378862269980304', time=2024-03-04T14:54:08.239258+0000, chain.objs.size()=1 2024-03-04T13:00:16.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.jkcPFizf9OH2WcDE1jzL8stE04302sF_0 2024-03-04T13:00:16.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10407709871592633903', time=2024-03-04T14:54:08.248527+0000, chain.objs.size()=1 2024-03-04T13:00:16.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.k2-2GFZ1hg-p39sA_AKxZrBVRkhllE3_0 2024-03-04T13:00:16.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5986417790159093715', time=2024-03-04T14:54:08.249208+0000, chain.objs.size()=1 2024-03-04T13:00:16.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.rv996hVUf826UCZX6qFTv7OKk21cSUJ_0 2024-03-04T13:00:16.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12601585573387027890', time=2024-03-04T14:54:09.037427+0000, chain.objs.size()=1 2024-03-04T13:00:16.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.SL6_1ooJo_gzGTQzINVUGgGvAVZXoJv_0 2024-03-04T13:00:16.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15973715857468073610', time=2024-03-04T14:54:12.643838+0000, chain.objs.size()=1 2024-03-04T13:00:16.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.274__shadow_.vVBgfQXCr2RgquDjWJzSiHz8eZtGlWb_0 2024-03-04T13:00:16.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12750189598243102542', time=2024-03-04T14:54:29.644699+0000, chain.objs.size()=1 2024-03-04T13:00:16.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tQtc5DGd193FSHt_Wv-oXm0n05H69iC_0 2024-03-04T13:00:16.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1114651335511081820', time=2024-03-04T14:54:29.646023+0000, chain.objs.size()=1 2024-03-04T13:00:16.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5yx0vUBCU4GBBojA0uBxhbq8zPk3oVt_0 2024-03-04T13:00:16.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16288457133827291585', time=2024-03-04T14:54:29.647578+0000, chain.objs.size()=1 2024-03-04T13:00:16.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.sUiN_zDWIkfVqvHqgZ7OJwuwDFxhJfJ_0 2024-03-04T13:00:16.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8731105479447102180', time=2024-03-04T14:54:29.673970+0000, chain.objs.size()=1 2024-03-04T13:00:16.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yHzhB2pnNlwGtGFxowHLfzfTs9vRfIS_0 2024-03-04T13:00:16.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7795196297526385128', time=2024-03-04T14:54:29.702038+0000, chain.objs.size()=1 2024-03-04T13:00:16.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.9Hm2n9M36yRW3gpZv_OB9Hi6Rq2GSiG_0 2024-03-04T13:00:16.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.334+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11273180544725544429', time=2024-03-04T14:54:29.703190+0000, chain.objs.size()=1 2024-03-04T13:00:16.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.335+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YrQJ0UWyvAOwXkHcgLHTmjIbqyfhMzA_0 2024-03-04T13:00:16.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.337+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14334387724500506985', time=2024-03-04T14:54:29.780413+0000, chain.objs.size()=1 2024-03-04T13:00:16.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.337+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.PQ6YYEia3jwoZ-jAg2xYtyNavWKbHin_0 2024-03-04T13:00:16.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.337+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13943537206706928698', time=2024-03-04T14:54:29.795658+0000, chain.objs.size()=1 2024-03-04T13:00:16.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.337+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.DqS3Iaphh7qMhh57nzM3xlmliwrlBOI_0 2024-03-04T13:00:16.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.337+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1546499909010430281', time=2024-03-04T14:54:29.815940+0000, chain.objs.size()=1 2024-03-04T13:00:16.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.337+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LOLgNTrfm9lrhg_rwm81PbyZsd334lC_0 2024-03-04T13:00:16.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.337+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11673026175259632593', time=2024-03-04T14:54:29.838959+0000, chain.objs.size()=1 2024-03-04T13:00:16.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.337+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wI_zJEeTxg2ApSqDwraeNQQU34KQEmS_0 2024-03-04T13:00:16.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.337+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5368569791448090324', time=2024-03-04T14:54:29.952001+0000, chain.objs.size()=1 2024-03-04T13:00:16.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.337+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.xis0czZUaxaNkClhT4aj1Ep1W9n7BM1_0 2024-03-04T13:00:16.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.337+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10592875143203279625', time=2024-03-04T14:54:29.974351+0000, chain.objs.size()=1 2024-03-04T13:00:16.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.337+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.L0GsEe3pmH4aSOs4llc02SPh5YnRzTo_0 2024-03-04T13:00:16.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.338+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15828861183718133284', time=2024-03-04T14:54:30.015937+0000, chain.objs.size()=1 2024-03-04T13:00:16.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.338+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.JVilZaVKvIFmcK9gkhXUISAfR3bE2OA_0 2024-03-04T13:00:16.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.338+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1593092555586659061', time=2024-03-04T14:54:30.102692+0000, chain.objs.size()=1 2024-03-04T13:00:16.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.338+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_._NkxgKQzMhKM0pQLflYSjNgLEMVQfDr_0 2024-03-04T13:00:16.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.338+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14138119559864612432', time=2024-03-04T14:54:30.117155+0000, chain.objs.size()=1 2024-03-04T13:00:16.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.338+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.N-Ei1epPodwTvxSgJ5Hp7fX6A3fQFpa_0 2024-03-04T13:00:16.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.338+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3823646512845339888', time=2024-03-04T14:54:30.124394+0000, chain.objs.size()=1 2024-03-04T13:00:16.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.338+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.13TjqT8guiy_pf5T5QKN4M7_ERSzIIu_0 2024-03-04T13:00:16.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.338+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5726703021725688782', time=2024-03-04T14:54:30.142127+0000, chain.objs.size()=1 2024-03-04T13:00:16.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.338+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.nuj6eFsNn-ssOKRMhBNyzw38e2GAOF2_0 2024-03-04T13:00:16.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.339+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5853106878392434014', time=2024-03-04T14:54:30.169723+0000, chain.objs.size()=1 2024-03-04T13:00:16.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.339+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.kCS68bO-O5jWmeTUVgWkxknol7N5myI_0 2024-03-04T13:00:16.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.339+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3860449793638483129', time=2024-03-04T14:54:30.171292+0000, chain.objs.size()=1 2024-03-04T13:00:16.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.339+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.gjD_zuEiCalBpsR4sLhm0dzGyfoYomx_0 2024-03-04T13:00:16.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.339+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1510477218861980716', time=2024-03-04T14:54:30.178880+0000, chain.objs.size()=1 2024-03-04T13:00:16.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.339+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ExuvF9YgzaTtX2uSTjRWbdZTEXktSAx_0 2024-03-04T13:00:16.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.339+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6433232485443847017', time=2024-03-04T14:54:30.267004+0000, chain.objs.size()=1 2024-03-04T13:00:16.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.339+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.dleW1-1KXwspGiUCYKDLD6efn2WZOMZ_0 2024-03-04T13:00:16.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4148363890889550823', time=2024-03-04T14:54:30.273680+0000, chain.objs.size()=1 2024-03-04T13:00:16.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oHGy8yxIFPvReDi493sfOrgdwUDTybc_0 2024-03-04T13:00:16.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12298890930602201350', time=2024-03-04T14:54:30.282724+0000, chain.objs.size()=1 2024-03-04T13:00:16.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.mePLSYMJZAWoDJTDA2G6pjVQsmJaB_v_0 2024-03-04T13:00:16.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15238754726858208932', time=2024-03-04T14:54:30.284308+0000, chain.objs.size()=1 2024-03-04T13:00:16.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.sjCUz7Dw-AoAah-uwveEhI2QErPJw9P_0 2024-03-04T13:00:16.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.880932384335406860', time=2024-03-04T14:54:30.337737+0000, chain.objs.size()=1 2024-03-04T13:00:16.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.DnnHY872ZMaAboN81rqKQPjBJHJxUJJ_0 2024-03-04T13:00:16.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9584995135758890244', time=2024-03-04T14:54:30.424165+0000, chain.objs.size()=1 2024-03-04T13:00:16.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.vN_W3LQ7HjZd1h2Fys5iJ7HwvKqKo00_0 2024-03-04T13:00:16.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11754710362230341079', time=2024-03-04T14:54:30.454602+0000, chain.objs.size()=1 2024-03-04T13:00:16.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.IGI-iDwBzcvnojT76_QArASAscAOr4n_0 2024-03-04T13:00:16.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14796117061689822618', time=2024-03-04T14:54:30.461555+0000, chain.objs.size()=1 2024-03-04T13:00:16.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.341+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.spsLcT3o-wKpwgsidKD2HC8SSrqP1Ga_0 2024-03-04T13:00:16.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.342+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2746681669228775655', time=2024-03-04T14:54:30.491766+0000, chain.objs.size()=1 2024-03-04T13:00:16.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.342+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.OSSecetjI4vmc3KvQ_DJYNXXF2vDKUe_0 2024-03-04T13:00:16.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.342+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2386237387011025916', time=2024-03-04T14:54:30.605294+0000, chain.objs.size()=1 2024-03-04T13:00:16.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.342+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Rnkdoq4p0CtefhyqWJdfukta2uwfQNC_0 2024-03-04T13:00:16.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.342+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5646390690256947521', time=2024-03-04T14:54:30.621336+0000, chain.objs.size()=1 2024-03-04T13:00:16.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.342+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.e0YgZ4UccfeOBx-nRHja9cyBwmY-uwK_0 2024-03-04T13:00:16.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.342+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11050309885363911979', time=2024-03-04T14:54:30.629700+0000, chain.objs.size()=1 2024-03-04T13:00:16.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.342+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yAPH1Oi4c3yObPnh-pN6np6rQd8kBxY_0 2024-03-04T13:00:16.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.344+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6033940950829175072', time=2024-03-04T14:54:30.657732+0000, chain.objs.size()=1 2024-03-04T13:00:16.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.344+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2lYCDC9NjLnlR3T6qJQIDZWeJ7yNeFR_0 2024-03-04T13:00:16.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9767269450849541118', time=2024-03-04T14:54:30.668612+0000, chain.objs.size()=1 2024-03-04T13:00:16.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Wv_QzDz9k-edkvNoBmwTQ6mQ57oNL6V_0 2024-03-04T13:00:16.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6296556966604745629', time=2024-03-04T14:54:30.738656+0000, chain.objs.size()=1 2024-03-04T13:00:16.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.6LFBHe4p7RDngRn4ClQCCBfq_BvGsmx_0 2024-03-04T13:00:16.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1899219163943152892', time=2024-03-04T14:54:30.768248+0000, chain.objs.size()=1 2024-03-04T13:00:16.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ex0R6nH7PnlmRjZAPWgz7MIxjY6KGew_0 2024-03-04T13:00:16.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6945872684595557256', time=2024-03-04T14:54:38.306943+0000, chain.objs.size()=1 2024-03-04T13:00:16.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wluUGOio8hADePQ1RUAGLOKrVHXQErx_0 2024-03-04T13:00:16.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4309960647824640102', time=2024-03-04T14:54:38.321580+0000, chain.objs.size()=1 2024-03-04T13:00:16.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.WSF_V7XroX19AmdQL7jehf7J8v0Ag5R_0 2024-03-04T13:00:16.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16672230447912546954', time=2024-03-04T14:54:38.329931+0000, chain.objs.size()=1 2024-03-04T13:00:16.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.nSEKvDOah519_X_Y-9Wzjv8URYC6wS0_0 2024-03-04T13:00:16.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14659335563703365680', time=2024-03-04T14:54:38.495721+0000, chain.objs.size()=1 2024-03-04T13:00:16.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Bn4MrG3bhm5XTDrntsDBXfYmWHHI1Fj_0 2024-03-04T13:00:16.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15748354144825803066', time=2024-03-04T14:54:38.512993+0000, chain.objs.size()=1 2024-03-04T13:00:16.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ie7iziADWx3s8sv7cGmO_orupiludsh_0 2024-03-04T13:00:16.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3383944225243818727', time=2024-03-04T14:54:38.674809+0000, chain.objs.size()=1 2024-03-04T13:00:16.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.XWl5ty1s5t9EfNYRfe_40MyzxL09D-I_0 2024-03-04T13:00:16.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17543882488497259671', time=2024-03-04T14:54:38.700717+0000, chain.objs.size()=1 2024-03-04T13:00:16.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.1_HpIQ6qCe3iDfuuG7XPJ2VobSUzLpa_0 2024-03-04T13:00:16.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.66126905555552293', time=2024-03-04T14:54:38.824214+0000, chain.objs.size()=1 2024-03-04T13:00:16.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.347+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.V4U8nEA59iMH19NyYuu8gx9ZFpgLKI1_0 2024-03-04T13:00:16.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.348+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.626075987782143549', time=2024-03-04T14:54:38.850976+0000, chain.objs.size()=1 2024-03-04T13:00:16.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.348+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.LjWd9IkL-FH9NdcXq7WzikeR3ZCjbF__0 2024-03-04T13:00:16.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.348+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10915211029144980426', time=2024-03-04T14:54:38.866049+0000, chain.objs.size()=1 2024-03-04T13:00:16.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.348+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.6ZlrD7ddAlZfie5V-RPT04EpJ2W7VVy_0 2024-03-04T13:00:16.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.349+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17164111151028928189', time=2024-03-04T14:54:38.957546+0000, chain.objs.size()=1 2024-03-04T13:00:16.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.349+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.o5wv7dJK8e8Gk30rvMbQW4LdxfJ3uvR_0 2024-03-04T13:00:16.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10414750322978187373', time=2024-03-04T14:54:38.961597+0000, chain.objs.size()=1 2024-03-04T13:00:16.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.9r4wEpLXsRLcQeZ6GNqh6i1OcaMTIca_0 2024-03-04T13:00:16.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17328262061250449255', time=2024-03-04T14:54:38.974149+0000, chain.objs.size()=1 2024-03-04T13:00:16.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HX7npSCEgZjgiUuCx8lurGrAr6q81wj_0 2024-03-04T13:00:16.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8365119018254949753', time=2024-03-04T14:54:38.974989+0000, chain.objs.size()=1 2024-03-04T13:00:16.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.44MS1FdabX3yQf26efR--BX465OA4Um_0 2024-03-04T13:00:16.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7415368659038660539', time=2024-03-04T14:54:38.982424+0000, chain.objs.size()=1 2024-03-04T13:00:16.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.CF7osNxlkNAS4zg0zQGtoJ-hFTPAiBY_0 2024-03-04T13:00:16.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11422326598695973087', time=2024-03-04T14:54:39.107093+0000, chain.objs.size()=1 2024-03-04T13:00:16.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wqGl0ai_gJhsumLx-ryQzcdL2WmLy3h_0 2024-03-04T13:00:16.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5721770644832436327', time=2024-03-04T14:54:39.117847+0000, chain.objs.size()=1 2024-03-04T13:00:16.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xjjh31-s1Ik0qw7C6jfrkXpLLXq2_-5_0 2024-03-04T13:00:16.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16868137005684646296', time=2024-03-04T14:54:39.152877+0000, chain.objs.size()=1 2024-03-04T13:00:16.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.bcJszG31wI8QP7iHk0F74Cw6NmjdqQH_0 2024-03-04T13:00:16.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5030732946585614161', time=2024-03-04T14:54:39.296749+0000, chain.objs.size()=1 2024-03-04T13:00:16.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.D8h78H0unW3mfEOp0FJEyJuRvJOmOMs_0 2024-03-04T13:00:16.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17515160077961706111', time=2024-03-04T14:54:39.317622+0000, chain.objs.size()=1 2024-03-04T13:00:16.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.d7p8Nzdp8EfM9OJm5bQU9ZKsdDXaVEu_0 2024-03-04T13:00:16.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7396376637481268585', time=2024-03-04T14:54:39.322598+0000, chain.objs.size()=1 2024-03-04T13:00:16.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xKUl5J7-ho9mzMA1H2JZ_TSUmgDl8ZR_0 2024-03-04T13:00:16.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15753602833503312862', time=2024-03-04T14:54:39.446806+0000, chain.objs.size()=1 2024-03-04T13:00:16.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.351+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.r5ewQYntYPuHtD8hxeOuflNApcLpcom_0 2024-03-04T13:00:16.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.352+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3714018354188334418', time=2024-03-04T14:54:39.489892+0000, chain.objs.size()=1 2024-03-04T13:00:16.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.352+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zUk7r8lP5sjJ-_U-48XDfY2IJNOvOoh_0 2024-03-04T13:00:16.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.353+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11267030090542763173', time=2024-03-04T14:55:29.995552+0000, chain.objs.size()=1 2024-03-04T13:00:16.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.353+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.408__shadow_.4cmdNfz1IROmEdDg48ME_2sss-CuaU__0 2024-03-04T13:00:16.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.353+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3961260064177363000', time=2024-03-04T14:55:31.342465+0000, chain.objs.size()=1 2024-03-04T13:00:16.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.353+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.411__shadow_.H3NXLS-wqbDn17DBHoG5eS2OZ1Q5LJ6_0 2024-03-04T13:00:16.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.353+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16709518567735497164', time=2024-03-04T14:55:52.973862+0000, chain.objs.size()=1 2024-03-04T13:00:16.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.353+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.457__shadow_.c2MtAz4NqztNCSBo-0hzTI4-JkVpkQR_0 2024-03-04T13:00:16.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.353+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.469__shadow_.13UXESWQ-XTABwO1C--Qj-qzrBaVoEF_1_18891a06a333bb817b33ee99e1cac53e', time=2024-03-04T14:55:58.393257+0000, chain.objs.size()=1 2024-03-04T13:00:16.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.353+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.469__shadow_.13UXESWQ-XTABwO1C--Qj-qzrBaVoEF_0 2024-03-04T13:00:16.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.357+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/51487 2024-03-04T13:00:16.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-03-04T13:00:16.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.475__shadow:uVjDMegxP6XYWgvybwvxI64cJu5z7Q0_.3EygMS0MkBsJBGyX0Po4m4qYgkDoKJC_1_20ec70e6a7257b373a24910c6e32875d', time=2024-03-04T14:56:01.112239+0000, chain.objs.size()=1 2024-03-04T13:00:16.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.475__shadow:uVjDMegxP6XYWgvybwvxI64cJu5z7Q0_.3EygMS0MkBsJBGyX0Po4m4qYgkDoKJC_0 2024-03-04T13:00:16.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18093060268948565726', time=2024-03-04T14:57:06.153361+0000, chain.objs.size()=1 2024-03-04T13:00:16.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.524__shadow_.mlE4g6W6cZuTh9uNpompFjzDJEjPQ0K_0 2024-03-04T13:00:16.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6488970157472225504', time=2024-03-04T14:57:21.995344+0000, chain.objs.size()=1 2024-03-04T13:00:16.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:W5OgnQ..u-pYzOvRjtqL.8bqj9EBjlC_.2NypqT4E6fVmtqAYiVE9hSbHMFw-VXa_0 2024-03-04T13:00:16.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1972230966688945600', time=2024-03-04T14:57:39.097503+0000, chain.objs.size()=1 2024-03-04T13:00:16.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:D5eOAbmR6A9Rhu2g.MlAY4W4Q3.qMIh_.OwjJ291Nurded29HP3IQ5Jy0wIW2FJU_0 2024-03-04T13:00:16.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2676597875975793857', time=2024-03-04T14:57:39.788587+0000, chain.objs.size()=1 2024-03-04T13:00:16.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:uuRLWEaiqDb3Fg8XkXHGiNeNWm25tZF_.F_x_CGLqGXpemAeCG63Arfgdjgg68IO_0 2024-03-04T13:00:16.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:jdjxZsdu3lo9t.PKiJuUgyq.gocjLZQ_.RSl-pA00LrsZUB1qD19DFPdP3q6UGJ__1_5968a44466634457f8d2446484371ded', time=2024-03-04T14:57:48.458760+0000, chain.objs.size()=1 2024-03-04T13:00:16.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:jdjxZsdu3lo9t.PKiJuUgyq.gocjLZQ_.RSl-pA00LrsZUB1qD19DFPdP3q6UGJ__0 2024-03-04T13:00:16.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:WPHXa.O.o9ns74ko2wGTzDUk0Ipn3FP_.q-PkcBk83m97JXzaQtec9oYYyJ0LelO_1_892b86505b4f21770ca92d72f76b2cc6', time=2024-03-04T14:57:48.566405+0000, chain.objs.size()=1 2024-03-04T13:00:16.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:WPHXa.O.o9ns74ko2wGTzDUk0Ipn3FP_.q-PkcBk83m97JXzaQtec9oYYyJ0LelO_0 2024-03-04T13:00:16.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11008035434846328142', time=2024-03-04T14:58:33.461559+0000, chain.objs.size()=1 2024-03-04T13:00:16.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.628__shadow_.4bnKo2yiyZCapG5uHljQBbp090FubbH_0 2024-03-04T13:00:16.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4453403097359097709', time=2024-03-04T14:58:38.194234+0000, chain.objs.size()=1 2024-03-04T13:00:16.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.641__shadow_.agWoaNDlJ4-ndPsQap-xPU7DQgzm5QY_0 2024-03-04T13:00:16.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.871202991797472252', time=2024-03-04T14:58:48.654463+0000, chain.objs.size()=1 2024-03-04T13:00:16.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.359+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.668__shadow:QMchKl3gJn8DiCkVG7UTMDNR2KHxLCp_.DR5K8L9qBZiWGmmvAGKgtQPZZ5PWId6_0 2024-03-04T13:00:16.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.362+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.364+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T13:00:16.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.366+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.367+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48663' 2024-03-04T13:00:16.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17659751723708645738', time=2024-03-04T14:52:58.855506+0000, chain.objs.size()=5 2024-03-04T13:00:16.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__multipart_foo-LUKEWARM.2~q2aB2Qj6PsFY9Z6-9S75Kc3N8kvUjDd.1 2024-03-04T13:00:16.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_foo-LUKEWARM.2~q2aB2Qj6PsFY9Z6-9S75Kc3N8kvUjDd.1_1 2024-03-04T13:00:16.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__multipart_foo-LUKEWARM.2~q2aB2Qj6PsFY9Z6-9S75Kc3N8kvUjDd.2 2024-03-04T13:00:16.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_foo-LUKEWARM.2~q2aB2Qj6PsFY9Z6-9S75Kc3N8kvUjDd.2_1 2024-03-04T13:00:16.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__multipart_foo-LUKEWARM.2~q2aB2Qj6PsFY9Z6-9S75Kc3N8kvUjDd.3 2024-03-04T13:00:16.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_J1VLsOFuBhchfafG1COTZJbYxnEpWC9', time=2024-03-04T14:53:00.287247+0000, chain.objs.size()=1 2024-03-04T13:00:16.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.156__shadow_.-izz7_OEWcbRiuwoKWXJKN5qz75yTem_0 2024-03-04T13:00:16.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4694581969036360595', time=2024-03-04T14:53:14.375139+0000, chain.objs.size()=1 2024-03-04T13:00:16.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.182__shadow_.8tr0RU6g7gHwcWZ6ZNrXsVJCOfzAyr7_0 2024-03-04T13:00:16.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2101885307959059193', time=2024-03-04T14:53:31.214538+0000, chain.objs.size()=1 2024-03-04T13:00:16.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.207__shadow_.Qej91Sv_HcJSmJfH8YJuBxIbVwZxrJN_0 2024-03-04T13:00:16.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7657008648455709749', time=2024-03-04T14:53:31.628383+0000, chain.objs.size()=1 2024-03-04T13:00:16.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.208__shadow_.N5En8KSkJKIxXhGT6nZHIx_m52eCL9e_0 2024-03-04T13:00:16.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17438365416660227724', time=2024-03-04T14:53:37.773334+0000, chain.objs.size()=1 2024-03-04T13:00:16.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.219__shadow_.oHCWxRnLzOcpHtlvy099QOASROzncOu_0 2024-03-04T13:00:16.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1854200136978952046', time=2024-03-04T14:53:52.055518+0000, chain.objs.size()=1 2024-03-04T13:00:16.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HN8XOcpPVi7WqlKoMtdETrCxnmaB0wN_0 2024-03-04T13:00:16.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4952206575278726180', time=2024-03-04T14:53:52.060467+0000, chain.objs.size()=1 2024-03-04T13:00:16.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.368+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.hzTqd0pO3PveDvYL3aTlETg95R85Mpi_0 2024-03-04T13:00:16.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9730392416300823239', time=2024-03-04T14:53:52.081826+0000, chain.objs.size()=1 2024-03-04T13:00:16.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HBRKmcM3hE1dv7ldMxW3A6PtvH5zYTL_0 2024-03-04T13:00:16.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16628064856955922803', time=2024-03-04T14:53:52.093726+0000, chain.objs.size()=1 2024-03-04T13:00:16.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.aN3TGLuoCY7F8WOmXTLOR0Z8ouVYTE9_0 2024-03-04T13:00:16.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12699292259091043671', time=2024-03-04T14:53:52.106107+0000, chain.objs.size()=1 2024-03-04T13:00:16.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CYS5LZ3UhcNrqG6pTID3GFEI8IXSenp_0 2024-03-04T13:00:16.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9812708445149847903', time=2024-03-04T14:53:52.302962+0000, chain.objs.size()=1 2024-03-04T13:00:16.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zGHAXfX8d_xfGryI6bP-4dhKI8i5HhM_0 2024-03-04T13:00:16.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.522769213606492676', time=2024-03-04T14:53:52.305284+0000, chain.objs.size()=1 2024-03-04T13:00:16.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PHYax9ZlmRtYOw_-dn8mmhWsnCZWNL1_0 2024-03-04T13:00:16.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14856750981063832288', time=2024-03-04T14:53:52.306490+0000, chain.objs.size()=1 2024-03-04T13:00:16.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5fCmftn_liHqXsrFD9RcQMFmnBFM4Xn_0 2024-03-04T13:00:16.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5790217690550056997', time=2024-03-04T14:53:52.432712+0000, chain.objs.size()=1 2024-03-04T13:00:16.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3mnBNdh8qoPBt9So3EhCiA2XjSrthP0_0 2024-03-04T13:00:16.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9636032545627996040', time=2024-03-04T14:53:52.434229+0000, chain.objs.size()=1 2024-03-04T13:00:16.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ebl0zkomcm4-dIZuJBq4d_svjEGEf11_0 2024-03-04T13:00:16.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2464585717645357479', time=2024-03-04T14:53:52.456292+0000, chain.objs.size()=1 2024-03-04T13:00:16.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.bvkpYtNHX5xm8jsSW5VKQSjWgl3R2sI_0 2024-03-04T13:00:16.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15426736337938109564', time=2024-03-04T14:53:52.482539+0000, chain.objs.size()=1 2024-03-04T13:00:16.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0xHzmtd8uFmGsyhcZAvm6vv9Sx98GKg_0 2024-03-04T13:00:16.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13137255700543149919', time=2024-03-04T14:53:52.484211+0000, chain.objs.size()=1 2024-03-04T13:00:16.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.372+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.e81JoFmFSGtIXldvLeM7-2dMJHM5sce_0 2024-03-04T13:00:16.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.373+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8621312568850343456', time=2024-03-04T14:53:52.607409+0000, chain.objs.size()=1 2024-03-04T13:00:16.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.373+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HVJCzrG7EH2200vy2JTS58K66lFgZ4D_0 2024-03-04T13:00:16.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.373+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2690813852230427203', time=2024-03-04T14:53:52.640243+0000, chain.objs.size()=1 2024-03-04T13:00:16.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.373+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-wW12UyD-9mc_bAkh8y-x7Bj-Gr2Vbq_0 2024-03-04T13:00:16.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3509716098297201077', time=2024-03-04T14:53:52.654971+0000, chain.objs.size()=1 2024-03-04T13:00:16.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PeelywPuComqbO5MBbQoA4ml1kEnrK5_0 2024-03-04T13:00:16.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8689114142504255951', time=2024-03-04T14:53:52.659495+0000, chain.objs.size()=1 2024-03-04T13:00:16.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3466u3_0ZZmUtsQbo__4tmz6xPY3S___0 2024-03-04T13:00:16.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15286833297717983744', time=2024-03-04T14:53:52.755127+0000, chain.objs.size()=1 2024-03-04T13:00:16.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.pmgDcPohOjScXBx4zN2hKs4d5IswndZ_0 2024-03-04T13:00:16.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7114937694333975294', time=2024-03-04T14:53:52.778663+0000, chain.objs.size()=1 2024-03-04T13:00:16.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Ih1qwIXnjdWJFfU4Zj9-9xkZ1rhBWSd_0 2024-03-04T13:00:16.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1199816143971204412', time=2024-03-04T14:53:52.787896+0000, chain.objs.size()=1 2024-03-04T13:00:16.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Xudxv98GBI7jmPerfr-GjWxEFtNkdKZ_0 2024-03-04T13:00:16.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2371109796814043652', time=2024-03-04T14:53:52.816719+0000, chain.objs.size()=1 2024-03-04T13:00:16.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.blhHd1D_C8kOs5kaNzp5cfkt79t5fWb_0 2024-03-04T13:00:16.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18358710451606857148', time=2024-03-04T14:53:52.820532+0000, chain.objs.size()=1 2024-03-04T13:00:16.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.uaAr-o5UJppDSJ8Dk4Rwt_pvKehNQXM_0 2024-03-04T13:00:16.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10679257612337826330', time=2024-03-04T14:53:52.926477+0000, chain.objs.size()=1 2024-03-04T13:00:16.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.DlGiDfSnqkqQrns6Gl-QkSAzUm24Ggr_0 2024-03-04T13:00:16.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6215200370090656834', time=2024-03-04T14:53:52.940496+0000, chain.objs.size()=1 2024-03-04T13:00:16.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.374+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Ft1ebPPu0QSaDr90gAi0-F1L-a5U3yv_0 2024-03-04T13:00:16.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.375+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9362006080402282998', time=2024-03-04T14:53:52.995194+0000, chain.objs.size()=1 2024-03-04T13:00:16.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.375+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ilB7lK159Y6ZqQ6Q9lJ58Yw4pECSVVw_0 2024-03-04T13:00:16.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.375+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1123166209167755054', time=2024-03-04T14:53:53.085683+0000, chain.objs.size()=1 2024-03-04T13:00:16.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.375+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.A0uDME4HctAMvcj4h_gs7s6E60yfXiG_0 2024-03-04T13:00:16.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.376+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4863374076564695040', time=2024-03-04T14:53:53.092642+0000, chain.objs.size()=1 2024-03-04T13:00:16.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.376+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.d3jUNvd9JDIZKPQ5PGLOnO54Gl3OAPa_0 2024-03-04T13:00:16.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.376+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14624953005550991171', time=2024-03-04T14:53:53.097393+0000, chain.objs.size()=1 2024-03-04T13:00:16.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.376+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.58j9N1f1iRDWkMclZISsjt2V3mbzsk8_0 2024-03-04T13:00:16.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.376+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.612811163100716110', time=2024-03-04T14:53:53.252855+0000, chain.objs.size()=1 2024-03-04T13:00:16.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.376+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.nfOMgq-NevBgZHVsRrhPdht_fnbFJto_0 2024-03-04T13:00:16.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.376+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.107862623371977479', time=2024-03-04T14:53:53.310010+0000, chain.objs.size()=1 2024-03-04T13:00:16.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.376+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-dS7fvNiHnfGecFilkp6SmvZVkc2g9d_0 2024-03-04T13:00:16.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.377+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5447095956594934817', time=2024-03-04T14:53:55.258408+0000, chain.objs.size()=1 2024-03-04T13:00:16.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.377+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.237__shadow_.-hZRFjHAlTwk_pkolviEoVGxzM2gP7H_0 2024-03-04T13:00:16.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.377+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4965780064495281021', time=2024-03-04T14:53:56.132835+0000, chain.objs.size()=1 2024-03-04T13:00:16.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.377+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.239__shadow_.L3zgigzDj_Dsje-xEdjIBk4ei4frD0C_0 2024-03-04T13:00:16.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.377+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13720564158818664501', time=2024-03-04T14:53:56.993413+0000, chain.objs.size()=1 2024-03-04T13:00:16.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.377+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.241__shadow_.SN4PVA8ezcvXgaPBoo3cDq5t0tgw-mP_0 2024-03-04T13:00:16.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.378+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1552708998545563443', time=2024-03-04T14:53:56.994250+0000, chain.objs.size()=1 2024-03-04T13:00:16.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.378+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.241__shadow_.PHYQuty3dgeQxLAHIkRjkDtZBZ7FxWm_0 2024-03-04T13:00:16.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.378+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10742655401302522761', time=2024-03-04T14:54:00.135510+0000, chain.objs.size()=1 2024-03-04T13:00:16.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.378+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.248__shadow_.-tHlmspNyp1c-jc8RabcAwNW7VUE3Wd_0 2024-03-04T13:00:16.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.378+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1093819835933047373', time=2024-03-04T14:54:00.136424+0000, chain.objs.size()=1 2024-03-04T13:00:16.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.378+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.248__shadow_.xJXsS305twFhUy-Za9eQxi585Ip2ZiS_0 2024-03-04T13:00:16.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.378+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11073081696698859081', time=2024-03-04T14:54:00.137278+0000, chain.objs.size()=1 2024-03-04T13:00:16.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.378+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.248__shadow_.EIQF0kUKtpFU7hhMi8FeL44ajzCqi3C_0 2024-03-04T13:00:16.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.378+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15962773642574218692', time=2024-03-04T14:54:00.571965+0000, chain.objs.size()=1 2024-03-04T13:00:16.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.378+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.249__shadow_.UTNXvGKsTScl53c3SijuELsAQCfDMpd_0 2024-03-04T13:00:16.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.378+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16226293910660585283', time=2024-03-04T14:54:05.863195+0000, chain.objs.size()=1 2024-03-04T13:00:16.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.378+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.261__shadow_.YmP6wQoz3_Q7IMWcmTmhRc4m556BsXn_0 2024-03-04T13:00:16.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.379+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12735310310638514756', time=2024-03-04T14:54:09.891351+0000, chain.objs.size()=1 2024-03-04T13:00:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.379+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.268__shadow_.bRy8K5aw2tl2ia7DO0M0xdCLF5uS63Z_0 2024-03-04T13:00:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.379+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3340965532017629464', time=2024-03-04T14:54:29.783625+0000, chain.objs.size()=1 2024-03-04T13:00:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.379+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.jfjpzpCWw1o0j5dniH7kuBTSjpHxo7M_0 2024-03-04T13:00:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.380+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1847358919947925651', time=2024-03-04T14:54:29.831700+0000, chain.objs.size()=1 2024-03-04T13:00:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.380+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.UC8Q5risMm0eN_j384Dm2cE6dW3p9Q2_0 2024-03-04T13:00:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.380+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10710815118611591302', time=2024-03-04T14:54:29.845905+0000, chain.objs.size()=1 2024-03-04T13:00:16.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.380+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.SbLqHVQBefGqCr5SmmBtqQ5FGr5rATT_0 2024-03-04T13:00:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.380+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5771451016952700598', time=2024-03-04T14:54:29.857863+0000, chain.objs.size()=1 2024-03-04T13:00:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.380+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lb0W8g3xCUVrYPkCdsjZNcCp9_c7ZKl_0 2024-03-04T13:00:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.380+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13363463934241538498', time=2024-03-04T14:54:29.862250+0000, chain.objs.size()=1 2024-03-04T13:00:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.380+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-qz3HFw3F4aWScZ6FnVWihVGxoLdrSb_0 2024-03-04T13:00:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.380+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5602365043314860374', time=2024-03-04T14:54:29.956679+0000, chain.objs.size()=1 2024-03-04T13:00:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.380+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.a9j4gEuRhc0gGmE058zqJseVjdUbaYY_0 2024-03-04T13:00:16.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.381+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18308817726051781619', time=2024-03-04T14:54:29.991780+0000, chain.objs.size()=1 2024-03-04T13:00:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.381+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.QC-Mvy3hf8Zh_uUiIAD70UJ3aGw45bF_0 2024-03-04T13:00:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.381+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2025550175247015105', time=2024-03-04T14:54:30.008776+0000, chain.objs.size()=1 2024-03-04T13:00:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.381+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cb-fUUjTYadGvdGVTz6TqKbHBP5tpQ0_0 2024-03-04T13:00:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.381+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18231017942195695723', time=2024-03-04T14:54:30.129828+0000, chain.objs.size()=1 2024-03-04T13:00:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.381+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-EcIrbVVnbgHkmC_AYNXFN-s4f89NfL_0 2024-03-04T13:00:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.381+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1376357021549574353', time=2024-03-04T14:54:30.138364+0000, chain.objs.size()=1 2024-03-04T13:00:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.381+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FstL5r6wYWX2LdKs6imY-I2cOpygITe_0 2024-03-04T13:00:16.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.381+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12337943563499963923', time=2024-03-04T14:54:30.150929+0000, chain.objs.size()=1 2024-03-04T13:00:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.381+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.A6eeDHKC_rhtadAgUXKoSwgsHaTXQLf_0 2024-03-04T13:00:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.381+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8394788680502869766', time=2024-03-04T14:54:30.154359+0000, chain.objs.size()=1 2024-03-04T13:00:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.381+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.h6zYi-0meUgwJHU-rxShLseD3-ZoPyV_0 2024-03-04T13:00:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.382+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13903007864450063916', time=2024-03-04T14:54:30.160234+0000, chain.objs.size()=1 2024-03-04T13:00:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.382+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cOoEjmj5wNmIcYv3cYojAhRRuelG6MD_0 2024-03-04T13:00:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.382+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18418538592303343099', time=2024-03-04T14:54:30.178681+0000, chain.objs.size()=1 2024-03-04T13:00:16.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.382+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.qBchVzsZmmG56L1YFeHQ5VLgVp3i0eh_0 2024-03-04T13:00:16.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.382+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13267307492607119746', time=2024-03-04T14:54:30.183769+0000, chain.objs.size()=1 2024-03-04T13:00:16.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.382+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_._UVsvb21EFkazX-VwSVxU3BzGUZWbcz_0 2024-03-04T13:00:16.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.382+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14581818955699530529', time=2024-03-04T14:54:30.287825+0000, chain.objs.size()=1 2024-03-04T13:00:16.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.382+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.W81RtnWW_gBT3RIJUQtt5AJ3Ei3_YC-_0 2024-03-04T13:00:16.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18421094757797699347', time=2024-03-04T14:54:30.290107+0000, chain.objs.size()=1 2024-03-04T13:00:16.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.p6uKHM96eM8cWrv5A_7fkbbxHjvzawk_0 2024-03-04T13:00:16.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2197240117739312163', time=2024-03-04T14:54:30.291008+0000, chain.objs.size()=1 2024-03-04T13:00:16.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ceqSam31Bz287BmL6Y-G5A2jS37WhM1_0 2024-03-04T13:00:16.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6470242634955644554', time=2024-03-04T14:54:30.303601+0000, chain.objs.size()=1 2024-03-04T13:00:16.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.zAY5sZTxxvx7ng5H_2SoQ3wylW2v8tX_0 2024-03-04T13:00:16.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16556868892545785964', time=2024-03-04T14:54:30.313408+0000, chain.objs.size()=1 2024-03-04T13:00:16.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.SzGd_70xowMqssuHnx7v8ASwmWMEjua_0 2024-03-04T13:00:16.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8951973326198637863', time=2024-03-04T14:54:30.316767+0000, chain.objs.size()=1 2024-03-04T13:00:16.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.uNEy-KTHDI2C14XTN4ADalBq3j5Q5Xl_0 2024-03-04T13:00:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16345494062957323179', time=2024-03-04T14:54:30.338771+0000, chain.objs.size()=1 2024-03-04T13:00:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-Twh7snaYXR5EA0rnafbBdLkVBojp9y_0 2024-03-04T13:00:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10398341761645926103', time=2024-03-04T14:54:30.421301+0000, chain.objs.size()=1 2024-03-04T13:00:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.383+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.m-wGbGQmVfTgaqUbRT2VtF-T2ZzfoAH_0 2024-03-04T13:00:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.384+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1620223088461316475', time=2024-03-04T14:54:30.435217+0000, chain.objs.size()=1 2024-03-04T13:00:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.384+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0bZx4dAVb-ZwVBHyaWhdJkewrI9LFyY_0 2024-03-04T13:00:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.384+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8649710805602498048', time=2024-03-04T14:54:30.465971+0000, chain.objs.size()=1 2024-03-04T13:00:16.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.384+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HepvJOJwv8on32y2ZTrmRfsoLfXBadR_0 2024-03-04T13:00:16.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.384+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5141478786885937070', time=2024-03-04T14:54:30.467160+0000, chain.objs.size()=1 2024-03-04T13:00:16.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.384+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.fPUyQ0HGxtDcxw5zzc-N2IL5HCc6tOR_0 2024-03-04T13:00:16.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.385+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3353720187901423605', time=2024-03-04T14:54:30.470530+0000, chain.objs.size()=1 2024-03-04T13:00:16.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.385+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Z88CzHibCINVoPKn8jEP4U-o8JBOI9G_0 2024-03-04T13:00:16.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.385+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6525629358164976069', time=2024-03-04T14:54:30.484301+0000, chain.objs.size()=1 2024-03-04T13:00:16.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.385+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.iYKLDdmBRPP2wSF8PXg14YvB1B3G463_0 2024-03-04T13:00:16.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.385+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3807124372361586289', time=2024-03-04T14:54:30.491321+0000, chain.objs.size()=1 2024-03-04T13:00:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.385+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Sho5v35YauwwYIjoFhEcpFcna9p--q5_0 2024-03-04T13:00:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15419050874053944861', time=2024-03-04T14:54:30.499365+0000, chain.objs.size()=1 2024-03-04T13:00:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.EepSPXrr3-HQCR8o9vTQSjA-xdjZGY3_0 2024-03-04T13:00:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2430213577017680473', time=2024-03-04T14:54:30.504902+0000, chain.objs.size()=1 2024-03-04T13:00:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-8-XLYeB8wOEdrTM0Sp76QUk9nPW2Xw_0 2024-03-04T13:00:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9231228585657680916', time=2024-03-04T14:54:30.591143+0000, chain.objs.size()=1 2024-03-04T13:00:16.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FkgMjqD3KTg17SjxsT5SEBk_cL1i1Lr_0 2024-03-04T13:00:16.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16443749072099537515', time=2024-03-04T14:54:30.643152+0000, chain.objs.size()=1 2024-03-04T13:00:16.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rOYB3WE6ohWNorDWYzytUttoY1ns3ia_0 2024-03-04T13:00:16.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15334537275778724054', time=2024-03-04T14:54:30.655331+0000, chain.objs.size()=1 2024-03-04T13:00:16.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Saql-Rv-RIbN3btNex5e-tB-rCbuwxO_0 2024-03-04T13:00:16.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14265544722649345369', time=2024-03-04T14:54:30.663248+0000, chain.objs.size()=1 2024-03-04T13:00:16.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HKyi7lSpefJ7DAHJ0L81176-4JpfOv8_0 2024-03-04T13:00:16.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.386+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15568059780055443127', time=2024-03-04T14:54:30.665742+0000, chain.objs.size()=1 2024-03-04T13:00:16.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.387+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.V3sWE13AlUR5c7p3LT3Ast3qqHEijqr_0 2024-03-04T13:00:16.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.387+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10275991664274544753', time=2024-03-04T14:54:30.784282+0000, chain.objs.size()=1 2024-03-04T13:00:16.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.387+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LE9qy8bT-c4fpzqLiRZgbAk71sqMF0G_0 2024-03-04T13:00:16.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15422115249825538077', time=2024-03-04T14:54:30.801357+0000, chain.objs.size()=1 2024-03-04T13:00:16.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wvYS3DIlEYkBaJRxUSNtBVhKRGq1QRo_0 2024-03-04T13:00:16.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.549326477677672681', time=2024-03-04T14:54:38.303528+0000, chain.objs.size()=1 2024-03-04T13:00:16.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.LeXh80htwFcj4WwQdElZ1z4_PVsl94B_0 2024-03-04T13:00:16.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4109372940647299769', time=2024-03-04T14:54:38.310010+0000, chain.objs.size()=1 2024-03-04T13:00:16.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eONkYwtW064bBGtQmfdFVive_M-KjUp_0 2024-03-04T13:00:16.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11909007619095198792', time=2024-03-04T14:54:38.359808+0000, chain.objs.size()=1 2024-03-04T13:00:16.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ySsPkrKUReZTDw2Hm4qzW1SPCxhjymj_0 2024-03-04T13:00:16.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13076179447615816315', time=2024-03-04T14:54:38.367096+0000, chain.objs.size()=1 2024-03-04T13:00:16.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.m1xRcSo2V6cY3R0RIrakzcKVMMYO4ui_0 2024-03-04T13:00:16.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1483040570535233611', time=2024-03-04T14:54:38.458718+0000, chain.objs.size()=1 2024-03-04T13:00:16.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.O4BqZ6G7_WcwuzuJSh3Inp3wwqn5Hkn_0 2024-03-04T13:00:16.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2852028100679812222', time=2024-03-04T14:54:38.503564+0000, chain.objs.size()=1 2024-03-04T13:00:16.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jAFGl7xDBuzmENdj-Fkuxc6Et3FKrgW_0 2024-03-04T13:00:16.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2995403726442657022', time=2024-03-04T14:54:38.529015+0000, chain.objs.size()=1 2024-03-04T13:00:16.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.QuJa3Abj7u67V68jP7LZ57fE_8LGJTK_0 2024-03-04T13:00:16.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5655652758778786634', time=2024-03-04T14:54:38.625745+0000, chain.objs.size()=1 2024-03-04T13:00:16.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pg5q-GyGEHJvjYvcVzcmeI0Y1t_pq32_0 2024-03-04T13:00:16.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2904765098242534832', time=2024-03-04T14:54:38.660053+0000, chain.objs.size()=1 2024-03-04T13:00:16.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.YuHvLC1IjFOAKfMkgcWR1FlvNL9HrWV_0 2024-03-04T13:00:16.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18339635044754358851', time=2024-03-04T14:54:38.662735+0000, chain.objs.size()=1 2024-03-04T13:00:16.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.388+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.DvcGEIcXKJtoTHyPmo_trHIltpZjGsY_0 2024-03-04T13:00:16.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.390+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8030456722379807065', time=2024-03-04T14:54:38.669441+0000, chain.objs.size()=1 2024-03-04T13:00:16.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.390+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ncMgCTHxEt2-E_ZRzLbhiSHXbcZlgh-_0 2024-03-04T13:00:16.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.390+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18253950736607117870', time=2024-03-04T14:54:38.708178+0000, chain.objs.size()=1 2024-03-04T13:00:16.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.390+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.vT4rcY_XA2gLi0EhsU_RIATlT9ge6BJ_0 2024-03-04T13:00:16.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.390+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2559014757160275355', time=2024-03-04T14:54:38.813675+0000, chain.objs.size()=1 2024-03-04T13:00:16.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.390+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2oQ_y4ZHRSOiwetlwtScOTDLSSlQlS4_0 2024-03-04T13:00:16.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.390+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3969403768150723814', time=2024-03-04T14:54:38.859679+0000, chain.objs.size()=1 2024-03-04T13:00:16.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.390+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tKr5RSpPxUUzGUYo6gCIy2TgH0c67FV_0 2024-03-04T13:00:16.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.390+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8221330258502423654', time=2024-03-04T14:54:38.947048+0000, chain.objs.size()=1 2024-03-04T13:00:16.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.390+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VrQFkQw8p0oDMp9j6RigOxq973U8Tzr_0 2024-03-04T13:00:16.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.390+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6604439734259289653', time=2024-03-04T14:54:38.950573+0000, chain.objs.size()=1 2024-03-04T13:00:16.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.390+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._VwFu9dgoNb54TtIaRbA-Lns9TAgGA2_0 2024-03-04T13:00:16.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.392+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/48663 2024-03-04T13:00:16.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-03-04T13:00:16.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3476687601458057041', time=2024-03-04T14:54:38.955014+0000, chain.objs.size()=1 2024-03-04T13:00:16.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KIL8YG4zV61z9HxrqcLh2GhyXmLmokW_0 2024-03-04T13:00:16.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8652235808717780813', time=2024-03-04T14:54:38.987128+0000, chain.objs.size()=1 2024-03-04T13:00:16.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.MbHDGv9haOX-9pp0dHT0jBTGs5ZM2tY_0 2024-03-04T13:00:16.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4966803558916247139', time=2024-03-04T14:54:38.991971+0000, chain.objs.size()=1 2024-03-04T13:00:16.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.3SZEirTWuPcNXjhnVmfg4yehZiw5ZN1_0 2024-03-04T13:00:16.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8789203467076023768', time=2024-03-04T14:54:39.115335+0000, chain.objs.size()=1 2024-03-04T13:00:16.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Zi-jCQF0UAKuPxuA1PslOveNWrJHkaj_0 2024-03-04T13:00:16.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1673653067240268979', time=2024-03-04T14:54:39.137464+0000, chain.objs.size()=1 2024-03-04T13:00:16.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5Mca5t6vmVuMGPHvfsghm1X7kH8FRdz_0 2024-03-04T13:00:16.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2576656237157696109', time=2024-03-04T14:54:39.138192+0000, chain.objs.size()=1 2024-03-04T13:00:16.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.H1MAUH2qhUjLnWUOJ0UM1otFLULRvk3_0 2024-03-04T13:00:16.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5088553575940995375', time=2024-03-04T14:54:39.153284+0000, chain.objs.size()=1 2024-03-04T13:00:16.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.enDKbA-nPm4LW4s1IJ0gC6BMBd5pKvf_0 2024-03-04T13:00:16.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5461337286239916281', time=2024-03-04T14:54:39.155766+0000, chain.objs.size()=1 2024-03-04T13:00:16.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.se551C68AHZLN7Ga42tZVf8Tp__jriS_0 2024-03-04T13:00:16.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11494495307796370748', time=2024-03-04T14:54:39.176552+0000, chain.objs.size()=1 2024-03-04T13:00:16.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.l1ENT4Th5tXXX_2Sm_Z4sqYEm2h2hCq_0 2024-03-04T13:00:16.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3880953734972387874', time=2024-03-04T14:54:39.191936+0000, chain.objs.size()=1 2024-03-04T13:00:16.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.8rVjyR_xLiEXW43EWoWJi_W1Q5S215a_0 2024-03-04T13:00:16.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6846464495627520585', time=2024-03-04T14:54:39.267758+0000, chain.objs.size()=1 2024-03-04T13:00:16.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VCzvhlhe3CvHpciPzlRacrpHuoxcWMk_0 2024-03-04T13:00:16.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11560193020353871014', time=2024-03-04T14:54:39.268490+0000, chain.objs.size()=1 2024-03-04T13:00:16.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.395+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kz6GCrCJvEBr8zqA0VQmn1zH1si4yl2_0 2024-03-04T13:00:16.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7965467380026782891', time=2024-03-04T14:54:39.269957+0000, chain.objs.size()=1 2024-03-04T13:00:16.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ATH_A443YOWn9XeMjd0_GKFtSXwYLQr_0 2024-03-04T13:00:16.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.424800951609782424', time=2024-03-04T14:54:39.339279+0000, chain.objs.size()=1 2024-03-04T13:00:16.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.fFskvzWlTLbEwV-dOjmOhSjg86fJQ-J_0 2024-03-04T13:00:16.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15769678736277885361', time=2024-03-04T14:54:39.350100+0000, chain.objs.size()=1 2024-03-04T13:00:16.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iJtwhyUyUTu6GICKStQ0iEudAXW6ejR_0 2024-03-04T13:00:16.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11974065455975171401', time=2024-03-04T14:54:39.432982+0000, chain.objs.size()=1 2024-03-04T13:00:16.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.yCEbEa5_QLABkJd_UGo3QILYYW2QFfs_0 2024-03-04T13:00:16.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.529946093548341589', time=2024-03-04T14:54:39.457493+0000, chain.objs.size()=1 2024-03-04T13:00:16.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.QZDV8FCv1W2DTxxPK8XIUXoyARfuq-L_0 2024-03-04T13:00:16.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17846557445145433560', time=2024-03-04T14:54:39.469842+0000, chain.objs.size()=1 2024-03-04T13:00:16.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5Iq_duYAomCHA4-dzaHmlcCX_GJyEAK_0 2024-03-04T13:00:16.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12181880951740116271', time=2024-03-04T14:55:04.304708+0000, chain.objs.size()=1 2024-03-04T13:00:16.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.397+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.354__shadow_.MR7P4zUckP9YMSE_SyG3W2-40NmJyoF_0 2024-03-04T13:00:16.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.400+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15769501988400584843', time=2024-03-04T14:55:29.003150+0000, chain.objs.size()=1 2024-03-04T13:00:16.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.400+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.406__shadow_.H7M64oIdNWjh1SkOYek_R1WB3gP7SGL_0 2024-03-04T13:00:16.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.400+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7150605155694958252', time=2024-03-04T14:55:35.373534+0000, chain.objs.size()=1 2024-03-04T13:00:16.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.400+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.418__shadow_.j9QOamfPW-SqQLGE-ejOTD0l6IoFE78_0 2024-03-04T13:00:16.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.400+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7911896207388046543', time=2024-03-04T14:55:45.957985+0000, chain.objs.size()=1 2024-03-04T13:00:16.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.400+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.436__shadow_.m7TzrD8ANhBCB-5V2KGoP_T6UEJGeU4_0 2024-03-04T13:00:16.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.400+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13384455869283415669', time=2024-03-04T14:55:46.973336+0000, chain.objs.size()=1 2024-03-04T13:00:16.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.400+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.438__shadow_.D1FW3z0PhbDWa7FcDKjXmZiNzr6qatN_0 2024-03-04T13:00:16.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.400+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.458__shadow_.PV_OUUal7K9Tq-gjmgyrz889MQDQuJd_1_6768556ed01d88d9aa2b2b7f636dda6d', time=2024-03-04T14:55:53.667946+0000, chain.objs.size()=1 2024-03-04T13:00:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.400+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.458__shadow_.PV_OUUal7K9Tq-gjmgyrz889MQDQuJd_0 2024-03-04T13:00:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.403+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1554330417222691057', time=2024-03-04T14:55:57.334104+0000, chain.objs.size()=1 2024-03-04T13:00:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.403+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.467__shadow_.IpbOVwvq1aBu8OB58sacNB1r-FcitgY_0 2024-03-04T13:00:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.403+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.468__shadow_.j1kJNVhlQpaf2oZoslh_QnR-bEoQZDx_1_54dba15dadff75198b60a94dda4326ea', time=2024-03-04T14:55:57.871499+0000, chain.objs.size()=1 2024-03-04T13:00:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.403+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.468__shadow_.j1kJNVhlQpaf2oZoslh_QnR-bEoQZDx_0 2024-03-04T13:00:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.403+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16776736897446344871', time=2024-03-04T14:56:08.582780+0000, chain.objs.size()=1 2024-03-04T13:00:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.403+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.490__multipart_mymultipart.2~iU6-cAI-1K9bADJVxTb2S0Op2MBqDCE.1 2024-03-04T13:00:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.403+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2650356064688673187', time=2024-03-04T14:56:23.467529+0000, chain.objs.size()=3 2024-03-04T13:00:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.403+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~2ODhLdTbMzv3bA9QVJ9HrJyiydiWZnf.1 2024-03-04T13:00:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.403+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~2ODhLdTbMzv3bA9QVJ9HrJyiydiWZnf.2 2024-03-04T13:00:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.403+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~2ODhLdTbMzv3bA9QVJ9HrJyiydiWZnf.3 2024-03-04T13:00:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.403+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12425693434220555137', time=2024-03-04T14:57:36.997264+0000, chain.objs.size()=1 2024-03-04T13:00:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.403+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:bMwzYHxOgRnCH4VjzgkisdxsFqo4633_.egNnZj3FRZsbH9r4wUPIwth9dLSUgIu_0 2024-03-04T13:00:16.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.406+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9026179661038992680', time=2024-03-04T14:57:37.754806+0000, chain.objs.size()=1 2024-03-04T13:00:16.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.406+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:BNpziMU3kjFDYd.l9levJnZNrz3ccDg_.YsHbBEXQ8pYPYt8tOq35yB8ps4n52di_0 2024-03-04T13:00:16.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.406+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12418887693897012302', time=2024-03-04T14:57:38.689069+0000, chain.objs.size()=1 2024-03-04T13:00:16.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.406+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:cFP3-sTRPR7T711jlrGfuDj2aFRC7Q-_.riAQoJBAcBK8w0S70cfuZr1wG8lFahV_0 2024-03-04T13:00:16.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.406+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4106548921716424931', time=2024-03-04T14:57:40.069046+0000, chain.objs.size()=1 2024-03-04T13:00:16.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.406+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:njGDtq3eqUWDdsj8YH8Q4J8dl1JMiU0_.8tnZaCqWOYAgi2M-PWqAfpHvJu8OA80_0 2024-03-04T13:00:16.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.406+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16730445197288615411', time=2024-03-04T14:57:42.553576+0000, chain.objs.size()=1 2024-03-04T13:00:16.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.406+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:XEm9aOuFVX5EutvFPMY-ieFdKoGAU3G_.fhE0zEuxRIPoSjtbxaXYl6PuBq66D0t_0 2024-03-04T13:00:16.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.775113238642120962', time=2024-03-04T14:57:48.463014+0000, chain.objs.size()=1 2024-03-04T13:00:16.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:WPHXa.O.o9ns74ko2wGTzDUk0Ipn3FP_.q-PkcBk83m97JXzaQtec9oYYyJ0LelO_0 2024-03-04T13:00:16.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4578474427847155152', time=2024-03-04T14:57:52.074683+0000, chain.objs.size()=1 2024-03-04T13:00:16.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.553__shadow:9CQDiGMPmnH9SICtqMwsgoGvYajVGYh_.yHBP160RJIDNhCqEI7YPSrwklFOXZIQ_0 2024-03-04T13:00:16.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9552238737964660379', time=2024-03-04T14:57:55.593825+0000, chain.objs.size()=1 2024-03-04T13:00:16.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.562__shadow_.L-35-yktsalALeLJEaLN3KdsxkP_LEO_0 2024-03-04T13:00:16.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1117208130223070797', time=2024-03-04T14:57:59.060879+0000, chain.objs.size()=1 2024-03-04T13:00:16.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.571__shadow_.QeDrOo6SBmoGh4adyNVEqsEgV-FuZZL_0 2024-03-04T13:00:16.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1859135288442789777', time=2024-03-04T14:58:17.143843+0000, chain.objs.size()=1 2024-03-04T13:00:16.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.596__shadow_.YQhohpwN9piADgR6mJ3BVdizCEqmKY6_0 2024-03-04T13:00:16.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5302717321417945066', time=2024-03-04T14:58:32.246466+0000, chain.objs.size()=1 2024-03-04T13:00:16.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.626__shadow_.g28Kcb_aixBh7GeaEmPResjWVUNzngP_0 2024-03-04T13:00:16.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.678__shadow_.BNdv2mURV5upeoSFwQz6Tr33SZA7Boe_1_cf47ebb7e2934b24bd69c7deb91cacfd', time=2024-03-04T14:59:11.468211+0000, chain.objs.size()=1 2024-03-04T13:00:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.408+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.678__shadow_.BNdv2mURV5upeoSFwQz6Tr33SZA7Boe_0 2024-03-04T13:00:16.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.414+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.416+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T13:00:16.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.418+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.418+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41224' 2024-03-04T13:00:16.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_49dA6NudsW7cJdxpFXTgKbDsmomE1jJ', time=2024-03-04T14:52:59.687833+0000, chain.objs.size()=3 2024-03-04T13:00:16.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.u_wQ5F6YLyiQr63CfiU6FfDS36rvILS_0 2024-03-04T13:00:16.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.u_wQ5F6YLyiQr63CfiU6FfDS36rvILS_1 2024-03-04T13:00:16.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.u_wQ5F6YLyiQr63CfiU6FfDS36rvILS_2 2024-03-04T13:00:16.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14316126340579788280', time=2024-03-04T14:53:23.052113+0000, chain.objs.size()=1 2024-03-04T13:00:16.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.190__shadow_.gpsjuSFgTfNfvfQ_oJ1DXV8XnD694sY_0 2024-03-04T13:00:16.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13218020774499927611', time=2024-03-04T14:53:31.215232+0000, chain.objs.size()=1 2024-03-04T13:00:16.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.207__shadow_.cl7km54Sjq8H80sVkJpC_4q4g-r7ZKp_0 2024-03-04T13:00:16.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3592099485645451345', time=2024-03-04T14:53:36.111993+0000, chain.objs.size()=1 2024-03-04T13:00:16.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.216__shadow_.rwJqrm37y4GaCzIRLLrHlHES-85HY00_0 2024-03-04T13:00:16.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8200248572974097448', time=2024-03-04T14:53:37.361427+0000, chain.objs.size()=1 2024-03-04T13:00:16.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.218__shadow_.QfkJcfuEPR8aWCzOoBkoXT9eyCJEJkC_0 2024-03-04T13:00:16.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15619861689348365076', time=2024-03-04T14:53:38.213157+0000, chain.objs.size()=1 2024-03-04T13:00:16.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.220__shadow_.RNSwFUDHlfJnBda58Z9Fc2S3qQKQqVG_0 2024-03-04T13:00:16.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2990478367580884971', time=2024-03-04T14:53:41.772558+0000, chain.objs.size()=1 2024-03-04T13:00:16.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.228__shadow_.xWU0XiEfD0CIBp_4oTsWnpe9sE6QcrQ_0 2024-03-04T13:00:16.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17111302390443567678', time=2024-03-04T14:53:52.041088+0000, chain.objs.size()=1 2024-03-04T13:00:16.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.D_zi7RpBVUXlZ4zIkFnElld5avY5CBS_0 2024-03-04T13:00:16.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9549857258747152963', time=2024-03-04T14:53:52.050400+0000, chain.objs.size()=1 2024-03-04T13:00:16.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.MyYwS6nmvHLozlk0vUeCnjyc3OVVwT2_0 2024-03-04T13:00:16.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4792631561170226863', time=2024-03-04T14:53:52.052651+0000, chain.objs.size()=1 2024-03-04T13:00:16.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.419+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VnqjV0VznMbGs0SydYtN3QL7ChL_y3j_0 2024-03-04T13:00:16.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.421+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15410456383965477105', time=2024-03-04T14:53:52.059659+0000, chain.objs.size()=1 2024-03-04T13:00:16.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.421+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yZKHa9MRX5PWOA5LjyVFp9CY7wPb4wN_0 2024-03-04T13:00:16.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13514785277320963424', time=2024-03-04T14:53:52.066009+0000, chain.objs.size()=1 2024-03-04T13:00:16.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.gu8X9KjQaQNFljQv9rCS5_xxc_naLbi_0 2024-03-04T13:00:16.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14367391321071915292', time=2024-03-04T14:53:52.088289+0000, chain.objs.size()=1 2024-03-04T13:00:16.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.fXyi_y1fUvBaJ3G6biUjmOKUn1gwkFl_0 2024-03-04T13:00:16.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16368768726555860208', time=2024-03-04T14:53:52.090286+0000, chain.objs.size()=1 2024-03-04T13:00:16.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.61OXH55_MTuc7Xb_fY1bweqkq6zB6ST_0 2024-03-04T13:00:16.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.368860351526080896', time=2024-03-04T14:53:52.096129+0000, chain.objs.size()=1 2024-03-04T13:00:16.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.QG8i6pDWi4k3poyZtWhjknAbjuGgynK_0 2024-03-04T13:00:16.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17911374764122153816', time=2024-03-04T14:53:52.119363+0000, chain.objs.size()=1 2024-03-04T13:00:16.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ShITHFJJ7TVic3WxbUg-NTnaUFfmlAg_0 2024-03-04T13:00:16.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6299087119426114688', time=2024-03-04T14:53:52.217967+0000, chain.objs.size()=1 2024-03-04T13:00:16.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.N7liA6FnCGnY0yTtVotMGlBqsVo4nrW_0 2024-03-04T13:00:16.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7015875199251377104', time=2024-03-04T14:53:52.221091+0000, chain.objs.size()=1 2024-03-04T13:00:16.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.dy3OElRcRJ6z_fviTiR_LvEsg-EEB1U_0 2024-03-04T13:00:16.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3752529937231932747', time=2024-03-04T14:53:52.230476+0000, chain.objs.size()=1 2024-03-04T13:00:16.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.iEuR75OH0ycx1xqle_j3tDd4ZOm8fT__0 2024-03-04T13:00:16.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13291558521581698161', time=2024-03-04T14:53:52.252788+0000, chain.objs.size()=1 2024-03-04T13:00:16.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.dHG9f3dZj3zANrJSxDsb34WnSaM1bBa_0 2024-03-04T13:00:16.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3807954948226840799', time=2024-03-04T14:53:52.261676+0000, chain.objs.size()=1 2024-03-04T13:00:16.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.424+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.DvNyAQj93z2-eAz6o-lx-4EXxIGyrjn_0 2024-03-04T13:00:16.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.426+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2292067653880823690', time=2024-03-04T14:53:52.311584+0000, chain.objs.size()=1 2024-03-04T13:00:16.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.426+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.KNT8kfQlehyZJzJRLOquhfuLx5Ozyrn_0 2024-03-04T13:00:16.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.426+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6164965859100967284', time=2024-03-04T14:53:52.443777+0000, chain.objs.size()=1 2024-03-04T13:00:16.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.426+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Gb9VyQPbg0_GvitKYhJW-6IXhETR_EA_0 2024-03-04T13:00:16.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.429+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6668504062267121383', time=2024-03-04T14:53:52.455370+0000, chain.objs.size()=1 2024-03-04T13:00:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.429+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.W92y4LCrZZDqx8UCHX93a0RDHcPQs1U_0 2024-03-04T13:00:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.429+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10239219253800413387', time=2024-03-04T14:53:52.594572+0000, chain.objs.size()=1 2024-03-04T13:00:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.429+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.DKX4XsNNZLEAUzfVfBsBxh0HY06Wuxy_0 2024-03-04T13:00:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.429+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14964566374458330132', time=2024-03-04T14:53:52.615119+0000, chain.objs.size()=1 2024-03-04T13:00:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.429+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.I5dSA8uqS2Bm14JICG5GSHeLDgfOzBT_0 2024-03-04T13:00:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.429+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6831403748529638399', time=2024-03-04T14:53:52.621710+0000, chain.objs.size()=1 2024-03-04T13:00:16.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.429+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jCthduxTRvDUnsTX0-dzoeHUQLPGhzZ_0 2024-03-04T13:00:16.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.429+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11550447553775028895', time=2024-03-04T14:53:52.659936+0000, chain.objs.size()=1 2024-03-04T13:00:16.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.430+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.oTEyiwiLknzQyBWhweu_eKQqPe0hG3u_0 2024-03-04T13:00:16.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.430+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16731638945545495369', time=2024-03-04T14:53:52.740880+0000, chain.objs.size()=1 2024-03-04T13:00:16.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.430+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5YuZ76yTan-KbqAjkfHj3h_qENhrCqv_0 2024-03-04T13:00:16.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.430+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12861714356285283046', time=2024-03-04T14:53:52.768518+0000, chain.objs.size()=1 2024-03-04T13:00:16.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.430+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.IStvum3UjieshTX0Zb2hKsQV8UizCfv_0 2024-03-04T13:00:16.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.430+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14920654261570192189', time=2024-03-04T14:53:52.825124+0000, chain.objs.size()=1 2024-03-04T13:00:16.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.430+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xe1fNuOJinlDRAIzTsBmCmpZ97Ch4yK_0 2024-03-04T13:00:16.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.430+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2941379270145770087', time=2024-03-04T14:53:52.913728+0000, chain.objs.size()=1 2024-03-04T13:00:16.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.430+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.4dsiA1zO9Ve3F05jCbG0jYmmz-ojvMK_0 2024-03-04T13:00:16.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.430+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6833158846962481616', time=2024-03-04T14:53:52.935445+0000, chain.objs.size()=1 2024-03-04T13:00:16.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.430+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.IoUTEgCAl2c-PgpEWXs7WE525lL0RXw_0 2024-03-04T13:00:16.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.432+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.303999348095128908', time=2024-03-04T14:53:52.972471+0000, chain.objs.size()=1 2024-03-04T13:00:16.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.432+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.oY7zl0nlG35_WkdluXxpFh1aGymo-9C_0 2024-03-04T13:00:16.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.432+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9579336719027451219', time=2024-03-04T14:53:53.085760+0000, chain.objs.size()=1 2024-03-04T13:00:16.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.432+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VFT8W_tGbwtwoG01TOCgGV7k4RgiyV7_0 2024-03-04T13:00:16.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.432+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2830208881890858184', time=2024-03-04T14:53:53.098039+0000, chain.objs.size()=1 2024-03-04T13:00:16.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.432+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vZTJEACNbKRuuEg_Sr9DPNwI7RRqOiN_0 2024-03-04T13:00:16.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6271280428853792988', time=2024-03-04T14:53:53.106121+0000, chain.objs.size()=1 2024-03-04T13:00:16.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VBDF5Yc5X41hBk-yrwpaUZMPVnOMUQc_0 2024-03-04T13:00:16.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.240843292518941228', time=2024-03-04T14:53:53.139283+0000, chain.objs.size()=1 2024-03-04T13:00:16.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.W8cAiRwBKvDl1W9cBm5wcA4As_gWVFO_0 2024-03-04T13:00:16.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8574120228477563102', time=2024-03-04T14:53:53.156365+0000, chain.objs.size()=1 2024-03-04T13:00:16.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.FkGJnqBdk_SkY2rPeajeohcVq0_u7jK_0 2024-03-04T13:00:16.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17788357049662409761', time=2024-03-04T14:53:53.159806+0000, chain.objs.size()=1 2024-03-04T13:00:16.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.gC3783nHQSHMJVgFDEBY-Pky5eJIu1D_0 2024-03-04T13:00:16.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17521838926778482082', time=2024-03-04T14:53:53.167338+0000, chain.objs.size()=1 2024-03-04T13:00:16.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jKacaoUoHCbGzSjHvicGSpucBQBCsY6_0 2024-03-04T13:00:16.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18373139185026370110', time=2024-03-04T14:53:53.264695+0000, chain.objs.size()=1 2024-03-04T13:00:16.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.hyjT4JeTIs2brOT6iDV_-kM2fEY-AT9_0 2024-03-04T13:00:16.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15108995297653427784', time=2024-03-04T14:53:54.853353+0000, chain.objs.size()=1 2024-03-04T13:00:16.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.236__shadow_.JVhy8T6SVfoNlaUfRWe3FkPB_ep9eal_0 2024-03-04T13:00:16.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6837676893708300451', time=2024-03-04T14:54:00.135159+0000, chain.objs.size()=1 2024-03-04T13:00:16.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.435+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.248__shadow_.Ko2jOmq29QIShVGSzwIxJKPgiAhOlT4_0 2024-03-04T13:00:16.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.438+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14545671841522334597', time=2024-03-04T14:54:03.562327+0000, chain.objs.size()=1 2024-03-04T13:00:16.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.438+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.256__shadow_.ix1ZnP8aQmViKH7yrbL809gW_Kr7j29_0 2024-03-04T13:00:16.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.438+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9522710112808991141', time=2024-03-04T14:54:04.960782+0000, chain.objs.size()=1 2024-03-04T13:00:16.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.438+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.259__shadow_.KyAQLVxxtTrprpehQrU5gqQUS24-3iK_0 2024-03-04T13:00:16.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.438+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12657508514574504399', time=2024-03-04T14:54:13.077658+0000, chain.objs.size()=1 2024-03-04T13:00:16.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.438+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.275__shadow_.sLBQnBN2ewcTEGDHVTDVxC89xItyt4Z_0 2024-03-04T13:00:16.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.440+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2870543480216626308', time=2024-03-04T14:54:29.617547+0000, chain.objs.size()=1 2024-03-04T13:00:16.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.440+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.fSZfex1dCLvjAs9gC0FAGRcZI_LleiY_0 2024-03-04T13:00:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.440+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6335358926069613612', time=2024-03-04T14:54:29.628974+0000, chain.objs.size()=1 2024-03-04T13:00:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.440+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Qgqt-ruGmv7U6HQof0HYiqP2-kt654T_0 2024-03-04T13:00:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.440+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10462417067676073569', time=2024-03-04T14:54:29.648808+0000, chain.objs.size()=1 2024-03-04T13:00:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.440+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.50PDRPzZuHF3uyMJvr1NzDwF4jc7C0U_0 2024-03-04T13:00:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16104798252179492179', time=2024-03-04T14:54:29.669803+0000, chain.objs.size()=1 2024-03-04T13:00:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.w1NrxdbRUs7TVoe9FzzNJHM5RLXxotP_0 2024-03-04T13:00:16.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4034393857833905632', time=2024-03-04T14:54:29.698664+0000, chain.objs.size()=1 2024-03-04T13:00:16.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5zjWB7HIcgzkCxFCJ0hs__I4CAWyWrm_0 2024-03-04T13:00:16.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7069019502487551571', time=2024-03-04T14:54:29.789942+0000, chain.objs.size()=1 2024-03-04T13:00:16.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.JrJ23TJRXL-3B-mUl7pHrZR6nNHie5P_0 2024-03-04T13:00:16.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6295745421888505605', time=2024-03-04T14:54:29.794057+0000, chain.objs.size()=1 2024-03-04T13:00:16.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VjBW8sQ8XFOaGEKzPK0vXjbie3XnAyh_0 2024-03-04T13:00:16.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8360975974480751943', time=2024-03-04T14:54:29.818648+0000, chain.objs.size()=1 2024-03-04T13:00:16.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.OIM-Nf-Pl6u3Qaeh20cvnwwqKdIqHzm_0 2024-03-04T13:00:16.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12859999126198366580', time=2024-03-04T14:54:29.827381+0000, chain.objs.size()=1 2024-03-04T13:00:16.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.kXpJnITP4DATV0Y87alfbP_y9s0_GG6_0 2024-03-04T13:00:16.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7672209852820720400', time=2024-03-04T14:54:29.829646+0000, chain.objs.size()=1 2024-03-04T13:00:16.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.bPYfP63dn1YYwXPQ4fow3vA10M6Grjm_0 2024-03-04T13:00:16.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7758960826590550964', time=2024-03-04T14:54:29.847776+0000, chain.objs.size()=1 2024-03-04T13:00:16.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.441+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.jncMl1RlayrAvXJ29jekssBCOUhijMA_0 2024-03-04T13:00:16.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.442+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8167424155250502455', time=2024-03-04T14:54:29.982188+0000, chain.objs.size()=1 2024-03-04T13:00:16.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.442+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HnNf58OhZJYah7KdVKgNxd-UlDvXvmX_0 2024-03-04T13:00:16.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.444+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2345967563741421631', time=2024-03-04T14:54:30.022718+0000, chain.objs.size()=1 2024-03-04T13:00:16.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.444+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.THJzycUbt2ypsTyaRmVdj1BdfdVPsOr_0 2024-03-04T13:00:16.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.444+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16978952087842092090', time=2024-03-04T14:54:30.112311+0000, chain.objs.size()=1 2024-03-04T13:00:16.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.444+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.EXZIN_zuzciTZFiUoILyBYZTlNUw7kq_0 2024-03-04T13:00:16.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.444+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17959589888093250345', time=2024-03-04T14:54:30.262523+0000, chain.objs.size()=1 2024-03-04T13:00:16.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.444+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.qYeQMYdJyavh3snnQ31kxg7GhWvnFuo_0 2024-03-04T13:00:16.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6921134016250597966', time=2024-03-04T14:54:30.265213+0000, chain.objs.size()=1 2024-03-04T13:00:16.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ATQnDlOF3BpLvNHsJdxFJEL6IJRZdEN_0 2024-03-04T13:00:16.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5847584460717183026', time=2024-03-04T14:54:30.276698+0000, chain.objs.size()=1 2024-03-04T13:00:16.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.b4IlAw0ILaAEngoesyckYUYGQPTlN5V_0 2024-03-04T13:00:16.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3779759465582489361', time=2024-03-04T14:54:30.314801+0000, chain.objs.size()=1 2024-03-04T13:00:16.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3M5tIj-Z6QF7e1Wv0HNXYoTya0QVEZJ_0 2024-03-04T13:00:16.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12634094568391569890', time=2024-03-04T14:54:30.325779+0000, chain.objs.size()=1 2024-03-04T13:00:16.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.vcXkjP_QzVUhpdJMa_zRB5GFXe2c5Og_0 2024-03-04T13:00:16.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5155646901797974405', time=2024-03-04T14:54:30.333306+0000, chain.objs.size()=1 2024-03-04T13:00:16.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.MU8u0Zqd5HKKqGh4koXt9tJh25kxD45_0 2024-03-04T13:00:16.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17710143869821604106', time=2024-03-04T14:54:30.443416+0000, chain.objs.size()=1 2024-03-04T13:00:16.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.9aVBB3Iljd0X9wZovfAPaDvjJW5wq0L_0 2024-03-04T13:00:16.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14047164774500282323', time=2024-03-04T14:54:30.451697+0000, chain.objs.size()=1 2024-03-04T13:00:16.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HBxeHiLZlnnOTbQIIeTCrTm8VftUuoJ_0 2024-03-04T13:00:16.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12628172520209486067', time=2024-03-04T14:54:30.454849+0000, chain.objs.size()=1 2024-03-04T13:00:16.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.O4VRM9YwSF3VEtaWmuULI6M3Hbr1STo_0 2024-03-04T13:00:16.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14502707427026674137', time=2024-03-04T14:54:30.476425+0000, chain.objs.size()=1 2024-03-04T13:00:16.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VldLX9ZAO8ShADtAO-lqBfXmWZ_cFf0_0 2024-03-04T13:00:16.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4071821887311368792', time=2024-03-04T14:54:30.490026+0000, chain.objs.size()=1 2024-03-04T13:00:16.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7sCN4Wk7bLlph_PpvJ_sWE9vo1V4yyT_0 2024-03-04T13:00:16.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13270387306759486385', time=2024-03-04T14:54:30.492748+0000, chain.objs.size()=1 2024-03-04T13:00:16.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.447+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.hbywIiYhEhOHmziaw2akf_JCUbIy2M1_0 2024-03-04T13:00:16.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13833023972918155677', time=2024-03-04T14:54:30.610324+0000, chain.objs.size()=1 2024-03-04T13:00:16.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.OehEUeW_KNsCeRkkKPPgyNZOgT1c-Dm_0 2024-03-04T13:00:16.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2592338846699289382', time=2024-03-04T14:54:30.634766+0000, chain.objs.size()=1 2024-03-04T13:00:16.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.smKTs4JQU_bRYiOnjdp3ttJ0uYDodW2_0 2024-03-04T13:00:16.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15968021130798958455', time=2024-03-04T14:54:30.647308+0000, chain.objs.size()=1 2024-03-04T13:00:16.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.9Rjg_vHSfiE1p__S1pMBZEata-9DCcy_0 2024-03-04T13:00:16.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15218955530747998809', time=2024-03-04T14:54:30.650499+0000, chain.objs.size()=1 2024-03-04T13:00:16.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.mwzuC_34Yn81UrysiephuyOCWlWIZNZ_0 2024-03-04T13:00:16.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5606125733223386540', time=2024-03-04T14:54:30.665468+0000, chain.objs.size()=1 2024-03-04T13:00:16.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.g10ktBZE90OBcU-V0vCkIC_nGgDFcA-_0 2024-03-04T13:00:16.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5810634516380585344', time=2024-03-04T14:54:30.736963+0000, chain.objs.size()=1 2024-03-04T13:00:16.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ZD1omefJ1f5jKBNjBek9noqTLZ7UOCd_0 2024-03-04T13:00:16.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1761709291785500167', time=2024-03-04T14:54:30.777306+0000, chain.objs.size()=1 2024-03-04T13:00:16.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.KusA7k7sxMfX7wMUk1A0Y_nKuTycPqS_0 2024-03-04T13:00:16.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18007121351000083000', time=2024-03-04T14:54:30.789840+0000, chain.objs.size()=1 2024-03-04T13:00:16.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5eUY6k6RAzSgX7VotvZG9vspPIB1qER_0 2024-03-04T13:00:16.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2379855451606915337', time=2024-03-04T14:54:30.795380+0000, chain.objs.size()=1 2024-03-04T13:00:16.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.L-ofn7yyzm3lfvQ1sJtLOzPiQGZQIah_0 2024-03-04T13:00:16.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16589703171591461133', time=2024-03-04T14:54:30.796493+0000, chain.objs.size()=1 2024-03-04T13:00:16.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.452+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lUH8rm-uE6a-uAPm_bgEMX53Yxb4tXR_0 2024-03-04T13:00:16.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.455+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2341036806063510738', time=2024-03-04T14:54:30.804495+0000, chain.objs.size()=1 2024-03-04T13:00:16.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.455+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.QVNxU2UeNxdSGOKenQ3BEjWluIgz6l3_0 2024-03-04T13:00:16.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1324561234780443907', time=2024-03-04T14:54:30.806417+0000, chain.objs.size()=1 2024-03-04T13:00:16.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.jn9WshHcxnpvWl0oEuLcG5QkAwIdPiL_0 2024-03-04T13:00:16.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4710423375498950953', time=2024-03-04T14:54:38.298272+0000, chain.objs.size()=1 2024-03-04T13:00:16.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.hU-iLyoE39OxX2GhRFIRiKNzfi18tbQ_0 2024-03-04T13:00:16.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5136427258077550363', time=2024-03-04T14:54:38.353430+0000, chain.objs.size()=1 2024-03-04T13:00:16.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.yEajwFi4qpxMkWJ45zGbgYiJey0OFih_0 2024-03-04T13:00:16.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14520374608309516395', time=2024-03-04T14:54:38.378275+0000, chain.objs.size()=1 2024-03-04T13:00:16.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.AMhR_JSRXRC47lgBDLzZqmrwsxXxfz8_0 2024-03-04T13:00:16.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3924557209095403851', time=2024-03-04T14:54:38.460864+0000, chain.objs.size()=1 2024-03-04T13:00:16.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.6sYrWqXP9QtLmSfpFv7dgV9auMe2-8n_0 2024-03-04T13:00:16.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1039109594693948547', time=2024-03-04T14:54:38.483997+0000, chain.objs.size()=1 2024-03-04T13:00:16.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.dbeMJflX8YrQnjx8LSK8Z-tvFmzOcMi_0 2024-03-04T13:00:16.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8658596275559862751', time=2024-03-04T14:54:38.498727+0000, chain.objs.size()=1 2024-03-04T13:00:16.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xgDRoY8QsaxBaqO_sOs6-csuTnliwEp_0 2024-03-04T13:00:16.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16309911479404244593', time=2024-03-04T14:54:38.499990+0000, chain.objs.size()=1 2024-03-04T13:00:16.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.z_Siq8ZZJpSkM4ilNzHH40cZ1o-Jpvw_0 2024-03-04T13:00:16.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2164507726852646385', time=2024-03-04T14:54:38.508215+0000, chain.objs.size()=1 2024-03-04T13:00:16.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.8BlEkV7cTBMuJ3jP3rnjWpB_g8bevji_0 2024-03-04T13:00:16.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3504991897950378795', time=2024-03-04T14:54:38.518776+0000, chain.objs.size()=1 2024-03-04T13:00:16.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.457+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.L8V5jRtddrGwFRSAhwIM1d3J_GiXqIk_0 2024-03-04T13:00:16.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16434778339931670547', time=2024-03-04T14:54:38.534293+0000, chain.objs.size()=1 2024-03-04T13:00:16.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rt_fgwx1NFmgzcA02Yr2abG2RT9hYIO_0 2024-03-04T13:00:16.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.460+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2960427504675036575', time=2024-03-04T14:54:38.682891+0000, chain.objs.size()=1 2024-03-04T13:00:16.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.460+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.YoPf4gbKv7X68Mxswzq6xHZTgpBlySu_0 2024-03-04T13:00:16.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.463+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10505376162813128754', time=2024-03-04T14:54:38.789335+0000, chain.objs.size()=1 2024-03-04T13:00:16.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.463+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HkygpM0V2zlBn2n80bDRQrPPrPIUVIg_0 2024-03-04T13:00:16.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.463+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4221745591998387775', time=2024-03-04T14:54:38.848414+0000, chain.objs.size()=1 2024-03-04T13:00:16.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.463+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.aKtZ_ppc1VLOh-lccgnUCaV0aXYATjO_0 2024-03-04T13:00:16.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.463+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2572884444671827933', time=2024-03-04T14:54:38.867213+0000, chain.objs.size()=1 2024-03-04T13:00:16.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.463+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wQNK9VA8A6iWJqQHzDd59ua5jejJiR9_0 2024-03-04T13:00:16.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.463+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12272491241524260673', time=2024-03-04T14:54:38.871941+0000, chain.objs.size()=1 2024-03-04T13:00:16.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.463+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.MtHwHQsetJjcVpQQi3i5zmeTCm-aU5Y_0 2024-03-04T13:00:16.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.468+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/41224 2024-03-04T13:00:16.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-03-04T13:00:16.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2894826592847972543', time=2024-03-04T14:54:38.976891+0000, chain.objs.size()=1 2024-03-04T13:00:16.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.NoprQlW_z2ncGD8rXxLW8zplXmWAhjO_0 2024-03-04T13:00:16.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17638474742341623259', time=2024-03-04T14:54:39.030015+0000, chain.objs.size()=1 2024-03-04T13:00:16.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iPefvqxxz1ISBdnX0dVeLJ4KI7gQpZU_0 2024-03-04T13:00:16.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11308121195295661384', time=2024-03-04T14:54:39.128330+0000, chain.objs.size()=1 2024-03-04T13:00:16.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0nKcjLiVgxd4nQIuxbGgYA3tvtEF4GA_0 2024-03-04T13:00:16.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10867798159803181049', time=2024-03-04T14:54:39.161743+0000, chain.objs.size()=1 2024-03-04T13:00:16.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wtZ8oK8S6-eCxo5QbdXOq-uWQh08hLQ_0 2024-03-04T13:00:16.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10113072891028001473', time=2024-03-04T14:54:39.292272+0000, chain.objs.size()=1 2024-03-04T13:00:16.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.75FdRd_aCxsbYj7q02V6a2tFzGbVsRk_0 2024-03-04T13:00:16.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13105984155429723233', time=2024-03-04T14:54:39.436457+0000, chain.objs.size()=1 2024-03-04T13:00:16.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.XreHnhtxHcmv3g4KaG_lXW547ObxQPD_0 2024-03-04T13:00:16.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1697411713015949036', time=2024-03-04T14:55:28.539287+0000, chain.objs.size()=1 2024-03-04T13:00:16.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.405__shadow_.imt-ziZsjqNNTAD8NxGVh3ibnrJ3jsn_0 2024-03-04T13:00:16.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5263616977502601386', time=2024-03-04T14:55:33.407316+0000, chain.objs.size()=1 2024-03-04T13:00:16.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.415__shadow_.FLR9D6as7-jTWfJ7_pmDePD3IMl6EyE_0 2024-03-04T13:00:16.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9541065698984597950', time=2024-03-04T14:55:42.618393+0000, chain.objs.size()=1 2024-03-04T13:00:16.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.431__shadow_.SvJB4qJ67sfex-DAIsvvt8AMlMWITZ6_0 2024-03-04T13:00:16.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2983041637936705799', time=2024-03-04T14:55:52.268034+0000, chain.objs.size()=1 2024-03-04T13:00:16.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.455__shadow_.cb4mxF7Cv-07-Herwj1W3KSmz4mHR7e_0 2024-03-04T13:00:16.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15293122738130083160', time=2024-03-04T14:56:12.527865+0000, chain.objs.size()=3 2024-03-04T13:00:16.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.493__multipart_mymultipart.2~6IgQA1yqxFWYzZ-9dBSNyPCBcQ8Cots.1 2024-03-04T13:00:16.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.471+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.493__multipart_mymultipart.2~6IgQA1yqxFWYzZ-9dBSNyPCBcQ8Cots.2 2024-03-04T13:00:16.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.493__multipart_mymultipart.2~6IgQA1yqxFWYzZ-9dBSNyPCBcQ8Cots.3 2024-03-04T13:00:16.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17870048742147201482', time=2024-03-04T14:56:23.000334+0000, chain.objs.size()=2 2024-03-04T13:00:16.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~sJjWeMSpvjLq_2aqifQF9kBoRiw33rZ.1 2024-03-04T13:00:16.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__shadow_mymultipart.2~sJjWeMSpvjLq_2aqifQF9kBoRiw33rZ.1_1 2024-03-04T13:00:16.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~FO190jKCovmmnKkSL19jCqMNrVn6FzJ', time=2024-03-04T14:56:29.948290+0000, chain.objs.size()=3 2024-03-04T13:00:16.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.503__multipart_mymultipart.2~FO190jKCovmmnKkSL19jCqMNrVn6FzJ.1 2024-03-04T13:00:16.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.503__shadow_mymultipart.2~FO190jKCovmmnKkSL19jCqMNrVn6FzJ.1_1 2024-03-04T13:00:16.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.503__multipart_mymultipart.2~FO190jKCovmmnKkSL19jCqMNrVn6FzJ.2 2024-03-04T13:00:16.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8932932762541006297', time=2024-03-04T14:57:06.783546+0000, chain.objs.size()=1 2024-03-04T13:00:16.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.525__shadow_.kcFkXhWMiWUgOqHrhWq9dMnq1iIczrK_0 2024-03-04T13:00:16.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6816438026179317816', time=2024-03-04T14:57:17.515210+0000, chain.objs.size()=1 2024-03-04T13:00:16.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:gaPyLjRHhvxcJRlSmlYc5qlw73OLAG9_.3a7hp4QEGX6l9XKnZXSP8ebLczm-C5u_0 2024-03-04T13:00:16.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15984451040433239804', time=2024-03-04T14:57:18.204609+0000, chain.objs.size()=1 2024-03-04T13:00:16.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:XdSVOAlH3629X9NihyznM75p.hX-vd2_.TLwfIXEOiMMMpFjEYio7Ytcq6kh6_9D_0 2024-03-04T13:00:16.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8971729660347306559', time=2024-03-04T14:57:21.185272+0000, chain.objs.size()=1 2024-03-04T13:00:16.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:6gWnACiScEtmzLEdnCJ66YeAmX5iWnc_.M3-sEXkwd1Xu7Vy0xzPHMWGBfqjqaKr_0 2024-03-04T13:00:16.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14297326123025356021', time=2024-03-04T14:57:27.015686+0000, chain.objs.size()=1 2024-03-04T13:00:16.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.476+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.541__shadow:x9GUJZj1KDeEXn8RFQIleNTH4VYGCHf_.vFs2rJMM-ew9cpkSN5PfiQPapHkmhpr_0 2024-03-04T13:00:16.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.479+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15143913848296399722', time=2024-03-04T14:57:31.043692+0000, chain.objs.size()=1 2024-03-04T13:00:16.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.479+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.542__shadow:jwOwNU2Jb6OnYjwyAOk3QGo-fjrfRjy_.SHZOwYRdVLFlUwDoZYRqDZ0PHXtrQ1h_0 2024-03-04T13:00:16.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5239221675152606331', time=2024-03-04T14:57:34.172234+0000, chain.objs.size()=1 2024-03-04T13:00:16.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:yfkeV2zpMaHsLVqHWj-oq9XxsDn6bDP_.JNxI4DMgXNtOwXQ-26usFfmPnY2hdwb_0 2024-03-04T13:00:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16426177098101778559', time=2024-03-04T14:57:34.700387+0000, chain.objs.size()=1 2024-03-04T13:00:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:AdLmyo2BtCLlkxWfEAEEbWmvnBAdV2S_.gybxXZWZYIJGbY0FvTvmmzAx0WLrra9_0 2024-03-04T13:00:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.846568507289489804', time=2024-03-04T14:57:37.570460+0000, chain.objs.size()=1 2024-03-04T13:00:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:y0KUngG6cgo3b34T38YWeRB.goeZ-oz_.NZh4SZzHwa4AIkyiQG0DXvMmvURigr2_0 2024-03-04T13:00:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3527711192161747782', time=2024-03-04T14:57:40.642100+0000, chain.objs.size()=1 2024-03-04T13:00:16.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:E70F1ejmGpEjNDIikd.JtzLi.RvukFy_.KAlTglSW1I2Hbnlf_MrsOVJ3cuKopT2_0 2024-03-04T13:00:16.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5321429433471275288', time=2024-03-04T14:57:43.734427+0000, chain.objs.size()=1 2024-03-04T13:00:16.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:8TJBrvKwjJJKzCG0SOKP1D0ga9K0IjL_.WdhE-9P4ftWJFG704BqPwhcIOYIU5Xr_0 2024-03-04T13:00:16.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9810324352424305992', time=2024-03-04T14:57:46.204982+0000, chain.objs.size()=4 2024-03-04T13:00:16.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__multipart_testobj.2~tN16vRlpCsZbQ2cfOVsAtcK83eAFLSy.1 2024-03-04T13:00:16.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__multipart_testobj.2~tN16vRlpCsZbQ2cfOVsAtcK83eAFLSy.2 2024-03-04T13:00:16.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__multipart_testobj.2~tN16vRlpCsZbQ2cfOVsAtcK83eAFLSy.3 2024-03-04T13:00:16.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.544__multipart_testobj.2~tN16vRlpCsZbQ2cfOVsAtcK83eAFLSy.4 2024-03-04T13:00:16.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4294074517517598760', time=2024-03-04T14:57:47.303780+0000, chain.objs.size()=1 2024-03-04T13:00:16.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.545__shadow:Gm3uZISXd3ZBY02qrr6gI1IQXnPcmEj_.4tT2uhJW5fueGryVVEBTi3MsBiNoNao_0 2024-03-04T13:00:16.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8116318598749521610', time=2024-03-04T14:57:52.069783+0000, chain.objs.size()=1 2024-03-04T13:00:16.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.482+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.553__shadow:2-f-t-1sQpYpMTMhAoQTXYDwPjW42on_.Sq1OLRaBcvG4B2M3vhS24qrQUm2yKPi_0 2024-03-04T13:00:16.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.484+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16255036443275383453', time=2024-03-04T14:58:00.215771+0000, chain.objs.size()=1 2024-03-04T13:00:16.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.484+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.574__shadow_.F7u1kor_JkRTMgG2v1r9IjrbRTtJKZI_0 2024-03-04T13:00:16.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.484+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12392079150797809961', time=2024-03-04T14:58:09.661402+0000, chain.objs.size()=1 2024-03-04T13:00:16.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.484+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.584__shadow_.XDY-o44b_85RjkYMvycAZS6ZpVFwkwT_0 2024-03-04T13:00:16.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8100760022391592258', time=2024-03-04T14:58:33.461905+0000, chain.objs.size()=1 2024-03-04T13:00:16.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.628__shadow_.i_fQgbwqCj6WX593wdsPLuTd9fEElaj_0 2024-03-04T13:00:16.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.402704580707348306', time=2024-03-04T14:58:34.686044+0000, chain.objs.size()=1 2024-03-04T13:00:16.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.632__shadow_.Kk0t-wIs-IqSMmV6HfSKH6jFnYr0YA8_0 2024-03-04T13:00:16.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11432830674104888780', time=2024-03-04T14:58:35.273199+0000, chain.objs.size()=1 2024-03-04T13:00:16.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.633__shadow_.73yVOy7BiuDIPjSzOcShO-4n5YumJ9p_0 2024-03-04T13:00:16.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13347783152222830728', time=2024-03-04T14:58:44.615865+0000, chain.objs.size()=1 2024-03-04T13:00:16.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.658__shadow:JGafuX1tZFBF3oTHnrjKrP.BRiLeGsg_.YWsameI6bRhb52B-abmvwnJiWwQFbLY_0 2024-03-04T13:00:16.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.485+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2684593187667835565', time=2024-03-04T14:58:44.943236+0000, chain.objs.size()=1 2024-03-04T13:00:16.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.485+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.659__shadow:mz1HoL-upOLk9SCfSY-IM72T.jWSdSZ_.VZYZSP0g-cJedyHDopEIn-UEPxCAHE0_0 2024-03-04T13:00:16.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.486+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1997552436591876360', time=2024-03-04T14:58:46.983186+0000, chain.objs.size()=1 2024-03-04T13:00:16.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.486+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.664__shadow:NJpFPTyTSdMwvYOTcNJjOTwJvSs8Yud_.naFJPXFUJKMgbDAmUCwMrxttQ1vPOGd_0 2024-03-04T13:00:16.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.487+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.489+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T13:00:16.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.491+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.491+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50246' 2024-03-04T13:00:16.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_G_bNk0qnNS5nfcIpmFAKJIBUfR4eyyl', time=2024-03-04T14:52:58.962197+0000, chain.objs.size()=3 2024-03-04T13:00:16.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.DhPuhUELm9C7K79CiG3CvNC3E8Z3bm8_0 2024-03-04T13:00:16.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.DhPuhUELm9C7K79CiG3CvNC3E8Z3bm8_1 2024-03-04T13:00:16.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.DhPuhUELm9C7K79CiG3CvNC3E8Z3bm8_2 2024-03-04T13:00:16.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_fvROxLCEjPBcUiOaShy8yiuv_Lgu4rF', time=2024-03-04T14:52:59.683163+0000, chain.objs.size()=3 2024-03-04T13:00:16.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.p-8Bv0x3nJNTh6WNd7KBDNnWHuow4nF_0 2024-03-04T13:00:16.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.p-8Bv0x3nJNTh6WNd7KBDNnWHuow4nF_1 2024-03-04T13:00:16.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.p-8Bv0x3nJNTh6WNd7KBDNnWHuow4nF_2 2024-03-04T13:00:16.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12606875120408139658', time=2024-03-04T14:53:52.102483+0000, chain.objs.size()=1 2024-03-04T13:00:16.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HWul0pbc_7ClxzuR4fDsqsRVOVjhDcr_0 2024-03-04T13:00:16.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16832248959519632537', time=2024-03-04T14:53:52.115541+0000, chain.objs.size()=1 2024-03-04T13:00:16.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.glmCL8haQTPA-p3lJuHw0rsCr0y6eXn_0 2024-03-04T13:00:16.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12856499993255030808', time=2024-03-04T14:53:52.117664+0000, chain.objs.size()=1 2024-03-04T13:00:16.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.sa5XQaI8qqe7OeH_rVIFwXbzMfsze42_0 2024-03-04T13:00:16.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9753714994929484410', time=2024-03-04T14:53:52.137386+0000, chain.objs.size()=1 2024-03-04T13:00:16.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JfqSdjnoBqvR0Z3UdIltvecb_YoP1Ad_0 2024-03-04T13:00:16.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9901557705104914708', time=2024-03-04T14:53:52.217367+0000, chain.objs.size()=1 2024-03-04T13:00:16.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.iI89AyayAHI6zLznZZ3B2mFXrrIPvI2_0 2024-03-04T13:00:16.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7521946800112101551', time=2024-03-04T14:53:52.218065+0000, chain.objs.size()=1 2024-03-04T13:00:16.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.492+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Bl2otRUfnIUYBdk3HHgtchW5L9aH_lp_0 2024-03-04T13:00:16.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.495+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9188097033349230306', time=2024-03-04T14:53:52.228176+0000, chain.objs.size()=1 2024-03-04T13:00:16.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.495+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vod0xcwsqGCEwKYgr1vXKjGE5IqSFwE_0 2024-03-04T13:00:16.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.495+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8095522906594040485', time=2024-03-04T14:53:52.229313+0000, chain.objs.size()=1 2024-03-04T13:00:16.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.495+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Z36ctlE45eXUdUHIKGqhUIJls92Z4pf_0 2024-03-04T13:00:16.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.495+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11531822460587571492', time=2024-03-04T14:53:52.241207+0000, chain.objs.size()=1 2024-03-04T13:00:16.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.495+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.H9bv-2r_pp3ESk7ySuG_y2j9P3PkeNl_0 2024-03-04T13:00:16.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.495+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9336337205056035910', time=2024-03-04T14:53:52.243219+0000, chain.objs.size()=1 2024-03-04T13:00:16.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.9S_RxUtMYmf5RZDQWx2VB9SbCKXJ3yK_0 2024-03-04T13:00:16.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15813614899023596451', time=2024-03-04T14:53:52.253383+0000, chain.objs.size()=1 2024-03-04T13:00:16.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.lG_RHj5WUKur72Z8WmoiylaICuYyqKS_0 2024-03-04T13:00:16.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8466006487140114068', time=2024-03-04T14:53:52.255480+0000, chain.objs.size()=1 2024-03-04T13:00:16.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.2NdXDHsL-U6TlvLdCtqm-LXDCC2ph5N_0 2024-03-04T13:00:16.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12007881136285416629', time=2024-03-04T14:53:52.263290+0000, chain.objs.size()=1 2024-03-04T13:00:16.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0aBIabsTpIzRxUuxVfdNQNK5yeREQSf_0 2024-03-04T13:00:16.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8646905998210675748', time=2024-03-04T14:53:52.268632+0000, chain.objs.size()=1 2024-03-04T13:00:16.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.MW_znCEBqKtUALt8XPOp9yrEnO6ZfdP_0 2024-03-04T13:00:16.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15207079696474653082', time=2024-03-04T14:53:52.276033+0000, chain.objs.size()=1 2024-03-04T13:00:16.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.TfjNIoTXi0w8xXrToh9zRgpYbqAEOeR_0 2024-03-04T13:00:16.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14353189320750230070', time=2024-03-04T14:53:52.303515+0000, chain.objs.size()=1 2024-03-04T13:00:16.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.w9sA-gbMTzng2X_E5hiVdp5hnCRvkBU_0 2024-03-04T13:00:16.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8320970132704349489', time=2024-03-04T14:53:52.418423+0000, chain.objs.size()=1 2024-03-04T13:00:16.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.crjPXz09ujXDHmdTjrVfH1Pqq2qA2cW_0 2024-03-04T13:00:16.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.378107771947313290', time=2024-03-04T14:53:52.425093+0000, chain.objs.size()=1 2024-03-04T13:00:16.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.496+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.okL38vesTspbINxScr4MX5Bed1098P5_0 2024-03-04T13:00:16.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.538642970015923832', time=2024-03-04T14:53:52.444304+0000, chain.objs.size()=1 2024-03-04T13:00:16.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.2fEy1me3tltSgeqLrPbjTI7sQvC7353_0 2024-03-04T13:00:16.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.497+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4562938028726420737', time=2024-03-04T14:53:52.488020+0000, chain.objs.size()=1 2024-03-04T13:00:16.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.497+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.DLX7ysviGp0ujVQnhDqeCUaf2QTiCCD_0 2024-03-04T13:00:16.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.333163042056301691', time=2024-03-04T14:53:52.568423+0000, chain.objs.size()=1 2024-03-04T13:00:16.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ec6xjevl-vUd0fJa3MC1SSm-OO3TVme_0 2024-03-04T13:00:16.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9759462837874804067', time=2024-03-04T14:53:52.585569+0000, chain.objs.size()=1 2024-03-04T13:00:16.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.qhEM9mP2Vn2pMhlcFx5bQ5UmrY-nS5S_0 2024-03-04T13:00:16.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9950148207860211537', time=2024-03-04T14:53:52.602501+0000, chain.objs.size()=1 2024-03-04T13:00:16.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.bR3VQR427mxFW0r9SlFVEmdDgMtRsO__0 2024-03-04T13:00:16.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10641768014022375660', time=2024-03-04T14:53:52.634806+0000, chain.objs.size()=1 2024-03-04T13:00:16.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.M4g0ZuztyHtA2p-UAzb1V7RAI76VKZ8_0 2024-03-04T13:00:16.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4224971468394065209', time=2024-03-04T14:53:52.635763+0000, chain.objs.size()=1 2024-03-04T13:00:16.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.gPLLRE9MGMbgI6OgkrIfGE5h6BJ35-W_0 2024-03-04T13:00:16.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9256701688420114359', time=2024-03-04T14:53:52.654227+0000, chain.objs.size()=1 2024-03-04T13:00:16.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vPeMT3Tw8gTjDryAQgHR72WGmevPRPX_0 2024-03-04T13:00:16.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11170732815828653487', time=2024-03-04T14:53:52.743523+0000, chain.objs.size()=1 2024-03-04T13:00:16.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.498+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GUW-DU2oHefuzi-qz31PHhJKph6Pvx__0 2024-03-04T13:00:16.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.499+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.847339277414628717', time=2024-03-04T14:53:52.765345+0000, chain.objs.size()=1 2024-03-04T13:00:16.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.499+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Wf8vpHQmw05ICMsACKh6o__0VRPZmVJ_0 2024-03-04T13:00:16.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.499+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7515177182893678629', time=2024-03-04T14:53:52.797610+0000, chain.objs.size()=1 2024-03-04T13:00:16.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.499+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.H2sF5_k8Df1Vh3ynamLKxc4QzQY60so_0 2024-03-04T13:00:16.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.499+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12278482003278339137', time=2024-03-04T14:53:52.811235+0000, chain.objs.size()=1 2024-03-04T13:00:16.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.499+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.kGj2bmofGVxFwXo8VaPancZ7WsUDCzt_0 2024-03-04T13:00:16.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.499+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14962270917666485343', time=2024-03-04T14:53:52.910845+0000, chain.objs.size()=1 2024-03-04T13:00:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.499+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-OzxbtW-LkYbwlGxhqhKov3qNvzH5Si_0 2024-03-04T13:00:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.500+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14064794958645320297', time=2024-03-04T14:53:52.929516+0000, chain.objs.size()=1 2024-03-04T13:00:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.500+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.qc-vbXTikF_e66_-XGl2LNCYqEHTp-G_0 2024-03-04T13:00:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.500+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14389249246409017396', time=2024-03-04T14:53:52.934704+0000, chain.objs.size()=1 2024-03-04T13:00:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.500+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-ReW8w98vvXrpPQJpvEQlvYkiH3gi90_0 2024-03-04T13:00:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.500+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5439852819821609495', time=2024-03-04T14:53:52.940090+0000, chain.objs.size()=1 2024-03-04T13:00:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.500+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.hGIoU33CYJBklwDteKApQ9aKYpxv-jC_0 2024-03-04T13:00:16.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.500+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13656492780566845572', time=2024-03-04T14:53:53.251589+0000, chain.objs.size()=1 2024-03-04T13:00:16.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.500+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3GTRG4FY6LG-b2vnox0cIKX0UIDMuUV_0 2024-03-04T13:00:16.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.500+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.621007042745083012', time=2024-03-04T14:54:00.570676+0000, chain.objs.size()=1 2024-03-04T13:00:16.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.500+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.249__shadow_.EYTC-ztQ9t7zKn6MUQ2vOgccG8NAo-y_0 2024-03-04T13:00:16.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.501+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14251179518735733506', time=2024-03-04T14:54:00.991206+0000, chain.objs.size()=1 2024-03-04T13:00:16.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.501+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.250__shadow_.GR7TWSjHwb9hWSQ8Hb_OHm26021shbe_0 2024-03-04T13:00:16.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.501+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4486177061707033114', time=2024-03-04T14:54:01.438924+0000, chain.objs.size()=1 2024-03-04T13:00:16.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.501+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.251__shadow_.RnTxHM8nmaeOVQsVKUADIXxv2I40NNr_0 2024-03-04T13:00:16.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.501+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11928887851135019676', time=2024-03-04T14:54:04.513507+0000, chain.objs.size()=1 2024-03-04T13:00:16.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.501+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.258__shadow_.WLtCVfYVVo3t6WbKbzOcuSSVMC975vb_0 2024-03-04T13:00:16.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1776951444689148622', time=2024-03-04T14:54:09.030514+0000, chain.objs.size()=1 2024-03-04T13:00:16.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.Ovi8B6ALq1hbR5cur6fIvXQ28a_GxsE_0 2024-03-04T13:00:16.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14348591234515010666', time=2024-03-04T14:54:13.560621+0000, chain.objs.size()=1 2024-03-04T13:00:16.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.276__shadow_.9AZwdZ4fmvGwcj9-XwZmByBj-UI0kgx_0 2024-03-04T13:00:16.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8544300571913002851', time=2024-03-04T14:54:15.038344+0000, chain.objs.size()=1 2024-03-04T13:00:16.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.279__shadow_.y4ZG-7UxjEPPHigfpmydcYcMoc_Y3MU_0 2024-03-04T13:00:16.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10572981925228219450', time=2024-03-04T14:54:29.627978+0000, chain.objs.size()=1 2024-03-04T13:00:16.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HkBf91eyepYH6z2euP7VCEGz21InGqW_0 2024-03-04T13:00:16.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5316916497776534593', time=2024-03-04T14:54:29.643690+0000, chain.objs.size()=1 2024-03-04T13:00:16.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.JtWBw0E75L3IPeH9WzYisAhjWrYc9YS_0 2024-03-04T13:00:16.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17600944040867485363', time=2024-03-04T14:54:29.651599+0000, chain.objs.size()=1 2024-03-04T13:00:16.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.E-js_V-Q_Vi6sWhimNvN-SD2Vx6PDda_0 2024-03-04T13:00:16.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16945843938063645831', time=2024-03-04T14:54:29.664693+0000, chain.objs.size()=1 2024-03-04T13:00:16.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.GVDc37ZMBmIg8InJXKZXTrC3qBX8nlm_0 2024-03-04T13:00:16.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1964178490682345485', time=2024-03-04T14:54:29.802595+0000, chain.objs.size()=1 2024-03-04T13:00:16.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.502+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.d6NjgLmND7nJJTng9wJ6MTpfPZklfKo_0 2024-03-04T13:00:16.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.504+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11662626648762787558', time=2024-03-04T14:54:29.808254+0000, chain.objs.size()=1 2024-03-04T13:00:16.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.504+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ErWECol7E4sQ11BfqDMu0RIijzt_GpA_0 2024-03-04T13:00:16.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.504+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6524351831620406869', time=2024-03-04T14:54:29.853610+0000, chain.objs.size()=1 2024-03-04T13:00:16.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.504+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LIN09r17SBI6pgwnZY0lVlnwzwGPqQ2_0 2024-03-04T13:00:16.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10208067277217208835', time=2024-03-04T14:54:29.858154+0000, chain.objs.size()=1 2024-03-04T13:00:16.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.WRJ0yrq2PSFSWnWaFHPS3MZop7IEKiH_0 2024-03-04T13:00:16.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2533397434709902985', time=2024-03-04T14:54:29.944464+0000, chain.objs.size()=1 2024-03-04T13:00:16.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.p_iY8zDDl3FscohJ0O_hfGjqhrgQZGA_0 2024-03-04T13:00:16.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17634647245841504716', time=2024-03-04T14:54:29.970462+0000, chain.objs.size()=1 2024-03-04T13:00:16.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.eYsVx9gcbVfk9HuRRO7TcSy6D4im6xV_0 2024-03-04T13:00:16.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14444895799993175093', time=2024-03-04T14:54:29.983457+0000, chain.objs.size()=1 2024-03-04T13:00:16.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HImK0Sa952F_w-NPlBlD6-q5_wg0_8K_0 2024-03-04T13:00:16.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5225241859522806201', time=2024-03-04T14:54:30.001835+0000, chain.objs.size()=1 2024-03-04T13:00:16.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.SVKcMtRJbPK730HSH0HcHNj7cygQCg-_0 2024-03-04T13:00:16.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4151598737394620438', time=2024-03-04T14:54:30.016656+0000, chain.objs.size()=1 2024-03-04T13:00:16.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.mWFX8B6ekdWh2Qlb9NyxlVRc83uDSO8_0 2024-03-04T13:00:16.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8780433818260590714', time=2024-03-04T14:54:30.025896+0000, chain.objs.size()=1 2024-03-04T13:00:16.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.1uNhIkK6T5J6OAtr3IoDSKv32siHjZi_0 2024-03-04T13:00:16.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6275997130129033394', time=2024-03-04T14:54:30.026885+0000, chain.objs.size()=1 2024-03-04T13:00:16.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.N7B266jIiceoLfSpEOR1EYQmEtiLGP7_0 2024-03-04T13:00:16.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2586762795200224719', time=2024-03-04T14:54:30.101241+0000, chain.objs.size()=1 2024-03-04T13:00:16.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.505+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rVhYPEJfWadgEthuyVIQXiF-2j0KD_N_0 2024-03-04T13:00:16.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.506+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12773396899047429867', time=2024-03-04T14:54:30.123478+0000, chain.objs.size()=1 2024-03-04T13:00:16.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.506+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.vhf-kXwjQkWRgvzHzGbHn3oagUGSj_0_0 2024-03-04T13:00:16.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.506+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5648813661330707350', time=2024-03-04T14:54:30.158222+0000, chain.objs.size()=1 2024-03-04T13:00:16.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.506+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.p-do2SAEQ9M52nDNWFr-ywEpbo7Zomv_0 2024-03-04T13:00:16.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12289626755382417844', time=2024-03-04T14:54:30.260763+0000, chain.objs.size()=1 2024-03-04T13:00:16.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.eb0muxHUP9hIXhO4hTERs9nXTFTAzpQ_0 2024-03-04T13:00:16.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14971630955158990316', time=2024-03-04T14:54:30.278383+0000, chain.objs.size()=1 2024-03-04T13:00:16.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Wk5qUQmY7aVvGyOGhCmBp8qSyseLWvN_0 2024-03-04T13:00:16.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1785545739355091961', time=2024-03-04T14:54:30.328345+0000, chain.objs.size()=1 2024-03-04T13:00:16.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.jeOXA5NmGJWPpiIQuHFwl75tvHGPBJe_0 2024-03-04T13:00:16.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4055866031959619446', time=2024-03-04T14:54:30.418398+0000, chain.objs.size()=1 2024-03-04T13:00:16.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.qVSTV9ZtWcA9eL4pz42rcAwo5Pneiwf_0 2024-03-04T13:00:16.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4926480623665439258', time=2024-03-04T14:54:30.430204+0000, chain.objs.size()=1 2024-03-04T13:00:16.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.S2ivVrHlIE804NoHshIOC32zIdYjIib_0 2024-03-04T13:00:16.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11742134167929208950', time=2024-03-04T14:54:30.446774+0000, chain.objs.size()=1 2024-03-04T13:00:16.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wn_IAbt4q7vKIgLZpv-Uc-_yfj_rQiy_0 2024-03-04T13:00:16.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8588345426099141630', time=2024-03-04T14:54:30.449270+0000, chain.objs.size()=1 2024-03-04T13:00:16.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YdP1NSs3H9eFvftGFS5TJMzain5CLKK_0 2024-03-04T13:00:16.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9139471803364108014', time=2024-03-04T14:54:30.453368+0000, chain.objs.size()=1 2024-03-04T13:00:16.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.AbBVT8ZeTGVTpfb4zddpzGCR6TWSCme_0 2024-03-04T13:00:16.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11931422485789834146', time=2024-03-04T14:54:30.600512+0000, chain.objs.size()=1 2024-03-04T13:00:16.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ZCbRdZZYBhJHrFNiJvgPm3O6hchh6FJ_0 2024-03-04T13:00:16.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12745379444190632129', time=2024-03-04T14:54:30.604025+0000, chain.objs.size()=1 2024-03-04T13:00:16.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ct8dsE-SpnxYCBqr0vDthKLQyLjsAD-_0 2024-03-04T13:00:16.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3268062360582268567', time=2024-03-04T14:54:30.639095+0000, chain.objs.size()=1 2024-03-04T13:00:16.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.509+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.gzDIwHvY_ev9ZpXfGCUvG1s3SdIn0Dp_0 2024-03-04T13:00:16.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.510+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2966691832216821803', time=2024-03-04T14:54:30.652734+0000, chain.objs.size()=1 2024-03-04T13:00:16.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.510+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.zpyW5Ax_AKCkLlkVT-bzuQ_I4qsNeMP_0 2024-03-04T13:00:16.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10480843081129036513', time=2024-03-04T14:54:30.664120+0000, chain.objs.size()=1 2024-03-04T13:00:16.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cbTM7G87oqGjeLSHIQQ-cONFM-zADUp_0 2024-03-04T13:00:16.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7426917207800450901', time=2024-03-04T14:54:30.737892+0000, chain.objs.size()=1 2024-03-04T13:00:16.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.KC66L-X99dhgKoe76lr5I95PXmNYFs5_0 2024-03-04T13:00:16.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13234621068967650433', time=2024-03-04T14:54:30.773932+0000, chain.objs.size()=1 2024-03-04T13:00:16.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ru01yyALaVYDwy9moQkcarewXcoInqP_0 2024-03-04T13:00:16.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3155069813897867616', time=2024-03-04T14:54:38.320767+0000, chain.objs.size()=1 2024-03-04T13:00:16.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ZUARBa4U6SYaZ4f32v2mHlc8EurFW71_0 2024-03-04T13:00:16.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9872947430600532255', time=2024-03-04T14:54:38.372097+0000, chain.objs.size()=1 2024-03-04T13:00:16.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HpMrkj1lZHE5LBAKGMFBd3HTfE1vnCJ_0 2024-03-04T13:00:16.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18316051974320731974', time=2024-03-04T14:54:38.473863+0000, chain.objs.size()=1 2024-03-04T13:00:16.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.u_suQ_SCTh1LkRc0kNygR2IjqH0CLuf_0 2024-03-04T13:00:16.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3637959280512056639', time=2024-03-04T14:54:38.510265+0000, chain.objs.size()=1 2024-03-04T13:00:16.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.nE0GkS3pxpiaLRpk_GUd7GPzFE3p9Fe_0 2024-03-04T13:00:16.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5382550629288106082', time=2024-03-04T14:54:38.624008+0000, chain.objs.size()=1 2024-03-04T13:00:16.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wrauHljqH61XwO74RS5yetBIm32kLcg_0 2024-03-04T13:00:16.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11529740033693163850', time=2024-03-04T14:54:38.636155+0000, chain.objs.size()=1 2024-03-04T13:00:16.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.E-wKvbJG1wycRjUJD9jRybaOEEvXWBl_0 2024-03-04T13:00:16.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15518470075404321322', time=2024-03-04T14:54:38.657098+0000, chain.objs.size()=1 2024-03-04T13:00:16.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.avbPSvcVuTsh1P0LyFR3H_99_EVr12G_0 2024-03-04T13:00:16.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13162047184514267097', time=2024-03-04T14:54:38.685362+0000, chain.objs.size()=1 2024-03-04T13:00:16.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.514+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.atjuHPtCGBrDN6TWGVz6EJ_5rXo27CR_0 2024-03-04T13:00:16.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.517+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16478672070215930810', time=2024-03-04T14:54:38.691372+0000, chain.objs.size()=1 2024-03-04T13:00:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.517+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.AQ2W3Beem1wcANcMZLUpE5RHscrU-Xa_0 2024-03-04T13:00:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.517+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10286580589573842123', time=2024-03-04T14:54:38.710889+0000, chain.objs.size()=1 2024-03-04T13:00:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.517+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VwZoDLKM8cHUp1MX8TyZutBs23DoEd-_0 2024-03-04T13:00:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.517+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14965401146539469804', time=2024-03-04T14:54:38.788058+0000, chain.objs.size()=1 2024-03-04T13:00:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.517+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pU6rH5uIo2GWT5KEJNUimj1eWL6rDHr_0 2024-03-04T13:00:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.831416785629917179', time=2024-03-04T14:54:38.828720+0000, chain.objs.size()=1 2024-03-04T13:00:16.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ZhHthCwLD3mOBX5oM9IrlRI6FSS1Hwb_0 2024-03-04T13:00:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15021192190396606700', time=2024-03-04T14:54:38.834257+0000, chain.objs.size()=1 2024-03-04T13:00:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wM6YUyhpONJVTC5d8D70EMPXIgR04I0_0 2024-03-04T13:00:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14497444354391146953', time=2024-03-04T14:54:38.978335+0000, chain.objs.size()=1 2024-03-04T13:00:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.WrNhZGJFEwyFdJXbO1J2cS1ZYvu6Bzw_0 2024-03-04T13:00:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9367685523310657346', time=2024-03-04T14:54:39.011987+0000, chain.objs.size()=1 2024-03-04T13:00:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0yx4FvQr5BYLegyn4RewV1lNyFcenMW_0 2024-03-04T13:00:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18382119198691194944', time=2024-03-04T14:54:39.104292+0000, chain.objs.size()=1 2024-03-04T13:00:16.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.6hZfSAfR8AmecwS7vk_KEqsJb2roX2q_0 2024-03-04T13:00:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3303818515859460878', time=2024-03-04T14:54:39.105164+0000, chain.objs.size()=1 2024-03-04T13:00:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.DpIbAnZk-hFt3SABSzVKWlKMmfxk5fi_0 2024-03-04T13:00:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11391843246378860503', time=2024-03-04T14:54:39.276156+0000, chain.objs.size()=1 2024-03-04T13:00:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.XTkvHNooUZZklil6Bp8WOepV8ovUtZx_0 2024-03-04T13:00:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1062300561609847160', time=2024-03-04T14:54:39.298985+0000, chain.objs.size()=1 2024-03-04T13:00:16.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.520+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ElwGr5cVOp4K8n-dCLw5j7TQ-IJd7GA_0 2024-03-04T13:00:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.523+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2577133907830990964', time=2024-03-04T14:54:39.312374+0000, chain.objs.size()=1 2024-03-04T13:00:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.523+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Iwqzd-0B_47W9aWUy0Kdr1cOiE3yk8n_0 2024-03-04T13:00:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.523+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3971200951149927666', time=2024-03-04T14:54:39.340883+0000, chain.objs.size()=1 2024-03-04T13:00:16.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.523+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xLpJZqTEQqPMcT9VdN-5jbcjoSqy4Hq_0 2024-03-04T13:00:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.523+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16515212146911036206', time=2024-03-04T14:54:39.350648+0000, chain.objs.size()=1 2024-03-04T13:00:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.523+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ufWi44Ish107uck9zmWoAObESWYRjKQ_0 2024-03-04T13:00:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.526+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16717653226436949942', time=2024-03-04T14:54:39.458958+0000, chain.objs.size()=1 2024-03-04T13:00:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.526+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Ulfe4UEpCs7Ur6ooLcvsCmQZa6kuBPO_0 2024-03-04T13:00:16.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.528+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/50246 2024-03-04T13:00:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-03-04T13:00:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11603490503579823574', time=2024-03-04T14:54:39.461487+0000, chain.objs.size()=1 2024-03-04T13:00:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.3mFB-4BdK8N5FHGyaUKevRVsGGtNHaH_0 2024-03-04T13:00:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3720380740895821338', time=2024-03-04T14:55:02.357130+0000, chain.objs.size()=1 2024-03-04T13:00:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.350__shadow_.bLav73v3v--WcocjFQhbmCCj1Nj-wkM_0 2024-03-04T13:00:16.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11830380480624554692', time=2024-03-04T14:55:52.722762+0000, chain.objs.size()=1 2024-03-04T13:00:16.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.456__shadow_.1WwnvXMTtZmdFZ9C2iUQYPIC7LJykhZ_0 2024-03-04T13:00:16.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9271045793141775497', time=2024-03-04T14:55:58.393853+0000, chain.objs.size()=1 2024-03-04T13:00:16.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.469__shadow_.13UXESWQ-XTABwO1C--Qj-qzrBaVoEF_0 2024-03-04T13:00:16.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8452103337276502844', time=2024-03-04T14:56:05.353146+0000, chain.objs.size()=1 2024-03-04T13:00:16.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.485__multipart_mymultipart.2~wuEMdnarZWM57UIVGt-axZy5WLdU_Dw.1 2024-03-04T13:00:16.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3703938139533862759', time=2024-03-04T14:56:06.624892+0000, chain.objs.size()=1 2024-03-04T13:00:16.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.488__multipart_mymultipartcopy.2~Q5xNpqNTvK8yVoQZlAduaumGbJequR-.1 2024-03-04T13:00:16.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2486589795420806210', time=2024-03-04T14:56:13.295023+0000, chain.objs.size()=4 2024-03-04T13:00:16.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.492__shadow:nxJPkoab7fa-DQbVOmg2n7qoB-3JuW0_.0vxBgp1D22VElPBRQObkfMOLrQ0z31T_0 2024-03-04T13:00:16.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.492__shadow:nxJPkoab7fa-DQbVOmg2n7qoB-3JuW0_.0vxBgp1D22VElPBRQObkfMOLrQ0z31T_1 2024-03-04T13:00:16.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.492__shadow:nxJPkoab7fa-DQbVOmg2n7qoB-3JuW0_.0vxBgp1D22VElPBRQObkfMOLrQ0z31T_2 2024-03-04T13:00:16.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.492__shadow:nxJPkoab7fa-DQbVOmg2n7qoB-3JuW0_.0vxBgp1D22VElPBRQObkfMOLrQ0z31T_3 2024-03-04T13:00:16.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~NoT76FJDhF7a3S1X9B-cX17H1lD-3Z1', time=2024-03-04T14:56:28.753260+0000, chain.objs.size()=4 2024-03-04T13:00:16.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.501__multipart_mymultipart.2~NoT76FJDhF7a3S1X9B-cX17H1lD-3Z1.1 2024-03-04T13:00:16.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.530+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.501__shadow_mymultipart.2~NoT76FJDhF7a3S1X9B-cX17H1lD-3Z1.1_1 2024-03-04T13:00:16.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.535+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.501__multipart_mymultipart.2~NoT76FJDhF7a3S1X9B-cX17H1lD-3Z1.2 2024-03-04T13:00:16.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.535+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.501__shadow_mymultipart.2~NoT76FJDhF7a3S1X9B-cX17H1lD-3Z1.2_1 2024-03-04T13:00:16.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.535+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15177944456894499355', time=2024-03-04T14:57:05.456493+0000, chain.objs.size()=1 2024-03-04T13:00:16.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.535+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.523__shadow_.nPL_iJtTIMooy_bMyBKXllMIzcutfhR_0 2024-03-04T13:00:16.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.535+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.47243934071180485', time=2024-03-04T14:57:47.293939+0000, chain.objs.size()=1 2024-03-04T13:00:16.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.535+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.545__shadow:HuDppwLvaDvm0JV5bDZxvbL.iJHjiDu_.nMN09j6QR7zLIu3nkKgJw8NfEH_7NAx_0 2024-03-04T13:00:16.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.535+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1277212356657126218', time=2024-03-04T14:57:52.080660+0000, chain.objs.size()=1 2024-03-04T13:00:16.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.535+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.553__shadow:BV1eFJzoqQD.Ks29aquLcXTut9oRMbX_.BaLdlcXTaBN82Oa3WOLnqIUmPxna_Pt_0 2024-03-04T13:00:16.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.535+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17798378019074384056', time=2024-03-04T14:57:52.149445+0000, chain.objs.size()=1 2024-03-04T13:00:16.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.535+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.553__shadow:mEMNB3xznzuCsnjNh0NM8dan2ORpL.1_.14UjdPHrhuUJCnOwdjshADaKT1oIAEg_0 2024-03-04T13:00:16.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.535+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16953949867504021569', time=2024-03-04T14:58:24.849999+0000, chain.objs.size()=1 2024-03-04T13:00:16.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.536+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.612__shadow_.b2PZATRdEjPQNKPhjtc20FGKF5Qq8en_0 2024-03-04T13:00:16.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.536+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11404659522640653026', time=2024-03-04T14:58:25.802234+0000, chain.objs.size()=1 2024-03-04T13:00:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.536+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.614__shadow_.ooM_WKkgjh7tfV_NzFvgv-fgiml42h6_0 2024-03-04T13:00:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.536+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10362173440901756796', time=2024-03-04T14:58:27.865548+0000, chain.objs.size()=1 2024-03-04T13:00:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.536+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.618__shadow_.dOndqSliVqzRooD3dBQIz53ItFbhAX0_0 2024-03-04T13:00:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.536+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9878149531403197863', time=2024-03-04T14:58:34.097183+0000, chain.objs.size()=1 2024-03-04T13:00:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.536+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.630__shadow_.aovIoIZBatN413epMYhE96bK5u40X3z_0 2024-03-04T13:00:16.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.541+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.543+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T13:00:16.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.544+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.545+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47143' 2024-03-04T13:00:16.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8168626684636751536', time=2024-03-04T14:53:23.867173+0000, chain.objs.size()=1 2024-03-04T13:00:16.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.192__shadow_.zE17hKARQ1PpaZypCwDcLxtleCeMcHK_0 2024-03-04T13:00:16.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3784367615004814717', time=2024-03-04T14:53:33.624840+0000, chain.objs.size()=1 2024-03-04T13:00:16.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.211__shadow_.4grdhP2LMcpF0rgwFfgiXkbrBeaeyO3_0 2024-03-04T13:00:16.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1410434744160112353', time=2024-03-04T14:53:34.884705+0000, chain.objs.size()=1 2024-03-04T13:00:16.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.214__shadow_.-wsCYxK2CNNUG0rKD3GXMV8vPOi0z5S_0 2024-03-04T13:00:16.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11731473352904730146', time=2024-03-04T14:53:37.361519+0000, chain.objs.size()=1 2024-03-04T13:00:16.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.218__shadow_.r0tYs_Y2B8OIs8LJiPzT6pFx-nWWBLR_0 2024-03-04T13:00:16.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11846930706119215819', time=2024-03-04T14:53:38.213420+0000, chain.objs.size()=1 2024-03-04T13:00:16.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.220__shadow_.k_Wj9IMWH6qjinu325yE7mZVyq9qSaz_0 2024-03-04T13:00:16.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6444688238563562796', time=2024-03-04T14:53:39.081368+0000, chain.objs.size()=1 2024-03-04T13:00:16.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.222__shadow_.mAhG-N8pZkhoFslflSA73QvaxGt9VUg_0 2024-03-04T13:00:16.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13013279756348723675', time=2024-03-04T14:53:42.226188+0000, chain.objs.size()=1 2024-03-04T13:00:16.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.229__shadow_.rpd-iUqbJz1B7071bvWcJ-mccXp-xoX_0 2024-03-04T13:00:16.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10883737045606350789', time=2024-03-04T14:53:43.515415+0000, chain.objs.size()=1 2024-03-04T13:00:16.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.232__shadow_.8hCvhGmcDFPvydM7YBbl0oZzvOhXZoN_0 2024-03-04T13:00:16.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.725297677073339435', time=2024-03-04T14:53:52.079650+0000, chain.objs.size()=1 2024-03-04T13:00:16.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.gR3mf_MKCRMuCohmpvyKCuV1RObQkuM_0 2024-03-04T13:00:16.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14665136312469845445', time=2024-03-04T14:53:52.086649+0000, chain.objs.size()=1 2024-03-04T13:00:16.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.v2Fi0wFiLSa-ogiBXcYxcyIid5K5lfC_0 2024-03-04T13:00:16.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10798423123304756883', time=2024-03-04T14:53:52.282001+0000, chain.objs.size()=1 2024-03-04T13:00:16.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.41D3DLtS4QfsS8GLzQh5FXUAg0ryP_v_0 2024-03-04T13:00:16.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5589628911769990617', time=2024-03-04T14:53:52.443256+0000, chain.objs.size()=1 2024-03-04T13:00:16.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.546+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.TWLbfcHjoQpXM2tC0e8T_8XEZepNTWO_0 2024-03-04T13:00:16.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11754087602131440638', time=2024-03-04T14:53:52.465762+0000, chain.objs.size()=1 2024-03-04T13:00:16.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.BNvo5HcJd7RWvC5SU87izfnPtaW-xXo_0 2024-03-04T13:00:16.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8159893528296516311', time=2024-03-04T14:53:52.605797+0000, chain.objs.size()=1 2024-03-04T13:00:16.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.S5Mvc2SJmwOQWvXvzvQyehcAoMwe4u-_0 2024-03-04T13:00:16.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11485178941873094789', time=2024-03-04T14:53:52.612196+0000, chain.objs.size()=1 2024-03-04T13:00:16.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.O_MJIKK6eiLHCiG5K12b_r-eanOZ6bv_0 2024-03-04T13:00:16.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6579842620554190311', time=2024-03-04T14:53:52.638340+0000, chain.objs.size()=1 2024-03-04T13:00:16.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.sInmOEceYbti7oRx26hg1SEmqpMZF46_0 2024-03-04T13:00:16.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8213671631931420092', time=2024-03-04T14:53:52.644638+0000, chain.objs.size()=1 2024-03-04T13:00:16.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.rTMT5ObmLVbEp-5DGlFZmSRCsAVed8X_0 2024-03-04T13:00:16.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16883195701919595867', time=2024-03-04T14:53:52.650462+0000, chain.objs.size()=1 2024-03-04T13:00:16.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Qpzm8pcwZhhSiSHA8TCtUMz0tb5MQP4_0 2024-03-04T13:00:16.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4361458879078486515', time=2024-03-04T14:53:52.661119+0000, chain.objs.size()=1 2024-03-04T13:00:16.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.4J7zTSla6Ey8gZpj2r7MhKvWIC5Iz7F_0 2024-03-04T13:00:16.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7489256498086814120', time=2024-03-04T14:53:52.663737+0000, chain.objs.size()=1 2024-03-04T13:00:16.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.z_jVvhojoEuZe0DcA1ODUeF1bTjOaUo_0 2024-03-04T13:00:16.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6537396756550448014', time=2024-03-04T14:53:52.745630+0000, chain.objs.size()=1 2024-03-04T13:00:16.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.I7xQSdvBhYqK7xxEbW7fJY2IMw2zbgY_0 2024-03-04T13:00:16.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17281925031653141065', time=2024-03-04T14:53:52.757075+0000, chain.objs.size()=1 2024-03-04T13:00:16.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.B3eQRolOSf_URkdZTX-rO5UV2_RgmkQ_0 2024-03-04T13:00:16.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13214301338075103575', time=2024-03-04T14:53:52.798352+0000, chain.objs.size()=1 2024-03-04T13:00:16.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.553+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.IfYRd4eHDhhjw-OrEp87tgM-G8xrZ_U_0 2024-03-04T13:00:16.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.558+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7082250802539407227', time=2024-03-04T14:53:52.812957+0000, chain.objs.size()=1 2024-03-04T13:00:16.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.558+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.6ZHj9odXwrhfrv1aGk6hs6P1-1vuUuc_0 2024-03-04T13:00:16.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.558+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6856574395180754063', time=2024-03-04T14:53:52.828871+0000, chain.objs.size()=1 2024-03-04T13:00:16.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.558+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LqtuLhMUUymrOYnqAtL3P9Q2TlW3fke_0 2024-03-04T13:00:16.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.558+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1259488348217296674', time=2024-03-04T14:53:52.833795+0000, chain.objs.size()=1 2024-03-04T13:00:16.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.558+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-lU4GExZsMYyqwXs02CypeeOXsiTKOW_0 2024-03-04T13:00:16.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.558+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5552839048559660914', time=2024-03-04T14:53:52.912593+0000, chain.objs.size()=1 2024-03-04T13:00:16.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.558+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zGSkC3b0E2x3yiFGr3FGWkaJBpaGuNm_0 2024-03-04T13:00:16.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15551086310138967977', time=2024-03-04T14:53:52.938472+0000, chain.objs.size()=1 2024-03-04T13:00:16.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.y7kpYoSZ7zvablVMH75OUnXYEARuqZl_0 2024-03-04T13:00:16.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4909637189196394164', time=2024-03-04T14:53:52.964948+0000, chain.objs.size()=1 2024-03-04T13:00:16.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.clFZRo-yl0xe34wqt55_keNXQ4GpM24_0 2024-03-04T13:00:16.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11680578287955667808', time=2024-03-04T14:53:52.969223+0000, chain.objs.size()=1 2024-03-04T13:00:16.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.9371DPfZjS7JrCX9fUI4fJKMo8QKYLx_0 2024-03-04T13:00:16.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2298473714305023271', time=2024-03-04T14:53:53.005122+0000, chain.objs.size()=1 2024-03-04T13:00:16.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.4ZBUBBktBdBl-G6ALJemT7J4Sn6JyuG_0 2024-03-04T13:00:16.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13105220714723647215', time=2024-03-04T14:53:53.100208+0000, chain.objs.size()=1 2024-03-04T13:00:16.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.AN0qyQOKlKPeS4zi7UdSY1b2yYzgxOp_0 2024-03-04T13:00:16.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1688481057501535954', time=2024-03-04T14:53:53.101959+0000, chain.objs.size()=1 2024-03-04T13:00:16.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ZSygmODto38_GUCoIyZ03r-Sx-tB0VF_0 2024-03-04T13:00:16.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1558494281013780702', time=2024-03-04T14:53:53.115540+0000, chain.objs.size()=1 2024-03-04T13:00:16.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.559+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.oqtmKPpM2lzJ2GuU83x6qUyOLAsbQ_W_0 2024-03-04T13:00:16.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.560+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8927184608208120955', time=2024-03-04T14:53:53.116656+0000, chain.objs.size()=1 2024-03-04T13:00:16.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.560+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.uJHqN6rCYGCr6zHUD3MwJp-7B3W5NON_0 2024-03-04T13:00:16.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.561+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3711895837755470172', time=2024-03-04T14:53:53.150124+0000, chain.objs.size()=1 2024-03-04T13:00:16.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.561+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.OznlplnWcYhM0iHQ8la1eIL2vZKOLg1_0 2024-03-04T13:00:16.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.562+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11759994634990340279', time=2024-03-04T14:53:53.165862+0000, chain.objs.size()=1 2024-03-04T13:00:16.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.562+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.gM9Jy1NeXbeYuAjA_jSNoL9zCBHtqnR_0 2024-03-04T13:00:16.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.562+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5473346381506389276', time=2024-03-04T14:53:53.252299+0000, chain.objs.size()=1 2024-03-04T13:00:16.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.562+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.AtIdIV4Hq5afFfmvTT0srf5cZbVfQ44_0 2024-03-04T13:00:16.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12166811646852928880', time=2024-03-04T14:53:53.256550+0000, chain.objs.size()=1 2024-03-04T13:00:16.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.j8MfkdxFx5CnU6aDh9hsUDe4YAmMc1Z_0 2024-03-04T13:00:16.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13201185586432622037', time=2024-03-04T14:53:53.265545+0000, chain.objs.size()=1 2024-03-04T13:00:16.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.KK1sIsEZetUU5XJ4cntOBRPpJRQZzD4_0 2024-03-04T13:00:16.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11354540615895349372', time=2024-03-04T14:53:53.269679+0000, chain.objs.size()=1 2024-03-04T13:00:16.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.bLoAK2dwNq0ZnlV4ZMkelHSEVHKh7cL_0 2024-03-04T13:00:16.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9995175287951111133', time=2024-03-04T14:53:53.272041+0000, chain.objs.size()=1 2024-03-04T13:00:16.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HA4cm8uS7VXnU2sHI4qAvqUsrMEsZ2k_0 2024-03-04T13:00:16.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8472888315552207146', time=2024-03-04T14:53:53.273009+0000, chain.objs.size()=1 2024-03-04T13:00:16.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YDY6JWE-YsEgXGtliEIzzoCoDP971tg_0 2024-03-04T13:00:16.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7283597784271961564', time=2024-03-04T14:53:53.299544+0000, chain.objs.size()=1 2024-03-04T13:00:16.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.huMXyTv4PQUczMY_Tktk3eecLTnLNBr_0 2024-03-04T13:00:16.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4523323629037607023', time=2024-03-04T14:53:57.437001+0000, chain.objs.size()=1 2024-03-04T13:00:16.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.242__shadow_.VP8BVsfbr1H1xKanICJA3iJfA_op8X9_0 2024-03-04T13:00:16.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12743471128042968721', time=2024-03-04T14:53:57.437688+0000, chain.objs.size()=1 2024-03-04T13:00:16.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.242__shadow_.T09nKivQ9IDHvgPAwRIPzr87-zL__ig_0 2024-03-04T13:00:16.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10687782491199110091', time=2024-03-04T14:53:58.815870+0000, chain.objs.size()=1 2024-03-04T13:00:16.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.245__shadow_.HKidn-th3YpDWLCs64RImuzNQlTtwfD_0 2024-03-04T13:00:16.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16719027238029371979', time=2024-03-04T14:53:59.695931+0000, chain.objs.size()=1 2024-03-04T13:00:16.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.247__shadow_.QRi7e441LUSj3KAgOLyf4h38KuoM65L_0 2024-03-04T13:00:16.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17803311332277834019', time=2024-03-04T14:54:05.411998+0000, chain.objs.size()=1 2024-03-04T13:00:16.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.565+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.260__shadow_.oSHl1Zzi5soq4iai0t1Nd5UOyVosXai_0 2024-03-04T13:00:16.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4368861596610491073', time=2024-03-04T14:54:10.807444+0000, chain.objs.size()=1 2024-03-04T13:00:16.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.270__shadow_.73iQ2S9eGEWDZYrLsSruiS7B2GMzbk7_0 2024-03-04T13:00:16.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5184162142964810249', time=2024-03-04T14:54:10.808629+0000, chain.objs.size()=1 2024-03-04T13:00:16.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.270__shadow_.bCUpM9P8B7MpC5n34svk7j_BN7e2nSr_0 2024-03-04T13:00:16.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3060151109919624880', time=2024-03-04T14:54:20.805585+0000, chain.objs.size()=1 2024-03-04T13:00:16.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.292__shadow:jn0ae7LWhGBGH4w.sHMLEOjNLDXWH8W_.AdmDXblYVdHmHUTQ2CI2rRP4H3ifi1Z_0 2024-03-04T13:00:16.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13962465058803284559', time=2024-03-04T14:54:29.637774+0000, chain.objs.size()=1 2024-03-04T13:00:16.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.X3GBqfA2N9Yx161vxaeloT7FRrg2h72_0 2024-03-04T13:00:16.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4354504149468498640', time=2024-03-04T14:54:29.638669+0000, chain.objs.size()=1 2024-03-04T13:00:16.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RK-8oq5M_vzPjCoqiSusn57MwOf7bn-_0 2024-03-04T13:00:16.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10935126076462145346', time=2024-03-04T14:54:29.661967+0000, chain.objs.size()=1 2024-03-04T13:00:16.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.I0ALtn4jRj0sJmzewpGkTbctJcor7yM_0 2024-03-04T13:00:16.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8977476762404969931', time=2024-03-04T14:54:29.675374+0000, chain.objs.size()=1 2024-03-04T13:00:16.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5kHJGePDuOoNmzCks5ZGlqXx9GG-3Tk_0 2024-03-04T13:00:16.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15048630971191303634', time=2024-03-04T14:54:29.690820+0000, chain.objs.size()=1 2024-03-04T13:00:16.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.jstH58qloIJOSjmwrwfACJxkeTBGGOm_0 2024-03-04T13:00:16.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11529485664411989647', time=2024-03-04T14:54:29.700865+0000, chain.objs.size()=1 2024-03-04T13:00:16.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lrHQkBB02DZoTCKAlmhvYIPB3B8gC-5_0 2024-03-04T13:00:16.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7842899255524393457', time=2024-03-04T14:54:29.814367+0000, chain.objs.size()=1 2024-03-04T13:00:16.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.i5qjHZSTlUkH4LJo2GkqyQbZFo8Hsd4_0 2024-03-04T13:00:16.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5660293913135590953', time=2024-03-04T14:54:29.828357+0000, chain.objs.size()=1 2024-03-04T13:00:16.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.570+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RJfcusd42iwdNKbas1irCrhBpWDm1dG_0 2024-03-04T13:00:16.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.572+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16231540825502704095', time=2024-03-04T14:54:29.832062+0000, chain.objs.size()=1 2024-03-04T13:00:16.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.572+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.89kuv61B5qh_9TJfIpT0rqkBy5pU_al_0 2024-03-04T13:00:16.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13856975691869579959', time=2024-03-04T14:54:29.968538+0000, chain.objs.size()=1 2024-03-04T13:00:16.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tETpBg-pVv8nSV-_5JYedzyLfK02Tr9_0 2024-03-04T13:00:16.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4057871999247881670', time=2024-03-04T14:54:30.001011+0000, chain.objs.size()=1 2024-03-04T13:00:16.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RWDk_yxiTqX3K2ybGOjmjPE6C25DS41_0 2024-03-04T13:00:16.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8460582379888117773', time=2024-03-04T14:54:30.004480+0000, chain.objs.size()=1 2024-03-04T13:00:16.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.SVt_a9XM3g3QsYag69vml8XJDqwK5jJ_0 2024-03-04T13:00:16.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7212187022571497953', time=2024-03-04T14:54:30.025490+0000, chain.objs.size()=1 2024-03-04T13:00:16.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ZtnDVnc88P1ldtEIUyoHiQrhSf_WK44_0 2024-03-04T13:00:16.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6065500301805829171', time=2024-03-04T14:54:30.159893+0000, chain.objs.size()=1 2024-03-04T13:00:16.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YaFo5BAS3oETmWiUVY8pySU7unrYvdn_0 2024-03-04T13:00:16.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18328770144171829645', time=2024-03-04T14:54:30.172130+0000, chain.objs.size()=1 2024-03-04T13:00:16.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.vKuHJnBhquO8G8dGx-InJO3gPerCKoZ_0 2024-03-04T13:00:16.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15989006228199393274', time=2024-03-04T14:54:30.280153+0000, chain.objs.size()=1 2024-03-04T13:00:16.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.SKeWNgmV7_d1OyiJcRMGotQ2UdOXBSj_0 2024-03-04T13:00:16.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15400058377898952794', time=2024-03-04T14:54:30.305514+0000, chain.objs.size()=1 2024-03-04T13:00:16.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.qPVkaRcgB2a02O4hnARtETJjiAtpcKz_0 2024-03-04T13:00:16.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6473406936070816313', time=2024-03-04T14:54:30.306779+0000, chain.objs.size()=1 2024-03-04T13:00:16.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.KqtFgQ5FB0ncsnrOAACrUJHvtQfGZX-_0 2024-03-04T13:00:16.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4845216526438379338', time=2024-03-04T14:54:30.315873+0000, chain.objs.size()=1 2024-03-04T13:00:16.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.IfzKjltZ2gexTbjwDi_FAZ7iOBLR6AH_0 2024-03-04T13:00:16.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1515236131406142096', time=2024-03-04T14:54:30.318898+0000, chain.objs.size()=1 2024-03-04T13:00:16.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.575+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tC7pmsiH2lO6hRocpkG8dXobR4NYY9a_0 2024-03-04T13:00:16.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.577+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8282230684830167883', time=2024-03-04T14:54:30.326725+0000, chain.objs.size()=1 2024-03-04T13:00:16.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.577+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Ip4W0ur7lUFiImksEBbJHaAlVY0BvKG_0 2024-03-04T13:00:16.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14680733307610878967', time=2024-03-04T14:54:30.341385+0000, chain.objs.size()=1 2024-03-04T13:00:16.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.OXIsaEvBjpT7e5s1zM8FichzNhetA7U_0 2024-03-04T13:00:16.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14809617542333476818', time=2024-03-04T14:54:30.498989+0000, chain.objs.size()=1 2024-03-04T13:00:16.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cXE4kzjiG_MYd5p0NWQRKPXt_bN5Jjw_0 2024-03-04T13:00:16.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13848579068177867523', time=2024-03-04T14:54:30.582023+0000, chain.objs.size()=1 2024-03-04T13:00:16.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Zpb95wtG8EgSKEorEVUzWQLkSJwFPdt_0 2024-03-04T13:00:16.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12964017326471638164', time=2024-03-04T14:54:30.597924+0000, chain.objs.size()=1 2024-03-04T13:00:16.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.QkFAnZWs9YTq2S8GZS-Qs_gTsckxdyC_0 2024-03-04T13:00:16.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12900428656929160022', time=2024-03-04T14:54:30.611821+0000, chain.objs.size()=1 2024-03-04T13:00:16.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LIooZRBlw4pPL0--gPwFj4JzDjGzMUu_0 2024-03-04T13:00:16.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12368238582174848860', time=2024-03-04T14:54:30.614624+0000, chain.objs.size()=1 2024-03-04T13:00:16.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5k9umB0mgMS6DH9uIAPmNgtQtQti-aR_0 2024-03-04T13:00:16.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10159851425243458739', time=2024-03-04T14:54:30.750188+0000, chain.objs.size()=1 2024-03-04T13:00:16.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tli5E2l9TCqzljetbcKssVFJx1_ENUi_0 2024-03-04T13:00:16.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12983249043439608972', time=2024-03-04T14:54:30.751305+0000, chain.objs.size()=1 2024-03-04T13:00:16.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LjH0oSud8_36xRfZFeEZ91q_URIDaQ8_0 2024-03-04T13:00:16.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12930637328905813929', time=2024-03-04T14:54:30.755413+0000, chain.objs.size()=1 2024-03-04T13:00:16.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ey0WjklNUy9dUIKMZ4Y3IIHqQ-1odBW_0 2024-03-04T13:00:16.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4660447253911283622', time=2024-03-04T14:54:30.758515+0000, chain.objs.size()=1 2024-03-04T13:00:16.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.578+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VVnWQGUdwmwSmX6VoJXmybC3QwAraD-_0 2024-03-04T13:00:16.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.580+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4734632038584592584', time=2024-03-04T14:54:30.760177+0000, chain.objs.size()=1 2024-03-04T13:00:16.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.580+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LvQVogNy8bbJY9oduyW2dHqNzWeZlJB_0 2024-03-04T13:00:16.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3827145100323543792', time=2024-03-04T14:54:30.761481+0000, chain.objs.size()=1 2024-03-04T13:00:16.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LOBVDIYzMhlnaaGVCzbGxS7gw3QjISf_0 2024-03-04T13:00:16.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.457100767185165894', time=2024-03-04T14:54:30.798743+0000, chain.objs.size()=1 2024-03-04T13:00:16.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.BmzR6pBA0Le9q8d8B5lFRq4AcVctNTq_0 2024-03-04T13:00:16.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13183707445319673269', time=2024-03-04T14:54:30.804495+0000, chain.objs.size()=1 2024-03-04T13:00:16.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tJ8Cy6ovOUBz1f6gU0Vrz8cGT1F6PxH_0 2024-03-04T13:00:16.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4125820878547884053', time=2024-03-04T14:54:30.805662+0000, chain.objs.size()=1 2024-03-04T13:00:16.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.KESp48fNaot2aFxM4fBV6V_PaQT5XdG_0 2024-03-04T13:00:16.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17398200642670282840', time=2024-03-04T14:54:38.327735+0000, chain.objs.size()=1 2024-03-04T13:00:16.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KLAI3fjLfq9UWZugqv1ckab4hb-zmRN_0 2024-03-04T13:00:16.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4504077785811656381', time=2024-03-04T14:54:38.334698+0000, chain.objs.size()=1 2024-03-04T13:00:16.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tWaqzRMJzKq7vVqA8nQigyEAm6wp7L3_0 2024-03-04T13:00:16.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13986346090629781086', time=2024-03-04T14:54:38.344689+0000, chain.objs.size()=1 2024-03-04T13:00:16.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.OxsvllYisAcaV2AoGb74EvIx5H5GtWw_0 2024-03-04T13:00:16.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10142029606747980051', time=2024-03-04T14:54:38.356558+0000, chain.objs.size()=1 2024-03-04T13:00:16.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iVMTCEUY0Y_fe5LZmlshkXkPIXy7BPx_0 2024-03-04T13:00:16.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.424120071558605185', time=2024-03-04T14:54:38.460557+0000, chain.objs.size()=1 2024-03-04T13:00:16.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eihk1adSTHbryXe3JJ5AaLGZvHBqInS_0 2024-03-04T13:00:16.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13294514019080324277', time=2024-03-04T14:54:38.461894+0000, chain.objs.size()=1 2024-03-04T13:00:16.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.WitqjMba760I_iIug498g1QoHUXWgm1_0 2024-03-04T13:00:16.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14788273140189715598', time=2024-03-04T14:54:38.471230+0000, chain.objs.size()=1 2024-03-04T13:00:16.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.583+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.GLYqZHoFWwkd__1KDdugKk3_oLJiva1_0 2024-03-04T13:00:16.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.585+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8262202975344237677', time=2024-03-04T14:54:38.501624+0000, chain.objs.size()=1 2024-03-04T13:00:16.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.585+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5LeUotmyTb9sfzGWMMPzCha293deces_0 2024-03-04T13:00:16.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.585+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13029606562338739235', time=2024-03-04T14:54:38.512999+0000, chain.objs.size()=1 2024-03-04T13:00:16.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.585+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.XzkJ9wgVCOUAw9pNjdGu69KQj3V7xvT_0 2024-03-04T13:00:16.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.586+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5750292444465655633', time=2024-03-04T14:54:38.527231+0000, chain.objs.size()=1 2024-03-04T13:00:16.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.586+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rdHywJtb0TtNTEQHQLK7II7hnpRHN1U_0 2024-03-04T13:00:16.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.586+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13834926690532138114', time=2024-03-04T14:54:38.535995+0000, chain.objs.size()=1 2024-03-04T13:00:16.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.586+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Rzcp9t9xeJ0YUyZ6mr-FPLEL1MXCx4t_0 2024-03-04T13:00:16.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.586+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18386198023611846242', time=2024-03-04T14:54:38.544978+0000, chain.objs.size()=1 2024-03-04T13:00:16.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.586+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.uxz7rlsKzNYqpN_b_hmLR4YySM-48tO_0 2024-03-04T13:00:16.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.588+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/47143 2024-03-04T13:00:16.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=47, truncated=0, next_marker='' 2024-03-04T13:00:16.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4204560009167168909', time=2024-03-04T14:54:38.638854+0000, chain.objs.size()=1 2024-03-04T13:00:16.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ezZgwgHCzAQ9y5oThdDg9J_xFwzo-uE_0 2024-03-04T13:00:16.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15660444160766437078', time=2024-03-04T14:54:38.649951+0000, chain.objs.size()=1 2024-03-04T13:00:16.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tYWXiCEBTn0v0XHpujuKpf2Sft7IRdo_0 2024-03-04T13:00:16.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3151791824108697231', time=2024-03-04T14:54:38.669148+0000, chain.objs.size()=1 2024-03-04T13:00:16.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pYq807w3nr56XJ-EbB0_8kRP3oWc_4o_0 2024-03-04T13:00:16.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15765437487307971861', time=2024-03-04T14:54:38.681204+0000, chain.objs.size()=1 2024-03-04T13:00:16.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Z0JmUEXtrwKdcs9l9jGEIApdaNAQpT1_0 2024-03-04T13:00:16.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18277077624256982610', time=2024-03-04T14:54:38.701015+0000, chain.objs.size()=1 2024-03-04T13:00:16.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Kl9oFOGRxSAQafPlPocM-WmAz7I7IGr_0 2024-03-04T13:00:16.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9289800754271661234', time=2024-03-04T14:54:38.704341+0000, chain.objs.size()=1 2024-03-04T13:00:16.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.hxWqocjcP-7pJT8Qb1FBAby2nInK69p_0 2024-03-04T13:00:16.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7581591136244798426', time=2024-03-04T14:54:38.821814+0000, chain.objs.size()=1 2024-03-04T13:00:16.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.1BN9JJAP3T2bUVS4DoCSPfp65ICzwH7_0 2024-03-04T13:00:16.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11033952984302531271', time=2024-03-04T14:54:38.858855+0000, chain.objs.size()=1 2024-03-04T13:00:16.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.bp1ZrPtcqyFb4PtH7u7ZGt_WitrkIuL_0 2024-03-04T13:00:16.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15900823734922526592', time=2024-03-04T14:54:38.942849+0000, chain.objs.size()=1 2024-03-04T13:00:16.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-AYKhngxltq1LvKgbcvEIGrL1N1vT-D_0 2024-03-04T13:00:16.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18322430886044204729', time=2024-03-04T14:54:38.944234+0000, chain.objs.size()=1 2024-03-04T13:00:16.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wL669b-sROSggmnb4PlFNu4CSA_tycc_0 2024-03-04T13:00:16.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15446894533846581762', time=2024-03-04T14:54:38.992287+0000, chain.objs.size()=1 2024-03-04T13:00:16.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VSlZ0kHoDevVuOfEOfIdax_ke0KGAzT_0 2024-03-04T13:00:16.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18240742526480132870', time=2024-03-04T14:54:38.997250+0000, chain.objs.size()=1 2024-03-04T13:00:16.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.591+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ce1wTfz_8eeEghXPbvwwcwTbSdgcyt4_0 2024-03-04T13:00:16.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10228618064126012128', time=2024-03-04T14:54:39.120660+0000, chain.objs.size()=1 2024-03-04T13:00:16.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2T93wp0p_mr7TN9z2WT2cM78B180q27_0 2024-03-04T13:00:16.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15668303417567278971', time=2024-03-04T14:54:39.128279+0000, chain.objs.size()=1 2024-03-04T13:00:16.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5kp_8r7ruWM576XDvKBmTrFgkvc1wHI_0 2024-03-04T13:00:16.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11034785230923138215', time=2024-03-04T14:54:39.131776+0000, chain.objs.size()=1 2024-03-04T13:00:16.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Edu9q_y5TUHa-A7i6gYJmX9Fdl8JfyJ_0 2024-03-04T13:00:16.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8187582333978971029', time=2024-03-04T14:54:39.167198+0000, chain.objs.size()=1 2024-03-04T13:00:16.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.6fUFTW3gbTL7Obm3EhzDTQ6vp6i_lqI_0 2024-03-04T13:00:16.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13293215047596231419', time=2024-03-04T14:54:39.168883+0000, chain.objs.size()=1 2024-03-04T13:00:16.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.I4Z2gLZf4kz5z_XPB66nw7zQrFbJb0x_0 2024-03-04T13:00:16.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2694075851731224550', time=2024-03-04T14:54:39.266121+0000, chain.objs.size()=1 2024-03-04T13:00:16.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.JWUMeX4kq1NKW-mRbz1ZIsm6KpdFvUV_0 2024-03-04T13:00:16.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4580964950695181355', time=2024-03-04T14:54:39.276556+0000, chain.objs.size()=1 2024-03-04T13:00:16.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.F_7l59-9kDiUMUqtqrprpE99G9cnBFT_0 2024-03-04T13:00:16.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.484532504178376988', time=2024-03-04T14:54:39.285948+0000, chain.objs.size()=1 2024-03-04T13:00:16.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-rlwp1d0Tuh4DRJFKozBNrvy2_4mZDF_0 2024-03-04T13:00:16.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12428600097558880033', time=2024-03-04T14:54:39.295780+0000, chain.objs.size()=1 2024-03-04T13:00:16.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.B_Ag0l7rdZZ4ttpHWLv-zbg8Lqb1FGo_0 2024-03-04T13:00:16.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1800119583675231845', time=2024-03-04T14:54:39.307721+0000, chain.objs.size()=1 2024-03-04T13:00:16.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rMV-DAK-yK80v2CUDbKc7TE26wcZ2zG_0 2024-03-04T13:00:16.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11052468967286989456', time=2024-03-04T14:54:39.311305+0000, chain.objs.size()=1 2024-03-04T13:00:16.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.594+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-pxXO85bveFMxn2wEtZQIbfGlXqu7ta_0 2024-03-04T13:00:16.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.595+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16435365810155626839', time=2024-03-04T14:54:39.341525+0000, chain.objs.size()=1 2024-03-04T13:00:16.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.595+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.MBqC4uHlBBerey3xsJ-HepJpnJweBcv_0 2024-03-04T13:00:16.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.595+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14655726545309333545', time=2024-03-04T14:54:39.351355+0000, chain.objs.size()=1 2024-03-04T13:00:16.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.595+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rSBXyPKsYdFwN1SF1mmYxboAnASrQzD_0 2024-03-04T13:00:16.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.596+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10216743514057937295', time=2024-03-04T14:54:39.424398+0000, chain.objs.size()=1 2024-03-04T13:00:16.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.596+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.CjQ917GCAxFxLTORDPmEFVzMY9Nh07d_0 2024-03-04T13:00:16.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.596+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4859429070987271984', time=2024-03-04T14:54:39.433757+0000, chain.objs.size()=1 2024-03-04T13:00:16.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.596+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.4i1zMDooJP2t9yoi25YndH2XYY5vIh__0 2024-03-04T13:00:16.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.596+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7516372926178479424', time=2024-03-04T14:54:39.479537+0000, chain.objs.size()=1 2024-03-04T13:00:16.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.596+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.sHDmA5faXmAlalH60jTznmaNpv037te_0 2024-03-04T13:00:16.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.596+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.73409713104762690', time=2024-03-04T14:54:39.490879+0000, chain.objs.size()=1 2024-03-04T13:00:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.596+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5nH7k0Ka48U-zcgNMA-xEZgozkCcT00_0 2024-03-04T13:00:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.596+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8457422942861455253', time=2024-03-04T14:55:01.840884+0000, chain.objs.size()=1 2024-03-04T13:00:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.596+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.349__shadow_._5Y4mt2MKMztCs319VJHXAZCqiNBY1d_0 2024-03-04T13:00:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.596+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1064278862649773385', time=2024-03-04T14:55:04.806363+0000, chain.objs.size()=1 2024-03-04T13:00:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.596+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.355__shadow_.eoLL7PvUXBmwOa8cVjDPb9WJKY0FHwb_0 2024-03-04T13:00:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.597+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17107295833208160736', time=2024-03-04T14:55:40.530266+0000, chain.objs.size()=1 2024-03-04T13:00:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.597+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.428__shadow_.dg3wlZSBs89YwqoySFLQrli5U-3GId__0 2024-03-04T13:00:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.597+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8152188472765718889', time=2024-03-04T14:55:44.668588+0000, chain.objs.size()=1 2024-03-04T13:00:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.597+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.434__shadow_.ct8vIVcRR6XfoNEnOIM7g7IK4SYTEaA_0 2024-03-04T13:00:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.597+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2775792180341213087', time=2024-03-04T14:55:46.337632+0000, chain.objs.size()=1 2024-03-04T13:00:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.597+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.437__shadow_.okb2W6-6JmGNjkpmgOseQhCyJeUFxUH_0 2024-03-04T13:00:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.598+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13962216088338249198', time=2024-03-04T14:55:52.268076+0000, chain.objs.size()=1 2024-03-04T13:00:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.598+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.455__shadow_.UHih4e85TYTW3K8cLOBEOjzBEBgyxWn_0 2024-03-04T13:00:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.598+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1901703785459917445', time=2024-03-04T14:56:22.470638+0000, chain.objs.size()=6 2024-03-04T13:00:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.598+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.nLTsrNdklBOAhG1XrP9AjnJC-ZQsN3eA.1 2024-03-04T13:00:16.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.598+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.m290tXMs3Yw0rf3AQ8BC7Sf67Ps4YiSh.2 2024-03-04T13:00:16.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.598+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.nXTEmjRZJGFbCUrgcu_zW-9qCd7aXgSf.3 2024-03-04T13:00:16.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.598+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.1C31hfzOPxbXpJTmsbBsfbUC_hb2APJJ.4 2024-03-04T13:00:16.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.599+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.cnOkmLppAV_Wgu1IHzbxKbEGx66rxCQj.5 2024-03-04T13:00:16.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.599+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.4TqvlLXL_AW4bFyufo36Y2wwVS_ebYv2.6 2024-03-04T13:00:16.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.599+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4473530626961084261', time=2024-03-04T14:56:46.577811+0000, chain.objs.size()=1 2024-03-04T13:00:16.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.599+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.508__shadow_.GymsQG__8UGJz72ORB3p5k0lvcDxi8p_0 2024-03-04T13:00:16.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.599+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13110867268662583868', time=2024-03-04T14:57:25.434891+0000, chain.objs.size()=1 2024-03-04T13:00:16.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.599+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.541__shadow_.P7PZFVqXlxgYDhdA7oXa5YMKVB7JRnS_0 2024-03-04T13:00:16.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.599+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5750789981665641191', time=2024-03-04T14:57:28.679962+0000, chain.objs.size()=1 2024-03-04T13:00:16.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.599+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.542__shadow:Wh0-i2dZRPu.ah83Wlea0VZmqCkqdL5_.VMGTwYhlsH7aHseeTZ51d_gecLkupIq_0 2024-03-04T13:00:16.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.599+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:qWii2vrhAQCRg4.szYF0GOL04dSrqIQ_.ToxtbdpX0lw97ov2RWWAVKJr30ON6RW_1_ec538a847b0ebf65b1f4774918e1ff7c', time=2024-03-04T14:57:48.566081+0000, chain.objs.size()=1 2024-03-04T13:00:16.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.599+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:qWii2vrhAQCRg4.szYF0GOL04dSrqIQ_.ToxtbdpX0lw97ov2RWWAVKJr30ON6RW_0 2024-03-04T13:00:16.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.599+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5530219915916937106', time=2024-03-04T14:57:51.592171+0000, chain.objs.size()=1 2024-03-04T13:00:16.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.599+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.552__shadow:TlpUjEwa4LXbGOjYzQe9YaIEhVhdXdd_.st0kmVLR0ZEXqqF6r5eh7FqiL26tYjz_0 2024-03-04T13:00:16.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.600+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11458795511521066969', time=2024-03-04T14:57:52.144053+0000, chain.objs.size()=1 2024-03-04T13:00:16.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.600+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.553__shadow:K96LhqO1jGwQpvavExhs9V0Ajos15O2_.EMfgWwcLJcKKbjLrDHYO21JzL5JFqNh_0 2024-03-04T13:00:16.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.600+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13262565633364072445', time=2024-03-04T14:58:15.960893+0000, chain.objs.size()=1 2024-03-04T13:00:16.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.600+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.593__shadow_.VJ6JvO6Ql0n8B7qCZh7D9xKlM91dntu_0 2024-03-04T13:00:16.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.600+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3372171204702160828', time=2024-03-04T14:58:31.630287+0000, chain.objs.size()=1 2024-03-04T13:00:16.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.600+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.625__shadow_.gOa1aSbgL75yqWSOynKu7zV3gsfg-7u_0 2024-03-04T13:00:16.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.600+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.628__shadow_.to6wk0U_jvgtKmiqsubfabyqxBezPRG_1_fce808192d7f94e5b385faae7878d4c4', time=2024-03-04T14:58:33.577807+0000, chain.objs.size()=1 2024-03-04T13:00:16.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.600+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.628__shadow_.to6wk0U_jvgtKmiqsubfabyqxBezPRG_0 2024-03-04T13:00:16.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.601+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9984614651675281132', time=2024-03-04T14:58:44.160867+0000, chain.objs.size()=1 2024-03-04T13:00:16.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.601+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.657__shadow_.dq4wBMardpdmfK3HMDXl-ANsg32X9Rh_0 2024-03-04T13:00:16.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.601+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5017531243385001751', time=2024-03-04T14:59:20.014284+0000, chain.objs.size()=1 2024-03-04T13:00:16.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.601+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.696__shadow_.khQfhbls_SOOVAHquMslF3gxadsr3rX_0 2024-03-04T13:00:16.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.604+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.607+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T13:00:16.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.608+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.609+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51071' 2024-03-04T13:00:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16994141066487040618', time=2024-03-04T14:53:13.955475+0000, chain.objs.size()=1 2024-03-04T13:00:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.181__shadow_.zMTPahzc1wEUUWiWqhVcFn4T-f13kgd_0 2024-03-04T13:00:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14359752941135182614', time=2024-03-04T14:53:29.418279+0000, chain.objs.size()=1 2024-03-04T13:00:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.203__shadow_.sH4s1Kt5fkqUUaQ333J9fdXReHXmK9B_0 2024-03-04T13:00:16.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18286767133416504102', time=2024-03-04T14:53:29.873372+0000, chain.objs.size()=1 2024-03-04T13:00:16.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.204__shadow_.q8vTFRT7z0IdSOnAQXf1SU90O51g5Yl_0 2024-03-04T13:00:16.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2710044703755715452', time=2024-03-04T14:53:41.318372+0000, chain.objs.size()=1 2024-03-04T13:00:16.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.227__shadow_.lB80GWQkBqhfO8ivOBJpd1q9kcDMMm-_0 2024-03-04T13:00:16.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.246346715552685431', time=2024-03-04T14:53:44.379894+0000, chain.objs.size()=1 2024-03-04T13:00:16.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.234__shadow_.3sVh62pfN0hGEZ-JmmZv6p5LX3q13x0_0 2024-03-04T13:00:16.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16140878093757497433', time=2024-03-04T14:53:52.066811+0000, chain.objs.size()=1 2024-03-04T13:00:16.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.EZbn77_7rq8zzGTy1EVvAP39lrp3vDj_0 2024-03-04T13:00:16.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11047077345274328886', time=2024-03-04T14:53:52.285475+0000, chain.objs.size()=1 2024-03-04T13:00:16.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.cNeonUgDKZrewcokJKFy2Zc5UKwykOR_0 2024-03-04T13:00:16.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.673746484163321136', time=2024-03-04T14:53:52.288076+0000, chain.objs.size()=1 2024-03-04T13:00:16.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.h01Y8WWlr6WsfFfHqsVVOkLcLPKsoaI_0 2024-03-04T13:00:16.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4591588085676695015', time=2024-03-04T14:53:52.462949+0000, chain.objs.size()=1 2024-03-04T13:00:16.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.k-8rOxehWeCv9qEmXY-P8GFXPrNG08Z_0 2024-03-04T13:00:16.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11434847804100505698', time=2024-03-04T14:53:52.467992+0000, chain.objs.size()=1 2024-03-04T13:00:16.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.W6BDY1tK8TDHo6L-asqwO8KqcRl6XsA_0 2024-03-04T13:00:16.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13564432642359265085', time=2024-03-04T14:53:52.482337+0000, chain.objs.size()=1 2024-03-04T13:00:16.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.29p4nXPuqOnyFEJRkLZAXq6G76kDMuG_0 2024-03-04T13:00:16.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7466639500059523788', time=2024-03-04T14:53:52.566722+0000, chain.objs.size()=1 2024-03-04T13:00:16.622 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.610+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.BpwyPpTLF50HHGopv9EZiBq3DoA7B3y_0 2024-03-04T13:00:16.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.681869423954801893', time=2024-03-04T14:53:52.637717+0000, chain.objs.size()=1 2024-03-04T13:00:16.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.EmSnkSvmx-XGBEKL5ZqWa8YjfgwEltY_0 2024-03-04T13:00:16.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5876341315012485447', time=2024-03-04T14:53:52.661434+0000, chain.objs.size()=1 2024-03-04T13:00:16.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Tw0dbcrB6_5nBUnHe_ziOOztSBIF4u0_0 2024-03-04T13:00:16.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11223155782252616648', time=2024-03-04T14:53:52.662963+0000, chain.objs.size()=1 2024-03-04T13:00:16.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.t0GyKFuwuwZRdCcHN8vuTd9zt0PjOXH_0 2024-03-04T13:00:16.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3884102163911728316', time=2024-03-04T14:53:52.744456+0000, chain.objs.size()=1 2024-03-04T13:00:16.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._tFxKPMMQaPyKWay7LxF_snZcYgOq9b_0 2024-03-04T13:00:16.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11568657326817377457', time=2024-03-04T14:53:52.751089+0000, chain.objs.size()=1 2024-03-04T13:00:16.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0yhdMc-J4Yen5nvrK1VFIyoqlWUsWjW_0 2024-03-04T13:00:16.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1758790653984649343', time=2024-03-04T14:53:52.773182+0000, chain.objs.size()=1 2024-03-04T13:00:16.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.O3rBwDNMw4ShJmmGF_C1zhS3Rmrj5ik_0 2024-03-04T13:00:16.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3880660330575479490', time=2024-03-04T14:53:52.781004+0000, chain.objs.size()=1 2024-03-04T13:00:16.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.aUecdX39ct2NVcv1fl0fGdggOkHp67R_0 2024-03-04T13:00:16.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16585061257019496452', time=2024-03-04T14:53:52.823550+0000, chain.objs.size()=1 2024-03-04T13:00:16.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Y-01qYglpfc0EiCK2WUmNPGSWPoUmYs_0 2024-03-04T13:00:16.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15329529158691994742', time=2024-03-04T14:53:52.835442+0000, chain.objs.size()=1 2024-03-04T13:00:16.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.612+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.n3FgIStHRGACJxvlNxftj-eK7MaWJhR_0 2024-03-04T13:00:16.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.613+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11360183308628488337', time=2024-03-04T14:53:52.917744+0000, chain.objs.size()=1 2024-03-04T13:00:16.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.613+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.gEmpKlwfvu0lpa4slt8WEs8FXaulvqn_0 2024-03-04T13:00:16.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12520498915532414354', time=2024-03-04T14:53:52.954585+0000, chain.objs.size()=1 2024-03-04T13:00:16.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.I3HLvjKnAYFEPOHIPULchuZAOFFtjOP_0 2024-03-04T13:00:16.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14396392539443781389', time=2024-03-04T14:53:52.976523+0000, chain.objs.size()=1 2024-03-04T13:00:16.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VOI8-EiGC9476LEKRhXZ8h6n8XjPqzO_0 2024-03-04T13:00:16.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8272821510379781011', time=2024-03-04T14:53:52.978235+0000, chain.objs.size()=1 2024-03-04T13:00:16.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.imFTRpAksgngbUSx6go_eN76THxydBR_0 2024-03-04T13:00:16.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2973305581704865532', time=2024-03-04T14:53:52.989096+0000, chain.objs.size()=1 2024-03-04T13:00:16.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.XPrVu_-wSvkXtYftgAoXarD_YGQJv0A_0 2024-03-04T13:00:16.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16356325632185321372', time=2024-03-04T14:53:53.002079+0000, chain.objs.size()=1 2024-03-04T13:00:16.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.G4aa4fX0pB_zyNtC7ozJjKOgZv7QAQB_0 2024-03-04T13:00:16.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16689946637303243931', time=2024-03-04T14:53:53.157019+0000, chain.objs.size()=1 2024-03-04T13:00:16.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mBIGpUvTCf5ZhmuVpF3vqlotGT8os0F_0 2024-03-04T13:00:16.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10360702091703785275', time=2024-03-04T14:53:53.261724+0000, chain.objs.size()=1 2024-03-04T13:00:16.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PQ8AaAMaBm6ltySDNS_d3x0W80Opedf_0 2024-03-04T13:00:16.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6637097851695287973', time=2024-03-04T14:53:53.289996+0000, chain.objs.size()=1 2024-03-04T13:00:16.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yx4RSXoULwyY7vOlokrV6wOJlniRW7a_0 2024-03-04T13:00:16.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14994430213697227211', time=2024-03-04T14:53:53.309975+0000, chain.objs.size()=1 2024-03-04T13:00:16.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.614+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JDiZ8yiObsL-5JFblTxwqNfjdSvrSKM_0 2024-03-04T13:00:16.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.636+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.526249235943280395', time=2024-03-04T14:53:55.258548+0000, chain.objs.size()=1 2024-03-04T13:00:16.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.636+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.237__shadow_.Wf9zLXNTTh3zXjUFZNJggNg9G63yi_k_0 2024-03-04T13:00:16.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.636+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14169874178762473721', time=2024-03-04T14:54:02.267261+0000, chain.objs.size()=1 2024-03-04T13:00:16.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.636+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.253__shadow_.h8j-p5k16bSrM6ke_gkVPuH7skl25cc_0 2024-03-04T13:00:16.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.636+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10562802178222752147', time=2024-03-04T14:54:02.268332+0000, chain.objs.size()=1 2024-03-04T13:00:16.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.636+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.253__shadow_.Aj7g2YTlk6kDphwWiGIIFCM3wqTczSm_0 2024-03-04T13:00:16.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.637+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15274096399515452266', time=2024-03-04T14:54:05.412722+0000, chain.objs.size()=1 2024-03-04T13:00:16.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.637+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.260__shadow_.8IhyVWIuF3maGHE2IHrafHOA6dndXe2_0 2024-03-04T13:00:16.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.637+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.679756171838891889', time=2024-03-04T14:54:09.025914+0000, chain.objs.size()=1 2024-03-04T13:00:16.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.637+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_._6dSCr1DfFaggPsozz6DtOuqUGi7SmP_0 2024-03-04T13:00:16.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.637+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11990591713217276595', time=2024-03-04T14:54:09.028936+0000, chain.objs.size()=1 2024-03-04T13:00:16.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.637+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.ynqshOj-0OIaDVgaKY4kIN6VApHHKM1_0 2024-03-04T13:00:16.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.637+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8155288797694895325', time=2024-03-04T14:54:11.288846+0000, chain.objs.size()=1 2024-03-04T13:00:16.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.637+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.271__shadow_.065_tHjREGlQ5kZhdC61qROQ03peEES_0 2024-03-04T13:00:16.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.637+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17436782646548752751', time=2024-03-04T14:54:29.627300+0000, chain.objs.size()=1 2024-03-04T13:00:16.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.637+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cfitjPoSmVp1ijfGutzn57bu6V2hvdX_0 2024-03-04T13:00:16.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.637+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7997701333910790110', time=2024-03-04T14:54:29.640221+0000, chain.objs.size()=1 2024-03-04T13:00:16.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.637+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wA6PGM80JrAdkTvWlyqMc-75W2N0jgt_0 2024-03-04T13:00:16.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.638+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.956203986775522745', time=2024-03-04T14:54:29.664949+0000, chain.objs.size()=1 2024-03-04T13:00:16.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.638+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3RJd7syUUpF0wEXsS_KHvVvlv1OgpUr_0 2024-03-04T13:00:16.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.638+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16296508319186119447', time=2024-03-04T14:54:29.683238+0000, chain.objs.size()=1 2024-03-04T13:00:16.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.638+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.6KlgyU86xqdmf1O69MVoYCSqttaQJRa_0 2024-03-04T13:00:16.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.638+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3447892188792104199', time=2024-03-04T14:54:29.784566+0000, chain.objs.size()=1 2024-03-04T13:00:16.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.638+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.sYXQENvVYbQoOuMk7aypbqE3IkoTnNS_0 2024-03-04T13:00:16.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.638+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5858466092475741555', time=2024-03-04T14:54:29.809595+0000, chain.objs.size()=1 2024-03-04T13:00:16.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.638+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Neh5LtzKHNk49xrHp9b33Ts-eaN6n3P_0 2024-03-04T13:00:16.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.638+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10738136693126564402', time=2024-03-04T14:54:29.826337+0000, chain.objs.size()=1 2024-03-04T13:00:16.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.638+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.azHIo9u-OBnZ_bspUCcd5dyY_K3pAoe_0 2024-03-04T13:00:16.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.639+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2270840183136728320', time=2024-03-04T14:54:29.828997+0000, chain.objs.size()=1 2024-03-04T13:00:16.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.639+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.WsKrPsWv7zttbhGAgJTXl2wSN6tFQON_0 2024-03-04T13:00:16.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.639+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12533094098032551909', time=2024-03-04T14:54:29.866590+0000, chain.objs.size()=1 2024-03-04T13:00:16.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.639+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ED3BGJlpiHt9Tkli2jDtxsgiO9kAKVE_0 2024-03-04T13:00:16.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.639+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8355362492048774684', time=2024-03-04T14:54:29.952011+0000, chain.objs.size()=1 2024-03-04T13:00:16.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.639+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oeMFd6gMeSbGHsQA5OsSwfA0l6j_KWl_0 2024-03-04T13:00:16.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.639+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13126586641264448854', time=2024-03-04T14:54:29.962154+0000, chain.objs.size()=1 2024-03-04T13:00:16.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.639+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.F13XdaQ0LJU_YXMoG55JjKYC8Ax4-vx_0 2024-03-04T13:00:16.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10105864648989536948', time=2024-03-04T14:54:29.978941+0000, chain.objs.size()=1 2024-03-04T13:00:16.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.htF2-eNldwZ9-vHaupoeqHFzBwkp3SJ_0 2024-03-04T13:00:16.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4449442494485884514', time=2024-03-04T14:54:30.127696+0000, chain.objs.size()=1 2024-03-04T13:00:16.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2NjMQXQmYGqYncSiHm7GddbiPQNB4Vq_0 2024-03-04T13:00:16.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5431150718485425103', time=2024-03-04T14:54:30.131662+0000, chain.objs.size()=1 2024-03-04T13:00:16.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.PssyXSFYOEP5_D4rj2TmA56T-YDQvnS_0 2024-03-04T13:00:16.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17475738768628657051', time=2024-03-04T14:54:30.171004+0000, chain.objs.size()=1 2024-03-04T13:00:16.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.6Hf62p7oG1aAr5JNJhRou9wmsZo8RJz_0 2024-03-04T13:00:16.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14994054177777871487', time=2024-03-04T14:54:30.260119+0000, chain.objs.size()=1 2024-03-04T13:00:16.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ViJ76gJ44wdeVym-8aP1eOCDwNQf18Q_0 2024-03-04T13:00:16.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13066354699615250342', time=2024-03-04T14:54:30.291926+0000, chain.objs.size()=1 2024-03-04T13:00:16.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Yysypu5cTZfpYTyZldAPuFPgY3cCGKF_0 2024-03-04T13:00:16.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14584803846036856856', time=2024-03-04T14:54:30.312887+0000, chain.objs.size()=1 2024-03-04T13:00:16.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.640+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.w00pEA_aGvGGxN7zM__J7t5414gWqEF_0 2024-03-04T13:00:16.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.641+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6118581210828614272', time=2024-03-04T14:54:30.345789+0000, chain.objs.size()=1 2024-03-04T13:00:16.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.641+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ifjNjHzEc3OxyBz7N4Z-wzpuiLd424m_0 2024-03-04T13:00:16.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.642+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1422777202364422703', time=2024-03-04T14:54:30.422430+0000, chain.objs.size()=1 2024-03-04T13:00:16.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.642+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3oAtjnSUjl0Za2_YuKmI-z-TNaS2owI_0 2024-03-04T13:00:16.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.642+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5046291675416058870', time=2024-03-04T14:54:30.468824+0000, chain.objs.size()=1 2024-03-04T13:00:16.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.642+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7tDSP1IzW4KLYo8tSTq9mzQ0SXsxUmw_0 2024-03-04T13:00:16.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.642+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12109829448919442444', time=2024-03-04T14:54:30.631309+0000, chain.objs.size()=1 2024-03-04T13:00:16.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.642+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.82MlOJhlRD0yH9IdP5AtNoTBsMON6DB_0 2024-03-04T13:00:16.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.642+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17343072396910492117', time=2024-03-04T14:54:30.644749+0000, chain.objs.size()=1 2024-03-04T13:00:16.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.642+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.E1lYVPrP2bbnMd4_yi20cjYsJK7iU3b_0 2024-03-04T13:00:16.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.642+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4170801536121491148', time=2024-03-04T14:54:30.645745+0000, chain.objs.size()=1 2024-03-04T13:00:16.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.642+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7fyb9e9fO0XeaPTzhqHMh5NHQfbRvQj_0 2024-03-04T13:00:16.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1533930771395786710', time=2024-03-04T14:54:30.661466+0000, chain.objs.size()=1 2024-03-04T13:00:16.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4hjAB371Z4uy4ySF3nDzxbO7GId5xo5_0 2024-03-04T13:00:16.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18086409790760274338', time=2024-03-04T14:54:30.752549+0000, chain.objs.size()=1 2024-03-04T13:00:16.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.22i8lHztdc6GTFU9YhVxZqb3xGKrr_o_0 2024-03-04T13:00:16.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13425099269584340187', time=2024-03-04T14:54:30.769958+0000, chain.objs.size()=1 2024-03-04T13:00:16.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.keOJYjvX5VZS0VbQX7eZu8CwRxEKQpI_0 2024-03-04T13:00:16.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2485871744284287994', time=2024-03-04T14:54:30.778586+0000, chain.objs.size()=1 2024-03-04T13:00:16.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Lz315_nb2I_v0YB50keUfiz2n-cOP3P_0 2024-03-04T13:00:16.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9752811266608798908', time=2024-03-04T14:54:30.786354+0000, chain.objs.size()=1 2024-03-04T13:00:16.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.DnkHFR7oJWoxzKpKDq69eZ4phk5xJjf_0 2024-03-04T13:00:16.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4342390123034891159', time=2024-03-04T14:54:30.793084+0000, chain.objs.size()=1 2024-03-04T13:00:16.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.xy6IYKvb-KfA9BxdUK6TGfz0mkMgmqB_0 2024-03-04T13:00:16.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6535511979155249939', time=2024-03-04T14:54:30.795456+0000, chain.objs.size()=1 2024-03-04T13:00:16.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Lf67AElzAsZ4QVihjBZJC8CV9M7p6zM_0 2024-03-04T13:00:16.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13605182829267732287', time=2024-03-04T14:54:30.805639+0000, chain.objs.size()=1 2024-03-04T13:00:16.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Yc9P12ia9AuX-jiAy3f49kjuFaPOnE8_0 2024-03-04T13:00:16.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15026996074513747845', time=2024-03-04T14:54:38.312384+0000, chain.objs.size()=1 2024-03-04T13:00:16.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Lk7Fx9R2wbJ8zHpPfPSa9NPPsGgrXvg_0 2024-03-04T13:00:16.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4274631237394983398', time=2024-03-04T14:54:38.331090+0000, chain.objs.size()=1 2024-03-04T13:00:16.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.F4-DZ_UaT2bAuzFfJGhg9sREz0YsoWK_0 2024-03-04T13:00:16.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8450404391685504671', time=2024-03-04T14:54:38.334605+0000, chain.objs.size()=1 2024-03-04T13:00:16.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.644+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.nrLjAMkGN8kt5OyJVez3Yb2uqjgIr-h_0 2024-03-04T13:00:16.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.646+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15883357789464633605', time=2024-03-04T14:54:38.360182+0000, chain.objs.size()=1 2024-03-04T13:00:16.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.646+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.DbwahOIPb6MYrW2CvfDxZpQ3dvpSR6H_0 2024-03-04T13:00:16.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.646+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3632687519089696617', time=2024-03-04T14:54:38.366354+0000, chain.objs.size()=1 2024-03-04T13:00:16.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.646+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5wq6oEG2JusHV5xumlszr-LzAlNGIqo_0 2024-03-04T13:00:16.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.646+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10862945199624180987', time=2024-03-04T14:54:38.472428+0000, chain.objs.size()=1 2024-03-04T13:00:16.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.646+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.4xdmvTYc8sCGvYsyLE72trNNjP5S4oe_0 2024-03-04T13:00:16.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.647+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8002464769090888702', time=2024-03-04T14:54:38.474792+0000, chain.objs.size()=1 2024-03-04T13:00:16.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.647+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.S0hrrMldz8FvAFKr2Um6KwicPqB8yOT_0 2024-03-04T13:00:16.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.647+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10249812310890582329', time=2024-03-04T14:54:38.477424+0000, chain.objs.size()=1 2024-03-04T13:00:16.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.647+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.sjArGbR2TwspM5JawxWGQ4jLQ8Ws4ju_0 2024-03-04T13:00:16.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.647+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15616425750900876541', time=2024-03-04T14:54:38.513954+0000, chain.objs.size()=1 2024-03-04T13:00:16.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.647+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zq3TS2bf4mVOGlU3nL0fCE02dniAWel_0 2024-03-04T13:00:16.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.647+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15999659737427330972', time=2024-03-04T14:54:38.528062+0000, chain.objs.size()=1 2024-03-04T13:00:16.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.647+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.owkSzAQEHzOfPU-2AlDetwqzQxSioWc_0 2024-03-04T13:00:16.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.647+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17981649863157990213', time=2024-03-04T14:54:38.531443+0000, chain.objs.size()=1 2024-03-04T13:00:16.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.647+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VoLlZ2hbS_TDMW-tBDjjNKvjOl9DyKj_0 2024-03-04T13:00:16.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3097518826846865535', time=2024-03-04T14:54:38.665377+0000, chain.objs.size()=1 2024-03-04T13:00:16.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.j9DhnmVRFCi22PnmybjR7KGTv2E8HxI_0 2024-03-04T13:00:16.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15973654357350083790', time=2024-03-04T14:54:38.790142+0000, chain.objs.size()=1 2024-03-04T13:00:16.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HtTiYjw7yO8WWuclxcIx_h6hzeMxKdF_0 2024-03-04T13:00:16.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16911576277628024987', time=2024-03-04T14:54:38.798824+0000, chain.objs.size()=1 2024-03-04T13:00:16.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.WS2McZpGRYuEvnJeDTjV8ltYbSLw7Yf_0 2024-03-04T13:00:16.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.648+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8104740216911438172', time=2024-03-04T14:54:38.801751+0000, chain.objs.size()=1 2024-03-04T13:00:16.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.648+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Jv8FL1dK2JsZDP8GtNVh73W7pgofCbY_0 2024-03-04T13:00:16.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11818442716733128545', time=2024-03-04T14:54:38.826264+0000, chain.objs.size()=1 2024-03-04T13:00:16.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.oh0kF4cak43KYr7epGC_6FiwR_BwQMV_0 2024-03-04T13:00:16.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14844909994280337392', time=2024-03-04T14:54:38.853765+0000, chain.objs.size()=1 2024-03-04T13:00:16.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jFx78D4TkoA7khgYbO8vJ3EtvTvn7Sp_0 2024-03-04T13:00:16.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4031410283914356994', time=2024-03-04T14:54:38.860679+0000, chain.objs.size()=1 2024-03-04T13:00:16.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.sRGwkoPlLe6sUtnfMuXajMJBVS1oiGN_0 2024-03-04T13:00:16.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15290293401988086694', time=2024-03-04T14:54:38.956954+0000, chain.objs.size()=1 2024-03-04T13:00:16.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Cq4O09fmsI51axlRioglxGNzrzW4Zaa_0 2024-03-04T13:00:16.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14446860586812750589', time=2024-03-04T14:54:38.987462+0000, chain.objs.size()=1 2024-03-04T13:00:16.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.bZ5DS2O-Ju2nEGgWsqCPV8oWTP0tJ7l_0 2024-03-04T13:00:16.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2737996049958568038', time=2024-03-04T14:54:39.007173+0000, chain.objs.size()=1 2024-03-04T13:00:16.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-3lY8b1yw1eEnwnM4GMwmIW1fUk6UMY_0 2024-03-04T13:00:16.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12689271693409171346', time=2024-03-04T14:54:39.116743+0000, chain.objs.size()=1 2024-03-04T13:00:16.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.R1-0v6edrLctK6lkkD7B6M3Fkmb6BVY_0 2024-03-04T13:00:16.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10255975594241069807', time=2024-03-04T14:54:39.172911+0000, chain.objs.size()=1 2024-03-04T13:00:16.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eCWYVM8iwtP8thYzJFReVNwMWZbio5f_0 2024-03-04T13:00:16.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1361574519642902824', time=2024-03-04T14:54:39.287776+0000, chain.objs.size()=1 2024-03-04T13:00:16.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.649+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.MUt1Z7Ta2WNLI_-GbK5-idg07TW0HMV_0 2024-03-04T13:00:16.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.650+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6072295663259682657', time=2024-03-04T14:54:39.293879+0000, chain.objs.size()=1 2024-03-04T13:00:16.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.650+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rD9j4rmBPk3wRILT_y5uNi-E_spYxrj_0 2024-03-04T13:00:16.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.650+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14664053729573915032', time=2024-03-04T14:54:39.306384+0000, chain.objs.size()=1 2024-03-04T13:00:16.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.650+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IztzLFQh1WmX9cxgIM7FtsI3as9qEbC_0 2024-03-04T13:00:16.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.651+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15209081935702128898', time=2024-03-04T14:54:39.313792+0000, chain.objs.size()=1 2024-03-04T13:00:16.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.651+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zUyap6CnrPLMFF7OZ8B5-pm3sIKFwaR_0 2024-03-04T13:00:16.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.652+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7404138880949129397', time=2024-03-04T14:54:39.340159+0000, chain.objs.size()=1 2024-03-04T13:00:16.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.652+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ExGyabGzwCRNSPw-OG3IOYF5E90Hh9D_0 2024-03-04T13:00:16.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.652+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9252584633696398755', time=2024-03-04T14:54:39.445384+0000, chain.objs.size()=1 2024-03-04T13:00:16.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.652+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jrbzKFPwTAtNYQ855ClgbNXgumyrsk5_0 2024-03-04T13:00:16.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.652+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1579395651666570763', time=2024-03-04T14:54:39.446127+0000, chain.objs.size()=1 2024-03-04T13:00:16.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.652+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Ey9BEoZ9Xp_h_otvrrIZkjYBuQsZjOG_0 2024-03-04T13:00:16.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.653+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/51071 2024-03-04T13:00:16.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-03-04T13:00:16.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6810888831320901565', time=2024-03-04T14:54:39.457282+0000, chain.objs.size()=1 2024-03-04T13:00:16.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.vbUkJZq-ROgkLnbROx-GNlXracILMc-_0 2024-03-04T13:00:16.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13981519561886356548', time=2024-03-04T14:54:39.480045+0000, chain.objs.size()=1 2024-03-04T13:00:16.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.r1yPPJfvEqLOk4zlQ3m7PLrI30viL8Q_0 2024-03-04T13:00:16.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4575246461933553755', time=2024-03-04T14:54:39.491487+0000, chain.objs.size()=1 2024-03-04T13:00:16.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.i3zcwOPacbqmmcf619MBPrnH9ukL9pv_0 2024-03-04T13:00:16.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17092808537451277658', time=2024-03-04T14:54:40.662457+0000, chain.objs.size()=1 2024-03-04T13:00:16.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.300__shadow_.2Ks0Mrz6ntAJR8D-cdZj1n7fyjywGaS_0 2024-03-04T13:00:16.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14126104187454315318', time=2024-03-04T14:55:02.204846+0000, chain.objs.size()=1 2024-03-04T13:00:16.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.350__shadow_.BT8r-30PPQlgSe47dBI_SEMi8kAGz6V_0 2024-03-04T13:00:16.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6452151236433283064', time=2024-03-04T14:55:41.202715+0000, chain.objs.size()=1 2024-03-04T13:00:16.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.429__shadow_.oWD7QJEbVusY_P5unTsxMkkZk_mNbPK_0 2024-03-04T13:00:16.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.2_36ea1a0074ec32913bb4e35e56534dcb', time=2024-03-04T14:56:03.436173+0000, chain.objs.size()=6 2024-03-04T13:00:16.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.1 2024-03-04T13:00:16.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.2 2024-03-04T13:00:16.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.3 2024-03-04T13:00:16.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.4 2024-03-04T13:00:16.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.5 2024-03-04T13:00:16.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.655+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.6 2024-03-04T13:00:16.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.657+0000 7f4a9ec23640 0 -- 172.21.15.90:0/1356638699 >> [v2:172.21.15.184:6824/1880219084,v1:172.21.15.184:6825/1880219084] conn(0x55bfc952ade0 msgr2=0x55bfc952d210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T13:00:16.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.659+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11351536176861399386', time=2024-03-04T14:56:12.999159+0000, chain.objs.size()=6 2024-03-04T13:00:16.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.659+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.493__multipart_mymultipart.2~J0uYdMSlLg-owWU-j9hnzRSAHoqeI0R.1 2024-03-04T13:00:16.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.659+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.493__shadow_mymultipart.2~J0uYdMSlLg-owWU-j9hnzRSAHoqeI0R.1_1 2024-03-04T13:00:16.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.659+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.493__multipart_mymultipart.2~J0uYdMSlLg-owWU-j9hnzRSAHoqeI0R.2 2024-03-04T13:00:16.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.659+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.493__shadow_mymultipart.2~J0uYdMSlLg-owWU-j9hnzRSAHoqeI0R.2_1 2024-03-04T13:00:16.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.659+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.493__multipart_mymultipart.2~J0uYdMSlLg-owWU-j9hnzRSAHoqeI0R.3 2024-03-04T13:00:16.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.659+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.493__shadow_mymultipart.2~J0uYdMSlLg-owWU-j9hnzRSAHoqeI0R.3_1 2024-03-04T13:00:16.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.659+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17440057344219728687', time=2024-03-04T14:56:17.548298+0000, chain.objs.size()=6 2024-03-04T13:00:16.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.659+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~WMqBlUwrr-i5_eGvJp7i7gjp4nnIwc8.1 2024-03-04T13:00:16.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.659+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.rS-HUUZRYFHDxrfBALE8r4cFBg085Ftw.2 2024-03-04T13:00:16.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.659+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~WMqBlUwrr-i5_eGvJp7i7gjp4nnIwc8.3 2024-03-04T13:00:16.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.660+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~WMqBlUwrr-i5_eGvJp7i7gjp4nnIwc8.4 2024-03-04T13:00:16.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.660+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~WMqBlUwrr-i5_eGvJp7i7gjp4nnIwc8.5 2024-03-04T13:00:16.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.661+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~WMqBlUwrr-i5_eGvJp7i7gjp4nnIwc8.6 2024-03-04T13:00:16.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.662+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~vTp8ayfLDDJ3u3-YETLLwAA9tA1leXQ', time=2024-03-04T14:56:29.941888+0000, chain.objs.size()=1 2024-03-04T13:00:16.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.662+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.503__multipart_mymultipart.2~vTp8ayfLDDJ3u3-YETLLwAA9tA1leXQ.1 2024-03-04T13:00:16.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.662+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9072218896748466554', time=2024-03-04T14:57:16.791740+0000, chain.objs.size()=1 2024-03-04T13:00:16.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.662+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:1gpBxshulY1ydiW1DPtclvGb4bNuJi._.LhKx0VLRe1WiXvqZl0XCYNSk4ZKe4AH_0 2024-03-04T13:00:16.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.662+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5157688779588811695', time=2024-03-04T14:57:21.329391+0000, chain.objs.size()=1 2024-03-04T13:00:16.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.662+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:M5E3P2MDsaO7cp.vwOjKr0fU1t8Gell_.UldwK-2OnyXqIifwIfAG9HnYvilEBSa_0 2024-03-04T13:00:16.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.662+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12607997466422474625', time=2024-03-04T14:57:23.962509+0000, chain.objs.size()=1 2024-03-04T13:00:16.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.662+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.539__shadow:RXlMyT4DwbqTAAMWKUtbf3ikgqVLw3v_.feYgDqV9sxx4F_ECuPBgaMBrya1Qkvm_0 2024-03-04T13:00:16.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12219005470683539229', time=2024-03-04T14:57:30.709697+0000, chain.objs.size()=1 2024-03-04T13:00:16.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.542__shadow:wI2PSUiT-3MivBpmToBzn9mLpa2Sm-l_.CULNNjVy5x3MqG8sZCC7N4Fmq1auq0t_0 2024-03-04T13:00:16.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:jdjxZsdu3lo9t.PKiJuUgyq.gocjLZQ_.RSl-pA00LrsZUB1qD19DFPdP3q6UGJ__1_3450cbb6d0808b4b47fd7bae2d94847c', time=2024-03-04T14:57:48.567000+0000, chain.objs.size()=1 2024-03-04T13:00:16.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:jdjxZsdu3lo9t.PKiJuUgyq.gocjLZQ_.RSl-pA00LrsZUB1qD19DFPdP3q6UGJ__0 2024-03-04T13:00:16.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11303979779326806948', time=2024-03-04T14:57:51.603880+0000, chain.objs.size()=1 2024-03-04T13:00:16.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.552__shadow:F1yMHbqYhCPZA41hndEcSgoO97ADvFj_.EpHGocq447He6nDCO0jAatfPBtjd2vA_0 2024-03-04T13:00:16.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.663+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.986722575280084959', time=2024-03-04T14:58:48.260510+0000, chain.objs.size()=1 2024-03-04T13:00:16.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.663+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.667__shadow_.5zQP2pibiFdX23wg-mu6fVk3H9fD4a4_0 2024-03-04T13:00:16.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.665+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.665+0000 7f4a9ec23640 0 -- 172.21.15.90:0/1356638699 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x55bfc9526ad0 msgr2=0x7f496807f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T13:00:16.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.667+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T13:00:16.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.668+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.668+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41415' 2024-03-04T13:00:16.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9965134960682485155', time=2024-03-04T14:52:52.625699+0000, chain.objs.size()=1 2024-03-04T13:00:16.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.146__shadow_.d2ttIqWP5gQc3cbVg604BuFLHuwKjjY_0 2024-03-04T13:00:16.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16583467609818227034', time=2024-03-04T14:52:55.282816+0000, chain.objs.size()=1 2024-03-04T13:00:16.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.150__shadow:5vgIgIlE.e7eEQP5.bNyob-BzTocJDZ_.GqL0TBohkxTlNrH7sbap3S5Xqtbi-qU_0 2024-03-04T13:00:16.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5673135504132723440', time=2024-03-04T14:52:57.020856+0000, chain.objs.size()=1 2024-03-04T13:00:16.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.vKoJ-mEKFE0o9v1FkvUx_wKrueSkTYj_0 2024-03-04T13:00:16.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3108228445966639217', time=2024-03-04T14:52:57.648576+0000, chain.objs.size()=3 2024-03-04T13:00:16.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.DfmH9zgnL9I1iOAyEamtqWyvwcXbl7v_0 2024-03-04T13:00:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.DfmH9zgnL9I1iOAyEamtqWyvwcXbl7v_1 2024-03-04T13:00:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.DfmH9zgnL9I1iOAyEamtqWyvwcXbl7v_2 2024-03-04T13:00:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14483322674881404837', time=2024-03-04T14:53:39.554577+0000, chain.objs.size()=1 2024-03-04T13:00:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.223__shadow_.c5X8QSWNH7IdJNl96V5WzSrAtwhAQ___0 2024-03-04T13:00:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16052868560167115371', time=2024-03-04T14:53:52.055660+0000, chain.objs.size()=1 2024-03-04T13:00:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.7uT6UUDBMYzv64jjRG7iDe3QiNid8le_0 2024-03-04T13:00:16.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2581059946684396318', time=2024-03-04T14:53:52.056799+0000, chain.objs.size()=1 2024-03-04T13:00:16.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.X35X6uSPOc-4Q0ln7hejmoWvyj0WYvc_0 2024-03-04T13:00:16.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.271992133751484400', time=2024-03-04T14:53:52.057566+0000, chain.objs.size()=1 2024-03-04T13:00:16.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.UKxrt1jTwrFGwKvWbRVXQOpGNCixebM_0 2024-03-04T13:00:16.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12315343904391347919', time=2024-03-04T14:53:52.077672+0000, chain.objs.size()=1 2024-03-04T13:00:16.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.AuczCcD1-AyA05w0pZgDgaqcUQ7Lcr__0 2024-03-04T13:00:16.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5129224732685291724', time=2024-03-04T14:53:52.216214+0000, chain.objs.size()=1 2024-03-04T13:00:16.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.669+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.kscgspwxqpCxCH3rXUZZ62SrkOgDQP7_0 2024-03-04T13:00:16.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.671+0000 7f4a9ec23640 0 -- 172.21.15.90:0/1356638699 >> [v2:172.21.15.90:6808/2300499759,v1:172.21.15.90:6809/2300499759] conn(0x55bfc952ade0 msgr2=0x7f496808c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T13:00:16.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.671+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10374178595504898536', time=2024-03-04T14:53:52.292897+0000, chain.objs.size()=1 2024-03-04T13:00:16.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.671+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.y4UOH44XOFfohkeXt95PlhPiZb9JMZB_0 2024-03-04T13:00:16.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.671+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12913799452167958005', time=2024-03-04T14:53:52.295698+0000, chain.objs.size()=1 2024-03-04T13:00:16.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.671+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.BcpP9RDVV9WWz1A4ozon4tdO2uT2JCD_0 2024-03-04T13:00:16.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.672+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4988581848494050644', time=2024-03-04T14:53:52.400115+0000, chain.objs.size()=1 2024-03-04T13:00:16.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.672+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.bhLrw7dI8fIOuNgXP9-PTU_PvchRXPd_0 2024-03-04T13:00:16.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8954746700626346408', time=2024-03-04T14:53:52.416766+0000, chain.objs.size()=1 2024-03-04T13:00:16.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.H21VVXy9lcnVnqHXGGh_888gM6IoXjM_0 2024-03-04T13:00:16.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7460499497761464089', time=2024-03-04T14:53:52.478782+0000, chain.objs.size()=1 2024-03-04T13:00:16.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.J0-gohzIgfOwLdxiQFz5MFiQ2h3qH0v_0 2024-03-04T13:00:16.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14725841906818974443', time=2024-03-04T14:53:52.484763+0000, chain.objs.size()=1 2024-03-04T13:00:16.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.r6QN8eCJDkJJVGj8AySnEjHPXlcYWra_0 2024-03-04T13:00:16.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12023096799770994135', time=2024-03-04T14:53:52.596710+0000, chain.objs.size()=1 2024-03-04T13:00:16.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jch2LR-wc_ow2TIk4ots3vcJfvaYaWG_0 2024-03-04T13:00:16.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13645891247292371833', time=2024-03-04T14:53:52.657902+0000, chain.objs.size()=1 2024-03-04T13:00:16.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.aL0PVbTY4z24RCEzb51utf_kMiZSxgs_0 2024-03-04T13:00:16.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3272161238862149979', time=2024-03-04T14:53:52.753990+0000, chain.objs.size()=1 2024-03-04T13:00:16.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.pufdj_A4r5e4BnAeJ9nURByoXdjXrp3_0 2024-03-04T13:00:16.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16663879692683010145', time=2024-03-04T14:53:52.911257+0000, chain.objs.size()=1 2024-03-04T13:00:16.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0ovhuVbhwIHP8qTK-unhj5UCUErIzlB_0 2024-03-04T13:00:16.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17117013362953592972', time=2024-03-04T14:53:52.912465+0000, chain.objs.size()=1 2024-03-04T13:00:16.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YpYPqzAt3kcSNPRXJ66dLUtXyN1JuKq_0 2024-03-04T13:00:16.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9222916663678818899', time=2024-03-04T14:53:52.984860+0000, chain.objs.size()=1 2024-03-04T13:00:16.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yeukEk48owOT22g7kcwG1CuOExlEOPv_0 2024-03-04T13:00:16.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2897620022782394849', time=2024-03-04T14:53:52.988212+0000, chain.objs.size()=1 2024-03-04T13:00:16.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.673+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.B--t-XAv4hT4fEUbdwfxWVOP1IXtGZi_0 2024-03-04T13:00:16.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10303046386088193555', time=2024-03-04T14:53:53.081781+0000, chain.objs.size()=1 2024-03-04T13:00:16.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.53gQYABNonYkRDRG-2oK-1UJ45J1m0q_0 2024-03-04T13:00:16.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13639550397866928050', time=2024-03-04T14:53:53.087600+0000, chain.objs.size()=1 2024-03-04T13:00:16.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.nfNUssik1b3DTdY_VYhWMoad_LhRUo5_0 2024-03-04T13:00:16.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10263331191318134639', time=2024-03-04T14:53:53.117818+0000, chain.objs.size()=1 2024-03-04T13:00:16.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.MtJ3CZsETBw2pG5UbrzS7PzYC7zyQ03_0 2024-03-04T13:00:16.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1903253859876995493', time=2024-03-04T14:53:53.132309+0000, chain.objs.size()=1 2024-03-04T13:00:16.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VrGi9spMRfxuiDZX6vw-Cmh0X9ptzwS_0 2024-03-04T13:00:16.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1008083536799822456', time=2024-03-04T14:53:53.158634+0000, chain.objs.size()=1 2024-03-04T13:00:16.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.coSSZxPZxXDBcO70hOKJuP81PngndRc_0 2024-03-04T13:00:16.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10622986621456914399', time=2024-03-04T14:53:53.287675+0000, chain.objs.size()=1 2024-03-04T13:00:16.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8HhaspCfCgfPJvsz_uvCBAFecO2_Hx7_0 2024-03-04T13:00:16.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8247528670952889647', time=2024-03-04T14:53:53.322916+0000, chain.objs.size()=1 2024-03-04T13:00:16.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.IicFvmvlTQnwW4W7_by0oAHZdrPFzjk_0 2024-03-04T13:00:16.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5353225065332787971', time=2024-03-04T14:53:53.328373+0000, chain.objs.size()=1 2024-03-04T13:00:16.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.4Oia1c4qcnmVf5tbKXlbfs66qy6nLoM_0 2024-03-04T13:00:16.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14269785795524238529', time=2024-03-04T14:54:01.859024+0000, chain.objs.size()=1 2024-03-04T13:00:16.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.252__shadow_.LoOdn6e2fRRNlN4rkpVRDG1_GFVntS-_0 2024-03-04T13:00:16.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12810455889162029983', time=2024-03-04T14:54:08.240002+0000, chain.objs.size()=1 2024-03-04T13:00:16.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_._Vy0uW4HQFvh4zrcq03IFmvj1hjgk0v_0 2024-03-04T13:00:16.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8914565015070334149', time=2024-03-04T14:54:08.250204+0000, chain.objs.size()=1 2024-03-04T13:00:16.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.676+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.QENW9lQ7MWcWgRi_ozYZy1AviVNPPpk_0 2024-03-04T13:00:16.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.677+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11821656605781277333', time=2024-03-04T14:54:11.288407+0000, chain.objs.size()=1 2024-03-04T13:00:16.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.677+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.271__shadow_.Y05mUa3CF2nLcWjm2-r4nsM-Ua5GjdX_0 2024-03-04T13:00:16.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.678+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13278453808091545043', time=2024-03-04T14:54:29.678865+0000, chain.objs.size()=1 2024-03-04T13:00:16.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.678+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LFgOwxwERJLSTqZzKc8cKh6NGXdsspa_0 2024-03-04T13:00:16.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.678+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7422463510905706211', time=2024-03-04T14:54:29.679504+0000, chain.objs.size()=1 2024-03-04T13:00:16.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.678+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.s92jI8W6CUkwUSDaBeR6GsVMzoTutaB_0 2024-03-04T13:00:16.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.678+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8205346062587179261', time=2024-03-04T14:54:29.686456+0000, chain.objs.size()=1 2024-03-04T13:00:16.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.678+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.eRaZ5FaAgxr-wIz7ydA3W81iP5eQUe7_0 2024-03-04T13:00:16.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.678+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1578060724582393326', time=2024-03-04T14:54:29.799266+0000, chain.objs.size()=1 2024-03-04T13:00:16.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.678+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2x3OzvUOJAv-kSjIjiaP2EzZsYMUPzi_0 2024-03-04T13:00:16.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.680+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497284086989022886', time=2024-03-04T14:54:29.850521+0000, chain.objs.size()=1 2024-03-04T13:00:16.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.680+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.XVnPBvTnwCoKfa3Pfz3P21vEaCWNthb_0 2024-03-04T13:00:16.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.680+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16557852522915843043', time=2024-03-04T14:54:29.861062+0000, chain.objs.size()=1 2024-03-04T13:00:16.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.680+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.s4GBmqEv2-au8kWPiw9BHqiFytRdgxw_0 2024-03-04T13:00:16.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.680+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9053242229819296744', time=2024-03-04T14:54:29.954504+0000, chain.objs.size()=1 2024-03-04T13:00:16.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.680+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2SHD7L_W49xtHkd7r5sF74Ma2f0ix2i_0 2024-03-04T13:00:16.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.680+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10920296765488099776', time=2024-03-04T14:54:29.956659+0000, chain.objs.size()=1 2024-03-04T13:00:16.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.680+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HJnvOiY-KNTkrB-P7HSell4uFzW6gut_0 2024-03-04T13:00:16.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.680+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3364530194077373225', time=2024-03-04T14:54:29.967003+0000, chain.objs.size()=1 2024-03-04T13:00:16.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.680+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5DyEoWusOt5DAv2I9PHtp_rv8xCUkG0_0 2024-03-04T13:00:16.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.680+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11873039877040856944', time=2024-03-04T14:54:30.120944+0000, chain.objs.size()=1 2024-03-04T13:00:16.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.680+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.dUCS2Nx6hDCcm-gjGznF2FD3zlyUlk1_0 2024-03-04T13:00:16.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.681+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4769119611656602440', time=2024-03-04T14:54:30.170452+0000, chain.objs.size()=1 2024-03-04T13:00:16.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.681+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.iqAZ7MqL65-oFBNJ1-JmH359RODF6ny_0 2024-03-04T13:00:16.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.681+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9379354622010393669', time=2024-03-04T14:54:30.263073+0000, chain.objs.size()=1 2024-03-04T13:00:16.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.681+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.XekFhaCvCrhFdJzTc4HETD-4nBIRpLZ_0 2024-03-04T13:00:16.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.681+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17607717373261691975', time=2024-03-04T14:54:30.280752+0000, chain.objs.size()=1 2024-03-04T13:00:16.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.681+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.bXu8XaZP-tJ6ALQItLpQheb0JO66sJM_0 2024-03-04T13:00:16.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.681+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9550266589513531999', time=2024-03-04T14:54:30.294889+0000, chain.objs.size()=1 2024-03-04T13:00:16.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.681+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3tmvEg0sLRsmTS_NsEGvbLpPhiTvOUp_0 2024-03-04T13:00:16.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.681+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6277188159650339854', time=2024-03-04T14:54:30.324814+0000, chain.objs.size()=1 2024-03-04T13:00:16.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.681+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0UkKMXvveiWeLNRI23TuhwWCFtECtB8_0 2024-03-04T13:00:16.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.683+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1244972739814441244', time=2024-03-04T14:54:30.341875+0000, chain.objs.size()=1 2024-03-04T13:00:16.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.683+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.1W_fcuaL2tjwKR1AX2l9T5x5suFQwVm_0 2024-03-04T13:00:16.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.683+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10196891502321569284', time=2024-03-04T14:54:30.460095+0000, chain.objs.size()=1 2024-03-04T13:00:16.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.683+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FfVoFGK6thvo2-KNp6byrisxkv23t4D_0 2024-03-04T13:00:16.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.683+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10519274251018172257', time=2024-03-04T14:54:30.493568+0000, chain.objs.size()=1 2024-03-04T13:00:16.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.683+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ckPldBu8x3ShPtgCNA4hyzD-U8KNplI_0 2024-03-04T13:00:16.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3560574320728508553', time=2024-03-04T14:54:30.579924+0000, chain.objs.size()=1 2024-03-04T13:00:16.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oH8NzLIDUumxf1fsuHkyPqsmnBY1Eos_0 2024-03-04T13:00:16.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6690157167601018159', time=2024-03-04T14:54:30.591148+0000, chain.objs.size()=1 2024-03-04T13:00:16.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Hi7LBWdP4Y7HwnXGmmwbG3N_t6JjOUt_0 2024-03-04T13:00:16.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18395218189092640817', time=2024-03-04T14:54:30.596079+0000, chain.objs.size()=1 2024-03-04T13:00:16.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.AXsUI2_Fz0dIxAKflaKuBao_Z1qxa51_0 2024-03-04T13:00:16.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3074041752740614638', time=2024-03-04T14:54:30.622860+0000, chain.objs.size()=1 2024-03-04T13:00:16.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.n7JTW7AvFCBCrD_0PXSUSVdkJiz2Odi_0 2024-03-04T13:00:16.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11710167094664015112', time=2024-03-04T14:54:30.646111+0000, chain.objs.size()=1 2024-03-04T13:00:16.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.dfS2pVsVm2c5Hj5lGQp4A-d5zgJrWrx_0 2024-03-04T13:00:16.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7837611484486156320', time=2024-03-04T14:54:30.744615+0000, chain.objs.size()=1 2024-03-04T13:00:16.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7aGYdRIbCMP_qbtrlsIWRGuFPBnkK99_0 2024-03-04T13:00:16.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14650039023504255011', time=2024-03-04T14:54:30.767177+0000, chain.objs.size()=1 2024-03-04T13:00:16.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.XhYMSgjU3EgclEHEYBlDHVY9DvjI7ha_0 2024-03-04T13:00:16.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13708583636045735477', time=2024-03-04T14:54:30.788716+0000, chain.objs.size()=1 2024-03-04T13:00:16.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.685+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.bJQO_TDWchqXw97lXRVpsyAbD1y3yUc_0 2024-03-04T13:00:16.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.686+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16247020073193899627', time=2024-03-04T14:54:38.339790+0000, chain.objs.size()=1 2024-03-04T13:00:16.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.686+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._l_f6MEwyaiM9Sk0fvVyyzGuPeOS4XO_0 2024-03-04T13:00:16.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.686+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16494689593190688504', time=2024-03-04T14:54:38.349433+0000, chain.objs.size()=1 2024-03-04T13:00:16.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.686+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.axSKJY2PYPPna6nIS4fxfND4JfI0Ccu_0 2024-03-04T13:00:16.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.686+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8727930269029629181', time=2024-03-04T14:54:38.360528+0000, chain.objs.size()=1 2024-03-04T13:00:16.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.686+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7AIo9BNNMeKAckaAtfr8Jx17E-X8ykM_0 2024-03-04T13:00:16.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.690+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7555708097120875007', time=2024-03-04T14:54:38.373389+0000, chain.objs.size()=1 2024-03-04T13:00:16.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.690+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.P2GhhvZj-F78rkE3pGVRcAbJ8VlOfKx_0 2024-03-04T13:00:16.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.690+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8061882335618250136', time=2024-03-04T14:54:38.379357+0000, chain.objs.size()=1 2024-03-04T13:00:16.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.690+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.bCGDS3mdq47nCWgNtkumjYIAA7ntjXy_0 2024-03-04T13:00:16.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.690+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9652423600536581260', time=2024-03-04T14:54:38.478478+0000, chain.objs.size()=1 2024-03-04T13:00:16.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.690+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.fsKLqgb1H6a2WFP5M9_hoOa0Vu-4BAR_0 2024-03-04T13:00:16.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8612994977470302326', time=2024-03-04T14:54:38.486152+0000, chain.objs.size()=1 2024-03-04T13:00:16.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.PTZQYAUMildLgol9e5hJmseeX7IskC1_0 2024-03-04T13:00:16.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4355512482536266578', time=2024-03-04T14:54:38.499098+0000, chain.objs.size()=1 2024-03-04T13:00:16.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.K61wRqmii1BbMw2EhK4Ppa1wY3pxXI1_0 2024-03-04T13:00:16.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16072426259113866573', time=2024-03-04T14:54:38.624133+0000, chain.objs.size()=1 2024-03-04T13:00:16.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.T3blCJtcRFZT-U3pIGcS51qR_azV6n2_0 2024-03-04T13:00:16.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14958005915194044404', time=2024-03-04T14:54:38.633153+0000, chain.objs.size()=1 2024-03-04T13:00:16.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.8M1efaWuduejJigfpm-sWwliQvL8Lhj_0 2024-03-04T13:00:16.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8417316563703845151', time=2024-03-04T14:54:38.648125+0000, chain.objs.size()=1 2024-03-04T13:00:16.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.JXyz7zO9fHftQiBuD32laQ057DpnqzS_0 2024-03-04T13:00:16.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5232057482643416936', time=2024-03-04T14:54:38.688848+0000, chain.objs.size()=1 2024-03-04T13:00:16.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kMUJuC6a2XGzZLpajN4ZxAX1ilZBDQa_0 2024-03-04T13:00:16.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2335533090969704927', time=2024-03-04T14:54:38.689953+0000, chain.objs.size()=1 2024-03-04T13:00:16.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.fhImjN61lE0uJ7DSRIIxkW3Qovp3eDN_0 2024-03-04T13:00:16.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4204324428367458003', time=2024-03-04T14:54:38.786254+0000, chain.objs.size()=1 2024-03-04T13:00:16.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.691+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2TBpzTZrHgUKiB_txwIu6VVvoeJmnuT_0 2024-03-04T13:00:16.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12685953197466456475', time=2024-03-04T14:54:38.795539+0000, chain.objs.size()=1 2024-03-04T13:00:16.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.dhkOMJ0mCyVQvEy6kVrMR8RlUzd5n2f_0 2024-03-04T13:00:16.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8592945344152247443', time=2024-03-04T14:54:38.807097+0000, chain.objs.size()=1 2024-03-04T13:00:16.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pmwcznQJtQkWfvfTvt9pR6EEGP1NZ3G_0 2024-03-04T13:00:16.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11308138008076707921', time=2024-03-04T14:54:38.819030+0000, chain.objs.size()=1 2024-03-04T13:00:16.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.I_kjfrnGoclmlx9z3PA0UwSt4z4Rhzg_0 2024-03-04T13:00:16.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1688274218847888000', time=2024-03-04T14:54:38.823330+0000, chain.objs.size()=1 2024-03-04T13:00:16.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.w3ZL6UjA8qSyN9gS2QP0nZacXYM0M7h_0 2024-03-04T13:00:16.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6538509410895221786', time=2024-03-04T14:54:38.824065+0000, chain.objs.size()=1 2024-03-04T13:00:16.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.AOQM8aiBqBQpLvsj7L6fudKtzi4Vtm-_0 2024-03-04T13:00:16.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.620851632432283502', time=2024-03-04T14:54:38.842201+0000, chain.objs.size()=1 2024-03-04T13:00:16.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zZ9zFnleEaBjm-WgQTnCQrxpLFDjmb6_0 2024-03-04T13:00:16.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3265416955706571098', time=2024-03-04T14:54:38.945791+0000, chain.objs.size()=1 2024-03-04T13:00:16.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iqXWlLSUGDQKEOIcGpCkCN14qg6CelB_0 2024-03-04T13:00:16.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14618091823208253235', time=2024-03-04T14:54:38.964574+0000, chain.objs.size()=1 2024-03-04T13:00:16.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Qeio9fy1NXClfQuGQYTrMpXr9HuRjfI_0 2024-03-04T13:00:16.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10190318843107210063', time=2024-03-04T14:54:38.973875+0000, chain.objs.size()=1 2024-03-04T13:00:16.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.SKNkATDWD9zGdoGheX9ieR2QZVrm_oj_0 2024-03-04T13:00:16.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7319744773894131222', time=2024-03-04T14:54:38.999728+0000, chain.objs.size()=1 2024-03-04T13:00:16.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ZFnvTA-xcTGwihzEouNHZ_j5E4wSSr3_0 2024-03-04T13:00:16.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13824372413005149446', time=2024-03-04T14:54:39.000562+0000, chain.objs.size()=1 2024-03-04T13:00:16.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.693+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.p12LHinRvlyIk-LArEBrod_2VtnnfhR_0 2024-03-04T13:00:16.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.694+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17483859378382129497', time=2024-03-04T14:54:39.110087+0000, chain.objs.size()=1 2024-03-04T13:00:16.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.694+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eKp9e022uaqZuw2Efo1W5LCMVxvR9ug_0 2024-03-04T13:00:16.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13754424736920897406', time=2024-03-04T14:54:39.170530+0000, chain.objs.size()=1 2024-03-04T13:00:16.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7zkoqBrm88IpRMkeg3bYmo8TM1lD8_n_0 2024-03-04T13:00:16.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5512035947240048598', time=2024-03-04T14:54:39.179087+0000, chain.objs.size()=1 2024-03-04T13:00:16.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Yao6P4wS9qExSZNqOXve4qviMlB3laU_0 2024-03-04T13:00:16.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8912568829646635340', time=2024-03-04T14:54:39.264002+0000, chain.objs.size()=1 2024-03-04T13:00:16.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.3lQoCr_lIzs3VqcfaWPW5O2FMy64sBk_0 2024-03-04T13:00:16.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1293172468354773410', time=2024-03-04T14:54:39.274315+0000, chain.objs.size()=1 2024-03-04T13:00:16.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.3hqxM9H6eRN3uTyPJ7jisSP5GGMQlXG_0 2024-03-04T13:00:16.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11784841281805593668', time=2024-03-04T14:54:39.297841+0000, chain.objs.size()=1 2024-03-04T13:00:16.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.GsiRqj8ecWSH-ZpVJpqRGMcT8NRbvxB_0 2024-03-04T13:00:16.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6020658660526546578', time=2024-03-04T14:54:39.320182+0000, chain.objs.size()=1 2024-03-04T13:00:16.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.bJB0m010IqK8dj2jo24qsN_4AEl4exU_0 2024-03-04T13:00:16.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11965034475682095518', time=2024-03-04T14:54:39.420298+0000, chain.objs.size()=1 2024-03-04T13:00:16.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.T1KUVVJmpiUn2GiwtjCLwdLvDNGDzEx_0 2024-03-04T13:00:16.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17647522305633197208', time=2024-03-04T14:54:39.444753+0000, chain.objs.size()=1 2024-03-04T13:00:16.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.a1KE0WEBq1XNCT-Ljzk8ctB0780pnw4_0 2024-03-04T13:00:16.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5014976213918368334', time=2024-03-04T14:54:45.794030+0000, chain.objs.size()=1 2024-03-04T13:00:16.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.312__shadow_.L-1hhw46RQ5vlyeMJHO-7BkzPNE1Pey_0 2024-03-04T13:00:16.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6513983585615160232', time=2024-03-04T14:55:32.699252+0000, chain.objs.size()=1 2024-03-04T13:00:16.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.695+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.414__shadow_.EWjcXKGk6JvQ-iS1enJFyBQYdjFtiSy_0 2024-03-04T13:00:16.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.696+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.468__shadow_.j1kJNVhlQpaf2oZoslh_QnR-bEoQZDx_1_3d2d393ef5e4a22628233870afcf0ad6', time=2024-03-04T14:55:57.870866+0000, chain.objs.size()=1 2024-03-04T13:00:16.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.696+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.468__shadow_.j1kJNVhlQpaf2oZoslh_QnR-bEoQZDx_0 2024-03-04T13:00:16.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.697+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8676561559970621363', time=2024-03-04T14:55:59.081311+0000, chain.objs.size()=1 2024-03-04T13:00:16.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.697+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.471__shadow_.dtEaJqaVcIi7WQMXzqmwRFwUV188M8M_0 2024-03-04T13:00:16.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.697+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9875902704759111259', time=2024-03-04T14:57:19.010181+0000, chain.objs.size()=1 2024-03-04T13:00:16.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.697+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:ogaE4D3uzA4HtA87Nwu7INBXBdmmXBd_.RCuBHX4vB0CEVQJkNlXziaZWyzyTsdL_0 2024-03-04T13:00:16.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.698+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/41415 2024-03-04T13:00:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.701+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T13:00:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.701+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4789669792970277987', time=2024-03-04T14:57:28.189253+0000, chain.objs.size()=1 2024-03-04T13:00:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.701+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.542__shadow:vrerT9ECn0xs48myGadW6rlS4-dX9js_.ksbmiJTv6bj7D9bvp71ApKrj1ofL0I3_0 2024-03-04T13:00:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.701+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7639342570988100333', time=2024-03-04T14:57:58.672291+0000, chain.objs.size()=1 2024-03-04T13:00:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.701+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.570__shadow_.vhbfjqMd1fXybdmFZ4ENw8o27MQCtWn_0 2024-03-04T13:00:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.701+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16428408159945039690', time=2024-03-04T14:58:32.792568+0000, chain.objs.size()=1 2024-03-04T13:00:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.701+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.627__shadow_.3-nuRnE9S6v6R-oMTulcrhFiHNRynqL_0 2024-03-04T13:00:16.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.779+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.781+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T13:00:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.782+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.783+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42745' 2024-03-04T13:00:16.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7437570212365782144', time=2024-03-04T14:52:55.834146+0000, chain.objs.size()=1 2024-03-04T13:00:16.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.151__shadow_.ee6y-7EiLVECrlLB1NJS-strHfx-2JO_0 2024-03-04T13:00:16.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9490269275173843261', time=2024-03-04T14:53:31.627717+0000, chain.objs.size()=1 2024-03-04T13:00:16.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.208__shadow_.xEhIMVohb5t8QeI30yMWxKFRUEHFbum_0 2024-03-04T13:00:16.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8305304984488939559', time=2024-03-04T14:53:33.626873+0000, chain.objs.size()=1 2024-03-04T13:00:16.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.211__shadow_.g6V_iz3y_MZVLZkQR_OsgnX_mrbVovm_0 2024-03-04T13:00:16.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.715720123554934192', time=2024-03-04T14:53:43.969273+0000, chain.objs.size()=1 2024-03-04T13:00:16.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.233__shadow_.VLe7LNBk04qFMa35gouN4zGlgkAZ2wY_0 2024-03-04T13:00:16.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10759431363454835048', time=2024-03-04T14:53:52.044116+0000, chain.objs.size()=1 2024-03-04T13:00:16.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CElMTLDi96m6BeaM64sCx6z-xr3KpCe_0 2024-03-04T13:00:16.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18081680217367318650', time=2024-03-04T14:53:52.070057+0000, chain.objs.size()=1 2024-03-04T13:00:16.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.NJ0Pfl0HFo4k8MgmGpzt9rQDzd98yzZ_0 2024-03-04T13:00:16.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4599437193390396030', time=2024-03-04T14:53:52.101605+0000, chain.objs.size()=1 2024-03-04T13:00:16.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Y0N8RuGck9UvFZ-QY2cnus-f0a1fQrD_0 2024-03-04T13:00:16.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7458589255305894340', time=2024-03-04T14:53:52.131622+0000, chain.objs.size()=1 2024-03-04T13:00:16.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.pnE5RHy3I7DaA87PFGmV_UWz3IPr-4P_0 2024-03-04T13:00:16.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14018214606509168136', time=2024-03-04T14:53:52.232669+0000, chain.objs.size()=1 2024-03-04T13:00:16.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.eoOhmkiIZB9DA15tAvryk5stGh7mpsC_0 2024-03-04T13:00:16.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8312480966775599118', time=2024-03-04T14:53:52.233531+0000, chain.objs.size()=1 2024-03-04T13:00:16.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.2ATG_-HTFYaCamS1bIgirwd22mRTmL-_0 2024-03-04T13:00:16.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8676277050520589305', time=2024-03-04T14:53:52.241988+0000, chain.objs.size()=1 2024-03-04T13:00:16.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.j48shiywP-lX4dA3PrZFAVFlYjUJ6Ry_0 2024-03-04T13:00:16.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14140364492413299490', time=2024-03-04T14:53:52.243916+0000, chain.objs.size()=1 2024-03-04T13:00:16.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.784+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YSO0M9yeF8YX3amNOgN3-KB9GCTjQUq_0 2024-03-04T13:00:16.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.785+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5116112296783509618', time=2024-03-04T14:53:52.260679+0000, chain.objs.size()=1 2024-03-04T13:00:16.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.785+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5xRQQvlkFjnfbLkbL5otmZ-n7LbhL3O_0 2024-03-04T13:00:16.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3050486060790263058', time=2024-03-04T14:53:52.308961+0000, chain.objs.size()=1 2024-03-04T13:00:16.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.AqoXha_bbZ_q7yzuJxvwGxCpmQviM5X_0 2024-03-04T13:00:16.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15233093243496123023', time=2024-03-04T14:53:52.398435+0000, chain.objs.size()=1 2024-03-04T13:00:16.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8rNa3MT1NkY2spCXVSaNCkpOwS22MyE_0 2024-03-04T13:00:16.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4690473235876900366', time=2024-03-04T14:53:52.421627+0000, chain.objs.size()=1 2024-03-04T13:00:16.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.92n3vsPOLNJzuWMScxgzbPEXL2tn4nZ_0 2024-03-04T13:00:16.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14407485002059346805', time=2024-03-04T14:53:52.474471+0000, chain.objs.size()=1 2024-03-04T13:00:16.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.M4HP5Tn9WyhDGnFZNaVEEjmU-gqUO7r_0 2024-03-04T13:00:16.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1188030156821811299', time=2024-03-04T14:53:52.571411+0000, chain.objs.size()=1 2024-03-04T13:00:16.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.v__hCAy5DZn0dvDxfsmI5Tylvt5Zwnc_0 2024-03-04T13:00:16.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13289583605002485864', time=2024-03-04T14:53:52.585628+0000, chain.objs.size()=1 2024-03-04T13:00:16.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.MQsM7di7TNmOZ_mnoWTWatzTt0GXI_c_0 2024-03-04T13:00:16.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9785621165081831168', time=2024-03-04T14:53:52.599227+0000, chain.objs.size()=1 2024-03-04T13:00:16.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.4N5ulSwjxKkg2rMzZokKLIM6CD3c_fv_0 2024-03-04T13:00:16.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.879126787429411348', time=2024-03-04T14:53:52.618023+0000, chain.objs.size()=1 2024-03-04T13:00:16.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Ofw6L9WhQNWdEQ0gkLsKNWT4_EiJDl1_0 2024-03-04T13:00:16.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12417962851351872904', time=2024-03-04T14:53:52.621477+0000, chain.objs.size()=1 2024-03-04T13:00:16.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Vx8_g1_5jyVpJilrXoHe6QyRDFl_Wgv_0 2024-03-04T13:00:16.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1574365681615214917', time=2024-03-04T14:53:52.639302+0000, chain.objs.size()=1 2024-03-04T13:00:16.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.786+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.SW8zvJPJfmj2HTqVUOx6Lp8-0ouVTG3_0 2024-03-04T13:00:16.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.787+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14669273115607726837', time=2024-03-04T14:53:52.915842+0000, chain.objs.size()=1 2024-03-04T13:00:16.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.787+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.2gNRkN24kmbKZxTyLN6gzXxK6plN5QP_0 2024-03-04T13:00:16.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9208049900296873009', time=2024-03-04T14:53:52.924376+0000, chain.objs.size()=1 2024-03-04T13:00:16.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zvaAl1GVOfYRyelSsIEgyE2j49G72PE_0 2024-03-04T13:00:16.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11604502498135847071', time=2024-03-04T14:53:52.928581+0000, chain.objs.size()=1 2024-03-04T13:00:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.onpXtA94WK4A0qko-rdIRAncqN7pUnE_0 2024-03-04T13:00:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1166797727499186758', time=2024-03-04T14:53:52.962327+0000, chain.objs.size()=1 2024-03-04T13:00:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.kRFX_HuDwayJ67Om1QQ2XmHmrFKFRs6_0 2024-03-04T13:00:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2674639160139998992', time=2024-03-04T14:53:52.986832+0000, chain.objs.size()=1 2024-03-04T13:00:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.cM0BlkijwCsXFW-ENbbFtBEmHeR2Bzp_0 2024-03-04T13:00:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12334341780034974751', time=2024-03-04T14:53:53.093932+0000, chain.objs.size()=1 2024-03-04T13:00:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.69dcGPA46SZxB9NR1SYylx6uCp_SJMG_0 2024-03-04T13:00:16.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.788+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2111467006153338726', time=2024-03-04T14:53:53.096938+0000, chain.objs.size()=1 2024-03-04T13:00:16.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.788+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.2DWuz5krpoSML-9obFAfZ9up99mnZQh_0 2024-03-04T13:00:16.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.789+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15977199408148105608', time=2024-03-04T14:53:53.103998+0000, chain.objs.size()=1 2024-03-04T13:00:16.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.789+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.7Sv5h6Ue5Tx2nGb9E2Vt8ypjkywzNsm_0 2024-03-04T13:00:16.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.789+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11863006651843797378', time=2024-03-04T14:53:53.124397+0000, chain.objs.size()=1 2024-03-04T13:00:16.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.789+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wnTPYfywVY-yeE_pSw8GYJuFW-nNtZn_0 2024-03-04T13:00:16.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.789+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11666095005877131387', time=2024-03-04T14:53:53.127318+0000, chain.objs.size()=1 2024-03-04T13:00:16.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.789+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yjILViBjgoB7OmqW3hZ5SDCOgTL8vml_0 2024-03-04T13:00:16.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.789+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17129847461321644942', time=2024-03-04T14:53:53.136923+0000, chain.objs.size()=1 2024-03-04T13:00:16.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.789+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yHNrdz0Y5i-wQcUmyd76GO6bpRKn-BV_0 2024-03-04T13:00:16.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.789+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9486148928331933208', time=2024-03-04T14:53:53.145952+0000, chain.objs.size()=1 2024-03-04T13:00:16.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.789+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HGBYQqeqFLILEtFDaWL6OYJ5P-boIa-_0 2024-03-04T13:00:16.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12443198863621776982', time=2024-03-04T14:53:53.175753+0000, chain.objs.size()=1 2024-03-04T13:00:16.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.foARptFRTHr8_7zTVL-5lMuF3MUv6hR_0 2024-03-04T13:00:16.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6213938543921916323', time=2024-03-04T14:53:53.266408+0000, chain.objs.size()=1 2024-03-04T13:00:16.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yj7CMrYogJb2wtJdw8_nw6OLiNnTQo5_0 2024-03-04T13:00:16.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5398780209342612520', time=2024-03-04T14:53:53.272182+0000, chain.objs.size()=1 2024-03-04T13:00:16.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.K96mMIBbZilNFwJt6414QI6fL_ot8Em_0 2024-03-04T13:00:16.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10918742720342684131', time=2024-03-04T14:53:53.318404+0000, chain.objs.size()=1 2024-03-04T13:00:16.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.BFjPwyync2dnZNrhrYgjsXZbgDjC-uD_0 2024-03-04T13:00:16.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.256419267925540786', time=2024-03-04T14:54:08.239139+0000, chain.objs.size()=1 2024-03-04T13:00:16.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.EHohubAq-8CWgOAsT4H-y302JGoILk8_0 2024-03-04T13:00:16.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14300025941267531604', time=2024-03-04T14:54:08.241631+0000, chain.objs.size()=1 2024-03-04T13:00:16.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.ije3Gqz1s5tPsXzTZsAx9Eh2fs63gjE_0 2024-03-04T13:00:16.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15654926289349645091', time=2024-03-04T14:54:08.250834+0000, chain.objs.size()=1 2024-03-04T13:00:16.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.s3KUFPLXqILwjRNurHTFpCjpFiLkHqf_0 2024-03-04T13:00:16.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10265215098975632443', time=2024-03-04T14:54:15.038506+0000, chain.objs.size()=1 2024-03-04T13:00:16.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.279__shadow_.Vxl75LUNn0oD8z5FMF5b_SC-G2WkB_k_0 2024-03-04T13:00:16.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6433016764728325455', time=2024-03-04T14:54:15.738915+0000, chain.objs.size()=1 2024-03-04T13:00:16.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.280__shadow:SQQDrf9Ws1Zo0D2NbfifwXgzXAczfNM_.nnEQS-aGX7cLGbT5nTqMu-fbt8wNkQx_0 2024-03-04T13:00:16.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5276528392329462715', time=2024-03-04T14:54:29.681219+0000, chain.objs.size()=1 2024-03-04T13:00:16.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.sU0_U4IusQNfhuzyBtciexRlbf3Kk4J_0 2024-03-04T13:00:16.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7775398342671420033', time=2024-03-04T14:54:29.783493+0000, chain.objs.size()=1 2024-03-04T13:00:16.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.791+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.vNopTwdm1m5ukhJ8inxcEdz1AjklRZM_0 2024-03-04T13:00:16.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15555727034995681696', time=2024-03-04T14:54:29.842154+0000, chain.objs.size()=1 2024-03-04T13:00:16.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.8TevZeHJE3_gGRgJeZzrgIh6yTugC8s_0 2024-03-04T13:00:16.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16018232584076284144', time=2024-03-04T14:54:29.847788+0000, chain.objs.size()=1 2024-03-04T13:00:16.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.mRCQ6nSlRoFkk6h5C95zU3OgHNECT_U_0 2024-03-04T13:00:16.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14860454803012845755', time=2024-03-04T14:54:29.862351+0000, chain.objs.size()=1 2024-03-04T13:00:16.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ZCP3CHc--6AokW0Mfri3MiOsHl69WdA_0 2024-03-04T13:00:16.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16547705327722242314', time=2024-03-04T14:54:29.980423+0000, chain.objs.size()=1 2024-03-04T13:00:16.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lkxtp7x6jX5BkopKzTYPLr3uoEOnV8t_0 2024-03-04T13:00:16.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12178065966577636906', time=2024-03-04T14:54:29.996292+0000, chain.objs.size()=1 2024-03-04T13:00:16.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LI-Rfqf1wjDbiR3fgCDbtzyKYPuMLBF_0 2024-03-04T13:00:16.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.429743988695283571', time=2024-03-04T14:54:30.022829+0000, chain.objs.size()=1 2024-03-04T13:00:16.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lBtFsdSabaxK3tVmdS20HpvMbSKDUd1_0 2024-03-04T13:00:16.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3276772461357623578', time=2024-03-04T14:54:30.116148+0000, chain.objs.size()=1 2024-03-04T13:00:16.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.q7yvO0Mj7niNSxbiw_hW_DiJV4SXnXR_0 2024-03-04T13:00:16.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14347118873844342588', time=2024-03-04T14:54:30.123799+0000, chain.objs.size()=1 2024-03-04T13:00:16.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.EROp4YKLQFIC6b8OQ8Ih9uTk8OvV2-n_0 2024-03-04T13:00:16.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7320353158624999281', time=2024-03-04T14:54:30.127358+0000, chain.objs.size()=1 2024-03-04T13:00:16.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oeFWRLh39wYvPOpzT8oVPYArjVRfWIE_0 2024-03-04T13:00:16.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14983672851347382433', time=2024-03-04T14:54:30.140330+0000, chain.objs.size()=1 2024-03-04T13:00:16.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.6e9LgtPfZxZUNgDQJaWYZR_t5uXpFtz_0 2024-03-04T13:00:16.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.113678750389201177', time=2024-03-04T14:54:30.152489+0000, chain.objs.size()=1 2024-03-04T13:00:16.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.793+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Jj1KI71K_W12rCb4xl0b_FdxZkchesK_0 2024-03-04T13:00:16.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.795+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5726482950174249442', time=2024-03-04T14:54:30.276689+0000, chain.objs.size()=1 2024-03-04T13:00:16.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.795+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.dO8OObi2uus5jk2nDI07MFsrWUiqNih_0 2024-03-04T13:00:16.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.795+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3809108213952698060', time=2024-03-04T14:54:30.295543+0000, chain.objs.size()=1 2024-03-04T13:00:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.795+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.t7RBKvw2eO8A2LtbHQOfKzVbTx8m0cS_0 2024-03-04T13:00:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.795+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9859931797576670030', time=2024-03-04T14:54:30.304505+0000, chain.objs.size()=1 2024-03-04T13:00:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.795+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.UEULIXyrsVRFa-F0hhuMnNGFNl9TR_l_0 2024-03-04T13:00:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.795+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15925216591269522486', time=2024-03-04T14:54:30.346790+0000, chain.objs.size()=1 2024-03-04T13:00:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.795+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.srYiw5HkdK3Do8U7CC1n2mpVdAA7ej__0 2024-03-04T13:00:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.795+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6086052153874857152', time=2024-03-04T14:54:30.450398+0000, chain.objs.size()=1 2024-03-04T13:00:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.795+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7r5NjP6U-oCn0XjtZq-jjZWSe5meCqW_0 2024-03-04T13:00:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2530335011016221546', time=2024-03-04T14:54:30.490831+0000, chain.objs.size()=1 2024-03-04T13:00:16.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.jvmDBl2Z1WHjGBYPSOwq_5uScRolxI6_0 2024-03-04T13:00:16.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6797390788090261520', time=2024-03-04T14:54:30.507065+0000, chain.objs.size()=1 2024-03-04T13:00:16.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RlT2VQ-A_Q1JjVQlmjCro2oidtVoGl-_0 2024-03-04T13:00:16.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16042821120664574204', time=2024-03-04T14:54:30.584197+0000, chain.objs.size()=1 2024-03-04T13:00:16.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.AVRJGKgU8Y5YKoPCxjnY--STMHvETgD_0 2024-03-04T13:00:16.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5242129562566172631', time=2024-03-04T14:54:30.600005+0000, chain.objs.size()=1 2024-03-04T13:00:16.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.dkQBXiVWYU6MnGe5NogK2qaJynQzqgh_0 2024-03-04T13:00:16.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15811236254506703801', time=2024-03-04T14:54:30.602174+0000, chain.objs.size()=1 2024-03-04T13:00:16.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3xUoGfRGndAi1AfI20qB0naTd5fp4Mt_0 2024-03-04T13:00:16.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17883811634461226370', time=2024-03-04T14:54:30.606597+0000, chain.objs.size()=1 2024-03-04T13:00:16.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.OH-5biOqa_ENfayF35RIc7GNJtFxytW_0 2024-03-04T13:00:16.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15385480107580379277', time=2024-03-04T14:54:30.628785+0000, chain.objs.size()=1 2024-03-04T13:00:16.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.796+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.AU-WA_eh1JiZaLB7A1tUZC54XSeiynF_0 2024-03-04T13:00:16.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.797+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10806207129542208397', time=2024-03-04T14:54:30.629429+0000, chain.objs.size()=1 2024-03-04T13:00:16.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.797+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7JqiuPckyNQ4fMmz3kagKGZgwOVTvgU_0 2024-03-04T13:00:16.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.797+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6470747752832229202', time=2024-03-04T14:54:30.653735+0000, chain.objs.size()=1 2024-03-04T13:00:16.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.797+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.GMi-bjVG4dwICZbQW8sxtaMnPF4Zs1h_0 2024-03-04T13:00:16.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.797+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5435555761609906625', time=2024-03-04T14:54:30.765615+0000, chain.objs.size()=1 2024-03-04T13:00:16.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.797+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.bh-p5-uAWe3etOvMhpujeyoaTbnPBsH_0 2024-03-04T13:00:16.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18289781951320143437', time=2024-03-04T14:54:30.777743+0000, chain.objs.size()=1 2024-03-04T13:00:16.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0RO2KLQ0dq_jHLdAxF0dk3JpaYr8pQ7_0 2024-03-04T13:00:16.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.360968399030842078', time=2024-03-04T14:54:38.330873+0000, chain.objs.size()=1 2024-03-04T13:00:16.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.BBLurOZKlmDRJopcZcbUw23Je0NKbMa_0 2024-03-04T13:00:16.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9626883061964922711', time=2024-03-04T14:54:38.362986+0000, chain.objs.size()=1 2024-03-04T13:00:16.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gaFmbb0ALi1_YT6ea_Jk6vgcFf3jXLi_0 2024-03-04T13:00:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18200398466267368828', time=2024-03-04T14:54:38.370419+0000, chain.objs.size()=1 2024-03-04T13:00:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ls8ZRBzBJ0TOHOn-9toEZ1edCxONHKQ_0 2024-03-04T13:00:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8246749336595944170', time=2024-03-04T14:54:38.469038+0000, chain.objs.size()=1 2024-03-04T13:00:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.9AkZsbtqanm1KGFq3j86gUqY09STswE_0 2024-03-04T13:00:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2643839221158587889', time=2024-03-04T14:54:38.472377+0000, chain.objs.size()=1 2024-03-04T13:00:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.SbdRBZQBBpcaMIGUrsbzDutVnmIRTaF_0 2024-03-04T13:00:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16276995159398763465', time=2024-03-04T14:54:38.488708+0000, chain.objs.size()=1 2024-03-04T13:00:16.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.25JzzuYnb2r6qKlTkj6d-NIZJokxQl0_0 2024-03-04T13:00:16.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2830905857457930658', time=2024-03-04T14:54:38.523123+0000, chain.objs.size()=1 2024-03-04T13:00:16.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0ZUsDujMtFVsviaNO6Mykt0LJFdDxyQ_0 2024-03-04T13:00:16.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14990824809546474281', time=2024-03-04T14:54:38.524400+0000, chain.objs.size()=1 2024-03-04T13:00:16.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.798+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.vwcGx4nzM7XZywr6pWTM5hUrK4toIXi_0 2024-03-04T13:00:16.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.799+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12776533583306792852', time=2024-03-04T14:54:38.533362+0000, chain.objs.size()=1 2024-03-04T13:00:16.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.799+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VC6_U5W_rwijRfaRX78s9wQMnJS-Mo7_0 2024-03-04T13:00:16.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.799+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11193130891217230028', time=2024-03-04T14:54:38.537237+0000, chain.objs.size()=1 2024-03-04T13:00:16.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.799+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.EYkUTKEAJJ_MgzfY4QHw0HWKm0prqwa_0 2024-03-04T13:00:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16535226958509245694', time=2024-03-04T14:54:38.636738+0000, chain.objs.size()=1 2024-03-04T13:00:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.TkIt4wUCenigwMAQ3YrFiJyQ2x_v46a_0 2024-03-04T13:00:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3612233036838708109', time=2024-03-04T14:54:38.689079+0000, chain.objs.size()=1 2024-03-04T13:00:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iUz0CX5NeN6QFVt2F5x4uVVHutAhrI__0 2024-03-04T13:00:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13654403814533558545', time=2024-03-04T14:54:38.692042+0000, chain.objs.size()=1 2024-03-04T13:00:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.CxGsqwKRWmrZR2IGEi9PznrkYj_JGez_0 2024-03-04T13:00:16.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16981125626738219163', time=2024-03-04T14:54:38.784039+0000, chain.objs.size()=1 2024-03-04T13:00:16.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.R63JrOT026w4UqB39P9_zyGCMatDihD_0 2024-03-04T13:00:16.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7918644143441895977', time=2024-03-04T14:54:38.796325+0000, chain.objs.size()=1 2024-03-04T13:00:16.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.N9CV4lhZmpTEWaaHC7HpLW0_FSegWyw_0 2024-03-04T13:00:16.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11192364933640606288', time=2024-03-04T14:54:38.802121+0000, chain.objs.size()=1 2024-03-04T13:00:16.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.TS8bJ9RNwWfhJfOsmwYmWaCof8xi2iS_0 2024-03-04T13:00:16.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1057325962710188272', time=2024-03-04T14:54:38.854279+0000, chain.objs.size()=1 2024-03-04T13:00:16.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IQ-2fczXVGT8XFAdhsKOE8duTr-TMvq_0 2024-03-04T13:00:16.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11018417920927061816', time=2024-03-04T14:54:38.985709+0000, chain.objs.size()=1 2024-03-04T13:00:16.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.d2hqmJwQtICWK-rNc0_7T8xogkzTjPr_0 2024-03-04T13:00:16.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10810498962885309118', time=2024-03-04T14:54:38.992353+0000, chain.objs.size()=1 2024-03-04T13:00:16.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.800+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.LmINaSd1MMITzeF-r6I0ylOqVTs-INA_0 2024-03-04T13:00:16.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.801+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14844161253214845353', time=2024-03-04T14:54:39.004152+0000, chain.objs.size()=1 2024-03-04T13:00:16.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.801+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7F3aRViXxZHySueRxV9-ll3A5AKSaxk_0 2024-03-04T13:00:16.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.801+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4818250644570953887', time=2024-03-04T14:54:39.137507+0000, chain.objs.size()=1 2024-03-04T13:00:16.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.801+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.MtUFpvHP3D4BwrPpvSHRpFvsRAPQctS_0 2024-03-04T13:00:16.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.801+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13741111228404183651', time=2024-03-04T14:54:39.167438+0000, chain.objs.size()=1 2024-03-04T13:00:16.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.801+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.3YhSPmj7bDd3iU--mKgT--ZcDp20BUd_0 2024-03-04T13:00:16.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.802+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13308394347456621470', time=2024-03-04T14:54:39.168914+0000, chain.objs.size()=1 2024-03-04T13:00:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.802+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.GVfNEZI5k4sWTmu08mhixg_H_FovwaI_0 2024-03-04T13:00:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.802+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14608754813363105781', time=2024-03-04T14:54:39.296635+0000, chain.objs.size()=1 2024-03-04T13:00:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.802+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ic4IHIaFhKh0J3ZX6iey__g8FX0AnRS_0 2024-03-04T13:00:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.802+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6981187152717061986', time=2024-03-04T14:54:39.316893+0000, chain.objs.size()=1 2024-03-04T13:00:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.802+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.oosc9YLlqBVlZZ6KEaxfnu-ugEh2ix2_0 2024-03-04T13:00:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.802+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1884107748719582624', time=2024-03-04T14:54:39.438991+0000, chain.objs.size()=1 2024-03-04T13:00:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.802+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.s-xlEIzLRZZFZdiAWxpEzUh-idSac_W_0 2024-03-04T13:00:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.802+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15178679722394632013', time=2024-03-04T14:54:39.457207+0000, chain.objs.size()=1 2024-03-04T13:00:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.802+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.NRCeJMNP9lIuL9pifOf0tzWvZpVntDH_0 2024-03-04T13:00:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.808+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/42745 2024-03-04T13:00:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.810+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-03-04T13:00:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17280947914651974741', time=2024-03-04T14:54:39.464425+0000, chain.objs.size()=1 2024-03-04T13:00:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wVzR9pxITHnWTj3FsyRUyPSxmx2LdLB_0 2024-03-04T13:00:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13734795251328986514', time=2024-03-04T14:54:39.491824+0000, chain.objs.size()=1 2024-03-04T13:00:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cBEUKvf5fl4o7HFziN3CS6kr5Axlvha_0 2024-03-04T13:00:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15989024761128302664', time=2024-03-04T14:55:52.267213+0000, chain.objs.size()=1 2024-03-04T13:00:16.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.455__shadow_.58Dyc7WK1LuS6vyyIYbIvsoxB2n9tIB_0 2024-03-04T13:00:16.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2615445068952294903', time=2024-03-04T14:56:01.001488+0000, chain.objs.size()=1 2024-03-04T13:00:16.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.475__shadow:uVjDMegxP6XYWgvybwvxI64cJu5z7Q0_.3EygMS0MkBsJBGyX0Po4m4qYgkDoKJC_0 2024-03-04T13:00:16.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14316617226970870897', time=2024-03-04T14:56:23.660154+0000, chain.objs.size()=3 2024-03-04T13:00:16.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~eFPBkZx6Y7Ndz8O-wgQ5eItQ3-mZIwy.1 2024-03-04T13:00:16.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~eFPBkZx6Y7Ndz8O-wgQ5eItQ3-mZIwy.2 2024-03-04T13:00:16.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~eFPBkZx6Y7Ndz8O-wgQ5eItQ3-mZIwy.3 2024-03-04T13:00:16.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11833092238969232149', time=2024-03-04T14:56:26.530379+0000, chain.objs.size()=4 2024-03-04T13:00:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~OFQtStAgri7m9jLHBUk37lEGItOVaxV.1 2024-03-04T13:00:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__shadow_mymultipart.2~OFQtStAgri7m9jLHBUk37lEGItOVaxV.1_1 2024-03-04T13:00:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~OFQtStAgri7m9jLHBUk37lEGItOVaxV.2 2024-03-04T13:00:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__shadow_mymultipart.2~OFQtStAgri7m9jLHBUk37lEGItOVaxV.2_1 2024-03-04T13:00:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5528082944658523717', time=2024-03-04T14:57:17.789081+0000, chain.objs.size()=1 2024-03-04T13:00:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.811+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:6QC08TU.dKl5UEOyVKDW3nHvd0KxGwB_.Q-Ai9XnmhrL1Vs_bjzY4aaH5_4Mt43P_0 2024-03-04T13:00:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.812+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1693831161887938675', time=2024-03-04T14:57:31.640718+0000, chain.objs.size()=1 2024-03-04T13:00:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.812+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:bQ6dgfig0EdfXoeHrzdtw1rr6qny1bo_.-6s2ROkcwCTYoutLN9gS1XJhvcpBpMa_0 2024-03-04T13:00:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.813+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5320377364409281552', time=2024-03-04T14:57:33.937470+0000, chain.objs.size()=1 2024-03-04T13:00:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.813+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:pbmqlV1pLJJysFRGmf8OwigSWRflXs0_.5fuOLxl9NT1faGmdyjUEeOjKX-nnXNE_0 2024-03-04T13:00:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.813+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.763300122119505100', time=2024-03-04T14:57:34.516632+0000, chain.objs.size()=1 2024-03-04T13:00:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.813+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:QXpBB5B6070O70eEI1AhnO3F9H.9W8M_.-PNbcRIuFp3_cy39B6hwG9-8-6zM9x-_0 2024-03-04T13:00:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7341583723917230618', time=2024-03-04T14:57:48.456663+0000, chain.objs.size()=1 2024-03-04T13:00:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:jdjxZsdu3lo9t.PKiJuUgyq.gocjLZQ_.RSl-pA00LrsZUB1qD19DFPdP3q6UGJ__0 2024-03-04T13:00:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3396709914984940382', time=2024-03-04T14:57:51.001374+0000, chain.objs.size()=1 2024-03-04T13:00:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.551__shadow:YzBQhF6HVBrw547G-9TSDLDydRXvCAG_.sw5NJB9r9a9jc-Uw3rspR_QMNhWGSDX_0 2024-03-04T13:00:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17543848757707644400', time=2024-03-04T14:57:55.594431+0000, chain.objs.size()=1 2024-03-04T13:00:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.562__shadow_.Zgaq6Bf_MThW-o5AI9lGbHjS8XqQSRG_0 2024-03-04T13:00:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB', time=2024-03-04T14:58:13.476788+0000, chain.objs.size()=12 2024-03-04T13:00:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.588__multipart_multipart_enc.2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB.1 2024-03-04T13:00:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.588__shadow_multipart_enc.2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB.1_1 2024-03-04T13:00:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.588__multipart_multipart_enc.2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB.2 2024-03-04T13:00:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.588__shadow_multipart_enc.2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB.2_1 2024-03-04T13:00:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.588__multipart_multipart_enc.2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB.3 2024-03-04T13:00:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.814+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.588__shadow_multipart_enc.2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB.3_1 2024-03-04T13:00:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.816+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.588__multipart_multipart_enc.2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB.4 2024-03-04T13:00:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.817+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.588__shadow_multipart_enc.2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB.4_1 2024-03-04T13:00:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.588__multipart_multipart_enc.2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB.5 2024-03-04T13:00:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.588__shadow_multipart_enc.2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB.5_1 2024-03-04T13:00:16.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.588__multipart_multipart_enc.2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB.6 2024-03-04T13:00:16.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.588__shadow_multipart_enc.2~en7NIkOMt1Ggej9a71nAk1WpBm2UasB.6_1 2024-03-04T13:00:16.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.818+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14744918494796705084', time=2024-03-04T14:58:22.039806+0000, chain.objs.size()=1 2024-03-04T13:00:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.818+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.607__shadow_.xDTBJcbXu4T-n2bNdNDWhU3Llkc3sDj_0 2024-03-04T13:00:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.821+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2881565223494757175', time=2024-03-04T14:58:23.657827+0000, chain.objs.size()=1 2024-03-04T13:00:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.821+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.610__shadow_.0S7TsSwyjFNWjv6i8zS345dsqvFyprF_0 2024-03-04T13:00:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.822+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.824+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T13:00:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.825+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.826+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48329' 2024-03-04T13:00:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6772895985601760810', time=2024-03-04T14:53:32.819275+0000, chain.objs.size()=1 2024-03-04T13:00:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.210__shadow_.Y7_lOU1uTSiCS0T7DYpDESwqIppfuRS_0 2024-03-04T13:00:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14176767790509552410', time=2024-03-04T14:53:43.515528+0000, chain.objs.size()=1 2024-03-04T13:00:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.232__shadow_.zeGpXnIBt1xdh1YUC1Hw2--gNsdjVgN_0 2024-03-04T13:00:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7720006985156127750', time=2024-03-04T14:53:52.045317+0000, chain.objs.size()=1 2024-03-04T13:00:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yvtqtjyIz_YYcicwn70FUBvjAWgLlX0_0 2024-03-04T13:00:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14333329421244698190', time=2024-03-04T14:53:52.233185+0000, chain.objs.size()=1 2024-03-04T13:00:16.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JdOb0CqNSHLuSGciBHSXnpEMNsuPBDn_0 2024-03-04T13:00:16.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15856328620758875050', time=2024-03-04T14:53:52.274604+0000, chain.objs.size()=1 2024-03-04T13:00:16.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.bh1s8XA35ek3Xe3W04k2ii_Qr1R_FnD_0 2024-03-04T13:00:16.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12784256149556284036', time=2024-03-04T14:53:52.281166+0000, chain.objs.size()=1 2024-03-04T13:00:16.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Lf_8lZ21aNyZenC1Zw6HOsqf9ZTnoTz_0 2024-03-04T13:00:16.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8840639734351799319', time=2024-03-04T14:53:52.284794+0000, chain.objs.size()=1 2024-03-04T13:00:16.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.6VHlwyPSqSaf2A2EPrIt7q78kXFDE7n_0 2024-03-04T13:00:16.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.371797636073348313', time=2024-03-04T14:53:52.314688+0000, chain.objs.size()=1 2024-03-04T13:00:16.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.M0uQK0JF7mBf8zJNG1go1MREPf1lSoq_0 2024-03-04T13:00:16.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10970793887865702143', time=2024-03-04T14:53:52.439958+0000, chain.objs.size()=1 2024-03-04T13:00:16.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.elTp05_jWmb_f5NK-cKEhTsGYvOs21O_0 2024-03-04T13:00:16.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11950134000838038434', time=2024-03-04T14:53:52.441680+0000, chain.objs.size()=1 2024-03-04T13:00:16.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.f0KjdH0T39Zp6IAoKz8L25YN_C3EXqi_0 2024-03-04T13:00:16.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3535499192750041876', time=2024-03-04T14:53:52.454314+0000, chain.objs.size()=1 2024-03-04T13:00:16.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8-H6Gr-bKmyREu-9vZSwkAAEiyG-qkX_0 2024-03-04T13:00:16.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.606285087466183365', time=2024-03-04T14:53:52.464252+0000, chain.objs.size()=1 2024-03-04T13:00:16.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.827+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yhv0csvdswYuypmYJtEds3gUvV5oGgg_0 2024-03-04T13:00:16.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.381346058748108611', time=2024-03-04T14:53:52.590039+0000, chain.objs.size()=1 2024-03-04T13:00:16.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HkGFvVKRIlgv-CHQFH7FwiJ6hK_mxg-_0 2024-03-04T13:00:16.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1595691507880057687', time=2024-03-04T14:53:52.744349+0000, chain.objs.size()=1 2024-03-04T13:00:16.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.6E2KxaLhzbZm9XCuw1_K9ERH6Qc_Q7l_0 2024-03-04T13:00:16.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15526284389315666025', time=2024-03-04T14:53:52.762143+0000, chain.objs.size()=1 2024-03-04T13:00:16.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.DtqQYGLfdhc3PPrs-vNRQslGBcZpBmI_0 2024-03-04T13:00:16.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7546704506048576686', time=2024-03-04T14:53:52.763617+0000, chain.objs.size()=1 2024-03-04T13:00:16.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.dcSJgu0l9fDs7gZsX3C1V0ZlJFPL8YB_0 2024-03-04T13:00:16.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3083728394987031375', time=2024-03-04T14:53:52.780626+0000, chain.objs.size()=1 2024-03-04T13:00:16.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.NgDVPiaMUcXzeYpzgswNqioT_MgXtUk_0 2024-03-04T13:00:16.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.375219839107956266', time=2024-03-04T14:53:52.791542+0000, chain.objs.size()=1 2024-03-04T13:00:16.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.B5KuaZej5Ez77Iolq-5Sb4zms_fVBH-_0 2024-03-04T13:00:16.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5862658056310275511', time=2024-03-04T14:53:52.794159+0000, chain.objs.size()=1 2024-03-04T13:00:16.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Uj0yq1k04sAXIUlvF4RX1Jtugd6hfQF_0 2024-03-04T13:00:16.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7136636938715121581', time=2024-03-04T14:53:52.810257+0000, chain.objs.size()=1 2024-03-04T13:00:16.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.829+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.OSIkZgpUqei7JrsNEPFVEEgfURa9zie_0 2024-03-04T13:00:16.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.831+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4681107913385780560', time=2024-03-04T14:53:52.935919+0000, chain.objs.size()=1 2024-03-04T13:00:16.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.831+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.eD7ay1pqIz3WozY6Z0f1oNfhMV295xx_0 2024-03-04T13:00:16.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.831+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5809928403199085355', time=2024-03-04T14:53:52.957788+0000, chain.objs.size()=1 2024-03-04T13:00:16.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.831+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LOKgzjwbMTV-DWzjvq9io1t1V4QLPy3_0 2024-03-04T13:00:16.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.831+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17071451935357442945', time=2024-03-04T14:53:52.998296+0000, chain.objs.size()=1 2024-03-04T13:00:16.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.831+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ZeUtFzT8WMVtm0ZpPALJCPOiM2GaGOm_0 2024-03-04T13:00:16.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.832+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13586619221165727921', time=2024-03-04T14:53:53.110654+0000, chain.objs.size()=1 2024-03-04T13:00:16.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.832+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.7rfJSdP7JBNtzTeR-eAnhJqp11pqKD6_0 2024-03-04T13:00:16.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12824563182566237452', time=2024-03-04T14:53:53.131673+0000, chain.objs.size()=1 2024-03-04T13:00:16.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.OuKgbII3GaDrN7m7GIN4V3X_AEB9Ols_0 2024-03-04T13:00:16.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12293545735401850993', time=2024-03-04T14:53:53.293799+0000, chain.objs.size()=1 2024-03-04T13:00:16.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HddZ-tJqnyGNCHVd_LCrpbdog-Ub8t7_0 2024-03-04T13:00:16.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4643381757157896063', time=2024-03-04T14:53:53.307801+0000, chain.objs.size()=1 2024-03-04T13:00:16.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.BLGANSdTAWme-1sLfCb9YEIa3hqq6-0_0 2024-03-04T13:00:16.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14956524608036489128', time=2024-03-04T14:53:53.323223+0000, chain.objs.size()=1 2024-03-04T13:00:16.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.FZ1B0S9CobdmriA_IGryjFzQ5kAHjUN_0 2024-03-04T13:00:16.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10275710004557613826', time=2024-03-04T14:53:56.562137+0000, chain.objs.size()=1 2024-03-04T13:00:16.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.240__shadow_.B8vJZ9g61kCNf5OtSP4IpzxiPJY09Zk_0 2024-03-04T13:00:16.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9464617584126237885', time=2024-03-04T14:54:02.680610+0000, chain.objs.size()=1 2024-03-04T13:00:16.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.254__shadow_.axmtSdFPEerqOooRHd_Slqu9ULbd6DG_0 2024-03-04T13:00:16.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1548637904626542945', time=2024-03-04T14:54:04.014334+0000, chain.objs.size()=1 2024-03-04T13:00:16.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.834+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.257__shadow_.-vbIiDxFOU2GcYDddizqHo5Dn67CPdB_0 2024-03-04T13:00:16.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17555115532934979826', time=2024-03-04T14:54:04.015082+0000, chain.objs.size()=1 2024-03-04T13:00:16.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.257__shadow_.wI6EkL2COK0by8c-uyk9vrMZgcDedhu_0 2024-03-04T13:00:16.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11681356104029776208', time=2024-03-04T14:54:08.241808+0000, chain.objs.size()=1 2024-03-04T13:00:16.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.AHqBuoKoB6YuRM2Wu8oA-08yB3a_ISb_0 2024-03-04T13:00:16.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1864069424138913239', time=2024-03-04T14:54:08.248508+0000, chain.objs.size()=1 2024-03-04T13:00:16.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.ziTxbyj5wDrXuc1KdnqkrgY5F5LA93D_0 2024-03-04T13:00:16.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.835+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14229285060120908160', time=2024-03-04T14:54:11.289079+0000, chain.objs.size()=1 2024-03-04T13:00:16.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.835+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.271__shadow_.tK7qugOs_I_FTbFsTfIOsbIyLz7crEU_0 2024-03-04T13:00:16.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.837+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3999515976554512608', time=2024-03-04T14:54:20.803293+0000, chain.objs.size()=1 2024-03-04T13:00:16.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.837+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.292__shadow:p2wzwq.WUPL5o.VYRk7868UYsfRx5W9_.4tqLVSt1yJ85xkxwySBTE2e_hlhL1HI_0 2024-03-04T13:00:16.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12425510671194485766', time=2024-03-04T14:54:29.616637+0000, chain.objs.size()=1 2024-03-04T13:00:16.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_._sP2Vd-M4e4w1lCZzN-jVaO2QjU3Do-_0 2024-03-04T13:00:16.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12201629494757141483', time=2024-03-04T14:54:29.620199+0000, chain.objs.size()=1 2024-03-04T13:00:16.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RIGdfar5S1AZxlYorfosyIcGGaBTDRq_0 2024-03-04T13:00:16.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15278282318136194221', time=2024-03-04T14:54:29.631684+0000, chain.objs.size()=1 2024-03-04T13:00:16.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.eKcjOUk6izZ33tw-8pDH2s0XIhrRgUo_0 2024-03-04T13:00:16.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9654988356032749508', time=2024-03-04T14:54:29.659474+0000, chain.objs.size()=1 2024-03-04T13:00:16.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.KoJ17BNb5KTGBwfEvfQM-aOHbSpH37n_0 2024-03-04T13:00:16.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10942123036668524660', time=2024-03-04T14:54:29.660249+0000, chain.objs.size()=1 2024-03-04T13:00:16.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_._AkRSzcCzmvt6o_1_3ggzB00Ok8KXqX_0 2024-03-04T13:00:16.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14007606278543261105', time=2024-03-04T14:54:29.678178+0000, chain.objs.size()=1 2024-03-04T13:00:16.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.NIMos9mP19k6Uum3qZxEKzaLf8vCzm0_0 2024-03-04T13:00:16.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8952052622652881694', time=2024-03-04T14:54:29.822353+0000, chain.objs.size()=1 2024-03-04T13:00:16.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.hqCb0SFS_sLvqbjLeRxNtSZOHQ46ikG_0 2024-03-04T13:00:16.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11641249986867221372', time=2024-03-04T14:54:29.940819+0000, chain.objs.size()=1 2024-03-04T13:00:16.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.gGupU9QpXlbGl6XpzMDTfkAap_uqMde_0 2024-03-04T13:00:16.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11905131848932397262', time=2024-03-04T14:54:29.944930+0000, chain.objs.size()=1 2024-03-04T13:00:16.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Qn9dbFoI6rKfFMsCMyizxc2TsZ45zC0_0 2024-03-04T13:00:16.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10587636826952957819', time=2024-03-04T14:54:29.963830+0000, chain.objs.size()=1 2024-03-04T13:00:16.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.BiOd5JXF5kOthog7c9oYEWDegXPjivo_0 2024-03-04T13:00:16.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.485740675048316100', time=2024-03-04T14:54:29.972441+0000, chain.objs.size()=1 2024-03-04T13:00:16.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.838+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7aszn7nZ8JkDnpMV5n4Il7ZxrESIW5U_0 2024-03-04T13:00:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.840+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17750987468704775902', time=2024-03-04T14:54:29.976721+0000, chain.objs.size()=1 2024-03-04T13:00:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.840+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.CgfvD6sOLunDg2_PxVsKeHVyS4Si1UX_0 2024-03-04T13:00:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.840+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2844658894892376729', time=2024-03-04T14:54:30.015445+0000, chain.objs.size()=1 2024-03-04T13:00:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.840+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.vNZi47FpPVcWFyRVXkKjRQk1UKFLmgB_0 2024-03-04T13:00:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.840+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.336721495404650682', time=2024-03-04T14:54:30.102197+0000, chain.objs.size()=1 2024-03-04T13:00:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.840+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.kRCxdEuv37XIRe5_fJLeE0puz1J5QKY_0 2024-03-04T13:00:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11239378404405655366', time=2024-03-04T14:54:30.122558+0000, chain.objs.size()=1 2024-03-04T13:00:16.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.R2PzmBGjNEUzV1wEy69LDp9AlO_6f0O_0 2024-03-04T13:00:16.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1736287735476440083', time=2024-03-04T14:54:30.160609+0000, chain.objs.size()=1 2024-03-04T13:00:16.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.g0AFKTtabtdmp-sz2QwiA08ig3eUGiI_0 2024-03-04T13:00:16.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6165973457723580296', time=2024-03-04T14:54:30.183062+0000, chain.objs.size()=1 2024-03-04T13:00:16.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VQ_zz6l647JvBs4XpnBK47S-aVMuLWT_0 2024-03-04T13:00:16.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.79716189637955755', time=2024-03-04T14:54:30.183709+0000, chain.objs.size()=1 2024-03-04T13:00:16.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.fKNIlh35sAfzUGMcnUAIZVDLSsumsXk_0 2024-03-04T13:00:16.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7950446758974865010', time=2024-03-04T14:54:30.261542+0000, chain.objs.size()=1 2024-03-04T13:00:16.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.hZrWC2RkFy0OpDLwGJoeQ6W34PO7Hz7_0 2024-03-04T13:00:16.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18061979724672929313', time=2024-03-04T14:54:30.339572+0000, chain.objs.size()=1 2024-03-04T13:00:16.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ZrvJl0iGGxcqxLHpkuqhe7O03VIcyEs_0 2024-03-04T13:00:16.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1887656665018419842', time=2024-03-04T14:54:30.345674+0000, chain.objs.size()=1 2024-03-04T13:00:16.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.TpQegTY_dPkgFFOO2JnL-LV2RayU-wf_0 2024-03-04T13:00:16.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11767498607168703787', time=2024-03-04T14:54:30.452497+0000, chain.objs.size()=1 2024-03-04T13:00:16.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.841+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.62vUmgkSwfV6RB_OTnYKgGAWmfQv-El_0 2024-03-04T13:00:16.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.843+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15173559467129247947', time=2024-03-04T14:54:30.475141+0000, chain.objs.size()=1 2024-03-04T13:00:16.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.843+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YCS9ijr0YnPKwDLlNN-VS1E2xSovQ9Z_0 2024-03-04T13:00:16.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.843+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18322127233775134629', time=2024-03-04T14:54:30.488340+0000, chain.objs.size()=1 2024-03-04T13:00:16.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.843+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.t6fVHHq_1_0MqC44v9XDmgPpuLA-dBy_0 2024-03-04T13:00:16.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.843+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9923899058564042966', time=2024-03-04T14:54:30.500814+0000, chain.objs.size()=1 2024-03-04T13:00:16.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.843+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.eSmwxH5WrXeeC3MMuO6Ga9YmhvWzKAW_0 2024-03-04T13:00:16.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.843+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13680392587989802678', time=2024-03-04T14:54:30.654785+0000, chain.objs.size()=1 2024-03-04T13:00:16.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.843+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.gJ5PrXCwyBuoNNBjBtD6Ruy8ZTI7qPu_0 2024-03-04T13:00:16.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17518999767969396788', time=2024-03-04T14:54:30.659433+0000, chain.objs.size()=1 2024-03-04T13:00:16.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.a_2or0YttoMMlku0sMRomyyAR9XE-tn_0 2024-03-04T13:00:16.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.844+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16249926027857058227', time=2024-03-04T14:54:30.736303+0000, chain.objs.size()=1 2024-03-04T13:00:16.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.844+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.knwBrNobSnPD_f0az-GfCS9k-xet1t1_0 2024-03-04T13:00:16.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6160782957718361794', time=2024-03-04T14:54:30.739930+0000, chain.objs.size()=1 2024-03-04T13:00:16.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.60ofb0eVJXmhCXNUDUZ4bpQIRYhgSjM_0 2024-03-04T13:00:16.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17808732982789312082', time=2024-03-04T14:54:30.749027+0000, chain.objs.size()=1 2024-03-04T13:00:16.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.iavr4_iK1LVRMDfq6ME6rude-4IzUpF_0 2024-03-04T13:00:16.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1423922021970981509', time=2024-03-04T14:54:30.750053+0000, chain.objs.size()=1 2024-03-04T13:00:16.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yU5D9wONkxQdeNymnoptIojKZAqv25m_0 2024-03-04T13:00:16.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15167414012327521275', time=2024-03-04T14:54:30.785634+0000, chain.objs.size()=1 2024-03-04T13:00:16.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2Fd5fuAf5Z1Xk8hHGj_wS8ZEYnETEUZ_0 2024-03-04T13:00:16.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18176892836847577584', time=2024-03-04T14:54:30.805528+0000, chain.objs.size()=1 2024-03-04T13:00:16.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.6hnSljuU4Dmb8PZHo-Pa2pKtVUmI34s_0 2024-03-04T13:00:16.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10065626099769029702', time=2024-03-04T14:54:38.294225+0000, chain.objs.size()=1 2024-03-04T13:00:16.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cBN_NzQ0mgqsfcSvj69DqS-2GyLF_WH_0 2024-03-04T13:00:16.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3335246622345929882', time=2024-03-04T14:54:38.298349+0000, chain.objs.size()=1 2024-03-04T13:00:16.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cwpsh3hRNlMxdPpnPbl3zsprP-6v3bk_0 2024-03-04T13:00:16.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12683966662909776642', time=2024-03-04T14:54:38.317224+0000, chain.objs.size()=1 2024-03-04T13:00:16.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0niTkoAss0EhB0MOf0Wb0h_zb-AqeLb_0 2024-03-04T13:00:16.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9184390426092112492', time=2024-03-04T14:54:38.352790+0000, chain.objs.size()=1 2024-03-04T13:00:16.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.847+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Ob4SmNdeFHwbgJwcXcizLa1kZ01qUok_0 2024-03-04T13:00:16.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3341300862065898573', time=2024-03-04T14:54:38.360364+0000, chain.objs.size()=1 2024-03-04T13:00:16.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.E7VCK2prpSph5S-BJY5RGoGwBOJJjjM_0 2024-03-04T13:00:16.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5853314831598817075', time=2024-03-04T14:54:38.462570+0000, chain.objs.size()=1 2024-03-04T13:00:16.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.3HyWRFQEBbHYS9pwfsW3H7n5YN_aw38_0 2024-03-04T13:00:16.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13156635272917326583', time=2024-03-04T14:54:38.481033+0000, chain.objs.size()=1 2024-03-04T13:00:16.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.8igzaWucPSojkVwQz_tuiGOvIZJEVrd_0 2024-03-04T13:00:16.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13949907728146131582', time=2024-03-04T14:54:38.481738+0000, chain.objs.size()=1 2024-03-04T13:00:16.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.QGi41KJs0nbpq9r1mISZJYLUdxddwNH_0 2024-03-04T13:00:16.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1633295142764580369', time=2024-03-04T14:54:38.513210+0000, chain.objs.size()=1 2024-03-04T13:00:16.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ZvzsczJeqmcDLL42Wf8U6QB4p_hLEOS_0 2024-03-04T13:00:16.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12147651042214958714', time=2024-03-04T14:54:38.543593+0000, chain.objs.size()=1 2024-03-04T13:00:16.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.icrYMGv690BKpjql2s-aXzTQwoJOJOi_0 2024-03-04T13:00:16.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9529370347091840508', time=2024-03-04T14:54:38.623782+0000, chain.objs.size()=1 2024-03-04T13:00:16.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.850+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zhY1ztpPnwkq8Ac6X0cKoRJin-OjBxy_0 2024-03-04T13:00:16.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14380272211327320873', time=2024-03-04T14:54:38.633613+0000, chain.objs.size()=1 2024-03-04T13:00:16.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KpfpzF-5q6uc5ueZ70NnRJ4qRdVpQH3_0 2024-03-04T13:00:16.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9364583439578609903', time=2024-03-04T14:54:38.635155+0000, chain.objs.size()=1 2024-03-04T13:00:16.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2eK4MQ-XZwx_etxtyQL54MhODksLby5_0 2024-03-04T13:00:16.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12991296526507655862', time=2024-03-04T14:54:38.637002+0000, chain.objs.size()=1 2024-03-04T13:00:16.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IVqoCtnZPMHAtMZb3A6m2yQlYkZ12i3_0 2024-03-04T13:00:16.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.794292599549047630', time=2024-03-04T14:54:38.686303+0000, chain.objs.size()=1 2024-03-04T13:00:16.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pifrmXEmGoZD0ohmEx5MrzuPLrmenN7_0 2024-03-04T13:00:16.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4a9e422640 0 -- 172.21.15.90:0/1356638699 >> [v2:172.21.15.184:6800/1721853619,v1:172.21.15.184:6801/1721853619] conn(0x7f4a8803d070 msgr2=0x7f4968082130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T13:00:16.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1799901195764147657', time=2024-03-04T14:54:38.694951+0000, chain.objs.size()=1 2024-03-04T13:00:16.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.uybK8zYDrgFYWaptIg5eISnXd5-5IiL_0 2024-03-04T13:00:16.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14053045320088594662', time=2024-03-04T14:54:38.697351+0000, chain.objs.size()=1 2024-03-04T13:00:16.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.851+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.bS4mBjkaygu9aB_LsDkbQltU_gG8k9I_0 2024-03-04T13:00:16.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.852+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2702059719393352221', time=2024-03-04T14:54:38.698210+0000, chain.objs.size()=1 2024-03-04T13:00:16.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.852+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pjTXBL7CDJlnohvREdQuANblfbsxzwN_0 2024-03-04T13:00:16.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.852+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11347743437656129454', time=2024-03-04T14:54:38.813973+0000, chain.objs.size()=1 2024-03-04T13:00:16.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.852+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7ORwjd4r4kr9fDfg_4sfmxp6w2coyI8_0 2024-03-04T13:00:16.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.853+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6870411642550463623', time=2024-03-04T14:54:38.835933+0000, chain.objs.size()=1 2024-03-04T13:00:16.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.853+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.aikaz0yNPJG4I-3-hmZdxRcD9zAd49v_0 2024-03-04T13:00:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.853+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16121369445868593204', time=2024-03-04T14:54:38.839398+0000, chain.objs.size()=1 2024-03-04T13:00:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.853+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.LTtMv4yqHrfqNXoviBh35UwUQq1x0ir_0 2024-03-04T13:00:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.853+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16002465174036786001', time=2024-03-04T14:54:38.946187+0000, chain.objs.size()=1 2024-03-04T13:00:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.853+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.CITtjyh6UDRjVAmrIWLDHbdnqAlqLyw_0 2024-03-04T13:00:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.853+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8316465602326365030', time=2024-03-04T14:54:38.980680+0000, chain.objs.size()=1 2024-03-04T13:00:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.853+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.O-ZgLbjE4ub9YyfPB54psz55am6Sjug_0 2024-03-04T13:00:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.854+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13611289712813805820', time=2024-03-04T14:54:39.010686+0000, chain.objs.size()=1 2024-03-04T13:00:16.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.854+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.AREVDx9jmETXtaBJjU4WzILaAZcmv5T_0 2024-03-04T13:00:16.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.854+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17982171830323129099', time=2024-03-04T14:54:39.127092+0000, chain.objs.size()=1 2024-03-04T13:00:16.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.854+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.aGMKwWpG74qYBe7BvAkqk7tK5xXtdJn_0 2024-03-04T13:00:16.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.854+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9972383260046899489', time=2024-03-04T14:54:39.279538+0000, chain.objs.size()=1 2024-03-04T13:00:16.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.854+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HIgZqGamSQj5SwlyJzQL2Adlu1CEQIO_0 2024-03-04T13:00:16.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.854+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3320966332747730092', time=2024-03-04T14:54:39.301266+0000, chain.objs.size()=1 2024-03-04T13:00:16.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.854+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kdo3UjrijMjxg98NxGXlP47GfCSqdnX_0 2024-03-04T13:00:16.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.854+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5329746296848662851', time=2024-03-04T14:54:39.309341+0000, chain.objs.size()=1 2024-03-04T13:00:16.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.854+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Glq1i3aQuRLDqJiWazGwLRTOcoUe4kG_0 2024-03-04T13:00:16.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.855+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10566928402773402061', time=2024-03-04T14:54:39.352156+0000, chain.objs.size()=1 2024-03-04T13:00:16.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.855+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.lRbiTc9Qph3QZAJrzfKhVqFfBTheorf_0 2024-03-04T13:00:16.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.855+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9003460585872669899', time=2024-03-04T14:54:39.433808+0000, chain.objs.size()=1 2024-03-04T13:00:16.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.855+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rZNhk165gPvTjwEKMLMPwor4A988GIM_0 2024-03-04T13:00:16.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.855+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9856379928464709937', time=2024-03-04T14:54:39.434761+0000, chain.objs.size()=1 2024-03-04T13:00:16.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.855+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.oHR29D8qPV-VWD99tLPWc9U8eAmX_Lo_0 2024-03-04T13:00:16.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.858+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/48329 2024-03-04T13:00:16.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-03-04T13:00:16.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13048364244351682117', time=2024-03-04T14:54:39.455961+0000, chain.objs.size()=1 2024-03-04T13:00:16.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.WFpY2SSs8k_AjH4Ogkbt0kJCnlMPH79_0 2024-03-04T13:00:16.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11079012579697789740', time=2024-03-04T14:54:39.471927+0000, chain.objs.size()=1 2024-03-04T13:00:16.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.X0yvL5B8n1uqnbwZdLYCHsrqNLPa3hP_0 2024-03-04T13:00:16.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18078183328561956263', time=2024-03-04T14:54:43.682252+0000, chain.objs.size()=1 2024-03-04T13:00:16.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.307__shadow_.fHsMeJRbru6tfs0fm_h4jcsotk5Ztab_0 2024-03-04T13:00:16.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13680644968685557403', time=2024-03-04T14:55:55.566516+0000, chain.objs.size()=1 2024-03-04T13:00:16.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.462__shadow_.WeRk6U2kZ0oZoDBuHjpjffC_3m0EJCT_0 2024-03-04T13:00:16.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9651081230215833725', time=2024-03-04T14:56:08.464173+0000, chain.objs.size()=1 2024-03-04T13:00:16.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.489__shadow_.pZQnG1CJp9JkqR0HHnVjH92ccK2odAO_0 2024-03-04T13:00:16.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14538448987890787860', time=2024-03-04T14:56:08.465929+0000, chain.objs.size()=1 2024-03-04T13:00:16.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.489__shadow_.VNbJwgkJ57ZTyNXWYAMxY0Al6TWsRJY_0 2024-03-04T13:00:16.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11797235247808269223', time=2024-03-04T14:57:06.622743+0000, chain.objs.size()=1 2024-03-04T13:00:16.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.525__shadow_.TwrbztbIDAbLGDaK94eEiZNXC6kuOnl_0 2024-03-04T13:00:16.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14928694868341788573', time=2024-03-04T14:57:13.627929+0000, chain.objs.size()=2 2024-03-04T13:00:16.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.530__shadow_.HHRjMBlZInBdZF3l5yttf8iqdDEC18B_0 2024-03-04T13:00:16.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.530__shadow_.HHRjMBlZInBdZF3l5yttf8iqdDEC18B_1 2024-03-04T13:00:16.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3860830326423770629', time=2024-03-04T14:57:18.348644+0000, chain.objs.size()=1 2024-03-04T13:00:16.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:c.ES3O3TuGs7hAO.VCOlEe9wt7qMJfU_.90hJYPT6dLXb535Oj5iMeY7UwPC5z35_0 2024-03-04T13:00:16.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8024560130668109910', time=2024-03-04T14:57:20.335674+0000, chain.objs.size()=1 2024-03-04T13:00:16.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:hoCgtBJocpjelMNqN1tm7CUwSY9ioMh_.6wKf--WG-yLdOL6MBLba5yNs1Kj6fTk_0 2024-03-04T13:00:16.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17748956001996117950', time=2024-03-04T14:57:40.495882+0000, chain.objs.size()=1 2024-03-04T13:00:16.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.860+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:A03KnwSHKBVTPooqPH.kCgXYemojrNs_.Vw7rR83kCyZS4A6OXqfjeFAsTbubXI8_0 2024-03-04T13:00:16.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.863+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1735676277672423781', time=2024-03-04T14:58:07.357305+0000, chain.objs.size()=12 2024-03-04T13:00:16.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.863+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.580__multipart_multipart_enc.2~HYYNK_KwE8zkdrB05PEtsdWymZVF0HC.1 2024-03-04T13:00:16.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.863+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.580__shadow_multipart_enc.2~HYYNK_KwE8zkdrB05PEtsdWymZVF0HC.1_1 2024-03-04T13:00:16.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.863+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.580__multipart_multipart_enc.2~HYYNK_KwE8zkdrB05PEtsdWymZVF0HC.2 2024-03-04T13:00:16.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.863+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.580__shadow_multipart_enc.2~HYYNK_KwE8zkdrB05PEtsdWymZVF0HC.2_1 2024-03-04T13:00:16.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.864+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.580__multipart_multipart_enc.2~HYYNK_KwE8zkdrB05PEtsdWymZVF0HC.3 2024-03-04T13:00:16.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.864+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.580__shadow_multipart_enc.2~HYYNK_KwE8zkdrB05PEtsdWymZVF0HC.3_1 2024-03-04T13:00:16.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.864+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.580__multipart_multipart_enc.2~HYYNK_KwE8zkdrB05PEtsdWymZVF0HC.4 2024-03-04T13:00:16.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.864+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.580__shadow_multipart_enc.2~HYYNK_KwE8zkdrB05PEtsdWymZVF0HC.4_1 2024-03-04T13:00:16.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.864+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.580__multipart_multipart_enc.2~HYYNK_KwE8zkdrB05PEtsdWymZVF0HC.5 2024-03-04T13:00:16.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.865+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.580__shadow_multipart_enc.2~HYYNK_KwE8zkdrB05PEtsdWymZVF0HC.5_1 2024-03-04T13:00:16.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.865+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.580__multipart_multipart_enc.2~HYYNK_KwE8zkdrB05PEtsdWymZVF0HC.6 2024-03-04T13:00:16.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.866+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.580__shadow_multipart_enc.2~HYYNK_KwE8zkdrB05PEtsdWymZVF0HC.6_1 2024-03-04T13:00:16.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.866+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15941784795637976129', time=2024-03-04T14:58:08.799266+0000, chain.objs.size()=1 2024-03-04T13:00:16.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.866+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.582__shadow_.OIqGKw2hJhHa2usphH5XicH59O0CepP_0 2024-03-04T13:00:16.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.870+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7765671331711487802', time=2024-03-04T14:58:31.003976+0000, chain.objs.size()=12 2024-03-04T13:00:16.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.870+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.624__multipart_foo.2~J56FFJ8dKL4NCEc31w-RfhYxhfkH3uT.1 2024-03-04T13:00:16.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.870+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.624__shadow_foo.2~J56FFJ8dKL4NCEc31w-RfhYxhfkH3uT.1_1 2024-03-04T13:00:16.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.870+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.624__multipart_foo.2~J56FFJ8dKL4NCEc31w-RfhYxhfkH3uT.2 2024-03-04T13:00:16.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.870+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.624__shadow_foo.2~J56FFJ8dKL4NCEc31w-RfhYxhfkH3uT.2_1 2024-03-04T13:00:16.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.870+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.624__multipart_foo.2~J56FFJ8dKL4NCEc31w-RfhYxhfkH3uT.3 2024-03-04T13:00:16.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.870+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.624__shadow_foo.2~J56FFJ8dKL4NCEc31w-RfhYxhfkH3uT.3_1 2024-03-04T13:00:16.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.870+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.624__multipart_foo.2~J56FFJ8dKL4NCEc31w-RfhYxhfkH3uT.4 2024-03-04T13:00:16.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.870+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.624__shadow_foo.2~J56FFJ8dKL4NCEc31w-RfhYxhfkH3uT.4_1 2024-03-04T13:00:16.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.871+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.624__multipart_foo.2~J56FFJ8dKL4NCEc31w-RfhYxhfkH3uT.5 2024-03-04T13:00:16.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.871+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.624__shadow_foo.2~J56FFJ8dKL4NCEc31w-RfhYxhfkH3uT.5_1 2024-03-04T13:00:16.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.871+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.624__multipart_foo.2~J56FFJ8dKL4NCEc31w-RfhYxhfkH3uT.6 2024-03-04T13:00:16.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.873+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.624__shadow_foo.2~J56FFJ8dKL4NCEc31w-RfhYxhfkH3uT.6_1 2024-03-04T13:00:16.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.875+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.484504657540002937', time=2024-03-04T14:58:42.122411+0000, chain.objs.size()=1 2024-03-04T13:00:16.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.875+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.652__shadow:OtrxBhRAuhb923Qf6J4j2HR3DD1AcJE_.wGIm0_wWA7iA0WLeOHfdVG91-JLz1Fm_0 2024-03-04T13:00:16.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.875+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17592710335150139319', time=2024-03-04T14:58:44.501816+0000, chain.objs.size()=1 2024-03-04T13:00:16.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.875+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.658__shadow:Mo.secTNVcNSLn6cTmroPLs8OJlut8K_.0WgLgA1TbkIu1ftdS9JWH--lyYo55FU_0 2024-03-04T13:00:16.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.875+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17780943317600581766', time=2024-03-04T14:58:49.973342+0000, chain.objs.size()=1 2024-03-04T13:00:16.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.875+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.671__shadow:ZGf9iBOhZW8z1LIGG9tMtPoTm0WtVrw_.hbv81bWd4y5Rd7PcceW8MIUn0e2Mcin_0 2024-03-04T13:00:16.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.878+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.880+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T13:00:16.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.881+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48450' 2024-03-04T13:00:16.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16984379809337367590', time=2024-03-04T14:52:52.446410+0000, chain.objs.size()=1 2024-03-04T13:00:16.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.145__shadow_.vabENFNhLo9mdlcFaPGUehYhTlakqDK_0 2024-03-04T13:00:16.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_XH1U7_lNK_KqDY3XEFKV1I7f9OUzdLK', time=2024-03-04T14:52:57.757790+0000, chain.objs.size()=3 2024-03-04T13:00:16.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.w692ABfbx3buA6DVM6yKSRp9049f5mD_0 2024-03-04T13:00:16.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.w692ABfbx3buA6DVM6yKSRp9049f5mD_1 2024-03-04T13:00:16.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.w692ABfbx3buA6DVM6yKSRp9049f5mD_2 2024-03-04T13:00:16.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_BXj2ytDjlyYtC_6ypwQzBVaDQHWguMu', time=2024-03-04T14:52:57.931104+0000, chain.objs.size()=1 2024-03-04T13:00:16.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.153__shadow_.PPxXZPOhgyn1LYaT6gRLZRsVKB9XesP_0 2024-03-04T13:00:16.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7359793192014514854', time=2024-03-04T14:53:02.354862+0000, chain.objs.size()=1 2024-03-04T13:00:16.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.163__shadow_.slWpU1qFaIVGtj0zJBumH1p0kWj02ez_0 2024-03-04T13:00:16.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6621220816052665086', time=2024-03-04T14:53:10.557576+0000, chain.objs.size()=1 2024-03-04T13:00:16.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.172__shadow_.b_AbSKGBki0Z36tUcNui2LcqhDoVz-7_0 2024-03-04T13:00:16.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6205555799525614820', time=2024-03-04T14:53:32.034786+0000, chain.objs.size()=1 2024-03-04T13:00:16.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.209__shadow_.CO7RDAfcWXmc5eUkSMNgvo5trhvz9Vc_0 2024-03-04T13:00:16.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5924483080368107496', time=2024-03-04T14:53:38.213255+0000, chain.objs.size()=1 2024-03-04T13:00:16.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.220__shadow_.epOX_S3aH0DY-8ncJAOIUfVywb82Sf3_0 2024-03-04T13:00:16.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1795456194098737164', time=2024-03-04T14:53:40.876820+0000, chain.objs.size()=1 2024-03-04T13:00:16.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.226__shadow_.SvlRPqGv3pr5PU83NUN5NmqiEWIppZh_0 2024-03-04T13:00:16.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17737895977374911905', time=2024-03-04T14:53:52.082515+0000, chain.objs.size()=1 2024-03-04T13:00:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CNwSU1NxJOjr333H3WZwkXM6jDy8EUt_0 2024-03-04T13:00:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16708334693685700100', time=2024-03-04T14:53:52.089910+0000, chain.objs.size()=1 2024-03-04T13:00:16.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.882+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.H97DZRLb61OcrjNFsw6h03BVxcL3JqA_0 2024-03-04T13:00:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.884+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15694137366978347263', time=2024-03-04T14:53:52.116373+0000, chain.objs.size()=1 2024-03-04T13:00:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.884+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.sdUNXBi5XltYFw3RNTSp_HjfvlItmAZ_0 2024-03-04T13:00:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11012769427795216104', time=2024-03-04T14:53:52.243874+0000, chain.objs.size()=1 2024-03-04T13:00:16.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GY5g67vaVvgoSsddC3DNtd_XhTXjFSr_0 2024-03-04T13:00:16.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4779127165633246844', time=2024-03-04T14:53:52.256999+0000, chain.objs.size()=1 2024-03-04T13:00:16.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.g0LoAoZYNrktDEFTcbvHK4qO_8wPhuQ_0 2024-03-04T13:00:16.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16701364639512496423', time=2024-03-04T14:53:52.262889+0000, chain.objs.size()=1 2024-03-04T13:00:16.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.OL58APK8p3RQITBe6irh1ykuMXg0aLT_0 2024-03-04T13:00:16.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15716766642265710590', time=2024-03-04T14:53:52.300941+0000, chain.objs.size()=1 2024-03-04T13:00:16.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.fv8gJRHOyGaJ7-n8nQHydg64CHzYyhh_0 2024-03-04T13:00:16.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16311532724133835514', time=2024-03-04T14:53:52.398024+0000, chain.objs.size()=1 2024-03-04T13:00:16.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.rh1jxVSOfQLawF5B8yNetx1L9L0xF7-_0 2024-03-04T13:00:16.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11819876005780554741', time=2024-03-04T14:53:52.401418+0000, chain.objs.size()=1 2024-03-04T13:00:16.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Qi4HAPIcO-qzDmW5arZXm-aqWXW-pHA_0 2024-03-04T13:00:16.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6122069758742217207', time=2024-03-04T14:53:52.420753+0000, chain.objs.size()=1 2024-03-04T13:00:16.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GrVLheDVzF7cNk_bY5bxNPQaCXPjfom_0 2024-03-04T13:00:16.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14597424497892366991', time=2024-03-04T14:53:52.435953+0000, chain.objs.size()=1 2024-03-04T13:00:16.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.9NpJfqQhkUayq-f8m33KF7uyKsb1k4u_0 2024-03-04T13:00:16.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6736285163799215429', time=2024-03-04T14:53:52.490229+0000, chain.objs.size()=1 2024-03-04T13:00:16.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.SybjuAUJvSVK4JjJmk8L-4m2l2bXU9e_0 2024-03-04T13:00:16.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9032901056134726681', time=2024-03-04T14:53:52.604058+0000, chain.objs.size()=1 2024-03-04T13:00:16.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jWFAYsOcRoCaupwU1lnt0yOlteWaplW_0 2024-03-04T13:00:16.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15002475072519720535', time=2024-03-04T14:53:52.609435+0000, chain.objs.size()=1 2024-03-04T13:00:16.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.885+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mUQloCKrrd_M7NyWe3uGFwqKqAmKO6J_0 2024-03-04T13:00:16.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.887+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15605016351578438767', time=2024-03-04T14:53:52.758542+0000, chain.objs.size()=1 2024-03-04T13:00:16.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.887+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Sag0q8liicN1Ctrge8q-9mbelaT43Pp_0 2024-03-04T13:00:16.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.418796377132790264', time=2024-03-04T14:53:52.766161+0000, chain.objs.size()=1 2024-03-04T13:00:16.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.RMItVdW0jqwmYYWxitt0f5dBmjighwo_0 2024-03-04T13:00:16.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10961626708798879288', time=2024-03-04T14:53:52.775349+0000, chain.objs.size()=1 2024-03-04T13:00:16.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-Zvp8Tk98jVokvxkgZXfbJb6wxjB6Us_0 2024-03-04T13:00:16.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4547957726995507931', time=2024-03-04T14:53:52.790425+0000, chain.objs.size()=1 2024-03-04T13:00:16.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YIZxEeJaWGl2XtrOfn3ZV2-Z7ylMHD__0 2024-03-04T13:00:16.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16152295702974167026', time=2024-03-04T14:53:52.827211+0000, chain.objs.size()=1 2024-03-04T13:00:16.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.K03nTNC7jwtHrdO6titOU58CgHyaeET_0 2024-03-04T13:00:16.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10693105124759718036', time=2024-03-04T14:53:52.986461+0000, chain.objs.size()=1 2024-03-04T13:00:16.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.fwnlYhB419o_ARSqFi1kDLJMQxP32lQ_0 2024-03-04T13:00:16.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13693741180221400288', time=2024-03-04T14:53:52.992671+0000, chain.objs.size()=1 2024-03-04T13:00:16.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vMgii6qdnWSz8L3TTUIq-RbnNuKz6wG_0 2024-03-04T13:00:16.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2785405850522236884', time=2024-03-04T14:53:53.085648+0000, chain.objs.size()=1 2024-03-04T13:00:16.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.gox1llFGXqdtqzsh3dVw2WqKzdPCvw4_0 2024-03-04T13:00:16.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8587457430366774806', time=2024-03-04T14:53:53.086338+0000, chain.objs.size()=1 2024-03-04T13:00:16.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.oUdDRsQW7UwKaglyqZssBGjr1qigYB7_0 2024-03-04T13:00:16.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7218783931360972450', time=2024-03-04T14:53:53.127161+0000, chain.objs.size()=1 2024-03-04T13:00:16.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0m4W_EieQ787Dafh6GR_pkdw7XM07Uy_0 2024-03-04T13:00:16.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13757226570024592301', time=2024-03-04T14:53:53.154497+0000, chain.objs.size()=1 2024-03-04T13:00:16.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.6qnD09rqFBe4Q-iJocicUoBN0Tq_vB5_0 2024-03-04T13:00:16.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10358077081639906753', time=2024-03-04T14:53:57.438385+0000, chain.objs.size()=1 2024-03-04T13:00:16.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.891+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.242__shadow_.3YE65SPpqh-pVVB3vhzHHYFwPoZLFSe_0 2024-03-04T13:00:16.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.893+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16801522907438807352', time=2024-03-04T14:54:00.571246+0000, chain.objs.size()=1 2024-03-04T13:00:16.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.893+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.249__shadow_.y5uqpALNmrbAgx5DIp4vba778UL8fCP_0 2024-03-04T13:00:16.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13896290309085139879', time=2024-03-04T14:54:08.243400+0000, chain.objs.size()=1 2024-03-04T13:00:16.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.vScthkZiEz4LDlz2526mbX4oTzfwWBo_0 2024-03-04T13:00:16.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7644776490169666385', time=2024-03-04T14:54:09.028198+0000, chain.objs.size()=1 2024-03-04T13:00:16.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.Fo9S6aA46DTBy2jZ1ZRP5vCZPDlNSqx_0 2024-03-04T13:00:16.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5585578693702873732', time=2024-03-04T14:54:09.030164+0000, chain.objs.size()=1 2024-03-04T13:00:16.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.2PaWyTSrWm68ZacB97_QTiGybM-KrfM_0 2024-03-04T13:00:16.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17823766233291394056', time=2024-03-04T14:54:09.039284+0000, chain.objs.size()=1 2024-03-04T13:00:16.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.Qozon5ckORVG5YNvM3CLjEnWwEW3Ism_0 2024-03-04T13:00:16.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5800730184160731644', time=2024-03-04T14:54:09.039953+0000, chain.objs.size()=1 2024-03-04T13:00:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.ZnxfZ1IzXiVwLJ8l2lY6H_ofSPOdkPG_0 2024-03-04T13:00:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8014248280172259506', time=2024-03-04T14:54:11.753809+0000, chain.objs.size()=1 2024-03-04T13:00:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.272__shadow_.XssQbd9SWVbtVqM93kkysU7QdKrU8uu_0 2024-03-04T13:00:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5838222080301683830', time=2024-03-04T14:54:11.754621+0000, chain.objs.size()=1 2024-03-04T13:00:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.272__shadow_.tLg5eQSXliZY9MV6r3Qusdc4s9wwKiH_0 2024-03-04T13:00:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10524699889438008347', time=2024-03-04T14:54:12.643984+0000, chain.objs.size()=1 2024-03-04T13:00:16.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.274__shadow_.5GxDjNcvJtBBlWy8nzGlYE3TF1J9735_0 2024-03-04T13:00:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14509137082038350829', time=2024-03-04T14:54:14.427144+0000, chain.objs.size()=1 2024-03-04T13:00:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.278__shadow_.zlM10Yvzl-Hy7Qvlsc98JjGuEVNawSK_0 2024-03-04T13:00:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13441083740379642564', time=2024-03-04T14:54:29.631428+0000, chain.objs.size()=1 2024-03-04T13:00:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.894+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.stfXAVfj26LfORDiQsCgCWr96zeU_ys_0 2024-03-04T13:00:16.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.895+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12623840069042817304', time=2024-03-04T14:54:29.691200+0000, chain.objs.size()=1 2024-03-04T13:00:16.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.895+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.1MbASy4FuZEIhmb8JALiiGALdRwhr_r_0 2024-03-04T13:00:16.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.896+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12943420860080699108', time=2024-03-04T14:54:29.701079+0000, chain.objs.size()=1 2024-03-04T13:00:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.896+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.bHvZBfms1-Ta8S_iNrsoFrLCtJuyFV2_0 2024-03-04T13:00:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.896+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3682704507610984538', time=2024-03-04T14:54:29.791073+0000, chain.objs.size()=1 2024-03-04T13:00:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.896+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.uKeYw6I6Gx5Wuv7hWEd5lv1ME3qZS3m_0 2024-03-04T13:00:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.896+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7353833356414460043', time=2024-03-04T14:54:29.800810+0000, chain.objs.size()=1 2024-03-04T13:00:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.896+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.OZxg1Oi6VQBmgzA2YkgZXdXEuuYqygX_0 2024-03-04T13:00:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.896+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4725233573718964823', time=2024-03-04T14:54:29.826730+0000, chain.objs.size()=1 2024-03-04T13:00:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.896+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YvabmfnppLJKgT5cxlUYShd8WlTdUnT_0 2024-03-04T13:00:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17780944975470931482', time=2024-03-04T14:54:29.856566+0000, chain.objs.size()=1 2024-03-04T13:00:16.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-wk-i4QtHm5SBI4fvZiZ-uKb2B7RTG1_0 2024-03-04T13:00:16.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13039150172464984360', time=2024-03-04T14:54:29.941264+0000, chain.objs.size()=1 2024-03-04T13:00:16.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Tt4e8gthNoZmQOnmSn43wmbXwsyy4bf_0 2024-03-04T13:00:16.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15517982605686459428', time=2024-03-04T14:54:29.945117+0000, chain.objs.size()=1 2024-03-04T13:00:16.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.vYHr7cvJgGl1Q8LbGBVlpbM7Eq0Bs16_0 2024-03-04T13:00:16.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13957771148950351842', time=2024-03-04T14:54:29.958866+0000, chain.objs.size()=1 2024-03-04T13:00:16.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.jrBwHJAPrGCW6vABvG3DIz2W3j2MpCp_0 2024-03-04T13:00:16.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9533175552537256911', time=2024-03-04T14:54:29.960431+0000, chain.objs.size()=1 2024-03-04T13:00:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.BKqXmqHPX3DduHT-E22R3KhqUfZScIh_0 2024-03-04T13:00:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9487253971935101548', time=2024-03-04T14:54:29.963947+0000, chain.objs.size()=1 2024-03-04T13:00:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.E9w0RvFKkXBNKGKYjnt4_g0n4JsX3t8_0 2024-03-04T13:00:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17495476314295862450', time=2024-03-04T14:54:30.005254+0000, chain.objs.size()=1 2024-03-04T13:00:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.897+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tauN6tV8rbuueDWNtgmo99XFs1Jr29M_0 2024-03-04T13:00:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.898+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11329793918046196315', time=2024-03-04T14:54:30.009532+0000, chain.objs.size()=1 2024-03-04T13:00:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.898+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Oejx6RutKnYrl2TKKOkyjlNYZng3QEX_0 2024-03-04T13:00:16.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.898+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18039716327627762214', time=2024-03-04T14:54:30.125465+0000, chain.objs.size()=1 2024-03-04T13:00:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.898+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.aZvjQQoPQJqgRYghBdzezAqfug2YcrY_0 2024-03-04T13:00:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.898+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13264693585120583234', time=2024-03-04T14:54:30.139590+0000, chain.objs.size()=1 2024-03-04T13:00:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.898+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4yzSbA35GNVwen2SclmRpGm0LBM5qhM_0 2024-03-04T13:00:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13748972336350416030', time=2024-03-04T14:54:30.164570+0000, chain.objs.size()=1 2024-03-04T13:00:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oQE-U60MSb4b2SLl_DnHqN8zWviCGT2_0 2024-03-04T13:00:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5414085090734509911', time=2024-03-04T14:54:30.166160+0000, chain.objs.size()=1 2024-03-04T13:00:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-l4MRnpYbvMPMqqzqs6nmwrR3YGtFW__0 2024-03-04T13:00:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3321380347212580315', time=2024-03-04T14:54:30.177978+0000, chain.objs.size()=1 2024-03-04T13:00:16.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cCgj1ZgWoSaqNFDI0U8CbD54Q24qaql_0 2024-03-04T13:00:16.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13495470153582898549', time=2024-03-04T14:54:30.259106+0000, chain.objs.size()=1 2024-03-04T13:00:16.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.vvcsoLpXHLlBlKYZKV13FYtOV4WNSEg_0 2024-03-04T13:00:16.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2258662062404600601', time=2024-03-04T14:54:30.269003+0000, chain.objs.size()=1 2024-03-04T13:00:16.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Z-Vu6XF0uSOP3ySxrIFRZaLiLA_BzJI_0 2024-03-04T13:00:16.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15069511111654598531', time=2024-03-04T14:54:30.270101+0000, chain.objs.size()=1 2024-03-04T13:00:16.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.PZ7Xup8J_IVqOlAVIVfMEnVbKtRdMuZ_0 2024-03-04T13:00:16.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1262772172765197860', time=2024-03-04T14:54:30.315612+0000, chain.objs.size()=1 2024-03-04T13:00:16.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RcMn71NpMchPH8yq9tp2Tt50koF7Cs1_0 2024-03-04T13:00:16.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11655065570252377874', time=2024-03-04T14:54:30.316511+0000, chain.objs.size()=1 2024-03-04T13:00:16.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.I1VzEl3WHedZ2qkVA3VRIyxKh6ZthE5_0 2024-03-04T13:00:16.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.762394742370971241', time=2024-03-04T14:54:30.320013+0000, chain.objs.size()=1 2024-03-04T13:00:16.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.899+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.WqeXYkh5hDvTJLVRuAh154mA1jNT3eP_0 2024-03-04T13:00:16.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.900+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7290044099592169436', time=2024-03-04T14:54:30.324785+0000, chain.objs.size()=1 2024-03-04T13:00:16.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.900+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.zmfAub5-3bQMfXaF0qaHHKqdN3O1Sy4_0 2024-03-04T13:00:16.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.900+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4736248797185720382', time=2024-03-04T14:54:30.330568+0000, chain.objs.size()=1 2024-03-04T13:00:16.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.900+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Am1Ylpa7uqcNboS6kIMJ6QsCnsog3wi_0 2024-03-04T13:00:16.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.900+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7737052130047722228', time=2024-03-04T14:54:30.418380+0000, chain.objs.size()=1 2024-03-04T13:00:16.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.900+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4-XQTk58hMg7xYXoP2PgxgiF1vK6897_0 2024-03-04T13:00:16.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.900+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14200389558901342347', time=2024-03-04T14:54:30.433764+0000, chain.objs.size()=1 2024-03-04T13:00:16.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.900+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.CWFvwtaD6B93ZGZk8dbdmxaUXsTrvQJ_0 2024-03-04T13:00:16.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.901+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7677806997069251235', time=2024-03-04T14:54:30.479484+0000, chain.objs.size()=1 2024-03-04T13:00:16.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.901+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.D32Nr69tZtHr7KA4kWnDwdMQy2PgAaz_0 2024-03-04T13:00:16.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.901+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13261721586228476266', time=2024-03-04T14:54:30.485361+0000, chain.objs.size()=1 2024-03-04T13:00:16.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.901+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.QukeW3ff97r_LbjJLxnPfqC9Uu0MxXn_0 2024-03-04T13:00:16.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3012094033391884145', time=2024-03-04T14:54:30.487711+0000, chain.objs.size()=1 2024-03-04T13:00:16.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ds6uCPc_zWfko7pVjqicqrXGFD4exEQ_0 2024-03-04T13:00:16.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2248283368809650119', time=2024-03-04T14:54:30.609680+0000, chain.objs.size()=1 2024-03-04T13:00:16.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.PaNkg2aRnFBgjDxveRYxA5stk21q6ew_0 2024-03-04T13:00:16.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12737449167402309073', time=2024-03-04T14:54:30.624034+0000, chain.objs.size()=1 2024-03-04T13:00:16.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.eSfhbzohPn2Hb6PRxAQLyOl56T_0GH2_0 2024-03-04T13:00:16.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5131603327809673955', time=2024-03-04T14:54:30.644227+0000, chain.objs.size()=1 2024-03-04T13:00:16.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-McftRWLRNrXSd91UF868sBtczVDnnt_0 2024-03-04T13:00:16.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9052259844999519211', time=2024-03-04T14:54:30.737939+0000, chain.objs.size()=1 2024-03-04T13:00:16.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.j7dAkYgoUE3ys0fzkaxRw8MBYfIAVuN_0 2024-03-04T13:00:16.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15984696370885007330', time=2024-03-04T14:54:30.739318+0000, chain.objs.size()=1 2024-03-04T13:00:16.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ULco2eAsEaz0dE0wNtjCsXCdvX2vjr5_0 2024-03-04T13:00:16.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10584507558012675849', time=2024-03-04T14:54:30.748850+0000, chain.objs.size()=1 2024-03-04T13:00:16.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.HYHj80WJYN6Ndh5fVp2pR7yoyXcTr7U_0 2024-03-04T13:00:16.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8317099286760086688', time=2024-03-04T14:54:38.292614+0000, chain.objs.size()=1 2024-03-04T13:00:16.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.TJogxDFcApETT-vhmgM5pzxzsYmis6S_0 2024-03-04T13:00:16.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6396401920657448411', time=2024-03-04T14:54:38.296528+0000, chain.objs.size()=1 2024-03-04T13:00:16.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wO-29zZmkZdwmmAmNvWi7jeO3Bwhzym_0 2024-03-04T13:00:16.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1797850620596475717', time=2024-03-04T14:54:38.303467+0000, chain.objs.size()=1 2024-03-04T13:00:16.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.902+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wemnHv5N9h5x3oaMAj5SKJfv7sjVOuk_0 2024-03-04T13:00:16.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.903+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6680261960110589256', time=2024-03-04T14:54:38.315660+0000, chain.objs.size()=1 2024-03-04T13:00:16.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.903+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cy7LYot0ezSDE14AXAgq2QZ12KtGUkW_0 2024-03-04T13:00:16.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14917354878381509018', time=2024-03-04T14:54:38.333635+0000, chain.objs.size()=1 2024-03-04T13:00:16.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Sa2tiMybrwmXLu9ZLsWIB8v3kFa0GVW_0 2024-03-04T13:00:16.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3871587010163472259', time=2024-03-04T14:54:38.458899+0000, chain.objs.size()=1 2024-03-04T13:00:16.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.qG0V83QuW7iV9Lo4RNX8O9xnpxlQYBh_0 2024-03-04T13:00:16.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9904547856818350885', time=2024-03-04T14:54:38.463740+0000, chain.objs.size()=1 2024-03-04T13:00:16.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.aCxkDewwB0026NNu8wEZjlynyfExZG0_0 2024-03-04T13:00:16.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.545389437179446608', time=2024-03-04T14:54:38.517860+0000, chain.objs.size()=1 2024-03-04T13:00:16.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.G6HIaSxHwQoJ-mrhhWjTL2Vl0K-kacS_0 2024-03-04T13:00:16.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17649798630343506220', time=2024-03-04T14:54:38.525698+0000, chain.objs.size()=1 2024-03-04T13:00:16.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.t4TmmPjgnXcKJ1bSwwemyK6tRXCLJfd_0 2024-03-04T13:00:16.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1651842923788246125', time=2024-03-04T14:54:38.651255+0000, chain.objs.size()=1 2024-03-04T13:00:16.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.PPKKhNoKHQ2S5GtfBYubIsoRUGA7rQr_0 2024-03-04T13:00:16.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12540317449884203742', time=2024-03-04T14:54:38.676137+0000, chain.objs.size()=1 2024-03-04T13:00:16.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VPcg4bmUXrVc-kv-k-3cirW8b7C0f-H_0 2024-03-04T13:00:16.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11691370527860369759', time=2024-03-04T14:54:38.709302+0000, chain.objs.size()=1 2024-03-04T13:00:16.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.T_OEhDcBOnu2ON4dzy5SrZUIM38JjFk_0 2024-03-04T13:00:16.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3282616718483297929', time=2024-03-04T14:54:38.786140+0000, chain.objs.size()=1 2024-03-04T13:00:16.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.c5YrrINkuGA4-nIT3NSd_vtfLX6AY7Q_0 2024-03-04T13:00:16.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9482016394424952380', time=2024-03-04T14:54:38.859137+0000, chain.objs.size()=1 2024-03-04T13:00:16.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tsFsTy-xnesMtyWkfiC7nn5aYE_Ry9E_0 2024-03-04T13:00:16.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6117686147672256625', time=2024-03-04T14:54:38.955552+0000, chain.objs.size()=1 2024-03-04T13:00:16.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.904+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.A7INIafVGi35K4gXUVPwf3I-UBCwxIc_0 2024-03-04T13:00:16.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11461943590417833572', time=2024-03-04T14:54:38.998419+0000, chain.objs.size()=1 2024-03-04T13:00:16.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.nzbpq-fUjLgQWNyQTc1d79VnW9Cm1Bm_0 2024-03-04T13:00:16.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.906+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8076979512913817014', time=2024-03-04T14:54:39.029730+0000, chain.objs.size()=1 2024-03-04T13:00:16.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.906+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0bNZ5p5aY0If955gYMootclymsE7pvS_0 2024-03-04T13:00:16.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.907+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6040281931252146488', time=2024-03-04T14:54:39.105830+0000, chain.objs.size()=1 2024-03-04T13:00:16.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.907+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.q0Ksw1rT8fxHAru2FyCgCTb-DMeInM2_0 2024-03-04T13:00:16.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.910+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/48450 2024-03-04T13:00:16.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-03-04T13:00:16.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10311991285973111386', time=2024-03-04T14:54:39.119853+0000, chain.objs.size()=1 2024-03-04T13:00:16.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.fRpld1IsN_0MgO0COOWhqIAbbtk3bpY_0 2024-03-04T13:00:16.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3087266333263552857', time=2024-03-04T14:54:39.123048+0000, chain.objs.size()=1 2024-03-04T13:00:16.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.UaSrX2Ss4tMN9SHXSG6pnZPd99Z8Arp_0 2024-03-04T13:00:16.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2173511990092586495', time=2024-03-04T14:54:39.167966+0000, chain.objs.size()=1 2024-03-04T13:00:16.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.naUN-Xu_COPFnMFFF2RuC5TG9vEYRzf_0 2024-03-04T13:00:16.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15197752511444078103', time=2024-03-04T14:54:39.273816+0000, chain.objs.size()=1 2024-03-04T13:00:16.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.WA9i242Sy1AOZsoRP7ExBmTsswmX_m__0 2024-03-04T13:00:16.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9479842645073780913', time=2024-03-04T14:54:39.290283+0000, chain.objs.size()=1 2024-03-04T13:00:16.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.C3MfDcLhQQBn8bmvOKmW6XpF1Nk1-gZ_0 2024-03-04T13:00:16.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7588993057054134921', time=2024-03-04T14:54:39.333189+0000, chain.objs.size()=1 2024-03-04T13:00:16.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2L6LXWoPxfyFQx4WBZYZjNJvs02RCz9_0 2024-03-04T13:00:16.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6552829092094230955', time=2024-03-04T14:54:39.468314+0000, chain.objs.size()=1 2024-03-04T13:00:16.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.15bWaV8QCyIWRUPIB5ppxXFxTpWzorf_0 2024-03-04T13:00:16.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13190693850561326088', time=2024-03-04T14:54:39.490707+0000, chain.objs.size()=1 2024-03-04T13:00:16.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tZ6hxyQOwM9LV_lXCZMpz0fgFqUBgE-_0 2024-03-04T13:00:16.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1361233646895964522', time=2024-03-04T14:54:47.954435+0000, chain.objs.size()=1 2024-03-04T13:00:16.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.317__shadow_.-4_V76gfZpmtEJP9Z5VQIxxp-VsmRdj_0 2024-03-04T13:00:16.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16611204276843277763', time=2024-03-04T14:55:52.265678+0000, chain.objs.size()=1 2024-03-04T13:00:16.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.455__shadow_.cobNl5X7x7--tdq8DZWJ35ZFDs-7qfj_0 2024-03-04T13:00:16.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7644993177260391797', time=2024-03-04T14:55:54.191141+0000, chain.objs.size()=1 2024-03-04T13:00:16.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.459__shadow_.-Q0e07xUSEgZ0l-QDsyIRnpLJ3PHosO_0 2024-03-04T13:00:16.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3300494172273012488', time=2024-03-04T14:56:23.294920+0000, chain.objs.size()=2 2024-03-04T13:00:16.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.912+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~a9C6IrbLxksSXT2TDpJo7ym3QL4MtNH.1 2024-03-04T13:00:16.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~a9C6IrbLxksSXT2TDpJo7ym3QL4MtNH.2 2024-03-04T13:00:16.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16571041901611355686', time=2024-03-04T14:56:28.348958+0000, chain.objs.size()=2 2024-03-04T13:00:16.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.500__multipart_mymultipart.2~a6FXSPPnEU6nlHkRwe-OI3YZ3aoBjAR.1 2024-03-04T13:00:16.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.500__multipart_mymultipart.2~a6FXSPPnEU6nlHkRwe-OI3YZ3aoBjAR.2 2024-03-04T13:00:16.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6302359104804018485', time=2024-03-04T14:57:04.129898+0000, chain.objs.size()=1 2024-03-04T13:00:16.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.521__shadow_.r1EPtP48wTVw5CMpb1b3VXnEtuUlmLO_0 2024-03-04T13:00:16.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11155726812812319177', time=2024-03-04T14:57:16.515372+0000, chain.objs.size()=1 2024-03-04T13:00:16.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:8A052kxpt8oOty2edXPM3nIHoEX7yZM_.r1BC9H9zT2NgYyMI-iLpjvCW0T2HSad_0 2024-03-04T13:00:16.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14569243193045989453', time=2024-03-04T14:57:20.193779+0000, chain.objs.size()=1 2024-03-04T13:00:16.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:ZVPEOXWD3Jpg0iDdGxvi2D6uvZ3zJ9M_.sjlcDw-1DrnDchaRAZ8cxpbq6meDdkB_0 2024-03-04T13:00:16.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11260153697454316638', time=2024-03-04T14:57:22.326087+0000, chain.objs.size()=1 2024-03-04T13:00:16.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:8K3bpV4o5.T0Fyoa1rmYOeEsRQ.S0b8_.341YH1Zj29-2N1dxgjNsUlG5B7UnyZY_0 2024-03-04T13:00:16.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1989862130094190142', time=2024-03-04T14:57:26.741180+0000, chain.objs.size()=1 2024-03-04T13:00:16.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.541__shadow:Aub.n7gDdMYwHApfD6EH5vZPS1Z-P7W_.4vo_SaEZ4nhLgXt7wi2bpWoMfhu5n1L_0 2024-03-04T13:00:16.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9649916718030120909', time=2024-03-04T14:57:41.318072+0000, chain.objs.size()=1 2024-03-04T13:00:16.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:l42widOq0A9tUG0nhbqo72PkjSg4bPQ_.v6Q6N69nk-iodtbGMix6p-yprdy5nzz_0 2024-03-04T13:00:16.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1747996200006980349', time=2024-03-04T14:57:49.597539+0000, chain.objs.size()=1 2024-03-04T13:00:16.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.549__shadow:YJDehXfvPC0C4TN9Z6uH3mgFTpv.sRA_.-Vb6XrX4JCeU5Qt08fUhzaRRabeBalg_0 2024-03-04T13:00:16.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.679__shadow_.WRNxZJXovzWJBTE2YBCegXySkoIxcYB_1_dfbd9e13a39f5966c54d03bc8b730e74', time=2024-03-04T14:59:11.903027+0000, chain.objs.size()=1 2024-03-04T13:00:16.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.914+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.679__shadow_.WRNxZJXovzWJBTE2YBCegXySkoIxcYB_0 2024-03-04T13:00:16.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.917+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.919+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T13:00:16.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.921+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.921+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52232' 2024-03-04T13:00:16.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1557145253441628867', time=2024-03-04T14:52:51.205119+0000, chain.objs.size()=1 2024-03-04T13:00:16.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.138__shadow_.-At8_WHm-V-SkBWTtH3n3JoTihopURy_0 2024-03-04T13:00:16.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14360199264744348222', time=2024-03-04T14:52:59.407760+0000, chain.objs.size()=5 2024-03-04T13:00:16.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__multipart_foo-FROZEN.2~WkvlmSyLb4cZYhCBLGeSgqRIATbOzvd.1 2024-03-04T13:00:16.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_foo-FROZEN.2~WkvlmSyLb4cZYhCBLGeSgqRIATbOzvd.1_1 2024-03-04T13:00:16.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__multipart_foo-FROZEN.2~WkvlmSyLb4cZYhCBLGeSgqRIATbOzvd.2 2024-03-04T13:00:16.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_foo-FROZEN.2~WkvlmSyLb4cZYhCBLGeSgqRIATbOzvd.2_1 2024-03-04T13:00:16.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__multipart_foo-FROZEN.2~WkvlmSyLb4cZYhCBLGeSgqRIATbOzvd.3 2024-03-04T13:00:16.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16893767245350243461', time=2024-03-04T14:53:29.872940+0000, chain.objs.size()=1 2024-03-04T13:00:16.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.204__shadow_._mBwh4-OpO86Oky9ggYe4285-397Q39_0 2024-03-04T13:00:16.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15669487635217148515', time=2024-03-04T14:53:30.778665+0000, chain.objs.size()=1 2024-03-04T13:00:16.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.206__shadow_._N2sj0udFu3D3iwvzPJdggiZ9Vp3YwL_0 2024-03-04T13:00:16.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9418338957951249483', time=2024-03-04T14:53:38.670937+0000, chain.objs.size()=1 2024-03-04T13:00:16.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.221__shadow_.wZip_zXmif-ICDJL2Rs7ku3VSKZUYGH_0 2024-03-04T13:00:16.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.150292093357261574', time=2024-03-04T14:53:39.080959+0000, chain.objs.size()=1 2024-03-04T13:00:16.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.222__shadow_.kH5KTRDbxahXHL0GRm_Q_USJfk6o0JC_0 2024-03-04T13:00:16.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5577825800451985282', time=2024-03-04T14:53:40.877623+0000, chain.objs.size()=1 2024-03-04T13:00:16.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.226__shadow_.lbmFDsZMmTeQVjPYvR0ZJ_4mFiQMiJb_0 2024-03-04T13:00:16.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17117384038711818008', time=2024-03-04T14:53:42.226864+0000, chain.objs.size()=1 2024-03-04T13:00:16.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.922+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.229__shadow_.66KdmjSFClkRin5BeIoWJilGCncFADO_0 2024-03-04T13:00:16.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.925+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2616000983804594813', time=2024-03-04T14:53:52.042472+0000, chain.objs.size()=1 2024-03-04T13:00:16.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.925+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.HdowUagXpPe2Qv6ur51HZFbnnwoJBjX_0 2024-03-04T13:00:16.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16040526432677874783', time=2024-03-04T14:53:52.045387+0000, chain.objs.size()=1 2024-03-04T13:00:16.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.UZ2y9T5BfjeA1PnG8oSREq2AygyRxPR_0 2024-03-04T13:00:16.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10142319998201769682', time=2024-03-04T14:53:52.067713+0000, chain.objs.size()=1 2024-03-04T13:00:16.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JAR1cwiSsnoDodYKR7CEJd8LRaJ20wt_0 2024-03-04T13:00:16.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13805350695811476602', time=2024-03-04T14:53:52.078146+0000, chain.objs.size()=1 2024-03-04T13:00:16.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.W6jVIGUVnYE7DCx7iC25h32tK08Ap83_0 2024-03-04T13:00:16.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8985984373215111119', time=2024-03-04T14:53:52.085414+0000, chain.objs.size()=1 2024-03-04T13:00:16.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.a-OHn3NiwcVobSG8JMLn2w27ESrJzyD_0 2024-03-04T13:00:16.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8702357945303765779', time=2024-03-04T14:53:52.111891+0000, chain.objs.size()=1 2024-03-04T13:00:16.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LnK6VFx9ckdGN1CQK9UQ6OkO2DZ3Vo2_0 2024-03-04T13:00:16.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5057473428952959573', time=2024-03-04T14:53:52.117175+0000, chain.objs.size()=1 2024-03-04T13:00:16.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.TYwPuo0vfrS2jv69sAsXFZnpFkcYtbZ_0 2024-03-04T13:00:16.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.224679621400837813', time=2024-03-04T14:53:52.126606+0000, chain.objs.size()=1 2024-03-04T13:00:16.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mF7Lq0WM9rF3_F9t8PClUfLYuwvICfX_0 2024-03-04T13:00:16.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11560494454254973165', time=2024-03-04T14:53:52.128219+0000, chain.objs.size()=1 2024-03-04T13:00:16.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.p3LglIqzw5Q8D8YmomazCizeZoC3B_9_0 2024-03-04T13:00:16.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2611513457335214014', time=2024-03-04T14:53:52.218362+0000, chain.objs.size()=1 2024-03-04T13:00:16.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0gj8cQfEsqSLEjKGabI1O2zEv2c0TKW_0 2024-03-04T13:00:16.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6366005067511082214', time=2024-03-04T14:53:52.232617+0000, chain.objs.size()=1 2024-03-04T13:00:16.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xuq_ZHBLNDZFGSZfxDtnupcBNaCDCD7_0 2024-03-04T13:00:16.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2304851223710700217', time=2024-03-04T14:53:52.248780+0000, chain.objs.size()=1 2024-03-04T13:00:16.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.926+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.RsM33raaUN9zu_BmHRcBHGYWqNkRZro_0 2024-03-04T13:00:16.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16535232413160396314', time=2024-03-04T14:53:52.312199+0000, chain.objs.size()=1 2024-03-04T13:00:16.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.neiNfFTw29HeqYPVdW6k0YE8YjGplhD_0 2024-03-04T13:00:16.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9369961010495806494', time=2024-03-04T14:53:52.317833+0000, chain.objs.size()=1 2024-03-04T13:00:16.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.y91YQ748upNR0eBwAmkwHOhsAZC1MxU_0 2024-03-04T13:00:16.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6560767104179185717', time=2024-03-04T14:53:52.402158+0000, chain.objs.size()=1 2024-03-04T13:00:16.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.XnYdj9wZCWjLAqROfn6D3l_yMPNh8wb_0 2024-03-04T13:00:16.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17505187566897470567', time=2024-03-04T14:53:52.409505+0000, chain.objs.size()=1 2024-03-04T13:00:16.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.of4nRVStsL_X0QMzv3iDqZafy_UW4SC_0 2024-03-04T13:00:16.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6830885777862842546', time=2024-03-04T14:53:52.423174+0000, chain.objs.size()=1 2024-03-04T13:00:16.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ylVMcx9ZDttMNrQdmuYUjTKVGBshCSk_0 2024-03-04T13:00:16.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.801035411666816206', time=2024-03-04T14:53:52.449466+0000, chain.objs.size()=1 2024-03-04T13:00:16.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.iUNrJuuO_2V6wlDL-VuWRcEDXHe7uLq_0 2024-03-04T13:00:16.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12177430287115994411', time=2024-03-04T14:53:52.475321+0000, chain.objs.size()=1 2024-03-04T13:00:16.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.auH_ERJG5rqtbii2cTyUw2WrDAQEjBT_0 2024-03-04T13:00:16.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2206404623168071033', time=2024-03-04T14:53:52.475996+0000, chain.objs.size()=1 2024-03-04T13:00:16.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._QYTOAERWlPCKeeD3yLU_8PyAlPuJCy_0 2024-03-04T13:00:16.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1392269714289718852', time=2024-03-04T14:53:52.483886+0000, chain.objs.size()=1 2024-03-04T13:00:16.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.928+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JFef-1p2g0rHCee-HDx3sMuhxBDJKJE_0 2024-03-04T13:00:16.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.929+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3230549071041803595', time=2024-03-04T14:53:52.568925+0000, chain.objs.size()=1 2024-03-04T13:00:16.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.929+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xU1j5w-0gU1W9gWHHMPfEeK-jajZEOf_0 2024-03-04T13:00:16.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.929+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8123372532142935820', time=2024-03-04T14:53:52.636557+0000, chain.objs.size()=1 2024-03-04T13:00:16.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.929+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.x0N4zfp_Mh0PoM4mUTlfX9_5UtBj5JU_0 2024-03-04T13:00:16.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.930+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4136200437585517094', time=2024-03-04T14:53:52.638039+0000, chain.objs.size()=1 2024-03-04T13:00:16.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.930+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.lu3U63nYUa8Urhj2vO9Tq4HgYduAZb9_0 2024-03-04T13:00:16.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4281326935500313607', time=2024-03-04T14:53:52.650337+0000, chain.objs.size()=1 2024-03-04T13:00:16.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8Yf9iIUDQD9DaP4vZqDIekTeb4xs-Qk_0 2024-03-04T13:00:16.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1926548224644705150', time=2024-03-04T14:53:52.741892+0000, chain.objs.size()=1 2024-03-04T13:00:16.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.XI5Pra1xdev0Oz8L4tHt2rTQTTPN_92_0 2024-03-04T13:00:16.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7436557631542134978', time=2024-03-04T14:53:52.754199+0000, chain.objs.size()=1 2024-03-04T13:00:16.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zXDOzYGz2x76uIYCwWm6Jt79YnP_9PM_0 2024-03-04T13:00:16.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3287121201616255616', time=2024-03-04T14:53:52.782485+0000, chain.objs.size()=1 2024-03-04T13:00:16.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jjPuuL_AYRFOMaTHlkMR29p_izufZXd_0 2024-03-04T13:00:16.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3942155706871257810', time=2024-03-04T14:53:52.938908+0000, chain.objs.size()=1 2024-03-04T13:00:16.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ZvvCAbFbauMD9TvN1IQ5_gbrkFQ_OV6_0 2024-03-04T13:00:16.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.931+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10349638987566929628', time=2024-03-04T14:53:53.081561+0000, chain.objs.size()=1 2024-03-04T13:00:16.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.931+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.aYx-3c0HHKH9sDS4XOmY8k5JAlmowpT_0 2024-03-04T13:00:16.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.932+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11531689828812076953', time=2024-03-04T14:53:53.094918+0000, chain.objs.size()=1 2024-03-04T13:00:16.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.932+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8rldCvqcr9caqzUjoiqfm-Fklg2Ujqh_0 2024-03-04T13:00:16.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.932+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8022067737347189144', time=2024-03-04T14:53:53.137247+0000, chain.objs.size()=1 2024-03-04T13:00:16.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.932+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.1QHBi7CnloYRowjfnhgct_dseV-pQHW_0 2024-03-04T13:00:16.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.932+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.656921747980737119', time=2024-03-04T14:53:53.139332+0000, chain.objs.size()=1 2024-03-04T13:00:16.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.932+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.iDOxf1ThgbPAF3dAA1NY-OPQF-0PjvH_0 2024-03-04T13:00:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.932+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6913448440696409707', time=2024-03-04T14:53:53.161612+0000, chain.objs.size()=1 2024-03-04T13:00:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.932+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.j0pg4VS2Tl42TDqbwGZNFVXiDVd9vdi_0 2024-03-04T13:00:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.932+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11224631409271473739', time=2024-03-04T14:53:53.171722+0000, chain.objs.size()=1 2024-03-04T13:00:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.932+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.k5DtzrM5VBssYwo4vAtu_rf5yr7x8P3_0 2024-03-04T13:00:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.933+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17661887803754371132', time=2024-03-04T14:53:53.249414+0000, chain.objs.size()=1 2024-03-04T13:00:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.933+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LGOonOomcfG5L9i5-TRXLkX1hPIrWMY_0 2024-03-04T13:00:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.933+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14668596038779851861', time=2024-03-04T14:53:53.273686+0000, chain.objs.size()=1 2024-03-04T13:00:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.933+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VjGS3pq96V8dUVIu6hgzBpY4ktY0Gpu_0 2024-03-04T13:00:16.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.933+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13342694123761516929', time=2024-03-04T14:53:53.280740+0000, chain.objs.size()=1 2024-03-04T13:00:16.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.933+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.725KElDOGwOzYr2yotao-OMnesgsBBg_0 2024-03-04T13:00:16.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.933+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10448920308650704418', time=2024-03-04T14:53:53.308033+0000, chain.objs.size()=1 2024-03-04T13:00:16.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.933+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zT1_vei0uNINGkfjNeKsH0CyseiECFy_0 2024-03-04T13:00:16.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.933+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1460067166890262040', time=2024-03-04T14:54:01.439412+0000, chain.objs.size()=1 2024-03-04T13:00:16.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.933+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.251__shadow_.fDJpv6ZSdZ0iegGZGrMRaVlT3Bze9yM_0 2024-03-04T13:00:16.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.933+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9274069755102343706', time=2024-03-04T14:54:09.470357+0000, chain.objs.size()=1 2024-03-04T13:00:16.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.933+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.267__shadow_.EGT8_6O6zhgRQ7KKUHTDoOp_qxXukZC_0 2024-03-04T13:00:16.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17147177682603391070', time=2024-03-04T14:54:09.891011+0000, chain.objs.size()=1 2024-03-04T13:00:16.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.268__shadow_.cSyPLX-YRXhuGyCu1-zePSqO2RqFSLV_0 2024-03-04T13:00:16.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9493106831947590617', time=2024-03-04T14:54:10.347990+0000, chain.objs.size()=1 2024-03-04T13:00:16.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.269__shadow_.agbmDLZ9DDNUvnLN7VS1OndQPdEcJ3D_0 2024-03-04T13:00:16.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13542098903936759971', time=2024-03-04T14:54:12.207488+0000, chain.objs.size()=1 2024-03-04T13:00:16.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.934+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.273__shadow_.WIgPe1DAjkJOgbnaS9Zl3ez06ZXNcRY_0 2024-03-04T13:00:16.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.934+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2827021686273340186', time=2024-03-04T14:54:12.644584+0000, chain.objs.size()=1 2024-03-04T13:00:16.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.274__shadow_.KsmOsioBz9bsWEIveo9RPKAL-DP8nqs_0 2024-03-04T13:00:16.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6582243710745834523', time=2024-03-04T14:54:29.639470+0000, chain.objs.size()=1 2024-03-04T13:00:16.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3Pfk0kMyJ7Ua_i5NQnrO9mEVm1tGI0a_0 2024-03-04T13:00:16.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8081820101342690537', time=2024-03-04T14:54:29.643303+0000, chain.objs.size()=1 2024-03-04T13:00:16.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.mdAKcpilHuvjrU7eLuwyqZ82yzNp8jF_0 2024-03-04T13:00:16.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3732393351620535894', time=2024-03-04T14:54:29.650436+0000, chain.objs.size()=1 2024-03-04T13:00:16.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5ieNVc3Wj78Uz5ZJcH-ocb_meKoQUMl_0 2024-03-04T13:00:16.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10294667983937824824', time=2024-03-04T14:54:29.670312+0000, chain.objs.size()=1 2024-03-04T13:00:16.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.hAHSVjw2tQxt1QQm6UqzSKZypyrGnZV_0 2024-03-04T13:00:16.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10186932531247689905', time=2024-03-04T14:54:29.676103+0000, chain.objs.size()=1 2024-03-04T13:00:16.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.n5pvqhNHBmoslgyozZdtEMuK14Vf0vh_0 2024-03-04T13:00:16.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6203650618728612792', time=2024-03-04T14:54:29.779263+0000, chain.objs.size()=1 2024-03-04T13:00:16.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.gRzi739Jmsb-FToUyxipC8LQs2ZqR_D_0 2024-03-04T13:00:16.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9167633593873852335', time=2024-03-04T14:54:29.792669+0000, chain.objs.size()=1 2024-03-04T13:00:16.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.935+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.koSVT0WFUbyy5tZrFbPXR5sTnMGFiYu_0 2024-03-04T13:00:16.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.936+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4953293062330463341', time=2024-03-04T14:54:29.793479+0000, chain.objs.size()=1 2024-03-04T13:00:16.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.936+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.KpjYEPCfX0JlEtND3khQ0Vkh-QOx10q_0 2024-03-04T13:00:16.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.936+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8545321674018447521', time=2024-03-04T14:54:29.800279+0000, chain.objs.size()=1 2024-03-04T13:00:16.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.936+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.f8Z3BKiMmK9MIK6UHi9X67jeOZkzhvy_0 2024-03-04T13:00:16.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.937+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4291197618535569250', time=2024-03-04T14:54:29.810713+0000, chain.objs.size()=1 2024-03-04T13:00:16.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.937+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5voZjSE6pzXrEfgK6Hk5mfXFLWlUfYO_0 2024-03-04T13:00:16.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.937+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17110731011440488909', time=2024-03-04T14:54:29.820397+0000, chain.objs.size()=1 2024-03-04T13:00:16.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.937+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.NRFwQpo77KSt_iI69HeDyobN6QoHPhp_0 2024-03-04T13:00:16.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.937+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2165620649634976782', time=2024-03-04T14:54:29.821955+0000, chain.objs.size()=1 2024-03-04T13:00:16.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.937+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.qX_GD-4y1g4dZKbSzbOJjgfeP43Zy-u_0 2024-03-04T13:00:16.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17025090888115068403', time=2024-03-04T14:54:29.832239+0000, chain.objs.size()=1 2024-03-04T13:00:16.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Tluc8BmB0Im-Ot7EGMaJayU43LNCkGb_0 2024-03-04T13:00:16.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3223243055455197627', time=2024-03-04T14:54:29.840021+0000, chain.objs.size()=1 2024-03-04T13:00:16.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.DcRX9Kxll2t3fJTycaZItoUm_qlir3i_0 2024-03-04T13:00:16.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1298011983033437239', time=2024-03-04T14:54:29.854813+0000, chain.objs.size()=1 2024-03-04T13:00:16.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.e7OuySF9K-dGCyIINMT-UTNRVeJt-pO_0 2024-03-04T13:00:16.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8426425141778289736', time=2024-03-04T14:54:29.944751+0000, chain.objs.size()=1 2024-03-04T13:00:16.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.EmUxWSJSvaCcUQdM6Y4q3o9rCQV2yja_0 2024-03-04T13:00:16.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14821754409581902407', time=2024-03-04T14:54:29.955160+0000, chain.objs.size()=1 2024-03-04T13:00:16.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.pJDucrw_bPSx5XUVu8uNhZTF8EoS3un_0 2024-03-04T13:00:16.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8901600907024857559', time=2024-03-04T14:54:29.987489+0000, chain.objs.size()=1 2024-03-04T13:00:16.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2ltmUg0Fx95xkHuB6r0amg6TIAwhbkx_0 2024-03-04T13:00:16.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4197546607697304621', time=2024-03-04T14:54:29.998137+0000, chain.objs.size()=1 2024-03-04T13:00:16.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.i564mlhZ0bzG30TomXNHNRSQpE-Cfd1_0 2024-03-04T13:00:16.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15506602223390142590', time=2024-03-04T14:54:29.999970+0000, chain.objs.size()=1 2024-03-04T13:00:16.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.938+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.B-1aE-0DDiT9aULLJ3yx_KxBn5PVAIm_0 2024-03-04T13:00:16.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9246103876763925669', time=2024-03-04T14:54:30.116784+0000, chain.objs.size()=1 2024-03-04T13:00:16.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.woWCX5MbThvugcWBcizx854kuLQ2K-R_0 2024-03-04T13:00:16.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7700849125023736518', time=2024-03-04T14:54:30.125252+0000, chain.objs.size()=1 2024-03-04T13:00:16.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.65P7Rk5YUsyJw1GGllDbxWOU85UMMYN_0 2024-03-04T13:00:16.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15197501588901130965', time=2024-03-04T14:54:30.159722+0000, chain.objs.size()=1 2024-03-04T13:00:16.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7lnR_Rvp0o2VkRyVuu-qCEhhQVEGdWb_0 2024-03-04T13:00:16.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15024318875893860517', time=2024-03-04T14:54:30.171399+0000, chain.objs.size()=1 2024-03-04T13:00:16.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.UN1qi7LCrCCSkYZ-j1xOMeZipCP1TZR_0 2024-03-04T13:00:16.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14256199971065064850', time=2024-03-04T14:54:30.185419+0000, chain.objs.size()=1 2024-03-04T13:00:16.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.MrOuPd4U0IEsCd0tulAXFIB0qaSUnc2_0 2024-03-04T13:00:16.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15927246133817757744', time=2024-03-04T14:54:30.284908+0000, chain.objs.size()=1 2024-03-04T13:00:16.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.knwvIMKsA4xBE1ZH6GG2rvdfVw5fjBR_0 2024-03-04T13:00:16.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6935357504461815906', time=2024-03-04T14:54:30.305437+0000, chain.objs.size()=1 2024-03-04T13:00:16.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.CQH2jG5ezCNDKvsClr4Z4Y5-dqnpeSV_0 2024-03-04T13:00:16.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1895140620345060937', time=2024-03-04T14:54:30.319100+0000, chain.objs.size()=1 2024-03-04T13:00:16.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.In7oC4WPmV-iLg-Ew7wHue2i_KicRKW_0 2024-03-04T13:00:16.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18165396489526798746', time=2024-03-04T14:54:30.430803+0000, chain.objs.size()=1 2024-03-04T13:00:16.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2Szt1PfCJuQjXki5fD3d2_uw3OQ0zKv_0 2024-03-04T13:00:16.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5626319345709312808', time=2024-03-04T14:54:30.491974+0000, chain.objs.size()=1 2024-03-04T13:00:16.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ThcqyFq00FVPvf3Ub0wKfNsQdaXhfaG_0 2024-03-04T13:00:16.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13948513326036908310', time=2024-03-04T14:54:30.499545+0000, chain.objs.size()=1 2024-03-04T13:00:16.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.940+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wWUx2v8TNPKq0S7J0yliAe5nz1vyKWa_0 2024-03-04T13:00:16.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.942+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6687192553962985864', time=2024-03-04T14:54:30.591575+0000, chain.objs.size()=1 2024-03-04T13:00:16.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.942+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4Q-V29_Id_JH_FbBnDdL4fI9qOuTcPP_0 2024-03-04T13:00:16.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.942+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18019928070884859673', time=2024-03-04T14:54:30.593713+0000, chain.objs.size()=1 2024-03-04T13:00:16.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.942+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VjsPq6XAkEW8OEWiJL4TIm7cmYhIeOK_0 2024-03-04T13:00:16.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.942+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14674149565146681813', time=2024-03-04T14:54:30.611276+0000, chain.objs.size()=1 2024-03-04T13:00:16.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.942+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tKsgpo_FUK9wTAhW-LQd2_lek6vtfM4_0 2024-03-04T13:00:16.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.942+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6493944399886809194', time=2024-03-04T14:54:30.631621+0000, chain.objs.size()=1 2024-03-04T13:00:16.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.942+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ToFiiJziaPl7V_f8ixcDOCBEFqBEJfR_0 2024-03-04T13:00:16.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.942+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5520773280468664908', time=2024-03-04T14:54:30.754574+0000, chain.objs.size()=1 2024-03-04T13:00:16.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.942+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.QycFAe7_zILwz23uHVvNz9pVX5-QHTy_0 2024-03-04T13:00:16.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.942+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1897209182976544011', time=2024-03-04T14:54:30.765791+0000, chain.objs.size()=1 2024-03-04T13:00:16.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.942+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YnitEm45yDl4V-lq8yaF6wK_oyZ2euc_0 2024-03-04T13:00:16.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.943+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11010750360754173774', time=2024-03-04T14:54:30.776597+0000, chain.objs.size()=1 2024-03-04T13:00:16.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.943+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0corA5pzDaLIpvOWK6X27ibVJQDcYjk_0 2024-03-04T13:00:16.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.943+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13441659835293699315', time=2024-03-04T14:54:38.295607+0000, chain.objs.size()=1 2024-03-04T13:00:16.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.943+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.e86qn4rq75UyPfXIPo4ns-5-ilcGhJ9_0 2024-03-04T13:00:16.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.943+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9275886572698206143', time=2024-03-04T14:54:38.318790+0000, chain.objs.size()=1 2024-03-04T13:00:16.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.943+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pRcfw3ej9nyB0iXgDGk9rfyWJ3Y7jEa_0 2024-03-04T13:00:16.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.943+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15846239491830022988', time=2024-03-04T14:54:38.322824+0000, chain.objs.size()=1 2024-03-04T13:00:16.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.943+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.UIvS0NMBp18VcWcSIj-e4ciZNU6DL-o_0 2024-03-04T13:00:16.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.943+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7421899871494276860', time=2024-03-04T14:54:38.325841+0000, chain.objs.size()=1 2024-03-04T13:00:16.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.943+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kg1HhcmeBe8M3qTT6oXvF1KbZImi76R_0 2024-03-04T13:00:16.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.943+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8582225663992851456', time=2024-03-04T14:54:38.526681+0000, chain.objs.size()=1 2024-03-04T13:00:16.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.943+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Fk-jGne3nPa6ixBfc7zgLTGIuRSy6te_0 2024-03-04T13:00:16.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.944+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15914867234678260437', time=2024-03-04T14:54:38.542997+0000, chain.objs.size()=1 2024-03-04T13:00:16.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.944+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5ANJUExjXKjVTCeDV8Sc4FchMTfe6Qv_0 2024-03-04T13:00:16.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.944+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6923747442697049812', time=2024-03-04T14:54:38.544837+0000, chain.objs.size()=1 2024-03-04T13:00:16.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.944+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.U6lQSNPFdHPN4KiN9XaI-_b9dU1-C20_0 2024-03-04T13:00:16.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.944+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8600130607935864868', time=2024-03-04T14:54:38.626612+0000, chain.objs.size()=1 2024-03-04T13:00:16.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.944+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.T-iQaYQluh5VyZPPg0B8Ev0j019zKEi_0 2024-03-04T13:00:16.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.944+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9044675236326629200', time=2024-03-04T14:54:38.683958+0000, chain.objs.size()=1 2024-03-04T13:00:16.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.944+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5cEU2E7TYELlYfAcqQgwMigbBTOJfRm_0 2024-03-04T13:00:16.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.946+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/52232 2024-03-04T13:00:16.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-03-04T13:00:16.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14185984447986795579', time=2024-03-04T14:54:38.688236+0000, chain.objs.size()=1 2024-03-04T13:00:16.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zxwQuWnaCic-2BeieaDLcCISd-m6Rsh_0 2024-03-04T13:00:16.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16321497847796512738', time=2024-03-04T14:54:38.823189+0000, chain.objs.size()=1 2024-03-04T13:00:16.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0cydfNTv5dFrxoy347o8I2mLb2L1MTJ_0 2024-03-04T13:00:16.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9904003678056026620', time=2024-03-04T14:54:38.833855+0000, chain.objs.size()=1 2024-03-04T13:00:16.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.yKyKLj_SzbioM6BkR9ObFR6ntyMB85I_0 2024-03-04T13:00:16.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6009561645210037608', time=2024-03-04T14:54:38.849081+0000, chain.objs.size()=1 2024-03-04T13:00:16.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2ekCy1rpsSJG76I--gFdBENjpyei3YT_0 2024-03-04T13:00:16.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7732987680495103312', time=2024-03-04T14:54:38.850106+0000, chain.objs.size()=1 2024-03-04T13:00:16.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.XC1_Ch2Sr8rR1zLsm_DkqczdpE7nWsq_0 2024-03-04T13:00:16.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4887859777946275936', time=2024-03-04T14:54:38.957895+0000, chain.objs.size()=1 2024-03-04T13:00:16.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xvJL7GaE3135AGOtFXXqN3zQtHSk0bJ_0 2024-03-04T13:00:16.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12682675731667396622', time=2024-03-04T14:54:39.024477+0000, chain.objs.size()=1 2024-03-04T13:00:16.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.SLUAaV8nvBTbVszAOA6bX9X1PxI4DqQ_0 2024-03-04T13:00:16.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15746379427964132898', time=2024-03-04T14:54:39.030151+0000, chain.objs.size()=1 2024-03-04T13:00:16.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-eVzjjo0fgAlPsXp17DjzRFU1dS-z70_0 2024-03-04T13:00:16.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3067229758895752667', time=2024-03-04T14:54:39.131358+0000, chain.objs.size()=1 2024-03-04T13:00:16.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.JltMQAFUDkG27uJusRYNbJPv3p4MJW__0 2024-03-04T13:00:16.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.120818547293227686', time=2024-03-04T14:54:39.147520+0000, chain.objs.size()=1 2024-03-04T13:00:16.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.LK6F-95WQAe06i8WXocMGmA2CqP4Hk6_0 2024-03-04T13:00:16.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1950549716214111806', time=2024-03-04T14:54:39.150466+0000, chain.objs.size()=1 2024-03-04T13:00:16.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IkY9g6OKXCAthXIa_bHjZLNAvSY5UEp_0 2024-03-04T13:00:16.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17637313034791502061', time=2024-03-04T14:54:39.179237+0000, chain.objs.size()=1 2024-03-04T13:00:16.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.949+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eKY66-m25t1ny2B3nnPazqIqSwV5wWp_0 2024-03-04T13:00:16.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.951+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16258437834883084577', time=2024-03-04T14:54:39.180246+0000, chain.objs.size()=1 2024-03-04T13:00:16.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.951+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.CIh-tr5BFlV3SdxRieWUpWIIfJMbObf_0 2024-03-04T13:00:16.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.951+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.434894564519563544', time=2024-03-04T14:54:39.186144+0000, chain.objs.size()=1 2024-03-04T13:00:16.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.951+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2rKGSX8kk0m2S2wrxfzI7juAEBeRhb9_0 2024-03-04T13:00:16.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.951+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16707144585442087977', time=2024-03-04T14:54:39.186867+0000, chain.objs.size()=1 2024-03-04T13:00:16.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.951+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.A1R-Y3lpXOLMRdhbSUqFO0Z4NXowkt6_0 2024-03-04T13:00:16.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.951+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15977764200767278220', time=2024-03-04T14:54:39.264109+0000, chain.objs.size()=1 2024-03-04T13:00:16.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.951+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IKFdzLVOn__MXHuBUBjMtqmyXcNJ-OI_0 2024-03-04T13:00:16.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.951+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7188853472363022405', time=2024-03-04T14:54:39.287792+0000, chain.objs.size()=1 2024-03-04T13:00:16.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.951+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.uugNzMrxQNwPnD0aC7GloPT-hLBdNXR_0 2024-03-04T13:00:16.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.952+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3618154692028209033', time=2024-03-04T14:54:39.313773+0000, chain.objs.size()=1 2024-03-04T13:00:16.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.952+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7mtY0AFECkjFkLXSQ4Gqes7xPN2ZGAW_0 2024-03-04T13:00:16.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.952+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14373231802891776463', time=2024-03-04T14:54:39.343765+0000, chain.objs.size()=1 2024-03-04T13:00:16.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.952+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.AXAvuicciSGNPYTAldsL27pyD35zBk3_0 2024-03-04T13:00:16.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.952+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4782289055105409884', time=2024-03-04T14:54:39.349327+0000, chain.objs.size()=1 2024-03-04T13:00:16.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.952+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2WeIf7Bz1azuGNi_1wRQmsSSoEjB4x0_0 2024-03-04T13:00:16.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.952+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13094075689886994171', time=2024-03-04T14:54:39.421801+0000, chain.objs.size()=1 2024-03-04T13:00:16.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.952+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eGNXI_WzNLWcpxqxv-ejuFDSNDuDUan_0 2024-03-04T13:00:16.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.952+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10899095586592067291', time=2024-03-04T14:54:39.425502+0000, chain.objs.size()=1 2024-03-04T13:00:16.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.952+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.WBafke414WES-3ZCMHlDYcvTcA0otEN_0 2024-03-04T13:00:16.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.952+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15622039703635436201', time=2024-03-04T14:54:39.432459+0000, chain.objs.size()=1 2024-03-04T13:00:16.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.952+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ExTIKPiDnlTc8brxrP623DbWcV8pnX8_0 2024-03-04T13:00:16.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.953+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5569863457186898030', time=2024-03-04T14:54:39.436954+0000, chain.objs.size()=1 2024-03-04T13:00:16.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.953+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KcGgCqEx1nBGNM8AvrTfWWzkw28J05S_0 2024-03-04T13:00:16.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.953+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13893435928792843721', time=2024-03-04T14:54:39.437922+0000, chain.objs.size()=1 2024-03-04T13:00:16.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.953+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xsVUL5cPfM8dRZU--_-AXraTJtzTnGC_0 2024-03-04T13:00:16.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.954+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17016772772744916741', time=2024-03-04T14:54:39.448475+0000, chain.objs.size()=1 2024-03-04T13:00:16.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.954+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.lPLhOoWr8Qq9a29HXV9q_gsU77216xe_0 2024-03-04T13:00:16.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.954+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7288582693321295305', time=2024-03-04T14:54:39.473891+0000, chain.objs.size()=1 2024-03-04T13:00:16.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.954+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.bpMT2DWuNIti7NaUvuE6UvgzX6zPAc2_0 2024-03-04T13:00:16.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.954+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9625718648564230733', time=2024-03-04T14:54:39.475965+0000, chain.objs.size()=1 2024-03-04T13:00:16.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.954+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.TUInv5DcyVi2hjdd3K77RRD_HW78NqM_0 2024-03-04T13:00:16.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.954+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8557328014041839317', time=2024-03-04T14:55:31.827223+0000, chain.objs.size()=1 2024-03-04T13:00:16.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.954+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.412__shadow_.ekS0kMGRA6vU2k5WlJtvNCnauKNA89y_0 2024-03-04T13:00:16.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.954+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9621710620291013486', time=2024-03-04T14:56:07.786589+0000, chain.objs.size()=1 2024-03-04T13:00:16.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.954+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.490__multipart_mymultipart.2~BZeeIQ9VTDGtjOy4PJsEuWWXEyrQsdv.1 2024-03-04T13:00:16.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.955+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.486417760466176082', time=2024-03-04T14:56:13.290494+0000, chain.objs.size()=1 2024-03-04T13:00:16.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.955+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.492__shadow:weVhWPbWYTRP09qkNrz-eM8w9lNxSR-_.lhl8TgMOAF7nA_YUyUTmWm3vFmIAuWg_0 2024-03-04T13:00:16.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.955+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~WMqBlUwrr-i5_eGvJp7i7gjp4nnIwc8', time=2024-03-04T14:56:15.947820+0000, chain.objs.size()=1 2024-03-04T13:00:16.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.955+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.494__multipart_mymultipart.2~WMqBlUwrr-i5_eGvJp7i7gjp4nnIwc8.2 2024-03-04T13:00:16.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.955+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6696158881607406923', time=2024-03-04T14:57:29.124739+0000, chain.objs.size()=1 2024-03-04T13:00:16.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.955+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.542__shadow:O0QRwbRtv3nRHAzQB-xmDauzltEtQ7w_.Qua6exI02nYKq0JBNtPmkYxkqisOzef_0 2024-03-04T13:00:16.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.955+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16707903451972199105', time=2024-03-04T14:57:35.633541+0000, chain.objs.size()=1 2024-03-04T13:00:16.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.955+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:ww32ItWUUrBG4tQulu9IDhzOdJ6zINU_.3CsUxmfjwOdC_bwbN1v_NiZJGpnjV6-_0 2024-03-04T13:00:16.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.956+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17095700009371398032', time=2024-03-04T14:58:19.242333+0000, chain.objs.size()=1 2024-03-04T13:00:16.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.956+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.601__shadow_.9ozDmujAPyT2-68fFVFaMASfBgx_vTM_0 2024-03-04T13:00:16.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.956+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17498241755856880807', time=2024-03-04T14:59:11.025867+0000, chain.objs.size()=1 2024-03-04T13:00:16.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.956+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.677__shadow:.lnx4GZq6rLDLWc1yxKxDcYFSN602U2_.aFzBqy5BDGJ8wBvQf_P0--O7v-sL_Ti_0 2024-03-04T13:00:16.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.957+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:16.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.959+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T13:00:16.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.961+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:16.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.961+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:16.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45924' 2024-03-04T13:00:16.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15420332777204437275', time=2024-03-04T14:52:55.828160+0000, chain.objs.size()=3 2024-03-04T13:00:16.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.151__shadow_.aO03QzUD7JlbHfamUcCg0Aamg9D40Gj_0 2024-03-04T13:00:16.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.151__shadow_.aO03QzUD7JlbHfamUcCg0Aamg9D40Gj_1 2024-03-04T13:00:16.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.151__shadow_.aO03QzUD7JlbHfamUcCg0Aamg9D40Gj_2 2024-03-04T13:00:16.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_h5c5XCMN9QwZSim_ROLjHQcH6UP1BuV', time=2024-03-04T14:53:01.041102+0000, chain.objs.size()=1 2024-03-04T13:00:16.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.158__shadow_.FRPlhh1Eiq_53aAniyNoMWlpoJgd4ss_0 2024-03-04T13:00:16.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.189721896054619055', time=2024-03-04T14:53:34.053712+0000, chain.objs.size()=1 2024-03-04T13:00:16.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.212__shadow_.HKGTgnuVz5v1CoHyKs1-lMU37Xwlggr_0 2024-03-04T13:00:16.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2073052200217654842', time=2024-03-04T14:53:39.555303+0000, chain.objs.size()=1 2024-03-04T13:00:16.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.223__shadow_.OOB6XNpS2pa6r5ASVPxTeX3BtloYfbw_0 2024-03-04T13:00:16.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10010525593272590380', time=2024-03-04T14:53:40.434308+0000, chain.objs.size()=1 2024-03-04T13:00:16.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.225__shadow_.XFmQgnPIuQGSgpLGtiHoX53cA8ufcG5_0 2024-03-04T13:00:16.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14793283729049483119', time=2024-03-04T14:53:42.226514+0000, chain.objs.size()=1 2024-03-04T13:00:16.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.229__shadow_.uHvuJSdsEGzICISCrmBvTGvbLt8xttK_0 2024-03-04T13:00:16.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5393455847044156716', time=2024-03-04T14:53:42.665438+0000, chain.objs.size()=1 2024-03-04T13:00:16.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.230__shadow_.ZcRMVansaJ5bgck3kkw48rPa3cqqTMb_0 2024-03-04T13:00:16.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8499598458033169380', time=2024-03-04T14:53:52.045980+0000, chain.objs.size()=1 2024-03-04T13:00:16.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PJw2b9KggiMAZLNEIIMbhduqyie6o6I_0 2024-03-04T13:00:16.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3597130879489590724', time=2024-03-04T14:53:52.110115+0000, chain.objs.size()=1 2024-03-04T13:00:16.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.7TW-07jLU-wZMUP_mOMEId5dlWteLkO_0 2024-03-04T13:00:16.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17006074187482470573', time=2024-03-04T14:53:52.115836+0000, chain.objs.size()=1 2024-03-04T13:00:16.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.962+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.e1mp9o4ia5cn60gXzUMMg1W4x_rMM_c_0 2024-03-04T13:00:16.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11681341361439166363', time=2024-03-04T14:53:52.134055+0000, chain.objs.size()=1 2024-03-04T13:00:16.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.g6iOutl74RrpelSltt0waaNuQ4qQ4Yh_0 2024-03-04T13:00:16.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17664432611118831463', time=2024-03-04T14:53:52.298922+0000, chain.objs.size()=1 2024-03-04T13:00:16.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YgHkK9pxXmtcgl-IE2hn3FFITd5rVl3_0 2024-03-04T13:00:16.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7549269287314750370', time=2024-03-04T14:53:52.311538+0000, chain.objs.size()=1 2024-03-04T13:00:16.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.C4ZIDXOg4c6bfxVjW5RWFIUgumlFALn_0 2024-03-04T13:00:16.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15122890566190393304', time=2024-03-04T14:53:52.445212+0000, chain.objs.size()=1 2024-03-04T13:00:16.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wA3p7XX7dj4AE0G2zI-TwknvRyMjNG0_0 2024-03-04T13:00:16.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1071101016319278499', time=2024-03-04T14:53:52.450728+0000, chain.objs.size()=1 2024-03-04T13:00:16.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.SaVVG9yP7TgGeQPxAIs5Lfee81npMS__0 2024-03-04T13:00:16.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3497785801264866817', time=2024-03-04T14:53:52.466336+0000, chain.objs.size()=1 2024-03-04T13:00:16.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._Gwt2If-yWg5-2_qBXeqK3J4LjOjJc7_0 2024-03-04T13:00:16.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5805756765456355850', time=2024-03-04T14:53:52.482194+0000, chain.objs.size()=1 2024-03-04T13:00:16.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5pSeNJ8VIgB9K4_jgxMdFvO1ZNJXBVk_0 2024-03-04T13:00:16.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10389537254603139953', time=2024-03-04T14:53:52.662240+0000, chain.objs.size()=1 2024-03-04T13:00:16.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mu-gAXjjxuVVRGEqegHol1OsEigiO26_0 2024-03-04T13:00:16.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14778130227112018151', time=2024-03-04T14:53:52.665379+0000, chain.objs.size()=1 2024-03-04T13:00:16.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.9WtHCQeq93TGnE3e5fSniiruiNsFQfq_0 2024-03-04T13:00:16.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7879397024313074300', time=2024-03-04T14:53:52.741219+0000, chain.objs.size()=1 2024-03-04T13:00:16.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Q7dUUlBze6pFJw0-Mrkfzi6OpQ6R3xY_0 2024-03-04T13:00:16.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18085918318101568052', time=2024-03-04T14:53:52.743884+0000, chain.objs.size()=1 2024-03-04T13:00:16.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.965+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.rW-CZN9iWx-V9MNY8tPw7UuDxTLP8M5_0 2024-03-04T13:00:16.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.966+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4636569314485439415', time=2024-03-04T14:53:52.764903+0000, chain.objs.size()=1 2024-03-04T13:00:16.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.966+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VQLdm-loT9LPe-5PXGWqa4Ae9yx_Ruz_0 2024-03-04T13:00:16.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.966+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1050098440412656713', time=2024-03-04T14:53:52.771264+0000, chain.objs.size()=1 2024-03-04T13:00:16.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.967+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.7o600lrzSRF5UUgJgFAc_NtmjZ0WfTn_0 2024-03-04T13:00:16.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.967+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13166378370803169043', time=2024-03-04T14:53:52.775554+0000, chain.objs.size()=1 2024-03-04T13:00:16.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.967+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8ze0GeQv8SoQU8sItYTYGXfLbGvUrcM_0 2024-03-04T13:00:16.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.967+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14415676554490300912', time=2024-03-04T14:53:52.778141+0000, chain.objs.size()=1 2024-03-04T13:00:16.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.967+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.YNmGSwiRwKbeAkNmIXwvxL9i3LLW1CX_0 2024-03-04T13:00:16.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.967+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6641070480571021162', time=2024-03-04T14:53:52.791343+0000, chain.objs.size()=1 2024-03-04T13:00:16.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.967+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.RM4S-7ZZTABAGMf0j5YxltTI1rr-td3_0 2024-03-04T13:00:16.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.967+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13417811174889031310', time=2024-03-04T14:53:52.814064+0000, chain.objs.size()=1 2024-03-04T13:00:16.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.967+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.qPmauCTyK3yNoWTAZKMbC4HlyJZZGW__0 2024-03-04T13:00:16.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.967+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7646857177588707097', time=2024-03-04T14:53:52.827762+0000, chain.objs.size()=1 2024-03-04T13:00:16.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.967+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.d_i0cm4dwesXs1nQZ689WqxsZkmEsHS_0 2024-03-04T13:00:16.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.968+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3260315495365151688', time=2024-03-04T14:53:52.929216+0000, chain.objs.size()=1 2024-03-04T13:00:16.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.968+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8d9sLu4nduFyV1ER8ro0U9ZDkSOBYBs_0 2024-03-04T13:00:16.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.968+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13369501803565553970', time=2024-03-04T14:53:52.930065+0000, chain.objs.size()=1 2024-03-04T13:00:16.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.968+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.aIr_Wi6OKBz8zkrepQLRSz4Nz7AyAcz_0 2024-03-04T13:00:16.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.968+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5791872148521654016', time=2024-03-04T14:53:52.937056+0000, chain.objs.size()=1 2024-03-04T13:00:16.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.968+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.nSZ_6uItcqOS0-X4rK09DRyNMIbTFGw_0 2024-03-04T13:00:16.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.968+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14442922878441883633', time=2024-03-04T14:53:52.973808+0000, chain.objs.size()=1 2024-03-04T13:00:16.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.968+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.gjO5N2burCRIGNDrkmXxheO7XyiEJVm_0 2024-03-04T13:00:16.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.968+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5727957428280380984', time=2024-03-04T14:53:52.994344+0000, chain.objs.size()=1 2024-03-04T13:00:16.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.968+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8dN2vRMvUgNAQLBDe2q_tluwN5HcoSD_0 2024-03-04T13:00:16.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.969+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7726365551460308783', time=2024-03-04T14:53:53.086924+0000, chain.objs.size()=1 2024-03-04T13:00:16.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.969+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.BN3WPAWkvh7nWsOVaqmNDWI-KJx9biT_0 2024-03-04T13:00:16.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.969+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13887493120723897553', time=2024-03-04T14:53:53.114264+0000, chain.objs.size()=1 2024-03-04T13:00:16.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.969+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GGngz30vWjSH2HGeI8-nHPzkZ_2jvtd_0 2024-03-04T13:00:16.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.969+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16951638478406315973', time=2024-03-04T14:53:53.125381+0000, chain.objs.size()=1 2024-03-04T13:00:16.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.969+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Szbq8HkwiyrjMyNjnU-slWUtJhSINFx_0 2024-03-04T13:00:16.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.969+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9908757108031514685', time=2024-03-04T14:53:53.146563+0000, chain.objs.size()=1 2024-03-04T13:00:16.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.969+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.kXPQTxRHe2APTY5ykHB5mtK7K7DE-54_0 2024-03-04T13:00:16.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.969+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1024905040994241514', time=2024-03-04T14:53:53.168416+0000, chain.objs.size()=1 2024-03-04T13:00:16.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.969+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3XULSe03IKuyp081q5N8kNAsT-UVRq1_0 2024-03-04T13:00:16.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.969+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1465391896411295307', time=2024-03-04T14:53:53.259211+0000, chain.objs.size()=1 2024-03-04T13:00:16.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.969+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ia1-b4_nzBJIqzeSEeQclmw4gGlxYWa_0 2024-03-04T13:00:16.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.970+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2459841547691805944', time=2024-03-04T14:53:53.273574+0000, chain.objs.size()=1 2024-03-04T13:00:16.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.970+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jx-J3QR2xJGT749Ttfzs5E80buY5E-1_0 2024-03-04T13:00:16.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.970+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.448439801220175523', time=2024-03-04T14:53:53.275050+0000, chain.objs.size()=1 2024-03-04T13:00:16.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.970+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CC19MJKY1Jbv36jJlmpAUFjYry8C_nT_0 2024-03-04T13:00:16.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.970+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12396793519887558409', time=2024-03-04T14:53:53.279541+0000, chain.objs.size()=1 2024-03-04T13:00:16.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.970+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PX2wAljDkv5sxDXls75BVw90Xks08B7_0 2024-03-04T13:00:16.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14332001967462113999', time=2024-03-04T14:53:53.281396+0000, chain.objs.size()=1 2024-03-04T13:00:16.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Ip-TK55ScYo3YPmDMDFv9bxLrGLhsRO_0 2024-03-04T13:00:16.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12089913372949560537', time=2024-03-04T14:53:53.286280+0000, chain.objs.size()=1 2024-03-04T13:00:16.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.hcvpG56zOPinbHTShLc6kttubWE0Su2_0 2024-03-04T13:00:16.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2355119987332631923', time=2024-03-04T14:53:53.302345+0000, chain.objs.size()=1 2024-03-04T13:00:16.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.k9i-8HtuH2P9SJSPPFxE02FAUJ1LLgx_0 2024-03-04T13:00:16.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15387006477887440305', time=2024-03-04T14:53:56.562272+0000, chain.objs.size()=1 2024-03-04T13:00:16.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.240__shadow_.qqCtDQJ1haucmGknswHXhskOW6bIP3-_0 2024-03-04T13:00:17.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5494062571047583082', time=2024-03-04T14:53:58.816311+0000, chain.objs.size()=1 2024-03-04T13:00:17.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.245__shadow_._9k3GM_b2VxhJWPREmZOdH807e6LObl_0 2024-03-04T13:00:17.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16310288559008803669', time=2024-03-04T14:54:00.989903+0000, chain.objs.size()=1 2024-03-04T13:00:17.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.250__shadow_.ue5FE15_-kj_gmpvy2Tcm9A7MxhmF74_0 2024-03-04T13:00:17.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2234246384570290676', time=2024-03-04T14:54:01.859116+0000, chain.objs.size()=1 2024-03-04T13:00:17.002 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.252__shadow_.Am-309MF2mRS-SWVqjo2kBhTgvtoc5M_0 2024-03-04T13:00:17.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13474889789150356087', time=2024-03-04T14:54:04.513237+0000, chain.objs.size()=1 2024-03-04T13:00:17.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.971+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.258__shadow_.Nc4jZsdRGZwY1qJct7YoNNPhYMLxnZ2_0 2024-03-04T13:00:17.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.972+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8590760685498774736', time=2024-03-04T14:54:05.412170+0000, chain.objs.size()=1 2024-03-04T13:00:17.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.972+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.260__shadow_.NV0aiZ6hndSAneUWGR0EAMI7Yd6lGa6_0 2024-03-04T13:00:17.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.972+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4521680778305958469', time=2024-03-04T14:54:05.862343+0000, chain.objs.size()=1 2024-03-04T13:00:17.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.972+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.261__shadow_.BXoHR3ARSeuQyyw_ziu7Co_O4kiAU0V_0 2024-03-04T13:00:17.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12666456949245167868', time=2024-03-04T14:54:08.240801+0000, chain.objs.size()=1 2024-03-04T13:00:17.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.tZpZh7aBXF7GXDzpIPpxmjNirEl_jS9_0 2024-03-04T13:00:17.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10567864184685849041', time=2024-03-04T14:54:10.346727+0000, chain.objs.size()=1 2024-03-04T13:00:17.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.269__shadow_.Cr7tf0ssmniHcId1K-SXpAQmbd1jQiY_0 2024-03-04T13:00:17.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4049686174200635714', time=2024-03-04T14:54:12.205594+0000, chain.objs.size()=1 2024-03-04T13:00:17.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.273__shadow_.g608mQ9TAutybgGDUIiiNlfFOclulwu_0 2024-03-04T13:00:17.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12692168832582970381', time=2024-03-04T14:54:15.737361+0000, chain.objs.size()=1 2024-03-04T13:00:17.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.280__shadow:wvFZGYjVy4RDtIDm6LRWZwUN6fcnP-W_.eQME0uU1t2ZSWmKmxDgdbW56Up-uczP_0 2024-03-04T13:00:17.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3028826111372422571', time=2024-03-04T14:54:29.616342+0000, chain.objs.size()=1 2024-03-04T13:00:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.B155whsz6YMNwnumR36gr8gXlrhp6Fz_0 2024-03-04T13:00:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10174382480617072598', time=2024-03-04T14:54:29.691971+0000, chain.objs.size()=1 2024-03-04T13:00:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.zUWoa_mBZAUvkdwytahiCe3jrahYQk4_0 2024-03-04T13:00:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4893836900924977397', time=2024-03-04T14:54:29.703135+0000, chain.objs.size()=1 2024-03-04T13:00:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LEIacCVnQe_3Lm_VBz91xMF4Nn5DEqf_0 2024-03-04T13:00:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6887518498015092315', time=2024-03-04T14:54:29.780599+0000, chain.objs.size()=1 2024-03-04T13:00:17.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.szrMe7n8YoMOlKpoSw5dmnlx9Pmxqkr_0 2024-03-04T13:00:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17381018998354894776', time=2024-03-04T14:54:29.971494+0000, chain.objs.size()=1 2024-03-04T13:00:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.973+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.7q3cPJppVHe2vwHKK2UiK9PfbNj2t7o_0 2024-03-04T13:00:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.974+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12890222484930618554', time=2024-03-04T14:54:29.989539+0000, chain.objs.size()=1 2024-03-04T13:00:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.974+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2cNRCvOAB2dpgA85Ba4xhW4sVFCHRFB_0 2024-03-04T13:00:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.974+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17262920928258200533', time=2024-03-04T14:54:30.013439+0000, chain.objs.size()=1 2024-03-04T13:00:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.974+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.uDC4B6tFy8sCKvrTdcG-tPpNIjGVp5r_0 2024-03-04T13:00:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10084780637718220143', time=2024-03-04T14:54:30.101105+0000, chain.objs.size()=1 2024-03-04T13:00:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.JopabLDVAHdcST4d7tsjl83D4vSUZl9_0 2024-03-04T13:00:17.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11928954002738973888', time=2024-03-04T14:54:30.113475+0000, chain.objs.size()=1 2024-03-04T13:00:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-9EQTQnsnG9QZCgzI0AeHhtDikzrEXp_0 2024-03-04T13:00:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10769585209457338718', time=2024-03-04T14:54:30.279336+0000, chain.objs.size()=1 2024-03-04T13:00:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-XWVWzJuL8xS3FAj_ZHj_YNP6TD5hPI_0 2024-03-04T13:00:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11483624261067545056', time=2024-03-04T14:54:30.287257+0000, chain.objs.size()=1 2024-03-04T13:00:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YOKW_TOmv18RnWlwi65CC6cQiLtQyyX_0 2024-03-04T13:00:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15638550662084314223', time=2024-03-04T14:54:30.342214+0000, chain.objs.size()=1 2024-03-04T13:00:17.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.89dztyDLow8GubNc2W1NL_JuUviBOX1_0 2024-03-04T13:00:17.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7402734404915281102', time=2024-03-04T14:54:30.344652+0000, chain.objs.size()=1 2024-03-04T13:00:17.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.afIvPv9NXSA7QrBSUas5m7uSZYdaznX_0 2024-03-04T13:00:17.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4347326215103927304', time=2024-03-04T14:54:30.423998+0000, chain.objs.size()=1 2024-03-04T13:00:17.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.975+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lhxx9CbUMPKL758K7G6zwFGXIBLfLM0_0 2024-03-04T13:00:17.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.976+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9109674590326765260', time=2024-03-04T14:54:30.442139+0000, chain.objs.size()=1 2024-03-04T13:00:17.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.976+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.gducf7oN6doyo_h0z1PFR3mZyK45LZW_0 2024-03-04T13:00:17.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.976+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10084352020250272714', time=2024-03-04T14:54:30.455044+0000, chain.objs.size()=1 2024-03-04T13:00:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.976+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.gIcfw6gRE4YLmjlJoOedOPyFCQ8XGhg_0 2024-03-04T13:00:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17712877625013438448', time=2024-03-04T14:54:30.468957+0000, chain.objs.size()=1 2024-03-04T13:00:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.h6-yAjW3ndIPffpmgHLYEJvawuC_dkc_0 2024-03-04T13:00:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15143166728593749698', time=2024-03-04T14:54:30.488211+0000, chain.objs.size()=1 2024-03-04T13:00:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Oo6Xz8IwH5JcVRbYYzAKEzEh8km5ISs_0 2024-03-04T13:00:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.506302719154494019', time=2024-03-04T14:54:30.581671+0000, chain.objs.size()=1 2024-03-04T13:00:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.jyXHfC8xI4VgektC_D_wtKS7AZ5Y_Pg_0 2024-03-04T13:00:17.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13311304120375602310', time=2024-03-04T14:54:30.599852+0000, chain.objs.size()=1 2024-03-04T13:00:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5MucwBtArcf4Nb30k1ojH9eAsLH-r_m_0 2024-03-04T13:00:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4795912611147542773', time=2024-03-04T14:54:30.602773+0000, chain.objs.size()=1 2024-03-04T13:00:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.JVLKBS3Wg_5gcD2-2Xott6apRjLYldx_0 2024-03-04T13:00:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15625689934710645053', time=2024-03-04T14:54:30.606640+0000, chain.objs.size()=1 2024-03-04T13:00:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ImhXlrJ-yPX4fxzxw6bupycOoR9Bn85_0 2024-03-04T13:00:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8394335214307180674', time=2024-03-04T14:54:30.660974+0000, chain.objs.size()=1 2024-03-04T13:00:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.977+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.IaKYQ-EcanADZmgJSp6Rx3BwoTnhZNl_0 2024-03-04T13:00:17.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.978+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5841190933105610347', time=2024-03-04T14:54:30.739914+0000, chain.objs.size()=1 2024-03-04T13:00:17.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.978+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Y2ync_4O54eqf6RTmv_crgJ1ytSU7Xz_0 2024-03-04T13:00:17.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.978+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5287676135901689257', time=2024-03-04T14:54:30.745858+0000, chain.objs.size()=1 2024-03-04T13:00:17.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.978+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.JoxEIjGV5vVJOHtvJygXfv6_4EPyQQa_0 2024-03-04T13:00:17.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.978+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.96421295012804501', time=2024-03-04T14:54:30.758799+0000, chain.objs.size()=1 2024-03-04T13:00:17.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.978+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Kff00HB52Yvv7ehAtD-MJj7LQUMMVPv_0 2024-03-04T13:00:17.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6431128534152398956', time=2024-03-04T14:54:30.771961+0000, chain.objs.size()=1 2024-03-04T13:00:17.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.teIJAwo5GqY5aqlT-ezcApdsFoK3pZ4_0 2024-03-04T13:00:17.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6556779341867743431', time=2024-03-04T14:54:38.292721+0000, chain.objs.size()=1 2024-03-04T13:00:17.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.N59_o-m_MzZxd2mi6X7E7o9ZeEdc1OE_0 2024-03-04T13:00:17.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3787310364940751825', time=2024-03-04T14:54:38.299580+0000, chain.objs.size()=1 2024-03-04T13:00:17.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.FpnOxhD9BVLiViqGOWjIzV_JUg2XQ_q_0 2024-03-04T13:00:17.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9310727746752339232', time=2024-03-04T14:54:38.301975+0000, chain.objs.size()=1 2024-03-04T13:00:17.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ttW46r571XzR7FH2jHE2ntf0hT_kPmC_0 2024-03-04T13:00:17.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17793147287795679052', time=2024-03-04T14:54:38.338621+0000, chain.objs.size()=1 2024-03-04T13:00:17.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Z5JGgi7aMofWb7m6FbyKIFlBW0zGPo3_0 2024-03-04T13:00:17.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18016311040166654201', time=2024-03-04T14:54:38.347938+0000, chain.objs.size()=1 2024-03-04T13:00:17.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.wIl21jioak-SHeMII586rzzXaMjKCqA_0 2024-03-04T13:00:17.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15867856416076287620', time=2024-03-04T14:54:38.350664+0000, chain.objs.size()=1 2024-03-04T13:00:17.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.moj8c_dJkFT1Ug-7-Uvy3bpaqOeF-Vy_0 2024-03-04T13:00:17.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10409725425322918319', time=2024-03-04T14:54:38.375168+0000, chain.objs.size()=1 2024-03-04T13:00:17.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0SSQMadpC1htOKMajuCVo4B5aykisRU_0 2024-03-04T13:00:17.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12927573640334365673', time=2024-03-04T14:54:38.378633+0000, chain.objs.size()=1 2024-03-04T13:00:17.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ytbPT2Fratp_AhF2mq9aZQeBlwjlEYT_0 2024-03-04T13:00:17.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8120890927864307732', time=2024-03-04T14:54:38.379457+0000, chain.objs.size()=1 2024-03-04T13:00:17.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.O5lYrXiUpfH0fnmRqR46l9oCpXdBKdA_0 2024-03-04T13:00:17.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16308672814027872881', time=2024-03-04T14:54:38.498206+0000, chain.objs.size()=1 2024-03-04T13:00:17.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.979+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pctT3Wl0YBN2psc-WNwroyY3S3kKgwi_0 2024-03-04T13:00:17.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15136825174788157331', time=2024-03-04T14:54:38.522956+0000, chain.objs.size()=1 2024-03-04T13:00:17.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pFFXDRRRGuzo5LPVJLtrX07A93R7l3G_0 2024-03-04T13:00:17.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8705447442535658189', time=2024-03-04T14:54:38.531407+0000, chain.objs.size()=1 2024-03-04T13:00:17.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.4te-qX61B36Kqht3t6__Z5DcoD2dny-_0 2024-03-04T13:00:17.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14442831525920096660', time=2024-03-04T14:54:38.622283+0000, chain.objs.size()=1 2024-03-04T13:00:17.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rhmy0_TYJbtLdVpg8EcQO76-sKsjbl0_0 2024-03-04T13:00:17.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12584890696556836783', time=2024-03-04T14:54:38.633330+0000, chain.objs.size()=1 2024-03-04T13:00:17.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2t2sWwGsh5PXYfsTxxAGnLQlJtyaQnS_0 2024-03-04T13:00:17.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15203030270835203354', time=2024-03-04T14:54:38.646208+0000, chain.objs.size()=1 2024-03-04T13:00:17.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tF8KymFNOOOGwMQAxSrDRzEXH04uS0z_0 2024-03-04T13:00:17.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.515494615951514098', time=2024-03-04T14:54:38.647992+0000, chain.objs.size()=1 2024-03-04T13:00:17.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.FMZtrmo8nlqNzVCtDP9sWmOzQdVk9v-_0 2024-03-04T13:00:17.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9953476558682505225', time=2024-03-04T14:54:38.659484+0000, chain.objs.size()=1 2024-03-04T13:00:17.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.981+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.uoerp-ufRbOhum9sWADdHGY4SQB63bW_0 2024-03-04T13:00:17.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.983+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/45924 2024-03-04T13:00:17.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-03-04T13:00:17.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.760379381915727595', time=2024-03-04T14:54:38.663885+0000, chain.objs.size()=1 2024-03-04T13:00:17.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.hAoL2IP0tTWV1aORHIS5A-QH8kDlb2l_0 2024-03-04T13:00:17.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11847109698134489722', time=2024-03-04T14:54:38.673503+0000, chain.objs.size()=1 2024-03-04T13:00:17.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.LSopaBo1neSydkmh3dRryEwCPHzHP1Y_0 2024-03-04T13:00:17.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12200989301249546782', time=2024-03-04T14:54:38.678259+0000, chain.objs.size()=1 2024-03-04T13:00:17.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.SgDN3bnryyaMCNf4B6D0u6lO34Lo4jC_0 2024-03-04T13:00:17.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3855876536803501311', time=2024-03-04T14:54:38.684956+0000, chain.objs.size()=1 2024-03-04T13:00:17.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.dH7mjh4BWzsgk-cY6RJrrGJvmPoBI-G_0 2024-03-04T13:00:17.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15187142413937797800', time=2024-03-04T14:54:38.705027+0000, chain.objs.size()=1 2024-03-04T13:00:17.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ZafCirlTE1sOH9M7Xd0V-5mvrDkZkrr_0 2024-03-04T13:00:17.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17815158645597663453', time=2024-03-04T14:54:38.784651+0000, chain.objs.size()=1 2024-03-04T13:00:17.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iCSuvVcTQi2M26C8y9Owc556VbKdbfS_0 2024-03-04T13:00:17.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2406365945265729455', time=2024-03-04T14:54:38.788287+0000, chain.objs.size()=1 2024-03-04T13:00:17.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.8n3KVXbJQe91WKCkKmmAJsuewHflb_M_0 2024-03-04T13:00:17.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13219644231154985122', time=2024-03-04T14:54:38.801043+0000, chain.objs.size()=1 2024-03-04T13:00:17.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.-0wlTgnXatI5j8voG-WaqmYQPqDAXa7_0 2024-03-04T13:00:17.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8035818640166201739', time=2024-03-04T14:54:38.806977+0000, chain.objs.size()=1 2024-03-04T13:00:17.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.oFCwngN_Bwis5ONk2CyVwIoqFjzvEO6_0 2024-03-04T13:00:17.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14652183066481643323', time=2024-03-04T14:54:38.843219+0000, chain.objs.size()=1 2024-03-04T13:00:17.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.4ndZ40FS2WBcK8DRhLn--Q8C-2yMon6_0 2024-03-04T13:00:17.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13475647261952690024', time=2024-03-04T14:54:38.991344+0000, chain.objs.size()=1 2024-03-04T13:00:17.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ADZ5v_fdQM97yCgGRfk9hz2SOQTvE4M_0 2024-03-04T13:00:17.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2857757717788770462', time=2024-03-04T14:54:39.108508+0000, chain.objs.size()=1 2024-03-04T13:00:17.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.985+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xtIPL4uZv2-Dl90SuSqDuxLQQdmw0Ha_0 2024-03-04T13:00:17.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.986+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14270770381531980387', time=2024-03-04T14:54:39.157345+0000, chain.objs.size()=1 2024-03-04T13:00:17.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.986+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.YCo3NEpmLXfnTMcq8xht2VAYbcL7KcN_0 2024-03-04T13:00:17.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8899335678449389198', time=2024-03-04T14:54:39.162865+0000, chain.objs.size()=1 2024-03-04T13:00:17.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IIIz_chyEfrA2M__qa0Wg4cGYnT4wPX_0 2024-03-04T13:00:17.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6817832353126025233', time=2024-03-04T14:54:39.170269+0000, chain.objs.size()=1 2024-03-04T13:00:17.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.mJpOkymTXfMJyKxkRlh_F_oNjONTOzY_0 2024-03-04T13:00:17.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14023643897827274779', time=2024-03-04T14:54:39.187606+0000, chain.objs.size()=1 2024-03-04T13:00:17.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tSicu1b24H0A2vjTSbyj8ntPRhIXnVH_0 2024-03-04T13:00:17.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10415013426143703927', time=2024-03-04T14:54:39.266543+0000, chain.objs.size()=1 2024-03-04T13:00:17.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.elBrfZ7QaKv0ZHV3WsR0q4MAioBw-aP_0 2024-03-04T13:00:17.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10125987477713031883', time=2024-03-04T14:54:39.286139+0000, chain.objs.size()=1 2024-03-04T13:00:17.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.D0dl5WpE8pUD2nkPu21Y070Oy0FXIMX_0 2024-03-04T13:00:17.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13263392775376102608', time=2024-03-04T14:54:39.432993+0000, chain.objs.size()=1 2024-03-04T13:00:17.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Z5DEQX9i_J2G06oTlUnWtl288w8mu98_0 2024-03-04T13:00:17.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13731137845454764189', time=2024-03-04T14:54:39.483809+0000, chain.objs.size()=1 2024-03-04T13:00:17.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.frmz3DMH4B_uLScR3VI1aAoCfRnCcPV_0 2024-03-04T13:00:17.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3557291406720799439', time=2024-03-04T14:55:45.957286+0000, chain.objs.size()=1 2024-03-04T13:00:17.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.436__shadow_.qNR2AmbBDzqC-j9xyZts3aXaZwYiQXE_0 2024-03-04T13:00:17.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6006919657007560862', time=2024-03-04T14:55:47.129999+0000, chain.objs.size()=1 2024-03-04T13:00:17.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.438__shadow_.TbNEnYGtk4l0WfOtTzhVPJ_aoEBjJKu_0 2024-03-04T13:00:17.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4992642782588427999', time=2024-03-04T14:55:47.130679+0000, chain.objs.size()=1 2024-03-04T13:00:17.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.987+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.438__shadow_.Ad2bl7Nm14GP-a3n2ZtVVIeBMj7Tc9P_0 2024-03-04T13:00:17.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.988+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.460__shadow_.Q5SElOa8U4bT36YvcIH8dTOotb_U2bI_1_9bbcd350975d849115acc3aa7c230800', time=2024-03-04T14:55:54.670111+0000, chain.objs.size()=1 2024-03-04T13:00:17.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.988+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.460__shadow_.Q5SElOa8U4bT36YvcIH8dTOotb_U2bI_0 2024-03-04T13:00:17.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.988+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.470__shadow_.N5OLFb8yJJqPc6dCYq2IIqJKGfSEwBz_1_15449f6863cd0ce8db79271ec9c70ce9', time=2024-03-04T14:55:58.508529+0000, chain.objs.size()=1 2024-03-04T13:00:17.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.988+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.470__shadow_.N5OLFb8yJJqPc6dCYq2IIqJKGfSEwBz_0 2024-03-04T13:00:17.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.988+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14708608219977591571', time=2024-03-04T14:56:23.769043+0000, chain.objs.size()=4 2024-03-04T13:00:17.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.988+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~L7PR6ksFrrhv109-kl0Q_n9M3zJusuQ.1 2024-03-04T13:00:17.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.989+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__shadow_mymultipart.2~L7PR6ksFrrhv109-kl0Q_n9M3zJusuQ.1_1 2024-03-04T13:00:17.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.989+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__multipart_mymultipart.2~L7PR6ksFrrhv109-kl0Q_n9M3zJusuQ.2 2024-03-04T13:00:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.989+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.495__shadow_mymultipart.2~L7PR6ksFrrhv109-kl0Q_n9M3zJusuQ.2_1 2024-03-04T13:00:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.989+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3771938670514760698', time=2024-03-04T14:56:24.981744+0000, chain.objs.size()=2 2024-03-04T13:00:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.989+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~cIGSZ95rIXduws8sGZ3RJHVD02W9XgW.1 2024-03-04T13:00:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.990+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~cIGSZ95rIXduws8sGZ3RJHVD02W9XgW.2 2024-03-04T13:00:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.990+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5571972379941877980', time=2024-03-04T14:57:30.203869+0000, chain.objs.size()=1 2024-03-04T13:00:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.990+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.542__shadow:NtR04dQtTjMWl-0hZ3-gQerRhmVGiif_.TLXv-XWKhMyoiolgaGZKotIPT7zpYLT_0 2024-03-04T13:00:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.990+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15736701513159557153', time=2024-03-04T14:57:34.364546+0000, chain.objs.size()=1 2024-03-04T13:00:17.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.990+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:pLzhMB-Y7cmo7xP72UuilOA2nhrSdCs_.-8klNXeyEH5p-lFttdnANtdD-E6HyLG_0 2024-03-04T13:00:17.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.990+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15737186358631865481', time=2024-03-04T14:57:36.036213+0000, chain.objs.size()=1 2024-03-04T13:00:17.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.990+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:sIPw0cXDka2Iz7i08SGloekcfWmjlRK_.0bUmDP5p975t-2bpPlhewYlckfv40uL_0 2024-03-04T13:00:17.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.990+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15077568522617256446', time=2024-03-04T14:57:39.463456+0000, chain.objs.size()=1 2024-03-04T13:00:17.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.990+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:wQoDonWLQJZgu-D7buq3Z3-oX.xR9-8_.hiuZe0T8646pLNOfGWJR3fgnDJcAZfM_0 2024-03-04T13:00:17.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.990+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8930917021978182470', time=2024-03-04T14:58:47.308840+0000, chain.objs.size()=1 2024-03-04T13:00:17.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.990+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.665__shadow:N4QkySB6MMZBrnczpI5thozhJWVGz.w_.e9NPpeEQBi6z5dS7SIiN7Adizm8syAw_0 2024-03-04T13:00:17.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.993+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:17.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.995+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T13:00:17.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.997+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:17.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.997+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:17.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49886' 2024-03-04T13:00:17.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6263326744310532232', time=2024-03-04T14:52:50.673008+0000, chain.objs.size()=1 2024-03-04T13:00:17.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.135__shadow_.Ou9hN7ulWqyDDr_KIjLOb8_reRBMXKi_0 2024-03-04T13:00:17.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.559555033073452574', time=2024-03-04T14:53:09.406379+0000, chain.objs.size()=1 2024-03-04T13:00:17.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.169__shadow_.Md3_kmkpk-2GTCkAJzv8rO6f8Qo0YDI_0 2024-03-04T13:00:17.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7626742938867024162', time=2024-03-04T14:53:09.838186+0000, chain.objs.size()=1 2024-03-04T13:00:17.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.170__shadow_.RY9fXsB4KTEJ9dCaShcI9I8AInRvfwM_0 2024-03-04T13:00:17.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7913687076735918575', time=2024-03-04T14:53:24.460162+0000, chain.objs.size()=1 2024-03-04T13:00:17.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.193__shadow_.zryecKJeMU4t24sWdWwHEsl0zUazg1h_0 2024-03-04T13:00:17.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11797079725825446157', time=2024-03-04T14:53:32.035708+0000, chain.objs.size()=1 2024-03-04T13:00:17.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.209__shadow_.74FxeWAxRIPRGR5MXiEiJz2d-d5L6y__0 2024-03-04T13:00:17.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3872949509005965763', time=2024-03-04T14:53:35.321277+0000, chain.objs.size()=1 2024-03-04T13:00:17.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.215__shadow_.juJoNBilrogLD1GrrcONmqZOLNCruNZ_0 2024-03-04T13:00:17.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3897913572555987380', time=2024-03-04T14:53:36.938489+0000, chain.objs.size()=1 2024-03-04T13:00:17.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.217__shadow_.Y-8JUrp6L0GDyDFTTK1Hj2hpU5Lc2nw_0 2024-03-04T13:00:17.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3393888528889604116', time=2024-03-04T14:53:43.968843+0000, chain.objs.size()=1 2024-03-04T13:00:17.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.233__shadow_.OJpo7yNkT-U3iowODnrUl4rzo54Mf8M_0 2024-03-04T13:00:17.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2535856928323866985', time=2024-03-04T14:53:52.079667+0000, chain.objs.size()=1 2024-03-04T13:00:17.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.MDh0d0r0hYivcYjN13qL2aJuL1koU1Y_0 2024-03-04T13:00:17.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17718667863912701231', time=2024-03-04T14:53:52.093179+0000, chain.objs.size()=1 2024-03-04T13:00:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mmgQClVwzw6qXsnKIpjTr57JW6PBQjo_0 2024-03-04T13:00:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12251858495260668635', time=2024-03-04T14:53:52.123224+0000, chain.objs.size()=1 2024-03-04T13:00:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Li0OrdBCngBm3t4afpWoO59Lq06J_8e_0 2024-03-04T13:00:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15684549410967747688', time=2024-03-04T14:53:52.124140+0000, chain.objs.size()=1 2024-03-04T13:00:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:16.998+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GablV-LIdOXbZws_IYs4p022S440xSl_0 2024-03-04T13:00:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9211060678752160251', time=2024-03-04T14:53:52.260956+0000, chain.objs.size()=1 2024-03-04T13:00:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.SFZa0zdnvpl3vJAVU7D-lBNbR29Ob_y_0 2024-03-04T13:00:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1926099173709947426', time=2024-03-04T14:53:52.295305+0000, chain.objs.size()=1 2024-03-04T13:00:17.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ve1bDFiC9CqyhSk3XW4it92KKLS0g2r_0 2024-03-04T13:00:17.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5061201511214607387', time=2024-03-04T14:53:52.432734+0000, chain.objs.size()=1 2024-03-04T13:00:17.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jLtdYLVmetwKn6idprWaZEHqHm_naBw_0 2024-03-04T13:00:17.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9102575200791262399', time=2024-03-04T14:53:52.464131+0000, chain.objs.size()=1 2024-03-04T13:00:17.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.sWTCWm3OJQIJX44mluCHLH6o7Wios_j_0 2024-03-04T13:00:17.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3738349029659713697', time=2024-03-04T14:53:52.480294+0000, chain.objs.size()=1 2024-03-04T13:00:17.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3XoMKxAuBC4WsVTFOrrhazFmi8AYnrs_0 2024-03-04T13:00:17.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.850622627364929790', time=2024-03-04T14:53:52.485339+0000, chain.objs.size()=1 2024-03-04T13:00:17.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.u9sRpf0iI-V2tNDp9OkqDS4mHMAFFuc_0 2024-03-04T13:00:17.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13346697464041245277', time=2024-03-04T14:53:52.488472+0000, chain.objs.size()=1 2024-03-04T13:00:17.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zr9m0OdxaMF6q5v6qldjOgBgq41lLBh_0 2024-03-04T13:00:17.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3333824719345888686', time=2024-03-04T14:53:52.570443+0000, chain.objs.size()=1 2024-03-04T13:00:17.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.9AwAjPEgTbMzCbDMOHn6cyEeXfOYaHO_0 2024-03-04T13:00:17.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1540788382445271307', time=2024-03-04T14:53:52.592620+0000, chain.objs.size()=1 2024-03-04T13:00:17.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.p3sHTfPWnkdZpm-yiR76pTSaEBjnGU1_0 2024-03-04T13:00:17.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17840633979613067563', time=2024-03-04T14:53:52.599959+0000, chain.objs.size()=1 2024-03-04T13:00:17.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Q8NCOjF8GBx6DL_YK51y69FW2NaG8d9_0 2024-03-04T13:00:17.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4584628603648221457', time=2024-03-04T14:53:52.618008+0000, chain.objs.size()=1 2024-03-04T13:00:17.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.000+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wYknDh3mOw80Qiia7aC14vpswLGUKCb_0 2024-03-04T13:00:17.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.001+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16129213756066265411', time=2024-03-04T14:53:52.621040+0000, chain.objs.size()=1 2024-03-04T13:00:17.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.001+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3cSpmqcz4AcXMg5H5_X4W-CHw7i31qJ_0 2024-03-04T13:00:17.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4063430913693331393', time=2024-03-04T14:53:52.654375+0000, chain.objs.size()=1 2024-03-04T13:00:17.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JSx1QnWeu3BClFG8Vmke7kzrInlFx_-_0 2024-03-04T13:00:17.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10320229162136337156', time=2024-03-04T14:53:52.787657+0000, chain.objs.size()=1 2024-03-04T13:00:17.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.uN5A4NQnPgMZOXhvP3ueOvwuPYnDHSO_0 2024-03-04T13:00:17.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15439118978023395997', time=2024-03-04T14:53:52.815662+0000, chain.objs.size()=1 2024-03-04T13:00:17.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.cDWyw67hwjGwP8ACczw28yEYWzOVDjS_0 2024-03-04T13:00:17.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9990375287280799310', time=2024-03-04T14:53:52.826239+0000, chain.objs.size()=1 2024-03-04T13:00:17.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ahrpJXsK0-Ph6gPzV7uBvNdR59Ky7H__0 2024-03-04T13:00:17.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.002+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17344270611968331121', time=2024-03-04T14:53:52.831103+0000, chain.objs.size()=1 2024-03-04T13:00:17.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.002+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ekWsF4_oG4_3Rq-dmTMdlPxzRfyZ_CH_0 2024-03-04T13:00:17.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6746394857192405419', time=2024-03-04T14:53:52.918644+0000, chain.objs.size()=1 2024-03-04T13:00:17.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.BLokA-kOPX40oGjD52NsxpBFkSu8Ov-_0 2024-03-04T13:00:17.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5554131641967408362', time=2024-03-04T14:53:52.920724+0000, chain.objs.size()=1 2024-03-04T13:00:17.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-aH3-Smd3YhjczVmqyL3cwTG0pyyMSX_0 2024-03-04T13:00:17.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2639236197819827038', time=2024-03-04T14:53:52.943566+0000, chain.objs.size()=1 2024-03-04T13:00:17.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.M7Cqz9MIZyIPiv3japkvGxSFJkJdRkR_0 2024-03-04T13:00:17.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10688464848730598994', time=2024-03-04T14:53:52.963358+0000, chain.objs.size()=1 2024-03-04T13:00:17.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5aNQ_kZL-db6I7pG6fVsgDIoBmuYA63_0 2024-03-04T13:00:17.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13309203242157302492', time=2024-03-04T14:53:52.986241+0000, chain.objs.size()=1 2024-03-04T13:00:17.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yUJH-ChY6L2HPx0QJgnX7w-QmfN1YjG_0 2024-03-04T13:00:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13865305861159791116', time=2024-03-04T14:53:53.110578+0000, chain.objs.size()=1 2024-03-04T13:00:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5bwzOrUKdI0o1oL4mLqYX3JMveCIjXb_0 2024-03-04T13:00:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4516241335753227301', time=2024-03-04T14:53:53.121235+0000, chain.objs.size()=1 2024-03-04T13:00:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.003+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.lJ9qEk2WkckFZ1z_ohFnAM9PBJbc7F7_0 2024-03-04T13:00:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.004+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6551391789368458102', time=2024-03-04T14:53:53.127519+0000, chain.objs.size()=1 2024-03-04T13:00:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.004+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zGdQXQIQOrHfhrY9CbXsk8oN9YLmuCU_0 2024-03-04T13:00:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.004+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7306046476246232121', time=2024-03-04T14:53:53.158531+0000, chain.objs.size()=1 2024-03-04T13:00:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.004+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.pmnyMgv-3O3n7r_fFzt6KRCjpA5MXgu_0 2024-03-04T13:00:17.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.004+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14548569210478698909', time=2024-03-04T14:53:53.177350+0000, chain.objs.size()=1 2024-03-04T13:00:17.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.004+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JH28OrGz1bU2Q9y7VlKSw6KGpWnww4p_0 2024-03-04T13:00:17.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.004+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2164218447804108214', time=2024-03-04T14:53:53.256268+0000, chain.objs.size()=1 2024-03-04T13:00:17.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.004+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.A7lhR2sxMR3N3aD77PkD3lO3vYhVohI_0 2024-03-04T13:00:17.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.005+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14282085035281932254', time=2024-03-04T14:53:53.281760+0000, chain.objs.size()=1 2024-03-04T13:00:17.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.005+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.u1CH8mVlerfbbR9fLlGufAiO1-dvAnW_0 2024-03-04T13:00:17.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.138332429256232539', time=2024-03-04T14:53:53.298405+0000, chain.objs.size()=1 2024-03-04T13:00:17.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.DknLPRLYgP2cJ4LTK85CzY6-9RVg2B1_0 2024-03-04T13:00:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8194620148233968215', time=2024-03-04T14:53:53.302986+0000, chain.objs.size()=1 2024-03-04T13:00:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.TG-509Z7kQj1cKiqicq-xU5YHiGaKt__0 2024-03-04T13:00:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7856755793890689122', time=2024-03-04T14:53:53.313120+0000, chain.objs.size()=1 2024-03-04T13:00:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.5xDUmDgdg9EIHn75AzjQPiy1MDgK32T_0 2024-03-04T13:00:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10143235969422537737', time=2024-03-04T14:53:53.319091+0000, chain.objs.size()=1 2024-03-04T13:00:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ybzKftHOFRXklmL-czQdUNstdYSm6U3_0 2024-03-04T13:00:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13020566386448723606', time=2024-03-04T14:53:53.325465+0000, chain.objs.size()=1 2024-03-04T13:00:17.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.u1QQl8yHn7CZmcPR9uX4O0jaKfeDaDi_0 2024-03-04T13:00:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18034450001529048735', time=2024-03-04T14:53:57.881292+0000, chain.objs.size()=1 2024-03-04T13:00:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.243__shadow_.bKKOvOzpZim3zlbLIDlvJxOF01Oobg3_0 2024-03-04T13:00:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5348165096847620974', time=2024-03-04T14:54:00.570948+0000, chain.objs.size()=1 2024-03-04T13:00:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.249__shadow_.m7zgh0FT3LDLcDHh6Erze36Y41-hYAw_0 2024-03-04T13:00:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16984460641254418510', time=2024-03-04T14:54:04.013751+0000, chain.objs.size()=1 2024-03-04T13:00:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.257__shadow_.8PmAW45UTVXAUKVN1He0w41xpkdm525_0 2024-03-04T13:00:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6003902388805904654', time=2024-03-04T14:54:08.249038+0000, chain.objs.size()=1 2024-03-04T13:00:17.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.jIrWdeK3jcCWKnGJ2YWgN8j5NHLNwan_0 2024-03-04T13:00:17.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14991090891295119146', time=2024-03-04T14:54:08.250268+0000, chain.objs.size()=1 2024-03-04T13:00:17.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.006+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.6E-FFw0PnvoC0eumXqHDuxAWRSP94b__0 2024-03-04T13:00:17.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.007+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2633048654156722019', time=2024-03-04T14:54:09.037524+0000, chain.objs.size()=1 2024-03-04T13:00:17.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.007+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.wt0iX1_mY-WH3FpbPNsNRmXgudzm_0B_0 2024-03-04T13:00:17.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.007+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17400722385879877951', time=2024-03-04T14:54:11.753600+0000, chain.objs.size()=1 2024-03-04T13:00:17.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.007+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.272__shadow_.GRA-QL7o8yrJ5xcLzekB-335WPGjaPM_0 2024-03-04T13:00:17.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.007+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1773480903566860898', time=2024-03-04T14:54:29.639598+0000, chain.objs.size()=1 2024-03-04T13:00:17.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.007+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.XDo3fPbUQJ4Ztod4wpSinrQsXJMfyqY_0 2024-03-04T13:00:17.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.008+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7206904152129294562', time=2024-03-04T14:54:29.654423+0000, chain.objs.size()=1 2024-03-04T13:00:17.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Yn3PNNTGi4icLuNVD9Q2f7vhKNUo8_c_0 2024-03-04T13:00:17.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13937980467679437864', time=2024-03-04T14:54:29.683566+0000, chain.objs.size()=1 2024-03-04T13:00:17.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.4NR6-vmEoQ7ml79N9H175a7WfAop91I_0 2024-03-04T13:00:17.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7517306274972929961', time=2024-03-04T14:54:29.843948+0000, chain.objs.size()=1 2024-03-04T13:00:17.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yhBjuN_Nimem6z1PZgyDkUMv3Tlwi-t_0 2024-03-04T13:00:17.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5218398348961296002', time=2024-03-04T14:54:29.941400+0000, chain.objs.size()=1 2024-03-04T13:00:17.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.IExaJYaWRWlhVJ8nJO_45jPlBUf_ARp_0 2024-03-04T13:00:17.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10458829053983989033', time=2024-03-04T14:54:29.965478+0000, chain.objs.size()=1 2024-03-04T13:00:17.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.lgd9tyiUdtUkC_GyL106_vZYMv8TCFB_0 2024-03-04T13:00:17.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3072857176458152637', time=2024-03-04T14:54:29.968579+0000, chain.objs.size()=1 2024-03-04T13:00:17.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.JAsKapnMoR5bIFbjSK5vZRAFvANgs3p_0 2024-03-04T13:00:17.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6742864561869996164', time=2024-03-04T14:54:29.984720+0000, chain.objs.size()=1 2024-03-04T13:00:17.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.009+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0aFaKwdecvgoI4JEf_oU-gY-eAc_G4J_0 2024-03-04T13:00:17.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15420006533230601615', time=2024-03-04T14:54:29.995598+0000, chain.objs.size()=1 2024-03-04T13:00:17.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.vpmHW42hPbqLA4oQGRoTQ5WX1fkEgDx_0 2024-03-04T13:00:17.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16072776288802736467', time=2024-03-04T14:54:30.027186+0000, chain.objs.size()=1 2024-03-04T13:00:17.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.MPwbFSnrABov13hSYmnJkirirP16nqY_0 2024-03-04T13:00:17.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4527056678467802626', time=2024-03-04T14:54:30.173852+0000, chain.objs.size()=1 2024-03-04T13:00:17.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.sygQ3KYuWJ84eQqBWW12UL32ZRxHSeX_0 2024-03-04T13:00:17.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10408849206483035747', time=2024-03-04T14:54:30.174547+0000, chain.objs.size()=1 2024-03-04T13:00:17.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.bvbvz3EDecn5TOXykLo9UCRMPvS-qFr_0 2024-03-04T13:00:17.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11215585293395205112', time=2024-03-04T14:54:30.177600+0000, chain.objs.size()=1 2024-03-04T13:00:17.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.8tQnsFo78k4v1NluVnqiE4oZTdkT2hF_0 2024-03-04T13:00:17.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4166544200225667419', time=2024-03-04T14:54:30.315172+0000, chain.objs.size()=1 2024-03-04T13:00:17.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.wSVI3A7cdqWTuwoIKnDNqrXdP2gWLDK_0 2024-03-04T13:00:17.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15041238888081542332', time=2024-03-04T14:54:30.337974+0000, chain.objs.size()=1 2024-03-04T13:00:17.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.kQwZ5zLMnKAr711QfzA85skgPBruiM2_0 2024-03-04T13:00:17.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10953005606884797956', time=2024-03-04T14:54:30.420974+0000, chain.objs.size()=1 2024-03-04T13:00:17.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.010+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.1jv59PBJNkNa_0a_yU833T32m9HhDY0_0 2024-03-04T13:00:17.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.011+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11418236164387889677', time=2024-03-04T14:54:30.423607+0000, chain.objs.size()=1 2024-03-04T13:00:17.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.011+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.McSu_kO0PG19KrOIpYAT8_YHPa4et9z_0 2024-03-04T13:00:17.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.011+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5266738021516165172', time=2024-03-04T14:54:30.502864+0000, chain.objs.size()=1 2024-03-04T13:00:17.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.011+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FZ6xVY5nUqOpW_W9xmK4NjduaytRt4Z_0 2024-03-04T13:00:17.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.011+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17782398223387567860', time=2024-03-04T14:54:30.508212+0000, chain.objs.size()=1 2024-03-04T13:00:17.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.011+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.NJtQBgnAkYX-JLFpJBW5WzrpX6IGLBr_0 2024-03-04T13:00:17.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.012+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.37089289198508299', time=2024-03-04T14:54:30.580357+0000, chain.objs.size()=1 2024-03-04T13:00:17.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.peeD7JcJPTkgkLBqOrhGvqnLSJP-a-H_0 2024-03-04T13:00:17.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13908822114551891692', time=2024-03-04T14:54:30.602073+0000, chain.objs.size()=1 2024-03-04T13:00:17.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.TaiFx3DUFZy2fYpX1NhVdJYrJ9ayX41_0 2024-03-04T13:00:17.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7372319237885051721', time=2024-03-04T14:54:30.614534+0000, chain.objs.size()=1 2024-03-04T13:00:17.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cm2t9N-4s3sBouunagDM5kwWVuU1diZ_0 2024-03-04T13:00:17.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10233704996626883799', time=2024-03-04T14:54:30.618872+0000, chain.objs.size()=1 2024-03-04T13:00:17.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rBuIB97p1wNZwVlt589wFxeni_jxcnR_0 2024-03-04T13:00:17.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9199687110474780782', time=2024-03-04T14:54:30.631886+0000, chain.objs.size()=1 2024-03-04T13:00:17.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.GNn88QSN-xNGghtLv0Fhwa_9Wzf1Dsd_0 2024-03-04T13:00:17.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12061537925472229987', time=2024-03-04T14:54:30.632802+0000, chain.objs.size()=1 2024-03-04T13:00:17.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cS3fisA2SM8oAZIpaymeNk_ipHqvA-B_0 2024-03-04T13:00:17.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.137069999639847929', time=2024-03-04T14:54:30.644156+0000, chain.objs.size()=1 2024-03-04T13:00:17.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tN4cj_1c_zrXAkFWan3_hrebX9SLPjy_0 2024-03-04T13:00:17.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10748913086625423666', time=2024-03-04T14:54:30.773617+0000, chain.objs.size()=1 2024-03-04T13:00:17.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.US91uWMS1zJ84bPI2G5hkKR6SqkDAxK_0 2024-03-04T13:00:17.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12653250772801095053', time=2024-03-04T14:54:30.774514+0000, chain.objs.size()=1 2024-03-04T13:00:17.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.YGY_OKa_AeV9DOMb5oxKyNJrBg_7o9u_0 2024-03-04T13:00:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11229778690830075616', time=2024-03-04T14:54:30.776144+0000, chain.objs.size()=1 2024-03-04T13:00:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.a6ZceQvC2h3pOIxK-xzS8LJ4rXMLZCg_0 2024-03-04T13:00:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.938057352394009642', time=2024-03-04T14:54:30.785636+0000, chain.objs.size()=1 2024-03-04T13:00:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.013+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.79hwEEd30TQRiZRrWKIXb0Jr82QXwUD_0 2024-03-04T13:00:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.014+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5982005958785680260', time=2024-03-04T14:54:38.308519+0000, chain.objs.size()=1 2024-03-04T13:00:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.014+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Q4Jl5AEu43T3W-_MHNsxASeKvZFSPSn_0 2024-03-04T13:00:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.014+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10872987564583151715', time=2024-03-04T14:54:38.317391+0000, chain.objs.size()=1 2024-03-04T13:00:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.014+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.NxPtaqW3qR5U--Jk91dQqRuvTbB95rA_0 2024-03-04T13:00:17.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.014+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1562290329517265513', time=2024-03-04T14:54:38.329693+0000, chain.objs.size()=1 2024-03-04T13:00:17.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.014+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.4bfzB7td8XTihs12I7Sh7Se11PQ4jSc_0 2024-03-04T13:00:17.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.014+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17313620768236081547', time=2024-03-04T14:54:38.334187+0000, chain.objs.size()=1 2024-03-04T13:00:17.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.014+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.qtNsgY_gQKJcej6w8soketAHtT-p57B_0 2024-03-04T13:00:17.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.015+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4459475346017865258', time=2024-03-04T14:54:38.367066+0000, chain.objs.size()=1 2024-03-04T13:00:17.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.015+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5BXUyjn4w3KOiwanE_Qmc_XP4rGlhQ__0 2024-03-04T13:00:17.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.015+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8889865083338546073', time=2024-03-04T14:54:38.472375+0000, chain.objs.size()=1 2024-03-04T13:00:17.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.015+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._KWgn7Lf22geGQU2EMfpN3sL3ceH42m_0 2024-03-04T13:00:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.015+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7634661470975369761', time=2024-03-04T14:54:38.500702+0000, chain.objs.size()=1 2024-03-04T13:00:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.015+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.7j3RnEb8suclxd1birIzqBv4erI_Ib-_0 2024-03-04T13:00:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.015+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6544904132517029527', time=2024-03-04T14:54:38.521354+0000, chain.objs.size()=1 2024-03-04T13:00:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.015+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.UBxka3UtEYSsTOJuEm0zriwUz2lr8a2_0 2024-03-04T13:00:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.015+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3531409260957047662', time=2024-03-04T14:54:38.621890+0000, chain.objs.size()=1 2024-03-04T13:00:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.015+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zSUPQofAJoMwNxvPl4HV6HCSIbcqegm_0 2024-03-04T13:00:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.016+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4765177477287301851', time=2024-03-04T14:54:38.644267+0000, chain.objs.size()=1 2024-03-04T13:00:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.016+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.AMLqPZ169-l6NoLEHoS2ErtF7ZrMKYd_0 2024-03-04T13:00:17.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.016+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14862581388959068436', time=2024-03-04T14:54:38.676896+0000, chain.objs.size()=1 2024-03-04T13:00:17.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.016+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zzCmLZ5wle7ELH5q7uumerB6-vZ-rul_0 2024-03-04T13:00:17.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.016+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10757517680703539593', time=2024-03-04T14:54:38.679271+0000, chain.objs.size()=1 2024-03-04T13:00:17.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.016+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.XXuzmmOfo69Crah6nR-z-23WyLvKzE0_0 2024-03-04T13:00:17.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.016+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13875787559613969743', time=2024-03-04T14:54:38.692677+0000, chain.objs.size()=1 2024-03-04T13:00:17.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.016+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.qS5UKBFil3ia5OyqWk_gNmud6Nnwe2E_0 2024-03-04T13:00:17.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.017+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5718535948652398422', time=2024-03-04T14:54:38.790115+0000, chain.objs.size()=1 2024-03-04T13:00:17.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.017+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.GrVBMMwNKi8KZ7_CADOEAzz8ycM-t2p_0 2024-03-04T13:00:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.017+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2389553114825656870', time=2024-03-04T14:54:38.801506+0000, chain.objs.size()=1 2024-03-04T13:00:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.017+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._qmlhTkfixYBJe3Y30FWYlYDx2ez6no_0 2024-03-04T13:00:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.017+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1073851047417046128', time=2024-03-04T14:54:38.847304+0000, chain.objs.size()=1 2024-03-04T13:00:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.017+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.y8AXJwtW8jwZb1FOYWvrGQ2pvAuwQF__0 2024-03-04T13:00:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.017+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11134173871194551227', time=2024-03-04T14:54:38.857438+0000, chain.objs.size()=1 2024-03-04T13:00:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.017+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.OiP4XKLk2kytQi7oxCfJ5r3MztsfT05_0 2024-03-04T13:00:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.019+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/49886 2024-03-04T13:00:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-03-04T13:00:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14783139390031484880', time=2024-03-04T14:54:38.957605+0000, chain.objs.size()=1 2024-03-04T13:00:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.zkLRoJ-WeuLzESesEIxTtncSQ4u1ox1_0 2024-03-04T13:00:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12539790919280602231', time=2024-03-04T14:54:38.982446+0000, chain.objs.size()=1 2024-03-04T13:00:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.DlYg0pVnnyoyvBWOifrpSX4NZOstK-4_0 2024-03-04T13:00:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8112205321479102833', time=2024-03-04T14:54:38.990408+0000, chain.objs.size()=1 2024-03-04T13:00:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.c0AEDZoh58nf7MoUshvMjJV3JA1b--q_0 2024-03-04T13:00:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4471680969788294548', time=2024-03-04T14:54:39.012471+0000, chain.objs.size()=1 2024-03-04T13:00:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.EfOcskSy39AET3lbkuGZgUkeEE-O6A3_0 2024-03-04T13:00:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7909759193179624094', time=2024-03-04T14:54:39.024979+0000, chain.objs.size()=1 2024-03-04T13:00:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.TeDrW7wBCMDGsRs-LrsCskfIV70jTlu_0 2024-03-04T13:00:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9839580867797541988', time=2024-03-04T14:54:39.157476+0000, chain.objs.size()=1 2024-03-04T13:00:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.UueOS9BiYyBdT00L1XPyJcvnR0Fnhoo_0 2024-03-04T13:00:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16307586296911112572', time=2024-03-04T14:54:39.188511+0000, chain.objs.size()=1 2024-03-04T13:00:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tsXVHjH8YCzWvMF6vk5stfQ4HN2vM2n_0 2024-03-04T13:00:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17465676352457939856', time=2024-03-04T14:54:39.264529+0000, chain.objs.size()=1 2024-03-04T13:00:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KvDUj_9O3xKiaEZ1q0B9Iotrami0K1u_0 2024-03-04T13:00:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15792527509734067077', time=2024-03-04T14:54:39.293639+0000, chain.objs.size()=1 2024-03-04T13:00:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.PDQqbL-gbvYqPmPDITo78rjNpEvBRY9_0 2024-03-04T13:00:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8451488769891813792', time=2024-03-04T14:54:39.307177+0000, chain.objs.size()=1 2024-03-04T13:00:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kbDvUimO6u1aN6rDOrep00mBD2MiViK_0 2024-03-04T13:00:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8995905135960947528', time=2024-03-04T14:54:39.348029+0000, chain.objs.size()=1 2024-03-04T13:00:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xgE6ChWXpPNm0_Uehm5BfQk2yrrQYWw_0 2024-03-04T13:00:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11264362815522469158', time=2024-03-04T14:54:39.422105+0000, chain.objs.size()=1 2024-03-04T13:00:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.021+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jzq9InspcELUsuqFKF6_eP0tSogKJ_Y_0 2024-03-04T13:00:17.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.023+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6307111201181725237', time=2024-03-04T14:54:39.422940+0000, chain.objs.size()=1 2024-03-04T13:00:17.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.023+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.l4ivux0cXt7baFs0NapTsHDNP6Ve0gl_0 2024-03-04T13:00:17.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.023+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17870047172324370339', time=2024-03-04T14:54:39.444204+0000, chain.objs.size()=1 2024-03-04T13:00:17.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.023+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._AVvOkxh1hk6wMuB2hTM8DPPIgto3AI_0 2024-03-04T13:00:17.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.023+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12323351809026046019', time=2024-03-04T14:54:39.456160+0000, chain.objs.size()=1 2024-03-04T13:00:17.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.023+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.o4gFCCpJqQ20T4b6f6jiOUM-F0Hy_Bg_0 2024-03-04T13:00:17.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.023+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5552619516030852083', time=2024-03-04T14:54:39.467037+0000, chain.objs.size()=1 2024-03-04T13:00:17.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.023+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.uqaKzTHlUOaMxzP0pi8Jx7tCUhJQBG2_0 2024-03-04T13:00:17.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17959692351782364334', time=2024-03-04T14:54:39.470817+0000, chain.objs.size()=1 2024-03-04T13:00:17.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.XW-WKSVGcIQkGj6eKXNVyN-ygb1SxpH_0 2024-03-04T13:00:17.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8821667310883541443', time=2024-03-04T14:54:39.482691+0000, chain.objs.size()=1 2024-03-04T13:00:17.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Yy4l-Q-3BZggjAIW0jrCB9y_EYYjtTq_0 2024-03-04T13:00:17.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14418727465434053818', time=2024-03-04T14:54:41.453162+0000, chain.objs.size()=1 2024-03-04T13:00:17.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.302__shadow_.vyFuGOKinhu5wP9o9joQH_2rn-Av6XS_0 2024-03-04T13:00:17.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5870721471684183208', time=2024-03-04T14:54:58.891953+0000, chain.objs.size()=1 2024-03-04T13:00:17.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.345__shadow_.Ns2NwgaOLXzb_Omk90bF699-pcOWFJ1_0 2024-03-04T13:00:17.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5088792766688967774', time=2024-03-04T14:55:26.755459+0000, chain.objs.size()=1 2024-03-04T13:00:17.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.401__shadow_.S0CscTYjPaTpT5d8mwS0JeL6eXnD3mg_0 2024-03-04T13:00:17.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10845736103810485418', time=2024-03-04T14:55:45.744103+0000, chain.objs.size()=1 2024-03-04T13:00:17.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.436__shadow_.Y1KogglLoHA26T-nGIvVebPRrhHgo46_0 2024-03-04T13:00:17.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17430193000605810300', time=2024-03-04T14:55:52.266944+0000, chain.objs.size()=1 2024-03-04T13:00:17.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.024+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.455__shadow_.kUxLte1ADyPe2fZotIXrSu5hFY9KirH_0 2024-03-04T13:00:17.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.025+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17252455381154928919', time=2024-03-04T14:55:54.669299+0000, chain.objs.size()=1 2024-03-04T13:00:17.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.025+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.460__shadow_.Q5SElOa8U4bT36YvcIH8dTOotb_U2bI_0 2024-03-04T13:00:17.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.025+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.2_250d357cb6299bf55d38a5636a3b00a7', time=2024-03-04T14:56:03.319791+0000, chain.objs.size()=6 2024-03-04T13:00:17.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.025+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.1 2024-03-04T13:00:17.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.025+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.2 2024-03-04T13:00:17.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.025+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.3 2024-03-04T13:00:17.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.025+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.4 2024-03-04T13:00:17.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.5 2024-03-04T13:00:17.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.6 2024-03-04T13:00:17.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.676160360572662510', time=2024-03-04T14:56:25.412551+0000, chain.objs.size()=3 2024-03-04T13:00:17.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~55Q8p3RUZQBlTXM5G3_tcJ9N4JZG22u.1 2024-03-04T13:00:17.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__shadow_mymultipart.2~55Q8p3RUZQBlTXM5G3_tcJ9N4JZG22u.1_1 2024-03-04T13:00:17.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.497__multipart_mymultipart.2~55Q8p3RUZQBlTXM5G3_tcJ9N4JZG22u.2 2024-03-04T13:00:17.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4379839249556821397', time=2024-03-04T14:57:06.025446+0000, chain.objs.size()=1 2024-03-04T13:00:17.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.524__shadow_.COV1y2QyjxXYkqy-hkn-7iseTs91Zhc_0 2024-03-04T13:00:17.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3176875711741494889', time=2024-03-04T14:57:19.773460+0000, chain.objs.size()=1 2024-03-04T13:00:17.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:VGSDdzveu0T8-gTO3Ztbzr.TEzASEgT_.yeGEmAzoKXlmif4K_nc9ETBVOsvdPVI_0 2024-03-04T13:00:17.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6775759026763367111', time=2024-03-04T14:57:23.334068+0000, chain.objs.size()=1 2024-03-04T13:00:17.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.538__shadow_.FvlKmEKdrQjx33MYTxrhoF85pmoEHRZ_0 2024-03-04T13:00:17.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1037696490003280098', time=2024-03-04T14:57:24.017713+0000, chain.objs.size()=1 2024-03-04T13:00:17.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.539__shadow_.ktS90QlI07I4JBiVcVFZTqO1pYTHLUc_0 2024-03-04T13:00:17.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10772437747194229396', time=2024-03-04T14:57:32.128342+0000, chain.objs.size()=1 2024-03-04T13:00:17.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:-1zkOdW7Ds6K4ZC6hAZuhUGqB1mWvA8_.DAF6Acopa0II3TVJhIsFdchZdWDCtr5_0 2024-03-04T13:00:17.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:qWii2vrhAQCRg4.szYF0GOL04dSrqIQ_.ToxtbdpX0lw97ov2RWWAVKJr30ON6RW_1_1044fbc96745659f41f168c503d18ced', time=2024-03-04T14:57:48.456683+0000, chain.objs.size()=1 2024-03-04T13:00:17.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.027+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:qWii2vrhAQCRg4.szYF0GOL04dSrqIQ_.ToxtbdpX0lw97ov2RWWAVKJr30ON6RW_0 2024-03-04T13:00:17.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.028+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.428476342800298624', time=2024-03-04T14:57:51.014720+0000, chain.objs.size()=1 2024-03-04T13:00:17.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.028+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.551__shadow:tlWFTCeVFL6R1zhra7KIW53UT2jeYIK_.wyTrvgS6YRP8IIRkEsOgzQHxPaLug5P_0 2024-03-04T13:00:17.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.028+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4389671410728934320', time=2024-03-04T14:58:32.792998+0000, chain.objs.size()=1 2024-03-04T13:00:17.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.028+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.627__shadow_.-3TCHTGQ5StIXu3od19e5J5eA2RBT4-_0 2024-03-04T13:00:17.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.030+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:17.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.033+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T13:00:17.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.034+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:17.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.034+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:17.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41803' 2024-03-04T13:00:17.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12673434390819929865', time=2024-03-04T14:53:38.670938+0000, chain.objs.size()=1 2024-03-04T13:00:17.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.221__shadow_.WaXpSemq3wvsQXEdvJAEfIePQemdmag_0 2024-03-04T13:00:17.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2318561553803637477', time=2024-03-04T14:53:52.060759+0000, chain.objs.size()=1 2024-03-04T13:00:17.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.kRAkbXSXW-f75nHoj838uQZbveB9FwI_0 2024-03-04T13:00:17.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14263510786315183273', time=2024-03-04T14:53:52.219713+0000, chain.objs.size()=1 2024-03-04T13:00:17.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.T83Ww_MLQ9QjpJ7AzaP4TJRhF8U3PT3_0 2024-03-04T13:00:17.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13851685502745832744', time=2024-03-04T14:53:52.258854+0000, chain.objs.size()=1 2024-03-04T13:00:17.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.hdcskh4SQCTJTrJgRjpN2eCrnV4JRuB_0 2024-03-04T13:00:17.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8824362232824667380', time=2024-03-04T14:53:52.316287+0000, chain.objs.size()=1 2024-03-04T13:00:17.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.iz1SMpk_4tXZWd-VxNId53qJ4iFJaDB_0 2024-03-04T13:00:17.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18152633759041318131', time=2024-03-04T14:53:52.398010+0000, chain.objs.size()=1 2024-03-04T13:00:17.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.B81UstvW3DQYh8KVnK3xZRvwhLGOPy2_0 2024-03-04T13:00:17.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11196826028674428369', time=2024-03-04T14:53:52.426705+0000, chain.objs.size()=1 2024-03-04T13:00:17.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.V8537_J589TmkoM5RjwZCJ7rJEE1m9F_0 2024-03-04T13:00:17.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15472488594572030430', time=2024-03-04T14:53:52.588610+0000, chain.objs.size()=1 2024-03-04T13:00:17.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.sUhmod63JiOwG3UMZZuQiIfG1SQN3vY_0 2024-03-04T13:00:17.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6352759024868616713', time=2024-03-04T14:53:52.633449+0000, chain.objs.size()=1 2024-03-04T13:00:17.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Q6Hu6irN9LqRcYHwFuF4bZOj9qvB3Sg_0 2024-03-04T13:00:17.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6135457347434557650', time=2024-03-04T14:53:52.650265+0000, chain.objs.size()=1 2024-03-04T13:00:17.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.tljA0sP-sDnADlW_kdmQc8cekQT7ei5_0 2024-03-04T13:00:17.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1346866310514402830', time=2024-03-04T14:53:52.738088+0000, chain.objs.size()=1 2024-03-04T13:00:17.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.3i8efDZxfAAMpzr3OPn0daQH3Y8v_5V_0 2024-03-04T13:00:17.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16115913038062266530', time=2024-03-04T14:53:52.756888+0000, chain.objs.size()=1 2024-03-04T13:00:17.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.035+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.OH9uMxPYCdzRQcYrssVK1LQ51q3cBNh_0 2024-03-04T13:00:17.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.037+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13552968879062859616', time=2024-03-04T14:53:52.818624+0000, chain.objs.size()=1 2024-03-04T13:00:17.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.037+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VkGtrY4p5Qtm0wHZp5n9awE-CYDJdTB_0 2024-03-04T13:00:17.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.037+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8730678206314455135', time=2024-03-04T14:53:52.832420+0000, chain.objs.size()=1 2024-03-04T13:00:17.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.037+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.VoJHH55LGtFrIuyV2H2hxXR6B9dWtxO_0 2024-03-04T13:00:17.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.037+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3044324772467696417', time=2024-03-04T14:53:52.913742+0000, chain.objs.size()=1 2024-03-04T13:00:17.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.037+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.hWHeSqnHFqHmZwqM719Cxvl89JKVBJF_0 2024-03-04T13:00:17.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.037+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11852329595273409341', time=2024-03-04T14:53:52.925082+0000, chain.objs.size()=1 2024-03-04T13:00:17.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.037+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.drFi9kaNzARgrOF1ghWtryAGdDbEp_j_0 2024-03-04T13:00:17.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.037+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2220497019361619235', time=2024-03-04T14:53:52.925896+0000, chain.objs.size()=1 2024-03-04T13:00:17.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.037+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vSx4KOhLfIL4tSeO7WePuLC5xwnJyUf_0 2024-03-04T13:00:17.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10485865951543894741', time=2024-03-04T14:53:52.963806+0000, chain.objs.size()=1 2024-03-04T13:00:17.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8Dj9C3-QGFpSLdKwONI-hn0EEhDPPi5_0 2024-03-04T13:00:17.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14699829083505157163', time=2024-03-04T14:53:52.983477+0000, chain.objs.size()=1 2024-03-04T13:00:17.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.9qrfFvyiqwOdWHNBAYwwpJ4HRWjlh0d_0 2024-03-04T13:00:17.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3239792436982197531', time=2024-03-04T14:53:53.097541+0000, chain.objs.size()=1 2024-03-04T13:00:17.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wYJ2xHxu6o926VU4IPq55_qJz4pgrac_0 2024-03-04T13:00:17.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1122131575661939225', time=2024-03-04T14:53:53.114058+0000, chain.objs.size()=1 2024-03-04T13:00:17.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.C9tzpVfKe2wTUrEvEEyvUUZvFSNasOZ_0 2024-03-04T13:00:17.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1190417195917991532', time=2024-03-04T14:53:53.115152+0000, chain.objs.size()=1 2024-03-04T13:00:17.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.E7Tya-7WxdpUR2xqlM3F2G2PJzfQyH7_0 2024-03-04T13:00:17.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13376484880181504639', time=2024-03-04T14:53:53.124703+0000, chain.objs.size()=1 2024-03-04T13:00:17.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.CcRgH7ajIUmabgtbK2dN8wToXdC9FMn_0 2024-03-04T13:00:17.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.038+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13632077731950168376', time=2024-03-04T14:53:53.159750+0000, chain.objs.size()=1 2024-03-04T13:00:17.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.039+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xJ-qe8btP4E5lLXNSo0HUxgaPaHS07t_0 2024-03-04T13:00:17.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.039+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6838987727984895681', time=2024-03-04T14:53:53.299692+0000, chain.objs.size()=1 2024-03-04T13:00:17.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.039+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.I1P75k5AxupKeCsTg4TklHchISqKPU__0 2024-03-04T13:00:17.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.039+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2366537287309219478', time=2024-03-04T14:53:53.303571+0000, chain.objs.size()=1 2024-03-04T13:00:17.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.039+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.0V5vFgbUfCQlNtr8SVHKK-SbbanMWps_0 2024-03-04T13:00:17.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.039+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9793975467982116333', time=2024-03-04T14:53:53.313057+0000, chain.objs.size()=1 2024-03-04T13:00:17.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.039+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.PUTgnHkm2mVt8ykpAnyEhuxxzRlk8Ov_0 2024-03-04T13:00:17.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.039+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16812468410155839007', time=2024-03-04T14:54:01.859302+0000, chain.objs.size()=1 2024-03-04T13:00:17.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.039+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.252__shadow_.6-ZwgdRx8oU6NfdfrnwfE-hedZQG-CZ_0 2024-03-04T13:00:17.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.039+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3699274363407286538', time=2024-03-04T14:54:03.122918+0000, chain.objs.size()=1 2024-03-04T13:00:17.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.039+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.255__shadow_.cAjd3WvzLW-nDfanAHyYIqKBvevVHt-_0 2024-03-04T13:00:17.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.040+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6822877716460611377', time=2024-03-04T14:54:08.240964+0000, chain.objs.size()=1 2024-03-04T13:00:17.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.040+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.djsroXG3K4ss-yJIKZSaId0yVnW04LJ_0 2024-03-04T13:00:17.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.040+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13337482299076800137', time=2024-03-04T14:54:08.242074+0000, chain.objs.size()=1 2024-03-04T13:00:17.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.040+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.QDns4h4ekgimcpVtdmyc6pCX7JTJZOs_0 2024-03-04T13:00:17.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11159507444410051901', time=2024-03-04T14:54:08.251629+0000, chain.objs.size()=1 2024-03-04T13:00:17.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.e6d90gJbA-aXQZOZw9fKbcwXoquYLu3_0 2024-03-04T13:00:17.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10741907974507324764', time=2024-03-04T14:54:12.206286+0000, chain.objs.size()=1 2024-03-04T13:00:17.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.273__shadow_.jmf4wcmNxol9x8u8NhNM24aXnqwe2bI_0 2024-03-04T13:00:17.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3535172300231069410', time=2024-03-04T14:54:13.996168+0000, chain.objs.size()=1 2024-03-04T13:00:17.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.277__shadow_.3RMd0W9vVtH3KPGRpe2Z9zAbfaRfoH3_0 2024-03-04T13:00:17.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13446588696728710209', time=2024-03-04T14:54:29.627357+0000, chain.objs.size()=1 2024-03-04T13:00:17.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.-p4kXNqfmw60J7tDDa_B_GVlCd0_rbC_0 2024-03-04T13:00:17.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5457291638053763380', time=2024-03-04T14:54:29.671626+0000, chain.objs.size()=1 2024-03-04T13:00:17.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.yhfkVhRi1lYO1Czg_QjLRZanqCIGzx0_0 2024-03-04T13:00:17.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12315604750533888370', time=2024-03-04T14:54:29.826832+0000, chain.objs.size()=1 2024-03-04T13:00:17.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.jCZRIqzuuYDAu3V9mqZtlWxgX24jmzE_0 2024-03-04T13:00:17.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16071623121861916850', time=2024-03-04T14:54:29.836744+0000, chain.objs.size()=1 2024-03-04T13:00:17.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.k9gG5ReED6nEIflvXkfG2xXs6zJ7tN1_0 2024-03-04T13:00:17.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16266512936954474306', time=2024-03-04T14:54:29.849938+0000, chain.objs.size()=1 2024-03-04T13:00:17.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.AZDYKqiBVqURvnM4-YFHa_rU2LWzvS5_0 2024-03-04T13:00:17.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8360635625723924173', time=2024-03-04T14:54:29.940887+0000, chain.objs.size()=1 2024-03-04T13:00:17.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.041+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tuS6UWa3qYkPfhfQudFeLZdOcy52LcB_0 2024-03-04T13:00:17.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.042+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6675552734284425743', time=2024-03-04T14:54:29.959137+0000, chain.objs.size()=1 2024-03-04T13:00:17.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.042+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.DKOx7reFe0p-SzERV71Qp-T4jMJxPtf_0 2024-03-04T13:00:17.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.042+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10560411086793217103', time=2024-03-04T14:54:29.973679+0000, chain.objs.size()=1 2024-03-04T13:00:17.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.042+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.RwdLUTo4FfN3w_DzLg7gDtzbAMBT163_0 2024-03-04T13:00:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.043+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10521725990008000474', time=2024-03-04T14:54:30.012649+0000, chain.objs.size()=1 2024-03-04T13:00:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.043+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.8ziIoWNOMUuRvUJZOAjG1dSHPr4e-hI_0 2024-03-04T13:00:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.043+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4149142946071437410', time=2024-03-04T14:54:30.023673+0000, chain.objs.size()=1 2024-03-04T13:00:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.043+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.2CLpQAeXSEoe7Yhgd-yhTJIBKs_SED2_0 2024-03-04T13:00:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.043+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13648277027953286608', time=2024-03-04T14:54:30.102696+0000, chain.objs.size()=1 2024-03-04T13:00:17.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.043+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.AljPjBt7LVwK7vxZ_gRPSaKxDiUXcfb_0 2024-03-04T13:00:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.043+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2986142306465954715', time=2024-03-04T14:54:30.103436+0000, chain.objs.size()=1 2024-03-04T13:00:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.043+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.124cQ-O70nhkKIginkqJLMkIe7VP-GJ_0 2024-03-04T13:00:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10605692929157873801', time=2024-03-04T14:54:30.114015+0000, chain.objs.size()=1 2024-03-04T13:00:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oqQkqC-H8OJbH0nmQeXzOXeLh3t4DT8_0 2024-03-04T13:00:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16328368736841298234', time=2024-03-04T14:54:30.139904+0000, chain.objs.size()=1 2024-03-04T13:00:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.a0IEkYuFHlYUEIAL5cYGnLaoQBn6tHR_0 2024-03-04T13:00:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2762308916208690588', time=2024-03-04T14:54:30.185919+0000, chain.objs.size()=1 2024-03-04T13:00:17.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.eqcp93lTPxlx-3ovzQDqLy-8s41ygX6_0 2024-03-04T13:00:17.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.771830792789510602', time=2024-03-04T14:54:30.344607+0000, chain.objs.size()=1 2024-03-04T13:00:17.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.uelJGg7ZqBREIj5Erj6aHgKnGROr47O_0 2024-03-04T13:00:17.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4377725187833240612', time=2024-03-04T14:54:30.453662+0000, chain.objs.size()=1 2024-03-04T13:00:17.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.8xnHru9WrdZOLGxhJTFGXcPnfEVVqXq_0 2024-03-04T13:00:17.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14196576467834262528', time=2024-03-04T14:54:30.471935+0000, chain.objs.size()=1 2024-03-04T13:00:17.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.fu-kdmtKoSIQFdsBLjaY-CBeqlh4mHG_0 2024-03-04T13:00:17.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17518440479393885215', time=2024-03-04T14:54:30.491802+0000, chain.objs.size()=1 2024-03-04T13:00:17.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.FZYFUdoIg1kQrZ0nexnZFEtvdE-KHIW_0 2024-03-04T13:00:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14102229321101619354', time=2024-03-04T14:54:30.660022+0000, chain.objs.size()=1 2024-03-04T13:00:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.B4jAIRw0jYVzE2xfsrtHjCdTeqX9lgQ_0 2024-03-04T13:00:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2057018633266995979', time=2024-03-04T14:54:30.668730+0000, chain.objs.size()=1 2024-03-04T13:00:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.044+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.fm-tka0ej2dTgQAWe6PYBT8DV1OKUrP_0 2024-03-04T13:00:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11604317400776802095', time=2024-03-04T14:54:30.787271+0000, chain.objs.size()=1 2024-03-04T13:00:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.z4qvHj9BHeiwJuo73QMOgaR-0cv_VBf_0 2024-03-04T13:00:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7260194285678730900', time=2024-03-04T14:54:30.797920+0000, chain.objs.size()=1 2024-03-04T13:00:17.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oLsU2hrZwFXt3mgRj9qN2MnFnZRpesY_0 2024-03-04T13:00:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.045+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17043458130923134096', time=2024-03-04T14:54:30.803403+0000, chain.objs.size()=1 2024-03-04T13:00:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.045+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.LmFA2o4MJpMxZ9C2utUZS-UC_zRkekA_0 2024-03-04T13:00:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.046+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7173054028059266861', time=2024-03-04T14:54:38.318076+0000, chain.objs.size()=1 2024-03-04T13:00:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.046+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.FXgbkvRJkpVSnBBUUaPyg4lIxe8P4lU_0 2024-03-04T13:00:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.046+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7086243551346901379', time=2024-03-04T14:54:38.343191+0000, chain.objs.size()=1 2024-03-04T13:00:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.046+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.33vnjymVzfXOtAXVnUBi7rX2dr_r4gK_0 2024-03-04T13:00:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.046+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12385466296817471939', time=2024-03-04T14:54:38.345316+0000, chain.objs.size()=1 2024-03-04T13:00:17.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.046+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gA58molYri3NlN9Wfatv5KDT7OR6Hb8_0 2024-03-04T13:00:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.046+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12126724167846805631', time=2024-03-04T14:54:38.348668+0000, chain.objs.size()=1 2024-03-04T13:00:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.046+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._Rmane3dVrHBuLVcINWEtRISu6NrHPy_0 2024-03-04T13:00:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.046+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1994095553572469716', time=2024-03-04T14:54:38.368548+0000, chain.objs.size()=1 2024-03-04T13:00:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.046+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Qpw36mz0X1oyS5l3u-9Zpw4HVlvKEj__0 2024-03-04T13:00:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.046+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2487964973105974226', time=2024-03-04T14:54:38.456831+0000, chain.objs.size()=1 2024-03-04T13:00:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.046+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.uBhOcj98sfTqUI1qItHd1_pGAkwtFuM_0 2024-03-04T13:00:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.047+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16766934002410405432', time=2024-03-04T14:54:38.494327+0000, chain.objs.size()=1 2024-03-04T13:00:17.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.047+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.gpAsqKtJy-61JvjfKFvi1GzgJ_eui5L_0 2024-03-04T13:00:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.047+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18355119072781562761', time=2024-03-04T14:54:38.510013+0000, chain.objs.size()=1 2024-03-04T13:00:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.047+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KTdUMsTbXy9uYrxMJtXPWV0aSzyA6e6_0 2024-03-04T13:00:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.047+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6894927531345929146', time=2024-03-04T14:54:38.622247+0000, chain.objs.size()=1 2024-03-04T13:00:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.047+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.JUovuf62ZaossSz4kecC9YPoQin1mEt_0 2024-03-04T13:00:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.047+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12526001945573575658', time=2024-03-04T14:54:38.633414+0000, chain.objs.size()=1 2024-03-04T13:00:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.047+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.GwguseoNHC9QG8Zt5t-J5fRDajHGnBp_0 2024-03-04T13:00:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12765216146396270703', time=2024-03-04T14:54:38.664102+0000, chain.objs.size()=1 2024-03-04T13:00:17.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xeAiVLebcqLmkDkob-JH7u0OdtVLUoc_0 2024-03-04T13:00:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15548757534877594893', time=2024-03-04T14:54:38.801472+0000, chain.objs.size()=1 2024-03-04T13:00:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2W77XK_bnlwNJernk0Kupbqv-ovHaAb_0 2024-03-04T13:00:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4548116397213995095', time=2024-03-04T14:54:38.802164+0000, chain.objs.size()=1 2024-03-04T13:00:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.FIGltedYn-XmU8HJiTmLZizPDhwmHSo_0 2024-03-04T13:00:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13861425720833567731', time=2024-03-04T14:54:38.803072+0000, chain.objs.size()=1 2024-03-04T13:00:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.MqVEw8Xc-2D_jJ8darq_VQaUdg_uuWY_0 2024-03-04T13:00:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13633770282284800709', time=2024-03-04T14:54:38.847817+0000, chain.objs.size()=1 2024-03-04T13:00:17.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.p4ILyNJ4Zv4hhU6zI080Bs2IETlnFQh_0 2024-03-04T13:00:17.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15611076836229724782', time=2024-03-04T14:54:38.861369+0000, chain.objs.size()=1 2024-03-04T13:00:17.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.1_hE1cby70asPBmEmTlngqw91HSzJyg_0 2024-03-04T13:00:17.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1262921406866677736', time=2024-03-04T14:54:38.866378+0000, chain.objs.size()=1 2024-03-04T13:00:17.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.uqbbqZ4A8ZM9PvnGMF_D0CP8ytjVxAV_0 2024-03-04T13:00:17.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10635935965436793420', time=2024-03-04T14:54:38.947922+0000, chain.objs.size()=1 2024-03-04T13:00:17.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.3KDA7zxDvj983LIPIN7LVXlgPntRCVh_0 2024-03-04T13:00:17.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10689986498831664328', time=2024-03-04T14:54:38.958974+0000, chain.objs.size()=1 2024-03-04T13:00:17.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.048+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.GitHEppbEaxd-HEKkKarM7Uem9KsFXa_0 2024-03-04T13:00:17.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.049+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4376404305402025795', time=2024-03-04T14:54:38.966122+0000, chain.objs.size()=1 2024-03-04T13:00:17.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.049+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._KI4qSyYpiGsmCAA8uv4olW8QaEF4J2_0 2024-03-04T13:00:17.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.049+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13636787350768914788', time=2024-03-04T14:54:38.968783+0000, chain.objs.size()=1 2024-03-04T13:00:17.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.049+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.syHeWALnmZeQ-OkVz6kXUqstUwh13AS_0 2024-03-04T13:00:17.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18082129244679571391', time=2024-03-04T14:54:38.977273+0000, chain.objs.size()=1 2024-03-04T13:00:17.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IhSTDwpZwrxV45lV2D0JKRd-TmChc0x_0 2024-03-04T13:00:17.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14834591024820485293', time=2024-03-04T14:54:38.996197+0000, chain.objs.size()=1 2024-03-04T13:00:17.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iQQV355iLa3y6TRV2Y3jErLG-n2MUC6_0 2024-03-04T13:00:17.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11886332372265621288', time=2024-03-04T14:54:39.021563+0000, chain.objs.size()=1 2024-03-04T13:00:17.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.jnJJd1QnVfWrQhjPaLZLdOZCKdkywhn_0 2024-03-04T13:00:17.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18189247668949498120', time=2024-03-04T14:54:39.027310+0000, chain.objs.size()=1 2024-03-04T13:00:17.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cUoqr-d4xdLVfiWxxjRsDV4-IH01Ax3_0 2024-03-04T13:00:17.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12763254411174822114', time=2024-03-04T14:54:39.118805+0000, chain.objs.size()=1 2024-03-04T13:00:17.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.qkyqV0STIMdEtAHAFXPqL2SYXMvLxRI_0 2024-03-04T13:00:17.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17877246847983527847', time=2024-03-04T14:54:39.120614+0000, chain.objs.size()=1 2024-03-04T13:00:17.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Vmk8TMGodSzLKcV0zBaLcjl3Ow74R2N_0 2024-03-04T13:00:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15284424251037177973', time=2024-03-04T14:54:39.160687+0000, chain.objs.size()=1 2024-03-04T13:00:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.mhWW2hqTmFNP3Ostz8IOCRWecJWL02M_0 2024-03-04T13:00:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10179898468675984110', time=2024-03-04T14:54:39.162255+0000, chain.objs.size()=1 2024-03-04T13:00:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eaRK8JfRza5lw_pac9cRab-teVtCUSc_0 2024-03-04T13:00:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12916575596871234114', time=2024-03-04T14:54:39.179908+0000, chain.objs.size()=1 2024-03-04T13:00:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.QyXMXKVHXIZ-C-W_9_5LKTbQYUqaY19_0 2024-03-04T13:00:17.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6783844215644384581', time=2024-03-04T14:54:39.274950+0000, chain.objs.size()=1 2024-03-04T13:00:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rq6FTx5CAxveLoHoKBQQKlbOxwDh8qk_0 2024-03-04T13:00:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4377745284142479786', time=2024-03-04T14:54:39.337231+0000, chain.objs.size()=1 2024-03-04T13:00:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.051+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.0gXmKYgOn2RRbkUxXy5F_FChjep3Q-Y_0 2024-03-04T13:00:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5057992316602448857', time=2024-03-04T14:54:39.426382+0000, chain.objs.size()=1 2024-03-04T13:00:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.hKzDumDk_8T6rXlVOAE3VIxLbv1aMkO_0 2024-03-04T13:00:17.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13876022418853528441', time=2024-03-04T14:54:39.456856+0000, chain.objs.size()=1 2024-03-04T13:00:17.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tnTU8ZwIRWcvD7cH8-WKshjFKRiBD6D_0 2024-03-04T13:00:17.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13921885349070795115', time=2024-03-04T14:54:58.476472+0000, chain.objs.size()=1 2024-03-04T13:00:17.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.344__shadow_.ze6gbbI6CBHRMoGWKd1tnIowcriuRCG_0 2024-03-04T13:00:17.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10094081760683297514', time=2024-03-04T14:55:39.853785+0000, chain.objs.size()=1 2024-03-04T13:00:17.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.427__shadow_.lYvWaM39Dh3YRLJYYvCV0Xp39pGyhz0_0 2024-03-04T13:00:17.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1192980555538865330', time=2024-03-04T14:55:41.855763+0000, chain.objs.size()=1 2024-03-04T13:00:17.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.430__shadow_.DimOKZtXOqYqTxD82sp3AOehqaP6uZ__0 2024-03-04T13:00:17.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5675528240547605482', time=2024-03-04T14:55:44.668451+0000, chain.objs.size()=1 2024-03-04T13:00:17.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.434__shadow_.5VYS8gyVi8DfHAZQQn9Cv-3wW0dAvru_0 2024-03-04T13:00:17.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3557513840522737079', time=2024-03-04T14:55:52.270966+0000, chain.objs.size()=1 2024-03-04T13:00:17.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.455__shadow_.GT2bIC46oIusMiqU9FbUVYnxbJAQElJ_0 2024-03-04T13:00:17.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11687935433380542447', time=2024-03-04T14:55:52.723019+0000, chain.objs.size()=1 2024-03-04T13:00:17.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.456__shadow_.Ig9q6tPTGNjUG4finVn57Ess6GQAbEb_0 2024-03-04T13:00:17.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16926370966599767291', time=2024-03-04T14:57:01.942187+0000, chain.objs.size()=1 2024-03-04T13:00:17.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.517__shadow_.zQz53k2bYxoJKZ-ll1uuqJlmlFzt8zU_0 2024-03-04T13:00:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3764359460658009529', time=2024-03-04T14:57:03.489820+0000, chain.objs.size()=1 2024-03-04T13:00:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.053+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.520__shadow_.3OrhPPddm6R4HYRHiMeKnjLq_QMJH4S_0 2024-03-04T13:00:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.056+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/41803 2024-03-04T13:00:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T13:00:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14526225357329043359', time=2024-03-04T14:57:47.281781+0000, chain.objs.size()=1 2024-03-04T13:00:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.545__shadow:5p77GyNiGEa7qnEACIdpsby4VymRvUC_.94FdGROVnuEK56MPb3xbYCGFVq9TCWu_0 2024-03-04T13:00:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2818048308384931928', time=2024-03-04T14:57:48.468440+0000, chain.objs.size()=1 2024-03-04T13:00:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.546__shadow:qWii2vrhAQCRg4.szYF0GOL04dSrqIQ_.ToxtbdpX0lw97ov2RWWAVKJr30ON6RW_0 2024-03-04T13:00:17.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17054616289872557688', time=2024-03-04T14:58:15.171778+0000, chain.objs.size()=1 2024-03-04T13:00:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.591__shadow_.aq5KY1zQzFVr4Loq6n_gla0eeLXKxod_0 2024-03-04T13:00:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2523022606615767903', time=2024-03-04T14:58:19.788895+0000, chain.objs.size()=1 2024-03-04T13:00:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.602__shadow_.KmMB2S3F-GmutENRS5BG8sjCJj-i9nv_0 2024-03-04T13:00:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12713065405719731634', time=2024-03-04T14:58:23.125149+0000, chain.objs.size()=1 2024-03-04T13:00:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.609__shadow_.61t-fLVCAiv7iidx75g1KJVFQk-NSUH_0 2024-03-04T13:00:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15310344755454004430', time=2024-03-04T14:59:20.482940+0000, chain.objs.size()=1 2024-03-04T13:00:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.058+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.697__shadow_.h7-CdZK0dpLUnUXPxlRi_fRexuMrlk__0 2024-03-04T13:00:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.060+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:17.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.062+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T13:00:17.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.063+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:17.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.064+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:17.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45182' 2024-03-04T13:00:17.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7933994981343470762', time=2024-03-04T14:53:00.208584+0000, chain.objs.size()=1 2024-03-04T13:00:17.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.155__shadow_.4SMtlnu0cd-vR5B_3yayxCh_DwjAE5x_0 2024-03-04T13:00:17.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12866107150067180656', time=2024-03-04T14:53:01.119041+0000, chain.objs.size()=1 2024-03-04T13:00:17.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.159__shadow_.wH4NAEs8-dfyGH1RRHeQBT1X9H0tOfk_0 2024-03-04T13:00:17.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2680444777290005708', time=2024-03-04T14:53:11.618512+0000, chain.objs.size()=1 2024-03-04T13:00:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.175__shadow_.mWaTtV5WfvdwR8HLLbOLsvpi-H01dna_0 2024-03-04T13:00:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~_A8RqzzvcJ8X-HOreTBFLbftI0330Xp', time=2024-03-04T14:53:24.841523+0000, chain.objs.size()=1 2024-03-04T13:00:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.194__multipart_mymultipart.2~_A8RqzzvcJ8X-HOreTBFLbftI0330Xp.1 2024-03-04T13:00:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9754366271686917044', time=2024-03-04T14:53:32.035557+0000, chain.objs.size()=1 2024-03-04T13:00:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.209__shadow_.Yzc7tvV2VbkRC1bCbm5mFsgIKc9G-B8_0 2024-03-04T13:00:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5555221779769932429', time=2024-03-04T14:53:33.625730+0000, chain.objs.size()=1 2024-03-04T13:00:17.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.211__shadow_.2V7W82EkIrZUGxw4u2rlwyNs94bRSkW_0 2024-03-04T13:00:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11854124946454726784', time=2024-03-04T14:53:39.556103+0000, chain.objs.size()=1 2024-03-04T13:00:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.223__shadow_.ybCnmgcXuyuUyIw7_BlNRwnH1MUAq68_0 2024-03-04T13:00:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.635754999959450777', time=2024-03-04T14:53:39.557033+0000, chain.objs.size()=1 2024-03-04T13:00:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.223__shadow_.c8tQubvroanYwm5i8gK7ftes87B3i5K_0 2024-03-04T13:00:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6388423625758996275', time=2024-03-04T14:53:40.435069+0000, chain.objs.size()=1 2024-03-04T13:00:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.225__shadow_.iyxdO851mz-niIHH9HJAtaPh_glwePr_0 2024-03-04T13:00:17.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13655207778573199479', time=2024-03-04T14:53:40.877760+0000, chain.objs.size()=1 2024-03-04T13:00:17.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.226__shadow_.76wMctDKmtmk12MRXwH-60wl1Ef-ZMS_0 2024-03-04T13:00:17.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9928107699887078114', time=2024-03-04T14:53:44.380561+0000, chain.objs.size()=1 2024-03-04T13:00:17.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.234__shadow_.x6s3euYSZIrUSiL06MwBghmrUrGh_sq_0 2024-03-04T13:00:17.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1929896828543771081', time=2024-03-04T14:53:52.051417+0000, chain.objs.size()=1 2024-03-04T13:00:17.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.065+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.MiaHsABsgegUVFYOWDm89bkvf_xtNxC_0 2024-03-04T13:00:17.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.066+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.172970449767495022', time=2024-03-04T14:53:52.087788+0000, chain.objs.size()=1 2024-03-04T13:00:17.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.066+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JvsqN9a8xVM1LTzEzXSRdiAyB3zz9qH_0 2024-03-04T13:00:17.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.067+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10841642967946815328', time=2024-03-04T14:53:52.221292+0000, chain.objs.size()=1 2024-03-04T13:00:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.067+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.cXKkrYt-odXfhWaRBu3x72ja52fgHHA_0 2024-03-04T13:00:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.067+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4718086896223486902', time=2024-03-04T14:53:52.266304+0000, chain.objs.size()=1 2024-03-04T13:00:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.067+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.G9ACrgaOjgCSDhBhFtkrtDaDew3jzyx_0 2024-03-04T13:00:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.067+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11977537173927724175', time=2024-03-04T14:53:52.296427+0000, chain.objs.size()=1 2024-03-04T13:00:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.067+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.mvF_denPG81PWKF3VMtjDgibNQC2_3V_0 2024-03-04T13:00:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.067+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4022780400870906539', time=2024-03-04T14:53:52.439034+0000, chain.objs.size()=1 2024-03-04T13:00:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.067+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LwmckQDL54BU-kAC_CIzyI1_ZgpXdii_0 2024-03-04T13:00:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.067+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10644962062313822375', time=2024-03-04T14:53:52.454317+0000, chain.objs.size()=1 2024-03-04T13:00:17.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.067+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zfr6qw8L_ZH-1IgwcXq7YccK3jiO8fz_0 2024-03-04T13:00:17.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.067+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17609730365023935962', time=2024-03-04T14:53:52.477254+0000, chain.objs.size()=1 2024-03-04T13:00:17.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.067+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.aVLa-vAPVaA2Pws_-IfiaRY1jyX-OfN_0 2024-03-04T13:00:17.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.068+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17665009208548011022', time=2024-03-04T14:53:52.606294+0000, chain.objs.size()=1 2024-03-04T13:00:17.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.068+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.NBmy249dZNjGR3xrPy8YFvZtpwrPuT-_0 2024-03-04T13:00:17.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.068+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5899522787828881347', time=2024-03-04T14:53:52.619683+0000, chain.objs.size()=1 2024-03-04T13:00:17.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.068+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.zoUE_TiW4-htMVqQFznqsSeCK__-sdn_0 2024-03-04T13:00:17.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.068+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6947610383979730267', time=2024-03-04T14:53:52.636722+0000, chain.objs.size()=1 2024-03-04T13:00:17.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.068+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jZoo_3tjFFBeh1Er5eHrDJAuz06Fwg0_0 2024-03-04T13:00:17.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.068+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17017232284154381028', time=2024-03-04T14:53:52.644240+0000, chain.objs.size()=1 2024-03-04T13:00:17.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.068+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.BQ0UkCb5EBokvj8eDKLTLQneG98v2FO_0 2024-03-04T13:00:17.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4428591602978759477', time=2024-03-04T14:53:52.663354+0000, chain.objs.size()=1 2024-03-04T13:00:17.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.NmtdqOPnILf11H2Dlg3tSnwbOH4EBhw_0 2024-03-04T13:00:17.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.820113451354853075', time=2024-03-04T14:53:52.754030+0000, chain.objs.size()=1 2024-03-04T13:00:17.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ZvgeuDXFUGzamwNYW8D17tztQ0IurcM_0 2024-03-04T13:00:17.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16716490247566560568', time=2024-03-04T14:53:52.767098+0000, chain.objs.size()=1 2024-03-04T13:00:17.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.Bsj7whg_MarNXsKOlKnKvrBF21PQC0X_0 2024-03-04T13:00:17.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11298970066647241057', time=2024-03-04T14:53:52.836369+0000, chain.objs.size()=1 2024-03-04T13:00:17.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.WVqqzInS3HjBACOpmTeVVE7daWkqSOD_0 2024-03-04T13:00:17.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16140142624244804934', time=2024-03-04T14:53:52.911413+0000, chain.objs.size()=1 2024-03-04T13:00:17.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yZcxMfrmni4CIZoUueAU5T7KVZf1pmt_0 2024-03-04T13:00:17.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14051232666496110592', time=2024-03-04T14:53:52.917417+0000, chain.objs.size()=1 2024-03-04T13:00:17.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JNshBDlWHGJqsuhqaVqVxiwEg_tA3Uf_0 2024-03-04T13:00:17.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2068036654926841797', time=2024-03-04T14:53:52.947772+0000, chain.objs.size()=1 2024-03-04T13:00:17.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.wZb3yrNa5vyzTKaHqBUZO5KBftWSMYs_0 2024-03-04T13:00:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13457360951994196542', time=2024-03-04T14:53:52.948569+0000, chain.objs.size()=1 2024-03-04T13:00:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.069+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.oRvKTyl29FOCmvuRVv1UUhAlunazj6U_0 2024-03-04T13:00:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.070+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2866716619376641853', time=2024-03-04T14:53:53.000380+0000, chain.objs.size()=1 2024-03-04T13:00:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.070+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xiM5saXGQIs9ZXApk3CCpxWdJTGeigT_0 2024-03-04T13:00:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.070+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4222968275676388261', time=2024-03-04T14:53:53.092722+0000, chain.objs.size()=1 2024-03-04T13:00:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.070+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.GKmSR_8vTY9f1c5YCZkRMpPSeLgYQ35_0 2024-03-04T13:00:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.070+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2388605850228287699', time=2024-03-04T14:53:53.116629+0000, chain.objs.size()=1 2024-03-04T13:00:17.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.070+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.h60t0ofYGCAx3Hb3CEdxm1e2PVm_3A3_0 2024-03-04T13:00:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12490977615500790299', time=2024-03-04T14:53:53.158915+0000, chain.objs.size()=1 2024-03-04T13:00:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.pyw-gMKfUsz-Qtc_ca4VLYr4IkVy8QR_0 2024-03-04T13:00:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10147813353753390221', time=2024-03-04T14:53:53.161351+0000, chain.objs.size()=1 2024-03-04T13:00:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vxyMjTpjfUEmjBf4x3rDUDB1FG_P_36_0 2024-03-04T13:00:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11382583084837440460', time=2024-03-04T14:53:53.250926+0000, chain.objs.size()=1 2024-03-04T13:00:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.b04ZiSOE85AfvVL57_Vh9akVzQXAo-O_0 2024-03-04T13:00:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5208604052517153569', time=2024-03-04T14:53:53.271337+0000, chain.objs.size()=1 2024-03-04T13:00:17.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.2svHUOF9yV3xu3ij-7yf3mDKFxT6DbF_0 2024-03-04T13:00:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.071+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2981815200427930275', time=2024-03-04T14:53:53.279931+0000, chain.objs.size()=1 2024-03-04T13:00:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.071+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.DU_Rj2BUWZs8wyXsbgVdre0LsB0wOBT_0 2024-03-04T13:00:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.072+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14466616914518917926', time=2024-03-04T14:53:53.295054+0000, chain.objs.size()=1 2024-03-04T13:00:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.072+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.OS6XH6cfNqSwAoSBl2nFd1IvI9bkeJ1_0 2024-03-04T13:00:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.072+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14202503390842374661', time=2024-03-04T14:53:53.297384+0000, chain.objs.size()=1 2024-03-04T13:00:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.072+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JkFGoL5U4KYmbhOLuNf-Irnl7SoJ6-T_0 2024-03-04T13:00:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.072+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11653598273387761164', time=2024-03-04T14:53:53.304751+0000, chain.objs.size()=1 2024-03-04T13:00:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.072+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.LubVrXkxJrQKhBVOsqL4dqgrcK70j_S_0 2024-03-04T13:00:17.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.072+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.969266703746816995', time=2024-03-04T14:53:53.314915+0000, chain.objs.size()=1 2024-03-04T13:00:17.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.072+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.2COqadzyi9yi5VXRCyBNEN10bRkUNgq_0 2024-03-04T13:00:17.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.072+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15757120757075595578', time=2024-03-04T14:54:02.680559+0000, chain.objs.size()=1 2024-03-04T13:00:17.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.072+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.254__shadow_.ndVxE7A_q3UbBAKYZ_6XfwchIoryfFH_0 2024-03-04T13:00:17.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.072+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4968458751332999084', time=2024-03-04T14:54:03.124661+0000, chain.objs.size()=1 2024-03-04T13:00:17.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.072+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.255__shadow_.Le_K3X8K7JWFpQ2reW5mB35g8f5y9kk_0 2024-03-04T13:00:17.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.073+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18139303800671134396', time=2024-03-04T14:54:04.960763+0000, chain.objs.size()=1 2024-03-04T13:00:17.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.073+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.259__shadow_.tIPa40_SXRORTlhbtr3Vr9KQ8BK4v20_0 2024-03-04T13:00:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4341316566083364705', time=2024-03-04T14:54:29.620640+0000, chain.objs.size()=1 2024-03-04T13:00:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.sGC2ScpTbXFY9jJYQMRY4JNuqVgEgl7_0 2024-03-04T13:00:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7026779188637168622', time=2024-03-04T14:54:29.666413+0000, chain.objs.size()=1 2024-03-04T13:00:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.CK7lgpiMYEoC7t4O2ah2UIq2jG6_T5g_0 2024-03-04T13:00:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15699891106959910858', time=2024-03-04T14:54:29.687223+0000, chain.objs.size()=1 2024-03-04T13:00:17.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.I_grK--3sgAODVVACyIKzy7bLZOkOvq_0 2024-03-04T13:00:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7694156201488991585', time=2024-03-04T14:54:29.696602+0000, chain.objs.size()=1 2024-03-04T13:00:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Ml6293xFWTTHs_u0qjNpJ54n8y6Oivt_0 2024-03-04T13:00:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3082225752412458738', time=2024-03-04T14:54:29.942160+0000, chain.objs.size()=1 2024-03-04T13:00:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.QKPugLslvIPICjOJGpou5-xGMASPpOC_0 2024-03-04T13:00:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4442400634340033876', time=2024-03-04T14:54:30.144120+0000, chain.objs.size()=1 2024-03-04T13:00:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rVmeZTFgcoGaxVLyIS2od63PtGS-AiW_0 2024-03-04T13:00:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5398821750591375352', time=2024-03-04T14:54:30.161427+0000, chain.objs.size()=1 2024-03-04T13:00:17.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.9O0k1Iq2JDx1q77MiICOvtalA3npjiJ_0 2024-03-04T13:00:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8502151350736835256', time=2024-03-04T14:54:30.164991+0000, chain.objs.size()=1 2024-03-04T13:00:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.a-7kX0apzTCf8k_a1fwZHzawpm04zWE_0 2024-03-04T13:00:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3217805047432769063', time=2024-03-04T14:54:30.334073+0000, chain.objs.size()=1 2024-03-04T13:00:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.SU1mEuCIxyzAnoFlfcpsylqTEa_HelP_0 2024-03-04T13:00:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14462237690792382823', time=2024-03-04T14:54:30.446580+0000, chain.objs.size()=1 2024-03-04T13:00:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.074+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.fSSpcFM2NMgBUsHADu_SKEAEYsYu-oj_0 2024-03-04T13:00:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.075+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9462085513586947491', time=2024-03-04T14:54:30.447978+0000, chain.objs.size()=1 2024-03-04T13:00:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.075+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.knzItDEcWIsSjyhtcISsNxUPaOX3UF2_0 2024-03-04T13:00:17.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15278882948242926497', time=2024-03-04T14:54:30.453602+0000, chain.objs.size()=1 2024-03-04T13:00:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.AJN3VsGRKUfLtRUwRrIkvBg1b7x7uw5_0 2024-03-04T13:00:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10971435528788585360', time=2024-03-04T14:54:30.470531+0000, chain.objs.size()=1 2024-03-04T13:00:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.PChSLsUTX7ihhvawrGsKjWuakOYC7dQ_0 2024-03-04T13:00:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17468312338396650467', time=2024-03-04T14:54:30.479607+0000, chain.objs.size()=1 2024-03-04T13:00:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.DjxFJOyK6bAaZeuLj9VXzCyZq2z1pch_0 2024-03-04T13:00:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12284746485440156981', time=2024-03-04T14:54:30.608529+0000, chain.objs.size()=1 2024-03-04T13:00:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VgkXf5JNhcsmUv4zkaDi4Lg3zRcPQMd_0 2024-03-04T13:00:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1728599597954211395', time=2024-03-04T14:54:30.615109+0000, chain.objs.size()=1 2024-03-04T13:00:17.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ifb8fZxBp4Op-NR0-AHNn-u2hrme71A_0 2024-03-04T13:00:17.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3834227202480400003', time=2024-03-04T14:54:30.621044+0000, chain.objs.size()=1 2024-03-04T13:00:17.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.TDA7VlZypGTYbJK6TQ-DyC8M2ze_rlJ_0 2024-03-04T13:00:17.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15435564708005929450', time=2024-03-04T14:54:30.643163+0000, chain.objs.size()=1 2024-03-04T13:00:17.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.JsJfnrANfLaWf4kwJ7y_vaIgk5B6-GY_0 2024-03-04T13:00:17.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12729029485998232776', time=2024-03-04T14:54:30.666950+0000, chain.objs.size()=1 2024-03-04T13:00:17.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.IwrBUTq24ROksb50Z93pIkvvqBU1tQG_0 2024-03-04T13:00:17.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7950974180791154516', time=2024-03-04T14:54:30.752118+0000, chain.objs.size()=1 2024-03-04T13:00:17.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.0hLJBj9SQiaiHOl9bIZFrpxFMq17LcK_0 2024-03-04T13:00:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8505812471786841271', time=2024-03-04T14:54:30.768891+0000, chain.objs.size()=1 2024-03-04T13:00:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.uZ6se4aga1jhLgDJcx7oTOKvZvvThg7_0 2024-03-04T13:00:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4570766348635719906', time=2024-03-04T14:54:38.307401+0000, chain.objs.size()=1 2024-03-04T13:00:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.076+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.AYohY6RLjEJ820kABEl0zeLhRSZwTwu_0 2024-03-04T13:00:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16078250220212759621', time=2024-03-04T14:54:38.343368+0000, chain.objs.size()=1 2024-03-04T13:00:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.LYugxuEXBPqFi97dRlKBvjt-hs8DfZj_0 2024-03-04T13:00:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18402281406130496540', time=2024-03-04T14:54:38.351052+0000, chain.objs.size()=1 2024-03-04T13:00:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.h8TJcAnBD9R7UGC8gW_u6mUXVpApI-x_0 2024-03-04T13:00:17.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12754875049091750892', time=2024-03-04T14:54:38.369691+0000, chain.objs.size()=1 2024-03-04T13:00:17.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.maPM52_CROmepAWrqKULqj9T2Ba8IGY_0 2024-03-04T13:00:17.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5247592148731302586', time=2024-03-04T14:54:38.478501+0000, chain.objs.size()=1 2024-03-04T13:00:17.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VZj4L7LBW3rypy4Ei2S_ezM4srBYclS_0 2024-03-04T13:00:17.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6976490661568584763', time=2024-03-04T14:54:38.502909+0000, chain.objs.size()=1 2024-03-04T13:00:17.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IgQPzmGDczm8dMSxZ3Sba3TzD1cD1iF_0 2024-03-04T13:00:17.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5986728550654663245', time=2024-03-04T14:54:38.505346+0000, chain.objs.size()=1 2024-03-04T13:00:17.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.mp9O5NbkpwbKT4c_4qiMoHZtLBWxD0w_0 2024-03-04T13:00:17.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8646723746289714191', time=2024-03-04T14:54:38.541738+0000, chain.objs.size()=1 2024-03-04T13:00:17.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.aOeqtxaBsdzCS0MbpNhmBFas41KIgXx_0 2024-03-04T13:00:17.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7349921405164026369', time=2024-03-04T14:54:38.643074+0000, chain.objs.size()=1 2024-03-04T13:00:17.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.g20xp6oX7WKZvcFnTjQjPc6sAorc4GZ_0 2024-03-04T13:00:17.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9996193177395894921', time=2024-03-04T14:54:38.695838+0000, chain.objs.size()=1 2024-03-04T13:00:17.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.KWaB1HG2xZL6-CMay0K10w_61UtQZNT_0 2024-03-04T13:00:17.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2644652193962629158', time=2024-03-04T14:54:38.821815+0000, chain.objs.size()=1 2024-03-04T13:00:17.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iOgpCknGvj0VpwJWT1acfXmzCJSFlUi_0 2024-03-04T13:00:17.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6532859766703116460', time=2024-03-04T14:54:38.830479+0000, chain.objs.size()=1 2024-03-04T13:00:17.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.078+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.vEHVbQlHBMSojyfkDQ1KsRyUqwCxt8t_0 2024-03-04T13:00:17.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8482887616684610671', time=2024-03-04T14:54:38.871868+0000, chain.objs.size()=1 2024-03-04T13:00:17.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.cqaIcfZ9jf5eU-4lGFT-OEPHDu4sdTf_0 2024-03-04T13:00:17.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4292620004723195565', time=2024-03-04T14:54:39.026586+0000, chain.objs.size()=1 2024-03-04T13:00:17.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eWMoyOMlIuoRrHWX75om_J12HQeSxGs_0 2024-03-04T13:00:17.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12321777592408875345', time=2024-03-04T14:54:39.115633+0000, chain.objs.size()=1 2024-03-04T13:00:17.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.MDNRb69yr4LZbpltuh1jk_s8169uxJg_0 2024-03-04T13:00:17.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9955545383309043565', time=2024-03-04T14:54:39.150994+0000, chain.objs.size()=1 2024-03-04T13:00:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._SOpJ9GBKvYvxUOxQiCgZLOiI4P6D5m_0 2024-03-04T13:00:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17304873797025432173', time=2024-03-04T14:54:39.156396+0000, chain.objs.size()=1 2024-03-04T13:00:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_._k0-7yZgNJ-GPuLOC0sjC2mOm43rYN2_0 2024-03-04T13:00:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14046802570631344372', time=2024-03-04T14:54:39.169084+0000, chain.objs.size()=1 2024-03-04T13:00:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.x2lhmZ-c56eWFKE_zLPsR8t5MZaYJwK_0 2024-03-04T13:00:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14984587020815270421', time=2024-03-04T14:54:39.179330+0000, chain.objs.size()=1 2024-03-04T13:00:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.2wGwfpBQt1DVaXJgWSjKwzJkaK49K3R_0 2024-03-04T13:00:17.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12596130318788444477', time=2024-03-04T14:54:39.192273+0000, chain.objs.size()=1 2024-03-04T13:00:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.lYqo_fhYlTRgaQdcZmdJoVi2kAGui-C_0 2024-03-04T13:00:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6855548345234248875', time=2024-03-04T14:54:39.286126+0000, chain.objs.size()=1 2024-03-04T13:00:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.oUO6jBM5FhD8ZNPHdu_DkWKZl1fY20T_0 2024-03-04T13:00:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15290843445574148102', time=2024-03-04T14:54:39.288133+0000, chain.objs.size()=1 2024-03-04T13:00:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Jtey5DDzThe4fm8QHORAmjnQrd7qnHv_0 2024-03-04T13:00:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15801316949913674979', time=2024-03-04T14:54:39.329518+0000, chain.objs.size()=1 2024-03-04T13:00:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.080+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Ov3DXUMeRKhxD25p_sfFIAjZhxYa1Yb_0 2024-03-04T13:00:17.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10567570026516281654', time=2024-03-04T14:54:39.422179+0000, chain.objs.size()=1 2024-03-04T13:00:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xSZq11L9zai3N7F-QjJqbyPyk9clhuY_0 2024-03-04T13:00:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13847971469432165262', time=2024-03-04T14:54:39.459108+0000, chain.objs.size()=1 2024-03-04T13:00:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.xzQJ5MDnmmFjw9kRlLAZB4ZiKbReBme_0 2024-03-04T13:00:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10038002573805345278', time=2024-03-04T14:54:39.467537+0000, chain.objs.size()=1 2024-03-04T13:00:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Z7QPLv5qsgTYuEzGFZ3grilK7k4zgii_0 2024-03-04T13:00:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13042418038937019303', time=2024-03-04T14:54:39.479358+0000, chain.objs.size()=1 2024-03-04T13:00:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.5VJLwb6pi3R4EEk2yRqsduQ0z3d-bZR_0 2024-03-04T13:00:17.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11507867181080396137', time=2024-03-04T14:54:58.057617+0000, chain.objs.size()=1 2024-03-04T13:00:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.343__shadow_.sxAWmHUl9Z0kUonINpNmoaH8feRBxA2_0 2024-03-04T13:00:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4337990702066595591', time=2024-03-04T14:55:17.579890+0000, chain.objs.size()=1 2024-03-04T13:00:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.381__shadow_.Hlk34vxjxVMffBlpysQQzxxhGdXjKec_0 2024-03-04T13:00:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18070430952858676986', time=2024-03-04T14:55:26.295259+0000, chain.objs.size()=1 2024-03-04T13:00:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.400__shadow_._5xs6UP2l-QkSJvzzhAN1SFumhhv-Wk_0 2024-03-04T13:00:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13918842536351250472', time=2024-03-04T14:55:32.269611+0000, chain.objs.size()=1 2024-03-04T13:00:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.413__shadow_.OTd8Nc-FMZ0X_oxmu2sNtMtWEMP6qkV_0 2024-03-04T13:00:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9303704982180499864', time=2024-03-04T14:55:45.958137+0000, chain.objs.size()=1 2024-03-04T13:00:17.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.082+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.436__shadow_.Wm2xICxSmMu0yfkIfgOU_lrR2vUwOQ0_0 2024-03-04T13:00:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.083+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16852197988883948923', time=2024-03-04T14:55:46.392007+0000, chain.objs.size()=1 2024-03-04T13:00:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.083+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.437__shadow_.mNGlUYfg_uHy_n0M2cQTU6Js18xld9b_0 2024-03-04T13:00:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.085+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/45182 2024-03-04T13:00:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-03-04T13:00:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.459__shadow_.-Q0e07xUSEgZ0l-QDsyIRnpLJ3PHosO_1_e7d98a33e424e85db955b1c474e968a6', time=2024-03-04T14:55:54.191180+0000, chain.objs.size()=1 2024-03-04T13:00:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.459__shadow_.-Q0e07xUSEgZ0l-QDsyIRnpLJ3PHosO_0 2024-03-04T13:00:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.475__shadow:uVjDMegxP6XYWgvybwvxI64cJu5z7Q0_.3EygMS0MkBsJBGyX0Po4m4qYgkDoKJC_1_d96e2c6d6778a488c187e79345e3f28a', time=2024-03-04T14:56:01.001047+0000, chain.objs.size()=1 2024-03-04T13:00:17.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.475__shadow:uVjDMegxP6XYWgvybwvxI64cJu5z7Q0_.3EygMS0MkBsJBGyX0Po4m4qYgkDoKJC_0 2024-03-04T13:00:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.2_1d6798d3c180dd106f6ffba5fff97e06', time=2024-03-04T14:56:03.547355+0000, chain.objs.size()=6 2024-03-04T13:00:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.1 2024-03-04T13:00:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.2 2024-03-04T13:00:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.3 2024-03-04T13:00:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.4 2024-03-04T13:00:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.5 2024-03-04T13:00:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.6 2024-03-04T13:00:17.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4103770567235165879', time=2024-03-04T14:57:02.337748+0000, chain.objs.size()=1 2024-03-04T13:00:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.518__shadow_.YZZlQdRSZT_RI9AMFm53TLXAjWMSYye_0 2024-03-04T13:00:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13533588331723494096', time=2024-03-04T14:57:06.006184+0000, chain.objs.size()=1 2024-03-04T13:00:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.524__shadow_.LNZXX1gaweKmNIdGNYtwtWBlxXV0JRx_0 2024-03-04T13:00:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10569061652413530401', time=2024-03-04T14:57:20.999184+0000, chain.objs.size()=1 2024-03-04T13:00:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:TwKPm.9BOlckAGopzlYvpwR1vrKraA5_.GrQFyCrBaXCsx3IaODjfeW1J8dCUuJ2_0 2024-03-04T13:00:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17780723046331600297', time=2024-03-04T14:57:35.188371+0000, chain.objs.size()=1 2024-03-04T13:00:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.087+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:mpYPgwD74k5A-l75SXpVwvtoVO217wL_.QRyKumFIgbWTsDvbkgwO0qMVvg_C4jO_0 2024-03-04T13:00:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9005397171716296599', time=2024-03-04T14:57:36.398739+0000, chain.objs.size()=1 2024-03-04T13:00:17.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:bIcAidfAf8xaz6QXV4uOk9XclTIlRhu_.dK-ajA8QpwDU2W27VijAVRuKG9873w__0 2024-03-04T13:00:17.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3687379517312430402', time=2024-03-04T14:57:42.880886+0000, chain.objs.size()=1 2024-03-04T13:00:17.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:1u0zGxrgTqca5I-mE8YZHuu2orncVs8_.lQ2pK6f9Thm2tr8YzVILk07x4KJgUQC_0 2024-03-04T13:00:17.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16035200474786582400', time=2024-03-04T14:57:43.160264+0000, chain.objs.size()=1 2024-03-04T13:00:17.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.543__shadow:RHJop2E9V-DQjaopiJkZTao7D4jKsJF_.RCK87gsCUpwadO2qzG00cn54JC5Zpep_0 2024-03-04T13:00:17.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6343820595402563771', time=2024-03-04T14:57:47.272150+0000, chain.objs.size()=1 2024-03-04T13:00:17.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.545__shadow:NkAgtVuFH0NCdL8xTJyqeQpT.Wbou5w_.k7uAeW_gvXjrr7bRyzdI9WzsA2-Auqc_0 2024-03-04T13:00:17.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14932101162693040702', time=2024-03-04T14:57:47.274073+0000, chain.objs.size()=1 2024-03-04T13:00:17.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.545__shadow:crDgGs3NeDBiuksh5vfjqW8OaQ702PX_.YPpwm458xoms4Q146TXC_K-O8Aag9sP_0 2024-03-04T13:00:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2520673359232576370', time=2024-03-04T14:58:15.570070+0000, chain.objs.size()=1 2024-03-04T13:00:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.592__shadow_.FeliOC3jaThJx2aF85A8z6AUPQNvLnH_0 2024-03-04T13:00:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3537014625837312581', time=2024-03-04T14:58:46.555087+0000, chain.objs.size()=1 2024-03-04T13:00:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.089+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.663__shadow:Cn5AL1VqX-Uxbh9w4R89hu4tAnUgtp1_.RDyQjY7L59cWrOIn0zRt0DWSceYZPgi_0 2024-03-04T13:00:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.091+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.093+0000 7f4aa2f24800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T13:00:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.094+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:00:17.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.094+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:00:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41733' 2024-03-04T13:00:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='_yOdMWiCwE-oeaYSne8twByBpVB53wUV', time=2024-03-04T14:52:59.693143+0000, chain.objs.size()=1 2024-03-04T13:00:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.154__shadow_.Pejc1c47DYNFH7gSe3w9VSoNchkNIs1_0 2024-03-04T13:00:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12593038970411161581', time=2024-03-04T14:53:01.325968+0000, chain.objs.size()=1 2024-03-04T13:00:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.159__shadow_.hvWG1Ky2U4iGmAozvBba2E3EqeVoYUs_0 2024-03-04T13:00:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15148378667095990499', time=2024-03-04T14:53:37.361363+0000, chain.objs.size()=1 2024-03-04T13:00:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.218__shadow_.XK5FqrGfbZUcEM0DyUPgRS9VbxecJ0I_0 2024-03-04T13:00:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1831465054344252603', time=2024-03-04T14:53:40.877300+0000, chain.objs.size()=1 2024-03-04T13:00:17.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.226__shadow_.OI6_0k_Z9c8H_zlUX6YmrvP31He5gIN_0 2024-03-04T13:00:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5529490854545596359', time=2024-03-04T14:53:52.068664+0000, chain.objs.size()=1 2024-03-04T13:00:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.dZ5PbuyAwx4izskyQyVURKDD6tb-L1V_0 2024-03-04T13:00:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15485769403099329548', time=2024-03-04T14:53:52.069548+0000, chain.objs.size()=1 2024-03-04T13:00:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ysfdlEGm7XzrIGw-s60sXiFhvP6Bx9u_0 2024-03-04T13:00:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14332902341387091915', time=2024-03-04T14:53:52.075916+0000, chain.objs.size()=1 2024-03-04T13:00:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.tpQxF1Esskg8DE28leIngL1c5flziv2_0 2024-03-04T13:00:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11187303287957585498', time=2024-03-04T14:53:52.093629+0000, chain.objs.size()=1 2024-03-04T13:00:17.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ODqX4od6N0xNTS2HLA5KFjsZkFpD1XX_0 2024-03-04T13:00:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17804641311520950938', time=2024-03-04T14:53:52.128056+0000, chain.objs.size()=1 2024-03-04T13:00:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JJhoQ2Q-8XUV6RECupuGBeJVcFvbbKj_0 2024-03-04T13:00:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2669271021044791977', time=2024-03-04T14:53:52.131057+0000, chain.objs.size()=1 2024-03-04T13:00:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.X3ugWbIDX0vUPhrguSSOo8OZc7hmh_y_0 2024-03-04T13:00:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18006442732266899576', time=2024-03-04T14:53:52.272948+0000, chain.objs.size()=1 2024-03-04T13:00:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.KvAt86Kk73FzUAXN1tfhwX4e-XYVzL-_0 2024-03-04T13:00:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7292324558240850473', time=2024-03-04T14:53:52.318509+0000, chain.objs.size()=1 2024-03-04T13:00:17.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.095+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.8SPVT0dIXjfdt6THqOOYv2cQdBe97kE_0 2024-03-04T13:00:17.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.309855324130775280', time=2024-03-04T14:53:52.399242+0000, chain.objs.size()=1 2024-03-04T13:00:17.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.FllIX7r4nwoVx6jRdYkN-ZZfYEEZVzS_0 2024-03-04T13:00:17.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12717944921889333494', time=2024-03-04T14:53:52.409989+0000, chain.objs.size()=1 2024-03-04T13:00:17.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.dz4Hl8UszPV9XnN0K0pO6uSrKG_aGpS_0 2024-03-04T13:00:17.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1723673472434777623', time=2024-03-04T14:53:52.445008+0000, chain.objs.size()=1 2024-03-04T13:00:17.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.vz65ulpSDis6G3ipLiSrM-ssmFKLbA9_0 2024-03-04T13:00:17.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.702455243038494975', time=2024-03-04T14:53:52.450117+0000, chain.objs.size()=1 2024-03-04T13:00:17.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.-fJDrDFIGpxX0cFbQsuBTQbPHLq9LOb_0 2024-03-04T13:00:17.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10357258679954720300', time=2024-03-04T14:53:52.456432+0000, chain.objs.size()=1 2024-03-04T13:00:17.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.BbRUVjq6cLunArb_-W2RKySZSdUAUhy_0 2024-03-04T13:00:17.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4428654675067064087', time=2024-03-04T14:53:52.580790+0000, chain.objs.size()=1 2024-03-04T13:00:17.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JsuvZD0__G26tI1mAi65mEhqpKIp8HN_0 2024-03-04T13:00:17.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.838618275926957472', time=2024-03-04T14:53:52.600400+0000, chain.objs.size()=1 2024-03-04T13:00:17.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xxkyL0tQhiYBHBGFYJ_4MEEXMPEWJe5_0 2024-03-04T13:00:17.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14375182545058389339', time=2024-03-04T14:53:52.611790+0000, chain.objs.size()=1 2024-03-04T13:00:17.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.JnPcOCXuXkQR4fXKNz9roCrOo-6m90n_0 2024-03-04T13:00:17.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11765779992621073393', time=2024-03-04T14:53:52.756566+0000, chain.objs.size()=1 2024-03-04T13:00:17.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.G_52CYjQ3ZPqPJMGPgAkyiGE5xrqi09_0 2024-03-04T13:00:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18091524494737004205', time=2024-03-04T14:53:52.808875+0000, chain.objs.size()=1 2024-03-04T13:00:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_._4aLCpmogY5ms7y1t5jV8kfGiWUSgwj_0 2024-03-04T13:00:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10317669068863652371', time=2024-03-04T14:53:52.813885+0000, chain.objs.size()=1 2024-03-04T13:00:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.097+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.f6yxZPtJDnDBATDMhINbfEN7ARU6rsX_0 2024-03-04T13:00:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.099+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6990410235515677337', time=2024-03-04T14:53:52.837277+0000, chain.objs.size()=1 2024-03-04T13:00:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.099+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.lgnau0nqbmtuNvlg9tailnSjaebxhOd_0 2024-03-04T13:00:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.099+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14915724738705041771', time=2024-03-04T14:53:52.938916+0000, chain.objs.size()=1 2024-03-04T13:00:17.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.099+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.xDA-PqpKFpL7hfjYiGYEujT6nmURiqM_0 2024-03-04T13:00:17.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.099+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5467995534084829817', time=2024-03-04T14:53:52.947610+0000, chain.objs.size()=1 2024-03-04T13:00:17.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.099+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.QQZiwTCxDRSvGvMrdvUJGh1BdgbagZt_0 2024-03-04T13:00:17.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.099+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10917575783628959878', time=2024-03-04T14:53:52.957434+0000, chain.objs.size()=1 2024-03-04T13:00:17.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.099+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.1NG9KPot_eXxjjAEtQ4m9ymmbB8LlRR_0 2024-03-04T13:00:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.099+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5215596137897504573', time=2024-03-04T14:53:52.986477+0000, chain.objs.size()=1 2024-03-04T13:00:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.099+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.TtiPZhTW-1UpffECyEt1djIGKMTWwaE_0 2024-03-04T13:00:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17063942963798024853', time=2024-03-04T14:53:53.102068+0000, chain.objs.size()=1 2024-03-04T13:00:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.r3VmOVpn-9uDT93DENatTjIEm0TwhrR_0 2024-03-04T13:00:17.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5420604588575155117', time=2024-03-04T14:53:53.247425+0000, chain.objs.size()=1 2024-03-04T13:00:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.yIV0h-LVApP6w8BR_kRUhvkh3v3f-es_0 2024-03-04T13:00:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2925743070236466597', time=2024-03-04T14:53:53.250818+0000, chain.objs.size()=1 2024-03-04T13:00:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.qsoIz_qDCZrzE61sDQ8_WR5eaUqApPg_0 2024-03-04T13:00:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3031131173933793629', time=2024-03-04T14:53:53.296589+0000, chain.objs.size()=1 2024-03-04T13:00:17.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.jJHQKMB1HItrBW7U6jw1tagWYnbhgHT_0 2024-03-04T13:00:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16685767107496349651', time=2024-03-04T14:53:53.320682+0000, chain.objs.size()=1 2024-03-04T13:00:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.235__shadow_.ou-U7zkFV1MKITGcuWrRPuRSzXOlWZ4_0 2024-03-04T13:00:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16515431228464766713', time=2024-03-04T14:53:57.880656+0000, chain.objs.size()=1 2024-03-04T13:00:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.243__shadow_.UAe99xz0jd1as4tC9_lZyB8W81yOOB0_0 2024-03-04T13:00:17.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.658502200939206499', time=2024-03-04T14:54:00.989842+0000, chain.objs.size()=1 2024-03-04T13:00:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.100+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.250__shadow_.-Bi-NZ-6Nk4I1VnQax12YAFFrvxA1vW_0 2024-03-04T13:00:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.101+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9329163752524909985', time=2024-03-04T14:54:08.241672+0000, chain.objs.size()=1 2024-03-04T13:00:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.101+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.265__shadow_.sCIQlVFd0K3DcIMbcUy6zDmkoJzPZIb_0 2024-03-04T13:00:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.101+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2095655817169605725', time=2024-03-04T14:54:09.027180+0000, chain.objs.size()=1 2024-03-04T13:00:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.101+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.266__shadow_.E16MGF39Q-d-Yx98vUqIgXSMt3Eh5jN_0 2024-03-04T13:00:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.101+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6636613062057991423', time=2024-03-04T14:54:09.470191+0000, chain.objs.size()=1 2024-03-04T13:00:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.101+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.267__shadow_.fj-JwHNETPvy8ePEbmifnqA9pSYL43d_0 2024-03-04T13:00:17.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.101+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9247535099915932885', time=2024-03-04T14:54:10.346151+0000, chain.objs.size()=1 2024-03-04T13:00:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.101+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.269__shadow_.WL6Kr8Sz2fKzehFQYQk30-Fmbs9G2ib_0 2024-03-04T13:00:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.102+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5134921679869858475', time=2024-03-04T14:54:12.643414+0000, chain.objs.size()=1 2024-03-04T13:00:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.102+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.274__shadow_.XamiYeP_95b0vW-rXODxQi4pulWm1BR_0 2024-03-04T13:00:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.102+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6316965041370928001', time=2024-03-04T14:54:29.616947+0000, chain.objs.size()=1 2024-03-04T13:00:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.102+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.1QUnom9X_i5ku1GyihF70YQ-LRL9rZf_0 2024-03-04T13:00:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.102+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1820422570506746662', time=2024-03-04T14:54:29.628770+0000, chain.objs.size()=1 2024-03-04T13:00:17.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.102+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.rikRhI_fHS1E0XqABjWY3xMUfxB3XrG_0 2024-03-04T13:00:17.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6356988511978549132', time=2024-03-04T14:54:29.659112+0000, chain.objs.size()=1 2024-03-04T13:00:17.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.EElPwZCXGMCv8wTU8FnPDt_Ay4EWRVx_0 2024-03-04T13:00:17.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3831601039208778220', time=2024-03-04T14:54:29.683335+0000, chain.objs.size()=1 2024-03-04T13:00:17.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ltkBWVHZtMJ3l0REDxyu-vNYZN6oPuk_0 2024-03-04T13:00:17.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10831942549484992596', time=2024-03-04T14:54:29.777818+0000, chain.objs.size()=1 2024-03-04T13:00:17.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.QiE_jFIFI0aRXS16HZtXAqVH-iySnFR_0 2024-03-04T13:00:17.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3662255761333705993', time=2024-03-04T14:54:29.795863+0000, chain.objs.size()=1 2024-03-04T13:00:17.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.bQjagtkhBawWWdTGmKeu9IEa11Qy_ub_0 2024-03-04T13:00:17.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1632983261273774373', time=2024-03-04T14:54:29.806076+0000, chain.objs.size()=1 2024-03-04T13:00:17.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Y7HtUQq96thZiDdMZbfz7UuRGTeJEJQ_0 2024-03-04T13:00:17.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16817254819295800599', time=2024-03-04T14:54:29.820419+0000, chain.objs.size()=1 2024-03-04T13:00:17.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.kr3dXFbIrvVNfNJTpWjfk-gfD2rBVSr_0 2024-03-04T13:00:17.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16875980124019583894', time=2024-03-04T14:54:29.827201+0000, chain.objs.size()=1 2024-03-04T13:00:17.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cTIqONnZ7MyVEK5KtxD3K_Lbg361_NA_0 2024-03-04T13:00:17.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17966267441967236351', time=2024-03-04T14:54:29.835617+0000, chain.objs.size()=1 2024-03-04T13:00:17.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.BdoMkVBd5ER9vFX06DaDxwchp_bulsA_0 2024-03-04T13:00:17.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6370692021610047664', time=2024-03-04T14:54:30.004381+0000, chain.objs.size()=1 2024-03-04T13:00:17.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.103+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.5g4K1GBDXvy6ENbxm0xU9hbquWCeyy__0 2024-03-04T13:00:17.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.104+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.814082134054719706', time=2024-03-04T14:54:30.105484+0000, chain.objs.size()=1 2024-03-04T13:00:17.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.104+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.3a7FlzjtBuWmdV6WxmYmky-ieuw3PHO_0 2024-03-04T13:00:17.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15645305618317144514', time=2024-03-04T14:54:30.107863+0000, chain.objs.size()=1 2024-03-04T13:00:17.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.uxK-oD2cFdcLbBJBXAzFv75YZfLHw0C_0 2024-03-04T13:00:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5762613034672853084', time=2024-03-04T14:54:30.111333+0000, chain.objs.size()=1 2024-03-04T13:00:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.g5z8GV92pKEBh_6Gbt6ARdOUMJkJme5_0 2024-03-04T13:00:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7892653931160348334', time=2024-03-04T14:54:30.133003+0000, chain.objs.size()=1 2024-03-04T13:00:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.iX5g-vxoor3rOnbOXRIFGnCSvhlwjo8_0 2024-03-04T13:00:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3395157553479879889', time=2024-03-04T14:54:30.168798+0000, chain.objs.size()=1 2024-03-04T13:00:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.sb8H69au2Zjt6PGB3T9lpL1XU1rN-gg_0 2024-03-04T13:00:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4262783518197568347', time=2024-03-04T14:54:30.271397+0000, chain.objs.size()=1 2024-03-04T13:00:17.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.Dpvpgg8TFjuwkwI_mQHHnLNCgnR3Fpf_0 2024-03-04T13:00:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5838154416857393900', time=2024-03-04T14:54:30.338421+0000, chain.objs.size()=1 2024-03-04T13:00:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.cthWkr6Pi0NeSlfqbKN71OVYP9PvoCB_0 2024-03-04T13:00:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6860718877780255383', time=2024-03-04T14:54:30.341430+0000, chain.objs.size()=1 2024-03-04T13:00:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.tzqs-Jn3oajVIus5aoypvksCyyNSgpi_0 2024-03-04T13:00:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1724665473761600496', time=2024-03-04T14:54:30.433809+0000, chain.objs.size()=1 2024-03-04T13:00:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.953BLxyjroqncUDAud7yr3oUd9JIG14_0 2024-03-04T13:00:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7906831641104392867', time=2024-03-04T14:54:30.445982+0000, chain.objs.size()=1 2024-03-04T13:00:17.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.105+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.ItPUDHG_jo42fbCi0uKN1TkKRz2jLWh_0 2024-03-04T13:00:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.107+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11057322621108619031', time=2024-03-04T14:54:30.478261+0000, chain.objs.size()=1 2024-03-04T13:00:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.107+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.iWMgByASHdtVAMkK_J1nnZOZVS4RCLU_0 2024-03-04T13:00:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.107+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7712387380815855651', time=2024-03-04T14:54:30.585073+0000, chain.objs.size()=1 2024-03-04T13:00:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.107+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.G61CTtYMB9rUAFBjV7xo1tyc57ZQHAt_0 2024-03-04T13:00:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.107+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.1968589113013003901', time=2024-03-04T14:54:30.779512+0000, chain.objs.size()=1 2024-03-04T13:00:17.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.107+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.dzEV2ysk7ZLchyZjfpfIedz8SWfrfA-_0 2024-03-04T13:00:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.108+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15375555631822427', time=2024-03-04T14:54:30.787713+0000, chain.objs.size()=1 2024-03-04T13:00:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.108+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.VITLu_c0fqF92NA5Skz1gYFX6n7HRlP_0 2024-03-04T13:00:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.108+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7871187939688438707', time=2024-03-04T14:54:30.794370+0000, chain.objs.size()=1 2024-03-04T13:00:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.108+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.qFajxmE9U5FT_KlbAs7JcH9Lxg0Q9Vd_0 2024-03-04T13:00:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7053417288920417259', time=2024-03-04T14:54:30.803500+0000, chain.objs.size()=1 2024-03-04T13:00:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.296__shadow_.oCHAUbkOu2rW1Y1VWMpoMZROlNu3Wsh_0 2024-03-04T13:00:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.15717682093791385825', time=2024-03-04T14:54:38.340487+0000, chain.objs.size()=1 2024-03-04T13:00:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.CZsxFAqwLGruOoi1BjUm3EvHhEgBwO9_0 2024-03-04T13:00:17.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8405955543271612561', time=2024-03-04T14:54:38.458868+0000, chain.objs.size()=1 2024-03-04T13:00:17.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.EXQ8roYgpu-uRm7IV2KAk2QybaQZmd6_0 2024-03-04T13:00:17.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17455537216833539236', time=2024-03-04T14:54:38.470138+0000, chain.objs.size()=1 2024-03-04T13:00:17.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HJkCLQMQPMKFNUISgM1BshpvaFq7sWM_0 2024-03-04T13:00:17.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2129287091615951843', time=2024-03-04T14:54:38.480040+0000, chain.objs.size()=1 2024-03-04T13:00:17.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.a61DlBsgUCRUGTYsEFNXst4QP3k7IRE_0 2024-03-04T13:00:17.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12645477452525897667', time=2024-03-04T14:54:38.513216+0000, chain.objs.size()=1 2024-03-04T13:00:17.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.WYO3uRaC55fGxNj5woaBimpSlcP4m1U_0 2024-03-04T13:00:17.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10830002229138078129', time=2024-03-04T14:54:38.525133+0000, chain.objs.size()=1 2024-03-04T13:00:17.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ZQ69beGMO4-e6PShENha2B5CTt_EPHZ_0 2024-03-04T13:00:17.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11397683184881123871', time=2024-03-04T14:54:38.537499+0000, chain.objs.size()=1 2024-03-04T13:00:17.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Jr3ZfCl0DWpBZJMfsMyEKM0apOIOlkM_0 2024-03-04T13:00:17.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3427995167593758567', time=2024-03-04T14:54:38.625308+0000, chain.objs.size()=1 2024-03-04T13:00:17.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.kgM8pCPDAniCqmuc1tEhHHnowlEHiv8_0 2024-03-04T13:00:17.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.12498599994411647674', time=2024-03-04T14:54:38.684499+0000, chain.objs.size()=1 2024-03-04T13:00:17.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IahIti0c2oMcEZMa-rAoD068xAvzhVq_0 2024-03-04T13:00:17.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7202414357899418589', time=2024-03-04T14:54:38.784206+0000, chain.objs.size()=1 2024-03-04T13:00:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.109+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.OTuKZEBJrwXCJToUtNHihYNRjk62R0Q_0 2024-03-04T13:00:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14980726012570582813', time=2024-03-04T14:54:38.798597+0000, chain.objs.size()=1 2024-03-04T13:00:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.I91yxa5_tLhJYUiPFfVRLeVhBdMRrBq_0 2024-03-04T13:00:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16065262519727289567', time=2024-03-04T14:54:38.800403+0000, chain.objs.size()=1 2024-03-04T13:00:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.pEVVR2e6_kap0z67wv2b6Iq4Vll1Qgv_0 2024-03-04T13:00:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6453347316875654980', time=2024-03-04T14:54:38.815986+0000, chain.objs.size()=1 2024-03-04T13:00:17.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rwkGIZovRJHT_tsiJqkIazf4OI78i9f_0 2024-03-04T13:00:17.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2568784058846628515', time=2024-03-04T14:54:38.816681+0000, chain.objs.size()=1 2024-03-04T13:00:17.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.MU03kfqIcXoVGTwEe1j-T1mfPnrUCGV_0 2024-03-04T13:00:17.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.111+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.10246119267246342469', time=2024-03-04T14:54:38.822152+0000, chain.objs.size()=1 2024-03-04T13:00:17.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.111+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.12_yo_E9r0ac1BdeqWKM9OgelnnJsv6_0 2024-03-04T13:00:17.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3270499520191521367', time=2024-03-04T14:54:38.867788+0000, chain.objs.size()=1 2024-03-04T13:00:17.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iLrHNC2sCBu54Hswwpp6PXruR6yBfL9_0 2024-03-04T13:00:17.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.102816203467151653', time=2024-03-04T14:54:38.947480+0000, chain.objs.size()=1 2024-03-04T13:00:17.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.HbHutO1Nxk7jhOscf1GxFZXrp80LjKF_0 2024-03-04T13:00:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9373419252882999887', time=2024-03-04T14:54:38.959912+0000, chain.objs.size()=1 2024-03-04T13:00:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.tHBuJMZq_wIk0VRK81FxySeShoiO5Xn_0 2024-03-04T13:00:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9625923816462526253', time=2024-03-04T14:54:39.015429+0000, chain.objs.size()=1 2024-03-04T13:00:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.lbGiR7tV7tu_tmhCfK32GObFOsksPLX_0 2024-03-04T13:00:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4295070751567814496', time=2024-03-04T14:54:39.106708+0000, chain.objs.size()=1 2024-03-04T13:00:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.VFZcZ5RF3cNJiq-mXG8SvCZty07F3Ez_0 2024-03-04T13:00:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.3635119872592918797', time=2024-03-04T14:54:39.107407+0000, chain.objs.size()=1 2024-03-04T13:00:17.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.SG5IMc0i41fKDIY8u3ZELu_wAnfp9e8_0 2024-03-04T13:00:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14679652477075318202', time=2024-03-04T14:54:39.116594+0000, chain.objs.size()=1 2024-03-04T13:00:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.IfKSiNXWHBeLFUmW0reW6h3RfUoUv5t_0 2024-03-04T13:00:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.2361987878466785031', time=2024-03-04T14:54:39.291193+0000, chain.objs.size()=1 2024-03-04T13:00:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.112+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.ZNNYHzH9_tVjcRT7-kxuKr89LIYLSPV_0 2024-03-04T13:00:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.13916221902893278358', time=2024-03-04T14:54:39.299663+0000, chain.objs.size()=1 2024-03-04T13:00:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.iCkil71FwiH15wqz-3_fy8L4ZvRQIPU_0 2024-03-04T13:00:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6059187666241336902', time=2024-03-04T14:54:39.433865+0000, chain.objs.size()=1 2024-03-04T13:00:17.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.Jzdl3oDho5ylT4HlYuTEAq5BUwwvzuZ_0 2024-03-04T13:00:17.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5896826298212407914', time=2024-03-04T14:54:39.444521+0000, chain.objs.size()=1 2024-03-04T13:00:17.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.rNTIt9DVVJ8We2bxM86EjqiH3lkrtd8_0 2024-03-04T13:00:17.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.113+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11900822318038063368', time=2024-03-04T14:54:39.449042+0000, chain.objs.size()=1 2024-03-04T13:00:17.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.113+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.UOqNq3Xy0LvPvyntPHDa1-Cn9OtH_ml_0 2024-03-04T13:00:17.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.114+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14186954987194091170', time=2024-03-04T14:54:39.460319+0000, chain.objs.size()=1 2024-03-04T13:00:17.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.114+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.WkvuXY3Gge5ln7IfO91f4FgvCJlHPJU_0 2024-03-04T13:00:17.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.114+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16517083023535802012', time=2024-03-04T14:54:39.479183+0000, chain.objs.size()=1 2024-03-04T13:00:17.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.114+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.B6kybE6wUTjesVtsjgh3-T9vDnJtsfj_0 2024-03-04T13:00:17.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.114+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.9232430436433786849', time=2024-03-04T14:54:39.488996+0000, chain.objs.size()=1 2024-03-04T13:00:17.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.114+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.297__shadow_.eQAZoaThI_vCt15NjiLBDz8eNneorJE_0 2024-03-04T13:00:17.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.114+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.6591550462309599207', time=2024-03-04T14:54:41.951656+0000, chain.objs.size()=1 2024-03-04T13:00:17.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.114+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.303__shadow_.7t7Yn37wWUFR11caS8BF8LU8DMHU1jq_0 2024-03-04T13:00:17.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.114+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.5683227349649648547', time=2024-03-04T14:55:01.376417+0000, chain.objs.size()=1 2024-03-04T13:00:17.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.114+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.348__shadow_.k8rTuMaPn0VZFprY5DVo3CFdLwBQkva_0 2024-03-04T13:00:17.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.114+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.4847386794691299686', time=2024-03-04T14:55:17.128289+0000, chain.objs.size()=1 2024-03-04T13:00:17.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.114+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.380__shadow_.I-uAaGwAJAWUgkUcW6V5lJywS4iIN-g_0 2024-03-04T13:00:17.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.116+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 0/41733 2024-03-04T13:00:17.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-03-04T13:00:17.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.201869640392839089', time=2024-03-04T14:55:45.799245+0000, chain.objs.size()=1 2024-03-04T13:00:17.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.436__shadow_.xmUW7h8OM5FUwl8RjB5PI5xsPcqeZXl_0 2024-03-04T13:00:17.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7542617840603771485', time=2024-03-04T14:55:52.722016+0000, chain.objs.size()=1 2024-03-04T13:00:17.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.456__shadow_.MUrtrmV1FV94sHjSWFMWX4da_5TGfQ2_0 2024-03-04T13:00:17.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.475__shadow:uVjDMegxP6XYWgvybwvxI64cJu5z7Q0_.3EygMS0MkBsJBGyX0Po4m4qYgkDoKJC_1_96f5de458aa4473827de13972f8453da', time=2024-03-04T14:56:01.003128+0000, chain.objs.size()=1 2024-03-04T13:00:17.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.475__shadow:uVjDMegxP6XYWgvybwvxI64cJu5z7Q0_.3EygMS0MkBsJBGyX0Po4m4qYgkDoKJC_0 2024-03-04T13:00:17.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.2_cd47d3d1d7e5e700ebfc61966146eac9', time=2024-03-04T14:56:03.547290+0000, chain.objs.size()=6 2024-03-04T13:00:17.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.1 2024-03-04T13:00:17.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.2 2024-03-04T13:00:17.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.3 2024-03-04T13:00:17.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.4 2024-03-04T13:00:17.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.5 2024-03-04T13:00:17.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.479__multipart_srcmultipart.2~P-SbnLLYe1tASrSAlzQMpEbVPQodFU6.6 2024-03-04T13:00:17.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.11241313849926541523', time=2024-03-04T14:57:04.294135+0000, chain.objs.size()=1 2024-03-04T13:00:17.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.521__shadow_._tWvg_P9eVi2M0NBdgLqHqdzNx4tkmu_0 2024-03-04T13:00:17.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8859513748611781664', time=2024-03-04T14:57:05.090943+0000, chain.objs.size()=1 2024-03-04T13:00:17.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.522__shadow_.VopFNr4uDABk8Bt3Ktvz3GNFsP6F6cd_0 2024-03-04T13:00:17.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='2~8YmQBi_4pVyXzAKeEw2492FMZKWAMpe', time=2024-03-04T14:57:08.339660+0000, chain.objs.size()=1 2024-03-04T13:00:17.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.118+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.528__multipart_mymultipart.2~8YmQBi_4pVyXzAKeEw2492FMZKWAMpe.1 2024-03-04T13:00:17.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18304927436638417356', time=2024-03-04T14:57:14.043844+0000, chain.objs.size()=1 2024-03-04T13:00:17.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.531__shadow_.bq-MkcuJkwE4cLQoj1SZd46JUURiJF2_0 2024-03-04T13:00:17.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14026705237033227453', time=2024-03-04T14:57:18.510156+0000, chain.objs.size()=1 2024-03-04T13:00:17.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.536__shadow:rDHHuvHFGUETi1LrybqnK6Qop0XqlnU_.tG4sqRsl8yS-R5vdrUlYhqbwjmp59P-_0 2024-03-04T13:00:17.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.16133415400832841491', time=2024-03-04T14:57:26.422219+0000, chain.objs.size()=1 2024-03-04T13:00:17.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.541__shadow:o6ANCkvrZepAx1dkOJSQYP5pZNmTZue_.X07I76quK05O41hzxpGmJ85KKDUsFGS_0 2024-03-04T13:00:17.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.18212370441988494912', time=2024-03-04T14:57:47.280182+0000, chain.objs.size()=1 2024-03-04T13:00:17.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.545__shadow:PgMip1Gjn6xveVCsvDkid3JcLsHPeWF_.ssAiit326va4bSSZGJaG36AgxsiG7Xw_0 2024-03-04T13:00:17.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.7290311491316090631', time=2024-03-04T14:58:04.367607+0000, chain.objs.size()=12 2024-03-04T13:00:17.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.579__multipart_multipart_enc.2~nQryC_r1IBTiwhf5cuX6JZGTQJkT--v.1 2024-03-04T13:00:17.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.579__shadow_multipart_enc.2~nQryC_r1IBTiwhf5cuX6JZGTQJkT--v.1_1 2024-03-04T13:00:17.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.579__multipart_multipart_enc.2~nQryC_r1IBTiwhf5cuX6JZGTQJkT--v.2 2024-03-04T13:00:17.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.120+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.579__shadow_multipart_enc.2~nQryC_r1IBTiwhf5cuX6JZGTQJkT--v.2_1 2024-03-04T13:00:17.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.121+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.579__multipart_multipart_enc.2~nQryC_r1IBTiwhf5cuX6JZGTQJkT--v.3 2024-03-04T13:00:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.121+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.579__shadow_multipart_enc.2~nQryC_r1IBTiwhf5cuX6JZGTQJkT--v.3_1 2024-03-04T13:00:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.121+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.579__multipart_multipart_enc.2~nQryC_r1IBTiwhf5cuX6JZGTQJkT--v.4 2024-03-04T13:00:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.579__shadow_multipart_enc.2~nQryC_r1IBTiwhf5cuX6JZGTQJkT--v.4_1 2024-03-04T13:00:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.579__multipart_multipart_enc.2~nQryC_r1IBTiwhf5cuX6JZGTQJkT--v.5 2024-03-04T13:00:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.579__shadow_multipart_enc.2~nQryC_r1IBTiwhf5cuX6JZGTQJkT--v.5_1 2024-03-04T13:00:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.579__multipart_multipart_enc.2~nQryC_r1IBTiwhf5cuX6JZGTQJkT--v.6 2024-03-04T13:00:17.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.579__shadow_multipart_enc.2~nQryC_r1IBTiwhf5cuX6JZGTQJkT--v.6_1 2024-03-04T13:00:17.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.17891056985307518735', time=2024-03-04T14:58:16.741265+0000, chain.objs.size()=1 2024-03-04T13:00:17.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.595__shadow_.0xZvpejskdUvESNLq0tCbI9qV2CsCKl_0 2024-03-04T13:00:17.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.8763008147026210095', time=2024-03-04T14:58:22.610889+0000, chain.objs.size()=1 2024-03-04T13:00:17.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.608__shadow_.f-VyjjONcZYRrSicP-m02jMgDhf5yVj_0 2024-03-04T13:00:17.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.630__shadow_.aovIoIZBatN413epMYhE96bK5u40X3z_1_e38c83b60a0e2acc990ea1482c9d5a41', time=2024-03-04T14:58:34.212338+0000, chain.objs.size()=1 2024-03-04T13:00:17.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.630__shadow_.aovIoIZBatN413epMYhE96bK5u40X3z_0 2024-03-04T13:00:17.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 20 garbage collection: RGWGC::process iterating over entry tag='9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.14560877233513245404', time=2024-03-04T14:58:50.977530+0000, chain.objs.size()=1 2024-03-04T13:00:17.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.124+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9ff357d4-34bf-43e3-830f-e9301a1282c1.4668.674__shadow:21vPzhiq-I-abULcpdouk-fE.0jcyZw_.AvyvbkINyvw-B7FCZiOV019EsDLYB5J_0 2024-03-04T13:00:17.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.128+0000 7f4aa2f24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:00:17.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.131+0000 7f49557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T13:00:17.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.133+0000 7f4aa2f24800 20 remove_watcher() i=0 2024-03-04T13:00:17.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.133+0000 7f4aa2f24800 2 removed watcher, disabling cache 2024-03-04T13:00:17.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.134+0000 7f4aa2f24800 20 remove_watcher() i=1 2024-03-04T13:00:17.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.135+0000 7f4aa2f24800 20 remove_watcher() i=2 2024-03-04T13:00:17.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.136+0000 7f4aa2f24800 20 remove_watcher() i=3 2024-03-04T13:00:17.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.137+0000 7f4aa2f24800 20 remove_watcher() i=4 2024-03-04T13:00:17.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.138+0000 7f4aa2f24800 20 remove_watcher() i=5 2024-03-04T13:00:17.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.139+0000 7f4aa2f24800 20 remove_watcher() i=6 2024-03-04T13:00:17.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-03-04T13:00:17.140+0000 7f4aa2f24800 20 remove_watcher() i=7 2024-03-04T13:00:17.192 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-03-04T13:00:17.206 DEBUG:teuthology.orchestra.run.smithi090:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-03-04T13:00:17.258 DEBUG:teuthology.orchestra.run.smithi090:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-03-04T13:00:17.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-03-04T13:00:17.325 DEBUG:teuthology.orchestra.run.smithi090:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-03-04T13:00:17.393 DEBUG:teuthology.orchestra.run.smithi090:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-03-04T13:00:17.461 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-03-04T13:00:17.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo update-ca-trust 2024-03-04T13:00:18.319 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-04T13:00:18.330 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-04T13:00:18.330 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:00:18.663 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:18.675 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-03-04T13:00:18.679 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":985,"stamp":"2024-03-04T13:00:17.354830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":686473817,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":254339,"num_read_kb":2785583,"num_write":156503,"num_write_kb":2552438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14275,"ondisk_log_size":14275,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3079856,"kb_used_data":1669928,"kb_used_omap":12,"kb_used_meta":1409587,"kb_avail":751894864,"statfs":{"total":773094113280,"available":769940340736,"internally_reserved":0,"allocated":1710006272,"data_stored":1670123478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1443417648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-217867511,"num_objects":-1453,"num_object_clones":0,"num_object_copies":-2906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1453,"num_whiteouts":0,"num_read":1696,"num_read_kb":79345,"num_write":1608,"num_write_kb":39020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004414"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.981271+0000","last_change":"2024-03-04T12:51:01.353518+0000","last_active":"2024-03-04T12:56:00.981271+0000","last_peered":"2024-03-04T12:56:00.981271+0000","last_clean":"2024-03-04T12:56:00.981271+0000","last_became_active":"2024-03-04T12:51:01.353225+0000","last_became_peered":"2024-03-04T12:51:01.353225+0000","last_unstale":"2024-03-04T12:56:00.981271+0000","last_undegraded":"2024-03-04T12:56:00.981271+0000","last_fullsized":"2024-03-04T12:56:00.981271+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:20:07.047294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"256'1","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.982336+0000","last_change":"2024-03-04T12:44:53.484600+0000","last_active":"2024-03-04T12:57:25.982336+0000","last_peered":"2024-03-04T12:57:25.982336+0000","last_clean":"2024-03-04T12:57:25.982336+0000","last_became_active":"2024-03-04T12:44:53.484341+0000","last_became_peered":"2024-03-04T12:44:53.484341+0000","last_unstale":"2024-03-04T12:57:25.982336+0000","last_undegraded":"2024-03-04T12:57:25.982336+0000","last_fullsized":"2024-03-04T12:57:25.982336+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:26:14.610910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:50.981767+0000","last_change":"2024-03-04T12:44:50.455898+0000","last_active":"2024-03-04T12:56:50.981767+0000","last_peered":"2024-03-04T12:56:50.981767+0000","last_clean":"2024-03-04T12:56:50.981767+0000","last_became_active":"2024-03-04T12:44:50.455509+0000","last_became_peered":"2024-03-04T12:44:50.455509+0000","last_unstale":"2024-03-04T12:56:50.981767+0000","last_undegraded":"2024-03-04T12:56:50.981767+0000","last_fullsized":"2024-03-04T12:56:50.981767+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:49.453401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"256'40","reported_seq":137,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.123970+0000","last_change":"2024-03-04T12:43:27.060696+0000","last_active":"2024-03-04T12:58:30.123970+0000","last_peered":"2024-03-04T12:58:30.123970+0000","last_clean":"2024-03-04T12:58:30.123970+0000","last_became_active":"2024-03-04T12:43:27.060405+0000","last_became_peered":"2024-03-04T12:43:27.060405+0000","last_unstale":"2024-03-04T12:58:30.123970+0000","last_undegraded":"2024-03-04T12:58:30.123970+0000","last_fullsized":"2024-03-04T12:58:30.123970+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:44.787006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":118,"num_write":66,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.981316+0000","last_change":"2024-03-04T12:51:01.358434+0000","last_active":"2024-03-04T12:56:00.981316+0000","last_peered":"2024-03-04T12:56:00.981316+0000","last_clean":"2024-03-04T12:56:00.981316+0000","last_became_active":"2024-03-04T12:51:01.358005+0000","last_became_peered":"2024-03-04T12:51:01.358005+0000","last_unstale":"2024-03-04T12:56:00.981316+0000","last_undegraded":"2024-03-04T12:56:00.981316+0000","last_fullsized":"2024-03-04T12:56:00.981316+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:18:34.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"256'8","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.000903+0000","last_change":"2024-03-04T12:44:53.487686+0000","last_active":"2024-03-04T12:59:56.000903+0000","last_peered":"2024-03-04T12:59:56.000903+0000","last_clean":"2024-03-04T12:59:56.000903+0000","last_became_active":"2024-03-04T12:44:53.486168+0000","last_became_peered":"2024-03-04T12:44:53.486168+0000","last_unstale":"2024-03-04T12:59:56.000903+0000","last_undegraded":"2024-03-04T12:59:56.000903+0000","last_fullsized":"2024-03-04T12:59:56.000903+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:34.274997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":10242,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.998713+0000","last_change":"2024-03-04T12:44:50.450818+0000","last_active":"2024-03-04T12:57:20.998713+0000","last_peered":"2024-03-04T12:57:20.998713+0000","last_clean":"2024-03-04T12:57:20.998713+0000","last_became_active":"2024-03-04T12:44:50.450465+0000","last_became_peered":"2024-03-04T12:44:50.450465+0000","last_unstale":"2024-03-04T12:57:20.998713+0000","last_undegraded":"2024-03-04T12:57:20.998713+0000","last_fullsized":"2024-03-04T12:57:20.998713+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:20:08.194072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"250'33","reported_seq":127,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:31.000006+0000","last_change":"2024-03-04T12:43:27.060869+0000","last_active":"2024-03-04T12:57:31.000006+0000","last_peered":"2024-03-04T12:57:31.000006+0000","last_clean":"2024-03-04T12:57:31.000006+0000","last_became_active":"2024-03-04T12:43:27.060562+0000","last_became_peered":"2024-03-04T12:43:27.060562+0000","last_unstale":"2024-03-04T12:57:31.000006+0000","last_undegraded":"2024-03-04T12:57:31.000006+0000","last_fullsized":"2024-03-04T12:57:31.000006+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:48.410106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":113,"num_write":48,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.979605+0000","last_change":"2024-03-04T12:51:01.596745+0000","last_active":"2024-03-04T12:57:00.979605+0000","last_peered":"2024-03-04T12:57:00.979605+0000","last_clean":"2024-03-04T12:57:00.979605+0000","last_became_active":"2024-03-04T12:51:01.595776+0000","last_became_peered":"2024-03-04T12:51:01.595776+0000","last_unstale":"2024-03-04T12:57:00.979605+0000","last_undegraded":"2024-03-04T12:57:00.979605+0000","last_fullsized":"2024-03-04T12:57:00.979605+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:37.758945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"256'11","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.996043+0000","last_change":"2024-03-04T12:44:53.479265+0000","last_active":"2024-03-04T12:57:25.996043+0000","last_peered":"2024-03-04T12:57:25.996043+0000","last_clean":"2024-03-04T12:57:25.996043+0000","last_became_active":"2024-03-04T12:44:53.478864+0000","last_became_peered":"2024-03-04T12:44:53.478864+0000","last_unstale":"2024-03-04T12:57:25.996043+0000","last_undegraded":"2024-03-04T12:57:25.996043+0000","last_fullsized":"2024-03-04T12:57:25.996043+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:28:17.550698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":25,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.982244+0000","last_change":"2024-03-04T12:44:50.454109+0000","last_active":"2024-03-04T12:57:20.982244+0000","last_peered":"2024-03-04T12:57:20.982244+0000","last_clean":"2024-03-04T12:57:20.982244+0000","last_became_active":"2024-03-04T12:44:50.453830+0000","last_became_peered":"2024-03-04T12:44:50.453830+0000","last_unstale":"2024-03-04T12:57:20.982244+0000","last_undegraded":"2024-03-04T12:57:20.982244+0000","last_fullsized":"2024-03-04T12:57:20.982244+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:34.779841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"256'64","reported_seq":196,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:09.281547+0000","last_change":"2024-03-04T12:43:27.067573+0000","last_active":"2024-03-04T12:56:09.281547+0000","last_peered":"2024-03-04T12:56:09.281547+0000","last_clean":"2024-03-04T12:56:09.281547+0000","last_became_active":"2024-03-04T12:43:27.067330+0000","last_became_peered":"2024-03-04T12:43:27.067330+0000","last_unstale":"2024-03-04T12:56:09.281547+0000","last_undegraded":"2024-03-04T12:56:09.281547+0000","last_fullsized":"2024-03-04T12:56:09.281547+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:08.510342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":194,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998217+0000","last_change":"2024-03-04T12:51:01.596599+0000","last_active":"2024-03-04T12:57:15.998217+0000","last_peered":"2024-03-04T12:57:15.998217+0000","last_clean":"2024-03-04T12:57:15.998217+0000","last_became_active":"2024-03-04T12:51:01.596268+0000","last_became_peered":"2024-03-04T12:51:01.596268+0000","last_unstale":"2024-03-04T12:57:15.998217+0000","last_undegraded":"2024-03-04T12:57:15.998217+0000","last_fullsized":"2024-03-04T12:57:15.998217+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:07:16.190633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.982302+0000","last_change":"2024-03-04T12:44:53.482037+0000","last_active":"2024-03-04T12:56:55.982302+0000","last_peered":"2024-03-04T12:56:55.982302+0000","last_clean":"2024-03-04T12:56:55.982302+0000","last_became_active":"2024-03-04T12:44:53.481760+0000","last_became_peered":"2024-03-04T12:44:53.481760+0000","last_unstale":"2024-03-04T12:56:55.982302+0000","last_undegraded":"2024-03-04T12:56:55.982302+0000","last_fullsized":"2024-03-04T12:56:55.982302+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:44.305523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.998658+0000","last_change":"2024-03-04T12:44:50.456063+0000","last_active":"2024-03-04T12:57:20.998658+0000","last_peered":"2024-03-04T12:57:20.998658+0000","last_clean":"2024-03-04T12:57:20.998658+0000","last_became_active":"2024-03-04T12:44:50.455723+0000","last_became_peered":"2024-03-04T12:44:50.455723+0000","last_unstale":"2024-03-04T12:57:20.998658+0000","last_undegraded":"2024-03-04T12:57:20.998658+0000","last_fullsized":"2024-03-04T12:57:20.998658+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:10:27.178040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"256'150","reported_seq":499,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.311363+0000","last_change":"2024-03-04T12:43:27.067487+0000","last_active":"2024-03-04T12:57:45.311363+0000","last_peered":"2024-03-04T12:57:45.311363+0000","last_clean":"2024-03-04T12:57:45.311363+0000","last_became_active":"2024-03-04T12:43:27.067228+0000","last_became_peered":"2024-03-04T12:43:27.067228+0000","last_unstale":"2024-03-04T12:57:45.311363+0000","last_undegraded":"2024-03-04T12:57:45.311363+0000","last_fullsized":"2024-03-04T12:57:45.311363+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:38.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":889,"num_read_kb":655,"num_write":189,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.976872+0000","last_change":"2024-03-04T12:51:01.356736+0000","last_active":"2024-03-04T12:55:50.976872+0000","last_peered":"2024-03-04T12:55:50.976872+0000","last_clean":"2024-03-04T12:55:50.976872+0000","last_became_active":"2024-03-04T12:51:01.356572+0000","last_became_peered":"2024-03-04T12:51:01.356572+0000","last_unstale":"2024-03-04T12:55:50.976872+0000","last_undegraded":"2024-03-04T12:55:50.976872+0000","last_fullsized":"2024-03-04T12:55:50.976872+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:07.737968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"256'3","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991872+0000","last_change":"2024-03-04T12:44:53.477654+0000","last_active":"2024-03-04T12:57:00.991872+0000","last_peered":"2024-03-04T12:57:00.991872+0000","last_clean":"2024-03-04T12:57:00.991872+0000","last_became_active":"2024-03-04T12:44:53.477386+0000","last_became_peered":"2024-03-04T12:44:53.477386+0000","last_unstale":"2024-03-04T12:57:00.991872+0000","last_undegraded":"2024-03-04T12:57:00.991872+0000","last_fullsized":"2024-03-04T12:57:00.991872+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:49:31.357868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":418,"num_write":3,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.988386+0000","last_change":"2024-03-04T12:44:50.449002+0000","last_active":"2024-03-04T12:57:20.988386+0000","last_peered":"2024-03-04T12:57:20.988386+0000","last_clean":"2024-03-04T12:57:20.988386+0000","last_became_active":"2024-03-04T12:44:50.448683+0000","last_became_peered":"2024-03-04T12:44:50.448683+0000","last_unstale":"2024-03-04T12:57:20.988386+0000","last_undegraded":"2024-03-04T12:57:20.988386+0000","last_fullsized":"2024-03-04T12:57:20.988386+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:39.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"256'38","reported_seq":128,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:29.561426+0000","last_change":"2024-03-04T12:43:27.062948+0000","last_active":"2024-03-04T12:58:29.561426+0000","last_peered":"2024-03-04T12:58:29.561426+0000","last_clean":"2024-03-04T12:58:29.561426+0000","last_became_active":"2024-03-04T12:43:27.062623+0000","last_became_peered":"2024-03-04T12:43:27.062623+0000","last_unstale":"2024-03-04T12:58:29.561426+0000","last_undegraded":"2024-03-04T12:58:29.561426+0000","last_fullsized":"2024-03-04T12:58:29.561426+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:50.641970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.979565+0000","last_change":"2024-03-04T12:51:01.357400+0000","last_active":"2024-03-04T12:55:50.979565+0000","last_peered":"2024-03-04T12:55:50.979565+0000","last_clean":"2024-03-04T12:55:50.979565+0000","last_became_active":"2024-03-04T12:51:01.355578+0000","last_became_peered":"2024-03-04T12:51:01.355578+0000","last_unstale":"2024-03-04T12:55:50.979565+0000","last_undegraded":"2024-03-04T12:55:50.979565+0000","last_fullsized":"2024-03-04T12:55:50.979565+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:25.516318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"256'9","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996330+0000","last_change":"2024-03-04T12:44:53.477157+0000","last_active":"2024-03-04T12:57:00.996330+0000","last_peered":"2024-03-04T12:57:00.996330+0000","last_clean":"2024-03-04T12:57:00.996330+0000","last_became_active":"2024-03-04T12:44:53.476348+0000","last_became_peered":"2024-03-04T12:44:53.476348+0000","last_unstale":"2024-03-04T12:57:00.996330+0000","last_undegraded":"2024-03-04T12:57:00.996330+0000","last_fullsized":"2024-03-04T12:57:00.996330+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:43.436115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'5","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.982216+0000","last_change":"2024-03-04T12:44:50.454551+0000","last_active":"2024-03-04T12:57:20.982216+0000","last_peered":"2024-03-04T12:57:20.982216+0000","last_clean":"2024-03-04T12:57:20.982216+0000","last_became_active":"2024-03-04T12:44:50.454252+0000","last_became_peered":"2024-03-04T12:44:50.454252+0000","last_unstale":"2024-03-04T12:57:20.982216+0000","last_undegraded":"2024-03-04T12:57:20.982216+0000","last_fullsized":"2024-03-04T12:57:20.982216+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:16:14.575234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"256'25","reported_seq":96,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:27.547187+0000","last_change":"2024-03-04T12:43:27.061927+0000","last_active":"2024-03-04T12:56:27.547187+0000","last_peered":"2024-03-04T12:56:27.547187+0000","last_clean":"2024-03-04T12:56:27.547187+0000","last_became_active":"2024-03-04T12:43:27.061611+0000","last_became_peered":"2024-03-04T12:43:27.061611+0000","last_unstale":"2024-03-04T12:56:27.547187+0000","last_undegraded":"2024-03-04T12:56:27.547187+0000","last_fullsized":"2024-03-04T12:56:27.547187+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:29.841849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.972502+0000","last_change":"2024-03-04T12:51:01.351751+0000","last_active":"2024-03-04T12:56:00.972502+0000","last_peered":"2024-03-04T12:56:00.972502+0000","last_clean":"2024-03-04T12:56:00.972502+0000","last_became_active":"2024-03-04T12:51:01.351465+0000","last_became_peered":"2024-03-04T12:51:01.351465+0000","last_unstale":"2024-03-04T12:56:00.972502+0000","last_undegraded":"2024-03-04T12:56:00.972502+0000","last_fullsized":"2024-03-04T12:56:00.972502+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:15.131665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"256'3","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.999164+0000","last_change":"2024-03-04T12:44:53.483089+0000","last_active":"2024-03-04T12:57:25.999164+0000","last_peered":"2024-03-04T12:57:25.999164+0000","last_clean":"2024-03-04T12:57:25.999164+0000","last_became_active":"2024-03-04T12:44:53.482806+0000","last_became_peered":"2024-03-04T12:44:53.482806+0000","last_unstale":"2024-03-04T12:57:25.999164+0000","last_undegraded":"2024-03-04T12:57:25.999164+0000","last_fullsized":"2024-03-04T12:57:25.999164+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:48:39.848469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":36,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.978599+0000","last_change":"2024-03-04T12:44:50.457492+0000","last_active":"2024-03-04T12:56:55.978599+0000","last_peered":"2024-03-04T12:56:55.978599+0000","last_clean":"2024-03-04T12:56:55.978599+0000","last_became_active":"2024-03-04T12:44:50.457180+0000","last_became_peered":"2024-03-04T12:44:50.457180+0000","last_unstale":"2024-03-04T12:56:55.978599+0000","last_undegraded":"2024-03-04T12:56:55.978599+0000","last_fullsized":"2024-03-04T12:56:55.978599+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:05.748747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"256'43","reported_seq":131,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:08.070073+0000","last_change":"2024-03-04T12:43:27.063888+0000","last_active":"2024-03-04T12:58:08.070073+0000","last_peered":"2024-03-04T12:58:08.070073+0000","last_clean":"2024-03-04T12:58:08.070073+0000","last_became_active":"2024-03-04T12:43:27.063191+0000","last_became_peered":"2024-03-04T12:43:27.063191+0000","last_unstale":"2024-03-04T12:58:08.070073+0000","last_undegraded":"2024-03-04T12:58:08.070073+0000","last_fullsized":"2024-03-04T12:58:08.070073+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:06.499554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":76,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.978217+0000","last_change":"2024-03-04T12:51:01.353519+0000","last_active":"2024-03-04T12:56:00.978217+0000","last_peered":"2024-03-04T12:56:00.978217+0000","last_clean":"2024-03-04T12:56:00.978217+0000","last_became_active":"2024-03-04T12:51:01.353248+0000","last_became_peered":"2024-03-04T12:51:01.353248+0000","last_unstale":"2024-03-04T12:56:00.978217+0000","last_undegraded":"2024-03-04T12:56:00.978217+0000","last_fullsized":"2024-03-04T12:56:00.978217+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:08:04.830256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"250'5","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.995929+0000","last_change":"2024-03-04T12:44:53.483754+0000","last_active":"2024-03-04T12:57:25.995929+0000","last_peered":"2024-03-04T12:57:25.995929+0000","last_clean":"2024-03-04T12:57:25.995929+0000","last_became_active":"2024-03-04T12:44:53.483210+0000","last_became_peered":"2024-03-04T12:44:53.483210+0000","last_unstale":"2024-03-04T12:57:25.995929+0000","last_undegraded":"2024-03-04T12:57:25.995929+0000","last_fullsized":"2024-03-04T12:57:25.995929+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:13.903672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"256'7","reported_seq":51,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.995460+0000","last_change":"2024-03-04T12:44:50.449512+0000","last_active":"2024-03-04T12:56:55.995460+0000","last_peered":"2024-03-04T12:56:55.995460+0000","last_clean":"2024-03-04T12:56:55.995460+0000","last_became_active":"2024-03-04T12:44:50.449291+0000","last_became_peered":"2024-03-04T12:44:50.449291+0000","last_unstale":"2024-03-04T12:56:55.995460+0000","last_undegraded":"2024-03-04T12:56:55.995460+0000","last_fullsized":"2024-03-04T12:56:55.995460+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:31.117281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"256'42","reported_seq":129,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:11.125334+0000","last_change":"2024-03-04T12:43:27.061951+0000","last_active":"2024-03-04T12:58:11.125334+0000","last_peered":"2024-03-04T12:58:11.125334+0000","last_clean":"2024-03-04T12:58:11.125334+0000","last_became_active":"2024-03-04T12:43:27.061663+0000","last_became_peered":"2024-03-04T12:43:27.061663+0000","last_unstale":"2024-03-04T12:58:11.125334+0000","last_undegraded":"2024-03-04T12:58:11.125334+0000","last_fullsized":"2024-03-04T12:58:11.125334+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:27:00.046660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.970079+0000","last_change":"2024-03-04T12:51:01.596240+0000","last_active":"2024-03-04T12:55:40.970079+0000","last_peered":"2024-03-04T12:55:40.970079+0000","last_clean":"2024-03-04T12:55:40.970079+0000","last_became_active":"2024-03-04T12:51:01.595943+0000","last_became_peered":"2024-03-04T12:51:01.595943+0000","last_unstale":"2024-03-04T12:55:40.970079+0000","last_undegraded":"2024-03-04T12:55:40.970079+0000","last_fullsized":"2024-03-04T12:55:40.970079+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:05:52.818694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"256'1","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.876732+0000","last_change":"2024-03-04T12:44:53.486306+0000","last_active":"2024-03-04T12:57:00.876732+0000","last_peered":"2024-03-04T12:57:00.876732+0000","last_clean":"2024-03-04T12:57:00.876732+0000","last_became_active":"2024-03-04T12:44:53.485995+0000","last_became_peered":"2024-03-04T12:44:53.485995+0000","last_unstale":"2024-03-04T12:57:00.876732+0000","last_undegraded":"2024-03-04T12:57:00.876732+0000","last_fullsized":"2024-03-04T12:57:00.876732+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:08.363349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"256'4","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:20.996938+0000","last_change":"2024-03-04T12:44:50.454948+0000","last_active":"2024-03-04T12:59:20.996938+0000","last_peered":"2024-03-04T12:59:20.996938+0000","last_clean":"2024-03-04T12:59:20.996938+0000","last_became_active":"2024-03-04T12:44:50.454617+0000","last_became_peered":"2024-03-04T12:44:50.454617+0000","last_unstale":"2024-03-04T12:59:20.996938+0000","last_undegraded":"2024-03-04T12:59:20.996938+0000","last_fullsized":"2024-03-04T12:59:20.996938+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:25:07.798347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"256'41","reported_seq":134,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:02.415602+0000","last_change":"2024-03-04T12:43:27.050913+0000","last_active":"2024-03-04T12:58:02.415602+0000","last_peered":"2024-03-04T12:58:02.415602+0000","last_clean":"2024-03-04T12:58:02.415602+0000","last_became_active":"2024-03-04T12:43:27.050088+0000","last_became_peered":"2024-03-04T12:43:27.050088+0000","last_unstale":"2024-03-04T12:58:02.415602+0000","last_undegraded":"2024-03-04T12:58:02.415602+0000","last_fullsized":"2024-03-04T12:58:02.415602+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:10:21.742322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":112,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.971352+0000","last_change":"2024-03-04T12:51:01.595890+0000","last_active":"2024-03-04T12:55:50.971352+0000","last_peered":"2024-03-04T12:55:50.971352+0000","last_clean":"2024-03-04T12:55:50.971352+0000","last_became_active":"2024-03-04T12:51:01.595530+0000","last_became_peered":"2024-03-04T12:51:01.595530+0000","last_unstale":"2024-03-04T12:55:50.971352+0000","last_undegraded":"2024-03-04T12:55:50.971352+0000","last_fullsized":"2024-03-04T12:55:50.971352+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:42:04.439066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"256'4","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.814138+0000","last_change":"2024-03-04T12:44:53.478706+0000","last_active":"2024-03-04T13:00:15.814138+0000","last_peered":"2024-03-04T13:00:15.814138+0000","last_clean":"2024-03-04T13:00:15.814138+0000","last_became_active":"2024-03-04T12:44:53.478099+0000","last_became_peered":"2024-03-04T12:44:53.478099+0000","last_unstale":"2024-03-04T13:00:15.814138+0000","last_undegraded":"2024-03-04T13:00:15.814138+0000","last_fullsized":"2024-03-04T13:00:15.814138+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:06:14.838765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.995606+0000","last_change":"2024-03-04T12:44:50.449111+0000","last_active":"2024-03-04T12:56:55.995606+0000","last_peered":"2024-03-04T12:56:55.995606+0000","last_clean":"2024-03-04T12:56:55.995606+0000","last_became_active":"2024-03-04T12:44:50.448745+0000","last_became_peered":"2024-03-04T12:44:50.448745+0000","last_unstale":"2024-03-04T12:56:55.995606+0000","last_undegraded":"2024-03-04T12:56:55.995606+0000","last_fullsized":"2024-03-04T12:56:55.995606+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:10:12.812219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"256'16","reported_seq":80,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:14.293042+0000","last_change":"2024-03-04T12:43:27.059795+0000","last_active":"2024-03-04T12:58:14.293042+0000","last_peered":"2024-03-04T12:58:14.293042+0000","last_clean":"2024-03-04T12:58:14.293042+0000","last_became_active":"2024-03-04T12:43:27.059494+0000","last_became_peered":"2024-03-04T12:43:27.059494+0000","last_unstale":"2024-03-04T12:58:14.293042+0000","last_undegraded":"2024-03-04T12:58:14.293042+0000","last_fullsized":"2024-03-04T12:58:14.293042+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:49.787014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":48,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.979602+0000","last_change":"2024-03-04T12:51:01.355844+0000","last_active":"2024-03-04T12:55:50.979602+0000","last_peered":"2024-03-04T12:55:50.979602+0000","last_clean":"2024-03-04T12:55:50.979602+0000","last_became_active":"2024-03-04T12:51:01.355560+0000","last_became_peered":"2024-03-04T12:51:01.355560+0000","last_unstale":"2024-03-04T12:55:50.979602+0000","last_undegraded":"2024-03-04T12:55:50.979602+0000","last_fullsized":"2024-03-04T12:55:50.979602+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:05:47.161069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'3","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996437+0000","last_change":"2024-03-04T12:44:53.476693+0000","last_active":"2024-03-04T12:57:00.996437+0000","last_peered":"2024-03-04T12:57:00.996437+0000","last_clean":"2024-03-04T12:57:00.996437+0000","last_became_active":"2024-03-04T12:44:53.475861+0000","last_became_peered":"2024-03-04T12:44:53.475861+0000","last_unstale":"2024-03-04T12:57:00.996437+0000","last_undegraded":"2024-03-04T12:57:00.996437+0000","last_fullsized":"2024-03-04T12:57:00.996437+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.651931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"256'6","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.873133+0000","last_change":"2024-03-04T12:44:50.453813+0000","last_active":"2024-03-04T12:56:35.873133+0000","last_peered":"2024-03-04T12:56:35.873133+0000","last_clean":"2024-03-04T12:56:35.873133+0000","last_became_active":"2024-03-04T12:44:50.453541+0000","last_became_peered":"2024-03-04T12:44:50.453541+0000","last_unstale":"2024-03-04T12:56:35.873133+0000","last_undegraded":"2024-03-04T12:56:35.873133+0000","last_fullsized":"2024-03-04T12:56:35.873133+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:58.224158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"256'48","reported_seq":147,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.129302+0000","last_change":"2024-03-04T12:43:27.071953+0000","last_active":"2024-03-04T12:58:05.129302+0000","last_peered":"2024-03-04T12:58:05.129302+0000","last_clean":"2024-03-04T12:58:05.129302+0000","last_became_active":"2024-03-04T12:43:27.069664+0000","last_became_peered":"2024-03-04T12:43:27.069664+0000","last_unstale":"2024-03-04T12:58:05.129302+0000","last_undegraded":"2024-03-04T12:58:05.129302+0000","last_fullsized":"2024-03-04T12:58:05.129302+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:18:04.123917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":13,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.992618+0000","last_change":"2024-03-04T12:51:41.753110+0000","last_active":"2024-03-04T12:56:30.992618+0000","last_peered":"2024-03-04T12:56:30.992618+0000","last_clean":"2024-03-04T12:56:30.992618+0000","last_became_active":"2024-03-04T12:51:41.752775+0000","last_became_peered":"2024-03-04T12:51:41.752775+0000","last_unstale":"2024-03-04T12:56:30.992618+0000","last_undegraded":"2024-03-04T12:56:30.992618+0000","last_fullsized":"2024-03-04T12:56:30.992618+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:14.336520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"256'6","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.983024+0000","last_change":"2024-03-04T12:44:53.478491+0000","last_active":"2024-03-04T12:57:00.983024+0000","last_peered":"2024-03-04T12:57:00.983024+0000","last_clean":"2024-03-04T12:57:00.983024+0000","last_became_active":"2024-03-04T12:44:53.478126+0000","last_became_peered":"2024-03-04T12:44:53.478126+0000","last_unstale":"2024-03-04T12:57:00.983024+0000","last_undegraded":"2024-03-04T12:57:00.983024+0000","last_fullsized":"2024-03-04T12:57:00.983024+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:47.296637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":11793,"num_write":11,"num_write_kb":7697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'1","reported_seq":38,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.982270+0000","last_change":"2024-03-04T12:44:50.455922+0000","last_active":"2024-03-04T12:56:55.982270+0000","last_peered":"2024-03-04T12:56:55.982270+0000","last_clean":"2024-03-04T12:56:55.982270+0000","last_became_active":"2024-03-04T12:44:50.455571+0000","last_became_peered":"2024-03-04T12:44:50.455571+0000","last_unstale":"2024-03-04T12:56:55.982270+0000","last_undegraded":"2024-03-04T12:56:55.982270+0000","last_fullsized":"2024-03-04T12:56:55.982270+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:00.096593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"256'47","reported_seq":142,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.983079+0000","last_change":"2024-03-04T12:43:27.060510+0000","last_active":"2024-03-04T12:57:30.983079+0000","last_peered":"2024-03-04T12:57:30.983079+0000","last_clean":"2024-03-04T12:57:30.983079+0000","last_became_active":"2024-03-04T12:43:27.060225+0000","last_became_peered":"2024-03-04T12:43:27.060225+0000","last_unstale":"2024-03-04T12:57:30.983079+0000","last_undegraded":"2024-03-04T12:57:30.983079+0000","last_fullsized":"2024-03-04T12:57:30.983079+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:54.961280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":112,"num_write":82,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.969881+0000","last_change":"2024-03-04T12:51:01.353480+0000","last_active":"2024-03-04T12:55:40.969881+0000","last_peered":"2024-03-04T12:55:40.969881+0000","last_clean":"2024-03-04T12:55:40.969881+0000","last_became_active":"2024-03-04T12:51:01.353087+0000","last_became_peered":"2024-03-04T12:51:01.353087+0000","last_unstale":"2024-03-04T12:55:40.969881+0000","last_undegraded":"2024-03-04T12:55:40.969881+0000","last_fullsized":"2024-03-04T12:55:40.969881+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:41.880369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.976551+0000","last_change":"2024-03-04T12:44:53.486342+0000","last_active":"2024-03-04T12:56:35.976551+0000","last_peered":"2024-03-04T12:56:35.976551+0000","last_clean":"2024-03-04T12:56:35.976551+0000","last_became_active":"2024-03-04T12:44:53.485819+0000","last_became_peered":"2024-03-04T12:44:53.485819+0000","last_unstale":"2024-03-04T12:56:35.976551+0000","last_undegraded":"2024-03-04T12:56:35.976551+0000","last_fullsized":"2024-03-04T12:56:35.976551+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:16.679448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"256'15","reported_seq":69,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.992528+0000","last_change":"2024-03-04T12:44:50.451881+0000","last_active":"2024-03-04T12:56:30.992528+0000","last_peered":"2024-03-04T12:56:30.992528+0000","last_clean":"2024-03-04T12:56:30.992528+0000","last_became_active":"2024-03-04T12:44:50.451612+0000","last_became_peered":"2024-03-04T12:44:50.451612+0000","last_unstale":"2024-03-04T12:56:30.992528+0000","last_undegraded":"2024-03-04T12:56:30.992528+0000","last_fullsized":"2024-03-04T12:56:30.992528+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:32.014515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":29700,"num_write":23,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"256'29","reported_seq":109,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.986253+0000","last_change":"2024-03-04T12:43:27.067821+0000","last_active":"2024-03-04T12:57:30.986253+0000","last_peered":"2024-03-04T12:57:30.986253+0000","last_clean":"2024-03-04T12:57:30.986253+0000","last_became_active":"2024-03-04T12:43:27.067356+0000","last_became_peered":"2024-03-04T12:43:27.067356+0000","last_unstale":"2024-03-04T12:57:30.986253+0000","last_undegraded":"2024-03-04T12:57:30.986253+0000","last_fullsized":"2024-03-04T12:57:30.986253+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:08.857494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":50,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.969928+0000","last_change":"2024-03-04T12:51:01.353135+0000","last_active":"2024-03-04T12:55:40.969928+0000","last_peered":"2024-03-04T12:55:40.969928+0000","last_clean":"2024-03-04T12:55:40.969928+0000","last_became_active":"2024-03-04T12:51:01.352205+0000","last_became_peered":"2024-03-04T12:51:01.352205+0000","last_unstale":"2024-03-04T12:55:40.969928+0000","last_undegraded":"2024-03-04T12:55:40.969928+0000","last_fullsized":"2024-03-04T12:55:40.969928+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:10:58.627530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"256'8","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:56.009808+0000","last_change":"2024-03-04T12:44:53.480313+0000","last_active":"2024-03-04T12:58:56.009808+0000","last_peered":"2024-03-04T12:58:56.009808+0000","last_clean":"2024-03-04T12:58:56.009808+0000","last_became_active":"2024-03-04T12:44:53.479906+0000","last_became_peered":"2024-03-04T12:44:53.479906+0000","last_unstale":"2024-03-04T12:58:56.009808+0000","last_undegraded":"2024-03-04T12:58:56.009808+0000","last_fullsized":"2024-03-04T12:58:56.009808+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:21.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":8765,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"256'2","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:50.892362+0000","last_change":"2024-03-04T12:44:50.455993+0000","last_active":"2024-03-04T12:58:50.892362+0000","last_peered":"2024-03-04T12:58:50.892362+0000","last_clean":"2024-03-04T12:58:50.892362+0000","last_became_active":"2024-03-04T12:44:50.455705+0000","last_became_peered":"2024-03-04T12:44:50.455705+0000","last_unstale":"2024-03-04T12:58:50.892362+0000","last_undegraded":"2024-03-04T12:58:50.892362+0000","last_fullsized":"2024-03-04T12:58:50.892362+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:28:07.679290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"256'37","reported_seq":129,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996807+0000","last_change":"2024-03-04T12:43:27.050258+0000","last_active":"2024-03-04T12:57:30.996807+0000","last_peered":"2024-03-04T12:57:30.996807+0000","last_clean":"2024-03-04T12:57:30.996807+0000","last_became_active":"2024-03-04T12:43:27.049948+0000","last_became_peered":"2024-03-04T12:43:27.049948+0000","last_unstale":"2024-03-04T12:57:30.996807+0000","last_undegraded":"2024-03-04T12:57:30.996807+0000","last_fullsized":"2024-03-04T12:57:30.996807+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:58:15.839313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":102,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.975555+0000","last_change":"2024-03-04T12:51:01.355931+0000","last_active":"2024-03-04T12:55:40.975555+0000","last_peered":"2024-03-04T12:55:40.975555+0000","last_clean":"2024-03-04T12:55:40.975555+0000","last_became_active":"2024-03-04T12:51:01.355460+0000","last_became_peered":"2024-03-04T12:51:01.355460+0000","last_unstale":"2024-03-04T12:55:40.975555+0000","last_undegraded":"2024-03-04T12:55:40.975555+0000","last_fullsized":"2024-03-04T12:55:40.975555+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:17:13.384167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.987291+0000","last_change":"2024-03-04T12:44:53.483084+0000","last_active":"2024-03-04T12:56:35.987291+0000","last_peered":"2024-03-04T12:56:35.987291+0000","last_clean":"2024-03-04T12:56:35.987291+0000","last_became_active":"2024-03-04T12:44:53.482573+0000","last_became_peered":"2024-03-04T12:44:53.482573+0000","last_unstale":"2024-03-04T12:56:35.987291+0000","last_undegraded":"2024-03-04T12:56:35.987291+0000","last_fullsized":"2024-03-04T12:56:35.987291+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:53.724969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":36,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.975976+0000","last_change":"2024-03-04T12:44:50.453266+0000","last_active":"2024-03-04T12:56:30.975976+0000","last_peered":"2024-03-04T12:56:30.975976+0000","last_clean":"2024-03-04T12:56:30.975976+0000","last_became_active":"2024-03-04T12:44:50.450815+0000","last_became_peered":"2024-03-04T12:44:50.450815+0000","last_unstale":"2024-03-04T12:56:30.975976+0000","last_undegraded":"2024-03-04T12:56:30.975976+0000","last_fullsized":"2024-03-04T12:56:30.975976+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:55.139788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"256'28","reported_seq":105,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996809+0000","last_change":"2024-03-04T12:43:27.056330+0000","last_active":"2024-03-04T12:57:30.996809+0000","last_peered":"2024-03-04T12:57:30.996809+0000","last_clean":"2024-03-04T12:57:30.996809+0000","last_became_active":"2024-03-04T12:43:27.055932+0000","last_became_peered":"2024-03-04T12:43:27.055932+0000","last_unstale":"2024-03-04T12:57:30.996809+0000","last_undegraded":"2024-03-04T12:57:30.996809+0000","last_fullsized":"2024-03-04T12:57:30.996809+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:37.799617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"253'1","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.970059+0000","last_change":"2024-03-04T12:51:01.356544+0000","last_active":"2024-03-04T12:55:40.970059+0000","last_peered":"2024-03-04T12:55:40.970059+0000","last_clean":"2024-03-04T12:55:40.970059+0000","last_became_active":"2024-03-04T12:51:01.356234+0000","last_became_peered":"2024-03-04T12:51:01.356234+0000","last_unstale":"2024-03-04T12:55:40.970059+0000","last_undegraded":"2024-03-04T12:55:40.970059+0000","last_fullsized":"2024-03-04T12:55:40.970059+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:48:48.586485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.982336+0000","last_change":"2024-03-04T12:44:53.481928+0000","last_active":"2024-03-04T12:56:35.982336+0000","last_peered":"2024-03-04T12:56:35.982336+0000","last_clean":"2024-03-04T12:56:35.982336+0000","last_became_active":"2024-03-04T12:44:53.481628+0000","last_became_peered":"2024-03-04T12:44:53.481628+0000","last_unstale":"2024-03-04T12:56:35.982336+0000","last_undegraded":"2024-03-04T12:56:35.982336+0000","last_fullsized":"2024-03-04T12:56:35.982336+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:17.939017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.986374+0000","last_change":"2024-03-04T12:44:50.457916+0000","last_active":"2024-03-04T12:56:30.986374+0000","last_peered":"2024-03-04T12:56:30.986374+0000","last_clean":"2024-03-04T12:56:30.986374+0000","last_became_active":"2024-03-04T12:44:50.457629+0000","last_became_peered":"2024-03-04T12:44:50.457629+0000","last_unstale":"2024-03-04T12:56:30.986374+0000","last_undegraded":"2024-03-04T12:56:30.986374+0000","last_fullsized":"2024-03-04T12:56:30.986374+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:34.728903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"256'46","reported_seq":148,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.983328+0000","last_change":"2024-03-04T12:43:27.061563+0000","last_active":"2024-03-04T12:57:30.983328+0000","last_peered":"2024-03-04T12:57:30.983328+0000","last_clean":"2024-03-04T12:57:30.983328+0000","last_became_active":"2024-03-04T12:43:27.061268+0000","last_became_peered":"2024-03-04T12:43:27.061268+0000","last_unstale":"2024-03-04T12:57:30.983328+0000","last_undegraded":"2024-03-04T12:57:30.983328+0000","last_fullsized":"2024-03-04T12:57:30.983328+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:22.110813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":125,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"254'1","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985556+0000","last_change":"2024-03-04T12:51:01.352006+0000","last_active":"2024-03-04T12:57:45.985556+0000","last_peered":"2024-03-04T12:57:45.985556+0000","last_clean":"2024-03-04T12:57:45.985556+0000","last_became_active":"2024-03-04T12:51:01.351718+0000","last_became_peered":"2024-03-04T12:51:01.351718+0000","last_unstale":"2024-03-04T12:57:45.985556+0000","last_undegraded":"2024-03-04T12:57:45.985556+0000","last_fullsized":"2024-03-04T12:57:45.985556+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:24:57.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"256'6","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.977187+0000","last_change":"2024-03-04T12:44:53.480592+0000","last_active":"2024-03-04T12:56:10.977187+0000","last_peered":"2024-03-04T12:56:10.977187+0000","last_clean":"2024-03-04T12:56:10.977187+0000","last_became_active":"2024-03-04T12:44:53.480237+0000","last_became_peered":"2024-03-04T12:44:53.480237+0000","last_unstale":"2024-03-04T12:56:10.977187+0000","last_undegraded":"2024-03-04T12:56:10.977187+0000","last_fullsized":"2024-03-04T12:56:10.977187+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:42.531307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"256'3","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.982286+0000","last_change":"2024-03-04T12:44:50.451651+0000","last_active":"2024-03-04T12:56:05.982286+0000","last_peered":"2024-03-04T12:56:05.982286+0000","last_clean":"2024-03-04T12:56:05.982286+0000","last_became_active":"2024-03-04T12:44:50.451353+0000","last_became_peered":"2024-03-04T12:44:50.451353+0000","last_unstale":"2024-03-04T12:56:05.982286+0000","last_undegraded":"2024-03-04T12:56:05.982286+0000","last_fullsized":"2024-03-04T12:56:05.982286+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:38.552540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"256'22","reported_seq":88,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991999+0000","last_change":"2024-03-04T12:43:27.060928+0000","last_active":"2024-03-04T12:57:00.991999+0000","last_peered":"2024-03-04T12:57:00.991999+0000","last_clean":"2024-03-04T12:57:00.991999+0000","last_became_active":"2024-03-04T12:43:27.060626+0000","last_became_peered":"2024-03-04T12:43:27.060626+0000","last_unstale":"2024-03-04T12:57:00.991999+0000","last_undegraded":"2024-03-04T12:57:00.991999+0000","last_fullsized":"2024-03-04T12:57:00.991999+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:18.681323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":39,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985610+0000","last_change":"2024-03-04T12:51:01.356830+0000","last_active":"2024-03-04T12:57:45.985610+0000","last_peered":"2024-03-04T12:57:45.985610+0000","last_clean":"2024-03-04T12:57:45.985610+0000","last_became_active":"2024-03-04T12:51:01.356268+0000","last_became_peered":"2024-03-04T12:51:01.356268+0000","last_unstale":"2024-03-04T12:57:45.985610+0000","last_undegraded":"2024-03-04T12:57:45.985610+0000","last_fullsized":"2024-03-04T12:57:45.985610+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:55:16.934337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:25.889144+0000","last_change":"2024-03-04T12:44:53.489009+0000","last_active":"2024-03-04T12:58:25.889144+0000","last_peered":"2024-03-04T12:58:25.889144+0000","last_clean":"2024-03-04T12:58:25.889144+0000","last_became_active":"2024-03-04T12:44:53.488798+0000","last_became_peered":"2024-03-04T12:44:53.488798+0000","last_unstale":"2024-03-04T12:58:25.889144+0000","last_undegraded":"2024-03-04T12:58:25.889144+0000","last_fullsized":"2024-03-04T12:58:25.889144+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:57.438592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'7","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.973217+0000","last_change":"2024-03-04T12:44:50.449837+0000","last_active":"2024-03-04T12:56:05.973217+0000","last_peered":"2024-03-04T12:56:05.973217+0000","last_clean":"2024-03-04T12:56:05.973217+0000","last_became_active":"2024-03-04T12:44:50.449555+0000","last_became_peered":"2024-03-04T12:44:50.449555+0000","last_unstale":"2024-03-04T12:56:05.973217+0000","last_undegraded":"2024-03-04T12:56:05.973217+0000","last_fullsized":"2024-03-04T12:56:05.973217+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:28:29.864964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":9220,"num_write":12,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"256'38","reported_seq":131,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.628221+0000","last_change":"2024-03-04T12:43:27.062921+0000","last_active":"2024-03-04T12:58:30.628221+0000","last_peered":"2024-03-04T12:58:30.628221+0000","last_clean":"2024-03-04T12:58:30.628221+0000","last_became_active":"2024-03-04T12:43:27.062618+0000","last_became_peered":"2024-03-04T12:43:27.062618+0000","last_unstale":"2024-03-04T12:58:30.628221+0000","last_undegraded":"2024-03-04T12:58:30.628221+0000","last_fullsized":"2024-03-04T12:58:30.628221+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:15.108779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":110,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985636+0000","last_change":"2024-03-04T12:51:01.358213+0000","last_active":"2024-03-04T12:57:45.985636+0000","last_peered":"2024-03-04T12:57:45.985636+0000","last_clean":"2024-03-04T12:57:45.985636+0000","last_became_active":"2024-03-04T12:51:01.357842+0000","last_became_peered":"2024-03-04T12:51:01.357842+0000","last_unstale":"2024-03-04T12:57:45.985636+0000","last_undegraded":"2024-03-04T12:57:45.985636+0000","last_fullsized":"2024-03-04T12:57:45.985636+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:49:05.564345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"256'1","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.973737+0000","last_change":"2024-03-04T12:44:53.483502+0000","last_active":"2024-03-04T12:56:10.973737+0000","last_peered":"2024-03-04T12:56:10.973737+0000","last_clean":"2024-03-04T12:56:10.973737+0000","last_became_active":"2024-03-04T12:44:53.483209+0000","last_became_peered":"2024-03-04T12:44:53.483209+0000","last_unstale":"2024-03-04T12:56:10.973737+0000","last_undegraded":"2024-03-04T12:56:10.973737+0000","last_fullsized":"2024-03-04T12:56:10.973737+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:30.529782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"256'4","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.976647+0000","last_change":"2024-03-04T12:44:50.458501+0000","last_active":"2024-03-04T12:56:05.976647+0000","last_peered":"2024-03-04T12:56:05.976647+0000","last_clean":"2024-03-04T12:56:05.976647+0000","last_became_active":"2024-03-04T12:44:50.458158+0000","last_became_peered":"2024-03-04T12:44:50.458158+0000","last_unstale":"2024-03-04T12:56:05.976647+0000","last_undegraded":"2024-03-04T12:56:05.976647+0000","last_fullsized":"2024-03-04T12:56:05.976647+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:23.431721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"256'48","reported_seq":150,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991998+0000","last_change":"2024-03-04T12:43:27.058847+0000","last_active":"2024-03-04T12:57:00.991998+0000","last_peered":"2024-03-04T12:57:00.991998+0000","last_clean":"2024-03-04T12:57:00.991998+0000","last_became_active":"2024-03-04T12:43:27.058410+0000","last_became_peered":"2024-03-04T12:43:27.058410+0000","last_unstale":"2024-03-04T12:57:00.991998+0000","last_undegraded":"2024-03-04T12:57:00.991998+0000","last_fullsized":"2024-03-04T12:57:00.991998+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:41.466619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":132,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985014+0000","last_change":"2024-03-04T12:51:01.597461+0000","last_active":"2024-03-04T12:57:45.985014+0000","last_peered":"2024-03-04T12:57:45.985014+0000","last_clean":"2024-03-04T12:57:45.985014+0000","last_became_active":"2024-03-04T12:51:01.597162+0000","last_became_peered":"2024-03-04T12:51:01.597162+0000","last_unstale":"2024-03-04T12:57:45.985014+0000","last_undegraded":"2024-03-04T12:57:45.985014+0000","last_fullsized":"2024-03-04T12:57:45.985014+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:42:36.597535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.989977+0000","last_change":"2024-03-04T12:44:53.478668+0000","last_active":"2024-03-04T12:56:10.989977+0000","last_peered":"2024-03-04T12:56:10.989977+0000","last_clean":"2024-03-04T12:56:10.989977+0000","last_became_active":"2024-03-04T12:44:53.478352+0000","last_became_peered":"2024-03-04T12:44:53.478352+0000","last_unstale":"2024-03-04T12:56:10.989977+0000","last_undegraded":"2024-03-04T12:56:10.989977+0000","last_fullsized":"2024-03-04T12:56:10.989977+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:59:40.881954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"256'1","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.978806+0000","last_change":"2024-03-04T12:44:50.449921+0000","last_active":"2024-03-04T12:56:05.978806+0000","last_peered":"2024-03-04T12:56:05.978806+0000","last_clean":"2024-03-04T12:56:05.978806+0000","last_became_active":"2024-03-04T12:44:50.449627+0000","last_became_peered":"2024-03-04T12:44:50.449627+0000","last_unstale":"2024-03-04T12:56:05.978806+0000","last_undegraded":"2024-03-04T12:56:05.978806+0000","last_fullsized":"2024-03-04T12:56:05.978806+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:14:46.561998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"244'9","reported_seq":65,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991914+0000","last_change":"2024-03-04T12:43:27.057430+0000","last_active":"2024-03-04T12:57:00.991914+0000","last_peered":"2024-03-04T12:57:00.991914+0000","last_clean":"2024-03-04T12:57:00.991914+0000","last_became_active":"2024-03-04T12:43:27.057074+0000","last_became_peered":"2024-03-04T12:43:27.057074+0000","last_unstale":"2024-03-04T12:57:00.991914+0000","last_undegraded":"2024-03-04T12:57:00.991914+0000","last_fullsized":"2024-03-04T12:57:00.991914+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:45.722473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.881147+0000","last_change":"2024-03-04T12:51:01.595664+0000","last_active":"2024-03-04T12:57:30.881147+0000","last_peered":"2024-03-04T12:57:30.881147+0000","last_clean":"2024-03-04T12:57:30.881147+0000","last_became_active":"2024-03-04T12:51:01.595390+0000","last_became_peered":"2024-03-04T12:51:01.595390+0000","last_unstale":"2024-03-04T12:57:30.881147+0000","last_undegraded":"2024-03-04T12:57:30.881147+0000","last_fullsized":"2024-03-04T12:57:30.881147+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:23.043787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"256'6","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.986440+0000","last_change":"2024-03-04T12:44:53.484184+0000","last_active":"2024-03-04T12:57:55.986440+0000","last_peered":"2024-03-04T12:57:55.986440+0000","last_clean":"2024-03-04T12:57:55.986440+0000","last_became_active":"2024-03-04T12:44:53.482800+0000","last_became_peered":"2024-03-04T12:44:53.482800+0000","last_unstale":"2024-03-04T12:57:55.986440+0000","last_undegraded":"2024-03-04T12:57:55.986440+0000","last_fullsized":"2024-03-04T12:57:55.986440+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:58.026882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'6","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.884861+0000","last_change":"2024-03-04T12:44:50.456248+0000","last_active":"2024-03-04T12:57:55.884861+0000","last_peered":"2024-03-04T12:57:55.884861+0000","last_clean":"2024-03-04T12:57:55.884861+0000","last_became_active":"2024-03-04T12:44:50.455937+0000","last_became_peered":"2024-03-04T12:44:50.455937+0000","last_unstale":"2024-03-04T12:57:55.884861+0000","last_undegraded":"2024-03-04T12:57:55.884861+0000","last_fullsized":"2024-03-04T12:57:55.884861+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:23.581048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":5,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"256'148","reported_seq":390,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:44.913079+0000","last_change":"2024-03-04T12:43:27.065338+0000","last_active":"2024-03-04T12:57:44.913079+0000","last_peered":"2024-03-04T12:57:44.913079+0000","last_clean":"2024-03-04T12:57:44.913079+0000","last_became_active":"2024-03-04T12:43:27.065085+0000","last_became_peered":"2024-03-04T12:43:27.065085+0000","last_unstale":"2024-03-04T12:57:44.913079+0000","last_undegraded":"2024-03-04T12:57:44.913079+0000","last_fullsized":"2024-03-04T12:57:44.913079+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:46.662116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":610,"num_read_kb":432,"num_write":236,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996782+0000","last_change":"2024-03-04T12:51:01.353357+0000","last_active":"2024-03-04T12:57:30.996782+0000","last_peered":"2024-03-04T12:57:30.996782+0000","last_clean":"2024-03-04T12:57:30.996782+0000","last_became_active":"2024-03-04T12:51:01.353012+0000","last_became_peered":"2024-03-04T12:51:01.353012+0000","last_unstale":"2024-03-04T12:57:30.996782+0000","last_undegraded":"2024-03-04T12:57:30.996782+0000","last_fullsized":"2024-03-04T12:57:30.996782+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:49:18.123279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"256'5","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.003246+0000","last_change":"2024-03-04T12:44:53.484778+0000","last_active":"2024-03-04T12:57:56.003246+0000","last_peered":"2024-03-04T12:57:56.003246+0000","last_clean":"2024-03-04T12:57:56.003246+0000","last_became_active":"2024-03-04T12:44:53.484514+0000","last_became_peered":"2024-03-04T12:44:53.484514+0000","last_unstale":"2024-03-04T12:57:56.003246+0000","last_undegraded":"2024-03-04T12:57:56.003246+0000","last_fullsized":"2024-03-04T12:57:56.003246+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:17.495701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":4138,"num_write":4,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"256'3","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.989386+0000","last_change":"2024-03-04T12:44:50.450378+0000","last_active":"2024-03-04T12:56:05.989386+0000","last_peered":"2024-03-04T12:56:05.989386+0000","last_clean":"2024-03-04T12:56:05.989386+0000","last_became_active":"2024-03-04T12:44:50.450101+0000","last_became_peered":"2024-03-04T12:44:50.450101+0000","last_unstale":"2024-03-04T12:56:05.989386+0000","last_undegraded":"2024-03-04T12:56:05.989386+0000","last_fullsized":"2024-03-04T12:56:05.989386+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:55:05.158919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"256'27","reported_seq":98,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.979590+0000","last_change":"2024-03-04T12:43:27.068000+0000","last_active":"2024-03-04T12:56:30.979590+0000","last_peered":"2024-03-04T12:56:30.979590+0000","last_clean":"2024-03-04T12:56:30.979590+0000","last_became_active":"2024-03-04T12:43:27.067391+0000","last_became_peered":"2024-03-04T12:43:27.067391+0000","last_unstale":"2024-03-04T12:56:30.979590+0000","last_undegraded":"2024-03-04T12:56:30.979590+0000","last_fullsized":"2024-03-04T12:56:30.979590+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:51:04.022422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:35.881989+0000","last_change":"2024-03-04T12:51:01.352487+0000","last_active":"2024-03-04T12:57:35.881989+0000","last_peered":"2024-03-04T12:57:35.881989+0000","last_clean":"2024-03-04T12:57:35.881989+0000","last_became_active":"2024-03-04T12:51:01.352191+0000","last_became_peered":"2024-03-04T12:51:01.352191+0000","last_unstale":"2024-03-04T12:57:35.881989+0000","last_undegraded":"2024-03-04T12:57:35.881989+0000","last_fullsized":"2024-03-04T12:57:35.881989+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:22.391789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"256'1","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.983144+0000","last_change":"2024-03-04T12:44:53.482531+0000","last_active":"2024-03-04T12:56:10.983144+0000","last_peered":"2024-03-04T12:56:10.983144+0000","last_clean":"2024-03-04T12:56:10.983144+0000","last_became_active":"2024-03-04T12:44:53.482253+0000","last_became_peered":"2024-03-04T12:44:53.482253+0000","last_unstale":"2024-03-04T12:56:10.983144+0000","last_undegraded":"2024-03-04T12:56:10.983144+0000","last_fullsized":"2024-03-04T12:56:10.983144+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:55:37.720046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.992327+0000","last_change":"2024-03-04T12:44:50.449345+0000","last_active":"2024-03-04T12:57:50.992327+0000","last_peered":"2024-03-04T12:57:50.992327+0000","last_clean":"2024-03-04T12:57:50.992327+0000","last_became_active":"2024-03-04T12:44:50.449070+0000","last_became_peered":"2024-03-04T12:44:50.449070+0000","last_unstale":"2024-03-04T12:57:50.992327+0000","last_undegraded":"2024-03-04T12:57:50.992327+0000","last_fullsized":"2024-03-04T12:57:50.992327+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:55.637780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"256'13","reported_seq":71,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:31.228261+0000","last_change":"2024-03-04T12:43:27.061968+0000","last_active":"2024-03-04T12:56:31.228261+0000","last_peered":"2024-03-04T12:56:31.228261+0000","last_clean":"2024-03-04T12:56:31.228261+0000","last_became_active":"2024-03-04T12:43:27.061574+0000","last_became_peered":"2024-03-04T12:43:27.061574+0000","last_unstale":"2024-03-04T12:56:31.228261+0000","last_undegraded":"2024-03-04T12:56:31.228261+0000","last_fullsized":"2024-03-04T12:56:31.228261+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:18:07.868716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.984940+0000","last_change":"2024-03-04T12:51:01.356675+0000","last_active":"2024-03-04T12:57:45.984940+0000","last_peered":"2024-03-04T12:57:45.984940+0000","last_clean":"2024-03-04T12:57:45.984940+0000","last_became_active":"2024-03-04T12:51:01.356286+0000","last_became_peered":"2024-03-04T12:51:01.356286+0000","last_unstale":"2024-03-04T12:57:45.984940+0000","last_undegraded":"2024-03-04T12:57:45.984940+0000","last_fullsized":"2024-03-04T12:57:45.984940+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:02:42.855512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"256'5","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.018577+0000","last_change":"2024-03-04T12:44:53.478083+0000","last_active":"2024-03-04T13:00:06.018577+0000","last_peered":"2024-03-04T13:00:06.018577+0000","last_clean":"2024-03-04T13:00:06.018577+0000","last_became_active":"2024-03-04T12:44:53.477801+0000","last_became_peered":"2024-03-04T12:44:53.477801+0000","last_unstale":"2024-03-04T13:00:06.018577+0000","last_undegraded":"2024-03-04T13:00:06.018577+0000","last_fullsized":"2024-03-04T13:00:06.018577+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:23.298015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"256'3","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.001397+0000","last_change":"2024-03-04T12:44:50.456287+0000","last_active":"2024-03-04T13:00:01.001397+0000","last_peered":"2024-03-04T13:00:01.001397+0000","last_clean":"2024-03-04T13:00:01.001397+0000","last_became_active":"2024-03-04T12:44:50.456005+0000","last_became_peered":"2024-03-04T12:44:50.456005+0000","last_unstale":"2024-03-04T13:00:01.001397+0000","last_undegraded":"2024-03-04T13:00:01.001397+0000","last_fullsized":"2024-03-04T13:00:01.001397+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:59:09.950535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"256'19","reported_seq":84,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.981609+0000","last_change":"2024-03-04T12:43:27.055261+0000","last_active":"2024-03-04T12:56:30.981609+0000","last_peered":"2024-03-04T12:56:30.981609+0000","last_clean":"2024-03-04T12:56:30.981609+0000","last_became_active":"2024-03-04T12:43:27.054951+0000","last_became_peered":"2024-03-04T12:43:27.054951+0000","last_unstale":"2024-03-04T12:56:30.981609+0000","last_undegraded":"2024-03-04T12:56:30.981609+0000","last_fullsized":"2024-03-04T12:56:30.981609+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:25:39.570283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":48,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998179+0000","last_change":"2024-03-04T12:51:01.596612+0000","last_active":"2024-03-04T12:57:15.998179+0000","last_peered":"2024-03-04T12:57:15.998179+0000","last_clean":"2024-03-04T12:57:15.998179+0000","last_became_active":"2024-03-04T12:51:01.596248+0000","last_became_peered":"2024-03-04T12:51:01.596248+0000","last_unstale":"2024-03-04T12:57:15.998179+0000","last_undegraded":"2024-03-04T12:57:15.998179+0000","last_fullsized":"2024-03-04T12:57:15.998179+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:41:22.243454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.985709+0000","last_change":"2024-03-04T12:44:53.481249+0000","last_active":"2024-03-04T12:57:25.985709+0000","last_peered":"2024-03-04T12:57:25.985709+0000","last_clean":"2024-03-04T12:57:25.985709+0000","last_became_active":"2024-03-04T12:44:53.480987+0000","last_became_peered":"2024-03-04T12:44:53.480987+0000","last_unstale":"2024-03-04T12:57:25.985709+0000","last_undegraded":"2024-03-04T12:57:25.985709+0000","last_fullsized":"2024-03-04T12:57:25.985709+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:51:53.423493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"256'4","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.425589+0000","last_change":"2024-03-04T12:44:50.456748+0000","last_active":"2024-03-04T13:00:15.425589+0000","last_peered":"2024-03-04T13:00:15.425589+0000","last_clean":"2024-03-04T13:00:15.425589+0000","last_became_active":"2024-03-04T12:44:50.455944+0000","last_became_peered":"2024-03-04T12:44:50.455944+0000","last_unstale":"2024-03-04T13:00:15.425589+0000","last_undegraded":"2024-03-04T13:00:15.425589+0000","last_fullsized":"2024-03-04T13:00:15.425589+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:14:51.600085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"256'15","reported_seq":78,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.979646+0000","last_change":"2024-03-04T12:43:27.060487+0000","last_active":"2024-03-04T12:56:30.979646+0000","last_peered":"2024-03-04T12:56:30.979646+0000","last_clean":"2024-03-04T12:56:30.979646+0000","last_became_active":"2024-03-04T12:43:27.060180+0000","last_became_peered":"2024-03-04T12:43:27.060180+0000","last_unstale":"2024-03-04T12:56:30.979646+0000","last_undegraded":"2024-03-04T12:56:30.979646+0000","last_fullsized":"2024-03-04T12:56:30.979646+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:19.510448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998192+0000","last_change":"2024-03-04T12:51:01.350629+0000","last_active":"2024-03-04T12:57:15.998192+0000","last_peered":"2024-03-04T12:57:15.998192+0000","last_clean":"2024-03-04T12:57:15.998192+0000","last_became_active":"2024-03-04T12:51:01.350349+0000","last_became_peered":"2024-03-04T12:51:01.350349+0000","last_unstale":"2024-03-04T12:57:15.998192+0000","last_undegraded":"2024-03-04T12:57:15.998192+0000","last_fullsized":"2024-03-04T12:57:15.998192+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:57.667851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"256'5","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.880408+0000","last_change":"2024-03-04T12:44:53.485721+0000","last_active":"2024-03-04T12:57:25.880408+0000","last_peered":"2024-03-04T12:57:25.880408+0000","last_clean":"2024-03-04T12:57:25.880408+0000","last_became_active":"2024-03-04T12:44:53.485429+0000","last_became_peered":"2024-03-04T12:44:53.485429+0000","last_unstale":"2024-03-04T12:57:25.880408+0000","last_undegraded":"2024-03-04T12:57:25.880408+0000","last_fullsized":"2024-03-04T12:57:25.880408+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:41:33.023905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":5,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"250'5","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:51.002839+0000","last_change":"2024-03-04T12:44:50.452899+0000","last_active":"2024-03-04T12:57:51.002839+0000","last_peered":"2024-03-04T12:57:51.002839+0000","last_clean":"2024-03-04T12:57:51.002839+0000","last_became_active":"2024-03-04T12:44:50.452611+0000","last_became_peered":"2024-03-04T12:44:50.452611+0000","last_unstale":"2024-03-04T12:57:51.002839+0000","last_undegraded":"2024-03-04T12:57:51.002839+0000","last_fullsized":"2024-03-04T12:57:51.002839+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:51.414927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"256'20","reported_seq":91,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:13.481796+0000","last_change":"2024-03-04T12:43:27.064585+0000","last_active":"2024-03-04T12:58:13.481796+0000","last_peered":"2024-03-04T12:58:13.481796+0000","last_clean":"2024-03-04T12:58:13.481796+0000","last_became_active":"2024-03-04T12:43:27.064375+0000","last_became_peered":"2024-03-04T12:43:27.064375+0000","last_unstale":"2024-03-04T12:58:13.481796+0000","last_undegraded":"2024-03-04T12:58:13.481796+0000","last_fullsized":"2024-03-04T12:58:13.481796+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:39:12.810173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":61,"num_write":47,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"252'1","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996931+0000","last_change":"2024-03-04T12:51:01.350196+0000","last_active":"2024-03-04T12:57:30.996931+0000","last_peered":"2024-03-04T12:57:30.996931+0000","last_clean":"2024-03-04T12:57:30.996931+0000","last_became_active":"2024-03-04T12:51:01.349889+0000","last_became_peered":"2024-03-04T12:51:01.349889+0000","last_unstale":"2024-03-04T12:57:30.996931+0000","last_undegraded":"2024-03-04T12:57:30.996931+0000","last_fullsized":"2024-03-04T12:57:30.996931+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:26:14.298363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"256'1","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.884969+0000","last_change":"2024-03-04T12:44:53.489468+0000","last_active":"2024-03-04T12:57:55.884969+0000","last_peered":"2024-03-04T12:57:55.884969+0000","last_clean":"2024-03-04T12:57:55.884969+0000","last_became_active":"2024-03-04T12:44:53.489232+0000","last_became_peered":"2024-03-04T12:44:53.489232+0000","last_unstale":"2024-03-04T12:57:55.884969+0000","last_undegraded":"2024-03-04T12:57:55.884969+0000","last_fullsized":"2024-03-04T12:57:55.884969+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:26:44.977704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.981541+0000","last_change":"2024-03-04T12:44:50.459626+0000","last_active":"2024-03-04T12:57:20.981541+0000","last_peered":"2024-03-04T12:57:20.981541+0000","last_clean":"2024-03-04T12:57:20.981541+0000","last_became_active":"2024-03-04T12:44:50.459359+0000","last_became_peered":"2024-03-04T12:44:50.459359+0000","last_unstale":"2024-03-04T12:57:20.981541+0000","last_undegraded":"2024-03-04T12:57:20.981541+0000","last_fullsized":"2024-03-04T12:57:20.981541+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:42.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"256'25","reported_seq":106,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:06.002606+0000","last_change":"2024-03-04T12:43:27.060629+0000","last_active":"2024-03-04T12:58:06.002606+0000","last_peered":"2024-03-04T12:58:06.002606+0000","last_clean":"2024-03-04T12:58:06.002606+0000","last_became_active":"2024-03-04T12:43:27.060115+0000","last_became_peered":"2024-03-04T12:43:27.060115+0000","last_unstale":"2024-03-04T12:58:06.002606+0000","last_undegraded":"2024-03-04T12:58:06.002606+0000","last_fullsized":"2024-03-04T12:58:06.002606+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:15:16.480822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.881250+0000","last_change":"2024-03-04T12:51:01.596756+0000","last_active":"2024-03-04T12:57:30.881250+0000","last_peered":"2024-03-04T12:57:30.881250+0000","last_clean":"2024-03-04T12:57:30.881250+0000","last_became_active":"2024-03-04T12:51:01.596463+0000","last_became_peered":"2024-03-04T12:51:01.596463+0000","last_unstale":"2024-03-04T12:57:30.881250+0000","last_undegraded":"2024-03-04T12:57:30.881250+0000","last_fullsized":"2024-03-04T12:57:30.881250+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:47:44.675447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"256'5","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.001127+0000","last_change":"2024-03-04T12:44:53.479417+0000","last_active":"2024-03-04T12:57:56.001127+0000","last_peered":"2024-03-04T12:57:56.001127+0000","last_clean":"2024-03-04T12:57:56.001127+0000","last_became_active":"2024-03-04T12:44:53.479076+0000","last_became_peered":"2024-03-04T12:44:53.479076+0000","last_unstale":"2024-03-04T12:57:56.001127+0000","last_undegraded":"2024-03-04T12:57:56.001127+0000","last_fullsized":"2024-03-04T12:57:56.001127+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:57.384073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":15,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"256'1","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.880441+0000","last_change":"2024-03-04T12:44:50.454670+0000","last_active":"2024-03-04T12:57:25.880441+0000","last_peered":"2024-03-04T12:57:25.880441+0000","last_clean":"2024-03-04T12:57:25.880441+0000","last_became_active":"2024-03-04T12:44:50.454398+0000","last_became_peered":"2024-03-04T12:44:50.454398+0000","last_unstale":"2024-03-04T12:57:25.880441+0000","last_undegraded":"2024-03-04T12:57:25.880441+0000","last_fullsized":"2024-03-04T12:57:25.880441+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:24:18.356924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"256'33","reported_seq":117,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.886555+0000","last_change":"2024-03-04T12:43:27.060915+0000","last_active":"2024-03-04T12:58:05.886555+0000","last_peered":"2024-03-04T12:58:05.886555+0000","last_clean":"2024-03-04T12:58:05.886555+0000","last_became_active":"2024-03-04T12:43:27.060589+0000","last_became_peered":"2024-03-04T12:43:27.060589+0000","last_unstale":"2024-03-04T12:58:05.886555+0000","last_undegraded":"2024-03-04T12:58:05.886555+0000","last_fullsized":"2024-03-04T12:58:05.886555+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:52:13.475390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":90,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991815+0000","last_change":"2024-03-04T12:51:01.357439+0000","last_active":"2024-03-04T12:57:00.991815+0000","last_peered":"2024-03-04T12:57:00.991815+0000","last_clean":"2024-03-04T12:57:00.991815+0000","last_became_active":"2024-03-04T12:51:01.355416+0000","last_became_peered":"2024-03-04T12:51:01.355416+0000","last_unstale":"2024-03-04T12:57:00.991815+0000","last_undegraded":"2024-03-04T12:57:00.991815+0000","last_fullsized":"2024-03-04T12:57:00.991815+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:22:00.087119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"256'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.898812+0000","last_change":"2024-03-04T12:44:53.486527+0000","last_active":"2024-03-04T12:59:30.898812+0000","last_peered":"2024-03-04T12:59:30.898812+0000","last_clean":"2024-03-04T12:59:30.898812+0000","last_became_active":"2024-03-04T12:44:53.486235+0000","last_became_peered":"2024-03-04T12:44:53.486235+0000","last_unstale":"2024-03-04T12:59:30.898812+0000","last_undegraded":"2024-03-04T12:59:30.898812+0000","last_fullsized":"2024-03-04T12:59:30.898812+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:38:59.682681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"256'6","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:26.015244+0000","last_change":"2024-03-04T12:44:50.458855+0000","last_active":"2024-03-04T12:59:26.015244+0000","last_peered":"2024-03-04T12:59:26.015244+0000","last_clean":"2024-03-04T12:59:26.015244+0000","last_became_active":"2024-03-04T12:44:50.458610+0000","last_became_peered":"2024-03-04T12:44:50.458610+0000","last_unstale":"2024-03-04T12:59:26.015244+0000","last_undegraded":"2024-03-04T12:59:26.015244+0000","last_fullsized":"2024-03-04T12:59:26.015244+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:02:54.023215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":7739,"num_write":11,"num_write_kb":7739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"256'17","reported_seq":79,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.988149+0000","last_change":"2024-03-04T12:43:27.067610+0000","last_active":"2024-03-04T12:58:05.988149+0000","last_peered":"2024-03-04T12:58:05.988149+0000","last_clean":"2024-03-04T12:58:05.988149+0000","last_became_active":"2024-03-04T12:43:27.067223+0000","last_became_peered":"2024-03-04T12:43:27.067223+0000","last_unstale":"2024-03-04T12:58:05.988149+0000","last_undegraded":"2024-03-04T12:58:05.988149+0000","last_fullsized":"2024-03-04T12:58:05.988149+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:38:30.372407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":41,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.980872+0000","last_change":"2024-03-04T12:51:01.353788+0000","last_active":"2024-03-04T12:57:15.980872+0000","last_peered":"2024-03-04T12:57:15.980872+0000","last_clean":"2024-03-04T12:57:15.980872+0000","last_became_active":"2024-03-04T12:51:01.353432+0000","last_became_peered":"2024-03-04T12:51:01.353432+0000","last_unstale":"2024-03-04T12:57:15.980872+0000","last_undegraded":"2024-03-04T12:57:15.980872+0000","last_fullsized":"2024-03-04T12:57:15.980872+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:01:52.475724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"250'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.876625+0000","last_change":"2024-03-04T12:44:53.482645+0000","last_active":"2024-03-04T12:57:00.876625+0000","last_peered":"2024-03-04T12:57:00.876625+0000","last_clean":"2024-03-04T12:57:00.876625+0000","last_became_active":"2024-03-04T12:44:53.482370+0000","last_became_peered":"2024-03-04T12:44:53.482370+0000","last_unstale":"2024-03-04T12:57:00.876625+0000","last_undegraded":"2024-03-04T12:57:00.876625+0000","last_fullsized":"2024-03-04T12:57:00.876625+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:19:00.147319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"256'3","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.995188+0000","last_change":"2024-03-04T12:44:50.451000+0000","last_active":"2024-03-04T12:57:20.995188+0000","last_peered":"2024-03-04T12:57:20.995188+0000","last_clean":"2024-03-04T12:57:20.995188+0000","last_became_active":"2024-03-04T12:44:50.450681+0000","last_became_peered":"2024-03-04T12:44:50.450681+0000","last_unstale":"2024-03-04T12:57:20.995188+0000","last_undegraded":"2024-03-04T12:57:20.995188+0000","last_fullsized":"2024-03-04T12:57:20.995188+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:33:37.753695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":368,"num_write":3,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"256'61","reported_seq":196,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.994297+0000","last_change":"2024-03-04T12:43:27.057075+0000","last_active":"2024-03-04T12:58:05.994297+0000","last_peered":"2024-03-04T12:58:05.994297+0000","last_clean":"2024-03-04T12:58:05.994297+0000","last_became_active":"2024-03-04T12:43:27.056781+0000","last_became_peered":"2024-03-04T12:43:27.056781+0000","last_unstale":"2024-03-04T12:58:05.994297+0000","last_undegraded":"2024-03-04T12:58:05.994297+0000","last_fullsized":"2024-03-04T12:58:05.994297+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:46:26.120127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":203,"num_write":94,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.994328+0000","last_change":"2024-03-04T12:51:01.349501+0000","last_active":"2024-03-04T12:57:15.994328+0000","last_peered":"2024-03-04T12:57:15.994328+0000","last_clean":"2024-03-04T12:57:15.994328+0000","last_became_active":"2024-03-04T12:51:01.349216+0000","last_became_peered":"2024-03-04T12:51:01.349216+0000","last_unstale":"2024-03-04T12:57:15.994328+0000","last_undegraded":"2024-03-04T12:57:15.994328+0000","last_fullsized":"2024-03-04T12:57:15.994328+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:06.080102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.989012+0000","last_change":"2024-03-04T12:44:53.479666+0000","last_active":"2024-03-04T12:57:25.989012+0000","last_peered":"2024-03-04T12:57:25.989012+0000","last_clean":"2024-03-04T12:57:25.989012+0000","last_became_active":"2024-03-04T12:44:53.479411+0000","last_became_peered":"2024-03-04T12:44:53.479411+0000","last_unstale":"2024-03-04T12:57:25.989012+0000","last_undegraded":"2024-03-04T12:57:25.989012+0000","last_fullsized":"2024-03-04T12:57:25.989012+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:44.241135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'5","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:55.893128+0000","last_change":"2024-03-04T12:44:50.451910+0000","last_active":"2024-03-04T12:58:55.893128+0000","last_peered":"2024-03-04T12:58:55.893128+0000","last_clean":"2024-03-04T12:58:55.893128+0000","last_became_active":"2024-03-04T12:44:50.451626+0000","last_became_peered":"2024-03-04T12:44:50.451626+0000","last_unstale":"2024-03-04T12:58:55.893128+0000","last_undegraded":"2024-03-04T12:58:55.893128+0000","last_fullsized":"2024-03-04T12:58:55.893128+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:38.879751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"256'127","reported_seq":405,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:06.002489+0000","last_change":"2024-03-04T12:43:27.056721+0000","last_active":"2024-03-04T12:58:06.002489+0000","last_peered":"2024-03-04T12:58:06.002489+0000","last_clean":"2024-03-04T12:58:06.002489+0000","last_became_active":"2024-03-04T12:43:27.056007+0000","last_became_peered":"2024-03-04T12:43:27.056007+0000","last_unstale":"2024-03-04T12:58:06.002489+0000","last_undegraded":"2024-03-04T12:58:06.002489+0000","last_fullsized":"2024-03-04T12:58:06.002489+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:47.106941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":540,"num_write":158,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.987839+0000","last_change":"2024-03-04T12:51:01.354894+0000","last_active":"2024-03-04T12:57:15.987839+0000","last_peered":"2024-03-04T12:57:15.987839+0000","last_clean":"2024-03-04T12:57:15.987839+0000","last_became_active":"2024-03-04T12:51:01.354601+0000","last_became_peered":"2024-03-04T12:51:01.354601+0000","last_unstale":"2024-03-04T12:57:15.987839+0000","last_undegraded":"2024-03-04T12:57:15.987839+0000","last_fullsized":"2024-03-04T12:57:15.987839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:00:49.358407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.982297+0000","last_change":"2024-03-04T12:44:53.486591+0000","last_active":"2024-03-04T12:57:25.982297+0000","last_peered":"2024-03-04T12:57:25.982297+0000","last_clean":"2024-03-04T12:57:25.982297+0000","last_became_active":"2024-03-04T12:44:53.486321+0000","last_became_peered":"2024-03-04T12:44:53.486321+0000","last_unstale":"2024-03-04T12:57:25.982297+0000","last_undegraded":"2024-03-04T12:57:25.982297+0000","last_fullsized":"2024-03-04T12:57:25.982297+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:17:26.146570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"250'2","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.988362+0000","last_change":"2024-03-04T12:44:50.456615+0000","last_active":"2024-03-04T12:57:20.988362+0000","last_peered":"2024-03-04T12:57:20.988362+0000","last_clean":"2024-03-04T12:57:20.988362+0000","last_became_active":"2024-03-04T12:44:50.456315+0000","last_became_peered":"2024-03-04T12:44:50.456315+0000","last_unstale":"2024-03-04T12:57:20.988362+0000","last_undegraded":"2024-03-04T12:57:20.988362+0000","last_fullsized":"2024-03-04T12:57:20.988362+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:45.991675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"256'28","reported_seq":104,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:18.211202+0000","last_change":"2024-03-04T12:43:27.064503+0000","last_active":"2024-03-04T12:59:18.211202+0000","last_peered":"2024-03-04T12:59:18.211202+0000","last_clean":"2024-03-04T12:59:18.211202+0000","last_became_active":"2024-03-04T12:43:27.064141+0000","last_became_peered":"2024-03-04T12:43:27.064141+0000","last_unstale":"2024-03-04T12:59:18.211202+0000","last_undegraded":"2024-03-04T12:59:18.211202+0000","last_fullsized":"2024-03-04T12:59:18.211202+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:28:02.741960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"256'359","reported_seq":1005,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.945168+0000","last_change":"2024-03-04T12:36:40.392809+0000","last_active":"2024-03-04T13:00:15.945168+0000","last_peered":"2024-03-04T13:00:15.945168+0000","last_clean":"2024-03-04T13:00:15.945168+0000","last_became_active":"2024-03-04T12:36:40.392399+0000","last_became_peered":"2024-03-04T12:36:40.392399+0000","last_unstale":"2024-03-04T13:00:15.945168+0000","last_undegraded":"2024-03-04T13:00:15.945168+0000","last_fullsized":"2024-03-04T13:00:15.945168+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:58:34.780333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10488354,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":586,"num_read_kb":17405,"num_write":1435,"num_write_kb":42784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"256'1110","reported_seq":2693,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.838199+0000","last_change":"2024-03-04T12:36:07.296271+0000","last_active":"2024-03-04T12:59:48.838199+0000","last_peered":"2024-03-04T12:59:48.838199+0000","last_clean":"2024-03-04T12:59:48.838199+0000","last_became_active":"2024-03-04T12:36:07.295125+0000","last_became_peered":"2024-03-04T12:36:07.295125+0000","last_unstale":"2024-03-04T12:59:48.838199+0000","last_undegraded":"2024-03-04T12:59:48.838199+0000","last_fullsized":"2024-03-04T12:59:48.838199+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:37.876237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4869,"num_read_kb":4281,"num_write":1536,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"256'278","reported_seq":873,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.964076+0000","last_change":"2024-03-04T12:36:05.280982+0000","last_active":"2024-03-04T13:00:15.964076+0000","last_peered":"2024-03-04T13:00:15.964076+0000","last_clean":"2024-03-04T13:00:15.964076+0000","last_became_active":"2024-03-04T12:36:05.280695+0000","last_became_peered":"2024-03-04T12:36:05.280695+0000","last_unstale":"2024-03-04T13:00:15.964076+0000","last_undegraded":"2024-03-04T13:00:15.964076+0000","last_fullsized":"2024-03-04T13:00:15.964076+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:14.407483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256947,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":390,"num_read_kb":2412,"num_write":1104,"num_write_kb":20516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"256'544","reported_seq":1937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671828+0000","last_change":"2024-03-04T12:36:07.297041+0000","last_active":"2024-03-04T13:00:06.671828+0000","last_peered":"2024-03-04T13:00:06.671828+0000","last_clean":"2024-03-04T13:00:06.671828+0000","last_became_active":"2024-03-04T12:36:07.296651+0000","last_became_peered":"2024-03-04T12:36:07.296651+0000","last_unstale":"2024-03-04T13:00:06.671828+0000","last_undegraded":"2024-03-04T13:00:06.671828+0000","last_fullsized":"2024-03-04T13:00:06.671828+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:29:22.170255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2661,"num_read_kb":2496,"num_write":771,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"256'273","reported_seq":876,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.984613+0000","last_change":"2024-03-04T12:36:05.285321+0000","last_active":"2024-03-04T13:00:15.984613+0000","last_peered":"2024-03-04T13:00:15.984613+0000","last_clean":"2024-03-04T13:00:15.984613+0000","last_became_active":"2024-03-04T12:36:05.285054+0000","last_became_peered":"2024-03-04T12:36:05.285054+0000","last_unstale":"2024-03-04T13:00:15.984613+0000","last_undegraded":"2024-03-04T13:00:15.984613+0000","last_fullsized":"2024-03-04T13:00:15.984613+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:36.940053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5939385,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":380,"num_read_kb":27371,"num_write":985,"num_write_kb":18696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"256'594","reported_seq":2014,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:49.593829+0000","last_change":"2024-03-04T12:36:07.298949+0000","last_active":"2024-03-04T12:59:49.593829+0000","last_peered":"2024-03-04T12:59:49.593829+0000","last_clean":"2024-03-04T12:59:49.593829+0000","last_became_active":"2024-03-04T12:36:07.298528+0000","last_became_peered":"2024-03-04T12:36:07.298528+0000","last_unstale":"2024-03-04T12:59:49.593829+0000","last_undegraded":"2024-03-04T12:59:49.593829+0000","last_fullsized":"2024-03-04T12:59:49.593829+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":500,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:22.362410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2805,"num_read_kb":2500,"num_write":805,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"256'293","reported_seq":905,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.003906+0000","last_change":"2024-03-04T12:36:05.294821+0000","last_active":"2024-03-04T13:00:16.003906+0000","last_peered":"2024-03-04T13:00:16.003906+0000","last_clean":"2024-03-04T13:00:16.003906+0000","last_became_active":"2024-03-04T12:36:05.293768+0000","last_became_peered":"2024-03-04T12:36:05.293768+0000","last_unstale":"2024-03-04T13:00:16.003906+0000","last_undegraded":"2024-03-04T13:00:16.003906+0000","last_fullsized":"2024-03-04T13:00:16.003906+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:18.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446620,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":395,"num_read_kb":31950,"num_write":1041,"num_write_kb":37939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"256'777","reported_seq":2174,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:51.407901+0000","last_change":"2024-03-04T12:36:40.394056+0000","last_active":"2024-03-04T12:59:51.407901+0000","last_peered":"2024-03-04T12:59:51.407901+0000","last_clean":"2024-03-04T12:59:51.407901+0000","last_became_active":"2024-03-04T12:36:40.393715+0000","last_became_peered":"2024-03-04T12:36:40.393715+0000","last_unstale":"2024-03-04T12:59:51.407901+0000","last_undegraded":"2024-03-04T12:59:51.407901+0000","last_fullsized":"2024-03-04T12:59:51.407901+0000","mapping_epoch":33,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:36.183102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3436,"num_read_kb":3037,"num_write":1058,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"256'335","reported_seq":970,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.839104+0000","last_change":"2024-03-04T12:36:05.290798+0000","last_active":"2024-03-04T13:00:15.839104+0000","last_peered":"2024-03-04T13:00:15.839104+0000","last_clean":"2024-03-04T13:00:15.839104+0000","last_became_active":"2024-03-04T12:36:05.290178+0000","last_became_peered":"2024-03-04T12:36:05.290178+0000","last_unstale":"2024-03-04T13:00:15.839104+0000","last_undegraded":"2024-03-04T13:00:15.839104+0000","last_fullsized":"2024-03-04T13:00:15.839104+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:22.012412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19588171,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":547,"num_read_kb":36032,"num_write":1331,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"256'371","reported_seq":1918,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:37.805811+0000","last_change":"2024-03-04T12:36:07.301906+0000","last_active":"2024-03-04T12:59:37.805811+0000","last_peered":"2024-03-04T12:59:37.805811+0000","last_clean":"2024-03-04T12:59:37.805811+0000","last_became_active":"2024-03-04T12:36:07.301582+0000","last_became_peered":"2024-03-04T12:36:07.301582+0000","last_unstale":"2024-03-04T12:59:37.805811+0000","last_undegraded":"2024-03-04T12:59:37.805811+0000","last_fullsized":"2024-03-04T12:59:37.805811+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:15:02.915559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2123,"num_read_kb":2049,"num_write":405,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"256'246","reported_seq":854,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.014306+0000","last_change":"2024-03-04T12:36:05.296558+0000","last_active":"2024-03-04T13:00:16.014306+0000","last_peered":"2024-03-04T13:00:16.014306+0000","last_clean":"2024-03-04T13:00:16.014306+0000","last_became_active":"2024-03-04T12:36:05.296284+0000","last_became_peered":"2024-03-04T12:36:05.296284+0000","last_unstale":"2024-03-04T13:00:16.014306+0000","last_undegraded":"2024-03-04T13:00:16.014306+0000","last_fullsized":"2024-03-04T13:00:16.014306+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:09:57.839904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15939941,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":339,"num_read_kb":80579,"num_write":908,"num_write_kb":32166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"256'779","reported_seq":2021,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.066749+0000","last_change":"2024-03-04T12:36:07.298292+0000","last_active":"2024-03-04T12:59:53.066749+0000","last_peered":"2024-03-04T12:59:53.066749+0000","last_clean":"2024-03-04T12:59:53.066749+0000","last_became_active":"2024-03-04T12:36:07.297953+0000","last_became_peered":"2024-03-04T12:36:07.297953+0000","last_unstale":"2024-03-04T12:59:53.066749+0000","last_undegraded":"2024-03-04T12:59:53.066749+0000","last_fullsized":"2024-03-04T12:59:53.066749+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:58:58.998184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3335,"num_read_kb":2888,"num_write":1111,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"256'267","reported_seq":980,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.816903+0000","last_change":"2024-03-04T12:36:05.291622+0000","last_active":"2024-03-04T13:00:15.816903+0000","last_peered":"2024-03-04T13:00:15.816903+0000","last_clean":"2024-03-04T13:00:15.816903+0000","last_became_active":"2024-03-04T12:36:05.291041+0000","last_became_peered":"2024-03-04T12:36:05.291041+0000","last_unstale":"2024-03-04T13:00:15.816903+0000","last_undegraded":"2024-03-04T13:00:15.816903+0000","last_fullsized":"2024-03-04T13:00:15.816903+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:02:19.031345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3234101,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":733,"num_read_kb":12113,"num_write":1095,"num_write_kb":11806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"256'692","reported_seq":2091,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.675667+0000","last_change":"2024-03-04T12:36:07.297212+0000","last_active":"2024-03-04T13:00:06.675667+0000","last_peered":"2024-03-04T13:00:06.675667+0000","last_clean":"2024-03-04T13:00:06.675667+0000","last_became_active":"2024-03-04T12:36:07.296763+0000","last_became_peered":"2024-03-04T12:36:07.296763+0000","last_unstale":"2024-03-04T13:00:06.675667+0000","last_undegraded":"2024-03-04T13:00:06.675667+0000","last_fullsized":"2024-03-04T13:00:06.675667+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:44:52.510569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3139,"num_read_kb":2812,"num_write":915,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"256'251","reported_seq":853,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.952700+0000","last_change":"2024-03-04T12:36:05.295212+0000","last_active":"2024-03-04T13:00:15.952700+0000","last_peered":"2024-03-04T13:00:15.952700+0000","last_clean":"2024-03-04T13:00:15.952700+0000","last_became_active":"2024-03-04T12:36:05.294967+0000","last_became_peered":"2024-03-04T12:36:05.294967+0000","last_unstale":"2024-03-04T13:00:15.952700+0000","last_undegraded":"2024-03-04T13:00:15.952700+0000","last_fullsized":"2024-03-04T13:00:15.952700+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:35:51.469381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12867186,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":343,"num_read_kb":71068,"num_write":894,"num_write_kb":54955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"256'783","reported_seq":2195,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.517649+0000","last_change":"2024-03-04T12:36:07.296706+0000","last_active":"2024-03-04T12:59:55.517649+0000","last_peered":"2024-03-04T12:59:55.517649+0000","last_clean":"2024-03-04T12:59:55.517649+0000","last_became_active":"2024-03-04T12:36:07.295530+0000","last_became_peered":"2024-03-04T12:36:07.295530+0000","last_unstale":"2024-03-04T12:59:55.517649+0000","last_undegraded":"2024-03-04T12:59:55.517649+0000","last_fullsized":"2024-03-04T12:59:55.517649+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:26.858210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3415,"num_read_kb":3026,"num_write":1069,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"256'351","reported_seq":1806,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671750+0000","last_change":"2024-03-04T12:36:07.298974+0000","last_active":"2024-03-04T13:00:06.671750+0000","last_peered":"2024-03-04T13:00:06.671750+0000","last_clean":"2024-03-04T13:00:06.671750+0000","last_became_active":"2024-03-04T12:36:07.298539+0000","last_became_peered":"2024-03-04T12:36:07.298539+0000","last_unstale":"2024-03-04T13:00:06.671750+0000","last_undegraded":"2024-03-04T13:00:06.671750+0000","last_fullsized":"2024-03-04T13:00:06.671750+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:04.598502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1997,"num_read_kb":1912,"num_write":401,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"256'293","reported_seq":983,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.893241+0000","last_change":"2024-03-04T12:36:05.295348+0000","last_active":"2024-03-04T13:00:15.893241+0000","last_peered":"2024-03-04T13:00:15.893241+0000","last_clean":"2024-03-04T13:00:15.893241+0000","last_became_active":"2024-03-04T12:36:05.295060+0000","last_became_peered":"2024-03-04T12:36:05.295060+0000","last_unstale":"2024-03-04T13:00:15.893241+0000","last_undegraded":"2024-03-04T13:00:15.893241+0000","last_fullsized":"2024-03-04T13:00:15.893241+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:44.913316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4278746,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":559,"num_read_kb":26330,"num_write":1253,"num_write_kb":36495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"256'327","reported_seq":1788,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.122768+0000","last_change":"2024-03-04T12:36:07.300589+0000","last_active":"2024-03-04T12:59:52.122768+0000","last_peered":"2024-03-04T12:59:52.122768+0000","last_clean":"2024-03-04T12:59:52.122768+0000","last_became_active":"2024-03-04T12:36:07.300270+0000","last_became_peered":"2024-03-04T12:36:07.300270+0000","last_unstale":"2024-03-04T12:59:52.122768+0000","last_undegraded":"2024-03-04T12:59:52.122768+0000","last_fullsized":"2024-03-04T12:59:52.122768+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:00:00.682987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2015,"num_read_kb":1950,"num_write":359,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"256'247","reported_seq":837,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.952332+0000","last_change":"2024-03-04T12:36:05.296970+0000","last_active":"2024-03-04T13:00:15.952332+0000","last_peered":"2024-03-04T13:00:15.952332+0000","last_clean":"2024-03-04T13:00:15.952332+0000","last_became_active":"2024-03-04T12:36:05.296621+0000","last_became_peered":"2024-03-04T12:36:05.296621+0000","last_unstale":"2024-03-04T13:00:15.952332+0000","last_undegraded":"2024-03-04T13:00:15.952332+0000","last_fullsized":"2024-03-04T13:00:15.952332+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:34:53.750419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050492,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":367,"num_read_kb":30706,"num_write":937,"num_write_kb":28664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"256'400","reported_seq":1882,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.469640+0000","last_change":"2024-03-04T12:36:07.294272+0000","last_active":"2024-03-04T12:59:55.469640+0000","last_peered":"2024-03-04T12:59:55.469640+0000","last_clean":"2024-03-04T12:59:55.469640+0000","last_became_active":"2024-03-04T12:36:07.293952+0000","last_became_peered":"2024-03-04T12:36:07.293952+0000","last_unstale":"2024-03-04T12:59:55.469640+0000","last_undegraded":"2024-03-04T12:59:55.469640+0000","last_fullsized":"2024-03-04T12:59:55.469640+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:15:20.296845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2282,"num_read_kb":2164,"num_write":473,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"256'281","reported_seq":914,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.009674+0000","last_change":"2024-03-04T12:36:05.296143+0000","last_active":"2024-03-04T13:00:16.009674+0000","last_peered":"2024-03-04T13:00:16.009674+0000","last_clean":"2024-03-04T13:00:16.009674+0000","last_became_active":"2024-03-04T12:36:05.295832+0000","last_became_peered":"2024-03-04T12:36:05.295832+0000","last_unstale":"2024-03-04T13:00:16.009674+0000","last_undegraded":"2024-03-04T13:00:16.009674+0000","last_fullsized":"2024-03-04T13:00:16.009674+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:40.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13175493,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":496,"num_read_kb":48295,"num_write":1213,"num_write_kb":38980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"256'623","reported_seq":2325,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.903999+0000","last_change":"2024-03-04T12:36:07.296100+0000","last_active":"2024-03-04T12:59:54.903999+0000","last_peered":"2024-03-04T12:59:54.903999+0000","last_clean":"2024-03-04T12:59:54.903999+0000","last_became_active":"2024-03-04T12:36:07.295798+0000","last_became_peered":"2024-03-04T12:36:07.295798+0000","last_unstale":"2024-03-04T12:59:54.903999+0000","last_undegraded":"2024-03-04T12:59:54.903999+0000","last_fullsized":"2024-03-04T12:59:54.903999+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":600,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:42.532663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3253,"num_read_kb":2977,"num_write":842,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"256'306","reported_seq":912,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.017795+0000","last_change":"2024-03-04T12:36:05.292220+0000","last_active":"2024-03-04T13:00:16.017795+0000","last_peered":"2024-03-04T13:00:16.017795+0000","last_clean":"2024-03-04T13:00:16.017795+0000","last_became_active":"2024-03-04T12:36:05.291477+0000","last_became_peered":"2024-03-04T12:36:05.291477+0000","last_unstale":"2024-03-04T13:00:16.017795+0000","last_undegraded":"2024-03-04T13:00:16.017795+0000","last_fullsized":"2024-03-04T13:00:16.017795+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:51.540928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6379471,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":436,"num_read_kb":10302,"num_write":1186,"num_write_kb":24769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"256'368","reported_seq":1762,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:34.665766+0000","last_change":"2024-03-04T12:36:07.290412+0000","last_active":"2024-03-04T12:59:34.665766+0000","last_peered":"2024-03-04T12:59:34.665766+0000","last_clean":"2024-03-04T12:59:34.665766+0000","last_became_active":"2024-03-04T12:36:07.290104+0000","last_became_peered":"2024-03-04T12:36:07.290104+0000","last_unstale":"2024-03-04T12:59:34.665766+0000","last_undegraded":"2024-03-04T12:59:34.665766+0000","last_fullsized":"2024-03-04T12:59:34.665766+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:26.340789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2031,"num_read_kb":1912,"num_write":446,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"256'276","reported_seq":893,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.003020+0000","last_change":"2024-03-04T12:36:05.291422+0000","last_active":"2024-03-04T13:00:16.003020+0000","last_peered":"2024-03-04T13:00:16.003020+0000","last_clean":"2024-03-04T13:00:16.003020+0000","last_became_active":"2024-03-04T12:36:05.291096+0000","last_became_peered":"2024-03-04T12:36:05.291096+0000","last_unstale":"2024-03-04T13:00:16.003020+0000","last_undegraded":"2024-03-04T13:00:16.003020+0000","last_fullsized":"2024-03-04T13:00:16.003020+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:07.540177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194835,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":438,"num_read_kb":17846,"num_write":1169,"num_write_kb":33765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"256'451","reported_seq":2118,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.018123+0000","last_change":"2024-03-04T12:36:07.298549+0000","last_active":"2024-03-04T12:59:56.018123+0000","last_peered":"2024-03-04T12:59:56.018123+0000","last_clean":"2024-03-04T12:59:56.018123+0000","last_became_active":"2024-03-04T12:36:07.297989+0000","last_became_peered":"2024-03-04T12:36:07.297989+0000","last_unstale":"2024-03-04T12:59:56.018123+0000","last_undegraded":"2024-03-04T12:59:56.018123+0000","last_fullsized":"2024-03-04T12:59:56.018123+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:09.358594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2700,"num_read_kb":2549,"num_write":550,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"256'323","reported_seq":987,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.937623+0000","last_change":"2024-03-04T12:36:05.281235+0000","last_active":"2024-03-04T13:00:15.937623+0000","last_peered":"2024-03-04T13:00:15.937623+0000","last_clean":"2024-03-04T13:00:15.937623+0000","last_became_active":"2024-03-04T12:36:05.280944+0000","last_became_peered":"2024-03-04T12:36:05.280944+0000","last_unstale":"2024-03-04T13:00:15.937623+0000","last_undegraded":"2024-03-04T13:00:15.937623+0000","last_fullsized":"2024-03-04T13:00:15.937623+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:42:06.994361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9728040,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":684,"num_read_kb":21551,"num_write":1160,"num_write_kb":33499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"256'82","reported_seq":558,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.125585+0000","last_change":"2024-03-04T12:36:15.356602+0000","last_active":"2024-03-04T12:59:52.125585+0000","last_peered":"2024-03-04T12:59:52.125585+0000","last_clean":"2024-03-04T12:59:52.125585+0000","last_became_active":"2024-03-04T12:36:15.356314+0000","last_became_peered":"2024-03-04T12:36:15.356314+0000","last_unstale":"2024-03-04T12:59:52.125585+0000","last_undegraded":"2024-03-04T12:59:52.125585+0000","last_fullsized":"2024-03-04T12:59:52.125585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:18:50.970854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":197,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"256'1096","reported_seq":2695,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.183207+0000","last_change":"2024-03-04T12:36:07.298156+0000","last_active":"2024-03-04T12:59:47.183207+0000","last_peered":"2024-03-04T12:59:47.183207+0000","last_clean":"2024-03-04T12:59:47.183207+0000","last_became_active":"2024-03-04T12:36:07.297879+0000","last_became_peered":"2024-03-04T12:36:07.297879+0000","last_unstale":"2024-03-04T12:59:47.183207+0000","last_undegraded":"2024-03-04T12:59:47.183207+0000","last_fullsized":"2024-03-04T12:59:47.183207+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:20.102942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4860,"num_read_kb":4288,"num_write":1505,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"256'319","reported_seq":927,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.814323+0000","last_change":"2024-03-04T12:36:05.297435+0000","last_active":"2024-03-04T13:00:15.814323+0000","last_peered":"2024-03-04T13:00:15.814323+0000","last_clean":"2024-03-04T13:00:15.814323+0000","last_became_active":"2024-03-04T12:36:05.296939+0000","last_became_peered":"2024-03-04T12:36:05.296939+0000","last_unstale":"2024-03-04T13:00:15.814323+0000","last_undegraded":"2024-03-04T13:00:15.814323+0000","last_fullsized":"2024-03-04T13:00:15.814323+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:05.528631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360056,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":415,"num_read_kb":33218,"num_write":1154,"num_write_kb":53558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.976554+0000","last_change":"2024-03-04T12:36:09.314445+0000","last_active":"2024-03-04T12:55:30.976554+0000","last_peered":"2024-03-04T12:55:30.976554+0000","last_clean":"2024-03-04T12:55:30.976554+0000","last_became_active":"2024-03-04T12:36:09.314065+0000","last_became_peered":"2024-03-04T12:36:09.314065+0000","last_unstale":"2024-03-04T12:55:30.976554+0000","last_undegraded":"2024-03-04T12:55:30.976554+0000","last_fullsized":"2024-03-04T12:55:30.976554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:31.539306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"256'281","reported_seq":848,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.994646+0000","last_change":"2024-03-04T12:36:11.326254+0000","last_active":"2024-03-04T13:00:15.994646+0000","last_peered":"2024-03-04T13:00:15.994646+0000","last_clean":"2024-03-04T13:00:15.994646+0000","last_became_active":"2024-03-04T12:36:11.325995+0000","last_became_peered":"2024-03-04T12:36:11.325995+0000","last_unstale":"2024-03-04T13:00:15.994646+0000","last_undegraded":"2024-03-04T13:00:15.994646+0000","last_fullsized":"2024-03-04T13:00:15.994646+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:44.077134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54042,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":461,"num_read_kb":924,"num_write":361,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.864607+0000","last_change":"2024-03-04T12:36:13.339677+0000","last_active":"2024-03-04T12:55:35.864607+0000","last_peered":"2024-03-04T12:55:35.864607+0000","last_clean":"2024-03-04T12:55:35.864607+0000","last_became_active":"2024-03-04T12:36:13.339305+0000","last_became_peered":"2024-03-04T12:36:13.339305+0000","last_unstale":"2024-03-04T12:55:35.864607+0000","last_undegraded":"2024-03-04T12:55:35.864607+0000","last_fullsized":"2024-03-04T12:55:35.864607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:00:43.245373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"256'2370","reported_seq":4141,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.448462+0000","last_change":"2024-03-04T12:36:15.362735+0000","last_active":"2024-03-04T13:00:07.448462+0000","last_peered":"2024-03-04T13:00:07.448462+0000","last_clean":"2024-03-04T13:00:07.448462+0000","last_became_active":"2024-03-04T12:36:15.362434+0000","last_became_peered":"2024-03-04T12:36:15.362434+0000","last_unstale":"2024-03-04T13:00:07.448462+0000","last_undegraded":"2024-03-04T13:00:07.448462+0000","last_fullsized":"2024-03-04T13:00:07.448462+0000","mapping_epoch":30,"log_start":"256'2300","ondisk_log_start":"256'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":2300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:44:00.181398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5876,"num_read_kb":5881,"num_write":4713,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"256'831","reported_seq":2403,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:40.772778+0000","last_change":"2024-03-04T12:36:07.295827+0000","last_active":"2024-03-04T12:59:40.772778+0000","last_peered":"2024-03-04T12:59:40.772778+0000","last_clean":"2024-03-04T12:59:40.772778+0000","last_became_active":"2024-03-04T12:36:07.295522+0000","last_became_peered":"2024-03-04T12:36:07.295522+0000","last_unstale":"2024-03-04T12:59:40.772778+0000","last_undegraded":"2024-03-04T12:59:40.772778+0000","last_fullsized":"2024-03-04T12:59:40.772778+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:48:41.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3820,"num_read_kb":3411,"num_write":1118,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"256'322","reported_seq":937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.005883+0000","last_change":"2024-03-04T12:36:05.288481+0000","last_active":"2024-03-04T13:00:16.005883+0000","last_peered":"2024-03-04T13:00:16.005883+0000","last_clean":"2024-03-04T13:00:16.005883+0000","last_became_active":"2024-03-04T12:36:05.288208+0000","last_became_peered":"2024-03-04T12:36:05.288208+0000","last_unstale":"2024-03-04T13:00:16.005883+0000","last_undegraded":"2024-03-04T13:00:16.005883+0000","last_fullsized":"2024-03-04T13:00:16.005883+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:48.405825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4588272,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":513,"num_read_kb":34780,"num_write":1135,"num_write_kb":45508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.980972+0000","last_change":"2024-03-04T12:36:09.309834+0000","last_active":"2024-03-04T12:57:10.980972+0000","last_peered":"2024-03-04T12:57:10.980972+0000","last_clean":"2024-03-04T12:57:10.980972+0000","last_became_active":"2024-03-04T12:36:09.309583+0000","last_became_peered":"2024-03-04T12:36:09.309583+0000","last_unstale":"2024-03-04T12:57:10.980972+0000","last_undegraded":"2024-03-04T12:57:10.980972+0000","last_fullsized":"2024-03-04T12:57:10.980972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:07.871941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"256'70","reported_seq":569,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.001099+0000","last_change":"2024-03-04T12:36:11.325082+0000","last_active":"2024-03-04T12:57:56.001099+0000","last_peered":"2024-03-04T12:57:56.001099+0000","last_clean":"2024-03-04T12:57:56.001099+0000","last_became_active":"2024-03-04T12:36:11.324761+0000","last_became_peered":"2024-03-04T12:36:11.324761+0000","last_unstale":"2024-03-04T12:57:56.001099+0000","last_undegraded":"2024-03-04T12:57:56.001099+0000","last_fullsized":"2024-03-04T12:57:56.001099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:54.454757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":50,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":471,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.977378+0000","last_change":"2024-03-04T12:36:13.343424+0000","last_active":"2024-03-04T12:55:35.977378+0000","last_peered":"2024-03-04T12:55:35.977378+0000","last_clean":"2024-03-04T12:55:35.977378+0000","last_became_active":"2024-03-04T12:36:13.343072+0000","last_became_peered":"2024-03-04T12:36:13.343072+0000","last_unstale":"2024-03-04T12:55:35.977378+0000","last_undegraded":"2024-03-04T12:55:35.977378+0000","last_fullsized":"2024-03-04T12:55:35.977378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:57.168843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"256'98","reported_seq":584,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.906113+0000","last_change":"2024-03-04T12:36:15.362615+0000","last_active":"2024-03-04T12:59:54.906113+0000","last_peered":"2024-03-04T12:59:54.906113+0000","last_clean":"2024-03-04T12:59:54.906113+0000","last_became_active":"2024-03-04T12:36:15.362354+0000","last_became_peered":"2024-03-04T12:36:15.362354+0000","last_unstale":"2024-03-04T12:59:54.906113+0000","last_undegraded":"2024-03-04T12:59:54.906113+0000","last_fullsized":"2024-03-04T12:59:54.906113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:28.389546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":121,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"256'345","reported_seq":1724,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.037932+0000","last_change":"2024-03-04T12:36:07.294690+0000","last_active":"2024-03-04T12:59:53.037932+0000","last_peered":"2024-03-04T12:59:53.037932+0000","last_clean":"2024-03-04T12:59:53.037932+0000","last_became_active":"2024-03-04T12:36:07.294328+0000","last_became_peered":"2024-03-04T12:36:07.294328+0000","last_unstale":"2024-03-04T12:59:53.037932+0000","last_undegraded":"2024-03-04T12:59:53.037932+0000","last_fullsized":"2024-03-04T12:59:53.037932+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:21.872722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1913,"num_read_kb":1818,"num_write":399,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"256'245","reported_seq":858,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.826805+0000","last_change":"2024-03-04T12:36:05.291937+0000","last_active":"2024-03-04T13:00:15.826805+0000","last_peered":"2024-03-04T13:00:15.826805+0000","last_clean":"2024-03-04T13:00:15.826805+0000","last_became_active":"2024-03-04T12:36:05.291366+0000","last_became_peered":"2024-03-04T12:36:05.291366+0000","last_unstale":"2024-03-04T13:00:15.826805+0000","last_undegraded":"2024-03-04T13:00:15.826805+0000","last_fullsized":"2024-03-04T13:00:15.826805+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:51:33.987631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074518,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":408,"num_read_kb":10586,"num_write":1086,"num_write_kb":21097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.968727+0000","last_change":"2024-03-04T12:36:09.310004+0000","last_active":"2024-03-04T12:55:30.968727+0000","last_peered":"2024-03-04T12:55:30.968727+0000","last_clean":"2024-03-04T12:55:30.968727+0000","last_became_active":"2024-03-04T12:36:09.309749+0000","last_became_peered":"2024-03-04T12:36:09.309749+0000","last_unstale":"2024-03-04T12:55:30.968727+0000","last_undegraded":"2024-03-04T12:55:30.968727+0000","last_fullsized":"2024-03-04T12:55:30.968727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:03:13.417440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"256'81","reported_seq":584,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:49.593521+0000","last_change":"2024-03-04T12:36:11.324407+0000","last_active":"2024-03-04T12:58:49.593521+0000","last_peered":"2024-03-04T12:58:49.593521+0000","last_clean":"2024-03-04T12:58:49.593521+0000","last_became_active":"2024-03-04T12:36:11.324127+0000","last_became_peered":"2024-03-04T12:36:11.324127+0000","last_unstale":"2024-03-04T12:58:49.593521+0000","last_undegraded":"2024-03-04T12:58:49.593521+0000","last_fullsized":"2024-03-04T12:58:49.593521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:48.776107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"256'508","reported_seq":1456,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.236381+0000","last_change":"2024-03-04T12:36:13.338671+0000","last_active":"2024-03-04T13:00:15.236381+0000","last_peered":"2024-03-04T13:00:15.236381+0000","last_clean":"2024-03-04T13:00:15.236381+0000","last_became_active":"2024-03-04T12:36:13.338070+0000","last_became_peered":"2024-03-04T12:36:13.338070+0000","last_unstale":"2024-03-04T13:00:15.236381+0000","last_undegraded":"2024-03-04T13:00:15.236381+0000","last_fullsized":"2024-03-04T13:00:15.236381+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:33:55.908350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"256'103","reported_seq":572,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:31.188469+0000","last_change":"2024-03-04T12:36:15.356684+0000","last_active":"2024-03-04T12:59:31.188469+0000","last_peered":"2024-03-04T12:59:31.188469+0000","last_clean":"2024-03-04T12:59:31.188469+0000","last_became_active":"2024-03-04T12:36:15.356417+0000","last_became_peered":"2024-03-04T12:36:15.356417+0000","last_unstale":"2024-03-04T12:59:31.188469+0000","last_undegraded":"2024-03-04T12:59:31.188469+0000","last_fullsized":"2024-03-04T12:59:31.188469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:52:14.210704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"256'684","reported_seq":2108,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.017188+0000","last_change":"2024-03-04T12:36:07.293732+0000","last_active":"2024-03-04T12:59:56.017188+0000","last_peered":"2024-03-04T12:59:56.017188+0000","last_clean":"2024-03-04T12:59:56.017188+0000","last_became_active":"2024-03-04T12:36:07.293493+0000","last_became_peered":"2024-03-04T12:36:07.293493+0000","last_unstale":"2024-03-04T12:59:56.017188+0000","last_undegraded":"2024-03-04T12:59:56.017188+0000","last_fullsized":"2024-03-04T12:59:56.017188+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:57:53.084655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3120,"num_read_kb":2817,"num_write":901,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"256'348","reported_seq":968,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.991149+0000","last_change":"2024-03-04T12:36:05.283970+0000","last_active":"2024-03-04T13:00:15.991149+0000","last_peered":"2024-03-04T13:00:15.991149+0000","last_clean":"2024-03-04T13:00:15.991149+0000","last_became_active":"2024-03-04T12:36:05.283477+0000","last_became_peered":"2024-03-04T12:36:05.283477+0000","last_unstale":"2024-03-04T13:00:15.991149+0000","last_undegraded":"2024-03-04T13:00:15.991149+0000","last_fullsized":"2024-03-04T13:00:15.991149+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:34:48.169224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2135532,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":502,"num_read_kb":32578,"num_write":1414,"num_write_kb":46757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.976596+0000","last_change":"2024-03-04T12:36:09.314720+0000","last_active":"2024-03-04T12:55:30.976596+0000","last_peered":"2024-03-04T12:55:30.976596+0000","last_clean":"2024-03-04T12:55:30.976596+0000","last_became_active":"2024-03-04T12:36:09.314215+0000","last_became_peered":"2024-03-04T12:36:09.314215+0000","last_unstale":"2024-03-04T12:55:30.976596+0000","last_undegraded":"2024-03-04T12:55:30.976596+0000","last_fullsized":"2024-03-04T12:55:30.976596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:41.656458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"256'247","reported_seq":789,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.763809+0000","last_change":"2024-03-04T12:36:11.956620+0000","last_active":"2024-03-04T13:00:15.763809+0000","last_peered":"2024-03-04T13:00:15.763809+0000","last_clean":"2024-03-04T13:00:15.763809+0000","last_became_active":"2024-03-04T12:36:11.956371+0000","last_became_peered":"2024-03-04T12:36:11.956371+0000","last_unstale":"2024-03-04T13:00:15.763809+0000","last_undegraded":"2024-03-04T13:00:15.763809+0000","last_fullsized":"2024-03-04T13:00:15.763809+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:43.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44142,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1035,"num_write":354,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"256'533","reported_seq":3334,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.240304+0000","last_change":"2024-03-04T12:36:13.344846+0000","last_active":"2024-03-04T13:00:15.240304+0000","last_peered":"2024-03-04T13:00:15.240304+0000","last_clean":"2024-03-04T13:00:15.240304+0000","last_became_active":"2024-03-04T12:36:13.344498+0000","last_became_peered":"2024-03-04T12:36:13.344498+0000","last_unstale":"2024-03-04T13:00:15.240304+0000","last_undegraded":"2024-03-04T13:00:15.240304+0000","last_fullsized":"2024-03-04T13:00:15.240304+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:40:58.604976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"256'768","reported_seq":2298,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.130713+0000","last_change":"2024-03-04T12:36:07.297672+0000","last_active":"2024-03-04T12:59:52.130713+0000","last_peered":"2024-03-04T12:59:52.130713+0000","last_clean":"2024-03-04T12:59:52.130713+0000","last_became_active":"2024-03-04T12:36:07.297320+0000","last_became_peered":"2024-03-04T12:36:07.297320+0000","last_unstale":"2024-03-04T12:59:52.130713+0000","last_undegraded":"2024-03-04T12:59:52.130713+0000","last_fullsized":"2024-03-04T12:59:52.130713+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:40.204657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3660,"num_read_kb":3298,"num_write":1023,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"256'325","reported_seq":987,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.769791+0000","last_change":"2024-03-04T12:36:05.294150+0000","last_active":"2024-03-04T13:00:15.769791+0000","last_peered":"2024-03-04T13:00:15.769791+0000","last_clean":"2024-03-04T13:00:15.769791+0000","last_became_active":"2024-03-04T12:36:05.293882+0000","last_became_peered":"2024-03-04T12:36:05.293882+0000","last_unstale":"2024-03-04T13:00:15.769791+0000","last_undegraded":"2024-03-04T13:00:15.769791+0000","last_fullsized":"2024-03-04T13:00:15.769791+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:44:38.505106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25761744,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":517,"num_read_kb":60171,"num_write":1396,"num_write_kb":40158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.884043+0000","last_change":"2024-03-04T12:36:09.308808+0000","last_active":"2024-03-04T12:57:50.884043+0000","last_peered":"2024-03-04T12:57:50.884043+0000","last_clean":"2024-03-04T12:57:50.884043+0000","last_became_active":"2024-03-04T12:36:09.308538+0000","last_became_peered":"2024-03-04T12:36:09.308538+0000","last_unstale":"2024-03-04T12:57:50.884043+0000","last_undegraded":"2024-03-04T12:57:50.884043+0000","last_fullsized":"2024-03-04T12:57:50.884043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:29.862690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"256'308","reported_seq":874,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.684356+0000","last_change":"2024-03-04T12:36:11.954866+0000","last_active":"2024-03-04T13:00:08.684356+0000","last_peered":"2024-03-04T13:00:08.684356+0000","last_clean":"2024-03-04T13:00:08.684356+0000","last_became_active":"2024-03-04T12:36:11.954597+0000","last_became_peered":"2024-03-04T12:36:11.954597+0000","last_unstale":"2024-03-04T13:00:08.684356+0000","last_undegraded":"2024-03-04T13:00:08.684356+0000","last_fullsized":"2024-03-04T13:00:08.684356+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:12.925538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66828,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":513,"num_read_kb":1018,"num_write":416,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.975791+0000","last_change":"2024-03-04T12:36:13.340164+0000","last_active":"2024-03-04T12:56:30.975791+0000","last_peered":"2024-03-04T12:56:30.975791+0000","last_clean":"2024-03-04T12:56:30.975791+0000","last_became_active":"2024-03-04T12:36:13.339890+0000","last_became_peered":"2024-03-04T12:36:13.339890+0000","last_unstale":"2024-03-04T12:56:30.975791+0000","last_undegraded":"2024-03-04T12:56:30.975791+0000","last_fullsized":"2024-03-04T12:56:30.975791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:01:43.082809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"256'505","reported_seq":1289,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.702992+0000","last_change":"2024-03-04T12:36:15.363257+0000","last_active":"2024-03-04T13:00:08.702992+0000","last_peered":"2024-03-04T13:00:08.702992+0000","last_clean":"2024-03-04T13:00:08.702992+0000","last_became_active":"2024-03-04T12:36:15.362355+0000","last_became_peered":"2024-03-04T12:36:15.362355+0000","last_unstale":"2024-03-04T13:00:08.702992+0000","last_undegraded":"2024-03-04T13:00:08.702992+0000","last_fullsized":"2024-03-04T13:00:08.702992+0000","mapping_epoch":30,"log_start":"250'400","ondisk_log_start":"250'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:39:12.607478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1234,"num_read_kb":1233,"num_write":1042,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"256'404","reported_seq":1914,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.480892+0000","last_change":"2024-03-04T12:36:07.292415+0000","last_active":"2024-03-04T12:59:55.480892+0000","last_peered":"2024-03-04T12:59:55.480892+0000","last_clean":"2024-03-04T12:59:55.480892+0000","last_became_active":"2024-03-04T12:36:07.291507+0000","last_became_peered":"2024-03-04T12:36:07.291507+0000","last_unstale":"2024-03-04T12:59:55.480892+0000","last_undegraded":"2024-03-04T12:59:55.480892+0000","last_fullsized":"2024-03-04T12:59:55.480892+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:09:27.148690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2180,"num_read_kb":2067,"num_write":478,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"256'268","reported_seq":891,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.819590+0000","last_change":"2024-03-04T12:36:05.286750+0000","last_active":"2024-03-04T13:00:15.819590+0000","last_peered":"2024-03-04T13:00:15.819590+0000","last_clean":"2024-03-04T13:00:15.819590+0000","last_became_active":"2024-03-04T12:36:05.286438+0000","last_became_peered":"2024-03-04T12:36:05.286438+0000","last_unstale":"2024-03-04T13:00:15.819590+0000","last_undegraded":"2024-03-04T13:00:15.819590+0000","last_fullsized":"2024-03-04T13:00:15.819590+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:34:40.712814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561797,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":436,"num_read_kb":18655,"num_write":1164,"num_write_kb":23251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.988264+0000","last_change":"2024-03-04T12:36:09.304859+0000","last_active":"2024-03-04T12:57:50.988264+0000","last_peered":"2024-03-04T12:57:50.988264+0000","last_clean":"2024-03-04T12:57:50.988264+0000","last_became_active":"2024-03-04T12:36:09.304561+0000","last_became_peered":"2024-03-04T12:36:09.304561+0000","last_unstale":"2024-03-04T12:57:50.988264+0000","last_undegraded":"2024-03-04T12:57:50.988264+0000","last_fullsized":"2024-03-04T12:57:50.988264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:50:41.171488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"256'264","reported_seq":800,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.659812+0000","last_change":"2024-03-04T12:36:11.324431+0000","last_active":"2024-03-04T13:00:08.659812+0000","last_peered":"2024-03-04T13:00:08.659812+0000","last_clean":"2024-03-04T13:00:08.659812+0000","last_became_active":"2024-03-04T12:36:11.324147+0000","last_became_peered":"2024-03-04T12:36:11.324147+0000","last_unstale":"2024-03-04T13:00:08.659812+0000","last_undegraded":"2024-03-04T13:00:08.659812+0000","last_fullsized":"2024-03-04T13:00:08.659812+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:08.464149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":936,"num_write":360,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.987062+0000","last_change":"2024-03-04T12:36:13.346330+0000","last_active":"2024-03-04T12:57:55.987062+0000","last_peered":"2024-03-04T12:57:55.987062+0000","last_clean":"2024-03-04T12:57:55.987062+0000","last_became_active":"2024-03-04T12:36:13.346077+0000","last_became_peered":"2024-03-04T12:36:13.346077+0000","last_unstale":"2024-03-04T12:57:55.987062+0000","last_undegraded":"2024-03-04T12:57:55.987062+0000","last_fullsized":"2024-03-04T12:57:55.987062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:53:58.068981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"256'121","reported_seq":600,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.249351+0000","last_change":"2024-03-04T12:36:15.360124+0000","last_active":"2024-03-04T12:59:48.249351+0000","last_peered":"2024-03-04T12:59:48.249351+0000","last_clean":"2024-03-04T12:59:48.249351+0000","last_became_active":"2024-03-04T12:36:15.359839+0000","last_became_peered":"2024-03-04T12:36:15.359839+0000","last_unstale":"2024-03-04T12:59:48.249351+0000","last_undegraded":"2024-03-04T12:59:48.249351+0000","last_fullsized":"2024-03-04T12:59:48.249351+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:21:16.002994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":144,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"256'819","reported_seq":2263,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.910676+0000","last_change":"2024-03-04T12:36:40.395151+0000","last_active":"2024-03-04T12:59:54.910676+0000","last_peered":"2024-03-04T12:59:54.910676+0000","last_clean":"2024-03-04T12:59:54.910676+0000","last_became_active":"2024-03-04T12:36:40.394812+0000","last_became_peered":"2024-03-04T12:36:40.394812+0000","last_unstale":"2024-03-04T12:59:54.910676+0000","last_undegraded":"2024-03-04T12:59:54.910676+0000","last_fullsized":"2024-03-04T12:59:54.910676+0000","mapping_epoch":33,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:10.350765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3628,"num_read_kb":3191,"num_write":1140,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"256'304","reported_seq":953,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.850484+0000","last_change":"2024-03-04T12:36:05.297783+0000","last_active":"2024-03-04T13:00:15.850484+0000","last_peered":"2024-03-04T13:00:15.850484+0000","last_clean":"2024-03-04T13:00:15.850484+0000","last_became_active":"2024-03-04T12:36:05.297486+0000","last_became_peered":"2024-03-04T12:36:05.297486+0000","last_unstale":"2024-03-04T13:00:15.850484+0000","last_undegraded":"2024-03-04T13:00:15.850484+0000","last_fullsized":"2024-03-04T13:00:15.850484+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:45.296031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20994598,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":550,"num_read_kb":44586,"num_write":1336,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'5","reported_seq":787,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.206385+0000","last_change":"2024-03-04T12:36:09.303560+0000","last_active":"2024-03-04T13:00:15.206385+0000","last_peered":"2024-03-04T13:00:15.206385+0000","last_clean":"2024-03-04T13:00:15.206385+0000","last_became_active":"2024-03-04T12:36:09.303280+0000","last_became_peered":"2024-03-04T12:36:09.303280+0000","last_unstale":"2024-03-04T13:00:15.206385+0000","last_undegraded":"2024-03-04T13:00:15.206385+0000","last_fullsized":"2024-03-04T13:00:15.206385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:32:28.838095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":467,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"256'280","reported_seq":828,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.686589+0000","last_change":"2024-03-04T12:36:11.325461+0000","last_active":"2024-03-04T13:00:08.686589+0000","last_peered":"2024-03-04T13:00:08.686589+0000","last_clean":"2024-03-04T13:00:08.686589+0000","last_became_active":"2024-03-04T12:36:11.325109+0000","last_became_peered":"2024-03-04T12:36:11.325109+0000","last_unstale":"2024-03-04T13:00:08.686589+0000","last_undegraded":"2024-03-04T13:00:08.686589+0000","last_fullsized":"2024-03-04T13:00:08.686589+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:48.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63172,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":463,"num_read_kb":979,"num_write":388,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"256'514","reported_seq":1818,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.241267+0000","last_change":"2024-03-04T12:36:13.342932+0000","last_active":"2024-03-04T13:00:15.241267+0000","last_peered":"2024-03-04T13:00:15.241267+0000","last_clean":"2024-03-04T13:00:15.241267+0000","last_became_active":"2024-03-04T12:36:13.342604+0000","last_became_peered":"2024-03-04T12:36:13.342604+0000","last_unstale":"2024-03-04T13:00:15.241267+0000","last_undegraded":"2024-03-04T13:00:15.241267+0000","last_fullsized":"2024-03-04T13:00:15.241267+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:05.485830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"256'91","reported_seq":551,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:32.243920+0000","last_change":"2024-03-04T12:36:15.360260+0000","last_active":"2024-03-04T12:59:32.243920+0000","last_peered":"2024-03-04T12:59:32.243920+0000","last_clean":"2024-03-04T12:59:32.243920+0000","last_became_active":"2024-03-04T12:36:15.359959+0000","last_became_peered":"2024-03-04T12:36:15.359959+0000","last_unstale":"2024-03-04T12:59:32.243920+0000","last_undegraded":"2024-03-04T12:59:32.243920+0000","last_fullsized":"2024-03-04T12:59:32.243920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:09.867645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"256'355","reported_seq":1798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.121512+0000","last_change":"2024-03-04T12:36:07.301861+0000","last_active":"2024-03-04T12:59:52.121512+0000","last_peered":"2024-03-04T12:59:52.121512+0000","last_clean":"2024-03-04T12:59:52.121512+0000","last_became_active":"2024-03-04T12:36:07.301558+0000","last_became_peered":"2024-03-04T12:36:07.301558+0000","last_unstale":"2024-03-04T12:59:52.121512+0000","last_undegraded":"2024-03-04T12:59:52.121512+0000","last_fullsized":"2024-03-04T12:59:52.121512+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:41.166126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1943,"num_read_kb":1867,"num_write":395,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"256'308","reported_seq":1058,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.935433+0000","last_change":"2024-03-04T12:36:05.293965+0000","last_active":"2024-03-04T13:00:15.935433+0000","last_peered":"2024-03-04T13:00:15.935433+0000","last_clean":"2024-03-04T13:00:15.935433+0000","last_became_active":"2024-03-04T12:36:05.293649+0000","last_became_peered":"2024-03-04T12:36:05.293649+0000","last_unstale":"2024-03-04T13:00:15.935433+0000","last_undegraded":"2024-03-04T13:00:15.935433+0000","last_fullsized":"2024-03-04T13:00:15.935433+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:55.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9453378,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":654,"num_read_kb":39140,"num_write":1321,"num_write_kb":31517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.988287+0000","last_change":"2024-03-04T12:36:09.304187+0000","last_active":"2024-03-04T12:57:50.988287+0000","last_peered":"2024-03-04T12:57:50.988287+0000","last_clean":"2024-03-04T12:57:50.988287+0000","last_became_active":"2024-03-04T12:36:09.303908+0000","last_became_peered":"2024-03-04T12:36:09.303908+0000","last_unstale":"2024-03-04T12:57:50.988287+0000","last_undegraded":"2024-03-04T12:57:50.988287+0000","last_fullsized":"2024-03-04T12:57:50.988287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:55:34.254756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"256'419","reported_seq":1009,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.251650+0000","last_change":"2024-03-04T12:36:11.328487+0000","last_active":"2024-03-04T13:00:15.251650+0000","last_peered":"2024-03-04T13:00:15.251650+0000","last_clean":"2024-03-04T13:00:15.251650+0000","last_became_active":"2024-03-04T12:36:11.326014+0000","last_became_peered":"2024-03-04T12:36:11.326014+0000","last_unstale":"2024-03-04T13:00:15.251650+0000","last_undegraded":"2024-03-04T13:00:15.251650+0000","last_fullsized":"2024-03-04T13:00:15.251650+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:45:24.328565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109509,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":732,"num_read_kb":1607,"num_write":604,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.988698+0000","last_change":"2024-03-04T12:36:13.335911+0000","last_active":"2024-03-04T12:57:55.988698+0000","last_peered":"2024-03-04T12:57:55.988698+0000","last_clean":"2024-03-04T12:57:55.988698+0000","last_became_active":"2024-03-04T12:36:13.335586+0000","last_became_peered":"2024-03-04T12:36:13.335586+0000","last_unstale":"2024-03-04T12:57:55.988698+0000","last_undegraded":"2024-03-04T12:57:55.988698+0000","last_fullsized":"2024-03-04T12:57:55.988698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:25.484088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"256'107","reported_seq":600,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:01.349664+0000","last_change":"2024-03-04T12:36:15.356552+0000","last_active":"2024-03-04T12:59:01.349664+0000","last_peered":"2024-03-04T12:59:01.349664+0000","last_clean":"2024-03-04T12:59:01.349664+0000","last_became_active":"2024-03-04T12:36:15.356270+0000","last_became_peered":"2024-03-04T12:36:15.356270+0000","last_unstale":"2024-03-04T12:59:01.349664+0000","last_undegraded":"2024-03-04T12:59:01.349664+0000","last_fullsized":"2024-03-04T12:59:01.349664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:20.445838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":257,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"256'398","reported_seq":1973,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.675701+0000","last_change":"2024-03-04T12:36:07.293079+0000","last_active":"2024-03-04T13:00:06.675701+0000","last_peered":"2024-03-04T13:00:06.675701+0000","last_clean":"2024-03-04T13:00:06.675701+0000","last_became_active":"2024-03-04T12:36:07.292788+0000","last_became_peered":"2024-03-04T12:36:07.292788+0000","last_unstale":"2024-03-04T13:00:06.675701+0000","last_undegraded":"2024-03-04T13:00:06.675701+0000","last_fullsized":"2024-03-04T13:00:06.675701+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:54.824676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2359,"num_read_kb":2243,"num_write":467,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"256'264","reported_seq":966,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.939047+0000","last_change":"2024-03-04T12:36:05.286316+0000","last_active":"2024-03-04T13:00:15.939047+0000","last_peered":"2024-03-04T13:00:15.939047+0000","last_clean":"2024-03-04T13:00:15.939047+0000","last_became_active":"2024-03-04T12:36:05.284594+0000","last_became_peered":"2024-03-04T12:36:05.284594+0000","last_unstale":"2024-03-04T13:00:15.939047+0000","last_undegraded":"2024-03-04T13:00:15.939047+0000","last_fullsized":"2024-03-04T13:00:15.939047+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:06.773008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12161951,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":556,"num_read_kb":110861,"num_write":978,"num_write_kb":39283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:25.979146+0000","last_change":"2024-03-04T12:36:09.305629+0000","last_active":"2024-03-04T12:56:25.979146+0000","last_peered":"2024-03-04T12:56:25.979146+0000","last_clean":"2024-03-04T12:56:25.979146+0000","last_became_active":"2024-03-04T12:36:09.305363+0000","last_became_peered":"2024-03-04T12:36:09.305363+0000","last_unstale":"2024-03-04T12:56:25.979146+0000","last_undegraded":"2024-03-04T12:56:25.979146+0000","last_fullsized":"2024-03-04T12:56:25.979146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:49:38.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"256'258","reported_seq":807,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.355690+0000","last_change":"2024-03-04T12:36:11.320326+0000","last_active":"2024-03-04T13:00:15.355690+0000","last_peered":"2024-03-04T13:00:15.355690+0000","last_clean":"2024-03-04T13:00:15.355690+0000","last_became_active":"2024-03-04T12:36:11.319633+0000","last_became_peered":"2024-03-04T12:36:11.319633+0000","last_unstale":"2024-03-04T13:00:15.355690+0000","last_undegraded":"2024-03-04T13:00:15.355690+0000","last_fullsized":"2024-03-04T13:00:15.355690+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:00:21.398680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":990,"num_write":404,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":463,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.992632+0000","last_change":"2024-03-04T12:36:13.349289+0000","last_active":"2024-03-04T12:56:30.992632+0000","last_peered":"2024-03-04T12:56:30.992632+0000","last_clean":"2024-03-04T12:56:30.992632+0000","last_became_active":"2024-03-04T12:36:13.348999+0000","last_became_peered":"2024-03-04T12:36:13.348999+0000","last_unstale":"2024-03-04T12:56:30.992632+0000","last_undegraded":"2024-03-04T12:56:30.992632+0000","last_fullsized":"2024-03-04T12:56:30.992632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:01:23.408092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"256'97","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:39.238643+0000","last_change":"2024-03-04T12:36:15.360060+0000","last_active":"2024-03-04T12:59:39.238643+0000","last_peered":"2024-03-04T12:59:39.238643+0000","last_clean":"2024-03-04T12:59:39.238643+0000","last_became_active":"2024-03-04T12:36:15.359732+0000","last_became_peered":"2024-03-04T12:36:15.359732+0000","last_unstale":"2024-03-04T12:59:39.238643+0000","last_undegraded":"2024-03-04T12:59:39.238643+0000","last_fullsized":"2024-03-04T12:59:39.238643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:46.691644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"256'879","reported_seq":2433,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.129050+0000","last_change":"2024-03-04T12:36:07.299296+0000","last_active":"2024-03-04T12:59:50.129050+0000","last_peered":"2024-03-04T12:59:50.129050+0000","last_clean":"2024-03-04T12:59:50.129050+0000","last_became_active":"2024-03-04T12:36:07.298999+0000","last_became_peered":"2024-03-04T12:36:07.298999+0000","last_unstale":"2024-03-04T12:59:50.129050+0000","last_undegraded":"2024-03-04T12:59:50.129050+0000","last_fullsized":"2024-03-04T12:59:50.129050+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:15.755740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4068,"num_read_kb":3596,"num_write":1224,"num_write_kb":497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"256'308","reported_seq":908,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.940339+0000","last_change":"2024-03-04T12:36:05.289780+0000","last_active":"2024-03-04T13:00:15.940339+0000","last_peered":"2024-03-04T13:00:15.940339+0000","last_clean":"2024-03-04T13:00:15.940339+0000","last_became_active":"2024-03-04T12:36:05.289486+0000","last_became_peered":"2024-03-04T12:36:05.289486+0000","last_unstale":"2024-03-04T13:00:15.940339+0000","last_undegraded":"2024-03-04T13:00:15.940339+0000","last_fullsized":"2024-03-04T13:00:15.940339+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:54.563075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17286171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":403,"num_read_kb":48705,"num_write":1279,"num_write_kb":64123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:25.975316+0000","last_change":"2024-03-04T12:36:09.306337+0000","last_active":"2024-03-04T12:56:25.975316+0000","last_peered":"2024-03-04T12:56:25.975316+0000","last_clean":"2024-03-04T12:56:25.975316+0000","last_became_active":"2024-03-04T12:36:09.305880+0000","last_became_peered":"2024-03-04T12:36:09.305880+0000","last_unstale":"2024-03-04T12:56:25.975316+0000","last_undegraded":"2024-03-04T12:56:25.975316+0000","last_fullsized":"2024-03-04T12:56:25.975316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:12:13.954397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"256'261","reported_seq":808,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.700544+0000","last_change":"2024-03-04T12:36:11.327832+0000","last_active":"2024-03-04T13:00:08.700544+0000","last_peered":"2024-03-04T13:00:08.700544+0000","last_clean":"2024-03-04T13:00:08.700544+0000","last_became_active":"2024-03-04T12:36:11.327499+0000","last_became_peered":"2024-03-04T12:36:11.327499+0000","last_unstale":"2024-03-04T13:00:08.700544+0000","last_undegraded":"2024-03-04T13:00:08.700544+0000","last_fullsized":"2024-03-04T13:00:08.700544+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:11:36.354045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56466,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":427,"num_read_kb":893,"num_write":352,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"256'476","reported_seq":1624,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.236960+0000","last_change":"2024-03-04T12:36:13.338140+0000","last_active":"2024-03-04T13:00:15.236960+0000","last_peered":"2024-03-04T13:00:15.236960+0000","last_clean":"2024-03-04T13:00:15.236960+0000","last_became_active":"2024-03-04T12:36:13.337817+0000","last_became_peered":"2024-03-04T12:36:13.337817+0000","last_unstale":"2024-03-04T13:00:15.236960+0000","last_undegraded":"2024-03-04T13:00:15.236960+0000","last_fullsized":"2024-03-04T13:00:15.236960+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:48.478224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"256'95","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:51.103823+0000","last_change":"2024-03-04T12:36:15.349157+0000","last_active":"2024-03-04T12:58:51.103823+0000","last_peered":"2024-03-04T12:58:51.103823+0000","last_clean":"2024-03-04T12:58:51.103823+0000","last_became_active":"2024-03-04T12:36:15.348869+0000","last_became_peered":"2024-03-04T12:36:15.348869+0000","last_unstale":"2024-03-04T12:58:51.103823+0000","last_undegraded":"2024-03-04T12:58:51.103823+0000","last_fullsized":"2024-03-04T12:58:51.103823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:52:50.410936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":240,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"256'411","reported_seq":1952,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.247659+0000","last_change":"2024-03-04T12:36:07.293897+0000","last_active":"2024-03-04T12:59:48.247659+0000","last_peered":"2024-03-04T12:59:48.247659+0000","last_clean":"2024-03-04T12:59:48.247659+0000","last_became_active":"2024-03-04T12:36:07.293586+0000","last_became_peered":"2024-03-04T12:36:07.293586+0000","last_unstale":"2024-03-04T12:59:48.247659+0000","last_undegraded":"2024-03-04T12:59:48.247659+0000","last_fullsized":"2024-03-04T12:59:48.247659+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:31.445571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2259,"num_read_kb":2143,"num_write":486,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"256'294","reported_seq":901,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.958822+0000","last_change":"2024-03-04T12:36:05.288353+0000","last_active":"2024-03-04T13:00:15.958822+0000","last_peered":"2024-03-04T13:00:15.958822+0000","last_clean":"2024-03-04T13:00:15.958822+0000","last_became_active":"2024-03-04T12:36:05.288036+0000","last_became_peered":"2024-03-04T12:36:05.288036+0000","last_unstale":"2024-03-04T13:00:15.958822+0000","last_undegraded":"2024-03-04T13:00:15.958822+0000","last_fullsized":"2024-03-04T13:00:15.958822+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:01.290623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243366,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":450,"num_read_kb":10713,"num_write":1269,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1088,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.217652+0000","last_change":"2024-03-04T12:36:09.315046+0000","last_active":"2024-03-04T13:00:15.217652+0000","last_peered":"2024-03-04T13:00:15.217652+0000","last_clean":"2024-03-04T13:00:15.217652+0000","last_became_active":"2024-03-04T12:36:09.314474+0000","last_became_peered":"2024-03-04T12:36:09.314474+0000","last_unstale":"2024-03-04T13:00:15.217652+0000","last_undegraded":"2024-03-04T13:00:15.217652+0000","last_fullsized":"2024-03-04T13:00:15.217652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:46:57.713946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":612,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"256'50","reported_seq":536,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:38.607544+0000","last_change":"2024-03-04T12:36:11.954876+0000","last_active":"2024-03-04T12:58:38.607544+0000","last_peered":"2024-03-04T12:58:38.607544+0000","last_clean":"2024-03-04T12:58:38.607544+0000","last_became_active":"2024-03-04T12:36:11.954508+0000","last_became_peered":"2024-03-04T12:36:11.954508+0000","last_unstale":"2024-03-04T12:58:38.607544+0000","last_undegraded":"2024-03-04T12:58:38.607544+0000","last_fullsized":"2024-03-04T12:58:38.607544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:09.989384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"256'481","reported_seq":1496,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.238885+0000","last_change":"2024-03-04T12:36:13.343179+0000","last_active":"2024-03-04T13:00:15.238885+0000","last_peered":"2024-03-04T13:00:15.238885+0000","last_clean":"2024-03-04T13:00:15.238885+0000","last_became_active":"2024-03-04T12:36:13.342902+0000","last_became_peered":"2024-03-04T12:36:13.342902+0000","last_unstale":"2024-03-04T13:00:15.238885+0000","last_undegraded":"2024-03-04T13:00:15.238885+0000","last_fullsized":"2024-03-04T13:00:15.238885+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:58.981468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"256'93","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:34.781977+0000","last_change":"2024-03-04T12:36:15.352744+0000","last_active":"2024-03-04T12:59:34.781977+0000","last_peered":"2024-03-04T12:59:34.781977+0000","last_clean":"2024-03-04T12:59:34.781977+0000","last_became_active":"2024-03-04T12:36:15.352420+0000","last_became_peered":"2024-03-04T12:36:15.352420+0000","last_unstale":"2024-03-04T12:59:34.781977+0000","last_undegraded":"2024-03-04T12:59:34.781977+0000","last_fullsized":"2024-03-04T12:59:34.781977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:55.559823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":79,"num_write":205,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"256'1079","reported_seq":2453,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.904016+0000","last_change":"2024-03-04T12:36:07.304422+0000","last_active":"2024-03-04T12:59:54.904016+0000","last_peered":"2024-03-04T12:59:54.904016+0000","last_clean":"2024-03-04T12:59:54.904016+0000","last_became_active":"2024-03-04T12:36:07.304123+0000","last_became_peered":"2024-03-04T12:36:07.304123+0000","last_unstale":"2024-03-04T12:59:54.904016+0000","last_undegraded":"2024-03-04T12:59:54.904016+0000","last_fullsized":"2024-03-04T12:59:54.904016+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1000,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:23.435722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4358,"num_read_kb":3794,"num_write":1486,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'323","reported_seq":947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.000117+0000","last_change":"2024-03-04T12:36:05.286870+0000","last_active":"2024-03-04T13:00:16.000117+0000","last_peered":"2024-03-04T13:00:16.000117+0000","last_clean":"2024-03-04T13:00:16.000117+0000","last_became_active":"2024-03-04T12:36:05.286442+0000","last_became_peered":"2024-03-04T12:36:05.286442+0000","last_unstale":"2024-03-04T13:00:16.000117+0000","last_undegraded":"2024-03-04T13:00:16.000117+0000","last_fullsized":"2024-03-04T13:00:16.000117+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:25:34.379001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7354917,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":454,"num_read_kb":22844,"num_write":1262,"num_write_kb":40494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:25.985653+0000","last_change":"2024-03-04T12:36:09.314992+0000","last_active":"2024-03-04T12:56:25.985653+0000","last_peered":"2024-03-04T12:56:25.985653+0000","last_clean":"2024-03-04T12:56:25.985653+0000","last_became_active":"2024-03-04T12:36:09.314671+0000","last_became_peered":"2024-03-04T12:36:09.314671+0000","last_unstale":"2024-03-04T12:56:25.985653+0000","last_undegraded":"2024-03-04T12:56:25.985653+0000","last_fullsized":"2024-03-04T12:56:25.985653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:57:19.079487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"256'286","reported_seq":848,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.832296+0000","last_change":"2024-03-04T12:36:11.325717+0000","last_active":"2024-03-04T13:00:08.832296+0000","last_peered":"2024-03-04T13:00:08.832296+0000","last_clean":"2024-03-04T13:00:08.832296+0000","last_became_active":"2024-03-04T12:36:11.325372+0000","last_became_peered":"2024-03-04T12:36:11.325372+0000","last_unstale":"2024-03-04T13:00:08.832296+0000","last_undegraded":"2024-03-04T13:00:08.832296+0000","last_fullsized":"2024-03-04T13:00:08.832296+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:16:12.771232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49363,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1032,"num_read_kb":1454,"num_write":1520,"num_write_kb":1422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.981677+0000","last_change":"2024-03-04T12:36:13.349278+0000","last_active":"2024-03-04T12:56:30.981677+0000","last_peered":"2024-03-04T12:56:30.981677+0000","last_clean":"2024-03-04T12:56:30.981677+0000","last_became_active":"2024-03-04T12:36:13.348998+0000","last_became_peered":"2024-03-04T12:36:13.348998+0000","last_unstale":"2024-03-04T12:56:30.981677+0000","last_undegraded":"2024-03-04T12:56:30.981677+0000","last_fullsized":"2024-03-04T12:56:30.981677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:03:29.176425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"256'116","reported_seq":596,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:43.519813+0000","last_change":"2024-03-04T12:36:15.363113+0000","last_active":"2024-03-04T12:58:43.519813+0000","last_peered":"2024-03-04T12:58:43.519813+0000","last_clean":"2024-03-04T12:58:43.519813+0000","last_became_active":"2024-03-04T12:36:15.362792+0000","last_became_peered":"2024-03-04T12:36:15.362792+0000","last_unstale":"2024-03-04T12:58:43.519813+0000","last_undegraded":"2024-03-04T12:58:43.519813+0000","last_fullsized":"2024-03-04T12:58:43.519813+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:51:39.773670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":132,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"256'316","reported_seq":1674,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.469861+0000","last_change":"2024-03-04T12:36:07.300301+0000","last_active":"2024-03-04T12:59:55.469861+0000","last_peered":"2024-03-04T12:59:55.469861+0000","last_clean":"2024-03-04T12:59:55.469861+0000","last_became_active":"2024-03-04T12:36:07.299952+0000","last_became_peered":"2024-03-04T12:36:07.299952+0000","last_unstale":"2024-03-04T12:59:55.469861+0000","last_undegraded":"2024-03-04T12:59:55.469861+0000","last_fullsized":"2024-03-04T12:59:55.469861+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:58.864307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1855,"num_read_kb":1767,"num_write":364,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":649,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.884796+0000","last_change":"2024-03-04T12:35:47.950593+0000","last_active":"2024-03-04T12:57:55.884796+0000","last_peered":"2024-03-04T12:57:55.884796+0000","last_clean":"2024-03-04T12:57:55.884796+0000","last_became_active":"2024-03-04T12:35:47.950213+0000","last_became_peered":"2024-03-04T12:35:47.950213+0000","last_unstale":"2024-03-04T12:57:55.884796+0000","last_undegraded":"2024-03-04T12:57:55.884796+0000","last_fullsized":"2024-03-04T12:57:55.884796+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_clean_scrub_stamp":"2024-03-04T12:35:46.856449+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:52:59.823887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.989264+0000","last_change":"2024-03-04T12:35:54.235102+0000","last_active":"2024-03-04T12:56:45.989264+0000","last_peered":"2024-03-04T12:56:45.989264+0000","last_clean":"2024-03-04T12:56:45.989264+0000","last_became_active":"2024-03-04T12:35:54.234819+0000","last_became_peered":"2024-03-04T12:35:54.234819+0000","last_unstale":"2024-03-04T12:56:45.989264+0000","last_undegraded":"2024-03-04T12:56:45.989264+0000","last_fullsized":"2024-03-04T12:56:45.989264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:40.517488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"256'276","reported_seq":885,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.898239+0000","last_change":"2024-03-04T12:36:05.297146+0000","last_active":"2024-03-04T13:00:15.898239+0000","last_peered":"2024-03-04T13:00:15.898239+0000","last_clean":"2024-03-04T13:00:15.898239+0000","last_became_active":"2024-03-04T12:36:05.296783+0000","last_became_peered":"2024-03-04T12:36:05.296783+0000","last_unstale":"2024-03-04T13:00:15.898239+0000","last_undegraded":"2024-03-04T13:00:15.898239+0000","last_fullsized":"2024-03-04T13:00:15.898239+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:06:23.807756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437583,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":424,"num_read_kb":16803,"num_write":1112,"num_write_kb":27899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.876708+0000","last_change":"2024-03-04T12:36:09.306698+0000","last_active":"2024-03-04T12:57:00.876708+0000","last_peered":"2024-03-04T12:57:00.876708+0000","last_clean":"2024-03-04T12:57:00.876708+0000","last_became_active":"2024-03-04T12:36:09.306398+0000","last_became_peered":"2024-03-04T12:36:09.306398+0000","last_unstale":"2024-03-04T12:57:00.876708+0000","last_undegraded":"2024-03-04T12:57:00.876708+0000","last_fullsized":"2024-03-04T12:57:00.876708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:16.000870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"256'653","reported_seq":1318,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.925262+0000","last_change":"2024-03-04T12:36:11.327855+0000","last_active":"2024-03-04T13:00:15.925262+0000","last_peered":"2024-03-04T13:00:15.925262+0000","last_clean":"2024-03-04T13:00:15.925262+0000","last_became_active":"2024-03-04T12:36:11.327652+0000","last_became_peered":"2024-03-04T12:36:11.327652+0000","last_unstale":"2024-03-04T13:00:15.925262+0000","last_undegraded":"2024-03-04T13:00:15.925262+0000","last_fullsized":"2024-03-04T13:00:15.925262+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:41:37.539307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158967,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1269,"num_read_kb":2731,"num_write":1176,"num_write_kb":1053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.003351+0000","last_change":"2024-03-04T12:36:13.341910+0000","last_active":"2024-03-04T12:57:56.003351+0000","last_peered":"2024-03-04T12:57:56.003351+0000","last_clean":"2024-03-04T12:57:56.003351+0000","last_became_active":"2024-03-04T12:36:13.341629+0000","last_became_peered":"2024-03-04T12:36:13.341629+0000","last_unstale":"2024-03-04T12:57:56.003351+0000","last_undegraded":"2024-03-04T12:57:56.003351+0000","last_fullsized":"2024-03-04T12:57:56.003351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:27:23.583364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"256'95","reported_seq":571,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.010288+0000","last_change":"2024-03-04T12:36:15.363641+0000","last_active":"2024-03-04T13:00:06.010288+0000","last_peered":"2024-03-04T13:00:06.010288+0000","last_clean":"2024-03-04T13:00:06.010288+0000","last_became_active":"2024-03-04T12:36:15.363355+0000","last_became_peered":"2024-03-04T12:36:15.363355+0000","last_unstale":"2024-03-04T13:00:06.010288+0000","last_undegraded":"2024-03-04T13:00:06.010288+0000","last_fullsized":"2024-03-04T13:00:06.010288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:41:52.622760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"256'352","reported_seq":1786,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:46.629131+0000","last_change":"2024-03-04T12:36:07.302006+0000","last_active":"2024-03-04T12:59:46.629131+0000","last_peered":"2024-03-04T12:59:46.629131+0000","last_clean":"2024-03-04T12:59:46.629131+0000","last_became_active":"2024-03-04T12:36:07.301706+0000","last_became_peered":"2024-03-04T12:36:07.301706+0000","last_unstale":"2024-03-04T12:59:46.629131+0000","last_undegraded":"2024-03-04T12:59:46.629131+0000","last_fullsized":"2024-03-04T12:59:46.629131+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:39:55.323374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2015,"num_read_kb":1927,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:00.885742+0000","last_change":"2024-03-04T12:35:54.238692+0000","last_active":"2024-03-04T12:58:00.885742+0000","last_peered":"2024-03-04T12:58:00.885742+0000","last_clean":"2024-03-04T12:58:00.885742+0000","last_became_active":"2024-03-04T12:35:54.238351+0000","last_became_peered":"2024-03-04T12:35:54.238351+0000","last_unstale":"2024-03-04T12:58:00.885742+0000","last_undegraded":"2024-03-04T12:58:00.885742+0000","last_fullsized":"2024-03-04T12:58:00.885742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:37.144629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"256'328","reported_seq":992,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.962030+0000","last_change":"2024-03-04T12:36:05.285992+0000","last_active":"2024-03-04T13:00:15.962030+0000","last_peered":"2024-03-04T13:00:15.962030+0000","last_clean":"2024-03-04T13:00:15.962030+0000","last_became_active":"2024-03-04T12:36:05.285659+0000","last_became_peered":"2024-03-04T12:36:05.285659+0000","last_unstale":"2024-03-04T13:00:15.962030+0000","last_undegraded":"2024-03-04T13:00:15.962030+0000","last_fullsized":"2024-03-04T13:00:15.962030+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:45:04.076122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11600186,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":557,"num_read_kb":21915,"num_write":1242,"num_write_kb":32530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:51.000222+0000","last_change":"2024-03-04T12:36:09.314765+0000","last_active":"2024-03-04T12:57:51.000222+0000","last_peered":"2024-03-04T12:57:51.000222+0000","last_clean":"2024-03-04T12:57:51.000222+0000","last_became_active":"2024-03-04T12:36:09.314113+0000","last_became_peered":"2024-03-04T12:36:09.314113+0000","last_unstale":"2024-03-04T12:57:51.000222+0000","last_undegraded":"2024-03-04T12:57:51.000222+0000","last_fullsized":"2024-03-04T12:57:51.000222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:55.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"256'1008","reported_seq":2112,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.879794+0000","last_change":"2024-03-04T12:36:11.323823+0000","last_active":"2024-03-04T13:00:15.879794+0000","last_peered":"2024-03-04T13:00:15.879794+0000","last_clean":"2024-03-04T13:00:15.879794+0000","last_became_active":"2024-03-04T12:36:11.323543+0000","last_became_peered":"2024-03-04T12:36:11.323543+0000","last_unstale":"2024-03-04T13:00:15.879794+0000","last_undegraded":"2024-03-04T13:00:15.879794+0000","last_fullsized":"2024-03-04T13:00:15.879794+0000","mapping_epoch":26,"log_start":"256'900","ondisk_log_start":"256'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":900,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:18.828076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168633,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1588,"num_read_kb":3038,"num_write":960,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.878183+0000","last_change":"2024-03-04T12:36:13.339634+0000","last_active":"2024-03-04T12:57:10.878183+0000","last_peered":"2024-03-04T12:57:10.878183+0000","last_clean":"2024-03-04T12:57:10.878183+0000","last_became_active":"2024-03-04T12:36:13.339353+0000","last_became_peered":"2024-03-04T12:36:13.339353+0000","last_unstale":"2024-03-04T12:57:10.878183+0000","last_undegraded":"2024-03-04T12:57:10.878183+0000","last_fullsized":"2024-03-04T12:57:10.878183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:35.363812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"256'145","reported_seq":632,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:45.918673+0000","last_change":"2024-03-04T12:36:15.346836+0000","last_active":"2024-03-04T12:59:45.918673+0000","last_peered":"2024-03-04T12:59:45.918673+0000","last_clean":"2024-03-04T12:59:45.918673+0000","last_became_active":"2024-03-04T12:36:15.346516+0000","last_became_peered":"2024-03-04T12:36:15.346516+0000","last_unstale":"2024-03-04T12:59:45.918673+0000","last_undegraded":"2024-03-04T12:59:45.918673+0000","last_fullsized":"2024-03-04T12:59:45.918673+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:23:48.979559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":196,"num_read_kb":196,"num_write":318,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"256'397","reported_seq":1866,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.670858+0000","last_change":"2024-03-04T12:36:07.303682+0000","last_active":"2024-03-04T13:00:06.670858+0000","last_peered":"2024-03-04T13:00:06.670858+0000","last_clean":"2024-03-04T13:00:06.670858+0000","last_became_active":"2024-03-04T12:36:07.300039+0000","last_became_peered":"2024-03-04T12:36:07.300039+0000","last_unstale":"2024-03-04T13:00:06.670858+0000","last_undegraded":"2024-03-04T13:00:06.670858+0000","last_fullsized":"2024-03-04T13:00:06.670858+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:24.962188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2349,"num_read_kb":2220,"num_write":468,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":492,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.981094+0000","last_change":"2024-03-04T12:35:54.236078+0000","last_active":"2024-03-04T12:56:45.981094+0000","last_peered":"2024-03-04T12:56:45.981094+0000","last_clean":"2024-03-04T12:56:45.981094+0000","last_became_active":"2024-03-04T12:35:54.235738+0000","last_became_peered":"2024-03-04T12:35:54.235738+0000","last_unstale":"2024-03-04T12:56:45.981094+0000","last_undegraded":"2024-03-04T12:56:45.981094+0000","last_fullsized":"2024-03-04T12:56:45.981094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:36:28.049431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"256'337","reported_seq":1225,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.939543+0000","last_change":"2024-03-04T12:36:05.275101+0000","last_active":"2024-03-04T13:00:15.939543+0000","last_peered":"2024-03-04T13:00:15.939543+0000","last_clean":"2024-03-04T13:00:15.939543+0000","last_became_active":"2024-03-04T12:36:05.274788+0000","last_became_peered":"2024-03-04T12:36:05.274788+0000","last_unstale":"2024-03-04T13:00:15.939543+0000","last_undegraded":"2024-03-04T13:00:15.939543+0000","last_fullsized":"2024-03-04T13:00:15.939543+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:42.330697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9511894,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":1057,"num_read_kb":10802,"num_write":1404,"num_write_kb":39091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.988318+0000","last_change":"2024-03-04T12:36:09.315373+0000","last_active":"2024-03-04T12:57:50.988318+0000","last_peered":"2024-03-04T12:57:50.988318+0000","last_clean":"2024-03-04T12:57:50.988318+0000","last_became_active":"2024-03-04T12:36:09.315023+0000","last_became_peered":"2024-03-04T12:36:09.315023+0000","last_unstale":"2024-03-04T12:57:50.988318+0000","last_undegraded":"2024-03-04T12:57:50.988318+0000","last_fullsized":"2024-03-04T12:57:50.988318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:07:21.105335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"256'188","reported_seq":992,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.829479+0000","last_change":"2024-03-04T12:36:11.955503+0000","last_active":"2024-03-04T13:00:08.829479+0000","last_peered":"2024-03-04T13:00:08.829479+0000","last_clean":"2024-03-04T13:00:08.829479+0000","last_became_active":"2024-03-04T12:36:11.954554+0000","last_became_peered":"2024-03-04T12:36:11.954554+0000","last_unstale":"2024-03-04T13:00:08.829479+0000","last_undegraded":"2024-03-04T13:00:08.829479+0000","last_fullsized":"2024-03-04T13:00:08.829479+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:18:36.129703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:05.997035+0000","last_change":"2024-03-04T12:36:13.338785+0000","last_active":"2024-03-04T12:57:05.997035+0000","last_peered":"2024-03-04T12:57:05.997035+0000","last_clean":"2024-03-04T12:57:05.997035+0000","last_became_active":"2024-03-04T12:36:13.338388+0000","last_became_peered":"2024-03-04T12:36:13.338388+0000","last_unstale":"2024-03-04T12:57:05.997035+0000","last_undegraded":"2024-03-04T12:57:05.997035+0000","last_fullsized":"2024-03-04T12:57:05.997035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:15.536794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'192","reported_seq":682,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:17.459051+0000","last_change":"2024-03-04T12:36:15.354193+0000","last_active":"2024-03-04T12:59:17.459051+0000","last_peered":"2024-03-04T12:59:17.459051+0000","last_clean":"2024-03-04T12:59:17.459051+0000","last_became_active":"2024-03-04T12:36:15.353529+0000","last_became_peered":"2024-03-04T12:36:15.353529+0000","last_unstale":"2024-03-04T12:59:17.459051+0000","last_undegraded":"2024-03-04T12:59:17.459051+0000","last_fullsized":"2024-03-04T12:59:17.459051+0000","mapping_epoch":30,"log_start":"241'100","ondisk_log_start":"241'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:04.219643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":292,"num_read_kb":316,"num_write":426,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"256'393","reported_seq":1822,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671228+0000","last_change":"2024-03-04T12:36:07.299521+0000","last_active":"2024-03-04T13:00:06.671228+0000","last_peered":"2024-03-04T13:00:06.671228+0000","last_clean":"2024-03-04T13:00:06.671228+0000","last_became_active":"2024-03-04T12:36:07.298936+0000","last_became_peered":"2024-03-04T12:36:07.298936+0000","last_unstale":"2024-03-04T13:00:06.671228+0000","last_undegraded":"2024-03-04T13:00:06.671228+0000","last_fullsized":"2024-03-04T13:00:06.671228+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:42:23.027185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2152,"num_read_kb":2018,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.989215+0000","last_change":"2024-03-04T12:35:54.238657+0000","last_active":"2024-03-04T12:56:45.989215+0000","last_peered":"2024-03-04T12:56:45.989215+0000","last_clean":"2024-03-04T12:56:45.989215+0000","last_became_active":"2024-03-04T12:35:54.238357+0000","last_became_peered":"2024-03-04T12:35:54.238357+0000","last_unstale":"2024-03-04T12:56:45.989215+0000","last_undegraded":"2024-03-04T12:56:45.989215+0000","last_fullsized":"2024-03-04T12:56:45.989215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:33:05.241037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"256'289","reported_seq":937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.937621+0000","last_change":"2024-03-04T12:36:05.289667+0000","last_active":"2024-03-04T13:00:15.937621+0000","last_peered":"2024-03-04T13:00:15.937621+0000","last_clean":"2024-03-04T13:00:15.937621+0000","last_became_active":"2024-03-04T12:36:05.289374+0000","last_became_peered":"2024-03-04T12:36:05.289374+0000","last_unstale":"2024-03-04T13:00:15.937621+0000","last_undegraded":"2024-03-04T13:00:15.937621+0000","last_fullsized":"2024-03-04T13:00:15.937621+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:40:44.869761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10396162,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":493,"num_read_kb":54490,"num_write":1239,"num_write_kb":39662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996409+0000","last_change":"2024-03-04T12:36:09.304779+0000","last_active":"2024-03-04T12:57:00.996409+0000","last_peered":"2024-03-04T12:57:00.996409+0000","last_clean":"2024-03-04T12:57:00.996409+0000","last_became_active":"2024-03-04T12:36:09.304291+0000","last_became_peered":"2024-03-04T12:36:09.304291+0000","last_unstale":"2024-03-04T12:57:00.996409+0000","last_undegraded":"2024-03-04T12:57:00.996409+0000","last_fullsized":"2024-03-04T12:57:00.996409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:49.161718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"256'81","reported_seq":586,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:12.360275+0000","last_change":"2024-03-04T12:36:11.326239+0000","last_active":"2024-03-04T12:59:12.360275+0000","last_peered":"2024-03-04T12:59:12.360275+0000","last_clean":"2024-03-04T12:59:12.360275+0000","last_became_active":"2024-03-04T12:36:11.325957+0000","last_became_peered":"2024-03-04T12:36:11.325957+0000","last_unstale":"2024-03-04T12:59:12.360275+0000","last_undegraded":"2024-03-04T12:59:12.360275+0000","last_fullsized":"2024-03-04T12:59:12.360275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:45:15.387282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":66,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":466,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.993163+0000","last_change":"2024-03-04T12:36:13.345759+0000","last_active":"2024-03-04T12:57:55.993163+0000","last_peered":"2024-03-04T12:57:55.993163+0000","last_clean":"2024-03-04T12:57:55.993163+0000","last_became_active":"2024-03-04T12:36:13.345547+0000","last_became_peered":"2024-03-04T12:36:13.345547+0000","last_unstale":"2024-03-04T12:57:55.993163+0000","last_undegraded":"2024-03-04T12:57:55.993163+0000","last_fullsized":"2024-03-04T12:57:55.993163+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:20.602726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"256'111","reported_seq":598,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:17.289185+0000","last_change":"2024-03-04T12:36:15.363530+0000","last_active":"2024-03-04T12:59:17.289185+0000","last_peered":"2024-03-04T12:59:17.289185+0000","last_clean":"2024-03-04T12:59:17.289185+0000","last_became_active":"2024-03-04T12:36:15.363185+0000","last_became_peered":"2024-03-04T12:36:15.363185+0000","last_unstale":"2024-03-04T12:59:17.289185+0000","last_undegraded":"2024-03-04T12:59:17.289185+0000","last_fullsized":"2024-03-04T12:59:17.289185+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:16.150410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":251,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"256'464","reported_seq":2007,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.027056+0000","last_change":"2024-03-04T12:36:07.297241+0000","last_active":"2024-03-04T12:59:56.027056+0000","last_peered":"2024-03-04T12:59:56.027056+0000","last_clean":"2024-03-04T12:59:56.027056+0000","last_became_active":"2024-03-04T12:36:07.296433+0000","last_became_peered":"2024-03-04T12:36:07.296433+0000","last_unstale":"2024-03-04T12:59:56.027056+0000","last_undegraded":"2024-03-04T12:59:56.027056+0000","last_fullsized":"2024-03-04T12:59:56.027056+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:57:02.539909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2396,"num_read_kb":2259,"num_write":579,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"256'350","reported_seq":1003,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.997751+0000","last_change":"2024-03-04T12:36:40.965648+0000","last_active":"2024-03-04T13:00:15.997751+0000","last_peered":"2024-03-04T13:00:15.997751+0000","last_clean":"2024-03-04T13:00:15.997751+0000","last_became_active":"2024-03-04T12:36:40.965346+0000","last_became_peered":"2024-03-04T12:36:40.965346+0000","last_unstale":"2024-03-04T13:00:15.997751+0000","last_undegraded":"2024-03-04T13:00:15.997751+0000","last_fullsized":"2024-03-04T13:00:15.997751+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:34.208423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6319328,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":575,"num_read_kb":48879,"num_write":1423,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.977490+0000","last_change":"2024-03-04T12:35:54.470673+0000","last_active":"2024-03-04T12:56:45.977490+0000","last_peered":"2024-03-04T12:56:45.977490+0000","last_clean":"2024-03-04T12:56:45.977490+0000","last_became_active":"2024-03-04T12:35:54.470407+0000","last_became_peered":"2024-03-04T12:35:54.470407+0000","last_unstale":"2024-03-04T12:56:45.977490+0000","last_undegraded":"2024-03-04T12:56:45.977490+0000","last_fullsized":"2024-03-04T12:56:45.977490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:30:21.008474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996381+0000","last_change":"2024-03-04T12:36:09.308620+0000","last_active":"2024-03-04T12:57:00.996381+0000","last_peered":"2024-03-04T12:57:00.996381+0000","last_clean":"2024-03-04T12:57:00.996381+0000","last_became_active":"2024-03-04T12:36:09.308360+0000","last_became_peered":"2024-03-04T12:36:09.308360+0000","last_unstale":"2024-03-04T12:57:00.996381+0000","last_undegraded":"2024-03-04T12:57:00.996381+0000","last_fullsized":"2024-03-04T12:57:00.996381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:12:02.956921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"256'484","reported_seq":1103,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.807353+0000","last_change":"2024-03-04T12:36:11.329225+0000","last_active":"2024-03-04T13:00:15.807353+0000","last_peered":"2024-03-04T13:00:15.807353+0000","last_clean":"2024-03-04T13:00:15.807353+0000","last_became_active":"2024-03-04T12:36:11.328923+0000","last_became_peered":"2024-03-04T12:36:11.328923+0000","last_unstale":"2024-03-04T13:00:15.807353+0000","last_undegraded":"2024-03-04T13:00:15.807353+0000","last_fullsized":"2024-03-04T13:00:15.807353+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:50.151006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":830,"num_read_kb":1802,"num_write":674,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:05.992670+0000","last_change":"2024-03-04T12:36:13.347228+0000","last_active":"2024-03-04T12:57:05.992670+0000","last_peered":"2024-03-04T12:57:05.992670+0000","last_clean":"2024-03-04T12:57:05.992670+0000","last_became_active":"2024-03-04T12:36:13.346886+0000","last_became_peered":"2024-03-04T12:36:13.346886+0000","last_unstale":"2024-03-04T12:57:05.992670+0000","last_undegraded":"2024-03-04T12:57:05.992670+0000","last_fullsized":"2024-03-04T12:57:05.992670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:14.642237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"256'94","reported_seq":573,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.020901+0000","last_change":"2024-03-04T12:36:15.350589+0000","last_active":"2024-03-04T12:59:56.020901+0000","last_peered":"2024-03-04T12:59:56.020901+0000","last_clean":"2024-03-04T12:59:56.020901+0000","last_became_active":"2024-03-04T12:36:15.350185+0000","last_became_peered":"2024-03-04T12:36:15.350185+0000","last_unstale":"2024-03-04T12:59:56.020901+0000","last_undegraded":"2024-03-04T12:59:56.020901+0000","last_fullsized":"2024-03-04T12:59:56.020901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:06:50.695793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":228,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"256'646","reported_seq":2008,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.609894+0000","last_change":"2024-03-04T12:36:07.296955+0000","last_active":"2024-03-04T12:59:47.609894+0000","last_peered":"2024-03-04T12:59:47.609894+0000","last_clean":"2024-03-04T12:59:47.609894+0000","last_became_active":"2024-03-04T12:36:07.296657+0000","last_became_peered":"2024-03-04T12:36:07.296657+0000","last_unstale":"2024-03-04T12:59:47.609894+0000","last_undegraded":"2024-03-04T12:59:47.609894+0000","last_fullsized":"2024-03-04T12:59:47.609894+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":600,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:09.500092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3068,"num_read_kb":2828,"num_write":988,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"256'311","reported_seq":984,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.890225+0000","last_change":"2024-03-04T12:36:05.275545+0000","last_active":"2024-03-04T13:00:15.890225+0000","last_peered":"2024-03-04T13:00:15.890225+0000","last_clean":"2024-03-04T13:00:15.890225+0000","last_became_active":"2024-03-04T12:36:05.275263+0000","last_became_peered":"2024-03-04T12:36:05.275263+0000","last_unstale":"2024-03-04T13:00:15.890225+0000","last_undegraded":"2024-03-04T13:00:15.890225+0000","last_fullsized":"2024-03-04T13:00:15.890225+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:05.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14025863,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":601,"num_read_kb":62539,"num_write":1399,"num_write_kb":42561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":492,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:50.875403+0000","last_change":"2024-03-04T12:35:54.470913+0000","last_active":"2024-03-04T12:56:50.875403+0000","last_peered":"2024-03-04T12:56:50.875403+0000","last_clean":"2024-03-04T12:56:50.875403+0000","last_became_active":"2024-03-04T12:35:54.470620+0000","last_became_peered":"2024-03-04T12:35:54.470620+0000","last_unstale":"2024-03-04T12:56:50.875403+0000","last_undegraded":"2024-03-04T12:56:50.875403+0000","last_fullsized":"2024-03-04T12:56:50.875403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:00.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.985543+0000","last_change":"2024-03-04T12:36:09.312394+0000","last_active":"2024-03-04T12:57:00.985543+0000","last_peered":"2024-03-04T12:57:00.985543+0000","last_clean":"2024-03-04T12:57:00.985543+0000","last_became_active":"2024-03-04T12:36:09.312135+0000","last_became_peered":"2024-03-04T12:36:09.312135+0000","last_unstale":"2024-03-04T12:57:00.985543+0000","last_undegraded":"2024-03-04T12:57:00.985543+0000","last_fullsized":"2024-03-04T12:57:00.985543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:40:59.354604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"256'139","reported_seq":665,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.644974+0000","last_change":"2024-03-04T12:36:11.954977+0000","last_active":"2024-03-04T12:59:48.644974+0000","last_peered":"2024-03-04T12:59:48.644974+0000","last_clean":"2024-03-04T12:59:48.644974+0000","last_became_active":"2024-03-04T12:36:11.954579+0000","last_became_peered":"2024-03-04T12:36:11.954579+0000","last_unstale":"2024-03-04T12:59:48.644974+0000","last_undegraded":"2024-03-04T12:59:48.644974+0000","last_fullsized":"2024-03-04T12:59:48.644974+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:39.654798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":130,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"256'544","reported_seq":4062,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.236192+0000","last_change":"2024-03-04T12:36:13.342293+0000","last_active":"2024-03-04T13:00:15.236192+0000","last_peered":"2024-03-04T13:00:15.236192+0000","last_clean":"2024-03-04T13:00:15.236192+0000","last_became_active":"2024-03-04T12:36:13.341957+0000","last_became_peered":"2024-03-04T12:36:13.341957+0000","last_unstale":"2024-03-04T13:00:15.236192+0000","last_undegraded":"2024-03-04T13:00:15.236192+0000","last_fullsized":"2024-03-04T13:00:15.236192+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:06.453055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"256'123","reported_seq":596,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.050692+0000","last_change":"2024-03-04T12:36:15.355664+0000","last_active":"2024-03-04T12:59:53.050692+0000","last_peered":"2024-03-04T12:59:53.050692+0000","last_clean":"2024-03-04T12:59:53.050692+0000","last_became_active":"2024-03-04T12:36:15.355291+0000","last_became_peered":"2024-03-04T12:36:15.355291+0000","last_unstale":"2024-03-04T12:59:53.050692+0000","last_undegraded":"2024-03-04T12:59:53.050692+0000","last_fullsized":"2024-03-04T12:59:53.050692+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:08.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"256'743","reported_seq":2161,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.045676+0000","last_change":"2024-03-04T12:36:07.290212+0000","last_active":"2024-03-04T12:59:53.045676+0000","last_peered":"2024-03-04T12:59:53.045676+0000","last_clean":"2024-03-04T12:59:53.045676+0000","last_became_active":"2024-03-04T12:36:07.289884+0000","last_became_peered":"2024-03-04T12:36:07.289884+0000","last_unstale":"2024-03-04T12:59:53.045676+0000","last_undegraded":"2024-03-04T12:59:53.045676+0000","last_fullsized":"2024-03-04T12:59:53.045676+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:07.678104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3351,"num_read_kb":2980,"num_write":997,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"256'280","reported_seq":886,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.946811+0000","last_change":"2024-03-04T12:36:05.291839+0000","last_active":"2024-03-04T13:00:15.946811+0000","last_peered":"2024-03-04T13:00:15.946811+0000","last_clean":"2024-03-04T13:00:15.946811+0000","last_became_active":"2024-03-04T12:36:05.291549+0000","last_became_peered":"2024-03-04T12:36:05.291549+0000","last_unstale":"2024-03-04T13:00:15.946811+0000","last_undegraded":"2024-03-04T13:00:15.946811+0000","last_fullsized":"2024-03-04T13:00:15.946811+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:39.785480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9454214,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":408,"num_read_kb":36332,"num_write":1088,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:35.983734+0000","last_change":"2024-03-04T12:35:54.239060+0000","last_active":"2024-03-04T12:57:35.983734+0000","last_peered":"2024-03-04T12:57:35.983734+0000","last_clean":"2024-03-04T12:57:35.983734+0000","last_became_active":"2024-03-04T12:35:54.238802+0000","last_became_peered":"2024-03-04T12:35:54.238802+0000","last_unstale":"2024-03-04T12:57:35.983734+0000","last_undegraded":"2024-03-04T12:57:35.983734+0000","last_fullsized":"2024-03-04T12:57:35.983734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:29.643511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991892+0000","last_change":"2024-03-04T12:36:09.307816+0000","last_active":"2024-03-04T12:57:00.991892+0000","last_peered":"2024-03-04T12:57:00.991892+0000","last_clean":"2024-03-04T12:57:00.991892+0000","last_became_active":"2024-03-04T12:36:09.307467+0000","last_became_peered":"2024-03-04T12:36:09.307467+0000","last_unstale":"2024-03-04T12:57:00.991892+0000","last_undegraded":"2024-03-04T12:57:00.991892+0000","last_fullsized":"2024-03-04T12:57:00.991892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:30:08.145067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"256'78","reported_seq":585,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:34.753384+0000","last_change":"2024-03-04T12:36:11.326288+0000","last_active":"2024-03-04T12:58:34.753384+0000","last_peered":"2024-03-04T12:58:34.753384+0000","last_clean":"2024-03-04T12:58:34.753384+0000","last_became_active":"2024-03-04T12:36:11.325955+0000","last_became_peered":"2024-03-04T12:36:11.325955+0000","last_unstale":"2024-03-04T12:58:34.753384+0000","last_undegraded":"2024-03-04T12:58:34.753384+0000","last_fullsized":"2024-03-04T12:58:34.753384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:39:41.658332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"256'533","reported_seq":1565,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.239222+0000","last_change":"2024-03-04T12:36:13.349703+0000","last_active":"2024-03-04T13:00:15.239222+0000","last_peered":"2024-03-04T13:00:15.239222+0000","last_clean":"2024-03-04T13:00:15.239222+0000","last_became_active":"2024-03-04T12:36:13.349421+0000","last_became_peered":"2024-03-04T12:36:13.349421+0000","last_unstale":"2024-03-04T13:00:15.239222+0000","last_undegraded":"2024-03-04T13:00:15.239222+0000","last_fullsized":"2024-03-04T13:00:15.239222+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:52:42.138224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"256'96","reported_seq":565,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.767846+0000","last_change":"2024-03-04T12:36:15.356492+0000","last_active":"2024-03-04T12:59:50.767846+0000","last_peered":"2024-03-04T12:59:50.767846+0000","last_clean":"2024-03-04T12:59:50.767846+0000","last_became_active":"2024-03-04T12:36:15.356192+0000","last_became_peered":"2024-03-04T12:36:15.356192+0000","last_unstale":"2024-03-04T12:59:50.767846+0000","last_undegraded":"2024-03-04T12:59:50.767846+0000","last_fullsized":"2024-03-04T12:59:50.767846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:15:40.455972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":232,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"256'390","reported_seq":1911,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.017107+0000","last_change":"2024-03-04T12:36:07.299701+0000","last_active":"2024-03-04T12:59:54.017107+0000","last_peered":"2024-03-04T12:59:54.017107+0000","last_clean":"2024-03-04T12:59:54.017107+0000","last_became_active":"2024-03-04T12:36:07.298963+0000","last_became_peered":"2024-03-04T12:36:07.298963+0000","last_unstale":"2024-03-04T12:59:54.017107+0000","last_undegraded":"2024-03-04T12:59:54.017107+0000","last_fullsized":"2024-03-04T12:59:54.017107+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:26.582084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2139,"num_write":463,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"256'288","reported_seq":898,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.013530+0000","last_change":"2024-03-04T12:36:05.282071+0000","last_active":"2024-03-04T13:00:16.013530+0000","last_peered":"2024-03-04T13:00:16.013530+0000","last_clean":"2024-03-04T13:00:16.013530+0000","last_became_active":"2024-03-04T12:36:05.281790+0000","last_became_peered":"2024-03-04T12:36:05.281790+0000","last_unstale":"2024-03-04T13:00:16.013530+0000","last_undegraded":"2024-03-04T13:00:16.013530+0000","last_fullsized":"2024-03-04T13:00:16.013530+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:07.529352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1779838,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":425,"num_read_kb":33441,"num_write":1152,"num_write_kb":31732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":488,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:35.990462+0000","last_change":"2024-03-04T12:35:54.239095+0000","last_active":"2024-03-04T12:57:35.990462+0000","last_peered":"2024-03-04T12:57:35.990462+0000","last_clean":"2024-03-04T12:57:35.990462+0000","last_became_active":"2024-03-04T12:35:54.238580+0000","last_became_peered":"2024-03-04T12:35:54.238580+0000","last_unstale":"2024-03-04T12:57:35.990462+0000","last_undegraded":"2024-03-04T12:57:35.990462+0000","last_fullsized":"2024-03-04T12:57:35.990462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:51.568234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:10.988802+0000","last_change":"2024-03-04T12:36:09.308483+0000","last_active":"2024-03-04T12:58:10.988802+0000","last_peered":"2024-03-04T12:58:10.988802+0000","last_clean":"2024-03-04T12:58:10.988802+0000","last_became_active":"2024-03-04T12:36:09.308162+0000","last_became_peered":"2024-03-04T12:36:09.308162+0000","last_unstale":"2024-03-04T12:58:10.988802+0000","last_undegraded":"2024-03-04T12:58:10.988802+0000","last_fullsized":"2024-03-04T12:58:10.988802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:27.690789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"256'696","reported_seq":1373,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.607555+0000","last_change":"2024-03-04T12:36:11.955174+0000","last_active":"2024-03-04T13:00:15.607555+0000","last_peered":"2024-03-04T13:00:15.607555+0000","last_clean":"2024-03-04T13:00:15.607555+0000","last_became_active":"2024-03-04T12:36:11.954569+0000","last_became_peered":"2024-03-04T12:36:11.954569+0000","last_unstale":"2024-03-04T13:00:15.607555+0000","last_undegraded":"2024-03-04T13:00:15.607555+0000","last_fullsized":"2024-03-04T13:00:15.607555+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:12.036941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161442,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1251,"num_read_kb":2835,"num_write":1034,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:05.980274+0000","last_change":"2024-03-04T12:36:13.346191+0000","last_active":"2024-03-04T12:57:05.980274+0000","last_peered":"2024-03-04T12:57:05.980274+0000","last_clean":"2024-03-04T12:57:05.980274+0000","last_became_active":"2024-03-04T12:36:13.345919+0000","last_became_peered":"2024-03-04T12:36:13.345919+0000","last_unstale":"2024-03-04T12:57:05.980274+0000","last_undegraded":"2024-03-04T12:57:05.980274+0000","last_fullsized":"2024-03-04T12:57:05.980274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:25.153970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"256'128","reported_seq":591,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:40.768192+0000","last_change":"2024-03-04T12:36:15.363169+0000","last_active":"2024-03-04T12:59:40.768192+0000","last_peered":"2024-03-04T12:59:40.768192+0000","last_clean":"2024-03-04T12:59:40.768192+0000","last_became_active":"2024-03-04T12:36:15.362710+0000","last_became_peered":"2024-03-04T12:36:15.362710+0000","last_unstale":"2024-03-04T12:59:40.768192+0000","last_undegraded":"2024-03-04T12:59:40.768192+0000","last_fullsized":"2024-03-04T12:59:40.768192+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:18:23.671452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"256'110","reported_seq":571,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.681038+0000","last_change":"2024-03-04T12:36:15.363367+0000","last_active":"2024-03-04T13:00:06.681038+0000","last_peered":"2024-03-04T13:00:06.681038+0000","last_clean":"2024-03-04T13:00:06.681038+0000","last_became_active":"2024-03-04T12:36:15.363057+0000","last_became_peered":"2024-03-04T12:36:15.363057+0000","last_unstale":"2024-03-04T13:00:06.681038+0000","last_undegraded":"2024-03-04T13:00:06.681038+0000","last_fullsized":"2024-03-04T13:00:06.681038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:35.204210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":263,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"256'521","reported_seq":2070,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:45.901603+0000","last_change":"2024-03-04T12:36:07.294876+0000","last_active":"2024-03-04T12:59:45.901603+0000","last_peered":"2024-03-04T12:59:45.901603+0000","last_clean":"2024-03-04T12:59:45.901603+0000","last_became_active":"2024-03-04T12:36:07.292930+0000","last_became_peered":"2024-03-04T12:36:07.292930+0000","last_unstale":"2024-03-04T12:59:45.901603+0000","last_undegraded":"2024-03-04T12:59:45.901603+0000","last_fullsized":"2024-03-04T12:59:45.901603+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:15:17.193064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2723,"num_read_kb":2502,"num_write":698,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"256'284","reported_seq":920,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.974266+0000","last_change":"2024-03-04T12:36:05.287586+0000","last_active":"2024-03-04T13:00:15.974266+0000","last_peered":"2024-03-04T13:00:15.974266+0000","last_clean":"2024-03-04T13:00:15.974266+0000","last_became_active":"2024-03-04T12:36:05.287299+0000","last_became_peered":"2024-03-04T12:36:05.287299+0000","last_unstale":"2024-03-04T13:00:15.974266+0000","last_undegraded":"2024-03-04T13:00:15.974266+0000","last_fullsized":"2024-03-04T13:00:15.974266+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:40.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3828104,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":463,"num_read_kb":31884,"num_write":1224,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"32'3","reported_seq":788,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.206991+0000","last_change":"2024-03-04T12:36:09.315302+0000","last_active":"2024-03-04T13:00:15.206991+0000","last_peered":"2024-03-04T13:00:15.206991+0000","last_clean":"2024-03-04T13:00:15.206991+0000","last_became_active":"2024-03-04T12:36:09.314810+0000","last_became_peered":"2024-03-04T12:36:09.314810+0000","last_unstale":"2024-03-04T13:00:15.206991+0000","last_undegraded":"2024-03-04T13:00:15.206991+0000","last_fullsized":"2024-03-04T13:00:15.206991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:17:00.218822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"256'241","reported_seq":780,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.684756+0000","last_change":"2024-03-04T12:36:11.324996+0000","last_active":"2024-03-04T13:00:08.684756+0000","last_peered":"2024-03-04T13:00:08.684756+0000","last_clean":"2024-03-04T13:00:08.684756+0000","last_became_active":"2024-03-04T12:36:11.323046+0000","last_became_peered":"2024-03-04T12:36:11.323046+0000","last_unstale":"2024-03-04T13:00:08.684756+0000","last_undegraded":"2024-03-04T13:00:08.684756+0000","last_fullsized":"2024-03-04T13:00:08.684756+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:10:29.009516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":394,"num_read_kb":838,"num_write":324,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":467,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.981601+0000","last_change":"2024-03-04T12:36:13.349171+0000","last_active":"2024-03-04T12:57:15.981601+0000","last_peered":"2024-03-04T12:57:15.981601+0000","last_clean":"2024-03-04T12:57:15.981601+0000","last_became_active":"2024-03-04T12:36:13.348696+0000","last_became_peered":"2024-03-04T12:36:13.348696+0000","last_unstale":"2024-03-04T12:57:15.981601+0000","last_undegraded":"2024-03-04T12:57:15.981601+0000","last_fullsized":"2024-03-04T12:57:15.981601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:01:19.715486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"256'83","reported_seq":554,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:20.071261+0000","last_change":"2024-03-04T12:36:15.354645+0000","last_active":"2024-03-04T12:59:20.071261+0000","last_peered":"2024-03-04T12:59:20.071261+0000","last_clean":"2024-03-04T12:59:20.071261+0000","last_became_active":"2024-03-04T12:36:15.354258+0000","last_became_peered":"2024-03-04T12:36:15.354258+0000","last_unstale":"2024-03-04T12:59:20.071261+0000","last_undegraded":"2024-03-04T12:59:20.071261+0000","last_fullsized":"2024-03-04T12:59:20.071261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:30.504574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":75,"num_write":188,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"256'355","reported_seq":1704,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.956805+0000","last_change":"2024-03-04T12:36:07.296187+0000","last_active":"2024-03-04T13:00:06.956805+0000","last_peered":"2024-03-04T13:00:06.956805+0000","last_clean":"2024-03-04T13:00:06.956805+0000","last_became_active":"2024-03-04T12:36:07.295803+0000","last_became_peered":"2024-03-04T12:36:07.295803+0000","last_unstale":"2024-03-04T13:00:06.956805+0000","last_undegraded":"2024-03-04T13:00:06.956805+0000","last_fullsized":"2024-03-04T13:00:06.956805+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:19:02.700056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1867,"num_read_kb":1777,"num_write":399,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"256'289","reported_seq":904,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.902010+0000","last_change":"2024-03-04T12:36:05.296316+0000","last_active":"2024-03-04T13:00:15.902010+0000","last_peered":"2024-03-04T13:00:15.902010+0000","last_clean":"2024-03-04T13:00:15.902010+0000","last_became_active":"2024-03-04T12:36:05.296032+0000","last_became_peered":"2024-03-04T12:36:05.296032+0000","last_unstale":"2024-03-04T13:00:15.902010+0000","last_undegraded":"2024-03-04T13:00:15.902010+0000","last_fullsized":"2024-03-04T13:00:15.902010+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:48:22.903820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4590334,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":441,"num_read_kb":28471,"num_write":1095,"num_write_kb":37420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.980941+0000","last_change":"2024-03-04T12:36:09.312289+0000","last_active":"2024-03-04T12:57:10.980941+0000","last_peered":"2024-03-04T12:57:10.980941+0000","last_clean":"2024-03-04T12:57:10.980941+0000","last_became_active":"2024-03-04T12:36:09.311953+0000","last_became_peered":"2024-03-04T12:36:09.311953+0000","last_unstale":"2024-03-04T12:57:10.980941+0000","last_undegraded":"2024-03-04T12:57:10.980941+0000","last_fullsized":"2024-03-04T12:57:10.980941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:21:39.688491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"256'31","reported_seq":504,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.950097+0000","last_change":"2024-03-04T12:36:11.326600+0000","last_active":"2024-03-04T12:58:30.950097+0000","last_peered":"2024-03-04T12:58:30.950097+0000","last_clean":"2024-03-04T12:58:30.950097+0000","last_became_active":"2024-03-04T12:36:11.326313+0000","last_became_peered":"2024-03-04T12:36:11.326313+0000","last_unstale":"2024-03-04T12:58:30.950097+0000","last_undegraded":"2024-03-04T12:58:30.950097+0000","last_fullsized":"2024-03-04T12:58:30.950097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:52.781748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":469,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.878921+0000","last_change":"2024-03-04T12:36:13.340743+0000","last_active":"2024-03-04T12:57:15.878921+0000","last_peered":"2024-03-04T12:57:15.878921+0000","last_clean":"2024-03-04T12:57:15.878921+0000","last_became_active":"2024-03-04T12:36:13.340203+0000","last_became_peered":"2024-03-04T12:36:13.340203+0000","last_unstale":"2024-03-04T12:57:15.878921+0000","last_undegraded":"2024-03-04T12:57:15.878921+0000","last_fullsized":"2024-03-04T12:57:15.878921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:09:09.659186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"256'90","reported_seq":564,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:47.266263+0000","last_change":"2024-03-04T12:36:15.353818+0000","last_active":"2024-03-04T12:58:47.266263+0000","last_peered":"2024-03-04T12:58:47.266263+0000","last_clean":"2024-03-04T12:58:47.266263+0000","last_became_active":"2024-03-04T12:36:15.353545+0000","last_became_peered":"2024-03-04T12:36:15.353545+0000","last_unstale":"2024-03-04T12:58:47.266263+0000","last_undegraded":"2024-03-04T12:58:47.266263+0000","last_fullsized":"2024-03-04T12:58:47.266263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:10.906970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":106,"num_write":213,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"256'994","reported_seq":2543,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.899888+0000","last_change":"2024-03-04T12:36:07.300137+0000","last_active":"2024-03-04T12:59:54.899888+0000","last_peered":"2024-03-04T12:59:54.899888+0000","last_clean":"2024-03-04T12:59:54.899888+0000","last_became_active":"2024-03-04T12:36:07.299326+0000","last_became_peered":"2024-03-04T12:36:07.299326+0000","last_unstale":"2024-03-04T12:59:54.899888+0000","last_undegraded":"2024-03-04T12:59:54.899888+0000","last_fullsized":"2024-03-04T12:59:54.899888+0000","mapping_epoch":22,"log_start":"256'900","ondisk_log_start":"256'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:59:41.402010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4343,"num_read_kb":3801,"num_write":1436,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"256'280","reported_seq":918,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.900172+0000","last_change":"2024-03-04T12:36:05.287491+0000","last_active":"2024-03-04T13:00:15.900172+0000","last_peered":"2024-03-04T13:00:15.900172+0000","last_clean":"2024-03-04T13:00:15.900172+0000","last_became_active":"2024-03-04T12:36:05.287185+0000","last_became_peered":"2024-03-04T12:36:05.287185+0000","last_unstale":"2024-03-04T13:00:15.900172+0000","last_undegraded":"2024-03-04T13:00:15.900172+0000","last_fullsized":"2024-03-04T13:00:15.900172+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:44.742710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2801863,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":486,"num_read_kb":7343,"num_write":1141,"num_write_kb":36636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.878079+0000","last_change":"2024-03-04T12:36:09.305577+0000","last_active":"2024-03-04T12:57:10.878079+0000","last_peered":"2024-03-04T12:57:10.878079+0000","last_clean":"2024-03-04T12:57:10.878079+0000","last_became_active":"2024-03-04T12:36:09.305288+0000","last_became_peered":"2024-03-04T12:36:09.305288+0000","last_unstale":"2024-03-04T12:57:10.878079+0000","last_undegraded":"2024-03-04T12:57:10.878079+0000","last_fullsized":"2024-03-04T12:57:10.878079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:02.570493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"256'291","reported_seq":850,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.684298+0000","last_change":"2024-03-04T12:36:11.325238+0000","last_active":"2024-03-04T13:00:15.684298+0000","last_peered":"2024-03-04T13:00:15.684298+0000","last_clean":"2024-03-04T13:00:15.684298+0000","last_became_active":"2024-03-04T12:36:11.324758+0000","last_became_peered":"2024-03-04T12:36:11.324758+0000","last_unstale":"2024-03-04T13:00:15.684298+0000","last_undegraded":"2024-03-04T13:00:15.684298+0000","last_fullsized":"2024-03-04T13:00:15.684298+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:41:09.027646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":483,"num_read_kb":1065,"num_write":390,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.987790+0000","last_change":"2024-03-04T12:36:13.345775+0000","last_active":"2024-03-04T12:57:15.987790+0000","last_peered":"2024-03-04T12:57:15.987790+0000","last_clean":"2024-03-04T12:57:15.987790+0000","last_became_active":"2024-03-04T12:36:13.345556+0000","last_became_peered":"2024-03-04T12:36:13.345556+0000","last_unstale":"2024-03-04T12:57:15.987790+0000","last_undegraded":"2024-03-04T12:57:15.987790+0000","last_fullsized":"2024-03-04T12:57:15.987790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:08.155061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"256'172","reported_seq":658,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:44.896942+0000","last_change":"2024-03-04T12:36:15.363805+0000","last_active":"2024-03-04T12:59:44.896942+0000","last_peered":"2024-03-04T12:59:44.896942+0000","last_clean":"2024-03-04T12:59:44.896942+0000","last_became_active":"2024-03-04T12:36:15.363544+0000","last_became_peered":"2024-03-04T12:36:15.363544+0000","last_unstale":"2024-03-04T12:59:44.896942+0000","last_undegraded":"2024-03-04T12:59:44.896942+0000","last_fullsized":"2024-03-04T12:59:44.896942+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:22:01.710579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":198,"num_write":386,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"256'401","reported_seq":1833,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.674646+0000","last_change":"2024-03-04T12:36:07.293124+0000","last_active":"2024-03-04T13:00:06.674646+0000","last_peered":"2024-03-04T13:00:06.674646+0000","last_clean":"2024-03-04T13:00:06.674646+0000","last_became_active":"2024-03-04T12:36:07.292814+0000","last_became_peered":"2024-03-04T12:36:07.292814+0000","last_unstale":"2024-03-04T13:00:06.674646+0000","last_undegraded":"2024-03-04T13:00:06.674646+0000","last_fullsized":"2024-03-04T13:00:06.674646+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:39.960903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2067,"num_read_kb":1953,"num_write":480,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"256'275","reported_seq":869,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.969508+0000","last_change":"2024-03-04T12:36:40.965263+0000","last_active":"2024-03-04T13:00:15.969508+0000","last_peered":"2024-03-04T13:00:15.969508+0000","last_clean":"2024-03-04T13:00:15.969508+0000","last_became_active":"2024-03-04T12:36:40.964989+0000","last_became_peered":"2024-03-04T12:36:40.964989+0000","last_unstale":"2024-03-04T13:00:15.969508+0000","last_undegraded":"2024-03-04T13:00:15.969508+0000","last_fullsized":"2024-03-04T13:00:15.969508+0000","mapping_epoch":33,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:02:05.061569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343052,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":408,"num_read_kb":22171,"num_write":1146,"num_write_kb":35457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.987012+0000","last_change":"2024-03-04T12:36:09.310197+0000","last_active":"2024-03-04T12:57:10.987012+0000","last_peered":"2024-03-04T12:57:10.987012+0000","last_clean":"2024-03-04T12:57:10.987012+0000","last_became_active":"2024-03-04T12:36:09.309883+0000","last_became_peered":"2024-03-04T12:36:09.309883+0000","last_unstale":"2024-03-04T12:57:10.987012+0000","last_undegraded":"2024-03-04T12:57:10.987012+0000","last_fullsized":"2024-03-04T12:57:10.987012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:50.413280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"256'252","reported_seq":795,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.482392+0000","last_change":"2024-03-04T12:36:11.325094+0000","last_active":"2024-03-04T13:00:15.482392+0000","last_peered":"2024-03-04T13:00:15.482392+0000","last_clean":"2024-03-04T13:00:15.482392+0000","last_became_active":"2024-03-04T12:36:11.324784+0000","last_became_peered":"2024-03-04T12:36:11.324784+0000","last_unstale":"2024-03-04T13:00:15.482392+0000","last_undegraded":"2024-03-04T13:00:15.482392+0000","last_fullsized":"2024-03-04T13:00:15.482392+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:27:03.628739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54138,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":1067,"num_write":352,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":463,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998151+0000","last_change":"2024-03-04T12:36:13.343536+0000","last_active":"2024-03-04T12:57:15.998151+0000","last_peered":"2024-03-04T12:57:15.998151+0000","last_clean":"2024-03-04T12:57:15.998151+0000","last_became_active":"2024-03-04T12:36:13.343030+0000","last_became_peered":"2024-03-04T12:36:13.343030+0000","last_unstale":"2024-03-04T12:57:15.998151+0000","last_undegraded":"2024-03-04T12:57:15.998151+0000","last_fullsized":"2024-03-04T12:57:15.998151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.616451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"256'687","reported_seq":2134,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.015184+0000","last_change":"2024-03-04T12:36:07.298429+0000","last_active":"2024-03-04T12:59:56.015184+0000","last_peered":"2024-03-04T12:59:56.015184+0000","last_clean":"2024-03-04T12:59:56.015184+0000","last_became_active":"2024-03-04T12:36:07.298154+0000","last_became_peered":"2024-03-04T12:36:07.298154+0000","last_unstale":"2024-03-04T12:59:56.015184+0000","last_undegraded":"2024-03-04T12:59:56.015184+0000","last_fullsized":"2024-03-04T12:59:56.015184+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":600,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:51:00.776425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3209,"num_read_kb":2902,"num_write":904,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"256'272","reported_seq":974,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.966882+0000","last_change":"2024-03-04T12:36:05.287614+0000","last_active":"2024-03-04T13:00:15.966882+0000","last_peered":"2024-03-04T13:00:15.966882+0000","last_clean":"2024-03-04T13:00:15.966882+0000","last_became_active":"2024-03-04T12:36:05.287329+0000","last_became_peered":"2024-03-04T12:36:05.287329+0000","last_unstale":"2024-03-04T13:00:15.966882+0000","last_undegraded":"2024-03-04T13:00:15.966882+0000","last_fullsized":"2024-03-04T13:00:15.966882+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:30.987377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389106,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":508,"num_read_kb":51332,"num_write":1158,"num_write_kb":22699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:11.005371+0000","last_change":"2024-03-04T12:36:09.307589+0000","last_active":"2024-03-04T12:58:11.005371+0000","last_peered":"2024-03-04T12:58:11.005371+0000","last_clean":"2024-03-04T12:58:11.005371+0000","last_became_active":"2024-03-04T12:36:09.307329+0000","last_became_peered":"2024-03-04T12:36:09.307329+0000","last_unstale":"2024-03-04T12:58:11.005371+0000","last_undegraded":"2024-03-04T12:58:11.005371+0000","last_fullsized":"2024-03-04T12:58:11.005371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:30.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"256'409","reported_seq":1008,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.419225+0000","last_change":"2024-03-04T12:36:11.323790+0000","last_active":"2024-03-04T13:00:15.419225+0000","last_peered":"2024-03-04T13:00:15.419225+0000","last_clean":"2024-03-04T13:00:15.419225+0000","last_became_active":"2024-03-04T12:36:11.323506+0000","last_became_peered":"2024-03-04T12:36:11.323506+0000","last_unstale":"2024-03-04T13:00:15.419225+0000","last_undegraded":"2024-03-04T13:00:15.419225+0000","last_fullsized":"2024-03-04T13:00:15.419225+0000","mapping_epoch":26,"log_start":"256'300","ondisk_log_start":"256'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:50:55.242458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115418,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":721,"num_read_kb":1701,"num_write":586,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.983858+0000","last_change":"2024-03-04T12:36:13.346933+0000","last_active":"2024-03-04T12:56:15.983858+0000","last_peered":"2024-03-04T12:56:15.983858+0000","last_clean":"2024-03-04T12:56:15.983858+0000","last_became_active":"2024-03-04T12:36:13.346628+0000","last_became_peered":"2024-03-04T12:36:13.346628+0000","last_unstale":"2024-03-04T12:56:15.983858+0000","last_undegraded":"2024-03-04T12:56:15.983858+0000","last_fullsized":"2024-03-04T12:56:15.983858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:37.000939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"256'165","reported_seq":643,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:49.594745+0000","last_change":"2024-03-04T12:36:15.354834+0000","last_active":"2024-03-04T12:59:49.594745+0000","last_peered":"2024-03-04T12:59:49.594745+0000","last_clean":"2024-03-04T12:59:49.594745+0000","last_became_active":"2024-03-04T12:36:15.354125+0000","last_became_peered":"2024-03-04T12:36:15.354125+0000","last_unstale":"2024-03-04T12:59:49.594745+0000","last_undegraded":"2024-03-04T12:59:49.594745+0000","last_fullsized":"2024-03-04T12:59:49.594745+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:35:56.991813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":203,"num_write":373,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"256'1141","reported_seq":2714,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.045130+0000","last_change":"2024-03-04T12:36:07.298750+0000","last_active":"2024-03-04T12:59:53.045130+0000","last_peered":"2024-03-04T12:59:53.045130+0000","last_clean":"2024-03-04T12:59:53.045130+0000","last_became_active":"2024-03-04T12:36:07.298434+0000","last_became_peered":"2024-03-04T12:36:07.298434+0000","last_unstale":"2024-03-04T12:59:53.045130+0000","last_undegraded":"2024-03-04T12:59:53.045130+0000","last_fullsized":"2024-03-04T12:59:53.045130+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:09:16.843310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4934,"num_read_kb":4324,"num_write":1585,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"256'338","reported_seq":981,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.997430+0000","last_change":"2024-03-04T12:36:05.287853+0000","last_active":"2024-03-04T13:00:15.997430+0000","last_peered":"2024-03-04T13:00:15.997430+0000","last_clean":"2024-03-04T13:00:15.997430+0000","last_became_active":"2024-03-04T12:36:05.287506+0000","last_became_peered":"2024-03-04T12:36:05.287506+0000","last_unstale":"2024-03-04T13:00:15.997430+0000","last_undegraded":"2024-03-04T13:00:15.997430+0000","last_fullsized":"2024-03-04T13:00:15.997430+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:32:38.606578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16098274,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":545,"num_read_kb":47013,"num_write":1100,"num_write_kb":33887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.985615+0000","last_change":"2024-03-04T12:36:09.309433+0000","last_active":"2024-03-04T12:57:00.985615+0000","last_peered":"2024-03-04T12:57:00.985615+0000","last_clean":"2024-03-04T12:57:00.985615+0000","last_became_active":"2024-03-04T12:36:09.309155+0000","last_became_peered":"2024-03-04T12:36:09.309155+0000","last_unstale":"2024-03-04T12:57:00.985615+0000","last_undegraded":"2024-03-04T12:57:00.985615+0000","last_fullsized":"2024-03-04T12:57:00.985615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:54:56.170543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"256'274","reported_seq":825,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.552159+0000","last_change":"2024-03-04T12:36:11.323679+0000","last_active":"2024-03-04T13:00:15.552159+0000","last_peered":"2024-03-04T13:00:15.552159+0000","last_clean":"2024-03-04T13:00:15.552159+0000","last_became_active":"2024-03-04T12:36:11.323320+0000","last_became_peered":"2024-03-04T12:36:11.323320+0000","last_unstale":"2024-03-04T13:00:15.552159+0000","last_undegraded":"2024-03-04T13:00:15.552159+0000","last_fullsized":"2024-03-04T13:00:15.552159+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:42.811474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44965,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":1036,"num_write":392,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":469,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.974256+0000","last_change":"2024-03-04T12:36:13.340810+0000","last_active":"2024-03-04T12:56:15.974256+0000","last_peered":"2024-03-04T12:56:15.974256+0000","last_clean":"2024-03-04T12:56:15.974256+0000","last_became_active":"2024-03-04T12:36:13.340525+0000","last_became_peered":"2024-03-04T12:36:13.340525+0000","last_unstale":"2024-03-04T12:56:15.974256+0000","last_undegraded":"2024-03-04T12:56:15.974256+0000","last_fullsized":"2024-03-04T12:56:15.974256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:06:28.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"256'155","reported_seq":980,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.538717+0000","last_change":"2024-03-04T12:36:15.363212+0000","last_active":"2024-03-04T13:00:07.538717+0000","last_peered":"2024-03-04T13:00:07.538717+0000","last_clean":"2024-03-04T13:00:07.538717+0000","last_became_active":"2024-03-04T12:36:15.362749+0000","last_became_peered":"2024-03-04T12:36:15.362749+0000","last_unstale":"2024-03-04T13:00:07.538717+0000","last_undegraded":"2024-03-04T13:00:07.538717+0000","last_fullsized":"2024-03-04T13:00:07.538717+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:19.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":549,"num_write":456,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"256'352","reported_seq":1696,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.292917+0000","last_change":"2024-03-04T12:36:07.293117+0000","last_active":"2024-03-04T12:59:48.292917+0000","last_peered":"2024-03-04T12:59:48.292917+0000","last_clean":"2024-03-04T12:59:48.292917+0000","last_became_active":"2024-03-04T12:36:07.292806+0000","last_became_peered":"2024-03-04T12:36:07.292806+0000","last_unstale":"2024-03-04T12:59:48.292917+0000","last_undegraded":"2024-03-04T12:59:48.292917+0000","last_fullsized":"2024-03-04T12:59:48.292917+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:31.918878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1929,"num_read_kb":1816,"num_write":430,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"256'283","reported_seq":919,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.000403+0000","last_change":"2024-03-04T12:36:05.289335+0000","last_active":"2024-03-04T13:00:16.000403+0000","last_peered":"2024-03-04T13:00:16.000403+0000","last_clean":"2024-03-04T13:00:16.000403+0000","last_became_active":"2024-03-04T12:36:05.289053+0000","last_became_peered":"2024-03-04T12:36:05.289053+0000","last_unstale":"2024-03-04T13:00:16.000403+0000","last_undegraded":"2024-03-04T13:00:16.000403+0000","last_fullsized":"2024-03-04T13:00:16.000403+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:54.563075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11429888,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":435,"num_read_kb":60644,"num_write":1156,"num_write_kb":49301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.983196+0000","last_change":"2024-03-04T12:36:09.308491+0000","last_active":"2024-03-04T12:56:10.983196+0000","last_peered":"2024-03-04T12:56:10.983196+0000","last_clean":"2024-03-04T12:56:10.983196+0000","last_became_active":"2024-03-04T12:36:09.308231+0000","last_became_peered":"2024-03-04T12:36:09.308231+0000","last_unstale":"2024-03-04T12:56:10.983196+0000","last_undegraded":"2024-03-04T12:56:10.983196+0000","last_fullsized":"2024-03-04T12:56:10.983196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:10:29.969171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"256'272","reported_seq":812,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.691138+0000","last_change":"2024-03-04T12:36:11.954917+0000","last_active":"2024-03-04T13:00:08.691138+0000","last_peered":"2024-03-04T13:00:08.691138+0000","last_clean":"2024-03-04T13:00:08.691138+0000","last_became_active":"2024-03-04T12:36:11.954568+0000","last_became_peered":"2024-03-04T12:36:11.954568+0000","last_unstale":"2024-03-04T13:00:08.691138+0000","last_undegraded":"2024-03-04T13:00:08.691138+0000","last_fullsized":"2024-03-04T13:00:08.691138+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:56.500891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64514,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":989,"num_write":386,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:15.988694+0000","last_change":"2024-03-04T12:36:13.346950+0000","last_active":"2024-03-04T12:58:15.988694+0000","last_peered":"2024-03-04T12:58:15.988694+0000","last_clean":"2024-03-04T12:58:15.988694+0000","last_became_active":"2024-03-04T12:36:13.346665+0000","last_became_peered":"2024-03-04T12:36:13.346665+0000","last_unstale":"2024-03-04T12:58:15.988694+0000","last_undegraded":"2024-03-04T12:58:15.988694+0000","last_fullsized":"2024-03-04T12:58:15.988694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:14.332069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'103","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.702492+0000","last_change":"2024-03-04T12:36:15.364059+0000","last_active":"2024-03-04T13:00:08.702492+0000","last_peered":"2024-03-04T13:00:08.702492+0000","last_clean":"2024-03-04T13:00:08.702492+0000","last_became_active":"2024-03-04T12:36:15.363269+0000","last_became_peered":"2024-03-04T12:36:15.363269+0000","last_unstale":"2024-03-04T13:00:08.702492+0000","last_undegraded":"2024-03-04T13:00:08.702492+0000","last_fullsized":"2024-03-04T13:00:08.702492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:56.078288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"256'427","reported_seq":1936,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.685753+0000","last_change":"2024-03-04T12:36:07.296189+0000","last_active":"2024-03-04T13:00:06.685753+0000","last_peered":"2024-03-04T13:00:06.685753+0000","last_clean":"2024-03-04T13:00:06.685753+0000","last_became_active":"2024-03-04T12:36:07.295353+0000","last_became_peered":"2024-03-04T12:36:07.295353+0000","last_unstale":"2024-03-04T13:00:06.685753+0000","last_undegraded":"2024-03-04T13:00:06.685753+0000","last_fullsized":"2024-03-04T13:00:06.685753+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:59:38.626041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2362,"num_read_kb":2211,"num_write":524,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"256'455","reported_seq":1101,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.976438+0000","last_change":"2024-03-04T12:36:05.293958+0000","last_active":"2024-03-04T13:00:15.976438+0000","last_peered":"2024-03-04T13:00:15.976438+0000","last_clean":"2024-03-04T13:00:15.976438+0000","last_became_active":"2024-03-04T12:36:05.293646+0000","last_became_peered":"2024-03-04T12:36:05.293646+0000","last_unstale":"2024-03-04T13:00:15.976438+0000","last_undegraded":"2024-03-04T13:00:15.976438+0000","last_fullsized":"2024-03-04T13:00:15.976438+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:32:24.040601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22047979,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":797,"num_read_kb":46886,"num_write":1400,"num_write_kb":44359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.973688+0000","last_change":"2024-03-04T12:36:09.305622+0000","last_active":"2024-03-04T12:56:10.973688+0000","last_peered":"2024-03-04T12:56:10.973688+0000","last_clean":"2024-03-04T12:56:10.973688+0000","last_became_active":"2024-03-04T12:36:09.305073+0000","last_became_peered":"2024-03-04T12:36:09.305073+0000","last_unstale":"2024-03-04T12:56:10.973688+0000","last_undegraded":"2024-03-04T12:56:10.973688+0000","last_fullsized":"2024-03-04T12:56:10.973688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:49.014929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"256'63","reported_seq":556,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:42.294211+0000","last_change":"2024-03-04T12:36:11.955268+0000","last_active":"2024-03-04T12:58:42.294211+0000","last_peered":"2024-03-04T12:58:42.294211+0000","last_clean":"2024-03-04T12:58:42.294211+0000","last_became_active":"2024-03-04T12:36:11.954563+0000","last_became_peered":"2024-03-04T12:36:11.954563+0000","last_unstale":"2024-03-04T12:58:42.294211+0000","last_undegraded":"2024-03-04T12:58:42.294211+0000","last_fullsized":"2024-03-04T12:58:42.294211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:42:13.043294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":71,"num_read_kb":64,"num_write":78,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"256'481","reported_seq":1806,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.233620+0000","last_change":"2024-03-04T12:36:13.340544+0000","last_active":"2024-03-04T13:00:15.233620+0000","last_peered":"2024-03-04T13:00:15.233620+0000","last_clean":"2024-03-04T13:00:15.233620+0000","last_became_active":"2024-03-04T12:36:13.340221+0000","last_became_peered":"2024-03-04T12:36:13.340221+0000","last_unstale":"2024-03-04T13:00:15.233620+0000","last_undegraded":"2024-03-04T13:00:15.233620+0000","last_fullsized":"2024-03-04T13:00:15.233620+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:34.550746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"256'132","reported_seq":606,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.133500+0000","last_change":"2024-03-04T12:36:15.364987+0000","last_active":"2024-03-04T12:59:50.133500+0000","last_peered":"2024-03-04T12:59:50.133500+0000","last_clean":"2024-03-04T12:59:50.133500+0000","last_became_active":"2024-03-04T12:36:15.364688+0000","last_became_peered":"2024-03-04T12:36:15.364688+0000","last_unstale":"2024-03-04T12:59:50.133500+0000","last_undegraded":"2024-03-04T12:59:50.133500+0000","last_fullsized":"2024-03-04T12:59:50.133500+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:22.015151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":294,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"256'357","reported_seq":1820,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.904913+0000","last_change":"2024-03-04T12:36:07.291346+0000","last_active":"2024-03-04T12:59:54.904913+0000","last_peered":"2024-03-04T12:59:54.904913+0000","last_clean":"2024-03-04T12:59:54.904913+0000","last_became_active":"2024-03-04T12:36:07.290637+0000","last_became_peered":"2024-03-04T12:36:07.290637+0000","last_unstale":"2024-03-04T12:59:54.904913+0000","last_undegraded":"2024-03-04T12:59:54.904913+0000","last_fullsized":"2024-03-04T12:59:54.904913+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:40:51.943588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1998,"num_read_kb":1913,"num_write":399,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"256'375","reported_seq":1028,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.974163+0000","last_change":"2024-03-04T12:36:05.294852+0000","last_active":"2024-03-04T13:00:15.974163+0000","last_peered":"2024-03-04T13:00:15.974163+0000","last_clean":"2024-03-04T13:00:15.974163+0000","last_became_active":"2024-03-04T12:36:05.294568+0000","last_became_peered":"2024-03-04T12:36:05.294568+0000","last_unstale":"2024-03-04T13:00:15.974163+0000","last_undegraded":"2024-03-04T13:00:15.974163+0000","last_fullsized":"2024-03-04T13:00:15.974163+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:30:30.652308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13300435,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":641,"num_read_kb":37257,"num_write":1320,"num_write_kb":50791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.869484+0000","last_change":"2024-03-04T12:36:09.306310+0000","last_active":"2024-03-04T12:56:10.869484+0000","last_peered":"2024-03-04T12:56:10.869484+0000","last_clean":"2024-03-04T12:56:10.869484+0000","last_became_active":"2024-03-04T12:36:09.306005+0000","last_became_peered":"2024-03-04T12:36:09.306005+0000","last_unstale":"2024-03-04T12:56:10.869484+0000","last_undegraded":"2024-03-04T12:56:10.869484+0000","last_fullsized":"2024-03-04T12:56:10.869484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:36:38.545939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"256'268","reported_seq":811,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.658146+0000","last_change":"2024-03-04T12:36:11.325797+0000","last_active":"2024-03-04T13:00:08.658146+0000","last_peered":"2024-03-04T13:00:08.658146+0000","last_clean":"2024-03-04T13:00:08.658146+0000","last_became_active":"2024-03-04T12:36:11.325503+0000","last_became_peered":"2024-03-04T12:36:11.325503+0000","last_unstale":"2024-03-04T13:00:08.658146+0000","last_undegraded":"2024-03-04T13:00:08.658146+0000","last_fullsized":"2024-03-04T13:00:08.658146+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:37.864953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64489,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":946,"num_write":368,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":462,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.986011+0000","last_change":"2024-03-04T12:36:13.339697+0000","last_active":"2024-03-04T12:55:35.986011+0000","last_peered":"2024-03-04T12:55:35.986011+0000","last_clean":"2024-03-04T12:55:35.986011+0000","last_became_active":"2024-03-04T12:36:13.339349+0000","last_became_peered":"2024-03-04T12:36:13.339349+0000","last_unstale":"2024-03-04T12:55:35.986011+0000","last_undegraded":"2024-03-04T12:55:35.986011+0000","last_fullsized":"2024-03-04T12:55:35.986011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:11.712690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"256'111","reported_seq":637,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:11.247234+0000","last_change":"2024-03-04T12:36:15.352689+0000","last_active":"2024-03-04T12:59:11.247234+0000","last_peered":"2024-03-04T12:59:11.247234+0000","last_clean":"2024-03-04T12:59:11.247234+0000","last_became_active":"2024-03-04T12:36:15.352383+0000","last_became_peered":"2024-03-04T12:36:15.352383+0000","last_unstale":"2024-03-04T12:59:11.247234+0000","last_undegraded":"2024-03-04T12:59:11.247234+0000","last_fullsized":"2024-03-04T12:59:11.247234+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:10:26.974662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":264,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"256'405","reported_seq":1774,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.045644+0000","last_change":"2024-03-04T12:36:07.296237+0000","last_active":"2024-03-04T12:59:56.045644+0000","last_peered":"2024-03-04T12:59:56.045644+0000","last_clean":"2024-03-04T12:59:56.045644+0000","last_became_active":"2024-03-04T12:36:07.295956+0000","last_became_peered":"2024-03-04T12:36:07.295956+0000","last_unstale":"2024-03-04T12:59:56.045644+0000","last_undegraded":"2024-03-04T12:59:56.045644+0000","last_fullsized":"2024-03-04T12:59:56.045644+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:07.889506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2057,"num_read_kb":1911,"num_write":497,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"256'251","reported_seq":843,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.004624+0000","last_change":"2024-03-04T12:36:05.294942+0000","last_active":"2024-03-04T13:00:16.004624+0000","last_peered":"2024-03-04T13:00:16.004624+0000","last_clean":"2024-03-04T13:00:16.004624+0000","last_became_active":"2024-03-04T12:36:05.294686+0000","last_became_peered":"2024-03-04T12:36:05.294686+0000","last_unstale":"2024-03-04T13:00:16.004624+0000","last_undegraded":"2024-03-04T13:00:16.004624+0000","last_fullsized":"2024-03-04T13:00:16.004624+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:40:07.056496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11121196,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":377,"num_read_kb":38414,"num_write":962,"num_write_kb":48852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.983094+0000","last_change":"2024-03-04T12:36:09.315306+0000","last_active":"2024-03-04T12:56:10.983094+0000","last_peered":"2024-03-04T12:56:10.983094+0000","last_clean":"2024-03-04T12:56:10.983094+0000","last_became_active":"2024-03-04T12:36:09.314912+0000","last_became_peered":"2024-03-04T12:36:09.314912+0000","last_unstale":"2024-03-04T12:56:10.983094+0000","last_undegraded":"2024-03-04T12:56:10.983094+0000","last_fullsized":"2024-03-04T12:56:10.983094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:28.512512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"256'261","reported_seq":792,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.658482+0000","last_change":"2024-03-04T12:36:11.325501+0000","last_active":"2024-03-04T13:00:08.658482+0000","last_peered":"2024-03-04T13:00:08.658482+0000","last_clean":"2024-03-04T13:00:08.658482+0000","last_became_active":"2024-03-04T12:36:11.325238+0000","last_became_peered":"2024-03-04T12:36:11.325238+0000","last_unstale":"2024-03-04T13:00:08.658482+0000","last_undegraded":"2024-03-04T13:00:08.658482+0000","last_fullsized":"2024-03-04T13:00:08.658482+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:52:12.180477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58120,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":904,"num_write":354,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.974979+0000","last_change":"2024-03-04T12:36:13.341948+0000","last_active":"2024-03-04T12:55:35.974979+0000","last_peered":"2024-03-04T12:55:35.974979+0000","last_clean":"2024-03-04T12:55:35.974979+0000","last_became_active":"2024-03-04T12:36:13.341689+0000","last_became_peered":"2024-03-04T12:36:13.341689+0000","last_unstale":"2024-03-04T12:55:35.974979+0000","last_undegraded":"2024-03-04T12:55:35.974979+0000","last_fullsized":"2024-03-04T12:55:35.974979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:02:47.747861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"256'98","reported_seq":590,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:37.800761+0000","last_change":"2024-03-04T12:36:15.353744+0000","last_active":"2024-03-04T12:59:37.800761+0000","last_peered":"2024-03-04T12:59:37.800761+0000","last_clean":"2024-03-04T12:59:37.800761+0000","last_became_active":"2024-03-04T12:36:15.353418+0000","last_became_peered":"2024-03-04T12:36:15.353418+0000","last_unstale":"2024-03-04T12:59:37.800761+0000","last_undegraded":"2024-03-04T12:59:37.800761+0000","last_fullsized":"2024-03-04T12:59:37.800761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:31:22.073567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"256'1443","reported_seq":2774,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:34.666144+0000","last_change":"2024-03-04T12:36:07.300609+0000","last_active":"2024-03-04T12:59:34.666144+0000","last_peered":"2024-03-04T12:59:34.666144+0000","last_clean":"2024-03-04T12:59:34.666144+0000","last_became_active":"2024-03-04T12:36:07.300067+0000","last_became_peered":"2024-03-04T12:36:07.300067+0000","last_unstale":"2024-03-04T12:59:34.666144+0000","last_undegraded":"2024-03-04T12:59:34.666144+0000","last_fullsized":"2024-03-04T12:59:34.666144+0000","mapping_epoch":22,"log_start":"256'1400","ondisk_log_start":"256'1400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:54:29.408852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5752,"num_read_kb":4912,"num_write":2067,"num_write_kb":923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"256'344","reported_seq":1000,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.982100+0000","last_change":"2024-03-04T12:36:05.284059+0000","last_active":"2024-03-04T13:00:15.982100+0000","last_peered":"2024-03-04T13:00:15.982100+0000","last_clean":"2024-03-04T13:00:15.982100+0000","last_became_active":"2024-03-04T12:36:05.283142+0000","last_became_peered":"2024-03-04T12:36:05.283142+0000","last_unstale":"2024-03-04T13:00:15.982100+0000","last_undegraded":"2024-03-04T13:00:15.982100+0000","last_fullsized":"2024-03-04T13:00:15.982100+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:42:53.872503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":623,"num_read_kb":1438,"num_write":1711,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.976430+0000","last_change":"2024-03-04T12:36:09.305585+0000","last_active":"2024-03-04T12:55:30.976430+0000","last_peered":"2024-03-04T12:55:30.976430+0000","last_clean":"2024-03-04T12:55:30.976430+0000","last_became_active":"2024-03-04T12:36:09.305182+0000","last_became_peered":"2024-03-04T12:36:09.305182+0000","last_unstale":"2024-03-04T12:55:30.976430+0000","last_undegraded":"2024-03-04T12:55:30.976430+0000","last_fullsized":"2024-03-04T12:55:30.976430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:08:29.761455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"256'234","reported_seq":763,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.688891+0000","last_change":"2024-03-04T12:36:11.324706+0000","last_active":"2024-03-04T13:00:08.688891+0000","last_peered":"2024-03-04T13:00:08.688891+0000","last_clean":"2024-03-04T13:00:08.688891+0000","last_became_active":"2024-03-04T12:36:11.324394+0000","last_became_peered":"2024-03-04T12:36:11.324394+0000","last_unstale":"2024-03-04T13:00:08.688891+0000","last_undegraded":"2024-03-04T13:00:08.688891+0000","last_fullsized":"2024-03-04T13:00:08.688891+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:55.889459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55992,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":875,"num_write":338,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":471,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.983889+0000","last_change":"2024-03-04T12:36:13.341181+0000","last_active":"2024-03-04T12:56:15.983889+0000","last_peered":"2024-03-04T12:56:15.983889+0000","last_clean":"2024-03-04T12:56:15.983889+0000","last_became_active":"2024-03-04T12:36:13.340897+0000","last_became_peered":"2024-03-04T12:36:13.340897+0000","last_unstale":"2024-03-04T12:56:15.983889+0000","last_undegraded":"2024-03-04T12:56:15.983889+0000","last_fullsized":"2024-03-04T12:56:15.983889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:02:05.268444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"256'169","reported_seq":1167,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.492529+0000","last_change":"2024-03-04T12:36:15.357808+0000","last_active":"2024-03-04T13:00:07.492529+0000","last_peered":"2024-03-04T13:00:07.492529+0000","last_clean":"2024-03-04T13:00:07.492529+0000","last_became_active":"2024-03-04T12:36:15.357141+0000","last_became_peered":"2024-03-04T12:36:15.357141+0000","last_unstale":"2024-03-04T13:00:07.492529+0000","last_undegraded":"2024-03-04T13:00:07.492529+0000","last_fullsized":"2024-03-04T13:00:07.492529+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:59:35.782871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":655,"num_read_kb":655,"num_write":360,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"256'1105","reported_seq":2587,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.017005+0000","last_change":"2024-03-04T12:36:07.291118+0000","last_active":"2024-03-04T12:59:54.017005+0000","last_peered":"2024-03-04T12:59:54.017005+0000","last_clean":"2024-03-04T12:59:54.017005+0000","last_became_active":"2024-03-04T12:36:07.290820+0000","last_became_peered":"2024-03-04T12:36:07.290820+0000","last_unstale":"2024-03-04T12:59:54.017005+0000","last_undegraded":"2024-03-04T12:59:54.017005+0000","last_fullsized":"2024-03-04T12:59:54.017005+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:04.696551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4641,"num_read_kb":4049,"num_write":1526,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"256'269","reported_seq":936,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.007499+0000","last_change":"2024-03-04T12:36:05.290216+0000","last_active":"2024-03-04T13:00:16.007499+0000","last_peered":"2024-03-04T13:00:16.007499+0000","last_clean":"2024-03-04T13:00:16.007499+0000","last_became_active":"2024-03-04T12:36:05.289897+0000","last_became_peered":"2024-03-04T12:36:05.289897+0000","last_unstale":"2024-03-04T13:00:16.007499+0000","last_undegraded":"2024-03-04T13:00:16.007499+0000","last_fullsized":"2024-03-04T13:00:16.007499+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:29.554222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5631842,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":540,"num_read_kb":14927,"num_write":990,"num_write_kb":32177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.968279+0000","last_change":"2024-03-04T12:36:09.311068+0000","last_active":"2024-03-04T12:55:30.968279+0000","last_peered":"2024-03-04T12:55:30.968279+0000","last_clean":"2024-03-04T12:55:30.968279+0000","last_became_active":"2024-03-04T12:36:09.310855+0000","last_became_peered":"2024-03-04T12:36:09.310855+0000","last_unstale":"2024-03-04T12:55:30.968279+0000","last_undegraded":"2024-03-04T12:55:30.968279+0000","last_fullsized":"2024-03-04T12:55:30.968279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:22.965213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"256'262","reported_seq":817,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.693001+0000","last_change":"2024-03-04T12:36:11.323707+0000","last_active":"2024-03-04T13:00:08.693001+0000","last_peered":"2024-03-04T13:00:08.693001+0000","last_clean":"2024-03-04T13:00:08.693001+0000","last_became_active":"2024-03-04T12:36:11.323352+0000","last_became_peered":"2024-03-04T12:36:11.323352+0000","last_unstale":"2024-03-04T13:00:08.693001+0000","last_undegraded":"2024-03-04T13:00:08.693001+0000","last_fullsized":"2024-03-04T13:00:08.693001+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:15.465595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":879,"num_write":344,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":462,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.990494+0000","last_change":"2024-03-04T12:36:13.343303+0000","last_active":"2024-03-04T12:56:15.990494+0000","last_peered":"2024-03-04T12:56:15.990494+0000","last_clean":"2024-03-04T12:56:15.990494+0000","last_became_active":"2024-03-04T12:36:13.342656+0000","last_became_peered":"2024-03-04T12:36:13.342656+0000","last_unstale":"2024-03-04T12:56:15.990494+0000","last_undegraded":"2024-03-04T12:56:15.990494+0000","last_fullsized":"2024-03-04T12:56:15.990494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:43.617222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"256'102","reported_seq":575,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:36.553742+0000","last_change":"2024-03-04T12:36:15.352666+0000","last_active":"2024-03-04T12:59:36.553742+0000","last_peered":"2024-03-04T12:59:36.553742+0000","last_clean":"2024-03-04T12:59:36.553742+0000","last_became_active":"2024-03-04T12:36:15.352333+0000","last_became_peered":"2024-03-04T12:36:15.352333+0000","last_unstale":"2024-03-04T12:59:36.553742+0000","last_undegraded":"2024-03-04T12:59:36.553742+0000","last_fullsized":"2024-03-04T12:59:36.553742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:36.600244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":93,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"256'392","reported_seq":1887,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.047579+0000","last_change":"2024-03-04T12:36:07.298617+0000","last_active":"2024-03-04T12:59:53.047579+0000","last_peered":"2024-03-04T12:59:53.047579+0000","last_clean":"2024-03-04T12:59:53.047579+0000","last_became_active":"2024-03-04T12:36:07.297660+0000","last_became_peered":"2024-03-04T12:36:07.297660+0000","last_unstale":"2024-03-04T12:59:53.047579+0000","last_undegraded":"2024-03-04T12:59:53.047579+0000","last_fullsized":"2024-03-04T12:59:53.047579+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:32.101783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":478,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"256'240","reported_seq":825,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.977272+0000","last_change":"2024-03-04T12:36:05.279913+0000","last_active":"2024-03-04T13:00:15.977272+0000","last_peered":"2024-03-04T13:00:15.977272+0000","last_clean":"2024-03-04T13:00:15.977272+0000","last_became_active":"2024-03-04T12:36:05.279576+0000","last_became_peered":"2024-03-04T12:36:05.279576+0000","last_unstale":"2024-03-04T13:00:15.977272+0000","last_undegraded":"2024-03-04T13:00:15.977272+0000","last_fullsized":"2024-03-04T13:00:15.977272+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:18.604604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6640307,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":344,"num_read_kb":32300,"num_write":1048,"num_write_kb":15765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"256'425","reported_seq":1850,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.047677+0000","last_change":"2024-03-04T12:36:07.300437+0000","last_active":"2024-03-04T12:59:53.047677+0000","last_peered":"2024-03-04T12:59:53.047677+0000","last_clean":"2024-03-04T12:59:53.047677+0000","last_became_active":"2024-03-04T12:36:07.300168+0000","last_became_peered":"2024-03-04T12:36:07.300168+0000","last_unstale":"2024-03-04T12:59:53.047677+0000","last_undegraded":"2024-03-04T12:59:53.047677+0000","last_fullsized":"2024-03-04T12:59:53.047677+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:16.225236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2082,"num_write":535,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"256'261","reported_seq":877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.946419+0000","last_change":"2024-03-04T12:36:05.287650+0000","last_active":"2024-03-04T13:00:15.946419+0000","last_peered":"2024-03-04T13:00:15.946419+0000","last_clean":"2024-03-04T13:00:15.946419+0000","last_became_active":"2024-03-04T12:36:05.287233+0000","last_became_peered":"2024-03-04T12:36:05.287233+0000","last_unstale":"2024-03-04T13:00:15.946419+0000","last_undegraded":"2024-03-04T13:00:15.946419+0000","last_fullsized":"2024-03-04T13:00:15.946419+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:20:52.908914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16232749,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":421,"num_read_kb":46552,"num_write":1150,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"256'338","reported_seq":1830,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.139327+0000","last_change":"2024-03-04T12:36:07.296382+0000","last_active":"2024-03-04T12:59:50.139327+0000","last_peered":"2024-03-04T12:59:50.139327+0000","last_clean":"2024-03-04T12:59:50.139327+0000","last_became_active":"2024-03-04T12:36:07.296104+0000","last_became_peered":"2024-03-04T12:36:07.296104+0000","last_unstale":"2024-03-04T12:59:50.139327+0000","last_undegraded":"2024-03-04T12:59:50.139327+0000","last_fullsized":"2024-03-04T12:59:50.139327+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:56.868284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1942,"num_read_kb":1888,"num_write":368,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"256'298","reported_seq":918,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.958438+0000","last_change":"2024-03-04T12:36:41.075779+0000","last_active":"2024-03-04T13:00:15.958438+0000","last_peered":"2024-03-04T13:00:15.958438+0000","last_clean":"2024-03-04T13:00:15.958438+0000","last_became_active":"2024-03-04T12:36:41.075381+0000","last_became_peered":"2024-03-04T12:36:41.075381+0000","last_unstale":"2024-03-04T13:00:15.958438+0000","last_undegraded":"2024-03-04T13:00:15.958438+0000","last_fullsized":"2024-03-04T13:00:15.958438+0000","mapping_epoch":33,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:58.826959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745056,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":477,"num_read_kb":52899,"num_write":1246,"num_write_kb":57282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"256'1024","reported_seq":2573,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.027302+0000","last_change":"2024-03-04T12:36:07.299735+0000","last_active":"2024-03-04T12:59:56.027302+0000","last_peered":"2024-03-04T12:59:56.027302+0000","last_clean":"2024-03-04T12:59:56.027302+0000","last_became_active":"2024-03-04T12:36:07.299282+0000","last_became_peered":"2024-03-04T12:36:07.299282+0000","last_unstale":"2024-03-04T12:59:56.027302+0000","last_undegraded":"2024-03-04T12:59:56.027302+0000","last_fullsized":"2024-03-04T12:59:56.027302+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:42:39.813252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4484,"num_read_kb":3892,"num_write":1521,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"256'254","reported_seq":906,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.966935+0000","last_change":"2024-03-04T12:36:05.283738+0000","last_active":"2024-03-04T13:00:15.966935+0000","last_peered":"2024-03-04T13:00:15.966935+0000","last_clean":"2024-03-04T13:00:15.966935+0000","last_became_active":"2024-03-04T12:36:05.283327+0000","last_became_peered":"2024-03-04T12:36:05.283327+0000","last_unstale":"2024-03-04T13:00:15.966935+0000","last_undegraded":"2024-03-04T13:00:15.966935+0000","last_fullsized":"2024-03-04T13:00:15.966935+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:26:39.224528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10220281,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":450,"num_read_kb":66598,"num_write":957,"num_write_kb":37083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"256'426","reported_seq":1880,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671263+0000","last_change":"2024-03-04T12:36:07.293252+0000","last_active":"2024-03-04T13:00:06.671263+0000","last_peered":"2024-03-04T13:00:06.671263+0000","last_clean":"2024-03-04T13:00:06.671263+0000","last_became_active":"2024-03-04T12:36:07.292950+0000","last_became_peered":"2024-03-04T12:36:07.292950+0000","last_unstale":"2024-03-04T13:00:06.671263+0000","last_undegraded":"2024-03-04T13:00:06.671263+0000","last_fullsized":"2024-03-04T13:00:06.671263+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:06.362966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2086,"num_write":515,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"256'240","reported_seq":854,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.978814+0000","last_change":"2024-03-04T12:36:05.287013+0000","last_active":"2024-03-04T13:00:15.978814+0000","last_peered":"2024-03-04T13:00:15.978814+0000","last_clean":"2024-03-04T13:00:15.978814+0000","last_became_active":"2024-03-04T12:36:05.286745+0000","last_became_peered":"2024-03-04T12:36:05.286745+0000","last_unstale":"2024-03-04T13:00:15.978814+0000","last_undegraded":"2024-03-04T13:00:15.978814+0000","last_fullsized":"2024-03-04T13:00:15.978814+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:28.246766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11547099,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":396,"num_read_kb":38207,"num_write":998,"num_write_kb":19360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"256'355","reported_seq":1889,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.837911+0000","last_change":"2024-03-04T12:36:07.291981+0000","last_active":"2024-03-04T12:59:48.837911+0000","last_peered":"2024-03-04T12:59:48.837911+0000","last_clean":"2024-03-04T12:59:48.837911+0000","last_became_active":"2024-03-04T12:36:07.291690+0000","last_became_peered":"2024-03-04T12:36:07.291690+0000","last_unstale":"2024-03-04T12:59:48.837911+0000","last_undegraded":"2024-03-04T12:59:48.837911+0000","last_fullsized":"2024-03-04T12:59:48.837911+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:27:20.656871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2163,"num_read_kb":2091,"num_write":400,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"256'260","reported_seq":877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.912989+0000","last_change":"2024-03-04T12:36:05.287869+0000","last_active":"2024-03-04T13:00:15.912989+0000","last_peered":"2024-03-04T13:00:15.912989+0000","last_clean":"2024-03-04T13:00:15.912989+0000","last_became_active":"2024-03-04T12:36:05.287529+0000","last_became_peered":"2024-03-04T12:36:05.287529+0000","last_unstale":"2024-03-04T13:00:15.912989+0000","last_undegraded":"2024-03-04T13:00:15.912989+0000","last_fullsized":"2024-03-04T13:00:15.912989+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:48.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097782,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":439,"num_read_kb":37296,"num_write":1054,"num_write_kb":36513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"256'739","reported_seq":2222,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.017452+0000","last_change":"2024-03-04T12:36:07.300374+0000","last_active":"2024-03-04T12:59:56.017452+0000","last_peered":"2024-03-04T12:59:56.017452+0000","last_clean":"2024-03-04T12:59:56.017452+0000","last_became_active":"2024-03-04T12:36:07.299881+0000","last_became_peered":"2024-03-04T12:36:07.299881+0000","last_unstale":"2024-03-04T12:59:56.017452+0000","last_undegraded":"2024-03-04T12:59:56.017452+0000","last_fullsized":"2024-03-04T12:59:56.017452+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:55:08.815424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3309,"num_read_kb":2983,"num_write":974,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"256'285","reported_seq":909,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.976782+0000","last_change":"2024-03-04T12:36:05.286690+0000","last_active":"2024-03-04T13:00:15.976782+0000","last_peered":"2024-03-04T13:00:15.976782+0000","last_clean":"2024-03-04T13:00:15.976782+0000","last_became_active":"2024-03-04T12:36:05.286397+0000","last_became_peered":"2024-03-04T12:36:05.286397+0000","last_unstale":"2024-03-04T13:00:15.976782+0000","last_undegraded":"2024-03-04T13:00:15.976782+0000","last_fullsized":"2024-03-04T13:00:15.976782+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:20:08.942318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104717,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":420,"num_read_kb":103287,"num_write":1181,"num_write_kb":47023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"256'475","reported_seq":2071,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.610564+0000","last_change":"2024-03-04T12:36:07.292858+0000","last_active":"2024-03-04T12:59:47.610564+0000","last_peered":"2024-03-04T12:59:47.610564+0000","last_clean":"2024-03-04T12:59:47.610564+0000","last_became_active":"2024-03-04T12:36:07.292501+0000","last_became_peered":"2024-03-04T12:36:07.292501+0000","last_unstale":"2024-03-04T12:59:47.610564+0000","last_undegraded":"2024-03-04T12:59:47.610564+0000","last_fullsized":"2024-03-04T12:59:47.610564+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:35.770287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2330,"num_write":558,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"256'280","reported_seq":877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.955320+0000","last_change":"2024-03-04T12:36:05.294285+0000","last_active":"2024-03-04T13:00:15.955320+0000","last_peered":"2024-03-04T13:00:15.955320+0000","last_clean":"2024-03-04T13:00:15.955320+0000","last_became_active":"2024-03-04T12:36:05.294007+0000","last_became_peered":"2024-03-04T12:36:05.294007+0000","last_unstale":"2024-03-04T13:00:15.955320+0000","last_undegraded":"2024-03-04T13:00:15.955320+0000","last_fullsized":"2024-03-04T13:00:15.955320+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:06.848739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924970,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":399,"num_read_kb":23598,"num_write":1150,"num_write_kb":28139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"256'446","reported_seq":1957,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.468689+0000","last_change":"2024-03-04T12:36:07.294584+0000","last_active":"2024-03-04T12:59:55.468689+0000","last_peered":"2024-03-04T12:59:55.468689+0000","last_clean":"2024-03-04T12:59:55.468689+0000","last_became_active":"2024-03-04T12:36:07.294283+0000","last_became_peered":"2024-03-04T12:36:07.294283+0000","last_unstale":"2024-03-04T12:59:55.468689+0000","last_undegraded":"2024-03-04T12:59:55.468689+0000","last_fullsized":"2024-03-04T12:59:55.468689+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:44:00.573776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2476,"num_read_kb":2316,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"256'291","reported_seq":904,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.003309+0000","last_change":"2024-03-04T12:36:05.290249+0000","last_active":"2024-03-04T13:00:16.003309+0000","last_peered":"2024-03-04T13:00:16.003309+0000","last_clean":"2024-03-04T13:00:16.003309+0000","last_became_active":"2024-03-04T12:36:05.289882+0000","last_became_peered":"2024-03-04T12:36:05.289882+0000","last_unstale":"2024-03-04T13:00:16.003309+0000","last_undegraded":"2024-03-04T13:00:16.003309+0000","last_fullsized":"2024-03-04T13:00:16.003309+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:30.035250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5637358,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":433,"num_read_kb":35092,"num_write":1050,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"256'454","reported_seq":1937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671932+0000","last_change":"2024-03-04T12:36:07.294765+0000","last_active":"2024-03-04T13:00:06.671932+0000","last_peered":"2024-03-04T13:00:06.671932+0000","last_clean":"2024-03-04T13:00:06.671932+0000","last_became_active":"2024-03-04T12:36:07.292904+0000","last_became_peered":"2024-03-04T12:36:07.292904+0000","last_unstale":"2024-03-04T13:00:06.671932+0000","last_undegraded":"2024-03-04T13:00:06.671932+0000","last_fullsized":"2024-03-04T13:00:06.671932+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:02.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2160,"num_write":550,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"256'265","reported_seq":851,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.962326+0000","last_change":"2024-03-04T12:36:05.294662+0000","last_active":"2024-03-04T13:00:15.962326+0000","last_peered":"2024-03-04T13:00:15.962326+0000","last_clean":"2024-03-04T13:00:15.962326+0000","last_became_active":"2024-03-04T12:36:05.294338+0000","last_became_peered":"2024-03-04T12:36:05.294338+0000","last_unstale":"2024-03-04T13:00:15.962326+0000","last_undegraded":"2024-03-04T13:00:15.962326+0000","last_fullsized":"2024-03-04T13:00:15.962326+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:09.803465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265765,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":394,"num_read_kb":2630,"num_write":1096,"num_write_kb":25999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"256'1251","reported_seq":2837,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.468793+0000","last_change":"2024-03-04T12:36:07.292610+0000","last_active":"2024-03-04T12:59:55.468793+0000","last_peered":"2024-03-04T12:59:55.468793+0000","last_clean":"2024-03-04T12:59:55.468793+0000","last_became_active":"2024-03-04T12:36:07.292294+0000","last_became_peered":"2024-03-04T12:36:07.292294+0000","last_unstale":"2024-03-04T12:59:55.468793+0000","last_undegraded":"2024-03-04T12:59:55.468793+0000","last_fullsized":"2024-03-04T12:59:55.468793+0000","mapping_epoch":22,"log_start":"256'1200","ondisk_log_start":"256'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:30:59.966747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5403,"num_read_kb":4680,"num_write":1785,"num_write_kb":760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"256'283","reported_seq":884,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.999538+0000","last_change":"2024-03-04T12:36:05.290703+0000","last_active":"2024-03-04T13:00:15.999538+0000","last_peered":"2024-03-04T13:00:15.999538+0000","last_clean":"2024-03-04T13:00:15.999538+0000","last_became_active":"2024-03-04T12:36:05.290410+0000","last_became_peered":"2024-03-04T12:36:05.290410+0000","last_unstale":"2024-03-04T13:00:15.999538+0000","last_undegraded":"2024-03-04T13:00:15.999538+0000","last_fullsized":"2024-03-04T13:00:15.999538+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:59.309109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6390630,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":409,"num_read_kb":19682,"num_write":1167,"num_write_kb":25111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"256'274","reported_seq":1515,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.123078+0000","last_change":"2024-03-04T12:36:07.293973+0000","last_active":"2024-03-04T12:59:52.123078+0000","last_peered":"2024-03-04T12:59:52.123078+0000","last_clean":"2024-03-04T12:59:52.123078+0000","last_became_active":"2024-03-04T12:36:07.291583+0000","last_became_peered":"2024-03-04T12:36:07.291583+0000","last_unstale":"2024-03-04T12:59:52.123078+0000","last_undegraded":"2024-03-04T12:59:52.123078+0000","last_fullsized":"2024-03-04T12:59:52.123078+0000","mapping_epoch":22,"log_start":"256'200","ondisk_log_start":"256'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:30:48.818767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1552,"num_read_kb":1496,"num_write":324,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"256'353","reported_seq":969,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.006131+0000","last_change":"2024-03-04T12:36:05.290812+0000","last_active":"2024-03-04T13:00:16.006131+0000","last_peered":"2024-03-04T13:00:16.006131+0000","last_clean":"2024-03-04T13:00:16.006131+0000","last_became_active":"2024-03-04T12:36:05.290522+0000","last_became_peered":"2024-03-04T12:36:05.290522+0000","last_unstale":"2024-03-04T13:00:16.006131+0000","last_undegraded":"2024-03-04T13:00:16.006131+0000","last_fullsized":"2024-03-04T13:00:16.006131+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:11:55.799567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12166245,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":559,"num_read_kb":8191,"num_write":1159,"num_write_kb":30951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"256'1119","reported_seq":2696,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.020212+0000","last_change":"2024-03-04T12:36:07.294845+0000","last_active":"2024-03-04T12:59:56.020212+0000","last_peered":"2024-03-04T12:59:56.020212+0000","last_clean":"2024-03-04T12:59:56.020212+0000","last_became_active":"2024-03-04T12:36:07.294536+0000","last_became_peered":"2024-03-04T12:36:07.294536+0000","last_unstale":"2024-03-04T12:59:56.020212+0000","last_undegraded":"2024-03-04T12:59:56.020212+0000","last_fullsized":"2024-03-04T12:59:56.020212+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:59.121496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4737,"num_read_kb":4156,"num_write":1530,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"256'273","reported_seq":886,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.939081+0000","last_change":"2024-03-04T12:36:05.286225+0000","last_active":"2024-03-04T13:00:15.939081+0000","last_peered":"2024-03-04T13:00:15.939081+0000","last_clean":"2024-03-04T13:00:15.939081+0000","last_became_active":"2024-03-04T12:36:05.285924+0000","last_became_peered":"2024-03-04T12:36:05.285924+0000","last_unstale":"2024-03-04T13:00:15.939081+0000","last_undegraded":"2024-03-04T13:00:15.939081+0000","last_fullsized":"2024-03-04T13:00:15.939081+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:09.707595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5191234,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":370,"num_read_kb":22811,"num_write":1021,"num_write_kb":24147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"256'331","reported_seq":1637,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.899638+0000","last_change":"2024-03-04T12:36:07.302695+0000","last_active":"2024-03-04T12:59:54.899638+0000","last_peered":"2024-03-04T12:59:54.899638+0000","last_clean":"2024-03-04T12:59:54.899638+0000","last_became_active":"2024-03-04T12:36:07.302371+0000","last_became_peered":"2024-03-04T12:36:07.302371+0000","last_unstale":"2024-03-04T12:59:54.899638+0000","last_undegraded":"2024-03-04T12:59:54.899638+0000","last_fullsized":"2024-03-04T12:59:54.899638+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:05.080759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1728,"num_read_kb":1642,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"256'274","reported_seq":868,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.853582+0000","last_change":"2024-03-04T12:36:05.290406+0000","last_active":"2024-03-04T13:00:15.853582+0000","last_peered":"2024-03-04T13:00:15.853582+0000","last_clean":"2024-03-04T13:00:15.853582+0000","last_became_active":"2024-03-04T12:36:05.290032+0000","last_became_peered":"2024-03-04T12:36:05.290032+0000","last_unstale":"2024-03-04T13:00:15.853582+0000","last_undegraded":"2024-03-04T13:00:15.853582+0000","last_fullsized":"2024-03-04T13:00:15.853582+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:02.601501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6587184,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":379,"num_read_kb":31102,"num_write":1038,"num_write_kb":33345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"256'416","reported_seq":1942,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.903846+0000","last_change":"2024-03-04T12:36:07.300654+0000","last_active":"2024-03-04T12:59:54.903846+0000","last_peered":"2024-03-04T12:59:54.903846+0000","last_clean":"2024-03-04T12:59:54.903846+0000","last_became_active":"2024-03-04T12:36:07.299718+0000","last_became_peered":"2024-03-04T12:36:07.299718+0000","last_unstale":"2024-03-04T12:59:54.903846+0000","last_undegraded":"2024-03-04T12:59:54.903846+0000","last_fullsized":"2024-03-04T12:59:54.903846+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:35:20.788356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2289,"num_read_kb":2179,"num_write":520,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"256'340","reported_seq":998,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.954726+0000","last_change":"2024-03-04T12:36:05.279867+0000","last_active":"2024-03-04T13:00:15.954726+0000","last_peered":"2024-03-04T13:00:15.954726+0000","last_clean":"2024-03-04T13:00:15.954726+0000","last_became_active":"2024-03-04T12:36:05.279538+0000","last_became_peered":"2024-03-04T12:36:05.279538+0000","last_unstale":"2024-03-04T13:00:15.954726+0000","last_undegraded":"2024-03-04T13:00:15.954726+0000","last_fullsized":"2024-03-04T13:00:15.954726+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:35.650378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6918989,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":570,"num_read_kb":6796,"num_write":1473,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"256'748","reported_seq":2146,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.850080+0000","last_change":"2024-03-04T12:36:07.294946+0000","last_active":"2024-03-04T12:59:48.850080+0000","last_peered":"2024-03-04T12:59:48.850080+0000","last_clean":"2024-03-04T12:59:48.850080+0000","last_became_active":"2024-03-04T12:36:07.294274+0000","last_became_peered":"2024-03-04T12:36:07.294274+0000","last_unstale":"2024-03-04T12:59:48.850080+0000","last_undegraded":"2024-03-04T12:59:48.850080+0000","last_fullsized":"2024-03-04T12:59:48.850080+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:24.843354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3445,"num_read_kb":3067,"num_write":1017,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"256'327","reported_seq":909,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.962540+0000","last_change":"2024-03-04T12:36:40.391610+0000","last_active":"2024-03-04T13:00:15.962540+0000","last_peered":"2024-03-04T13:00:15.962540+0000","last_clean":"2024-03-04T13:00:15.962540+0000","last_became_active":"2024-03-04T12:36:40.391325+0000","last_became_peered":"2024-03-04T12:36:40.391325+0000","last_unstale":"2024-03-04T13:00:15.962540+0000","last_undegraded":"2024-03-04T13:00:15.962540+0000","last_fullsized":"2024-03-04T13:00:15.962540+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:12.401772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11385688,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":467,"num_read_kb":41620,"num_write":1209,"num_write_kb":38740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"256'326","reported_seq":1036,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.959228+0000","last_change":"2024-03-04T12:36:05.288067+0000","last_active":"2024-03-04T13:00:15.959228+0000","last_peered":"2024-03-04T13:00:15.959228+0000","last_clean":"2024-03-04T13:00:15.959228+0000","last_became_active":"2024-03-04T12:36:05.287744+0000","last_became_peered":"2024-03-04T12:36:05.287744+0000","last_unstale":"2024-03-04T13:00:15.959228+0000","last_undegraded":"2024-03-04T13:00:15.959228+0000","last_fullsized":"2024-03-04T13:00:15.959228+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:52.068699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4081952,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":754,"num_read_kb":29804,"num_write":1251,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"256'537","reported_seq":2091,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.609188+0000","last_change":"2024-03-04T12:36:07.302554+0000","last_active":"2024-03-04T12:59:47.609188+0000","last_peered":"2024-03-04T12:59:47.609188+0000","last_clean":"2024-03-04T12:59:47.609188+0000","last_became_active":"2024-03-04T12:36:07.302290+0000","last_became_peered":"2024-03-04T12:36:07.302290+0000","last_unstale":"2024-03-04T12:59:47.609188+0000","last_undegraded":"2024-03-04T12:59:47.609188+0000","last_fullsized":"2024-03-04T12:59:47.609188+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:53.412189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2955,"num_read_kb":2687,"num_write":726,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"256'406","reported_seq":1180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.999620+0000","last_change":"2024-03-04T12:36:05.284158+0000","last_active":"2024-03-04T13:00:15.999620+0000","last_peered":"2024-03-04T13:00:15.999620+0000","last_clean":"2024-03-04T13:00:15.999620+0000","last_became_active":"2024-03-04T12:36:05.283797+0000","last_became_peered":"2024-03-04T12:36:05.283797+0000","last_unstale":"2024-03-04T13:00:15.999620+0000","last_undegraded":"2024-03-04T13:00:15.999620+0000","last_fullsized":"2024-03-04T13:00:15.999620+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:29.801034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15904196,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":1071,"num_read_kb":38636,"num_write":1623,"num_write_kb":30809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"256'783","reported_seq":2208,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.901394+0000","last_change":"2024-03-04T12:36:07.301827+0000","last_active":"2024-03-04T12:59:54.901394+0000","last_peered":"2024-03-04T12:59:54.901394+0000","last_clean":"2024-03-04T12:59:54.901394+0000","last_became_active":"2024-03-04T12:36:07.301542+0000","last_became_peered":"2024-03-04T12:36:07.301542+0000","last_unstale":"2024-03-04T12:59:54.901394+0000","last_undegraded":"2024-03-04T12:59:54.901394+0000","last_fullsized":"2024-03-04T12:59:54.901394+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:45.175861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3434,"num_read_kb":3044,"num_write":1054,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":61919647,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":145,"num_read_kb":179702,"num_write":156,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122798080,"data_stored":122790718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5885,"num_read_kb":4252,"num_write":2245,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1077,"ondisk_log_size":1077,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":9441,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":12014,"num_read_kb":11868,"num_write":14038,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":18882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2352,"ondisk_log_size":2352,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":470,"ondisk_log_size":470,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1765411,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":15272,"num_read_kb":31264,"num_write":13026,"num_write_kb":10804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2318336,"data_stored":1877287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2190,"ondisk_log_size":2190,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1552,"num_read_kb":1546,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":187094,"num_read_kb":170304,"num_write":50851,"num_write_kb":17572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3861,"ondisk_log_size":3861,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":560694938,"num_objects":3061,"num_object_clones":0,"num_object_copies":6122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3061,"num_whiteouts":0,"num_read":32107,"num_read_kb":2210879,"num_write":75838,"num_write_kb":2282182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1146773504,"data_stored":1125152021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4086,"ondisk_log_size":4086,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":61492375,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":146,"num_read_kb":175660,"num_write":156,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122994688,"data_stored":122984750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575146,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":566116,"kb_used_data":291996,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93805724,"statfs":{"total":96636764160,"available":96057061376,"internally_reserved":0,"allocated":299003904,"data_stored":292894628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575147,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361432,"kb_used_data":109388,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94010408,"statfs":{"total":96636764160,"available":96266657792,"internally_reserved":0,"allocated":112013312,"data_stored":108598334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575147,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357592,"kb_used_data":245936,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94014248,"statfs":{"total":96636764160,"available":96270589952,"internally_reserved":0,"allocated":251838464,"data_stored":245965854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575145,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290636,"kb_used_data":223320,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94081204,"statfs":{"total":96636764160,"available":96339152896,"internally_reserved":0,"allocated":228679680,"data_stored":223855331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575145,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":461676,"kb_used_data":205620,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93910164,"statfs":{"total":96636764160,"available":96164007936,"internally_reserved":0,"allocated":210554880,"data_stored":205208502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262142407},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575146,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282108,"kb_used_data":196852,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94089732,"statfs":{"total":96636764160,"available":96347885568,"internally_reserved":0,"allocated":201576448,"data_stored":197312818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575149,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283840,"kb_used_data":176376,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94088000,"statfs":{"total":96636764160,"available":96346112000,"internally_reserved":0,"allocated":180609024,"data_stored":176119526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575146,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":476456,"kb_used_data":220440,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93895384,"statfs":{"total":96636764160,"available":96148873216,"internally_reserved":0,"allocated":225730560,"data_stored":220168485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":151445504,"data_stored":148281035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":97763328,"data_stored":95850048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":122564608,"data_stored":120666676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":148090880,"data_stored":144888191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":196055040,"data_stored":192769456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":162119680,"data_stored":159161227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92483584,"data_stored":90567117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":176250880,"data_stored":172968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":259557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":244102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":90869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":357717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":43735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":377061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":141578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":362668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28315648,"data_stored":28314756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14730523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25169028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16830464,"data_stored":16827675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19963904,"data_stored":19963089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12120064,"data_stored":12118699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22659072,"data_stored":22654918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":10525905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10539008,"data_stored":10536219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:00:18.731 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:00:19.058 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:19.069 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-03-04T13:00:19.071 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":985,"stamp":"2024-03-04T13:00:17.354830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":686473817,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":254339,"num_read_kb":2785583,"num_write":156503,"num_write_kb":2552438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14275,"ondisk_log_size":14275,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3079856,"kb_used_data":1669928,"kb_used_omap":12,"kb_used_meta":1409587,"kb_avail":751894864,"statfs":{"total":773094113280,"available":769940340736,"internally_reserved":0,"allocated":1710006272,"data_stored":1670123478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1443417648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-217867511,"num_objects":-1453,"num_object_clones":0,"num_object_copies":-2906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1453,"num_whiteouts":0,"num_read":1696,"num_read_kb":79345,"num_write":1608,"num_write_kb":39020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004414"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.981271+0000","last_change":"2024-03-04T12:51:01.353518+0000","last_active":"2024-03-04T12:56:00.981271+0000","last_peered":"2024-03-04T12:56:00.981271+0000","last_clean":"2024-03-04T12:56:00.981271+0000","last_became_active":"2024-03-04T12:51:01.353225+0000","last_became_peered":"2024-03-04T12:51:01.353225+0000","last_unstale":"2024-03-04T12:56:00.981271+0000","last_undegraded":"2024-03-04T12:56:00.981271+0000","last_fullsized":"2024-03-04T12:56:00.981271+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:20:07.047294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"256'1","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.982336+0000","last_change":"2024-03-04T12:44:53.484600+0000","last_active":"2024-03-04T12:57:25.982336+0000","last_peered":"2024-03-04T12:57:25.982336+0000","last_clean":"2024-03-04T12:57:25.982336+0000","last_became_active":"2024-03-04T12:44:53.484341+0000","last_became_peered":"2024-03-04T12:44:53.484341+0000","last_unstale":"2024-03-04T12:57:25.982336+0000","last_undegraded":"2024-03-04T12:57:25.982336+0000","last_fullsized":"2024-03-04T12:57:25.982336+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:26:14.610910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:50.981767+0000","last_change":"2024-03-04T12:44:50.455898+0000","last_active":"2024-03-04T12:56:50.981767+0000","last_peered":"2024-03-04T12:56:50.981767+0000","last_clean":"2024-03-04T12:56:50.981767+0000","last_became_active":"2024-03-04T12:44:50.455509+0000","last_became_peered":"2024-03-04T12:44:50.455509+0000","last_unstale":"2024-03-04T12:56:50.981767+0000","last_undegraded":"2024-03-04T12:56:50.981767+0000","last_fullsized":"2024-03-04T12:56:50.981767+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:49.453401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"256'40","reported_seq":137,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.123970+0000","last_change":"2024-03-04T12:43:27.060696+0000","last_active":"2024-03-04T12:58:30.123970+0000","last_peered":"2024-03-04T12:58:30.123970+0000","last_clean":"2024-03-04T12:58:30.123970+0000","last_became_active":"2024-03-04T12:43:27.060405+0000","last_became_peered":"2024-03-04T12:43:27.060405+0000","last_unstale":"2024-03-04T12:58:30.123970+0000","last_undegraded":"2024-03-04T12:58:30.123970+0000","last_fullsized":"2024-03-04T12:58:30.123970+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:44.787006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":118,"num_write":66,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.981316+0000","last_change":"2024-03-04T12:51:01.358434+0000","last_active":"2024-03-04T12:56:00.981316+0000","last_peered":"2024-03-04T12:56:00.981316+0000","last_clean":"2024-03-04T12:56:00.981316+0000","last_became_active":"2024-03-04T12:51:01.358005+0000","last_became_peered":"2024-03-04T12:51:01.358005+0000","last_unstale":"2024-03-04T12:56:00.981316+0000","last_undegraded":"2024-03-04T12:56:00.981316+0000","last_fullsized":"2024-03-04T12:56:00.981316+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:18:34.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"256'8","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.000903+0000","last_change":"2024-03-04T12:44:53.487686+0000","last_active":"2024-03-04T12:59:56.000903+0000","last_peered":"2024-03-04T12:59:56.000903+0000","last_clean":"2024-03-04T12:59:56.000903+0000","last_became_active":"2024-03-04T12:44:53.486168+0000","last_became_peered":"2024-03-04T12:44:53.486168+0000","last_unstale":"2024-03-04T12:59:56.000903+0000","last_undegraded":"2024-03-04T12:59:56.000903+0000","last_fullsized":"2024-03-04T12:59:56.000903+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:34.274997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":10242,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.998713+0000","last_change":"2024-03-04T12:44:50.450818+0000","last_active":"2024-03-04T12:57:20.998713+0000","last_peered":"2024-03-04T12:57:20.998713+0000","last_clean":"2024-03-04T12:57:20.998713+0000","last_became_active":"2024-03-04T12:44:50.450465+0000","last_became_peered":"2024-03-04T12:44:50.450465+0000","last_unstale":"2024-03-04T12:57:20.998713+0000","last_undegraded":"2024-03-04T12:57:20.998713+0000","last_fullsized":"2024-03-04T12:57:20.998713+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:20:08.194072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"250'33","reported_seq":127,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:31.000006+0000","last_change":"2024-03-04T12:43:27.060869+0000","last_active":"2024-03-04T12:57:31.000006+0000","last_peered":"2024-03-04T12:57:31.000006+0000","last_clean":"2024-03-04T12:57:31.000006+0000","last_became_active":"2024-03-04T12:43:27.060562+0000","last_became_peered":"2024-03-04T12:43:27.060562+0000","last_unstale":"2024-03-04T12:57:31.000006+0000","last_undegraded":"2024-03-04T12:57:31.000006+0000","last_fullsized":"2024-03-04T12:57:31.000006+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:48.410106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":113,"num_write":48,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.979605+0000","last_change":"2024-03-04T12:51:01.596745+0000","last_active":"2024-03-04T12:57:00.979605+0000","last_peered":"2024-03-04T12:57:00.979605+0000","last_clean":"2024-03-04T12:57:00.979605+0000","last_became_active":"2024-03-04T12:51:01.595776+0000","last_became_peered":"2024-03-04T12:51:01.595776+0000","last_unstale":"2024-03-04T12:57:00.979605+0000","last_undegraded":"2024-03-04T12:57:00.979605+0000","last_fullsized":"2024-03-04T12:57:00.979605+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:37.758945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"256'11","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.996043+0000","last_change":"2024-03-04T12:44:53.479265+0000","last_active":"2024-03-04T12:57:25.996043+0000","last_peered":"2024-03-04T12:57:25.996043+0000","last_clean":"2024-03-04T12:57:25.996043+0000","last_became_active":"2024-03-04T12:44:53.478864+0000","last_became_peered":"2024-03-04T12:44:53.478864+0000","last_unstale":"2024-03-04T12:57:25.996043+0000","last_undegraded":"2024-03-04T12:57:25.996043+0000","last_fullsized":"2024-03-04T12:57:25.996043+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:28:17.550698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":25,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.982244+0000","last_change":"2024-03-04T12:44:50.454109+0000","last_active":"2024-03-04T12:57:20.982244+0000","last_peered":"2024-03-04T12:57:20.982244+0000","last_clean":"2024-03-04T12:57:20.982244+0000","last_became_active":"2024-03-04T12:44:50.453830+0000","last_became_peered":"2024-03-04T12:44:50.453830+0000","last_unstale":"2024-03-04T12:57:20.982244+0000","last_undegraded":"2024-03-04T12:57:20.982244+0000","last_fullsized":"2024-03-04T12:57:20.982244+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:34.779841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"256'64","reported_seq":196,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:09.281547+0000","last_change":"2024-03-04T12:43:27.067573+0000","last_active":"2024-03-04T12:56:09.281547+0000","last_peered":"2024-03-04T12:56:09.281547+0000","last_clean":"2024-03-04T12:56:09.281547+0000","last_became_active":"2024-03-04T12:43:27.067330+0000","last_became_peered":"2024-03-04T12:43:27.067330+0000","last_unstale":"2024-03-04T12:56:09.281547+0000","last_undegraded":"2024-03-04T12:56:09.281547+0000","last_fullsized":"2024-03-04T12:56:09.281547+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:08.510342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":194,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998217+0000","last_change":"2024-03-04T12:51:01.596599+0000","last_active":"2024-03-04T12:57:15.998217+0000","last_peered":"2024-03-04T12:57:15.998217+0000","last_clean":"2024-03-04T12:57:15.998217+0000","last_became_active":"2024-03-04T12:51:01.596268+0000","last_became_peered":"2024-03-04T12:51:01.596268+0000","last_unstale":"2024-03-04T12:57:15.998217+0000","last_undegraded":"2024-03-04T12:57:15.998217+0000","last_fullsized":"2024-03-04T12:57:15.998217+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:07:16.190633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.982302+0000","last_change":"2024-03-04T12:44:53.482037+0000","last_active":"2024-03-04T12:56:55.982302+0000","last_peered":"2024-03-04T12:56:55.982302+0000","last_clean":"2024-03-04T12:56:55.982302+0000","last_became_active":"2024-03-04T12:44:53.481760+0000","last_became_peered":"2024-03-04T12:44:53.481760+0000","last_unstale":"2024-03-04T12:56:55.982302+0000","last_undegraded":"2024-03-04T12:56:55.982302+0000","last_fullsized":"2024-03-04T12:56:55.982302+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:44.305523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.998658+0000","last_change":"2024-03-04T12:44:50.456063+0000","last_active":"2024-03-04T12:57:20.998658+0000","last_peered":"2024-03-04T12:57:20.998658+0000","last_clean":"2024-03-04T12:57:20.998658+0000","last_became_active":"2024-03-04T12:44:50.455723+0000","last_became_peered":"2024-03-04T12:44:50.455723+0000","last_unstale":"2024-03-04T12:57:20.998658+0000","last_undegraded":"2024-03-04T12:57:20.998658+0000","last_fullsized":"2024-03-04T12:57:20.998658+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:10:27.178040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"256'150","reported_seq":499,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.311363+0000","last_change":"2024-03-04T12:43:27.067487+0000","last_active":"2024-03-04T12:57:45.311363+0000","last_peered":"2024-03-04T12:57:45.311363+0000","last_clean":"2024-03-04T12:57:45.311363+0000","last_became_active":"2024-03-04T12:43:27.067228+0000","last_became_peered":"2024-03-04T12:43:27.067228+0000","last_unstale":"2024-03-04T12:57:45.311363+0000","last_undegraded":"2024-03-04T12:57:45.311363+0000","last_fullsized":"2024-03-04T12:57:45.311363+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:38.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":889,"num_read_kb":655,"num_write":189,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.976872+0000","last_change":"2024-03-04T12:51:01.356736+0000","last_active":"2024-03-04T12:55:50.976872+0000","last_peered":"2024-03-04T12:55:50.976872+0000","last_clean":"2024-03-04T12:55:50.976872+0000","last_became_active":"2024-03-04T12:51:01.356572+0000","last_became_peered":"2024-03-04T12:51:01.356572+0000","last_unstale":"2024-03-04T12:55:50.976872+0000","last_undegraded":"2024-03-04T12:55:50.976872+0000","last_fullsized":"2024-03-04T12:55:50.976872+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:07.737968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"256'3","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991872+0000","last_change":"2024-03-04T12:44:53.477654+0000","last_active":"2024-03-04T12:57:00.991872+0000","last_peered":"2024-03-04T12:57:00.991872+0000","last_clean":"2024-03-04T12:57:00.991872+0000","last_became_active":"2024-03-04T12:44:53.477386+0000","last_became_peered":"2024-03-04T12:44:53.477386+0000","last_unstale":"2024-03-04T12:57:00.991872+0000","last_undegraded":"2024-03-04T12:57:00.991872+0000","last_fullsized":"2024-03-04T12:57:00.991872+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:49:31.357868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":418,"num_write":3,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.988386+0000","last_change":"2024-03-04T12:44:50.449002+0000","last_active":"2024-03-04T12:57:20.988386+0000","last_peered":"2024-03-04T12:57:20.988386+0000","last_clean":"2024-03-04T12:57:20.988386+0000","last_became_active":"2024-03-04T12:44:50.448683+0000","last_became_peered":"2024-03-04T12:44:50.448683+0000","last_unstale":"2024-03-04T12:57:20.988386+0000","last_undegraded":"2024-03-04T12:57:20.988386+0000","last_fullsized":"2024-03-04T12:57:20.988386+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:39.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"256'38","reported_seq":128,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:29.561426+0000","last_change":"2024-03-04T12:43:27.062948+0000","last_active":"2024-03-04T12:58:29.561426+0000","last_peered":"2024-03-04T12:58:29.561426+0000","last_clean":"2024-03-04T12:58:29.561426+0000","last_became_active":"2024-03-04T12:43:27.062623+0000","last_became_peered":"2024-03-04T12:43:27.062623+0000","last_unstale":"2024-03-04T12:58:29.561426+0000","last_undegraded":"2024-03-04T12:58:29.561426+0000","last_fullsized":"2024-03-04T12:58:29.561426+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:50.641970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.979565+0000","last_change":"2024-03-04T12:51:01.357400+0000","last_active":"2024-03-04T12:55:50.979565+0000","last_peered":"2024-03-04T12:55:50.979565+0000","last_clean":"2024-03-04T12:55:50.979565+0000","last_became_active":"2024-03-04T12:51:01.355578+0000","last_became_peered":"2024-03-04T12:51:01.355578+0000","last_unstale":"2024-03-04T12:55:50.979565+0000","last_undegraded":"2024-03-04T12:55:50.979565+0000","last_fullsized":"2024-03-04T12:55:50.979565+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:25.516318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"256'9","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996330+0000","last_change":"2024-03-04T12:44:53.477157+0000","last_active":"2024-03-04T12:57:00.996330+0000","last_peered":"2024-03-04T12:57:00.996330+0000","last_clean":"2024-03-04T12:57:00.996330+0000","last_became_active":"2024-03-04T12:44:53.476348+0000","last_became_peered":"2024-03-04T12:44:53.476348+0000","last_unstale":"2024-03-04T12:57:00.996330+0000","last_undegraded":"2024-03-04T12:57:00.996330+0000","last_fullsized":"2024-03-04T12:57:00.996330+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:43.436115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'5","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.982216+0000","last_change":"2024-03-04T12:44:50.454551+0000","last_active":"2024-03-04T12:57:20.982216+0000","last_peered":"2024-03-04T12:57:20.982216+0000","last_clean":"2024-03-04T12:57:20.982216+0000","last_became_active":"2024-03-04T12:44:50.454252+0000","last_became_peered":"2024-03-04T12:44:50.454252+0000","last_unstale":"2024-03-04T12:57:20.982216+0000","last_undegraded":"2024-03-04T12:57:20.982216+0000","last_fullsized":"2024-03-04T12:57:20.982216+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:16:14.575234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"256'25","reported_seq":96,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:27.547187+0000","last_change":"2024-03-04T12:43:27.061927+0000","last_active":"2024-03-04T12:56:27.547187+0000","last_peered":"2024-03-04T12:56:27.547187+0000","last_clean":"2024-03-04T12:56:27.547187+0000","last_became_active":"2024-03-04T12:43:27.061611+0000","last_became_peered":"2024-03-04T12:43:27.061611+0000","last_unstale":"2024-03-04T12:56:27.547187+0000","last_undegraded":"2024-03-04T12:56:27.547187+0000","last_fullsized":"2024-03-04T12:56:27.547187+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:29.841849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.972502+0000","last_change":"2024-03-04T12:51:01.351751+0000","last_active":"2024-03-04T12:56:00.972502+0000","last_peered":"2024-03-04T12:56:00.972502+0000","last_clean":"2024-03-04T12:56:00.972502+0000","last_became_active":"2024-03-04T12:51:01.351465+0000","last_became_peered":"2024-03-04T12:51:01.351465+0000","last_unstale":"2024-03-04T12:56:00.972502+0000","last_undegraded":"2024-03-04T12:56:00.972502+0000","last_fullsized":"2024-03-04T12:56:00.972502+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:15.131665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"256'3","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.999164+0000","last_change":"2024-03-04T12:44:53.483089+0000","last_active":"2024-03-04T12:57:25.999164+0000","last_peered":"2024-03-04T12:57:25.999164+0000","last_clean":"2024-03-04T12:57:25.999164+0000","last_became_active":"2024-03-04T12:44:53.482806+0000","last_became_peered":"2024-03-04T12:44:53.482806+0000","last_unstale":"2024-03-04T12:57:25.999164+0000","last_undegraded":"2024-03-04T12:57:25.999164+0000","last_fullsized":"2024-03-04T12:57:25.999164+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:48:39.848469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":36,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.978599+0000","last_change":"2024-03-04T12:44:50.457492+0000","last_active":"2024-03-04T12:56:55.978599+0000","last_peered":"2024-03-04T12:56:55.978599+0000","last_clean":"2024-03-04T12:56:55.978599+0000","last_became_active":"2024-03-04T12:44:50.457180+0000","last_became_peered":"2024-03-04T12:44:50.457180+0000","last_unstale":"2024-03-04T12:56:55.978599+0000","last_undegraded":"2024-03-04T12:56:55.978599+0000","last_fullsized":"2024-03-04T12:56:55.978599+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:05.748747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"256'43","reported_seq":131,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:08.070073+0000","last_change":"2024-03-04T12:43:27.063888+0000","last_active":"2024-03-04T12:58:08.070073+0000","last_peered":"2024-03-04T12:58:08.070073+0000","last_clean":"2024-03-04T12:58:08.070073+0000","last_became_active":"2024-03-04T12:43:27.063191+0000","last_became_peered":"2024-03-04T12:43:27.063191+0000","last_unstale":"2024-03-04T12:58:08.070073+0000","last_undegraded":"2024-03-04T12:58:08.070073+0000","last_fullsized":"2024-03-04T12:58:08.070073+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:06.499554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":76,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.978217+0000","last_change":"2024-03-04T12:51:01.353519+0000","last_active":"2024-03-04T12:56:00.978217+0000","last_peered":"2024-03-04T12:56:00.978217+0000","last_clean":"2024-03-04T12:56:00.978217+0000","last_became_active":"2024-03-04T12:51:01.353248+0000","last_became_peered":"2024-03-04T12:51:01.353248+0000","last_unstale":"2024-03-04T12:56:00.978217+0000","last_undegraded":"2024-03-04T12:56:00.978217+0000","last_fullsized":"2024-03-04T12:56:00.978217+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:08:04.830256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"250'5","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.995929+0000","last_change":"2024-03-04T12:44:53.483754+0000","last_active":"2024-03-04T12:57:25.995929+0000","last_peered":"2024-03-04T12:57:25.995929+0000","last_clean":"2024-03-04T12:57:25.995929+0000","last_became_active":"2024-03-04T12:44:53.483210+0000","last_became_peered":"2024-03-04T12:44:53.483210+0000","last_unstale":"2024-03-04T12:57:25.995929+0000","last_undegraded":"2024-03-04T12:57:25.995929+0000","last_fullsized":"2024-03-04T12:57:25.995929+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:13.903672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"256'7","reported_seq":51,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.995460+0000","last_change":"2024-03-04T12:44:50.449512+0000","last_active":"2024-03-04T12:56:55.995460+0000","last_peered":"2024-03-04T12:56:55.995460+0000","last_clean":"2024-03-04T12:56:55.995460+0000","last_became_active":"2024-03-04T12:44:50.449291+0000","last_became_peered":"2024-03-04T12:44:50.449291+0000","last_unstale":"2024-03-04T12:56:55.995460+0000","last_undegraded":"2024-03-04T12:56:55.995460+0000","last_fullsized":"2024-03-04T12:56:55.995460+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:31.117281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"256'42","reported_seq":129,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:11.125334+0000","last_change":"2024-03-04T12:43:27.061951+0000","last_active":"2024-03-04T12:58:11.125334+0000","last_peered":"2024-03-04T12:58:11.125334+0000","last_clean":"2024-03-04T12:58:11.125334+0000","last_became_active":"2024-03-04T12:43:27.061663+0000","last_became_peered":"2024-03-04T12:43:27.061663+0000","last_unstale":"2024-03-04T12:58:11.125334+0000","last_undegraded":"2024-03-04T12:58:11.125334+0000","last_fullsized":"2024-03-04T12:58:11.125334+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:27:00.046660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.970079+0000","last_change":"2024-03-04T12:51:01.596240+0000","last_active":"2024-03-04T12:55:40.970079+0000","last_peered":"2024-03-04T12:55:40.970079+0000","last_clean":"2024-03-04T12:55:40.970079+0000","last_became_active":"2024-03-04T12:51:01.595943+0000","last_became_peered":"2024-03-04T12:51:01.595943+0000","last_unstale":"2024-03-04T12:55:40.970079+0000","last_undegraded":"2024-03-04T12:55:40.970079+0000","last_fullsized":"2024-03-04T12:55:40.970079+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:05:52.818694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"256'1","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.876732+0000","last_change":"2024-03-04T12:44:53.486306+0000","last_active":"2024-03-04T12:57:00.876732+0000","last_peered":"2024-03-04T12:57:00.876732+0000","last_clean":"2024-03-04T12:57:00.876732+0000","last_became_active":"2024-03-04T12:44:53.485995+0000","last_became_peered":"2024-03-04T12:44:53.485995+0000","last_unstale":"2024-03-04T12:57:00.876732+0000","last_undegraded":"2024-03-04T12:57:00.876732+0000","last_fullsized":"2024-03-04T12:57:00.876732+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:08.363349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"256'4","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:20.996938+0000","last_change":"2024-03-04T12:44:50.454948+0000","last_active":"2024-03-04T12:59:20.996938+0000","last_peered":"2024-03-04T12:59:20.996938+0000","last_clean":"2024-03-04T12:59:20.996938+0000","last_became_active":"2024-03-04T12:44:50.454617+0000","last_became_peered":"2024-03-04T12:44:50.454617+0000","last_unstale":"2024-03-04T12:59:20.996938+0000","last_undegraded":"2024-03-04T12:59:20.996938+0000","last_fullsized":"2024-03-04T12:59:20.996938+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:25:07.798347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"256'41","reported_seq":134,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:02.415602+0000","last_change":"2024-03-04T12:43:27.050913+0000","last_active":"2024-03-04T12:58:02.415602+0000","last_peered":"2024-03-04T12:58:02.415602+0000","last_clean":"2024-03-04T12:58:02.415602+0000","last_became_active":"2024-03-04T12:43:27.050088+0000","last_became_peered":"2024-03-04T12:43:27.050088+0000","last_unstale":"2024-03-04T12:58:02.415602+0000","last_undegraded":"2024-03-04T12:58:02.415602+0000","last_fullsized":"2024-03-04T12:58:02.415602+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:10:21.742322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":112,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.971352+0000","last_change":"2024-03-04T12:51:01.595890+0000","last_active":"2024-03-04T12:55:50.971352+0000","last_peered":"2024-03-04T12:55:50.971352+0000","last_clean":"2024-03-04T12:55:50.971352+0000","last_became_active":"2024-03-04T12:51:01.595530+0000","last_became_peered":"2024-03-04T12:51:01.595530+0000","last_unstale":"2024-03-04T12:55:50.971352+0000","last_undegraded":"2024-03-04T12:55:50.971352+0000","last_fullsized":"2024-03-04T12:55:50.971352+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:42:04.439066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"256'4","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.814138+0000","last_change":"2024-03-04T12:44:53.478706+0000","last_active":"2024-03-04T13:00:15.814138+0000","last_peered":"2024-03-04T13:00:15.814138+0000","last_clean":"2024-03-04T13:00:15.814138+0000","last_became_active":"2024-03-04T12:44:53.478099+0000","last_became_peered":"2024-03-04T12:44:53.478099+0000","last_unstale":"2024-03-04T13:00:15.814138+0000","last_undegraded":"2024-03-04T13:00:15.814138+0000","last_fullsized":"2024-03-04T13:00:15.814138+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:06:14.838765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.995606+0000","last_change":"2024-03-04T12:44:50.449111+0000","last_active":"2024-03-04T12:56:55.995606+0000","last_peered":"2024-03-04T12:56:55.995606+0000","last_clean":"2024-03-04T12:56:55.995606+0000","last_became_active":"2024-03-04T12:44:50.448745+0000","last_became_peered":"2024-03-04T12:44:50.448745+0000","last_unstale":"2024-03-04T12:56:55.995606+0000","last_undegraded":"2024-03-04T12:56:55.995606+0000","last_fullsized":"2024-03-04T12:56:55.995606+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:10:12.812219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"256'16","reported_seq":80,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:14.293042+0000","last_change":"2024-03-04T12:43:27.059795+0000","last_active":"2024-03-04T12:58:14.293042+0000","last_peered":"2024-03-04T12:58:14.293042+0000","last_clean":"2024-03-04T12:58:14.293042+0000","last_became_active":"2024-03-04T12:43:27.059494+0000","last_became_peered":"2024-03-04T12:43:27.059494+0000","last_unstale":"2024-03-04T12:58:14.293042+0000","last_undegraded":"2024-03-04T12:58:14.293042+0000","last_fullsized":"2024-03-04T12:58:14.293042+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:49.787014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":48,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.979602+0000","last_change":"2024-03-04T12:51:01.355844+0000","last_active":"2024-03-04T12:55:50.979602+0000","last_peered":"2024-03-04T12:55:50.979602+0000","last_clean":"2024-03-04T12:55:50.979602+0000","last_became_active":"2024-03-04T12:51:01.355560+0000","last_became_peered":"2024-03-04T12:51:01.355560+0000","last_unstale":"2024-03-04T12:55:50.979602+0000","last_undegraded":"2024-03-04T12:55:50.979602+0000","last_fullsized":"2024-03-04T12:55:50.979602+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:05:47.161069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'3","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996437+0000","last_change":"2024-03-04T12:44:53.476693+0000","last_active":"2024-03-04T12:57:00.996437+0000","last_peered":"2024-03-04T12:57:00.996437+0000","last_clean":"2024-03-04T12:57:00.996437+0000","last_became_active":"2024-03-04T12:44:53.475861+0000","last_became_peered":"2024-03-04T12:44:53.475861+0000","last_unstale":"2024-03-04T12:57:00.996437+0000","last_undegraded":"2024-03-04T12:57:00.996437+0000","last_fullsized":"2024-03-04T12:57:00.996437+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.651931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"256'6","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.873133+0000","last_change":"2024-03-04T12:44:50.453813+0000","last_active":"2024-03-04T12:56:35.873133+0000","last_peered":"2024-03-04T12:56:35.873133+0000","last_clean":"2024-03-04T12:56:35.873133+0000","last_became_active":"2024-03-04T12:44:50.453541+0000","last_became_peered":"2024-03-04T12:44:50.453541+0000","last_unstale":"2024-03-04T12:56:35.873133+0000","last_undegraded":"2024-03-04T12:56:35.873133+0000","last_fullsized":"2024-03-04T12:56:35.873133+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:58.224158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"256'48","reported_seq":147,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.129302+0000","last_change":"2024-03-04T12:43:27.071953+0000","last_active":"2024-03-04T12:58:05.129302+0000","last_peered":"2024-03-04T12:58:05.129302+0000","last_clean":"2024-03-04T12:58:05.129302+0000","last_became_active":"2024-03-04T12:43:27.069664+0000","last_became_peered":"2024-03-04T12:43:27.069664+0000","last_unstale":"2024-03-04T12:58:05.129302+0000","last_undegraded":"2024-03-04T12:58:05.129302+0000","last_fullsized":"2024-03-04T12:58:05.129302+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:18:04.123917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":13,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.992618+0000","last_change":"2024-03-04T12:51:41.753110+0000","last_active":"2024-03-04T12:56:30.992618+0000","last_peered":"2024-03-04T12:56:30.992618+0000","last_clean":"2024-03-04T12:56:30.992618+0000","last_became_active":"2024-03-04T12:51:41.752775+0000","last_became_peered":"2024-03-04T12:51:41.752775+0000","last_unstale":"2024-03-04T12:56:30.992618+0000","last_undegraded":"2024-03-04T12:56:30.992618+0000","last_fullsized":"2024-03-04T12:56:30.992618+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:14.336520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"256'6","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.983024+0000","last_change":"2024-03-04T12:44:53.478491+0000","last_active":"2024-03-04T12:57:00.983024+0000","last_peered":"2024-03-04T12:57:00.983024+0000","last_clean":"2024-03-04T12:57:00.983024+0000","last_became_active":"2024-03-04T12:44:53.478126+0000","last_became_peered":"2024-03-04T12:44:53.478126+0000","last_unstale":"2024-03-04T12:57:00.983024+0000","last_undegraded":"2024-03-04T12:57:00.983024+0000","last_fullsized":"2024-03-04T12:57:00.983024+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:47.296637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":11793,"num_write":11,"num_write_kb":7697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'1","reported_seq":38,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.982270+0000","last_change":"2024-03-04T12:44:50.455922+0000","last_active":"2024-03-04T12:56:55.982270+0000","last_peered":"2024-03-04T12:56:55.982270+0000","last_clean":"2024-03-04T12:56:55.982270+0000","last_became_active":"2024-03-04T12:44:50.455571+0000","last_became_peered":"2024-03-04T12:44:50.455571+0000","last_unstale":"2024-03-04T12:56:55.982270+0000","last_undegraded":"2024-03-04T12:56:55.982270+0000","last_fullsized":"2024-03-04T12:56:55.982270+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:00.096593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"256'47","reported_seq":142,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.983079+0000","last_change":"2024-03-04T12:43:27.060510+0000","last_active":"2024-03-04T12:57:30.983079+0000","last_peered":"2024-03-04T12:57:30.983079+0000","last_clean":"2024-03-04T12:57:30.983079+0000","last_became_active":"2024-03-04T12:43:27.060225+0000","last_became_peered":"2024-03-04T12:43:27.060225+0000","last_unstale":"2024-03-04T12:57:30.983079+0000","last_undegraded":"2024-03-04T12:57:30.983079+0000","last_fullsized":"2024-03-04T12:57:30.983079+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:54.961280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":112,"num_write":82,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.969881+0000","last_change":"2024-03-04T12:51:01.353480+0000","last_active":"2024-03-04T12:55:40.969881+0000","last_peered":"2024-03-04T12:55:40.969881+0000","last_clean":"2024-03-04T12:55:40.969881+0000","last_became_active":"2024-03-04T12:51:01.353087+0000","last_became_peered":"2024-03-04T12:51:01.353087+0000","last_unstale":"2024-03-04T12:55:40.969881+0000","last_undegraded":"2024-03-04T12:55:40.969881+0000","last_fullsized":"2024-03-04T12:55:40.969881+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:41.880369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.976551+0000","last_change":"2024-03-04T12:44:53.486342+0000","last_active":"2024-03-04T12:56:35.976551+0000","last_peered":"2024-03-04T12:56:35.976551+0000","last_clean":"2024-03-04T12:56:35.976551+0000","last_became_active":"2024-03-04T12:44:53.485819+0000","last_became_peered":"2024-03-04T12:44:53.485819+0000","last_unstale":"2024-03-04T12:56:35.976551+0000","last_undegraded":"2024-03-04T12:56:35.976551+0000","last_fullsized":"2024-03-04T12:56:35.976551+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:16.679448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"256'15","reported_seq":69,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.992528+0000","last_change":"2024-03-04T12:44:50.451881+0000","last_active":"2024-03-04T12:56:30.992528+0000","last_peered":"2024-03-04T12:56:30.992528+0000","last_clean":"2024-03-04T12:56:30.992528+0000","last_became_active":"2024-03-04T12:44:50.451612+0000","last_became_peered":"2024-03-04T12:44:50.451612+0000","last_unstale":"2024-03-04T12:56:30.992528+0000","last_undegraded":"2024-03-04T12:56:30.992528+0000","last_fullsized":"2024-03-04T12:56:30.992528+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:32.014515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":29700,"num_write":23,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"256'29","reported_seq":109,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.986253+0000","last_change":"2024-03-04T12:43:27.067821+0000","last_active":"2024-03-04T12:57:30.986253+0000","last_peered":"2024-03-04T12:57:30.986253+0000","last_clean":"2024-03-04T12:57:30.986253+0000","last_became_active":"2024-03-04T12:43:27.067356+0000","last_became_peered":"2024-03-04T12:43:27.067356+0000","last_unstale":"2024-03-04T12:57:30.986253+0000","last_undegraded":"2024-03-04T12:57:30.986253+0000","last_fullsized":"2024-03-04T12:57:30.986253+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:08.857494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":50,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.969928+0000","last_change":"2024-03-04T12:51:01.353135+0000","last_active":"2024-03-04T12:55:40.969928+0000","last_peered":"2024-03-04T12:55:40.969928+0000","last_clean":"2024-03-04T12:55:40.969928+0000","last_became_active":"2024-03-04T12:51:01.352205+0000","last_became_peered":"2024-03-04T12:51:01.352205+0000","last_unstale":"2024-03-04T12:55:40.969928+0000","last_undegraded":"2024-03-04T12:55:40.969928+0000","last_fullsized":"2024-03-04T12:55:40.969928+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:10:58.627530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"256'8","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:56.009808+0000","last_change":"2024-03-04T12:44:53.480313+0000","last_active":"2024-03-04T12:58:56.009808+0000","last_peered":"2024-03-04T12:58:56.009808+0000","last_clean":"2024-03-04T12:58:56.009808+0000","last_became_active":"2024-03-04T12:44:53.479906+0000","last_became_peered":"2024-03-04T12:44:53.479906+0000","last_unstale":"2024-03-04T12:58:56.009808+0000","last_undegraded":"2024-03-04T12:58:56.009808+0000","last_fullsized":"2024-03-04T12:58:56.009808+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:21.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":8765,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"256'2","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:50.892362+0000","last_change":"2024-03-04T12:44:50.455993+0000","last_active":"2024-03-04T12:58:50.892362+0000","last_peered":"2024-03-04T12:58:50.892362+0000","last_clean":"2024-03-04T12:58:50.892362+0000","last_became_active":"2024-03-04T12:44:50.455705+0000","last_became_peered":"2024-03-04T12:44:50.455705+0000","last_unstale":"2024-03-04T12:58:50.892362+0000","last_undegraded":"2024-03-04T12:58:50.892362+0000","last_fullsized":"2024-03-04T12:58:50.892362+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:28:07.679290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"256'37","reported_seq":129,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996807+0000","last_change":"2024-03-04T12:43:27.050258+0000","last_active":"2024-03-04T12:57:30.996807+0000","last_peered":"2024-03-04T12:57:30.996807+0000","last_clean":"2024-03-04T12:57:30.996807+0000","last_became_active":"2024-03-04T12:43:27.049948+0000","last_became_peered":"2024-03-04T12:43:27.049948+0000","last_unstale":"2024-03-04T12:57:30.996807+0000","last_undegraded":"2024-03-04T12:57:30.996807+0000","last_fullsized":"2024-03-04T12:57:30.996807+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:58:15.839313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":102,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.975555+0000","last_change":"2024-03-04T12:51:01.355931+0000","last_active":"2024-03-04T12:55:40.975555+0000","last_peered":"2024-03-04T12:55:40.975555+0000","last_clean":"2024-03-04T12:55:40.975555+0000","last_became_active":"2024-03-04T12:51:01.355460+0000","last_became_peered":"2024-03-04T12:51:01.355460+0000","last_unstale":"2024-03-04T12:55:40.975555+0000","last_undegraded":"2024-03-04T12:55:40.975555+0000","last_fullsized":"2024-03-04T12:55:40.975555+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:17:13.384167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.987291+0000","last_change":"2024-03-04T12:44:53.483084+0000","last_active":"2024-03-04T12:56:35.987291+0000","last_peered":"2024-03-04T12:56:35.987291+0000","last_clean":"2024-03-04T12:56:35.987291+0000","last_became_active":"2024-03-04T12:44:53.482573+0000","last_became_peered":"2024-03-04T12:44:53.482573+0000","last_unstale":"2024-03-04T12:56:35.987291+0000","last_undegraded":"2024-03-04T12:56:35.987291+0000","last_fullsized":"2024-03-04T12:56:35.987291+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:53.724969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":36,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.975976+0000","last_change":"2024-03-04T12:44:50.453266+0000","last_active":"2024-03-04T12:56:30.975976+0000","last_peered":"2024-03-04T12:56:30.975976+0000","last_clean":"2024-03-04T12:56:30.975976+0000","last_became_active":"2024-03-04T12:44:50.450815+0000","last_became_peered":"2024-03-04T12:44:50.450815+0000","last_unstale":"2024-03-04T12:56:30.975976+0000","last_undegraded":"2024-03-04T12:56:30.975976+0000","last_fullsized":"2024-03-04T12:56:30.975976+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:55.139788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"256'28","reported_seq":105,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996809+0000","last_change":"2024-03-04T12:43:27.056330+0000","last_active":"2024-03-04T12:57:30.996809+0000","last_peered":"2024-03-04T12:57:30.996809+0000","last_clean":"2024-03-04T12:57:30.996809+0000","last_became_active":"2024-03-04T12:43:27.055932+0000","last_became_peered":"2024-03-04T12:43:27.055932+0000","last_unstale":"2024-03-04T12:57:30.996809+0000","last_undegraded":"2024-03-04T12:57:30.996809+0000","last_fullsized":"2024-03-04T12:57:30.996809+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:37.799617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"253'1","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.970059+0000","last_change":"2024-03-04T12:51:01.356544+0000","last_active":"2024-03-04T12:55:40.970059+0000","last_peered":"2024-03-04T12:55:40.970059+0000","last_clean":"2024-03-04T12:55:40.970059+0000","last_became_active":"2024-03-04T12:51:01.356234+0000","last_became_peered":"2024-03-04T12:51:01.356234+0000","last_unstale":"2024-03-04T12:55:40.970059+0000","last_undegraded":"2024-03-04T12:55:40.970059+0000","last_fullsized":"2024-03-04T12:55:40.970059+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:48:48.586485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.982336+0000","last_change":"2024-03-04T12:44:53.481928+0000","last_active":"2024-03-04T12:56:35.982336+0000","last_peered":"2024-03-04T12:56:35.982336+0000","last_clean":"2024-03-04T12:56:35.982336+0000","last_became_active":"2024-03-04T12:44:53.481628+0000","last_became_peered":"2024-03-04T12:44:53.481628+0000","last_unstale":"2024-03-04T12:56:35.982336+0000","last_undegraded":"2024-03-04T12:56:35.982336+0000","last_fullsized":"2024-03-04T12:56:35.982336+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:17.939017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.986374+0000","last_change":"2024-03-04T12:44:50.457916+0000","last_active":"2024-03-04T12:56:30.986374+0000","last_peered":"2024-03-04T12:56:30.986374+0000","last_clean":"2024-03-04T12:56:30.986374+0000","last_became_active":"2024-03-04T12:44:50.457629+0000","last_became_peered":"2024-03-04T12:44:50.457629+0000","last_unstale":"2024-03-04T12:56:30.986374+0000","last_undegraded":"2024-03-04T12:56:30.986374+0000","last_fullsized":"2024-03-04T12:56:30.986374+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:34.728903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"256'46","reported_seq":148,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.983328+0000","last_change":"2024-03-04T12:43:27.061563+0000","last_active":"2024-03-04T12:57:30.983328+0000","last_peered":"2024-03-04T12:57:30.983328+0000","last_clean":"2024-03-04T12:57:30.983328+0000","last_became_active":"2024-03-04T12:43:27.061268+0000","last_became_peered":"2024-03-04T12:43:27.061268+0000","last_unstale":"2024-03-04T12:57:30.983328+0000","last_undegraded":"2024-03-04T12:57:30.983328+0000","last_fullsized":"2024-03-04T12:57:30.983328+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:22.110813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":125,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"254'1","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985556+0000","last_change":"2024-03-04T12:51:01.352006+0000","last_active":"2024-03-04T12:57:45.985556+0000","last_peered":"2024-03-04T12:57:45.985556+0000","last_clean":"2024-03-04T12:57:45.985556+0000","last_became_active":"2024-03-04T12:51:01.351718+0000","last_became_peered":"2024-03-04T12:51:01.351718+0000","last_unstale":"2024-03-04T12:57:45.985556+0000","last_undegraded":"2024-03-04T12:57:45.985556+0000","last_fullsized":"2024-03-04T12:57:45.985556+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:24:57.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"256'6","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.977187+0000","last_change":"2024-03-04T12:44:53.480592+0000","last_active":"2024-03-04T12:56:10.977187+0000","last_peered":"2024-03-04T12:56:10.977187+0000","last_clean":"2024-03-04T12:56:10.977187+0000","last_became_active":"2024-03-04T12:44:53.480237+0000","last_became_peered":"2024-03-04T12:44:53.480237+0000","last_unstale":"2024-03-04T12:56:10.977187+0000","last_undegraded":"2024-03-04T12:56:10.977187+0000","last_fullsized":"2024-03-04T12:56:10.977187+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:42.531307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"256'3","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.982286+0000","last_change":"2024-03-04T12:44:50.451651+0000","last_active":"2024-03-04T12:56:05.982286+0000","last_peered":"2024-03-04T12:56:05.982286+0000","last_clean":"2024-03-04T12:56:05.982286+0000","last_became_active":"2024-03-04T12:44:50.451353+0000","last_became_peered":"2024-03-04T12:44:50.451353+0000","last_unstale":"2024-03-04T12:56:05.982286+0000","last_undegraded":"2024-03-04T12:56:05.982286+0000","last_fullsized":"2024-03-04T12:56:05.982286+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:38.552540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"256'22","reported_seq":88,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991999+0000","last_change":"2024-03-04T12:43:27.060928+0000","last_active":"2024-03-04T12:57:00.991999+0000","last_peered":"2024-03-04T12:57:00.991999+0000","last_clean":"2024-03-04T12:57:00.991999+0000","last_became_active":"2024-03-04T12:43:27.060626+0000","last_became_peered":"2024-03-04T12:43:27.060626+0000","last_unstale":"2024-03-04T12:57:00.991999+0000","last_undegraded":"2024-03-04T12:57:00.991999+0000","last_fullsized":"2024-03-04T12:57:00.991999+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:18.681323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":39,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985610+0000","last_change":"2024-03-04T12:51:01.356830+0000","last_active":"2024-03-04T12:57:45.985610+0000","last_peered":"2024-03-04T12:57:45.985610+0000","last_clean":"2024-03-04T12:57:45.985610+0000","last_became_active":"2024-03-04T12:51:01.356268+0000","last_became_peered":"2024-03-04T12:51:01.356268+0000","last_unstale":"2024-03-04T12:57:45.985610+0000","last_undegraded":"2024-03-04T12:57:45.985610+0000","last_fullsized":"2024-03-04T12:57:45.985610+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:55:16.934337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:25.889144+0000","last_change":"2024-03-04T12:44:53.489009+0000","last_active":"2024-03-04T12:58:25.889144+0000","last_peered":"2024-03-04T12:58:25.889144+0000","last_clean":"2024-03-04T12:58:25.889144+0000","last_became_active":"2024-03-04T12:44:53.488798+0000","last_became_peered":"2024-03-04T12:44:53.488798+0000","last_unstale":"2024-03-04T12:58:25.889144+0000","last_undegraded":"2024-03-04T12:58:25.889144+0000","last_fullsized":"2024-03-04T12:58:25.889144+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:57.438592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'7","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.973217+0000","last_change":"2024-03-04T12:44:50.449837+0000","last_active":"2024-03-04T12:56:05.973217+0000","last_peered":"2024-03-04T12:56:05.973217+0000","last_clean":"2024-03-04T12:56:05.973217+0000","last_became_active":"2024-03-04T12:44:50.449555+0000","last_became_peered":"2024-03-04T12:44:50.449555+0000","last_unstale":"2024-03-04T12:56:05.973217+0000","last_undegraded":"2024-03-04T12:56:05.973217+0000","last_fullsized":"2024-03-04T12:56:05.973217+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:28:29.864964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":9220,"num_write":12,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"256'38","reported_seq":131,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.628221+0000","last_change":"2024-03-04T12:43:27.062921+0000","last_active":"2024-03-04T12:58:30.628221+0000","last_peered":"2024-03-04T12:58:30.628221+0000","last_clean":"2024-03-04T12:58:30.628221+0000","last_became_active":"2024-03-04T12:43:27.062618+0000","last_became_peered":"2024-03-04T12:43:27.062618+0000","last_unstale":"2024-03-04T12:58:30.628221+0000","last_undegraded":"2024-03-04T12:58:30.628221+0000","last_fullsized":"2024-03-04T12:58:30.628221+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:15.108779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":110,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985636+0000","last_change":"2024-03-04T12:51:01.358213+0000","last_active":"2024-03-04T12:57:45.985636+0000","last_peered":"2024-03-04T12:57:45.985636+0000","last_clean":"2024-03-04T12:57:45.985636+0000","last_became_active":"2024-03-04T12:51:01.357842+0000","last_became_peered":"2024-03-04T12:51:01.357842+0000","last_unstale":"2024-03-04T12:57:45.985636+0000","last_undegraded":"2024-03-04T12:57:45.985636+0000","last_fullsized":"2024-03-04T12:57:45.985636+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:49:05.564345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"256'1","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.973737+0000","last_change":"2024-03-04T12:44:53.483502+0000","last_active":"2024-03-04T12:56:10.973737+0000","last_peered":"2024-03-04T12:56:10.973737+0000","last_clean":"2024-03-04T12:56:10.973737+0000","last_became_active":"2024-03-04T12:44:53.483209+0000","last_became_peered":"2024-03-04T12:44:53.483209+0000","last_unstale":"2024-03-04T12:56:10.973737+0000","last_undegraded":"2024-03-04T12:56:10.973737+0000","last_fullsized":"2024-03-04T12:56:10.973737+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:30.529782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"256'4","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.976647+0000","last_change":"2024-03-04T12:44:50.458501+0000","last_active":"2024-03-04T12:56:05.976647+0000","last_peered":"2024-03-04T12:56:05.976647+0000","last_clean":"2024-03-04T12:56:05.976647+0000","last_became_active":"2024-03-04T12:44:50.458158+0000","last_became_peered":"2024-03-04T12:44:50.458158+0000","last_unstale":"2024-03-04T12:56:05.976647+0000","last_undegraded":"2024-03-04T12:56:05.976647+0000","last_fullsized":"2024-03-04T12:56:05.976647+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:23.431721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"256'48","reported_seq":150,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991998+0000","last_change":"2024-03-04T12:43:27.058847+0000","last_active":"2024-03-04T12:57:00.991998+0000","last_peered":"2024-03-04T12:57:00.991998+0000","last_clean":"2024-03-04T12:57:00.991998+0000","last_became_active":"2024-03-04T12:43:27.058410+0000","last_became_peered":"2024-03-04T12:43:27.058410+0000","last_unstale":"2024-03-04T12:57:00.991998+0000","last_undegraded":"2024-03-04T12:57:00.991998+0000","last_fullsized":"2024-03-04T12:57:00.991998+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:41.466619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":132,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985014+0000","last_change":"2024-03-04T12:51:01.597461+0000","last_active":"2024-03-04T12:57:45.985014+0000","last_peered":"2024-03-04T12:57:45.985014+0000","last_clean":"2024-03-04T12:57:45.985014+0000","last_became_active":"2024-03-04T12:51:01.597162+0000","last_became_peered":"2024-03-04T12:51:01.597162+0000","last_unstale":"2024-03-04T12:57:45.985014+0000","last_undegraded":"2024-03-04T12:57:45.985014+0000","last_fullsized":"2024-03-04T12:57:45.985014+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:42:36.597535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.989977+0000","last_change":"2024-03-04T12:44:53.478668+0000","last_active":"2024-03-04T12:56:10.989977+0000","last_peered":"2024-03-04T12:56:10.989977+0000","last_clean":"2024-03-04T12:56:10.989977+0000","last_became_active":"2024-03-04T12:44:53.478352+0000","last_became_peered":"2024-03-04T12:44:53.478352+0000","last_unstale":"2024-03-04T12:56:10.989977+0000","last_undegraded":"2024-03-04T12:56:10.989977+0000","last_fullsized":"2024-03-04T12:56:10.989977+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:59:40.881954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"256'1","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.978806+0000","last_change":"2024-03-04T12:44:50.449921+0000","last_active":"2024-03-04T12:56:05.978806+0000","last_peered":"2024-03-04T12:56:05.978806+0000","last_clean":"2024-03-04T12:56:05.978806+0000","last_became_active":"2024-03-04T12:44:50.449627+0000","last_became_peered":"2024-03-04T12:44:50.449627+0000","last_unstale":"2024-03-04T12:56:05.978806+0000","last_undegraded":"2024-03-04T12:56:05.978806+0000","last_fullsized":"2024-03-04T12:56:05.978806+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:14:46.561998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"244'9","reported_seq":65,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991914+0000","last_change":"2024-03-04T12:43:27.057430+0000","last_active":"2024-03-04T12:57:00.991914+0000","last_peered":"2024-03-04T12:57:00.991914+0000","last_clean":"2024-03-04T12:57:00.991914+0000","last_became_active":"2024-03-04T12:43:27.057074+0000","last_became_peered":"2024-03-04T12:43:27.057074+0000","last_unstale":"2024-03-04T12:57:00.991914+0000","last_undegraded":"2024-03-04T12:57:00.991914+0000","last_fullsized":"2024-03-04T12:57:00.991914+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:45.722473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.881147+0000","last_change":"2024-03-04T12:51:01.595664+0000","last_active":"2024-03-04T12:57:30.881147+0000","last_peered":"2024-03-04T12:57:30.881147+0000","last_clean":"2024-03-04T12:57:30.881147+0000","last_became_active":"2024-03-04T12:51:01.595390+0000","last_became_peered":"2024-03-04T12:51:01.595390+0000","last_unstale":"2024-03-04T12:57:30.881147+0000","last_undegraded":"2024-03-04T12:57:30.881147+0000","last_fullsized":"2024-03-04T12:57:30.881147+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:23.043787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"256'6","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.986440+0000","last_change":"2024-03-04T12:44:53.484184+0000","last_active":"2024-03-04T12:57:55.986440+0000","last_peered":"2024-03-04T12:57:55.986440+0000","last_clean":"2024-03-04T12:57:55.986440+0000","last_became_active":"2024-03-04T12:44:53.482800+0000","last_became_peered":"2024-03-04T12:44:53.482800+0000","last_unstale":"2024-03-04T12:57:55.986440+0000","last_undegraded":"2024-03-04T12:57:55.986440+0000","last_fullsized":"2024-03-04T12:57:55.986440+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:58.026882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'6","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.884861+0000","last_change":"2024-03-04T12:44:50.456248+0000","last_active":"2024-03-04T12:57:55.884861+0000","last_peered":"2024-03-04T12:57:55.884861+0000","last_clean":"2024-03-04T12:57:55.884861+0000","last_became_active":"2024-03-04T12:44:50.455937+0000","last_became_peered":"2024-03-04T12:44:50.455937+0000","last_unstale":"2024-03-04T12:57:55.884861+0000","last_undegraded":"2024-03-04T12:57:55.884861+0000","last_fullsized":"2024-03-04T12:57:55.884861+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:23.581048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":5,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"256'148","reported_seq":390,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:44.913079+0000","last_change":"2024-03-04T12:43:27.065338+0000","last_active":"2024-03-04T12:57:44.913079+0000","last_peered":"2024-03-04T12:57:44.913079+0000","last_clean":"2024-03-04T12:57:44.913079+0000","last_became_active":"2024-03-04T12:43:27.065085+0000","last_became_peered":"2024-03-04T12:43:27.065085+0000","last_unstale":"2024-03-04T12:57:44.913079+0000","last_undegraded":"2024-03-04T12:57:44.913079+0000","last_fullsized":"2024-03-04T12:57:44.913079+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:46.662116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":610,"num_read_kb":432,"num_write":236,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996782+0000","last_change":"2024-03-04T12:51:01.353357+0000","last_active":"2024-03-04T12:57:30.996782+0000","last_peered":"2024-03-04T12:57:30.996782+0000","last_clean":"2024-03-04T12:57:30.996782+0000","last_became_active":"2024-03-04T12:51:01.353012+0000","last_became_peered":"2024-03-04T12:51:01.353012+0000","last_unstale":"2024-03-04T12:57:30.996782+0000","last_undegraded":"2024-03-04T12:57:30.996782+0000","last_fullsized":"2024-03-04T12:57:30.996782+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:49:18.123279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"256'5","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.003246+0000","last_change":"2024-03-04T12:44:53.484778+0000","last_active":"2024-03-04T12:57:56.003246+0000","last_peered":"2024-03-04T12:57:56.003246+0000","last_clean":"2024-03-04T12:57:56.003246+0000","last_became_active":"2024-03-04T12:44:53.484514+0000","last_became_peered":"2024-03-04T12:44:53.484514+0000","last_unstale":"2024-03-04T12:57:56.003246+0000","last_undegraded":"2024-03-04T12:57:56.003246+0000","last_fullsized":"2024-03-04T12:57:56.003246+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:17.495701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":4138,"num_write":4,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"256'3","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.989386+0000","last_change":"2024-03-04T12:44:50.450378+0000","last_active":"2024-03-04T12:56:05.989386+0000","last_peered":"2024-03-04T12:56:05.989386+0000","last_clean":"2024-03-04T12:56:05.989386+0000","last_became_active":"2024-03-04T12:44:50.450101+0000","last_became_peered":"2024-03-04T12:44:50.450101+0000","last_unstale":"2024-03-04T12:56:05.989386+0000","last_undegraded":"2024-03-04T12:56:05.989386+0000","last_fullsized":"2024-03-04T12:56:05.989386+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:55:05.158919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"256'27","reported_seq":98,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.979590+0000","last_change":"2024-03-04T12:43:27.068000+0000","last_active":"2024-03-04T12:56:30.979590+0000","last_peered":"2024-03-04T12:56:30.979590+0000","last_clean":"2024-03-04T12:56:30.979590+0000","last_became_active":"2024-03-04T12:43:27.067391+0000","last_became_peered":"2024-03-04T12:43:27.067391+0000","last_unstale":"2024-03-04T12:56:30.979590+0000","last_undegraded":"2024-03-04T12:56:30.979590+0000","last_fullsized":"2024-03-04T12:56:30.979590+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:51:04.022422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:35.881989+0000","last_change":"2024-03-04T12:51:01.352487+0000","last_active":"2024-03-04T12:57:35.881989+0000","last_peered":"2024-03-04T12:57:35.881989+0000","last_clean":"2024-03-04T12:57:35.881989+0000","last_became_active":"2024-03-04T12:51:01.352191+0000","last_became_peered":"2024-03-04T12:51:01.352191+0000","last_unstale":"2024-03-04T12:57:35.881989+0000","last_undegraded":"2024-03-04T12:57:35.881989+0000","last_fullsized":"2024-03-04T12:57:35.881989+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:22.391789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"256'1","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.983144+0000","last_change":"2024-03-04T12:44:53.482531+0000","last_active":"2024-03-04T12:56:10.983144+0000","last_peered":"2024-03-04T12:56:10.983144+0000","last_clean":"2024-03-04T12:56:10.983144+0000","last_became_active":"2024-03-04T12:44:53.482253+0000","last_became_peered":"2024-03-04T12:44:53.482253+0000","last_unstale":"2024-03-04T12:56:10.983144+0000","last_undegraded":"2024-03-04T12:56:10.983144+0000","last_fullsized":"2024-03-04T12:56:10.983144+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:55:37.720046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.992327+0000","last_change":"2024-03-04T12:44:50.449345+0000","last_active":"2024-03-04T12:57:50.992327+0000","last_peered":"2024-03-04T12:57:50.992327+0000","last_clean":"2024-03-04T12:57:50.992327+0000","last_became_active":"2024-03-04T12:44:50.449070+0000","last_became_peered":"2024-03-04T12:44:50.449070+0000","last_unstale":"2024-03-04T12:57:50.992327+0000","last_undegraded":"2024-03-04T12:57:50.992327+0000","last_fullsized":"2024-03-04T12:57:50.992327+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:55.637780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"256'13","reported_seq":71,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:31.228261+0000","last_change":"2024-03-04T12:43:27.061968+0000","last_active":"2024-03-04T12:56:31.228261+0000","last_peered":"2024-03-04T12:56:31.228261+0000","last_clean":"2024-03-04T12:56:31.228261+0000","last_became_active":"2024-03-04T12:43:27.061574+0000","last_became_peered":"2024-03-04T12:43:27.061574+0000","last_unstale":"2024-03-04T12:56:31.228261+0000","last_undegraded":"2024-03-04T12:56:31.228261+0000","last_fullsized":"2024-03-04T12:56:31.228261+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:18:07.868716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.984940+0000","last_change":"2024-03-04T12:51:01.356675+0000","last_active":"2024-03-04T12:57:45.984940+0000","last_peered":"2024-03-04T12:57:45.984940+0000","last_clean":"2024-03-04T12:57:45.984940+0000","last_became_active":"2024-03-04T12:51:01.356286+0000","last_became_peered":"2024-03-04T12:51:01.356286+0000","last_unstale":"2024-03-04T12:57:45.984940+0000","last_undegraded":"2024-03-04T12:57:45.984940+0000","last_fullsized":"2024-03-04T12:57:45.984940+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:02:42.855512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"256'5","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.018577+0000","last_change":"2024-03-04T12:44:53.478083+0000","last_active":"2024-03-04T13:00:06.018577+0000","last_peered":"2024-03-04T13:00:06.018577+0000","last_clean":"2024-03-04T13:00:06.018577+0000","last_became_active":"2024-03-04T12:44:53.477801+0000","last_became_peered":"2024-03-04T12:44:53.477801+0000","last_unstale":"2024-03-04T13:00:06.018577+0000","last_undegraded":"2024-03-04T13:00:06.018577+0000","last_fullsized":"2024-03-04T13:00:06.018577+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:23.298015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"256'3","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.001397+0000","last_change":"2024-03-04T12:44:50.456287+0000","last_active":"2024-03-04T13:00:01.001397+0000","last_peered":"2024-03-04T13:00:01.001397+0000","last_clean":"2024-03-04T13:00:01.001397+0000","last_became_active":"2024-03-04T12:44:50.456005+0000","last_became_peered":"2024-03-04T12:44:50.456005+0000","last_unstale":"2024-03-04T13:00:01.001397+0000","last_undegraded":"2024-03-04T13:00:01.001397+0000","last_fullsized":"2024-03-04T13:00:01.001397+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:59:09.950535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"256'19","reported_seq":84,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.981609+0000","last_change":"2024-03-04T12:43:27.055261+0000","last_active":"2024-03-04T12:56:30.981609+0000","last_peered":"2024-03-04T12:56:30.981609+0000","last_clean":"2024-03-04T12:56:30.981609+0000","last_became_active":"2024-03-04T12:43:27.054951+0000","last_became_peered":"2024-03-04T12:43:27.054951+0000","last_unstale":"2024-03-04T12:56:30.981609+0000","last_undegraded":"2024-03-04T12:56:30.981609+0000","last_fullsized":"2024-03-04T12:56:30.981609+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:25:39.570283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":48,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998179+0000","last_change":"2024-03-04T12:51:01.596612+0000","last_active":"2024-03-04T12:57:15.998179+0000","last_peered":"2024-03-04T12:57:15.998179+0000","last_clean":"2024-03-04T12:57:15.998179+0000","last_became_active":"2024-03-04T12:51:01.596248+0000","last_became_peered":"2024-03-04T12:51:01.596248+0000","last_unstale":"2024-03-04T12:57:15.998179+0000","last_undegraded":"2024-03-04T12:57:15.998179+0000","last_fullsized":"2024-03-04T12:57:15.998179+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:41:22.243454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.985709+0000","last_change":"2024-03-04T12:44:53.481249+0000","last_active":"2024-03-04T12:57:25.985709+0000","last_peered":"2024-03-04T12:57:25.985709+0000","last_clean":"2024-03-04T12:57:25.985709+0000","last_became_active":"2024-03-04T12:44:53.480987+0000","last_became_peered":"2024-03-04T12:44:53.480987+0000","last_unstale":"2024-03-04T12:57:25.985709+0000","last_undegraded":"2024-03-04T12:57:25.985709+0000","last_fullsized":"2024-03-04T12:57:25.985709+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:51:53.423493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"256'4","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.425589+0000","last_change":"2024-03-04T12:44:50.456748+0000","last_active":"2024-03-04T13:00:15.425589+0000","last_peered":"2024-03-04T13:00:15.425589+0000","last_clean":"2024-03-04T13:00:15.425589+0000","last_became_active":"2024-03-04T12:44:50.455944+0000","last_became_peered":"2024-03-04T12:44:50.455944+0000","last_unstale":"2024-03-04T13:00:15.425589+0000","last_undegraded":"2024-03-04T13:00:15.425589+0000","last_fullsized":"2024-03-04T13:00:15.425589+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:14:51.600085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"256'15","reported_seq":78,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.979646+0000","last_change":"2024-03-04T12:43:27.060487+0000","last_active":"2024-03-04T12:56:30.979646+0000","last_peered":"2024-03-04T12:56:30.979646+0000","last_clean":"2024-03-04T12:56:30.979646+0000","last_became_active":"2024-03-04T12:43:27.060180+0000","last_became_peered":"2024-03-04T12:43:27.060180+0000","last_unstale":"2024-03-04T12:56:30.979646+0000","last_undegraded":"2024-03-04T12:56:30.979646+0000","last_fullsized":"2024-03-04T12:56:30.979646+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:19.510448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998192+0000","last_change":"2024-03-04T12:51:01.350629+0000","last_active":"2024-03-04T12:57:15.998192+0000","last_peered":"2024-03-04T12:57:15.998192+0000","last_clean":"2024-03-04T12:57:15.998192+0000","last_became_active":"2024-03-04T12:51:01.350349+0000","last_became_peered":"2024-03-04T12:51:01.350349+0000","last_unstale":"2024-03-04T12:57:15.998192+0000","last_undegraded":"2024-03-04T12:57:15.998192+0000","last_fullsized":"2024-03-04T12:57:15.998192+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:57.667851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"256'5","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.880408+0000","last_change":"2024-03-04T12:44:53.485721+0000","last_active":"2024-03-04T12:57:25.880408+0000","last_peered":"2024-03-04T12:57:25.880408+0000","last_clean":"2024-03-04T12:57:25.880408+0000","last_became_active":"2024-03-04T12:44:53.485429+0000","last_became_peered":"2024-03-04T12:44:53.485429+0000","last_unstale":"2024-03-04T12:57:25.880408+0000","last_undegraded":"2024-03-04T12:57:25.880408+0000","last_fullsized":"2024-03-04T12:57:25.880408+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:41:33.023905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":5,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"250'5","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:51.002839+0000","last_change":"2024-03-04T12:44:50.452899+0000","last_active":"2024-03-04T12:57:51.002839+0000","last_peered":"2024-03-04T12:57:51.002839+0000","last_clean":"2024-03-04T12:57:51.002839+0000","last_became_active":"2024-03-04T12:44:50.452611+0000","last_became_peered":"2024-03-04T12:44:50.452611+0000","last_unstale":"2024-03-04T12:57:51.002839+0000","last_undegraded":"2024-03-04T12:57:51.002839+0000","last_fullsized":"2024-03-04T12:57:51.002839+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:51.414927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"256'20","reported_seq":91,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:13.481796+0000","last_change":"2024-03-04T12:43:27.064585+0000","last_active":"2024-03-04T12:58:13.481796+0000","last_peered":"2024-03-04T12:58:13.481796+0000","last_clean":"2024-03-04T12:58:13.481796+0000","last_became_active":"2024-03-04T12:43:27.064375+0000","last_became_peered":"2024-03-04T12:43:27.064375+0000","last_unstale":"2024-03-04T12:58:13.481796+0000","last_undegraded":"2024-03-04T12:58:13.481796+0000","last_fullsized":"2024-03-04T12:58:13.481796+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:39:12.810173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":61,"num_write":47,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"252'1","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996931+0000","last_change":"2024-03-04T12:51:01.350196+0000","last_active":"2024-03-04T12:57:30.996931+0000","last_peered":"2024-03-04T12:57:30.996931+0000","last_clean":"2024-03-04T12:57:30.996931+0000","last_became_active":"2024-03-04T12:51:01.349889+0000","last_became_peered":"2024-03-04T12:51:01.349889+0000","last_unstale":"2024-03-04T12:57:30.996931+0000","last_undegraded":"2024-03-04T12:57:30.996931+0000","last_fullsized":"2024-03-04T12:57:30.996931+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:26:14.298363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"256'1","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.884969+0000","last_change":"2024-03-04T12:44:53.489468+0000","last_active":"2024-03-04T12:57:55.884969+0000","last_peered":"2024-03-04T12:57:55.884969+0000","last_clean":"2024-03-04T12:57:55.884969+0000","last_became_active":"2024-03-04T12:44:53.489232+0000","last_became_peered":"2024-03-04T12:44:53.489232+0000","last_unstale":"2024-03-04T12:57:55.884969+0000","last_undegraded":"2024-03-04T12:57:55.884969+0000","last_fullsized":"2024-03-04T12:57:55.884969+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:26:44.977704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.981541+0000","last_change":"2024-03-04T12:44:50.459626+0000","last_active":"2024-03-04T12:57:20.981541+0000","last_peered":"2024-03-04T12:57:20.981541+0000","last_clean":"2024-03-04T12:57:20.981541+0000","last_became_active":"2024-03-04T12:44:50.459359+0000","last_became_peered":"2024-03-04T12:44:50.459359+0000","last_unstale":"2024-03-04T12:57:20.981541+0000","last_undegraded":"2024-03-04T12:57:20.981541+0000","last_fullsized":"2024-03-04T12:57:20.981541+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:42.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"256'25","reported_seq":106,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:06.002606+0000","last_change":"2024-03-04T12:43:27.060629+0000","last_active":"2024-03-04T12:58:06.002606+0000","last_peered":"2024-03-04T12:58:06.002606+0000","last_clean":"2024-03-04T12:58:06.002606+0000","last_became_active":"2024-03-04T12:43:27.060115+0000","last_became_peered":"2024-03-04T12:43:27.060115+0000","last_unstale":"2024-03-04T12:58:06.002606+0000","last_undegraded":"2024-03-04T12:58:06.002606+0000","last_fullsized":"2024-03-04T12:58:06.002606+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:15:16.480822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.881250+0000","last_change":"2024-03-04T12:51:01.596756+0000","last_active":"2024-03-04T12:57:30.881250+0000","last_peered":"2024-03-04T12:57:30.881250+0000","last_clean":"2024-03-04T12:57:30.881250+0000","last_became_active":"2024-03-04T12:51:01.596463+0000","last_became_peered":"2024-03-04T12:51:01.596463+0000","last_unstale":"2024-03-04T12:57:30.881250+0000","last_undegraded":"2024-03-04T12:57:30.881250+0000","last_fullsized":"2024-03-04T12:57:30.881250+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:47:44.675447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"256'5","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.001127+0000","last_change":"2024-03-04T12:44:53.479417+0000","last_active":"2024-03-04T12:57:56.001127+0000","last_peered":"2024-03-04T12:57:56.001127+0000","last_clean":"2024-03-04T12:57:56.001127+0000","last_became_active":"2024-03-04T12:44:53.479076+0000","last_became_peered":"2024-03-04T12:44:53.479076+0000","last_unstale":"2024-03-04T12:57:56.001127+0000","last_undegraded":"2024-03-04T12:57:56.001127+0000","last_fullsized":"2024-03-04T12:57:56.001127+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:57.384073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":15,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"256'1","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.880441+0000","last_change":"2024-03-04T12:44:50.454670+0000","last_active":"2024-03-04T12:57:25.880441+0000","last_peered":"2024-03-04T12:57:25.880441+0000","last_clean":"2024-03-04T12:57:25.880441+0000","last_became_active":"2024-03-04T12:44:50.454398+0000","last_became_peered":"2024-03-04T12:44:50.454398+0000","last_unstale":"2024-03-04T12:57:25.880441+0000","last_undegraded":"2024-03-04T12:57:25.880441+0000","last_fullsized":"2024-03-04T12:57:25.880441+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:24:18.356924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"256'33","reported_seq":117,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.886555+0000","last_change":"2024-03-04T12:43:27.060915+0000","last_active":"2024-03-04T12:58:05.886555+0000","last_peered":"2024-03-04T12:58:05.886555+0000","last_clean":"2024-03-04T12:58:05.886555+0000","last_became_active":"2024-03-04T12:43:27.060589+0000","last_became_peered":"2024-03-04T12:43:27.060589+0000","last_unstale":"2024-03-04T12:58:05.886555+0000","last_undegraded":"2024-03-04T12:58:05.886555+0000","last_fullsized":"2024-03-04T12:58:05.886555+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:52:13.475390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":90,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991815+0000","last_change":"2024-03-04T12:51:01.357439+0000","last_active":"2024-03-04T12:57:00.991815+0000","last_peered":"2024-03-04T12:57:00.991815+0000","last_clean":"2024-03-04T12:57:00.991815+0000","last_became_active":"2024-03-04T12:51:01.355416+0000","last_became_peered":"2024-03-04T12:51:01.355416+0000","last_unstale":"2024-03-04T12:57:00.991815+0000","last_undegraded":"2024-03-04T12:57:00.991815+0000","last_fullsized":"2024-03-04T12:57:00.991815+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:22:00.087119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"256'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.898812+0000","last_change":"2024-03-04T12:44:53.486527+0000","last_active":"2024-03-04T12:59:30.898812+0000","last_peered":"2024-03-04T12:59:30.898812+0000","last_clean":"2024-03-04T12:59:30.898812+0000","last_became_active":"2024-03-04T12:44:53.486235+0000","last_became_peered":"2024-03-04T12:44:53.486235+0000","last_unstale":"2024-03-04T12:59:30.898812+0000","last_undegraded":"2024-03-04T12:59:30.898812+0000","last_fullsized":"2024-03-04T12:59:30.898812+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:38:59.682681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"256'6","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:26.015244+0000","last_change":"2024-03-04T12:44:50.458855+0000","last_active":"2024-03-04T12:59:26.015244+0000","last_peered":"2024-03-04T12:59:26.015244+0000","last_clean":"2024-03-04T12:59:26.015244+0000","last_became_active":"2024-03-04T12:44:50.458610+0000","last_became_peered":"2024-03-04T12:44:50.458610+0000","last_unstale":"2024-03-04T12:59:26.015244+0000","last_undegraded":"2024-03-04T12:59:26.015244+0000","last_fullsized":"2024-03-04T12:59:26.015244+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:02:54.023215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":7739,"num_write":11,"num_write_kb":7739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"256'17","reported_seq":79,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.988149+0000","last_change":"2024-03-04T12:43:27.067610+0000","last_active":"2024-03-04T12:58:05.988149+0000","last_peered":"2024-03-04T12:58:05.988149+0000","last_clean":"2024-03-04T12:58:05.988149+0000","last_became_active":"2024-03-04T12:43:27.067223+0000","last_became_peered":"2024-03-04T12:43:27.067223+0000","last_unstale":"2024-03-04T12:58:05.988149+0000","last_undegraded":"2024-03-04T12:58:05.988149+0000","last_fullsized":"2024-03-04T12:58:05.988149+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:38:30.372407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":41,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.980872+0000","last_change":"2024-03-04T12:51:01.353788+0000","last_active":"2024-03-04T12:57:15.980872+0000","last_peered":"2024-03-04T12:57:15.980872+0000","last_clean":"2024-03-04T12:57:15.980872+0000","last_became_active":"2024-03-04T12:51:01.353432+0000","last_became_peered":"2024-03-04T12:51:01.353432+0000","last_unstale":"2024-03-04T12:57:15.980872+0000","last_undegraded":"2024-03-04T12:57:15.980872+0000","last_fullsized":"2024-03-04T12:57:15.980872+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:01:52.475724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"250'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.876625+0000","last_change":"2024-03-04T12:44:53.482645+0000","last_active":"2024-03-04T12:57:00.876625+0000","last_peered":"2024-03-04T12:57:00.876625+0000","last_clean":"2024-03-04T12:57:00.876625+0000","last_became_active":"2024-03-04T12:44:53.482370+0000","last_became_peered":"2024-03-04T12:44:53.482370+0000","last_unstale":"2024-03-04T12:57:00.876625+0000","last_undegraded":"2024-03-04T12:57:00.876625+0000","last_fullsized":"2024-03-04T12:57:00.876625+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:19:00.147319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"256'3","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.995188+0000","last_change":"2024-03-04T12:44:50.451000+0000","last_active":"2024-03-04T12:57:20.995188+0000","last_peered":"2024-03-04T12:57:20.995188+0000","last_clean":"2024-03-04T12:57:20.995188+0000","last_became_active":"2024-03-04T12:44:50.450681+0000","last_became_peered":"2024-03-04T12:44:50.450681+0000","last_unstale":"2024-03-04T12:57:20.995188+0000","last_undegraded":"2024-03-04T12:57:20.995188+0000","last_fullsized":"2024-03-04T12:57:20.995188+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:33:37.753695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":368,"num_write":3,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"256'61","reported_seq":196,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.994297+0000","last_change":"2024-03-04T12:43:27.057075+0000","last_active":"2024-03-04T12:58:05.994297+0000","last_peered":"2024-03-04T12:58:05.994297+0000","last_clean":"2024-03-04T12:58:05.994297+0000","last_became_active":"2024-03-04T12:43:27.056781+0000","last_became_peered":"2024-03-04T12:43:27.056781+0000","last_unstale":"2024-03-04T12:58:05.994297+0000","last_undegraded":"2024-03-04T12:58:05.994297+0000","last_fullsized":"2024-03-04T12:58:05.994297+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:46:26.120127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":203,"num_write":94,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.994328+0000","last_change":"2024-03-04T12:51:01.349501+0000","last_active":"2024-03-04T12:57:15.994328+0000","last_peered":"2024-03-04T12:57:15.994328+0000","last_clean":"2024-03-04T12:57:15.994328+0000","last_became_active":"2024-03-04T12:51:01.349216+0000","last_became_peered":"2024-03-04T12:51:01.349216+0000","last_unstale":"2024-03-04T12:57:15.994328+0000","last_undegraded":"2024-03-04T12:57:15.994328+0000","last_fullsized":"2024-03-04T12:57:15.994328+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:06.080102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.989012+0000","last_change":"2024-03-04T12:44:53.479666+0000","last_active":"2024-03-04T12:57:25.989012+0000","last_peered":"2024-03-04T12:57:25.989012+0000","last_clean":"2024-03-04T12:57:25.989012+0000","last_became_active":"2024-03-04T12:44:53.479411+0000","last_became_peered":"2024-03-04T12:44:53.479411+0000","last_unstale":"2024-03-04T12:57:25.989012+0000","last_undegraded":"2024-03-04T12:57:25.989012+0000","last_fullsized":"2024-03-04T12:57:25.989012+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:44.241135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'5","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:55.893128+0000","last_change":"2024-03-04T12:44:50.451910+0000","last_active":"2024-03-04T12:58:55.893128+0000","last_peered":"2024-03-04T12:58:55.893128+0000","last_clean":"2024-03-04T12:58:55.893128+0000","last_became_active":"2024-03-04T12:44:50.451626+0000","last_became_peered":"2024-03-04T12:44:50.451626+0000","last_unstale":"2024-03-04T12:58:55.893128+0000","last_undegraded":"2024-03-04T12:58:55.893128+0000","last_fullsized":"2024-03-04T12:58:55.893128+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:38.879751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"256'127","reported_seq":405,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:06.002489+0000","last_change":"2024-03-04T12:43:27.056721+0000","last_active":"2024-03-04T12:58:06.002489+0000","last_peered":"2024-03-04T12:58:06.002489+0000","last_clean":"2024-03-04T12:58:06.002489+0000","last_became_active":"2024-03-04T12:43:27.056007+0000","last_became_peered":"2024-03-04T12:43:27.056007+0000","last_unstale":"2024-03-04T12:58:06.002489+0000","last_undegraded":"2024-03-04T12:58:06.002489+0000","last_fullsized":"2024-03-04T12:58:06.002489+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:47.106941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":540,"num_write":158,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.987839+0000","last_change":"2024-03-04T12:51:01.354894+0000","last_active":"2024-03-04T12:57:15.987839+0000","last_peered":"2024-03-04T12:57:15.987839+0000","last_clean":"2024-03-04T12:57:15.987839+0000","last_became_active":"2024-03-04T12:51:01.354601+0000","last_became_peered":"2024-03-04T12:51:01.354601+0000","last_unstale":"2024-03-04T12:57:15.987839+0000","last_undegraded":"2024-03-04T12:57:15.987839+0000","last_fullsized":"2024-03-04T12:57:15.987839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:00:49.358407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.982297+0000","last_change":"2024-03-04T12:44:53.486591+0000","last_active":"2024-03-04T12:57:25.982297+0000","last_peered":"2024-03-04T12:57:25.982297+0000","last_clean":"2024-03-04T12:57:25.982297+0000","last_became_active":"2024-03-04T12:44:53.486321+0000","last_became_peered":"2024-03-04T12:44:53.486321+0000","last_unstale":"2024-03-04T12:57:25.982297+0000","last_undegraded":"2024-03-04T12:57:25.982297+0000","last_fullsized":"2024-03-04T12:57:25.982297+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:17:26.146570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"250'2","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.988362+0000","last_change":"2024-03-04T12:44:50.456615+0000","last_active":"2024-03-04T12:57:20.988362+0000","last_peered":"2024-03-04T12:57:20.988362+0000","last_clean":"2024-03-04T12:57:20.988362+0000","last_became_active":"2024-03-04T12:44:50.456315+0000","last_became_peered":"2024-03-04T12:44:50.456315+0000","last_unstale":"2024-03-04T12:57:20.988362+0000","last_undegraded":"2024-03-04T12:57:20.988362+0000","last_fullsized":"2024-03-04T12:57:20.988362+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:45.991675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"256'28","reported_seq":104,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:18.211202+0000","last_change":"2024-03-04T12:43:27.064503+0000","last_active":"2024-03-04T12:59:18.211202+0000","last_peered":"2024-03-04T12:59:18.211202+0000","last_clean":"2024-03-04T12:59:18.211202+0000","last_became_active":"2024-03-04T12:43:27.064141+0000","last_became_peered":"2024-03-04T12:43:27.064141+0000","last_unstale":"2024-03-04T12:59:18.211202+0000","last_undegraded":"2024-03-04T12:59:18.211202+0000","last_fullsized":"2024-03-04T12:59:18.211202+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:28:02.741960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"256'359","reported_seq":1005,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.945168+0000","last_change":"2024-03-04T12:36:40.392809+0000","last_active":"2024-03-04T13:00:15.945168+0000","last_peered":"2024-03-04T13:00:15.945168+0000","last_clean":"2024-03-04T13:00:15.945168+0000","last_became_active":"2024-03-04T12:36:40.392399+0000","last_became_peered":"2024-03-04T12:36:40.392399+0000","last_unstale":"2024-03-04T13:00:15.945168+0000","last_undegraded":"2024-03-04T13:00:15.945168+0000","last_fullsized":"2024-03-04T13:00:15.945168+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:58:34.780333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10488354,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":586,"num_read_kb":17405,"num_write":1435,"num_write_kb":42784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"256'1110","reported_seq":2693,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.838199+0000","last_change":"2024-03-04T12:36:07.296271+0000","last_active":"2024-03-04T12:59:48.838199+0000","last_peered":"2024-03-04T12:59:48.838199+0000","last_clean":"2024-03-04T12:59:48.838199+0000","last_became_active":"2024-03-04T12:36:07.295125+0000","last_became_peered":"2024-03-04T12:36:07.295125+0000","last_unstale":"2024-03-04T12:59:48.838199+0000","last_undegraded":"2024-03-04T12:59:48.838199+0000","last_fullsized":"2024-03-04T12:59:48.838199+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:37.876237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4869,"num_read_kb":4281,"num_write":1536,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"256'278","reported_seq":873,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.964076+0000","last_change":"2024-03-04T12:36:05.280982+0000","last_active":"2024-03-04T13:00:15.964076+0000","last_peered":"2024-03-04T13:00:15.964076+0000","last_clean":"2024-03-04T13:00:15.964076+0000","last_became_active":"2024-03-04T12:36:05.280695+0000","last_became_peered":"2024-03-04T12:36:05.280695+0000","last_unstale":"2024-03-04T13:00:15.964076+0000","last_undegraded":"2024-03-04T13:00:15.964076+0000","last_fullsized":"2024-03-04T13:00:15.964076+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:14.407483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256947,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":390,"num_read_kb":2412,"num_write":1104,"num_write_kb":20516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"256'544","reported_seq":1937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671828+0000","last_change":"2024-03-04T12:36:07.297041+0000","last_active":"2024-03-04T13:00:06.671828+0000","last_peered":"2024-03-04T13:00:06.671828+0000","last_clean":"2024-03-04T13:00:06.671828+0000","last_became_active":"2024-03-04T12:36:07.296651+0000","last_became_peered":"2024-03-04T12:36:07.296651+0000","last_unstale":"2024-03-04T13:00:06.671828+0000","last_undegraded":"2024-03-04T13:00:06.671828+0000","last_fullsized":"2024-03-04T13:00:06.671828+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:29:22.170255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2661,"num_read_kb":2496,"num_write":771,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"256'273","reported_seq":876,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.984613+0000","last_change":"2024-03-04T12:36:05.285321+0000","last_active":"2024-03-04T13:00:15.984613+0000","last_peered":"2024-03-04T13:00:15.984613+0000","last_clean":"2024-03-04T13:00:15.984613+0000","last_became_active":"2024-03-04T12:36:05.285054+0000","last_became_peered":"2024-03-04T12:36:05.285054+0000","last_unstale":"2024-03-04T13:00:15.984613+0000","last_undegraded":"2024-03-04T13:00:15.984613+0000","last_fullsized":"2024-03-04T13:00:15.984613+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:36.940053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5939385,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":380,"num_read_kb":27371,"num_write":985,"num_write_kb":18696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"256'594","reported_seq":2014,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:49.593829+0000","last_change":"2024-03-04T12:36:07.298949+0000","last_active":"2024-03-04T12:59:49.593829+0000","last_peered":"2024-03-04T12:59:49.593829+0000","last_clean":"2024-03-04T12:59:49.593829+0000","last_became_active":"2024-03-04T12:36:07.298528+0000","last_became_peered":"2024-03-04T12:36:07.298528+0000","last_unstale":"2024-03-04T12:59:49.593829+0000","last_undegraded":"2024-03-04T12:59:49.593829+0000","last_fullsized":"2024-03-04T12:59:49.593829+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":500,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:22.362410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2805,"num_read_kb":2500,"num_write":805,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"256'293","reported_seq":905,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.003906+0000","last_change":"2024-03-04T12:36:05.294821+0000","last_active":"2024-03-04T13:00:16.003906+0000","last_peered":"2024-03-04T13:00:16.003906+0000","last_clean":"2024-03-04T13:00:16.003906+0000","last_became_active":"2024-03-04T12:36:05.293768+0000","last_became_peered":"2024-03-04T12:36:05.293768+0000","last_unstale":"2024-03-04T13:00:16.003906+0000","last_undegraded":"2024-03-04T13:00:16.003906+0000","last_fullsized":"2024-03-04T13:00:16.003906+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:18.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446620,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":395,"num_read_kb":31950,"num_write":1041,"num_write_kb":37939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"256'777","reported_seq":2174,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:51.407901+0000","last_change":"2024-03-04T12:36:40.394056+0000","last_active":"2024-03-04T12:59:51.407901+0000","last_peered":"2024-03-04T12:59:51.407901+0000","last_clean":"2024-03-04T12:59:51.407901+0000","last_became_active":"2024-03-04T12:36:40.393715+0000","last_became_peered":"2024-03-04T12:36:40.393715+0000","last_unstale":"2024-03-04T12:59:51.407901+0000","last_undegraded":"2024-03-04T12:59:51.407901+0000","last_fullsized":"2024-03-04T12:59:51.407901+0000","mapping_epoch":33,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:36.183102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3436,"num_read_kb":3037,"num_write":1058,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"256'335","reported_seq":970,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.839104+0000","last_change":"2024-03-04T12:36:05.290798+0000","last_active":"2024-03-04T13:00:15.839104+0000","last_peered":"2024-03-04T13:00:15.839104+0000","last_clean":"2024-03-04T13:00:15.839104+0000","last_became_active":"2024-03-04T12:36:05.290178+0000","last_became_peered":"2024-03-04T12:36:05.290178+0000","last_unstale":"2024-03-04T13:00:15.839104+0000","last_undegraded":"2024-03-04T13:00:15.839104+0000","last_fullsized":"2024-03-04T13:00:15.839104+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:22.012412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19588171,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":547,"num_read_kb":36032,"num_write":1331,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"256'371","reported_seq":1918,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:37.805811+0000","last_change":"2024-03-04T12:36:07.301906+0000","last_active":"2024-03-04T12:59:37.805811+0000","last_peered":"2024-03-04T12:59:37.805811+0000","last_clean":"2024-03-04T12:59:37.805811+0000","last_became_active":"2024-03-04T12:36:07.301582+0000","last_became_peered":"2024-03-04T12:36:07.301582+0000","last_unstale":"2024-03-04T12:59:37.805811+0000","last_undegraded":"2024-03-04T12:59:37.805811+0000","last_fullsized":"2024-03-04T12:59:37.805811+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:15:02.915559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2123,"num_read_kb":2049,"num_write":405,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"256'246","reported_seq":854,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.014306+0000","last_change":"2024-03-04T12:36:05.296558+0000","last_active":"2024-03-04T13:00:16.014306+0000","last_peered":"2024-03-04T13:00:16.014306+0000","last_clean":"2024-03-04T13:00:16.014306+0000","last_became_active":"2024-03-04T12:36:05.296284+0000","last_became_peered":"2024-03-04T12:36:05.296284+0000","last_unstale":"2024-03-04T13:00:16.014306+0000","last_undegraded":"2024-03-04T13:00:16.014306+0000","last_fullsized":"2024-03-04T13:00:16.014306+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:09:57.839904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15939941,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":339,"num_read_kb":80579,"num_write":908,"num_write_kb":32166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"256'779","reported_seq":2021,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.066749+0000","last_change":"2024-03-04T12:36:07.298292+0000","last_active":"2024-03-04T12:59:53.066749+0000","last_peered":"2024-03-04T12:59:53.066749+0000","last_clean":"2024-03-04T12:59:53.066749+0000","last_became_active":"2024-03-04T12:36:07.297953+0000","last_became_peered":"2024-03-04T12:36:07.297953+0000","last_unstale":"2024-03-04T12:59:53.066749+0000","last_undegraded":"2024-03-04T12:59:53.066749+0000","last_fullsized":"2024-03-04T12:59:53.066749+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:58:58.998184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3335,"num_read_kb":2888,"num_write":1111,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"256'267","reported_seq":980,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.816903+0000","last_change":"2024-03-04T12:36:05.291622+0000","last_active":"2024-03-04T13:00:15.816903+0000","last_peered":"2024-03-04T13:00:15.816903+0000","last_clean":"2024-03-04T13:00:15.816903+0000","last_became_active":"2024-03-04T12:36:05.291041+0000","last_became_peered":"2024-03-04T12:36:05.291041+0000","last_unstale":"2024-03-04T13:00:15.816903+0000","last_undegraded":"2024-03-04T13:00:15.816903+0000","last_fullsized":"2024-03-04T13:00:15.816903+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:02:19.031345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3234101,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":733,"num_read_kb":12113,"num_write":1095,"num_write_kb":11806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"256'692","reported_seq":2091,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.675667+0000","last_change":"2024-03-04T12:36:07.297212+0000","last_active":"2024-03-04T13:00:06.675667+0000","last_peered":"2024-03-04T13:00:06.675667+0000","last_clean":"2024-03-04T13:00:06.675667+0000","last_became_active":"2024-03-04T12:36:07.296763+0000","last_became_peered":"2024-03-04T12:36:07.296763+0000","last_unstale":"2024-03-04T13:00:06.675667+0000","last_undegraded":"2024-03-04T13:00:06.675667+0000","last_fullsized":"2024-03-04T13:00:06.675667+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:44:52.510569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3139,"num_read_kb":2812,"num_write":915,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"256'251","reported_seq":853,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.952700+0000","last_change":"2024-03-04T12:36:05.295212+0000","last_active":"2024-03-04T13:00:15.952700+0000","last_peered":"2024-03-04T13:00:15.952700+0000","last_clean":"2024-03-04T13:00:15.952700+0000","last_became_active":"2024-03-04T12:36:05.294967+0000","last_became_peered":"2024-03-04T12:36:05.294967+0000","last_unstale":"2024-03-04T13:00:15.952700+0000","last_undegraded":"2024-03-04T13:00:15.952700+0000","last_fullsized":"2024-03-04T13:00:15.952700+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:35:51.469381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12867186,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":343,"num_read_kb":71068,"num_write":894,"num_write_kb":54955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"256'783","reported_seq":2195,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.517649+0000","last_change":"2024-03-04T12:36:07.296706+0000","last_active":"2024-03-04T12:59:55.517649+0000","last_peered":"2024-03-04T12:59:55.517649+0000","last_clean":"2024-03-04T12:59:55.517649+0000","last_became_active":"2024-03-04T12:36:07.295530+0000","last_became_peered":"2024-03-04T12:36:07.295530+0000","last_unstale":"2024-03-04T12:59:55.517649+0000","last_undegraded":"2024-03-04T12:59:55.517649+0000","last_fullsized":"2024-03-04T12:59:55.517649+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:26.858210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3415,"num_read_kb":3026,"num_write":1069,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"256'351","reported_seq":1806,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671750+0000","last_change":"2024-03-04T12:36:07.298974+0000","last_active":"2024-03-04T13:00:06.671750+0000","last_peered":"2024-03-04T13:00:06.671750+0000","last_clean":"2024-03-04T13:00:06.671750+0000","last_became_active":"2024-03-04T12:36:07.298539+0000","last_became_peered":"2024-03-04T12:36:07.298539+0000","last_unstale":"2024-03-04T13:00:06.671750+0000","last_undegraded":"2024-03-04T13:00:06.671750+0000","last_fullsized":"2024-03-04T13:00:06.671750+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:04.598502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1997,"num_read_kb":1912,"num_write":401,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"256'293","reported_seq":983,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.893241+0000","last_change":"2024-03-04T12:36:05.295348+0000","last_active":"2024-03-04T13:00:15.893241+0000","last_peered":"2024-03-04T13:00:15.893241+0000","last_clean":"2024-03-04T13:00:15.893241+0000","last_became_active":"2024-03-04T12:36:05.295060+0000","last_became_peered":"2024-03-04T12:36:05.295060+0000","last_unstale":"2024-03-04T13:00:15.893241+0000","last_undegraded":"2024-03-04T13:00:15.893241+0000","last_fullsized":"2024-03-04T13:00:15.893241+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:44.913316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4278746,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":559,"num_read_kb":26330,"num_write":1253,"num_write_kb":36495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"256'327","reported_seq":1788,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.122768+0000","last_change":"2024-03-04T12:36:07.300589+0000","last_active":"2024-03-04T12:59:52.122768+0000","last_peered":"2024-03-04T12:59:52.122768+0000","last_clean":"2024-03-04T12:59:52.122768+0000","last_became_active":"2024-03-04T12:36:07.300270+0000","last_became_peered":"2024-03-04T12:36:07.300270+0000","last_unstale":"2024-03-04T12:59:52.122768+0000","last_undegraded":"2024-03-04T12:59:52.122768+0000","last_fullsized":"2024-03-04T12:59:52.122768+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:00:00.682987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2015,"num_read_kb":1950,"num_write":359,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"256'247","reported_seq":837,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.952332+0000","last_change":"2024-03-04T12:36:05.296970+0000","last_active":"2024-03-04T13:00:15.952332+0000","last_peered":"2024-03-04T13:00:15.952332+0000","last_clean":"2024-03-04T13:00:15.952332+0000","last_became_active":"2024-03-04T12:36:05.296621+0000","last_became_peered":"2024-03-04T12:36:05.296621+0000","last_unstale":"2024-03-04T13:00:15.952332+0000","last_undegraded":"2024-03-04T13:00:15.952332+0000","last_fullsized":"2024-03-04T13:00:15.952332+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:34:53.750419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050492,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":367,"num_read_kb":30706,"num_write":937,"num_write_kb":28664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"256'400","reported_seq":1882,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.469640+0000","last_change":"2024-03-04T12:36:07.294272+0000","last_active":"2024-03-04T12:59:55.469640+0000","last_peered":"2024-03-04T12:59:55.469640+0000","last_clean":"2024-03-04T12:59:55.469640+0000","last_became_active":"2024-03-04T12:36:07.293952+0000","last_became_peered":"2024-03-04T12:36:07.293952+0000","last_unstale":"2024-03-04T12:59:55.469640+0000","last_undegraded":"2024-03-04T12:59:55.469640+0000","last_fullsized":"2024-03-04T12:59:55.469640+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:15:20.296845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2282,"num_read_kb":2164,"num_write":473,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"256'281","reported_seq":914,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.009674+0000","last_change":"2024-03-04T12:36:05.296143+0000","last_active":"2024-03-04T13:00:16.009674+0000","last_peered":"2024-03-04T13:00:16.009674+0000","last_clean":"2024-03-04T13:00:16.009674+0000","last_became_active":"2024-03-04T12:36:05.295832+0000","last_became_peered":"2024-03-04T12:36:05.295832+0000","last_unstale":"2024-03-04T13:00:16.009674+0000","last_undegraded":"2024-03-04T13:00:16.009674+0000","last_fullsized":"2024-03-04T13:00:16.009674+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:40.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13175493,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":496,"num_read_kb":48295,"num_write":1213,"num_write_kb":38980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"256'623","reported_seq":2325,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.903999+0000","last_change":"2024-03-04T12:36:07.296100+0000","last_active":"2024-03-04T12:59:54.903999+0000","last_peered":"2024-03-04T12:59:54.903999+0000","last_clean":"2024-03-04T12:59:54.903999+0000","last_became_active":"2024-03-04T12:36:07.295798+0000","last_became_peered":"2024-03-04T12:36:07.295798+0000","last_unstale":"2024-03-04T12:59:54.903999+0000","last_undegraded":"2024-03-04T12:59:54.903999+0000","last_fullsized":"2024-03-04T12:59:54.903999+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":600,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:42.532663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3253,"num_read_kb":2977,"num_write":842,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"256'306","reported_seq":912,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.017795+0000","last_change":"2024-03-04T12:36:05.292220+0000","last_active":"2024-03-04T13:00:16.017795+0000","last_peered":"2024-03-04T13:00:16.017795+0000","last_clean":"2024-03-04T13:00:16.017795+0000","last_became_active":"2024-03-04T12:36:05.291477+0000","last_became_peered":"2024-03-04T12:36:05.291477+0000","last_unstale":"2024-03-04T13:00:16.017795+0000","last_undegraded":"2024-03-04T13:00:16.017795+0000","last_fullsized":"2024-03-04T13:00:16.017795+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:51.540928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6379471,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":436,"num_read_kb":10302,"num_write":1186,"num_write_kb":24769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"256'368","reported_seq":1762,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:34.665766+0000","last_change":"2024-03-04T12:36:07.290412+0000","last_active":"2024-03-04T12:59:34.665766+0000","last_peered":"2024-03-04T12:59:34.665766+0000","last_clean":"2024-03-04T12:59:34.665766+0000","last_became_active":"2024-03-04T12:36:07.290104+0000","last_became_peered":"2024-03-04T12:36:07.290104+0000","last_unstale":"2024-03-04T12:59:34.665766+0000","last_undegraded":"2024-03-04T12:59:34.665766+0000","last_fullsized":"2024-03-04T12:59:34.665766+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:26.340789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2031,"num_read_kb":1912,"num_write":446,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"256'276","reported_seq":893,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.003020+0000","last_change":"2024-03-04T12:36:05.291422+0000","last_active":"2024-03-04T13:00:16.003020+0000","last_peered":"2024-03-04T13:00:16.003020+0000","last_clean":"2024-03-04T13:00:16.003020+0000","last_became_active":"2024-03-04T12:36:05.291096+0000","last_became_peered":"2024-03-04T12:36:05.291096+0000","last_unstale":"2024-03-04T13:00:16.003020+0000","last_undegraded":"2024-03-04T13:00:16.003020+0000","last_fullsized":"2024-03-04T13:00:16.003020+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:07.540177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194835,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":438,"num_read_kb":17846,"num_write":1169,"num_write_kb":33765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"256'451","reported_seq":2118,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.018123+0000","last_change":"2024-03-04T12:36:07.298549+0000","last_active":"2024-03-04T12:59:56.018123+0000","last_peered":"2024-03-04T12:59:56.018123+0000","last_clean":"2024-03-04T12:59:56.018123+0000","last_became_active":"2024-03-04T12:36:07.297989+0000","last_became_peered":"2024-03-04T12:36:07.297989+0000","last_unstale":"2024-03-04T12:59:56.018123+0000","last_undegraded":"2024-03-04T12:59:56.018123+0000","last_fullsized":"2024-03-04T12:59:56.018123+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:09.358594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2700,"num_read_kb":2549,"num_write":550,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"256'323","reported_seq":987,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.937623+0000","last_change":"2024-03-04T12:36:05.281235+0000","last_active":"2024-03-04T13:00:15.937623+0000","last_peered":"2024-03-04T13:00:15.937623+0000","last_clean":"2024-03-04T13:00:15.937623+0000","last_became_active":"2024-03-04T12:36:05.280944+0000","last_became_peered":"2024-03-04T12:36:05.280944+0000","last_unstale":"2024-03-04T13:00:15.937623+0000","last_undegraded":"2024-03-04T13:00:15.937623+0000","last_fullsized":"2024-03-04T13:00:15.937623+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:42:06.994361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9728040,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":684,"num_read_kb":21551,"num_write":1160,"num_write_kb":33499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"256'82","reported_seq":558,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.125585+0000","last_change":"2024-03-04T12:36:15.356602+0000","last_active":"2024-03-04T12:59:52.125585+0000","last_peered":"2024-03-04T12:59:52.125585+0000","last_clean":"2024-03-04T12:59:52.125585+0000","last_became_active":"2024-03-04T12:36:15.356314+0000","last_became_peered":"2024-03-04T12:36:15.356314+0000","last_unstale":"2024-03-04T12:59:52.125585+0000","last_undegraded":"2024-03-04T12:59:52.125585+0000","last_fullsized":"2024-03-04T12:59:52.125585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:18:50.970854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":197,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"256'1096","reported_seq":2695,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.183207+0000","last_change":"2024-03-04T12:36:07.298156+0000","last_active":"2024-03-04T12:59:47.183207+0000","last_peered":"2024-03-04T12:59:47.183207+0000","last_clean":"2024-03-04T12:59:47.183207+0000","last_became_active":"2024-03-04T12:36:07.297879+0000","last_became_peered":"2024-03-04T12:36:07.297879+0000","last_unstale":"2024-03-04T12:59:47.183207+0000","last_undegraded":"2024-03-04T12:59:47.183207+0000","last_fullsized":"2024-03-04T12:59:47.183207+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:20.102942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4860,"num_read_kb":4288,"num_write":1505,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"256'319","reported_seq":927,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.814323+0000","last_change":"2024-03-04T12:36:05.297435+0000","last_active":"2024-03-04T13:00:15.814323+0000","last_peered":"2024-03-04T13:00:15.814323+0000","last_clean":"2024-03-04T13:00:15.814323+0000","last_became_active":"2024-03-04T12:36:05.296939+0000","last_became_peered":"2024-03-04T12:36:05.296939+0000","last_unstale":"2024-03-04T13:00:15.814323+0000","last_undegraded":"2024-03-04T13:00:15.814323+0000","last_fullsized":"2024-03-04T13:00:15.814323+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:05.528631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360056,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":415,"num_read_kb":33218,"num_write":1154,"num_write_kb":53558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.976554+0000","last_change":"2024-03-04T12:36:09.314445+0000","last_active":"2024-03-04T12:55:30.976554+0000","last_peered":"2024-03-04T12:55:30.976554+0000","last_clean":"2024-03-04T12:55:30.976554+0000","last_became_active":"2024-03-04T12:36:09.314065+0000","last_became_peered":"2024-03-04T12:36:09.314065+0000","last_unstale":"2024-03-04T12:55:30.976554+0000","last_undegraded":"2024-03-04T12:55:30.976554+0000","last_fullsized":"2024-03-04T12:55:30.976554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:31.539306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"256'281","reported_seq":848,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.994646+0000","last_change":"2024-03-04T12:36:11.326254+0000","last_active":"2024-03-04T13:00:15.994646+0000","last_peered":"2024-03-04T13:00:15.994646+0000","last_clean":"2024-03-04T13:00:15.994646+0000","last_became_active":"2024-03-04T12:36:11.325995+0000","last_became_peered":"2024-03-04T12:36:11.325995+0000","last_unstale":"2024-03-04T13:00:15.994646+0000","last_undegraded":"2024-03-04T13:00:15.994646+0000","last_fullsized":"2024-03-04T13:00:15.994646+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:44.077134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54042,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":461,"num_read_kb":924,"num_write":361,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.864607+0000","last_change":"2024-03-04T12:36:13.339677+0000","last_active":"2024-03-04T12:55:35.864607+0000","last_peered":"2024-03-04T12:55:35.864607+0000","last_clean":"2024-03-04T12:55:35.864607+0000","last_became_active":"2024-03-04T12:36:13.339305+0000","last_became_peered":"2024-03-04T12:36:13.339305+0000","last_unstale":"2024-03-04T12:55:35.864607+0000","last_undegraded":"2024-03-04T12:55:35.864607+0000","last_fullsized":"2024-03-04T12:55:35.864607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:00:43.245373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"256'2370","reported_seq":4141,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.448462+0000","last_change":"2024-03-04T12:36:15.362735+0000","last_active":"2024-03-04T13:00:07.448462+0000","last_peered":"2024-03-04T13:00:07.448462+0000","last_clean":"2024-03-04T13:00:07.448462+0000","last_became_active":"2024-03-04T12:36:15.362434+0000","last_became_peered":"2024-03-04T12:36:15.362434+0000","last_unstale":"2024-03-04T13:00:07.448462+0000","last_undegraded":"2024-03-04T13:00:07.448462+0000","last_fullsized":"2024-03-04T13:00:07.448462+0000","mapping_epoch":30,"log_start":"256'2300","ondisk_log_start":"256'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":2300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:44:00.181398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5876,"num_read_kb":5881,"num_write":4713,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"256'831","reported_seq":2403,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:40.772778+0000","last_change":"2024-03-04T12:36:07.295827+0000","last_active":"2024-03-04T12:59:40.772778+0000","last_peered":"2024-03-04T12:59:40.772778+0000","last_clean":"2024-03-04T12:59:40.772778+0000","last_became_active":"2024-03-04T12:36:07.295522+0000","last_became_peered":"2024-03-04T12:36:07.295522+0000","last_unstale":"2024-03-04T12:59:40.772778+0000","last_undegraded":"2024-03-04T12:59:40.772778+0000","last_fullsized":"2024-03-04T12:59:40.772778+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:48:41.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3820,"num_read_kb":3411,"num_write":1118,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"256'322","reported_seq":937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.005883+0000","last_change":"2024-03-04T12:36:05.288481+0000","last_active":"2024-03-04T13:00:16.005883+0000","last_peered":"2024-03-04T13:00:16.005883+0000","last_clean":"2024-03-04T13:00:16.005883+0000","last_became_active":"2024-03-04T12:36:05.288208+0000","last_became_peered":"2024-03-04T12:36:05.288208+0000","last_unstale":"2024-03-04T13:00:16.005883+0000","last_undegraded":"2024-03-04T13:00:16.005883+0000","last_fullsized":"2024-03-04T13:00:16.005883+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:48.405825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4588272,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":513,"num_read_kb":34780,"num_write":1135,"num_write_kb":45508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.980972+0000","last_change":"2024-03-04T12:36:09.309834+0000","last_active":"2024-03-04T12:57:10.980972+0000","last_peered":"2024-03-04T12:57:10.980972+0000","last_clean":"2024-03-04T12:57:10.980972+0000","last_became_active":"2024-03-04T12:36:09.309583+0000","last_became_peered":"2024-03-04T12:36:09.309583+0000","last_unstale":"2024-03-04T12:57:10.980972+0000","last_undegraded":"2024-03-04T12:57:10.980972+0000","last_fullsized":"2024-03-04T12:57:10.980972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:07.871941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"256'70","reported_seq":569,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.001099+0000","last_change":"2024-03-04T12:36:11.325082+0000","last_active":"2024-03-04T12:57:56.001099+0000","last_peered":"2024-03-04T12:57:56.001099+0000","last_clean":"2024-03-04T12:57:56.001099+0000","last_became_active":"2024-03-04T12:36:11.324761+0000","last_became_peered":"2024-03-04T12:36:11.324761+0000","last_unstale":"2024-03-04T12:57:56.001099+0000","last_undegraded":"2024-03-04T12:57:56.001099+0000","last_fullsized":"2024-03-04T12:57:56.001099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:54.454757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":50,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":471,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.977378+0000","last_change":"2024-03-04T12:36:13.343424+0000","last_active":"2024-03-04T12:55:35.977378+0000","last_peered":"2024-03-04T12:55:35.977378+0000","last_clean":"2024-03-04T12:55:35.977378+0000","last_became_active":"2024-03-04T12:36:13.343072+0000","last_became_peered":"2024-03-04T12:36:13.343072+0000","last_unstale":"2024-03-04T12:55:35.977378+0000","last_undegraded":"2024-03-04T12:55:35.977378+0000","last_fullsized":"2024-03-04T12:55:35.977378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:57.168843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"256'98","reported_seq":584,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.906113+0000","last_change":"2024-03-04T12:36:15.362615+0000","last_active":"2024-03-04T12:59:54.906113+0000","last_peered":"2024-03-04T12:59:54.906113+0000","last_clean":"2024-03-04T12:59:54.906113+0000","last_became_active":"2024-03-04T12:36:15.362354+0000","last_became_peered":"2024-03-04T12:36:15.362354+0000","last_unstale":"2024-03-04T12:59:54.906113+0000","last_undegraded":"2024-03-04T12:59:54.906113+0000","last_fullsized":"2024-03-04T12:59:54.906113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:28.389546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":121,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"256'345","reported_seq":1724,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.037932+0000","last_change":"2024-03-04T12:36:07.294690+0000","last_active":"2024-03-04T12:59:53.037932+0000","last_peered":"2024-03-04T12:59:53.037932+0000","last_clean":"2024-03-04T12:59:53.037932+0000","last_became_active":"2024-03-04T12:36:07.294328+0000","last_became_peered":"2024-03-04T12:36:07.294328+0000","last_unstale":"2024-03-04T12:59:53.037932+0000","last_undegraded":"2024-03-04T12:59:53.037932+0000","last_fullsized":"2024-03-04T12:59:53.037932+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:21.872722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1913,"num_read_kb":1818,"num_write":399,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"256'245","reported_seq":858,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.826805+0000","last_change":"2024-03-04T12:36:05.291937+0000","last_active":"2024-03-04T13:00:15.826805+0000","last_peered":"2024-03-04T13:00:15.826805+0000","last_clean":"2024-03-04T13:00:15.826805+0000","last_became_active":"2024-03-04T12:36:05.291366+0000","last_became_peered":"2024-03-04T12:36:05.291366+0000","last_unstale":"2024-03-04T13:00:15.826805+0000","last_undegraded":"2024-03-04T13:00:15.826805+0000","last_fullsized":"2024-03-04T13:00:15.826805+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:51:33.987631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074518,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":408,"num_read_kb":10586,"num_write":1086,"num_write_kb":21097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.968727+0000","last_change":"2024-03-04T12:36:09.310004+0000","last_active":"2024-03-04T12:55:30.968727+0000","last_peered":"2024-03-04T12:55:30.968727+0000","last_clean":"2024-03-04T12:55:30.968727+0000","last_became_active":"2024-03-04T12:36:09.309749+0000","last_became_peered":"2024-03-04T12:36:09.309749+0000","last_unstale":"2024-03-04T12:55:30.968727+0000","last_undegraded":"2024-03-04T12:55:30.968727+0000","last_fullsized":"2024-03-04T12:55:30.968727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:03:13.417440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"256'81","reported_seq":584,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:49.593521+0000","last_change":"2024-03-04T12:36:11.324407+0000","last_active":"2024-03-04T12:58:49.593521+0000","last_peered":"2024-03-04T12:58:49.593521+0000","last_clean":"2024-03-04T12:58:49.593521+0000","last_became_active":"2024-03-04T12:36:11.324127+0000","last_became_peered":"2024-03-04T12:36:11.324127+0000","last_unstale":"2024-03-04T12:58:49.593521+0000","last_undegraded":"2024-03-04T12:58:49.593521+0000","last_fullsized":"2024-03-04T12:58:49.593521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:48.776107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"256'508","reported_seq":1456,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.236381+0000","last_change":"2024-03-04T12:36:13.338671+0000","last_active":"2024-03-04T13:00:15.236381+0000","last_peered":"2024-03-04T13:00:15.236381+0000","last_clean":"2024-03-04T13:00:15.236381+0000","last_became_active":"2024-03-04T12:36:13.338070+0000","last_became_peered":"2024-03-04T12:36:13.338070+0000","last_unstale":"2024-03-04T13:00:15.236381+0000","last_undegraded":"2024-03-04T13:00:15.236381+0000","last_fullsized":"2024-03-04T13:00:15.236381+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:33:55.908350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"256'103","reported_seq":572,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:31.188469+0000","last_change":"2024-03-04T12:36:15.356684+0000","last_active":"2024-03-04T12:59:31.188469+0000","last_peered":"2024-03-04T12:59:31.188469+0000","last_clean":"2024-03-04T12:59:31.188469+0000","last_became_active":"2024-03-04T12:36:15.356417+0000","last_became_peered":"2024-03-04T12:36:15.356417+0000","last_unstale":"2024-03-04T12:59:31.188469+0000","last_undegraded":"2024-03-04T12:59:31.188469+0000","last_fullsized":"2024-03-04T12:59:31.188469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:52:14.210704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"256'684","reported_seq":2108,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.017188+0000","last_change":"2024-03-04T12:36:07.293732+0000","last_active":"2024-03-04T12:59:56.017188+0000","last_peered":"2024-03-04T12:59:56.017188+0000","last_clean":"2024-03-04T12:59:56.017188+0000","last_became_active":"2024-03-04T12:36:07.293493+0000","last_became_peered":"2024-03-04T12:36:07.293493+0000","last_unstale":"2024-03-04T12:59:56.017188+0000","last_undegraded":"2024-03-04T12:59:56.017188+0000","last_fullsized":"2024-03-04T12:59:56.017188+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:57:53.084655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3120,"num_read_kb":2817,"num_write":901,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"256'348","reported_seq":968,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.991149+0000","last_change":"2024-03-04T12:36:05.283970+0000","last_active":"2024-03-04T13:00:15.991149+0000","last_peered":"2024-03-04T13:00:15.991149+0000","last_clean":"2024-03-04T13:00:15.991149+0000","last_became_active":"2024-03-04T12:36:05.283477+0000","last_became_peered":"2024-03-04T12:36:05.283477+0000","last_unstale":"2024-03-04T13:00:15.991149+0000","last_undegraded":"2024-03-04T13:00:15.991149+0000","last_fullsized":"2024-03-04T13:00:15.991149+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:34:48.169224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2135532,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":502,"num_read_kb":32578,"num_write":1414,"num_write_kb":46757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.976596+0000","last_change":"2024-03-04T12:36:09.314720+0000","last_active":"2024-03-04T12:55:30.976596+0000","last_peered":"2024-03-04T12:55:30.976596+0000","last_clean":"2024-03-04T12:55:30.976596+0000","last_became_active":"2024-03-04T12:36:09.314215+0000","last_became_peered":"2024-03-04T12:36:09.314215+0000","last_unstale":"2024-03-04T12:55:30.976596+0000","last_undegraded":"2024-03-04T12:55:30.976596+0000","last_fullsized":"2024-03-04T12:55:30.976596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:41.656458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"256'247","reported_seq":789,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.763809+0000","last_change":"2024-03-04T12:36:11.956620+0000","last_active":"2024-03-04T13:00:15.763809+0000","last_peered":"2024-03-04T13:00:15.763809+0000","last_clean":"2024-03-04T13:00:15.763809+0000","last_became_active":"2024-03-04T12:36:11.956371+0000","last_became_peered":"2024-03-04T12:36:11.956371+0000","last_unstale":"2024-03-04T13:00:15.763809+0000","last_undegraded":"2024-03-04T13:00:15.763809+0000","last_fullsized":"2024-03-04T13:00:15.763809+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:43.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44142,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1035,"num_write":354,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"256'533","reported_seq":3334,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.240304+0000","last_change":"2024-03-04T12:36:13.344846+0000","last_active":"2024-03-04T13:00:15.240304+0000","last_peered":"2024-03-04T13:00:15.240304+0000","last_clean":"2024-03-04T13:00:15.240304+0000","last_became_active":"2024-03-04T12:36:13.344498+0000","last_became_peered":"2024-03-04T12:36:13.344498+0000","last_unstale":"2024-03-04T13:00:15.240304+0000","last_undegraded":"2024-03-04T13:00:15.240304+0000","last_fullsized":"2024-03-04T13:00:15.240304+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:40:58.604976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"256'768","reported_seq":2298,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.130713+0000","last_change":"2024-03-04T12:36:07.297672+0000","last_active":"2024-03-04T12:59:52.130713+0000","last_peered":"2024-03-04T12:59:52.130713+0000","last_clean":"2024-03-04T12:59:52.130713+0000","last_became_active":"2024-03-04T12:36:07.297320+0000","last_became_peered":"2024-03-04T12:36:07.297320+0000","last_unstale":"2024-03-04T12:59:52.130713+0000","last_undegraded":"2024-03-04T12:59:52.130713+0000","last_fullsized":"2024-03-04T12:59:52.130713+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:40.204657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3660,"num_read_kb":3298,"num_write":1023,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"256'325","reported_seq":987,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.769791+0000","last_change":"2024-03-04T12:36:05.294150+0000","last_active":"2024-03-04T13:00:15.769791+0000","last_peered":"2024-03-04T13:00:15.769791+0000","last_clean":"2024-03-04T13:00:15.769791+0000","last_became_active":"2024-03-04T12:36:05.293882+0000","last_became_peered":"2024-03-04T12:36:05.293882+0000","last_unstale":"2024-03-04T13:00:15.769791+0000","last_undegraded":"2024-03-04T13:00:15.769791+0000","last_fullsized":"2024-03-04T13:00:15.769791+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:44:38.505106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25761744,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":517,"num_read_kb":60171,"num_write":1396,"num_write_kb":40158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.884043+0000","last_change":"2024-03-04T12:36:09.308808+0000","last_active":"2024-03-04T12:57:50.884043+0000","last_peered":"2024-03-04T12:57:50.884043+0000","last_clean":"2024-03-04T12:57:50.884043+0000","last_became_active":"2024-03-04T12:36:09.308538+0000","last_became_peered":"2024-03-04T12:36:09.308538+0000","last_unstale":"2024-03-04T12:57:50.884043+0000","last_undegraded":"2024-03-04T12:57:50.884043+0000","last_fullsized":"2024-03-04T12:57:50.884043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:29.862690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"256'308","reported_seq":874,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.684356+0000","last_change":"2024-03-04T12:36:11.954866+0000","last_active":"2024-03-04T13:00:08.684356+0000","last_peered":"2024-03-04T13:00:08.684356+0000","last_clean":"2024-03-04T13:00:08.684356+0000","last_became_active":"2024-03-04T12:36:11.954597+0000","last_became_peered":"2024-03-04T12:36:11.954597+0000","last_unstale":"2024-03-04T13:00:08.684356+0000","last_undegraded":"2024-03-04T13:00:08.684356+0000","last_fullsized":"2024-03-04T13:00:08.684356+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:12.925538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66828,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":513,"num_read_kb":1018,"num_write":416,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.975791+0000","last_change":"2024-03-04T12:36:13.340164+0000","last_active":"2024-03-04T12:56:30.975791+0000","last_peered":"2024-03-04T12:56:30.975791+0000","last_clean":"2024-03-04T12:56:30.975791+0000","last_became_active":"2024-03-04T12:36:13.339890+0000","last_became_peered":"2024-03-04T12:36:13.339890+0000","last_unstale":"2024-03-04T12:56:30.975791+0000","last_undegraded":"2024-03-04T12:56:30.975791+0000","last_fullsized":"2024-03-04T12:56:30.975791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:01:43.082809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"256'505","reported_seq":1289,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.702992+0000","last_change":"2024-03-04T12:36:15.363257+0000","last_active":"2024-03-04T13:00:08.702992+0000","last_peered":"2024-03-04T13:00:08.702992+0000","last_clean":"2024-03-04T13:00:08.702992+0000","last_became_active":"2024-03-04T12:36:15.362355+0000","last_became_peered":"2024-03-04T12:36:15.362355+0000","last_unstale":"2024-03-04T13:00:08.702992+0000","last_undegraded":"2024-03-04T13:00:08.702992+0000","last_fullsized":"2024-03-04T13:00:08.702992+0000","mapping_epoch":30,"log_start":"250'400","ondisk_log_start":"250'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:39:12.607478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1234,"num_read_kb":1233,"num_write":1042,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"256'404","reported_seq":1914,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.480892+0000","last_change":"2024-03-04T12:36:07.292415+0000","last_active":"2024-03-04T12:59:55.480892+0000","last_peered":"2024-03-04T12:59:55.480892+0000","last_clean":"2024-03-04T12:59:55.480892+0000","last_became_active":"2024-03-04T12:36:07.291507+0000","last_became_peered":"2024-03-04T12:36:07.291507+0000","last_unstale":"2024-03-04T12:59:55.480892+0000","last_undegraded":"2024-03-04T12:59:55.480892+0000","last_fullsized":"2024-03-04T12:59:55.480892+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:09:27.148690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2180,"num_read_kb":2067,"num_write":478,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"256'268","reported_seq":891,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.819590+0000","last_change":"2024-03-04T12:36:05.286750+0000","last_active":"2024-03-04T13:00:15.819590+0000","last_peered":"2024-03-04T13:00:15.819590+0000","last_clean":"2024-03-04T13:00:15.819590+0000","last_became_active":"2024-03-04T12:36:05.286438+0000","last_became_peered":"2024-03-04T12:36:05.286438+0000","last_unstale":"2024-03-04T13:00:15.819590+0000","last_undegraded":"2024-03-04T13:00:15.819590+0000","last_fullsized":"2024-03-04T13:00:15.819590+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:34:40.712814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561797,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":436,"num_read_kb":18655,"num_write":1164,"num_write_kb":23251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.988264+0000","last_change":"2024-03-04T12:36:09.304859+0000","last_active":"2024-03-04T12:57:50.988264+0000","last_peered":"2024-03-04T12:57:50.988264+0000","last_clean":"2024-03-04T12:57:50.988264+0000","last_became_active":"2024-03-04T12:36:09.304561+0000","last_became_peered":"2024-03-04T12:36:09.304561+0000","last_unstale":"2024-03-04T12:57:50.988264+0000","last_undegraded":"2024-03-04T12:57:50.988264+0000","last_fullsized":"2024-03-04T12:57:50.988264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:50:41.171488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"256'264","reported_seq":800,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.659812+0000","last_change":"2024-03-04T12:36:11.324431+0000","last_active":"2024-03-04T13:00:08.659812+0000","last_peered":"2024-03-04T13:00:08.659812+0000","last_clean":"2024-03-04T13:00:08.659812+0000","last_became_active":"2024-03-04T12:36:11.324147+0000","last_became_peered":"2024-03-04T12:36:11.324147+0000","last_unstale":"2024-03-04T13:00:08.659812+0000","last_undegraded":"2024-03-04T13:00:08.659812+0000","last_fullsized":"2024-03-04T13:00:08.659812+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:08.464149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":936,"num_write":360,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.987062+0000","last_change":"2024-03-04T12:36:13.346330+0000","last_active":"2024-03-04T12:57:55.987062+0000","last_peered":"2024-03-04T12:57:55.987062+0000","last_clean":"2024-03-04T12:57:55.987062+0000","last_became_active":"2024-03-04T12:36:13.346077+0000","last_became_peered":"2024-03-04T12:36:13.346077+0000","last_unstale":"2024-03-04T12:57:55.987062+0000","last_undegraded":"2024-03-04T12:57:55.987062+0000","last_fullsized":"2024-03-04T12:57:55.987062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:53:58.068981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"256'121","reported_seq":600,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.249351+0000","last_change":"2024-03-04T12:36:15.360124+0000","last_active":"2024-03-04T12:59:48.249351+0000","last_peered":"2024-03-04T12:59:48.249351+0000","last_clean":"2024-03-04T12:59:48.249351+0000","last_became_active":"2024-03-04T12:36:15.359839+0000","last_became_peered":"2024-03-04T12:36:15.359839+0000","last_unstale":"2024-03-04T12:59:48.249351+0000","last_undegraded":"2024-03-04T12:59:48.249351+0000","last_fullsized":"2024-03-04T12:59:48.249351+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:21:16.002994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":144,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"256'819","reported_seq":2263,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.910676+0000","last_change":"2024-03-04T12:36:40.395151+0000","last_active":"2024-03-04T12:59:54.910676+0000","last_peered":"2024-03-04T12:59:54.910676+0000","last_clean":"2024-03-04T12:59:54.910676+0000","last_became_active":"2024-03-04T12:36:40.394812+0000","last_became_peered":"2024-03-04T12:36:40.394812+0000","last_unstale":"2024-03-04T12:59:54.910676+0000","last_undegraded":"2024-03-04T12:59:54.910676+0000","last_fullsized":"2024-03-04T12:59:54.910676+0000","mapping_epoch":33,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:10.350765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3628,"num_read_kb":3191,"num_write":1140,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"256'304","reported_seq":953,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.850484+0000","last_change":"2024-03-04T12:36:05.297783+0000","last_active":"2024-03-04T13:00:15.850484+0000","last_peered":"2024-03-04T13:00:15.850484+0000","last_clean":"2024-03-04T13:00:15.850484+0000","last_became_active":"2024-03-04T12:36:05.297486+0000","last_became_peered":"2024-03-04T12:36:05.297486+0000","last_unstale":"2024-03-04T13:00:15.850484+0000","last_undegraded":"2024-03-04T13:00:15.850484+0000","last_fullsized":"2024-03-04T13:00:15.850484+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:45.296031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20994598,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":550,"num_read_kb":44586,"num_write":1336,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'5","reported_seq":787,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.206385+0000","last_change":"2024-03-04T12:36:09.303560+0000","last_active":"2024-03-04T13:00:15.206385+0000","last_peered":"2024-03-04T13:00:15.206385+0000","last_clean":"2024-03-04T13:00:15.206385+0000","last_became_active":"2024-03-04T12:36:09.303280+0000","last_became_peered":"2024-03-04T12:36:09.303280+0000","last_unstale":"2024-03-04T13:00:15.206385+0000","last_undegraded":"2024-03-04T13:00:15.206385+0000","last_fullsized":"2024-03-04T13:00:15.206385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:32:28.838095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":467,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"256'280","reported_seq":828,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.686589+0000","last_change":"2024-03-04T12:36:11.325461+0000","last_active":"2024-03-04T13:00:08.686589+0000","last_peered":"2024-03-04T13:00:08.686589+0000","last_clean":"2024-03-04T13:00:08.686589+0000","last_became_active":"2024-03-04T12:36:11.325109+0000","last_became_peered":"2024-03-04T12:36:11.325109+0000","last_unstale":"2024-03-04T13:00:08.686589+0000","last_undegraded":"2024-03-04T13:00:08.686589+0000","last_fullsized":"2024-03-04T13:00:08.686589+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:48.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63172,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":463,"num_read_kb":979,"num_write":388,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"256'514","reported_seq":1818,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.241267+0000","last_change":"2024-03-04T12:36:13.342932+0000","last_active":"2024-03-04T13:00:15.241267+0000","last_peered":"2024-03-04T13:00:15.241267+0000","last_clean":"2024-03-04T13:00:15.241267+0000","last_became_active":"2024-03-04T12:36:13.342604+0000","last_became_peered":"2024-03-04T12:36:13.342604+0000","last_unstale":"2024-03-04T13:00:15.241267+0000","last_undegraded":"2024-03-04T13:00:15.241267+0000","last_fullsized":"2024-03-04T13:00:15.241267+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:05.485830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"256'91","reported_seq":551,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:32.243920+0000","last_change":"2024-03-04T12:36:15.360260+0000","last_active":"2024-03-04T12:59:32.243920+0000","last_peered":"2024-03-04T12:59:32.243920+0000","last_clean":"2024-03-04T12:59:32.243920+0000","last_became_active":"2024-03-04T12:36:15.359959+0000","last_became_peered":"2024-03-04T12:36:15.359959+0000","last_unstale":"2024-03-04T12:59:32.243920+0000","last_undegraded":"2024-03-04T12:59:32.243920+0000","last_fullsized":"2024-03-04T12:59:32.243920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:09.867645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"256'355","reported_seq":1798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.121512+0000","last_change":"2024-03-04T12:36:07.301861+0000","last_active":"2024-03-04T12:59:52.121512+0000","last_peered":"2024-03-04T12:59:52.121512+0000","last_clean":"2024-03-04T12:59:52.121512+0000","last_became_active":"2024-03-04T12:36:07.301558+0000","last_became_peered":"2024-03-04T12:36:07.301558+0000","last_unstale":"2024-03-04T12:59:52.121512+0000","last_undegraded":"2024-03-04T12:59:52.121512+0000","last_fullsized":"2024-03-04T12:59:52.121512+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:41.166126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1943,"num_read_kb":1867,"num_write":395,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"256'308","reported_seq":1058,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.935433+0000","last_change":"2024-03-04T12:36:05.293965+0000","last_active":"2024-03-04T13:00:15.935433+0000","last_peered":"2024-03-04T13:00:15.935433+0000","last_clean":"2024-03-04T13:00:15.935433+0000","last_became_active":"2024-03-04T12:36:05.293649+0000","last_became_peered":"2024-03-04T12:36:05.293649+0000","last_unstale":"2024-03-04T13:00:15.935433+0000","last_undegraded":"2024-03-04T13:00:15.935433+0000","last_fullsized":"2024-03-04T13:00:15.935433+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:55.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9453378,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":654,"num_read_kb":39140,"num_write":1321,"num_write_kb":31517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.988287+0000","last_change":"2024-03-04T12:36:09.304187+0000","last_active":"2024-03-04T12:57:50.988287+0000","last_peered":"2024-03-04T12:57:50.988287+0000","last_clean":"2024-03-04T12:57:50.988287+0000","last_became_active":"2024-03-04T12:36:09.303908+0000","last_became_peered":"2024-03-04T12:36:09.303908+0000","last_unstale":"2024-03-04T12:57:50.988287+0000","last_undegraded":"2024-03-04T12:57:50.988287+0000","last_fullsized":"2024-03-04T12:57:50.988287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:55:34.254756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"256'419","reported_seq":1009,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.251650+0000","last_change":"2024-03-04T12:36:11.328487+0000","last_active":"2024-03-04T13:00:15.251650+0000","last_peered":"2024-03-04T13:00:15.251650+0000","last_clean":"2024-03-04T13:00:15.251650+0000","last_became_active":"2024-03-04T12:36:11.326014+0000","last_became_peered":"2024-03-04T12:36:11.326014+0000","last_unstale":"2024-03-04T13:00:15.251650+0000","last_undegraded":"2024-03-04T13:00:15.251650+0000","last_fullsized":"2024-03-04T13:00:15.251650+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:45:24.328565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109509,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":732,"num_read_kb":1607,"num_write":604,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.988698+0000","last_change":"2024-03-04T12:36:13.335911+0000","last_active":"2024-03-04T12:57:55.988698+0000","last_peered":"2024-03-04T12:57:55.988698+0000","last_clean":"2024-03-04T12:57:55.988698+0000","last_became_active":"2024-03-04T12:36:13.335586+0000","last_became_peered":"2024-03-04T12:36:13.335586+0000","last_unstale":"2024-03-04T12:57:55.988698+0000","last_undegraded":"2024-03-04T12:57:55.988698+0000","last_fullsized":"2024-03-04T12:57:55.988698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:25.484088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"256'107","reported_seq":600,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:01.349664+0000","last_change":"2024-03-04T12:36:15.356552+0000","last_active":"2024-03-04T12:59:01.349664+0000","last_peered":"2024-03-04T12:59:01.349664+0000","last_clean":"2024-03-04T12:59:01.349664+0000","last_became_active":"2024-03-04T12:36:15.356270+0000","last_became_peered":"2024-03-04T12:36:15.356270+0000","last_unstale":"2024-03-04T12:59:01.349664+0000","last_undegraded":"2024-03-04T12:59:01.349664+0000","last_fullsized":"2024-03-04T12:59:01.349664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:20.445838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":257,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"256'398","reported_seq":1973,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.675701+0000","last_change":"2024-03-04T12:36:07.293079+0000","last_active":"2024-03-04T13:00:06.675701+0000","last_peered":"2024-03-04T13:00:06.675701+0000","last_clean":"2024-03-04T13:00:06.675701+0000","last_became_active":"2024-03-04T12:36:07.292788+0000","last_became_peered":"2024-03-04T12:36:07.292788+0000","last_unstale":"2024-03-04T13:00:06.675701+0000","last_undegraded":"2024-03-04T13:00:06.675701+0000","last_fullsized":"2024-03-04T13:00:06.675701+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:54.824676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2359,"num_read_kb":2243,"num_write":467,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"256'264","reported_seq":966,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.939047+0000","last_change":"2024-03-04T12:36:05.286316+0000","last_active":"2024-03-04T13:00:15.939047+0000","last_peered":"2024-03-04T13:00:15.939047+0000","last_clean":"2024-03-04T13:00:15.939047+0000","last_became_active":"2024-03-04T12:36:05.284594+0000","last_became_peered":"2024-03-04T12:36:05.284594+0000","last_unstale":"2024-03-04T13:00:15.939047+0000","last_undegraded":"2024-03-04T13:00:15.939047+0000","last_fullsized":"2024-03-04T13:00:15.939047+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:06.773008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12161951,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":556,"num_read_kb":110861,"num_write":978,"num_write_kb":39283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:25.979146+0000","last_change":"2024-03-04T12:36:09.305629+0000","last_active":"2024-03-04T12:56:25.979146+0000","last_peered":"2024-03-04T12:56:25.979146+0000","last_clean":"2024-03-04T12:56:25.979146+0000","last_became_active":"2024-03-04T12:36:09.305363+0000","last_became_peered":"2024-03-04T12:36:09.305363+0000","last_unstale":"2024-03-04T12:56:25.979146+0000","last_undegraded":"2024-03-04T12:56:25.979146+0000","last_fullsized":"2024-03-04T12:56:25.979146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:49:38.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"256'258","reported_seq":807,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.355690+0000","last_change":"2024-03-04T12:36:11.320326+0000","last_active":"2024-03-04T13:00:15.355690+0000","last_peered":"2024-03-04T13:00:15.355690+0000","last_clean":"2024-03-04T13:00:15.355690+0000","last_became_active":"2024-03-04T12:36:11.319633+0000","last_became_peered":"2024-03-04T12:36:11.319633+0000","last_unstale":"2024-03-04T13:00:15.355690+0000","last_undegraded":"2024-03-04T13:00:15.355690+0000","last_fullsized":"2024-03-04T13:00:15.355690+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:00:21.398680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":990,"num_write":404,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":463,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.992632+0000","last_change":"2024-03-04T12:36:13.349289+0000","last_active":"2024-03-04T12:56:30.992632+0000","last_peered":"2024-03-04T12:56:30.992632+0000","last_clean":"2024-03-04T12:56:30.992632+0000","last_became_active":"2024-03-04T12:36:13.348999+0000","last_became_peered":"2024-03-04T12:36:13.348999+0000","last_unstale":"2024-03-04T12:56:30.992632+0000","last_undegraded":"2024-03-04T12:56:30.992632+0000","last_fullsized":"2024-03-04T12:56:30.992632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:01:23.408092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"256'97","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:39.238643+0000","last_change":"2024-03-04T12:36:15.360060+0000","last_active":"2024-03-04T12:59:39.238643+0000","last_peered":"2024-03-04T12:59:39.238643+0000","last_clean":"2024-03-04T12:59:39.238643+0000","last_became_active":"2024-03-04T12:36:15.359732+0000","last_became_peered":"2024-03-04T12:36:15.359732+0000","last_unstale":"2024-03-04T12:59:39.238643+0000","last_undegraded":"2024-03-04T12:59:39.238643+0000","last_fullsized":"2024-03-04T12:59:39.238643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:46.691644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"256'879","reported_seq":2433,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.129050+0000","last_change":"2024-03-04T12:36:07.299296+0000","last_active":"2024-03-04T12:59:50.129050+0000","last_peered":"2024-03-04T12:59:50.129050+0000","last_clean":"2024-03-04T12:59:50.129050+0000","last_became_active":"2024-03-04T12:36:07.298999+0000","last_became_peered":"2024-03-04T12:36:07.298999+0000","last_unstale":"2024-03-04T12:59:50.129050+0000","last_undegraded":"2024-03-04T12:59:50.129050+0000","last_fullsized":"2024-03-04T12:59:50.129050+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:15.755740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4068,"num_read_kb":3596,"num_write":1224,"num_write_kb":497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"256'308","reported_seq":908,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.940339+0000","last_change":"2024-03-04T12:36:05.289780+0000","last_active":"2024-03-04T13:00:15.940339+0000","last_peered":"2024-03-04T13:00:15.940339+0000","last_clean":"2024-03-04T13:00:15.940339+0000","last_became_active":"2024-03-04T12:36:05.289486+0000","last_became_peered":"2024-03-04T12:36:05.289486+0000","last_unstale":"2024-03-04T13:00:15.940339+0000","last_undegraded":"2024-03-04T13:00:15.940339+0000","last_fullsized":"2024-03-04T13:00:15.940339+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:54.563075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17286171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":403,"num_read_kb":48705,"num_write":1279,"num_write_kb":64123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:25.975316+0000","last_change":"2024-03-04T12:36:09.306337+0000","last_active":"2024-03-04T12:56:25.975316+0000","last_peered":"2024-03-04T12:56:25.975316+0000","last_clean":"2024-03-04T12:56:25.975316+0000","last_became_active":"2024-03-04T12:36:09.305880+0000","last_became_peered":"2024-03-04T12:36:09.305880+0000","last_unstale":"2024-03-04T12:56:25.975316+0000","last_undegraded":"2024-03-04T12:56:25.975316+0000","last_fullsized":"2024-03-04T12:56:25.975316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:12:13.954397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"256'261","reported_seq":808,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.700544+0000","last_change":"2024-03-04T12:36:11.327832+0000","last_active":"2024-03-04T13:00:08.700544+0000","last_peered":"2024-03-04T13:00:08.700544+0000","last_clean":"2024-03-04T13:00:08.700544+0000","last_became_active":"2024-03-04T12:36:11.327499+0000","last_became_peered":"2024-03-04T12:36:11.327499+0000","last_unstale":"2024-03-04T13:00:08.700544+0000","last_undegraded":"2024-03-04T13:00:08.700544+0000","last_fullsized":"2024-03-04T13:00:08.700544+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:11:36.354045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56466,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":427,"num_read_kb":893,"num_write":352,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"256'476","reported_seq":1624,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.236960+0000","last_change":"2024-03-04T12:36:13.338140+0000","last_active":"2024-03-04T13:00:15.236960+0000","last_peered":"2024-03-04T13:00:15.236960+0000","last_clean":"2024-03-04T13:00:15.236960+0000","last_became_active":"2024-03-04T12:36:13.337817+0000","last_became_peered":"2024-03-04T12:36:13.337817+0000","last_unstale":"2024-03-04T13:00:15.236960+0000","last_undegraded":"2024-03-04T13:00:15.236960+0000","last_fullsized":"2024-03-04T13:00:15.236960+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:48.478224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"256'95","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:51.103823+0000","last_change":"2024-03-04T12:36:15.349157+0000","last_active":"2024-03-04T12:58:51.103823+0000","last_peered":"2024-03-04T12:58:51.103823+0000","last_clean":"2024-03-04T12:58:51.103823+0000","last_became_active":"2024-03-04T12:36:15.348869+0000","last_became_peered":"2024-03-04T12:36:15.348869+0000","last_unstale":"2024-03-04T12:58:51.103823+0000","last_undegraded":"2024-03-04T12:58:51.103823+0000","last_fullsized":"2024-03-04T12:58:51.103823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:52:50.410936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":240,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"256'411","reported_seq":1952,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.247659+0000","last_change":"2024-03-04T12:36:07.293897+0000","last_active":"2024-03-04T12:59:48.247659+0000","last_peered":"2024-03-04T12:59:48.247659+0000","last_clean":"2024-03-04T12:59:48.247659+0000","last_became_active":"2024-03-04T12:36:07.293586+0000","last_became_peered":"2024-03-04T12:36:07.293586+0000","last_unstale":"2024-03-04T12:59:48.247659+0000","last_undegraded":"2024-03-04T12:59:48.247659+0000","last_fullsized":"2024-03-04T12:59:48.247659+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:31.445571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2259,"num_read_kb":2143,"num_write":486,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"256'294","reported_seq":901,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.958822+0000","last_change":"2024-03-04T12:36:05.288353+0000","last_active":"2024-03-04T13:00:15.958822+0000","last_peered":"2024-03-04T13:00:15.958822+0000","last_clean":"2024-03-04T13:00:15.958822+0000","last_became_active":"2024-03-04T12:36:05.288036+0000","last_became_peered":"2024-03-04T12:36:05.288036+0000","last_unstale":"2024-03-04T13:00:15.958822+0000","last_undegraded":"2024-03-04T13:00:15.958822+0000","last_fullsized":"2024-03-04T13:00:15.958822+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:01.290623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243366,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":450,"num_read_kb":10713,"num_write":1269,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1088,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.217652+0000","last_change":"2024-03-04T12:36:09.315046+0000","last_active":"2024-03-04T13:00:15.217652+0000","last_peered":"2024-03-04T13:00:15.217652+0000","last_clean":"2024-03-04T13:00:15.217652+0000","last_became_active":"2024-03-04T12:36:09.314474+0000","last_became_peered":"2024-03-04T12:36:09.314474+0000","last_unstale":"2024-03-04T13:00:15.217652+0000","last_undegraded":"2024-03-04T13:00:15.217652+0000","last_fullsized":"2024-03-04T13:00:15.217652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:46:57.713946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":612,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"256'50","reported_seq":536,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:38.607544+0000","last_change":"2024-03-04T12:36:11.954876+0000","last_active":"2024-03-04T12:58:38.607544+0000","last_peered":"2024-03-04T12:58:38.607544+0000","last_clean":"2024-03-04T12:58:38.607544+0000","last_became_active":"2024-03-04T12:36:11.954508+0000","last_became_peered":"2024-03-04T12:36:11.954508+0000","last_unstale":"2024-03-04T12:58:38.607544+0000","last_undegraded":"2024-03-04T12:58:38.607544+0000","last_fullsized":"2024-03-04T12:58:38.607544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:09.989384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"256'481","reported_seq":1496,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.238885+0000","last_change":"2024-03-04T12:36:13.343179+0000","last_active":"2024-03-04T13:00:15.238885+0000","last_peered":"2024-03-04T13:00:15.238885+0000","last_clean":"2024-03-04T13:00:15.238885+0000","last_became_active":"2024-03-04T12:36:13.342902+0000","last_became_peered":"2024-03-04T12:36:13.342902+0000","last_unstale":"2024-03-04T13:00:15.238885+0000","last_undegraded":"2024-03-04T13:00:15.238885+0000","last_fullsized":"2024-03-04T13:00:15.238885+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:58.981468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"256'93","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:34.781977+0000","last_change":"2024-03-04T12:36:15.352744+0000","last_active":"2024-03-04T12:59:34.781977+0000","last_peered":"2024-03-04T12:59:34.781977+0000","last_clean":"2024-03-04T12:59:34.781977+0000","last_became_active":"2024-03-04T12:36:15.352420+0000","last_became_peered":"2024-03-04T12:36:15.352420+0000","last_unstale":"2024-03-04T12:59:34.781977+0000","last_undegraded":"2024-03-04T12:59:34.781977+0000","last_fullsized":"2024-03-04T12:59:34.781977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:55.559823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":79,"num_write":205,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"256'1079","reported_seq":2453,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.904016+0000","last_change":"2024-03-04T12:36:07.304422+0000","last_active":"2024-03-04T12:59:54.904016+0000","last_peered":"2024-03-04T12:59:54.904016+0000","last_clean":"2024-03-04T12:59:54.904016+0000","last_became_active":"2024-03-04T12:36:07.304123+0000","last_became_peered":"2024-03-04T12:36:07.304123+0000","last_unstale":"2024-03-04T12:59:54.904016+0000","last_undegraded":"2024-03-04T12:59:54.904016+0000","last_fullsized":"2024-03-04T12:59:54.904016+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1000,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:23.435722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4358,"num_read_kb":3794,"num_write":1486,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'323","reported_seq":947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.000117+0000","last_change":"2024-03-04T12:36:05.286870+0000","last_active":"2024-03-04T13:00:16.000117+0000","last_peered":"2024-03-04T13:00:16.000117+0000","last_clean":"2024-03-04T13:00:16.000117+0000","last_became_active":"2024-03-04T12:36:05.286442+0000","last_became_peered":"2024-03-04T12:36:05.286442+0000","last_unstale":"2024-03-04T13:00:16.000117+0000","last_undegraded":"2024-03-04T13:00:16.000117+0000","last_fullsized":"2024-03-04T13:00:16.000117+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:25:34.379001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7354917,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":454,"num_read_kb":22844,"num_write":1262,"num_write_kb":40494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:25.985653+0000","last_change":"2024-03-04T12:36:09.314992+0000","last_active":"2024-03-04T12:56:25.985653+0000","last_peered":"2024-03-04T12:56:25.985653+0000","last_clean":"2024-03-04T12:56:25.985653+0000","last_became_active":"2024-03-04T12:36:09.314671+0000","last_became_peered":"2024-03-04T12:36:09.314671+0000","last_unstale":"2024-03-04T12:56:25.985653+0000","last_undegraded":"2024-03-04T12:56:25.985653+0000","last_fullsized":"2024-03-04T12:56:25.985653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:57:19.079487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"256'286","reported_seq":848,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.832296+0000","last_change":"2024-03-04T12:36:11.325717+0000","last_active":"2024-03-04T13:00:08.832296+0000","last_peered":"2024-03-04T13:00:08.832296+0000","last_clean":"2024-03-04T13:00:08.832296+0000","last_became_active":"2024-03-04T12:36:11.325372+0000","last_became_peered":"2024-03-04T12:36:11.325372+0000","last_unstale":"2024-03-04T13:00:08.832296+0000","last_undegraded":"2024-03-04T13:00:08.832296+0000","last_fullsized":"2024-03-04T13:00:08.832296+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:16:12.771232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49363,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1032,"num_read_kb":1454,"num_write":1520,"num_write_kb":1422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.981677+0000","last_change":"2024-03-04T12:36:13.349278+0000","last_active":"2024-03-04T12:56:30.981677+0000","last_peered":"2024-03-04T12:56:30.981677+0000","last_clean":"2024-03-04T12:56:30.981677+0000","last_became_active":"2024-03-04T12:36:13.348998+0000","last_became_peered":"2024-03-04T12:36:13.348998+0000","last_unstale":"2024-03-04T12:56:30.981677+0000","last_undegraded":"2024-03-04T12:56:30.981677+0000","last_fullsized":"2024-03-04T12:56:30.981677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:03:29.176425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"256'116","reported_seq":596,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:43.519813+0000","last_change":"2024-03-04T12:36:15.363113+0000","last_active":"2024-03-04T12:58:43.519813+0000","last_peered":"2024-03-04T12:58:43.519813+0000","last_clean":"2024-03-04T12:58:43.519813+0000","last_became_active":"2024-03-04T12:36:15.362792+0000","last_became_peered":"2024-03-04T12:36:15.362792+0000","last_unstale":"2024-03-04T12:58:43.519813+0000","last_undegraded":"2024-03-04T12:58:43.519813+0000","last_fullsized":"2024-03-04T12:58:43.519813+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:51:39.773670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":132,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"256'316","reported_seq":1674,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.469861+0000","last_change":"2024-03-04T12:36:07.300301+0000","last_active":"2024-03-04T12:59:55.469861+0000","last_peered":"2024-03-04T12:59:55.469861+0000","last_clean":"2024-03-04T12:59:55.469861+0000","last_became_active":"2024-03-04T12:36:07.299952+0000","last_became_peered":"2024-03-04T12:36:07.299952+0000","last_unstale":"2024-03-04T12:59:55.469861+0000","last_undegraded":"2024-03-04T12:59:55.469861+0000","last_fullsized":"2024-03-04T12:59:55.469861+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:58.864307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1855,"num_read_kb":1767,"num_write":364,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":649,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.884796+0000","last_change":"2024-03-04T12:35:47.950593+0000","last_active":"2024-03-04T12:57:55.884796+0000","last_peered":"2024-03-04T12:57:55.884796+0000","last_clean":"2024-03-04T12:57:55.884796+0000","last_became_active":"2024-03-04T12:35:47.950213+0000","last_became_peered":"2024-03-04T12:35:47.950213+0000","last_unstale":"2024-03-04T12:57:55.884796+0000","last_undegraded":"2024-03-04T12:57:55.884796+0000","last_fullsized":"2024-03-04T12:57:55.884796+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_clean_scrub_stamp":"2024-03-04T12:35:46.856449+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:52:59.823887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.989264+0000","last_change":"2024-03-04T12:35:54.235102+0000","last_active":"2024-03-04T12:56:45.989264+0000","last_peered":"2024-03-04T12:56:45.989264+0000","last_clean":"2024-03-04T12:56:45.989264+0000","last_became_active":"2024-03-04T12:35:54.234819+0000","last_became_peered":"2024-03-04T12:35:54.234819+0000","last_unstale":"2024-03-04T12:56:45.989264+0000","last_undegraded":"2024-03-04T12:56:45.989264+0000","last_fullsized":"2024-03-04T12:56:45.989264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:40.517488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"256'276","reported_seq":885,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.898239+0000","last_change":"2024-03-04T12:36:05.297146+0000","last_active":"2024-03-04T13:00:15.898239+0000","last_peered":"2024-03-04T13:00:15.898239+0000","last_clean":"2024-03-04T13:00:15.898239+0000","last_became_active":"2024-03-04T12:36:05.296783+0000","last_became_peered":"2024-03-04T12:36:05.296783+0000","last_unstale":"2024-03-04T13:00:15.898239+0000","last_undegraded":"2024-03-04T13:00:15.898239+0000","last_fullsized":"2024-03-04T13:00:15.898239+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:06:23.807756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437583,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":424,"num_read_kb":16803,"num_write":1112,"num_write_kb":27899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.876708+0000","last_change":"2024-03-04T12:36:09.306698+0000","last_active":"2024-03-04T12:57:00.876708+0000","last_peered":"2024-03-04T12:57:00.876708+0000","last_clean":"2024-03-04T12:57:00.876708+0000","last_became_active":"2024-03-04T12:36:09.306398+0000","last_became_peered":"2024-03-04T12:36:09.306398+0000","last_unstale":"2024-03-04T12:57:00.876708+0000","last_undegraded":"2024-03-04T12:57:00.876708+0000","last_fullsized":"2024-03-04T12:57:00.876708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:16.000870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"256'653","reported_seq":1318,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.925262+0000","last_change":"2024-03-04T12:36:11.327855+0000","last_active":"2024-03-04T13:00:15.925262+0000","last_peered":"2024-03-04T13:00:15.925262+0000","last_clean":"2024-03-04T13:00:15.925262+0000","last_became_active":"2024-03-04T12:36:11.327652+0000","last_became_peered":"2024-03-04T12:36:11.327652+0000","last_unstale":"2024-03-04T13:00:15.925262+0000","last_undegraded":"2024-03-04T13:00:15.925262+0000","last_fullsized":"2024-03-04T13:00:15.925262+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:41:37.539307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158967,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1269,"num_read_kb":2731,"num_write":1176,"num_write_kb":1053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.003351+0000","last_change":"2024-03-04T12:36:13.341910+0000","last_active":"2024-03-04T12:57:56.003351+0000","last_peered":"2024-03-04T12:57:56.003351+0000","last_clean":"2024-03-04T12:57:56.003351+0000","last_became_active":"2024-03-04T12:36:13.341629+0000","last_became_peered":"2024-03-04T12:36:13.341629+0000","last_unstale":"2024-03-04T12:57:56.003351+0000","last_undegraded":"2024-03-04T12:57:56.003351+0000","last_fullsized":"2024-03-04T12:57:56.003351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:27:23.583364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"256'95","reported_seq":571,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.010288+0000","last_change":"2024-03-04T12:36:15.363641+0000","last_active":"2024-03-04T13:00:06.010288+0000","last_peered":"2024-03-04T13:00:06.010288+0000","last_clean":"2024-03-04T13:00:06.010288+0000","last_became_active":"2024-03-04T12:36:15.363355+0000","last_became_peered":"2024-03-04T12:36:15.363355+0000","last_unstale":"2024-03-04T13:00:06.010288+0000","last_undegraded":"2024-03-04T13:00:06.010288+0000","last_fullsized":"2024-03-04T13:00:06.010288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:41:52.622760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"256'352","reported_seq":1786,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:46.629131+0000","last_change":"2024-03-04T12:36:07.302006+0000","last_active":"2024-03-04T12:59:46.629131+0000","last_peered":"2024-03-04T12:59:46.629131+0000","last_clean":"2024-03-04T12:59:46.629131+0000","last_became_active":"2024-03-04T12:36:07.301706+0000","last_became_peered":"2024-03-04T12:36:07.301706+0000","last_unstale":"2024-03-04T12:59:46.629131+0000","last_undegraded":"2024-03-04T12:59:46.629131+0000","last_fullsized":"2024-03-04T12:59:46.629131+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:39:55.323374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2015,"num_read_kb":1927,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:00.885742+0000","last_change":"2024-03-04T12:35:54.238692+0000","last_active":"2024-03-04T12:58:00.885742+0000","last_peered":"2024-03-04T12:58:00.885742+0000","last_clean":"2024-03-04T12:58:00.885742+0000","last_became_active":"2024-03-04T12:35:54.238351+0000","last_became_peered":"2024-03-04T12:35:54.238351+0000","last_unstale":"2024-03-04T12:58:00.885742+0000","last_undegraded":"2024-03-04T12:58:00.885742+0000","last_fullsized":"2024-03-04T12:58:00.885742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:37.144629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"256'328","reported_seq":992,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.962030+0000","last_change":"2024-03-04T12:36:05.285992+0000","last_active":"2024-03-04T13:00:15.962030+0000","last_peered":"2024-03-04T13:00:15.962030+0000","last_clean":"2024-03-04T13:00:15.962030+0000","last_became_active":"2024-03-04T12:36:05.285659+0000","last_became_peered":"2024-03-04T12:36:05.285659+0000","last_unstale":"2024-03-04T13:00:15.962030+0000","last_undegraded":"2024-03-04T13:00:15.962030+0000","last_fullsized":"2024-03-04T13:00:15.962030+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:45:04.076122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11600186,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":557,"num_read_kb":21915,"num_write":1242,"num_write_kb":32530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:51.000222+0000","last_change":"2024-03-04T12:36:09.314765+0000","last_active":"2024-03-04T12:57:51.000222+0000","last_peered":"2024-03-04T12:57:51.000222+0000","last_clean":"2024-03-04T12:57:51.000222+0000","last_became_active":"2024-03-04T12:36:09.314113+0000","last_became_peered":"2024-03-04T12:36:09.314113+0000","last_unstale":"2024-03-04T12:57:51.000222+0000","last_undegraded":"2024-03-04T12:57:51.000222+0000","last_fullsized":"2024-03-04T12:57:51.000222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:55.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"256'1008","reported_seq":2112,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.879794+0000","last_change":"2024-03-04T12:36:11.323823+0000","last_active":"2024-03-04T13:00:15.879794+0000","last_peered":"2024-03-04T13:00:15.879794+0000","last_clean":"2024-03-04T13:00:15.879794+0000","last_became_active":"2024-03-04T12:36:11.323543+0000","last_became_peered":"2024-03-04T12:36:11.323543+0000","last_unstale":"2024-03-04T13:00:15.879794+0000","last_undegraded":"2024-03-04T13:00:15.879794+0000","last_fullsized":"2024-03-04T13:00:15.879794+0000","mapping_epoch":26,"log_start":"256'900","ondisk_log_start":"256'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":900,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:18.828076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168633,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1588,"num_read_kb":3038,"num_write":960,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.878183+0000","last_change":"2024-03-04T12:36:13.339634+0000","last_active":"2024-03-04T12:57:10.878183+0000","last_peered":"2024-03-04T12:57:10.878183+0000","last_clean":"2024-03-04T12:57:10.878183+0000","last_became_active":"2024-03-04T12:36:13.339353+0000","last_became_peered":"2024-03-04T12:36:13.339353+0000","last_unstale":"2024-03-04T12:57:10.878183+0000","last_undegraded":"2024-03-04T12:57:10.878183+0000","last_fullsized":"2024-03-04T12:57:10.878183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:35.363812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"256'145","reported_seq":632,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:45.918673+0000","last_change":"2024-03-04T12:36:15.346836+0000","last_active":"2024-03-04T12:59:45.918673+0000","last_peered":"2024-03-04T12:59:45.918673+0000","last_clean":"2024-03-04T12:59:45.918673+0000","last_became_active":"2024-03-04T12:36:15.346516+0000","last_became_peered":"2024-03-04T12:36:15.346516+0000","last_unstale":"2024-03-04T12:59:45.918673+0000","last_undegraded":"2024-03-04T12:59:45.918673+0000","last_fullsized":"2024-03-04T12:59:45.918673+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:23:48.979559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":196,"num_read_kb":196,"num_write":318,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"256'397","reported_seq":1866,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.670858+0000","last_change":"2024-03-04T12:36:07.303682+0000","last_active":"2024-03-04T13:00:06.670858+0000","last_peered":"2024-03-04T13:00:06.670858+0000","last_clean":"2024-03-04T13:00:06.670858+0000","last_became_active":"2024-03-04T12:36:07.300039+0000","last_became_peered":"2024-03-04T12:36:07.300039+0000","last_unstale":"2024-03-04T13:00:06.670858+0000","last_undegraded":"2024-03-04T13:00:06.670858+0000","last_fullsized":"2024-03-04T13:00:06.670858+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:24.962188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2349,"num_read_kb":2220,"num_write":468,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":492,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.981094+0000","last_change":"2024-03-04T12:35:54.236078+0000","last_active":"2024-03-04T12:56:45.981094+0000","last_peered":"2024-03-04T12:56:45.981094+0000","last_clean":"2024-03-04T12:56:45.981094+0000","last_became_active":"2024-03-04T12:35:54.235738+0000","last_became_peered":"2024-03-04T12:35:54.235738+0000","last_unstale":"2024-03-04T12:56:45.981094+0000","last_undegraded":"2024-03-04T12:56:45.981094+0000","last_fullsized":"2024-03-04T12:56:45.981094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:36:28.049431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"256'337","reported_seq":1225,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.939543+0000","last_change":"2024-03-04T12:36:05.275101+0000","last_active":"2024-03-04T13:00:15.939543+0000","last_peered":"2024-03-04T13:00:15.939543+0000","last_clean":"2024-03-04T13:00:15.939543+0000","last_became_active":"2024-03-04T12:36:05.274788+0000","last_became_peered":"2024-03-04T12:36:05.274788+0000","last_unstale":"2024-03-04T13:00:15.939543+0000","last_undegraded":"2024-03-04T13:00:15.939543+0000","last_fullsized":"2024-03-04T13:00:15.939543+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:42.330697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9511894,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":1057,"num_read_kb":10802,"num_write":1404,"num_write_kb":39091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.988318+0000","last_change":"2024-03-04T12:36:09.315373+0000","last_active":"2024-03-04T12:57:50.988318+0000","last_peered":"2024-03-04T12:57:50.988318+0000","last_clean":"2024-03-04T12:57:50.988318+0000","last_became_active":"2024-03-04T12:36:09.315023+0000","last_became_peered":"2024-03-04T12:36:09.315023+0000","last_unstale":"2024-03-04T12:57:50.988318+0000","last_undegraded":"2024-03-04T12:57:50.988318+0000","last_fullsized":"2024-03-04T12:57:50.988318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:07:21.105335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"256'188","reported_seq":992,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.829479+0000","last_change":"2024-03-04T12:36:11.955503+0000","last_active":"2024-03-04T13:00:08.829479+0000","last_peered":"2024-03-04T13:00:08.829479+0000","last_clean":"2024-03-04T13:00:08.829479+0000","last_became_active":"2024-03-04T12:36:11.954554+0000","last_became_peered":"2024-03-04T12:36:11.954554+0000","last_unstale":"2024-03-04T13:00:08.829479+0000","last_undegraded":"2024-03-04T13:00:08.829479+0000","last_fullsized":"2024-03-04T13:00:08.829479+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:18:36.129703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:05.997035+0000","last_change":"2024-03-04T12:36:13.338785+0000","last_active":"2024-03-04T12:57:05.997035+0000","last_peered":"2024-03-04T12:57:05.997035+0000","last_clean":"2024-03-04T12:57:05.997035+0000","last_became_active":"2024-03-04T12:36:13.338388+0000","last_became_peered":"2024-03-04T12:36:13.338388+0000","last_unstale":"2024-03-04T12:57:05.997035+0000","last_undegraded":"2024-03-04T12:57:05.997035+0000","last_fullsized":"2024-03-04T12:57:05.997035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:15.536794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'192","reported_seq":682,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:17.459051+0000","last_change":"2024-03-04T12:36:15.354193+0000","last_active":"2024-03-04T12:59:17.459051+0000","last_peered":"2024-03-04T12:59:17.459051+0000","last_clean":"2024-03-04T12:59:17.459051+0000","last_became_active":"2024-03-04T12:36:15.353529+0000","last_became_peered":"2024-03-04T12:36:15.353529+0000","last_unstale":"2024-03-04T12:59:17.459051+0000","last_undegraded":"2024-03-04T12:59:17.459051+0000","last_fullsized":"2024-03-04T12:59:17.459051+0000","mapping_epoch":30,"log_start":"241'100","ondisk_log_start":"241'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:04.219643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":292,"num_read_kb":316,"num_write":426,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"256'393","reported_seq":1822,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671228+0000","last_change":"2024-03-04T12:36:07.299521+0000","last_active":"2024-03-04T13:00:06.671228+0000","last_peered":"2024-03-04T13:00:06.671228+0000","last_clean":"2024-03-04T13:00:06.671228+0000","last_became_active":"2024-03-04T12:36:07.298936+0000","last_became_peered":"2024-03-04T12:36:07.298936+0000","last_unstale":"2024-03-04T13:00:06.671228+0000","last_undegraded":"2024-03-04T13:00:06.671228+0000","last_fullsized":"2024-03-04T13:00:06.671228+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:42:23.027185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2152,"num_read_kb":2018,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.989215+0000","last_change":"2024-03-04T12:35:54.238657+0000","last_active":"2024-03-04T12:56:45.989215+0000","last_peered":"2024-03-04T12:56:45.989215+0000","last_clean":"2024-03-04T12:56:45.989215+0000","last_became_active":"2024-03-04T12:35:54.238357+0000","last_became_peered":"2024-03-04T12:35:54.238357+0000","last_unstale":"2024-03-04T12:56:45.989215+0000","last_undegraded":"2024-03-04T12:56:45.989215+0000","last_fullsized":"2024-03-04T12:56:45.989215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:33:05.241037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"256'289","reported_seq":937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.937621+0000","last_change":"2024-03-04T12:36:05.289667+0000","last_active":"2024-03-04T13:00:15.937621+0000","last_peered":"2024-03-04T13:00:15.937621+0000","last_clean":"2024-03-04T13:00:15.937621+0000","last_became_active":"2024-03-04T12:36:05.289374+0000","last_became_peered":"2024-03-04T12:36:05.289374+0000","last_unstale":"2024-03-04T13:00:15.937621+0000","last_undegraded":"2024-03-04T13:00:15.937621+0000","last_fullsized":"2024-03-04T13:00:15.937621+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:40:44.869761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10396162,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":493,"num_read_kb":54490,"num_write":1239,"num_write_kb":39662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996409+0000","last_change":"2024-03-04T12:36:09.304779+0000","last_active":"2024-03-04T12:57:00.996409+0000","last_peered":"2024-03-04T12:57:00.996409+0000","last_clean":"2024-03-04T12:57:00.996409+0000","last_became_active":"2024-03-04T12:36:09.304291+0000","last_became_peered":"2024-03-04T12:36:09.304291+0000","last_unstale":"2024-03-04T12:57:00.996409+0000","last_undegraded":"2024-03-04T12:57:00.996409+0000","last_fullsized":"2024-03-04T12:57:00.996409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:49.161718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"256'81","reported_seq":586,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:12.360275+0000","last_change":"2024-03-04T12:36:11.326239+0000","last_active":"2024-03-04T12:59:12.360275+0000","last_peered":"2024-03-04T12:59:12.360275+0000","last_clean":"2024-03-04T12:59:12.360275+0000","last_became_active":"2024-03-04T12:36:11.325957+0000","last_became_peered":"2024-03-04T12:36:11.325957+0000","last_unstale":"2024-03-04T12:59:12.360275+0000","last_undegraded":"2024-03-04T12:59:12.360275+0000","last_fullsized":"2024-03-04T12:59:12.360275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:45:15.387282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":66,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":466,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.993163+0000","last_change":"2024-03-04T12:36:13.345759+0000","last_active":"2024-03-04T12:57:55.993163+0000","last_peered":"2024-03-04T12:57:55.993163+0000","last_clean":"2024-03-04T12:57:55.993163+0000","last_became_active":"2024-03-04T12:36:13.345547+0000","last_became_peered":"2024-03-04T12:36:13.345547+0000","last_unstale":"2024-03-04T12:57:55.993163+0000","last_undegraded":"2024-03-04T12:57:55.993163+0000","last_fullsized":"2024-03-04T12:57:55.993163+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:20.602726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"256'111","reported_seq":598,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:17.289185+0000","last_change":"2024-03-04T12:36:15.363530+0000","last_active":"2024-03-04T12:59:17.289185+0000","last_peered":"2024-03-04T12:59:17.289185+0000","last_clean":"2024-03-04T12:59:17.289185+0000","last_became_active":"2024-03-04T12:36:15.363185+0000","last_became_peered":"2024-03-04T12:36:15.363185+0000","last_unstale":"2024-03-04T12:59:17.289185+0000","last_undegraded":"2024-03-04T12:59:17.289185+0000","last_fullsized":"2024-03-04T12:59:17.289185+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:16.150410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":251,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"256'464","reported_seq":2007,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.027056+0000","last_change":"2024-03-04T12:36:07.297241+0000","last_active":"2024-03-04T12:59:56.027056+0000","last_peered":"2024-03-04T12:59:56.027056+0000","last_clean":"2024-03-04T12:59:56.027056+0000","last_became_active":"2024-03-04T12:36:07.296433+0000","last_became_peered":"2024-03-04T12:36:07.296433+0000","last_unstale":"2024-03-04T12:59:56.027056+0000","last_undegraded":"2024-03-04T12:59:56.027056+0000","last_fullsized":"2024-03-04T12:59:56.027056+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:57:02.539909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2396,"num_read_kb":2259,"num_write":579,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"256'350","reported_seq":1003,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.997751+0000","last_change":"2024-03-04T12:36:40.965648+0000","last_active":"2024-03-04T13:00:15.997751+0000","last_peered":"2024-03-04T13:00:15.997751+0000","last_clean":"2024-03-04T13:00:15.997751+0000","last_became_active":"2024-03-04T12:36:40.965346+0000","last_became_peered":"2024-03-04T12:36:40.965346+0000","last_unstale":"2024-03-04T13:00:15.997751+0000","last_undegraded":"2024-03-04T13:00:15.997751+0000","last_fullsized":"2024-03-04T13:00:15.997751+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:34.208423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6319328,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":575,"num_read_kb":48879,"num_write":1423,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.977490+0000","last_change":"2024-03-04T12:35:54.470673+0000","last_active":"2024-03-04T12:56:45.977490+0000","last_peered":"2024-03-04T12:56:45.977490+0000","last_clean":"2024-03-04T12:56:45.977490+0000","last_became_active":"2024-03-04T12:35:54.470407+0000","last_became_peered":"2024-03-04T12:35:54.470407+0000","last_unstale":"2024-03-04T12:56:45.977490+0000","last_undegraded":"2024-03-04T12:56:45.977490+0000","last_fullsized":"2024-03-04T12:56:45.977490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:30:21.008474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996381+0000","last_change":"2024-03-04T12:36:09.308620+0000","last_active":"2024-03-04T12:57:00.996381+0000","last_peered":"2024-03-04T12:57:00.996381+0000","last_clean":"2024-03-04T12:57:00.996381+0000","last_became_active":"2024-03-04T12:36:09.308360+0000","last_became_peered":"2024-03-04T12:36:09.308360+0000","last_unstale":"2024-03-04T12:57:00.996381+0000","last_undegraded":"2024-03-04T12:57:00.996381+0000","last_fullsized":"2024-03-04T12:57:00.996381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:12:02.956921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"256'484","reported_seq":1103,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.807353+0000","last_change":"2024-03-04T12:36:11.329225+0000","last_active":"2024-03-04T13:00:15.807353+0000","last_peered":"2024-03-04T13:00:15.807353+0000","last_clean":"2024-03-04T13:00:15.807353+0000","last_became_active":"2024-03-04T12:36:11.328923+0000","last_became_peered":"2024-03-04T12:36:11.328923+0000","last_unstale":"2024-03-04T13:00:15.807353+0000","last_undegraded":"2024-03-04T13:00:15.807353+0000","last_fullsized":"2024-03-04T13:00:15.807353+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:50.151006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":830,"num_read_kb":1802,"num_write":674,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:05.992670+0000","last_change":"2024-03-04T12:36:13.347228+0000","last_active":"2024-03-04T12:57:05.992670+0000","last_peered":"2024-03-04T12:57:05.992670+0000","last_clean":"2024-03-04T12:57:05.992670+0000","last_became_active":"2024-03-04T12:36:13.346886+0000","last_became_peered":"2024-03-04T12:36:13.346886+0000","last_unstale":"2024-03-04T12:57:05.992670+0000","last_undegraded":"2024-03-04T12:57:05.992670+0000","last_fullsized":"2024-03-04T12:57:05.992670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:14.642237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"256'94","reported_seq":573,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.020901+0000","last_change":"2024-03-04T12:36:15.350589+0000","last_active":"2024-03-04T12:59:56.020901+0000","last_peered":"2024-03-04T12:59:56.020901+0000","last_clean":"2024-03-04T12:59:56.020901+0000","last_became_active":"2024-03-04T12:36:15.350185+0000","last_became_peered":"2024-03-04T12:36:15.350185+0000","last_unstale":"2024-03-04T12:59:56.020901+0000","last_undegraded":"2024-03-04T12:59:56.020901+0000","last_fullsized":"2024-03-04T12:59:56.020901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:06:50.695793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":228,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"256'646","reported_seq":2008,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.609894+0000","last_change":"2024-03-04T12:36:07.296955+0000","last_active":"2024-03-04T12:59:47.609894+0000","last_peered":"2024-03-04T12:59:47.609894+0000","last_clean":"2024-03-04T12:59:47.609894+0000","last_became_active":"2024-03-04T12:36:07.296657+0000","last_became_peered":"2024-03-04T12:36:07.296657+0000","last_unstale":"2024-03-04T12:59:47.609894+0000","last_undegraded":"2024-03-04T12:59:47.609894+0000","last_fullsized":"2024-03-04T12:59:47.609894+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":600,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:09.500092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3068,"num_read_kb":2828,"num_write":988,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"256'311","reported_seq":984,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.890225+0000","last_change":"2024-03-04T12:36:05.275545+0000","last_active":"2024-03-04T13:00:15.890225+0000","last_peered":"2024-03-04T13:00:15.890225+0000","last_clean":"2024-03-04T13:00:15.890225+0000","last_became_active":"2024-03-04T12:36:05.275263+0000","last_became_peered":"2024-03-04T12:36:05.275263+0000","last_unstale":"2024-03-04T13:00:15.890225+0000","last_undegraded":"2024-03-04T13:00:15.890225+0000","last_fullsized":"2024-03-04T13:00:15.890225+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:05.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14025863,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":601,"num_read_kb":62539,"num_write":1399,"num_write_kb":42561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":492,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:50.875403+0000","last_change":"2024-03-04T12:35:54.470913+0000","last_active":"2024-03-04T12:56:50.875403+0000","last_peered":"2024-03-04T12:56:50.875403+0000","last_clean":"2024-03-04T12:56:50.875403+0000","last_became_active":"2024-03-04T12:35:54.470620+0000","last_became_peered":"2024-03-04T12:35:54.470620+0000","last_unstale":"2024-03-04T12:56:50.875403+0000","last_undegraded":"2024-03-04T12:56:50.875403+0000","last_fullsized":"2024-03-04T12:56:50.875403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:00.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.985543+0000","last_change":"2024-03-04T12:36:09.312394+0000","last_active":"2024-03-04T12:57:00.985543+0000","last_peered":"2024-03-04T12:57:00.985543+0000","last_clean":"2024-03-04T12:57:00.985543+0000","last_became_active":"2024-03-04T12:36:09.312135+0000","last_became_peered":"2024-03-04T12:36:09.312135+0000","last_unstale":"2024-03-04T12:57:00.985543+0000","last_undegraded":"2024-03-04T12:57:00.985543+0000","last_fullsized":"2024-03-04T12:57:00.985543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:40:59.354604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"256'139","reported_seq":665,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.644974+0000","last_change":"2024-03-04T12:36:11.954977+0000","last_active":"2024-03-04T12:59:48.644974+0000","last_peered":"2024-03-04T12:59:48.644974+0000","last_clean":"2024-03-04T12:59:48.644974+0000","last_became_active":"2024-03-04T12:36:11.954579+0000","last_became_peered":"2024-03-04T12:36:11.954579+0000","last_unstale":"2024-03-04T12:59:48.644974+0000","last_undegraded":"2024-03-04T12:59:48.644974+0000","last_fullsized":"2024-03-04T12:59:48.644974+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:39.654798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":130,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"256'544","reported_seq":4062,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.236192+0000","last_change":"2024-03-04T12:36:13.342293+0000","last_active":"2024-03-04T13:00:15.236192+0000","last_peered":"2024-03-04T13:00:15.236192+0000","last_clean":"2024-03-04T13:00:15.236192+0000","last_became_active":"2024-03-04T12:36:13.341957+0000","last_became_peered":"2024-03-04T12:36:13.341957+0000","last_unstale":"2024-03-04T13:00:15.236192+0000","last_undegraded":"2024-03-04T13:00:15.236192+0000","last_fullsized":"2024-03-04T13:00:15.236192+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:06.453055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"256'123","reported_seq":596,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.050692+0000","last_change":"2024-03-04T12:36:15.355664+0000","last_active":"2024-03-04T12:59:53.050692+0000","last_peered":"2024-03-04T12:59:53.050692+0000","last_clean":"2024-03-04T12:59:53.050692+0000","last_became_active":"2024-03-04T12:36:15.355291+0000","last_became_peered":"2024-03-04T12:36:15.355291+0000","last_unstale":"2024-03-04T12:59:53.050692+0000","last_undegraded":"2024-03-04T12:59:53.050692+0000","last_fullsized":"2024-03-04T12:59:53.050692+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:08.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"256'743","reported_seq":2161,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.045676+0000","last_change":"2024-03-04T12:36:07.290212+0000","last_active":"2024-03-04T12:59:53.045676+0000","last_peered":"2024-03-04T12:59:53.045676+0000","last_clean":"2024-03-04T12:59:53.045676+0000","last_became_active":"2024-03-04T12:36:07.289884+0000","last_became_peered":"2024-03-04T12:36:07.289884+0000","last_unstale":"2024-03-04T12:59:53.045676+0000","last_undegraded":"2024-03-04T12:59:53.045676+0000","last_fullsized":"2024-03-04T12:59:53.045676+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:07.678104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3351,"num_read_kb":2980,"num_write":997,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"256'280","reported_seq":886,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.946811+0000","last_change":"2024-03-04T12:36:05.291839+0000","last_active":"2024-03-04T13:00:15.946811+0000","last_peered":"2024-03-04T13:00:15.946811+0000","last_clean":"2024-03-04T13:00:15.946811+0000","last_became_active":"2024-03-04T12:36:05.291549+0000","last_became_peered":"2024-03-04T12:36:05.291549+0000","last_unstale":"2024-03-04T13:00:15.946811+0000","last_undegraded":"2024-03-04T13:00:15.946811+0000","last_fullsized":"2024-03-04T13:00:15.946811+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:39.785480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9454214,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":408,"num_read_kb":36332,"num_write":1088,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:35.983734+0000","last_change":"2024-03-04T12:35:54.239060+0000","last_active":"2024-03-04T12:57:35.983734+0000","last_peered":"2024-03-04T12:57:35.983734+0000","last_clean":"2024-03-04T12:57:35.983734+0000","last_became_active":"2024-03-04T12:35:54.238802+0000","last_became_peered":"2024-03-04T12:35:54.238802+0000","last_unstale":"2024-03-04T12:57:35.983734+0000","last_undegraded":"2024-03-04T12:57:35.983734+0000","last_fullsized":"2024-03-04T12:57:35.983734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:29.643511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991892+0000","last_change":"2024-03-04T12:36:09.307816+0000","last_active":"2024-03-04T12:57:00.991892+0000","last_peered":"2024-03-04T12:57:00.991892+0000","last_clean":"2024-03-04T12:57:00.991892+0000","last_became_active":"2024-03-04T12:36:09.307467+0000","last_became_peered":"2024-03-04T12:36:09.307467+0000","last_unstale":"2024-03-04T12:57:00.991892+0000","last_undegraded":"2024-03-04T12:57:00.991892+0000","last_fullsized":"2024-03-04T12:57:00.991892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:30:08.145067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"256'78","reported_seq":585,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:34.753384+0000","last_change":"2024-03-04T12:36:11.326288+0000","last_active":"2024-03-04T12:58:34.753384+0000","last_peered":"2024-03-04T12:58:34.753384+0000","last_clean":"2024-03-04T12:58:34.753384+0000","last_became_active":"2024-03-04T12:36:11.325955+0000","last_became_peered":"2024-03-04T12:36:11.325955+0000","last_unstale":"2024-03-04T12:58:34.753384+0000","last_undegraded":"2024-03-04T12:58:34.753384+0000","last_fullsized":"2024-03-04T12:58:34.753384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:39:41.658332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"256'533","reported_seq":1565,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.239222+0000","last_change":"2024-03-04T12:36:13.349703+0000","last_active":"2024-03-04T13:00:15.239222+0000","last_peered":"2024-03-04T13:00:15.239222+0000","last_clean":"2024-03-04T13:00:15.239222+0000","last_became_active":"2024-03-04T12:36:13.349421+0000","last_became_peered":"2024-03-04T12:36:13.349421+0000","last_unstale":"2024-03-04T13:00:15.239222+0000","last_undegraded":"2024-03-04T13:00:15.239222+0000","last_fullsized":"2024-03-04T13:00:15.239222+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:52:42.138224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"256'96","reported_seq":565,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.767846+0000","last_change":"2024-03-04T12:36:15.356492+0000","last_active":"2024-03-04T12:59:50.767846+0000","last_peered":"2024-03-04T12:59:50.767846+0000","last_clean":"2024-03-04T12:59:50.767846+0000","last_became_active":"2024-03-04T12:36:15.356192+0000","last_became_peered":"2024-03-04T12:36:15.356192+0000","last_unstale":"2024-03-04T12:59:50.767846+0000","last_undegraded":"2024-03-04T12:59:50.767846+0000","last_fullsized":"2024-03-04T12:59:50.767846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:15:40.455972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":232,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"256'390","reported_seq":1911,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.017107+0000","last_change":"2024-03-04T12:36:07.299701+0000","last_active":"2024-03-04T12:59:54.017107+0000","last_peered":"2024-03-04T12:59:54.017107+0000","last_clean":"2024-03-04T12:59:54.017107+0000","last_became_active":"2024-03-04T12:36:07.298963+0000","last_became_peered":"2024-03-04T12:36:07.298963+0000","last_unstale":"2024-03-04T12:59:54.017107+0000","last_undegraded":"2024-03-04T12:59:54.017107+0000","last_fullsized":"2024-03-04T12:59:54.017107+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:26.582084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2139,"num_write":463,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"256'288","reported_seq":898,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.013530+0000","last_change":"2024-03-04T12:36:05.282071+0000","last_active":"2024-03-04T13:00:16.013530+0000","last_peered":"2024-03-04T13:00:16.013530+0000","last_clean":"2024-03-04T13:00:16.013530+0000","last_became_active":"2024-03-04T12:36:05.281790+0000","last_became_peered":"2024-03-04T12:36:05.281790+0000","last_unstale":"2024-03-04T13:00:16.013530+0000","last_undegraded":"2024-03-04T13:00:16.013530+0000","last_fullsized":"2024-03-04T13:00:16.013530+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:07.529352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1779838,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":425,"num_read_kb":33441,"num_write":1152,"num_write_kb":31732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":488,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:35.990462+0000","last_change":"2024-03-04T12:35:54.239095+0000","last_active":"2024-03-04T12:57:35.990462+0000","last_peered":"2024-03-04T12:57:35.990462+0000","last_clean":"2024-03-04T12:57:35.990462+0000","last_became_active":"2024-03-04T12:35:54.238580+0000","last_became_peered":"2024-03-04T12:35:54.238580+0000","last_unstale":"2024-03-04T12:57:35.990462+0000","last_undegraded":"2024-03-04T12:57:35.990462+0000","last_fullsized":"2024-03-04T12:57:35.990462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:51.568234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:10.988802+0000","last_change":"2024-03-04T12:36:09.308483+0000","last_active":"2024-03-04T12:58:10.988802+0000","last_peered":"2024-03-04T12:58:10.988802+0000","last_clean":"2024-03-04T12:58:10.988802+0000","last_became_active":"2024-03-04T12:36:09.308162+0000","last_became_peered":"2024-03-04T12:36:09.308162+0000","last_unstale":"2024-03-04T12:58:10.988802+0000","last_undegraded":"2024-03-04T12:58:10.988802+0000","last_fullsized":"2024-03-04T12:58:10.988802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:27.690789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"256'696","reported_seq":1373,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.607555+0000","last_change":"2024-03-04T12:36:11.955174+0000","last_active":"2024-03-04T13:00:15.607555+0000","last_peered":"2024-03-04T13:00:15.607555+0000","last_clean":"2024-03-04T13:00:15.607555+0000","last_became_active":"2024-03-04T12:36:11.954569+0000","last_became_peered":"2024-03-04T12:36:11.954569+0000","last_unstale":"2024-03-04T13:00:15.607555+0000","last_undegraded":"2024-03-04T13:00:15.607555+0000","last_fullsized":"2024-03-04T13:00:15.607555+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:12.036941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161442,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1251,"num_read_kb":2835,"num_write":1034,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:05.980274+0000","last_change":"2024-03-04T12:36:13.346191+0000","last_active":"2024-03-04T12:57:05.980274+0000","last_peered":"2024-03-04T12:57:05.980274+0000","last_clean":"2024-03-04T12:57:05.980274+0000","last_became_active":"2024-03-04T12:36:13.345919+0000","last_became_peered":"2024-03-04T12:36:13.345919+0000","last_unstale":"2024-03-04T12:57:05.980274+0000","last_undegraded":"2024-03-04T12:57:05.980274+0000","last_fullsized":"2024-03-04T12:57:05.980274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:25.153970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"256'128","reported_seq":591,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:40.768192+0000","last_change":"2024-03-04T12:36:15.363169+0000","last_active":"2024-03-04T12:59:40.768192+0000","last_peered":"2024-03-04T12:59:40.768192+0000","last_clean":"2024-03-04T12:59:40.768192+0000","last_became_active":"2024-03-04T12:36:15.362710+0000","last_became_peered":"2024-03-04T12:36:15.362710+0000","last_unstale":"2024-03-04T12:59:40.768192+0000","last_undegraded":"2024-03-04T12:59:40.768192+0000","last_fullsized":"2024-03-04T12:59:40.768192+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:18:23.671452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"256'110","reported_seq":571,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.681038+0000","last_change":"2024-03-04T12:36:15.363367+0000","last_active":"2024-03-04T13:00:06.681038+0000","last_peered":"2024-03-04T13:00:06.681038+0000","last_clean":"2024-03-04T13:00:06.681038+0000","last_became_active":"2024-03-04T12:36:15.363057+0000","last_became_peered":"2024-03-04T12:36:15.363057+0000","last_unstale":"2024-03-04T13:00:06.681038+0000","last_undegraded":"2024-03-04T13:00:06.681038+0000","last_fullsized":"2024-03-04T13:00:06.681038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:35.204210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":263,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"256'521","reported_seq":2070,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:45.901603+0000","last_change":"2024-03-04T12:36:07.294876+0000","last_active":"2024-03-04T12:59:45.901603+0000","last_peered":"2024-03-04T12:59:45.901603+0000","last_clean":"2024-03-04T12:59:45.901603+0000","last_became_active":"2024-03-04T12:36:07.292930+0000","last_became_peered":"2024-03-04T12:36:07.292930+0000","last_unstale":"2024-03-04T12:59:45.901603+0000","last_undegraded":"2024-03-04T12:59:45.901603+0000","last_fullsized":"2024-03-04T12:59:45.901603+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:15:17.193064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2723,"num_read_kb":2502,"num_write":698,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"256'284","reported_seq":920,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.974266+0000","last_change":"2024-03-04T12:36:05.287586+0000","last_active":"2024-03-04T13:00:15.974266+0000","last_peered":"2024-03-04T13:00:15.974266+0000","last_clean":"2024-03-04T13:00:15.974266+0000","last_became_active":"2024-03-04T12:36:05.287299+0000","last_became_peered":"2024-03-04T12:36:05.287299+0000","last_unstale":"2024-03-04T13:00:15.974266+0000","last_undegraded":"2024-03-04T13:00:15.974266+0000","last_fullsized":"2024-03-04T13:00:15.974266+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:40.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3828104,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":463,"num_read_kb":31884,"num_write":1224,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"32'3","reported_seq":788,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.206991+0000","last_change":"2024-03-04T12:36:09.315302+0000","last_active":"2024-03-04T13:00:15.206991+0000","last_peered":"2024-03-04T13:00:15.206991+0000","last_clean":"2024-03-04T13:00:15.206991+0000","last_became_active":"2024-03-04T12:36:09.314810+0000","last_became_peered":"2024-03-04T12:36:09.314810+0000","last_unstale":"2024-03-04T13:00:15.206991+0000","last_undegraded":"2024-03-04T13:00:15.206991+0000","last_fullsized":"2024-03-04T13:00:15.206991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:17:00.218822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"256'241","reported_seq":780,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.684756+0000","last_change":"2024-03-04T12:36:11.324996+0000","last_active":"2024-03-04T13:00:08.684756+0000","last_peered":"2024-03-04T13:00:08.684756+0000","last_clean":"2024-03-04T13:00:08.684756+0000","last_became_active":"2024-03-04T12:36:11.323046+0000","last_became_peered":"2024-03-04T12:36:11.323046+0000","last_unstale":"2024-03-04T13:00:08.684756+0000","last_undegraded":"2024-03-04T13:00:08.684756+0000","last_fullsized":"2024-03-04T13:00:08.684756+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:10:29.009516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":394,"num_read_kb":838,"num_write":324,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":467,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.981601+0000","last_change":"2024-03-04T12:36:13.349171+0000","last_active":"2024-03-04T12:57:15.981601+0000","last_peered":"2024-03-04T12:57:15.981601+0000","last_clean":"2024-03-04T12:57:15.981601+0000","last_became_active":"2024-03-04T12:36:13.348696+0000","last_became_peered":"2024-03-04T12:36:13.348696+0000","last_unstale":"2024-03-04T12:57:15.981601+0000","last_undegraded":"2024-03-04T12:57:15.981601+0000","last_fullsized":"2024-03-04T12:57:15.981601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:01:19.715486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"256'83","reported_seq":554,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:20.071261+0000","last_change":"2024-03-04T12:36:15.354645+0000","last_active":"2024-03-04T12:59:20.071261+0000","last_peered":"2024-03-04T12:59:20.071261+0000","last_clean":"2024-03-04T12:59:20.071261+0000","last_became_active":"2024-03-04T12:36:15.354258+0000","last_became_peered":"2024-03-04T12:36:15.354258+0000","last_unstale":"2024-03-04T12:59:20.071261+0000","last_undegraded":"2024-03-04T12:59:20.071261+0000","last_fullsized":"2024-03-04T12:59:20.071261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:30.504574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":75,"num_write":188,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"256'355","reported_seq":1704,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.956805+0000","last_change":"2024-03-04T12:36:07.296187+0000","last_active":"2024-03-04T13:00:06.956805+0000","last_peered":"2024-03-04T13:00:06.956805+0000","last_clean":"2024-03-04T13:00:06.956805+0000","last_became_active":"2024-03-04T12:36:07.295803+0000","last_became_peered":"2024-03-04T12:36:07.295803+0000","last_unstale":"2024-03-04T13:00:06.956805+0000","last_undegraded":"2024-03-04T13:00:06.956805+0000","last_fullsized":"2024-03-04T13:00:06.956805+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:19:02.700056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1867,"num_read_kb":1777,"num_write":399,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"256'289","reported_seq":904,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.902010+0000","last_change":"2024-03-04T12:36:05.296316+0000","last_active":"2024-03-04T13:00:15.902010+0000","last_peered":"2024-03-04T13:00:15.902010+0000","last_clean":"2024-03-04T13:00:15.902010+0000","last_became_active":"2024-03-04T12:36:05.296032+0000","last_became_peered":"2024-03-04T12:36:05.296032+0000","last_unstale":"2024-03-04T13:00:15.902010+0000","last_undegraded":"2024-03-04T13:00:15.902010+0000","last_fullsized":"2024-03-04T13:00:15.902010+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:48:22.903820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4590334,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":441,"num_read_kb":28471,"num_write":1095,"num_write_kb":37420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.980941+0000","last_change":"2024-03-04T12:36:09.312289+0000","last_active":"2024-03-04T12:57:10.980941+0000","last_peered":"2024-03-04T12:57:10.980941+0000","last_clean":"2024-03-04T12:57:10.980941+0000","last_became_active":"2024-03-04T12:36:09.311953+0000","last_became_peered":"2024-03-04T12:36:09.311953+0000","last_unstale":"2024-03-04T12:57:10.980941+0000","last_undegraded":"2024-03-04T12:57:10.980941+0000","last_fullsized":"2024-03-04T12:57:10.980941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:21:39.688491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"256'31","reported_seq":504,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.950097+0000","last_change":"2024-03-04T12:36:11.326600+0000","last_active":"2024-03-04T12:58:30.950097+0000","last_peered":"2024-03-04T12:58:30.950097+0000","last_clean":"2024-03-04T12:58:30.950097+0000","last_became_active":"2024-03-04T12:36:11.326313+0000","last_became_peered":"2024-03-04T12:36:11.326313+0000","last_unstale":"2024-03-04T12:58:30.950097+0000","last_undegraded":"2024-03-04T12:58:30.950097+0000","last_fullsized":"2024-03-04T12:58:30.950097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:52.781748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":469,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.878921+0000","last_change":"2024-03-04T12:36:13.340743+0000","last_active":"2024-03-04T12:57:15.878921+0000","last_peered":"2024-03-04T12:57:15.878921+0000","last_clean":"2024-03-04T12:57:15.878921+0000","last_became_active":"2024-03-04T12:36:13.340203+0000","last_became_peered":"2024-03-04T12:36:13.340203+0000","last_unstale":"2024-03-04T12:57:15.878921+0000","last_undegraded":"2024-03-04T12:57:15.878921+0000","last_fullsized":"2024-03-04T12:57:15.878921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:09:09.659186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"256'90","reported_seq":564,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:47.266263+0000","last_change":"2024-03-04T12:36:15.353818+0000","last_active":"2024-03-04T12:58:47.266263+0000","last_peered":"2024-03-04T12:58:47.266263+0000","last_clean":"2024-03-04T12:58:47.266263+0000","last_became_active":"2024-03-04T12:36:15.353545+0000","last_became_peered":"2024-03-04T12:36:15.353545+0000","last_unstale":"2024-03-04T12:58:47.266263+0000","last_undegraded":"2024-03-04T12:58:47.266263+0000","last_fullsized":"2024-03-04T12:58:47.266263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:10.906970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":106,"num_write":213,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"256'994","reported_seq":2543,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.899888+0000","last_change":"2024-03-04T12:36:07.300137+0000","last_active":"2024-03-04T12:59:54.899888+0000","last_peered":"2024-03-04T12:59:54.899888+0000","last_clean":"2024-03-04T12:59:54.899888+0000","last_became_active":"2024-03-04T12:36:07.299326+0000","last_became_peered":"2024-03-04T12:36:07.299326+0000","last_unstale":"2024-03-04T12:59:54.899888+0000","last_undegraded":"2024-03-04T12:59:54.899888+0000","last_fullsized":"2024-03-04T12:59:54.899888+0000","mapping_epoch":22,"log_start":"256'900","ondisk_log_start":"256'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:59:41.402010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4343,"num_read_kb":3801,"num_write":1436,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"256'280","reported_seq":918,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.900172+0000","last_change":"2024-03-04T12:36:05.287491+0000","last_active":"2024-03-04T13:00:15.900172+0000","last_peered":"2024-03-04T13:00:15.900172+0000","last_clean":"2024-03-04T13:00:15.900172+0000","last_became_active":"2024-03-04T12:36:05.287185+0000","last_became_peered":"2024-03-04T12:36:05.287185+0000","last_unstale":"2024-03-04T13:00:15.900172+0000","last_undegraded":"2024-03-04T13:00:15.900172+0000","last_fullsized":"2024-03-04T13:00:15.900172+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:44.742710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2801863,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":486,"num_read_kb":7343,"num_write":1141,"num_write_kb":36636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.878079+0000","last_change":"2024-03-04T12:36:09.305577+0000","last_active":"2024-03-04T12:57:10.878079+0000","last_peered":"2024-03-04T12:57:10.878079+0000","last_clean":"2024-03-04T12:57:10.878079+0000","last_became_active":"2024-03-04T12:36:09.305288+0000","last_became_peered":"2024-03-04T12:36:09.305288+0000","last_unstale":"2024-03-04T12:57:10.878079+0000","last_undegraded":"2024-03-04T12:57:10.878079+0000","last_fullsized":"2024-03-04T12:57:10.878079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:02.570493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"256'291","reported_seq":850,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.684298+0000","last_change":"2024-03-04T12:36:11.325238+0000","last_active":"2024-03-04T13:00:15.684298+0000","last_peered":"2024-03-04T13:00:15.684298+0000","last_clean":"2024-03-04T13:00:15.684298+0000","last_became_active":"2024-03-04T12:36:11.324758+0000","last_became_peered":"2024-03-04T12:36:11.324758+0000","last_unstale":"2024-03-04T13:00:15.684298+0000","last_undegraded":"2024-03-04T13:00:15.684298+0000","last_fullsized":"2024-03-04T13:00:15.684298+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:41:09.027646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":483,"num_read_kb":1065,"num_write":390,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.987790+0000","last_change":"2024-03-04T12:36:13.345775+0000","last_active":"2024-03-04T12:57:15.987790+0000","last_peered":"2024-03-04T12:57:15.987790+0000","last_clean":"2024-03-04T12:57:15.987790+0000","last_became_active":"2024-03-04T12:36:13.345556+0000","last_became_peered":"2024-03-04T12:36:13.345556+0000","last_unstale":"2024-03-04T12:57:15.987790+0000","last_undegraded":"2024-03-04T12:57:15.987790+0000","last_fullsized":"2024-03-04T12:57:15.987790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:08.155061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"256'172","reported_seq":658,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:44.896942+0000","last_change":"2024-03-04T12:36:15.363805+0000","last_active":"2024-03-04T12:59:44.896942+0000","last_peered":"2024-03-04T12:59:44.896942+0000","last_clean":"2024-03-04T12:59:44.896942+0000","last_became_active":"2024-03-04T12:36:15.363544+0000","last_became_peered":"2024-03-04T12:36:15.363544+0000","last_unstale":"2024-03-04T12:59:44.896942+0000","last_undegraded":"2024-03-04T12:59:44.896942+0000","last_fullsized":"2024-03-04T12:59:44.896942+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:22:01.710579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":198,"num_write":386,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"256'401","reported_seq":1833,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.674646+0000","last_change":"2024-03-04T12:36:07.293124+0000","last_active":"2024-03-04T13:00:06.674646+0000","last_peered":"2024-03-04T13:00:06.674646+0000","last_clean":"2024-03-04T13:00:06.674646+0000","last_became_active":"2024-03-04T12:36:07.292814+0000","last_became_peered":"2024-03-04T12:36:07.292814+0000","last_unstale":"2024-03-04T13:00:06.674646+0000","last_undegraded":"2024-03-04T13:00:06.674646+0000","last_fullsized":"2024-03-04T13:00:06.674646+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:39.960903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2067,"num_read_kb":1953,"num_write":480,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"256'275","reported_seq":869,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.969508+0000","last_change":"2024-03-04T12:36:40.965263+0000","last_active":"2024-03-04T13:00:15.969508+0000","last_peered":"2024-03-04T13:00:15.969508+0000","last_clean":"2024-03-04T13:00:15.969508+0000","last_became_active":"2024-03-04T12:36:40.964989+0000","last_became_peered":"2024-03-04T12:36:40.964989+0000","last_unstale":"2024-03-04T13:00:15.969508+0000","last_undegraded":"2024-03-04T13:00:15.969508+0000","last_fullsized":"2024-03-04T13:00:15.969508+0000","mapping_epoch":33,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:02:05.061569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343052,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":408,"num_read_kb":22171,"num_write":1146,"num_write_kb":35457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.987012+0000","last_change":"2024-03-04T12:36:09.310197+0000","last_active":"2024-03-04T12:57:10.987012+0000","last_peered":"2024-03-04T12:57:10.987012+0000","last_clean":"2024-03-04T12:57:10.987012+0000","last_became_active":"2024-03-04T12:36:09.309883+0000","last_became_peered":"2024-03-04T12:36:09.309883+0000","last_unstale":"2024-03-04T12:57:10.987012+0000","last_undegraded":"2024-03-04T12:57:10.987012+0000","last_fullsized":"2024-03-04T12:57:10.987012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:50.413280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"256'252","reported_seq":795,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.482392+0000","last_change":"2024-03-04T12:36:11.325094+0000","last_active":"2024-03-04T13:00:15.482392+0000","last_peered":"2024-03-04T13:00:15.482392+0000","last_clean":"2024-03-04T13:00:15.482392+0000","last_became_active":"2024-03-04T12:36:11.324784+0000","last_became_peered":"2024-03-04T12:36:11.324784+0000","last_unstale":"2024-03-04T13:00:15.482392+0000","last_undegraded":"2024-03-04T13:00:15.482392+0000","last_fullsized":"2024-03-04T13:00:15.482392+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:27:03.628739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54138,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":1067,"num_write":352,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":463,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998151+0000","last_change":"2024-03-04T12:36:13.343536+0000","last_active":"2024-03-04T12:57:15.998151+0000","last_peered":"2024-03-04T12:57:15.998151+0000","last_clean":"2024-03-04T12:57:15.998151+0000","last_became_active":"2024-03-04T12:36:13.343030+0000","last_became_peered":"2024-03-04T12:36:13.343030+0000","last_unstale":"2024-03-04T12:57:15.998151+0000","last_undegraded":"2024-03-04T12:57:15.998151+0000","last_fullsized":"2024-03-04T12:57:15.998151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.616451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"256'687","reported_seq":2134,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.015184+0000","last_change":"2024-03-04T12:36:07.298429+0000","last_active":"2024-03-04T12:59:56.015184+0000","last_peered":"2024-03-04T12:59:56.015184+0000","last_clean":"2024-03-04T12:59:56.015184+0000","last_became_active":"2024-03-04T12:36:07.298154+0000","last_became_peered":"2024-03-04T12:36:07.298154+0000","last_unstale":"2024-03-04T12:59:56.015184+0000","last_undegraded":"2024-03-04T12:59:56.015184+0000","last_fullsized":"2024-03-04T12:59:56.015184+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":600,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:51:00.776425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3209,"num_read_kb":2902,"num_write":904,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"256'272","reported_seq":974,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.966882+0000","last_change":"2024-03-04T12:36:05.287614+0000","last_active":"2024-03-04T13:00:15.966882+0000","last_peered":"2024-03-04T13:00:15.966882+0000","last_clean":"2024-03-04T13:00:15.966882+0000","last_became_active":"2024-03-04T12:36:05.287329+0000","last_became_peered":"2024-03-04T12:36:05.287329+0000","last_unstale":"2024-03-04T13:00:15.966882+0000","last_undegraded":"2024-03-04T13:00:15.966882+0000","last_fullsized":"2024-03-04T13:00:15.966882+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:30.987377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389106,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":508,"num_read_kb":51332,"num_write":1158,"num_write_kb":22699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:11.005371+0000","last_change":"2024-03-04T12:36:09.307589+0000","last_active":"2024-03-04T12:58:11.005371+0000","last_peered":"2024-03-04T12:58:11.005371+0000","last_clean":"2024-03-04T12:58:11.005371+0000","last_became_active":"2024-03-04T12:36:09.307329+0000","last_became_peered":"2024-03-04T12:36:09.307329+0000","last_unstale":"2024-03-04T12:58:11.005371+0000","last_undegraded":"2024-03-04T12:58:11.005371+0000","last_fullsized":"2024-03-04T12:58:11.005371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:30.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"256'409","reported_seq":1008,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.419225+0000","last_change":"2024-03-04T12:36:11.323790+0000","last_active":"2024-03-04T13:00:15.419225+0000","last_peered":"2024-03-04T13:00:15.419225+0000","last_clean":"2024-03-04T13:00:15.419225+0000","last_became_active":"2024-03-04T12:36:11.323506+0000","last_became_peered":"2024-03-04T12:36:11.323506+0000","last_unstale":"2024-03-04T13:00:15.419225+0000","last_undegraded":"2024-03-04T13:00:15.419225+0000","last_fullsized":"2024-03-04T13:00:15.419225+0000","mapping_epoch":26,"log_start":"256'300","ondisk_log_start":"256'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:50:55.242458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115418,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":721,"num_read_kb":1701,"num_write":586,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.983858+0000","last_change":"2024-03-04T12:36:13.346933+0000","last_active":"2024-03-04T12:56:15.983858+0000","last_peered":"2024-03-04T12:56:15.983858+0000","last_clean":"2024-03-04T12:56:15.983858+0000","last_became_active":"2024-03-04T12:36:13.346628+0000","last_became_peered":"2024-03-04T12:36:13.346628+0000","last_unstale":"2024-03-04T12:56:15.983858+0000","last_undegraded":"2024-03-04T12:56:15.983858+0000","last_fullsized":"2024-03-04T12:56:15.983858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:37.000939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"256'165","reported_seq":643,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:49.594745+0000","last_change":"2024-03-04T12:36:15.354834+0000","last_active":"2024-03-04T12:59:49.594745+0000","last_peered":"2024-03-04T12:59:49.594745+0000","last_clean":"2024-03-04T12:59:49.594745+0000","last_became_active":"2024-03-04T12:36:15.354125+0000","last_became_peered":"2024-03-04T12:36:15.354125+0000","last_unstale":"2024-03-04T12:59:49.594745+0000","last_undegraded":"2024-03-04T12:59:49.594745+0000","last_fullsized":"2024-03-04T12:59:49.594745+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:35:56.991813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":203,"num_write":373,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"256'1141","reported_seq":2714,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.045130+0000","last_change":"2024-03-04T12:36:07.298750+0000","last_active":"2024-03-04T12:59:53.045130+0000","last_peered":"2024-03-04T12:59:53.045130+0000","last_clean":"2024-03-04T12:59:53.045130+0000","last_became_active":"2024-03-04T12:36:07.298434+0000","last_became_peered":"2024-03-04T12:36:07.298434+0000","last_unstale":"2024-03-04T12:59:53.045130+0000","last_undegraded":"2024-03-04T12:59:53.045130+0000","last_fullsized":"2024-03-04T12:59:53.045130+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:09:16.843310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4934,"num_read_kb":4324,"num_write":1585,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"256'338","reported_seq":981,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.997430+0000","last_change":"2024-03-04T12:36:05.287853+0000","last_active":"2024-03-04T13:00:15.997430+0000","last_peered":"2024-03-04T13:00:15.997430+0000","last_clean":"2024-03-04T13:00:15.997430+0000","last_became_active":"2024-03-04T12:36:05.287506+0000","last_became_peered":"2024-03-04T12:36:05.287506+0000","last_unstale":"2024-03-04T13:00:15.997430+0000","last_undegraded":"2024-03-04T13:00:15.997430+0000","last_fullsized":"2024-03-04T13:00:15.997430+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:32:38.606578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16098274,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":545,"num_read_kb":47013,"num_write":1100,"num_write_kb":33887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.985615+0000","last_change":"2024-03-04T12:36:09.309433+0000","last_active":"2024-03-04T12:57:00.985615+0000","last_peered":"2024-03-04T12:57:00.985615+0000","last_clean":"2024-03-04T12:57:00.985615+0000","last_became_active":"2024-03-04T12:36:09.309155+0000","last_became_peered":"2024-03-04T12:36:09.309155+0000","last_unstale":"2024-03-04T12:57:00.985615+0000","last_undegraded":"2024-03-04T12:57:00.985615+0000","last_fullsized":"2024-03-04T12:57:00.985615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:54:56.170543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"256'274","reported_seq":825,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.552159+0000","last_change":"2024-03-04T12:36:11.323679+0000","last_active":"2024-03-04T13:00:15.552159+0000","last_peered":"2024-03-04T13:00:15.552159+0000","last_clean":"2024-03-04T13:00:15.552159+0000","last_became_active":"2024-03-04T12:36:11.323320+0000","last_became_peered":"2024-03-04T12:36:11.323320+0000","last_unstale":"2024-03-04T13:00:15.552159+0000","last_undegraded":"2024-03-04T13:00:15.552159+0000","last_fullsized":"2024-03-04T13:00:15.552159+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:42.811474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44965,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":1036,"num_write":392,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":469,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.974256+0000","last_change":"2024-03-04T12:36:13.340810+0000","last_active":"2024-03-04T12:56:15.974256+0000","last_peered":"2024-03-04T12:56:15.974256+0000","last_clean":"2024-03-04T12:56:15.974256+0000","last_became_active":"2024-03-04T12:36:13.340525+0000","last_became_peered":"2024-03-04T12:36:13.340525+0000","last_unstale":"2024-03-04T12:56:15.974256+0000","last_undegraded":"2024-03-04T12:56:15.974256+0000","last_fullsized":"2024-03-04T12:56:15.974256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:06:28.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"256'155","reported_seq":980,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.538717+0000","last_change":"2024-03-04T12:36:15.363212+0000","last_active":"2024-03-04T13:00:07.538717+0000","last_peered":"2024-03-04T13:00:07.538717+0000","last_clean":"2024-03-04T13:00:07.538717+0000","last_became_active":"2024-03-04T12:36:15.362749+0000","last_became_peered":"2024-03-04T12:36:15.362749+0000","last_unstale":"2024-03-04T13:00:07.538717+0000","last_undegraded":"2024-03-04T13:00:07.538717+0000","last_fullsized":"2024-03-04T13:00:07.538717+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:19.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":549,"num_write":456,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"256'352","reported_seq":1696,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.292917+0000","last_change":"2024-03-04T12:36:07.293117+0000","last_active":"2024-03-04T12:59:48.292917+0000","last_peered":"2024-03-04T12:59:48.292917+0000","last_clean":"2024-03-04T12:59:48.292917+0000","last_became_active":"2024-03-04T12:36:07.292806+0000","last_became_peered":"2024-03-04T12:36:07.292806+0000","last_unstale":"2024-03-04T12:59:48.292917+0000","last_undegraded":"2024-03-04T12:59:48.292917+0000","last_fullsized":"2024-03-04T12:59:48.292917+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:31.918878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1929,"num_read_kb":1816,"num_write":430,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"256'283","reported_seq":919,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.000403+0000","last_change":"2024-03-04T12:36:05.289335+0000","last_active":"2024-03-04T13:00:16.000403+0000","last_peered":"2024-03-04T13:00:16.000403+0000","last_clean":"2024-03-04T13:00:16.000403+0000","last_became_active":"2024-03-04T12:36:05.289053+0000","last_became_peered":"2024-03-04T12:36:05.289053+0000","last_unstale":"2024-03-04T13:00:16.000403+0000","last_undegraded":"2024-03-04T13:00:16.000403+0000","last_fullsized":"2024-03-04T13:00:16.000403+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:54.563075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11429888,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":435,"num_read_kb":60644,"num_write":1156,"num_write_kb":49301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.983196+0000","last_change":"2024-03-04T12:36:09.308491+0000","last_active":"2024-03-04T12:56:10.983196+0000","last_peered":"2024-03-04T12:56:10.983196+0000","last_clean":"2024-03-04T12:56:10.983196+0000","last_became_active":"2024-03-04T12:36:09.308231+0000","last_became_peered":"2024-03-04T12:36:09.308231+0000","last_unstale":"2024-03-04T12:56:10.983196+0000","last_undegraded":"2024-03-04T12:56:10.983196+0000","last_fullsized":"2024-03-04T12:56:10.983196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:10:29.969171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"256'272","reported_seq":812,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.691138+0000","last_change":"2024-03-04T12:36:11.954917+0000","last_active":"2024-03-04T13:00:08.691138+0000","last_peered":"2024-03-04T13:00:08.691138+0000","last_clean":"2024-03-04T13:00:08.691138+0000","last_became_active":"2024-03-04T12:36:11.954568+0000","last_became_peered":"2024-03-04T12:36:11.954568+0000","last_unstale":"2024-03-04T13:00:08.691138+0000","last_undegraded":"2024-03-04T13:00:08.691138+0000","last_fullsized":"2024-03-04T13:00:08.691138+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:56.500891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64514,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":989,"num_write":386,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:15.988694+0000","last_change":"2024-03-04T12:36:13.346950+0000","last_active":"2024-03-04T12:58:15.988694+0000","last_peered":"2024-03-04T12:58:15.988694+0000","last_clean":"2024-03-04T12:58:15.988694+0000","last_became_active":"2024-03-04T12:36:13.346665+0000","last_became_peered":"2024-03-04T12:36:13.346665+0000","last_unstale":"2024-03-04T12:58:15.988694+0000","last_undegraded":"2024-03-04T12:58:15.988694+0000","last_fullsized":"2024-03-04T12:58:15.988694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:14.332069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'103","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.702492+0000","last_change":"2024-03-04T12:36:15.364059+0000","last_active":"2024-03-04T13:00:08.702492+0000","last_peered":"2024-03-04T13:00:08.702492+0000","last_clean":"2024-03-04T13:00:08.702492+0000","last_became_active":"2024-03-04T12:36:15.363269+0000","last_became_peered":"2024-03-04T12:36:15.363269+0000","last_unstale":"2024-03-04T13:00:08.702492+0000","last_undegraded":"2024-03-04T13:00:08.702492+0000","last_fullsized":"2024-03-04T13:00:08.702492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:56.078288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"256'427","reported_seq":1936,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.685753+0000","last_change":"2024-03-04T12:36:07.296189+0000","last_active":"2024-03-04T13:00:06.685753+0000","last_peered":"2024-03-04T13:00:06.685753+0000","last_clean":"2024-03-04T13:00:06.685753+0000","last_became_active":"2024-03-04T12:36:07.295353+0000","last_became_peered":"2024-03-04T12:36:07.295353+0000","last_unstale":"2024-03-04T13:00:06.685753+0000","last_undegraded":"2024-03-04T13:00:06.685753+0000","last_fullsized":"2024-03-04T13:00:06.685753+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:59:38.626041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2362,"num_read_kb":2211,"num_write":524,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"256'455","reported_seq":1101,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.976438+0000","last_change":"2024-03-04T12:36:05.293958+0000","last_active":"2024-03-04T13:00:15.976438+0000","last_peered":"2024-03-04T13:00:15.976438+0000","last_clean":"2024-03-04T13:00:15.976438+0000","last_became_active":"2024-03-04T12:36:05.293646+0000","last_became_peered":"2024-03-04T12:36:05.293646+0000","last_unstale":"2024-03-04T13:00:15.976438+0000","last_undegraded":"2024-03-04T13:00:15.976438+0000","last_fullsized":"2024-03-04T13:00:15.976438+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:32:24.040601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22047979,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":797,"num_read_kb":46886,"num_write":1400,"num_write_kb":44359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.973688+0000","last_change":"2024-03-04T12:36:09.305622+0000","last_active":"2024-03-04T12:56:10.973688+0000","last_peered":"2024-03-04T12:56:10.973688+0000","last_clean":"2024-03-04T12:56:10.973688+0000","last_became_active":"2024-03-04T12:36:09.305073+0000","last_became_peered":"2024-03-04T12:36:09.305073+0000","last_unstale":"2024-03-04T12:56:10.973688+0000","last_undegraded":"2024-03-04T12:56:10.973688+0000","last_fullsized":"2024-03-04T12:56:10.973688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:49.014929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"256'63","reported_seq":556,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:42.294211+0000","last_change":"2024-03-04T12:36:11.955268+0000","last_active":"2024-03-04T12:58:42.294211+0000","last_peered":"2024-03-04T12:58:42.294211+0000","last_clean":"2024-03-04T12:58:42.294211+0000","last_became_active":"2024-03-04T12:36:11.954563+0000","last_became_peered":"2024-03-04T12:36:11.954563+0000","last_unstale":"2024-03-04T12:58:42.294211+0000","last_undegraded":"2024-03-04T12:58:42.294211+0000","last_fullsized":"2024-03-04T12:58:42.294211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:42:13.043294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":71,"num_read_kb":64,"num_write":78,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"256'481","reported_seq":1806,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.233620+0000","last_change":"2024-03-04T12:36:13.340544+0000","last_active":"2024-03-04T13:00:15.233620+0000","last_peered":"2024-03-04T13:00:15.233620+0000","last_clean":"2024-03-04T13:00:15.233620+0000","last_became_active":"2024-03-04T12:36:13.340221+0000","last_became_peered":"2024-03-04T12:36:13.340221+0000","last_unstale":"2024-03-04T13:00:15.233620+0000","last_undegraded":"2024-03-04T13:00:15.233620+0000","last_fullsized":"2024-03-04T13:00:15.233620+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:34.550746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"256'132","reported_seq":606,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.133500+0000","last_change":"2024-03-04T12:36:15.364987+0000","last_active":"2024-03-04T12:59:50.133500+0000","last_peered":"2024-03-04T12:59:50.133500+0000","last_clean":"2024-03-04T12:59:50.133500+0000","last_became_active":"2024-03-04T12:36:15.364688+0000","last_became_peered":"2024-03-04T12:36:15.364688+0000","last_unstale":"2024-03-04T12:59:50.133500+0000","last_undegraded":"2024-03-04T12:59:50.133500+0000","last_fullsized":"2024-03-04T12:59:50.133500+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:22.015151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":294,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"256'357","reported_seq":1820,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.904913+0000","last_change":"2024-03-04T12:36:07.291346+0000","last_active":"2024-03-04T12:59:54.904913+0000","last_peered":"2024-03-04T12:59:54.904913+0000","last_clean":"2024-03-04T12:59:54.904913+0000","last_became_active":"2024-03-04T12:36:07.290637+0000","last_became_peered":"2024-03-04T12:36:07.290637+0000","last_unstale":"2024-03-04T12:59:54.904913+0000","last_undegraded":"2024-03-04T12:59:54.904913+0000","last_fullsized":"2024-03-04T12:59:54.904913+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:40:51.943588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1998,"num_read_kb":1913,"num_write":399,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"256'375","reported_seq":1028,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.974163+0000","last_change":"2024-03-04T12:36:05.294852+0000","last_active":"2024-03-04T13:00:15.974163+0000","last_peered":"2024-03-04T13:00:15.974163+0000","last_clean":"2024-03-04T13:00:15.974163+0000","last_became_active":"2024-03-04T12:36:05.294568+0000","last_became_peered":"2024-03-04T12:36:05.294568+0000","last_unstale":"2024-03-04T13:00:15.974163+0000","last_undegraded":"2024-03-04T13:00:15.974163+0000","last_fullsized":"2024-03-04T13:00:15.974163+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:30:30.652308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13300435,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":641,"num_read_kb":37257,"num_write":1320,"num_write_kb":50791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.869484+0000","last_change":"2024-03-04T12:36:09.306310+0000","last_active":"2024-03-04T12:56:10.869484+0000","last_peered":"2024-03-04T12:56:10.869484+0000","last_clean":"2024-03-04T12:56:10.869484+0000","last_became_active":"2024-03-04T12:36:09.306005+0000","last_became_peered":"2024-03-04T12:36:09.306005+0000","last_unstale":"2024-03-04T12:56:10.869484+0000","last_undegraded":"2024-03-04T12:56:10.869484+0000","last_fullsized":"2024-03-04T12:56:10.869484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:36:38.545939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"256'268","reported_seq":811,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.658146+0000","last_change":"2024-03-04T12:36:11.325797+0000","last_active":"2024-03-04T13:00:08.658146+0000","last_peered":"2024-03-04T13:00:08.658146+0000","last_clean":"2024-03-04T13:00:08.658146+0000","last_became_active":"2024-03-04T12:36:11.325503+0000","last_became_peered":"2024-03-04T12:36:11.325503+0000","last_unstale":"2024-03-04T13:00:08.658146+0000","last_undegraded":"2024-03-04T13:00:08.658146+0000","last_fullsized":"2024-03-04T13:00:08.658146+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:37.864953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64489,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":946,"num_write":368,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":462,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.986011+0000","last_change":"2024-03-04T12:36:13.339697+0000","last_active":"2024-03-04T12:55:35.986011+0000","last_peered":"2024-03-04T12:55:35.986011+0000","last_clean":"2024-03-04T12:55:35.986011+0000","last_became_active":"2024-03-04T12:36:13.339349+0000","last_became_peered":"2024-03-04T12:36:13.339349+0000","last_unstale":"2024-03-04T12:55:35.986011+0000","last_undegraded":"2024-03-04T12:55:35.986011+0000","last_fullsized":"2024-03-04T12:55:35.986011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:11.712690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"256'111","reported_seq":637,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:11.247234+0000","last_change":"2024-03-04T12:36:15.352689+0000","last_active":"2024-03-04T12:59:11.247234+0000","last_peered":"2024-03-04T12:59:11.247234+0000","last_clean":"2024-03-04T12:59:11.247234+0000","last_became_active":"2024-03-04T12:36:15.352383+0000","last_became_peered":"2024-03-04T12:36:15.352383+0000","last_unstale":"2024-03-04T12:59:11.247234+0000","last_undegraded":"2024-03-04T12:59:11.247234+0000","last_fullsized":"2024-03-04T12:59:11.247234+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:10:26.974662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":264,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"256'405","reported_seq":1774,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.045644+0000","last_change":"2024-03-04T12:36:07.296237+0000","last_active":"2024-03-04T12:59:56.045644+0000","last_peered":"2024-03-04T12:59:56.045644+0000","last_clean":"2024-03-04T12:59:56.045644+0000","last_became_active":"2024-03-04T12:36:07.295956+0000","last_became_peered":"2024-03-04T12:36:07.295956+0000","last_unstale":"2024-03-04T12:59:56.045644+0000","last_undegraded":"2024-03-04T12:59:56.045644+0000","last_fullsized":"2024-03-04T12:59:56.045644+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:07.889506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2057,"num_read_kb":1911,"num_write":497,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"256'251","reported_seq":843,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.004624+0000","last_change":"2024-03-04T12:36:05.294942+0000","last_active":"2024-03-04T13:00:16.004624+0000","last_peered":"2024-03-04T13:00:16.004624+0000","last_clean":"2024-03-04T13:00:16.004624+0000","last_became_active":"2024-03-04T12:36:05.294686+0000","last_became_peered":"2024-03-04T12:36:05.294686+0000","last_unstale":"2024-03-04T13:00:16.004624+0000","last_undegraded":"2024-03-04T13:00:16.004624+0000","last_fullsized":"2024-03-04T13:00:16.004624+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:40:07.056496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11121196,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":377,"num_read_kb":38414,"num_write":962,"num_write_kb":48852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.983094+0000","last_change":"2024-03-04T12:36:09.315306+0000","last_active":"2024-03-04T12:56:10.983094+0000","last_peered":"2024-03-04T12:56:10.983094+0000","last_clean":"2024-03-04T12:56:10.983094+0000","last_became_active":"2024-03-04T12:36:09.314912+0000","last_became_peered":"2024-03-04T12:36:09.314912+0000","last_unstale":"2024-03-04T12:56:10.983094+0000","last_undegraded":"2024-03-04T12:56:10.983094+0000","last_fullsized":"2024-03-04T12:56:10.983094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:28.512512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"256'261","reported_seq":792,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.658482+0000","last_change":"2024-03-04T12:36:11.325501+0000","last_active":"2024-03-04T13:00:08.658482+0000","last_peered":"2024-03-04T13:00:08.658482+0000","last_clean":"2024-03-04T13:00:08.658482+0000","last_became_active":"2024-03-04T12:36:11.325238+0000","last_became_peered":"2024-03-04T12:36:11.325238+0000","last_unstale":"2024-03-04T13:00:08.658482+0000","last_undegraded":"2024-03-04T13:00:08.658482+0000","last_fullsized":"2024-03-04T13:00:08.658482+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:52:12.180477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58120,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":904,"num_write":354,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.974979+0000","last_change":"2024-03-04T12:36:13.341948+0000","last_active":"2024-03-04T12:55:35.974979+0000","last_peered":"2024-03-04T12:55:35.974979+0000","last_clean":"2024-03-04T12:55:35.974979+0000","last_became_active":"2024-03-04T12:36:13.341689+0000","last_became_peered":"2024-03-04T12:36:13.341689+0000","last_unstale":"2024-03-04T12:55:35.974979+0000","last_undegraded":"2024-03-04T12:55:35.974979+0000","last_fullsized":"2024-03-04T12:55:35.974979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:02:47.747861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"256'98","reported_seq":590,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:37.800761+0000","last_change":"2024-03-04T12:36:15.353744+0000","last_active":"2024-03-04T12:59:37.800761+0000","last_peered":"2024-03-04T12:59:37.800761+0000","last_clean":"2024-03-04T12:59:37.800761+0000","last_became_active":"2024-03-04T12:36:15.353418+0000","last_became_peered":"2024-03-04T12:36:15.353418+0000","last_unstale":"2024-03-04T12:59:37.800761+0000","last_undegraded":"2024-03-04T12:59:37.800761+0000","last_fullsized":"2024-03-04T12:59:37.800761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:31:22.073567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"256'1443","reported_seq":2774,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:34.666144+0000","last_change":"2024-03-04T12:36:07.300609+0000","last_active":"2024-03-04T12:59:34.666144+0000","last_peered":"2024-03-04T12:59:34.666144+0000","last_clean":"2024-03-04T12:59:34.666144+0000","last_became_active":"2024-03-04T12:36:07.300067+0000","last_became_peered":"2024-03-04T12:36:07.300067+0000","last_unstale":"2024-03-04T12:59:34.666144+0000","last_undegraded":"2024-03-04T12:59:34.666144+0000","last_fullsized":"2024-03-04T12:59:34.666144+0000","mapping_epoch":22,"log_start":"256'1400","ondisk_log_start":"256'1400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:54:29.408852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5752,"num_read_kb":4912,"num_write":2067,"num_write_kb":923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"256'344","reported_seq":1000,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.982100+0000","last_change":"2024-03-04T12:36:05.284059+0000","last_active":"2024-03-04T13:00:15.982100+0000","last_peered":"2024-03-04T13:00:15.982100+0000","last_clean":"2024-03-04T13:00:15.982100+0000","last_became_active":"2024-03-04T12:36:05.283142+0000","last_became_peered":"2024-03-04T12:36:05.283142+0000","last_unstale":"2024-03-04T13:00:15.982100+0000","last_undegraded":"2024-03-04T13:00:15.982100+0000","last_fullsized":"2024-03-04T13:00:15.982100+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:42:53.872503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":623,"num_read_kb":1438,"num_write":1711,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.976430+0000","last_change":"2024-03-04T12:36:09.305585+0000","last_active":"2024-03-04T12:55:30.976430+0000","last_peered":"2024-03-04T12:55:30.976430+0000","last_clean":"2024-03-04T12:55:30.976430+0000","last_became_active":"2024-03-04T12:36:09.305182+0000","last_became_peered":"2024-03-04T12:36:09.305182+0000","last_unstale":"2024-03-04T12:55:30.976430+0000","last_undegraded":"2024-03-04T12:55:30.976430+0000","last_fullsized":"2024-03-04T12:55:30.976430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:08:29.761455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"256'234","reported_seq":763,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.688891+0000","last_change":"2024-03-04T12:36:11.324706+0000","last_active":"2024-03-04T13:00:08.688891+0000","last_peered":"2024-03-04T13:00:08.688891+0000","last_clean":"2024-03-04T13:00:08.688891+0000","last_became_active":"2024-03-04T12:36:11.324394+0000","last_became_peered":"2024-03-04T12:36:11.324394+0000","last_unstale":"2024-03-04T13:00:08.688891+0000","last_undegraded":"2024-03-04T13:00:08.688891+0000","last_fullsized":"2024-03-04T13:00:08.688891+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:55.889459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55992,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":875,"num_write":338,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":471,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.983889+0000","last_change":"2024-03-04T12:36:13.341181+0000","last_active":"2024-03-04T12:56:15.983889+0000","last_peered":"2024-03-04T12:56:15.983889+0000","last_clean":"2024-03-04T12:56:15.983889+0000","last_became_active":"2024-03-04T12:36:13.340897+0000","last_became_peered":"2024-03-04T12:36:13.340897+0000","last_unstale":"2024-03-04T12:56:15.983889+0000","last_undegraded":"2024-03-04T12:56:15.983889+0000","last_fullsized":"2024-03-04T12:56:15.983889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:02:05.268444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"256'169","reported_seq":1167,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.492529+0000","last_change":"2024-03-04T12:36:15.357808+0000","last_active":"2024-03-04T13:00:07.492529+0000","last_peered":"2024-03-04T13:00:07.492529+0000","last_clean":"2024-03-04T13:00:07.492529+0000","last_became_active":"2024-03-04T12:36:15.357141+0000","last_became_peered":"2024-03-04T12:36:15.357141+0000","last_unstale":"2024-03-04T13:00:07.492529+0000","last_undegraded":"2024-03-04T13:00:07.492529+0000","last_fullsized":"2024-03-04T13:00:07.492529+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:59:35.782871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":655,"num_read_kb":655,"num_write":360,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"256'1105","reported_seq":2587,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.017005+0000","last_change":"2024-03-04T12:36:07.291118+0000","last_active":"2024-03-04T12:59:54.017005+0000","last_peered":"2024-03-04T12:59:54.017005+0000","last_clean":"2024-03-04T12:59:54.017005+0000","last_became_active":"2024-03-04T12:36:07.290820+0000","last_became_peered":"2024-03-04T12:36:07.290820+0000","last_unstale":"2024-03-04T12:59:54.017005+0000","last_undegraded":"2024-03-04T12:59:54.017005+0000","last_fullsized":"2024-03-04T12:59:54.017005+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:04.696551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4641,"num_read_kb":4049,"num_write":1526,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"256'269","reported_seq":936,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.007499+0000","last_change":"2024-03-04T12:36:05.290216+0000","last_active":"2024-03-04T13:00:16.007499+0000","last_peered":"2024-03-04T13:00:16.007499+0000","last_clean":"2024-03-04T13:00:16.007499+0000","last_became_active":"2024-03-04T12:36:05.289897+0000","last_became_peered":"2024-03-04T12:36:05.289897+0000","last_unstale":"2024-03-04T13:00:16.007499+0000","last_undegraded":"2024-03-04T13:00:16.007499+0000","last_fullsized":"2024-03-04T13:00:16.007499+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:29.554222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5631842,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":540,"num_read_kb":14927,"num_write":990,"num_write_kb":32177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.968279+0000","last_change":"2024-03-04T12:36:09.311068+0000","last_active":"2024-03-04T12:55:30.968279+0000","last_peered":"2024-03-04T12:55:30.968279+0000","last_clean":"2024-03-04T12:55:30.968279+0000","last_became_active":"2024-03-04T12:36:09.310855+0000","last_became_peered":"2024-03-04T12:36:09.310855+0000","last_unstale":"2024-03-04T12:55:30.968279+0000","last_undegraded":"2024-03-04T12:55:30.968279+0000","last_fullsized":"2024-03-04T12:55:30.968279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:22.965213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"256'262","reported_seq":817,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.693001+0000","last_change":"2024-03-04T12:36:11.323707+0000","last_active":"2024-03-04T13:00:08.693001+0000","last_peered":"2024-03-04T13:00:08.693001+0000","last_clean":"2024-03-04T13:00:08.693001+0000","last_became_active":"2024-03-04T12:36:11.323352+0000","last_became_peered":"2024-03-04T12:36:11.323352+0000","last_unstale":"2024-03-04T13:00:08.693001+0000","last_undegraded":"2024-03-04T13:00:08.693001+0000","last_fullsized":"2024-03-04T13:00:08.693001+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:15.465595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":879,"num_write":344,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":462,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.990494+0000","last_change":"2024-03-04T12:36:13.343303+0000","last_active":"2024-03-04T12:56:15.990494+0000","last_peered":"2024-03-04T12:56:15.990494+0000","last_clean":"2024-03-04T12:56:15.990494+0000","last_became_active":"2024-03-04T12:36:13.342656+0000","last_became_peered":"2024-03-04T12:36:13.342656+0000","last_unstale":"2024-03-04T12:56:15.990494+0000","last_undegraded":"2024-03-04T12:56:15.990494+0000","last_fullsized":"2024-03-04T12:56:15.990494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:43.617222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"256'102","reported_seq":575,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:36.553742+0000","last_change":"2024-03-04T12:36:15.352666+0000","last_active":"2024-03-04T12:59:36.553742+0000","last_peered":"2024-03-04T12:59:36.553742+0000","last_clean":"2024-03-04T12:59:36.553742+0000","last_became_active":"2024-03-04T12:36:15.352333+0000","last_became_peered":"2024-03-04T12:36:15.352333+0000","last_unstale":"2024-03-04T12:59:36.553742+0000","last_undegraded":"2024-03-04T12:59:36.553742+0000","last_fullsized":"2024-03-04T12:59:36.553742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:36.600244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":93,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"256'392","reported_seq":1887,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.047579+0000","last_change":"2024-03-04T12:36:07.298617+0000","last_active":"2024-03-04T12:59:53.047579+0000","last_peered":"2024-03-04T12:59:53.047579+0000","last_clean":"2024-03-04T12:59:53.047579+0000","last_became_active":"2024-03-04T12:36:07.297660+0000","last_became_peered":"2024-03-04T12:36:07.297660+0000","last_unstale":"2024-03-04T12:59:53.047579+0000","last_undegraded":"2024-03-04T12:59:53.047579+0000","last_fullsized":"2024-03-04T12:59:53.047579+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:32.101783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":478,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"256'240","reported_seq":825,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.977272+0000","last_change":"2024-03-04T12:36:05.279913+0000","last_active":"2024-03-04T13:00:15.977272+0000","last_peered":"2024-03-04T13:00:15.977272+0000","last_clean":"2024-03-04T13:00:15.977272+0000","last_became_active":"2024-03-04T12:36:05.279576+0000","last_became_peered":"2024-03-04T12:36:05.279576+0000","last_unstale":"2024-03-04T13:00:15.977272+0000","last_undegraded":"2024-03-04T13:00:15.977272+0000","last_fullsized":"2024-03-04T13:00:15.977272+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:18.604604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6640307,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":344,"num_read_kb":32300,"num_write":1048,"num_write_kb":15765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"256'425","reported_seq":1850,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.047677+0000","last_change":"2024-03-04T12:36:07.300437+0000","last_active":"2024-03-04T12:59:53.047677+0000","last_peered":"2024-03-04T12:59:53.047677+0000","last_clean":"2024-03-04T12:59:53.047677+0000","last_became_active":"2024-03-04T12:36:07.300168+0000","last_became_peered":"2024-03-04T12:36:07.300168+0000","last_unstale":"2024-03-04T12:59:53.047677+0000","last_undegraded":"2024-03-04T12:59:53.047677+0000","last_fullsized":"2024-03-04T12:59:53.047677+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:16.225236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2082,"num_write":535,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"256'261","reported_seq":877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.946419+0000","last_change":"2024-03-04T12:36:05.287650+0000","last_active":"2024-03-04T13:00:15.946419+0000","last_peered":"2024-03-04T13:00:15.946419+0000","last_clean":"2024-03-04T13:00:15.946419+0000","last_became_active":"2024-03-04T12:36:05.287233+0000","last_became_peered":"2024-03-04T12:36:05.287233+0000","last_unstale":"2024-03-04T13:00:15.946419+0000","last_undegraded":"2024-03-04T13:00:15.946419+0000","last_fullsized":"2024-03-04T13:00:15.946419+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:20:52.908914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16232749,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":421,"num_read_kb":46552,"num_write":1150,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"256'338","reported_seq":1830,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.139327+0000","last_change":"2024-03-04T12:36:07.296382+0000","last_active":"2024-03-04T12:59:50.139327+0000","last_peered":"2024-03-04T12:59:50.139327+0000","last_clean":"2024-03-04T12:59:50.139327+0000","last_became_active":"2024-03-04T12:36:07.296104+0000","last_became_peered":"2024-03-04T12:36:07.296104+0000","last_unstale":"2024-03-04T12:59:50.139327+0000","last_undegraded":"2024-03-04T12:59:50.139327+0000","last_fullsized":"2024-03-04T12:59:50.139327+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:56.868284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1942,"num_read_kb":1888,"num_write":368,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"256'298","reported_seq":918,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.958438+0000","last_change":"2024-03-04T12:36:41.075779+0000","last_active":"2024-03-04T13:00:15.958438+0000","last_peered":"2024-03-04T13:00:15.958438+0000","last_clean":"2024-03-04T13:00:15.958438+0000","last_became_active":"2024-03-04T12:36:41.075381+0000","last_became_peered":"2024-03-04T12:36:41.075381+0000","last_unstale":"2024-03-04T13:00:15.958438+0000","last_undegraded":"2024-03-04T13:00:15.958438+0000","last_fullsized":"2024-03-04T13:00:15.958438+0000","mapping_epoch":33,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:58.826959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745056,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":477,"num_read_kb":52899,"num_write":1246,"num_write_kb":57282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"256'1024","reported_seq":2573,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.027302+0000","last_change":"2024-03-04T12:36:07.299735+0000","last_active":"2024-03-04T12:59:56.027302+0000","last_peered":"2024-03-04T12:59:56.027302+0000","last_clean":"2024-03-04T12:59:56.027302+0000","last_became_active":"2024-03-04T12:36:07.299282+0000","last_became_peered":"2024-03-04T12:36:07.299282+0000","last_unstale":"2024-03-04T12:59:56.027302+0000","last_undegraded":"2024-03-04T12:59:56.027302+0000","last_fullsized":"2024-03-04T12:59:56.027302+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:42:39.813252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4484,"num_read_kb":3892,"num_write":1521,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"256'254","reported_seq":906,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.966935+0000","last_change":"2024-03-04T12:36:05.283738+0000","last_active":"2024-03-04T13:00:15.966935+0000","last_peered":"2024-03-04T13:00:15.966935+0000","last_clean":"2024-03-04T13:00:15.966935+0000","last_became_active":"2024-03-04T12:36:05.283327+0000","last_became_peered":"2024-03-04T12:36:05.283327+0000","last_unstale":"2024-03-04T13:00:15.966935+0000","last_undegraded":"2024-03-04T13:00:15.966935+0000","last_fullsized":"2024-03-04T13:00:15.966935+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:26:39.224528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10220281,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":450,"num_read_kb":66598,"num_write":957,"num_write_kb":37083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"256'426","reported_seq":1880,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671263+0000","last_change":"2024-03-04T12:36:07.293252+0000","last_active":"2024-03-04T13:00:06.671263+0000","last_peered":"2024-03-04T13:00:06.671263+0000","last_clean":"2024-03-04T13:00:06.671263+0000","last_became_active":"2024-03-04T12:36:07.292950+0000","last_became_peered":"2024-03-04T12:36:07.292950+0000","last_unstale":"2024-03-04T13:00:06.671263+0000","last_undegraded":"2024-03-04T13:00:06.671263+0000","last_fullsized":"2024-03-04T13:00:06.671263+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:06.362966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2086,"num_write":515,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"256'240","reported_seq":854,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.978814+0000","last_change":"2024-03-04T12:36:05.287013+0000","last_active":"2024-03-04T13:00:15.978814+0000","last_peered":"2024-03-04T13:00:15.978814+0000","last_clean":"2024-03-04T13:00:15.978814+0000","last_became_active":"2024-03-04T12:36:05.286745+0000","last_became_peered":"2024-03-04T12:36:05.286745+0000","last_unstale":"2024-03-04T13:00:15.978814+0000","last_undegraded":"2024-03-04T13:00:15.978814+0000","last_fullsized":"2024-03-04T13:00:15.978814+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:28.246766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11547099,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":396,"num_read_kb":38207,"num_write":998,"num_write_kb":19360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"256'355","reported_seq":1889,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.837911+0000","last_change":"2024-03-04T12:36:07.291981+0000","last_active":"2024-03-04T12:59:48.837911+0000","last_peered":"2024-03-04T12:59:48.837911+0000","last_clean":"2024-03-04T12:59:48.837911+0000","last_became_active":"2024-03-04T12:36:07.291690+0000","last_became_peered":"2024-03-04T12:36:07.291690+0000","last_unstale":"2024-03-04T12:59:48.837911+0000","last_undegraded":"2024-03-04T12:59:48.837911+0000","last_fullsized":"2024-03-04T12:59:48.837911+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:27:20.656871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2163,"num_read_kb":2091,"num_write":400,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"256'260","reported_seq":877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.912989+0000","last_change":"2024-03-04T12:36:05.287869+0000","last_active":"2024-03-04T13:00:15.912989+0000","last_peered":"2024-03-04T13:00:15.912989+0000","last_clean":"2024-03-04T13:00:15.912989+0000","last_became_active":"2024-03-04T12:36:05.287529+0000","last_became_peered":"2024-03-04T12:36:05.287529+0000","last_unstale":"2024-03-04T13:00:15.912989+0000","last_undegraded":"2024-03-04T13:00:15.912989+0000","last_fullsized":"2024-03-04T13:00:15.912989+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:48.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097782,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":439,"num_read_kb":37296,"num_write":1054,"num_write_kb":36513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"256'739","reported_seq":2222,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.017452+0000","last_change":"2024-03-04T12:36:07.300374+0000","last_active":"2024-03-04T12:59:56.017452+0000","last_peered":"2024-03-04T12:59:56.017452+0000","last_clean":"2024-03-04T12:59:56.017452+0000","last_became_active":"2024-03-04T12:36:07.299881+0000","last_became_peered":"2024-03-04T12:36:07.299881+0000","last_unstale":"2024-03-04T12:59:56.017452+0000","last_undegraded":"2024-03-04T12:59:56.017452+0000","last_fullsized":"2024-03-04T12:59:56.017452+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:55:08.815424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3309,"num_read_kb":2983,"num_write":974,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"256'285","reported_seq":909,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.976782+0000","last_change":"2024-03-04T12:36:05.286690+0000","last_active":"2024-03-04T13:00:15.976782+0000","last_peered":"2024-03-04T13:00:15.976782+0000","last_clean":"2024-03-04T13:00:15.976782+0000","last_became_active":"2024-03-04T12:36:05.286397+0000","last_became_peered":"2024-03-04T12:36:05.286397+0000","last_unstale":"2024-03-04T13:00:15.976782+0000","last_undegraded":"2024-03-04T13:00:15.976782+0000","last_fullsized":"2024-03-04T13:00:15.976782+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:20:08.942318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104717,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":420,"num_read_kb":103287,"num_write":1181,"num_write_kb":47023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"256'475","reported_seq":2071,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.610564+0000","last_change":"2024-03-04T12:36:07.292858+0000","last_active":"2024-03-04T12:59:47.610564+0000","last_peered":"2024-03-04T12:59:47.610564+0000","last_clean":"2024-03-04T12:59:47.610564+0000","last_became_active":"2024-03-04T12:36:07.292501+0000","last_became_peered":"2024-03-04T12:36:07.292501+0000","last_unstale":"2024-03-04T12:59:47.610564+0000","last_undegraded":"2024-03-04T12:59:47.610564+0000","last_fullsized":"2024-03-04T12:59:47.610564+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:35.770287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2330,"num_write":558,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"256'280","reported_seq":877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.955320+0000","last_change":"2024-03-04T12:36:05.294285+0000","last_active":"2024-03-04T13:00:15.955320+0000","last_peered":"2024-03-04T13:00:15.955320+0000","last_clean":"2024-03-04T13:00:15.955320+0000","last_became_active":"2024-03-04T12:36:05.294007+0000","last_became_peered":"2024-03-04T12:36:05.294007+0000","last_unstale":"2024-03-04T13:00:15.955320+0000","last_undegraded":"2024-03-04T13:00:15.955320+0000","last_fullsized":"2024-03-04T13:00:15.955320+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:06.848739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924970,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":399,"num_read_kb":23598,"num_write":1150,"num_write_kb":28139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"256'446","reported_seq":1957,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.468689+0000","last_change":"2024-03-04T12:36:07.294584+0000","last_active":"2024-03-04T12:59:55.468689+0000","last_peered":"2024-03-04T12:59:55.468689+0000","last_clean":"2024-03-04T12:59:55.468689+0000","last_became_active":"2024-03-04T12:36:07.294283+0000","last_became_peered":"2024-03-04T12:36:07.294283+0000","last_unstale":"2024-03-04T12:59:55.468689+0000","last_undegraded":"2024-03-04T12:59:55.468689+0000","last_fullsized":"2024-03-04T12:59:55.468689+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:44:00.573776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2476,"num_read_kb":2316,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"256'291","reported_seq":904,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.003309+0000","last_change":"2024-03-04T12:36:05.290249+0000","last_active":"2024-03-04T13:00:16.003309+0000","last_peered":"2024-03-04T13:00:16.003309+0000","last_clean":"2024-03-04T13:00:16.003309+0000","last_became_active":"2024-03-04T12:36:05.289882+0000","last_became_peered":"2024-03-04T12:36:05.289882+0000","last_unstale":"2024-03-04T13:00:16.003309+0000","last_undegraded":"2024-03-04T13:00:16.003309+0000","last_fullsized":"2024-03-04T13:00:16.003309+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:30.035250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5637358,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":433,"num_read_kb":35092,"num_write":1050,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"256'454","reported_seq":1937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671932+0000","last_change":"2024-03-04T12:36:07.294765+0000","last_active":"2024-03-04T13:00:06.671932+0000","last_peered":"2024-03-04T13:00:06.671932+0000","last_clean":"2024-03-04T13:00:06.671932+0000","last_became_active":"2024-03-04T12:36:07.292904+0000","last_became_peered":"2024-03-04T12:36:07.292904+0000","last_unstale":"2024-03-04T13:00:06.671932+0000","last_undegraded":"2024-03-04T13:00:06.671932+0000","last_fullsized":"2024-03-04T13:00:06.671932+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:02.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2160,"num_write":550,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"256'265","reported_seq":851,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.962326+0000","last_change":"2024-03-04T12:36:05.294662+0000","last_active":"2024-03-04T13:00:15.962326+0000","last_peered":"2024-03-04T13:00:15.962326+0000","last_clean":"2024-03-04T13:00:15.962326+0000","last_became_active":"2024-03-04T12:36:05.294338+0000","last_became_peered":"2024-03-04T12:36:05.294338+0000","last_unstale":"2024-03-04T13:00:15.962326+0000","last_undegraded":"2024-03-04T13:00:15.962326+0000","last_fullsized":"2024-03-04T13:00:15.962326+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:09.803465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265765,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":394,"num_read_kb":2630,"num_write":1096,"num_write_kb":25999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"256'1251","reported_seq":2837,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.468793+0000","last_change":"2024-03-04T12:36:07.292610+0000","last_active":"2024-03-04T12:59:55.468793+0000","last_peered":"2024-03-04T12:59:55.468793+0000","last_clean":"2024-03-04T12:59:55.468793+0000","last_became_active":"2024-03-04T12:36:07.292294+0000","last_became_peered":"2024-03-04T12:36:07.292294+0000","last_unstale":"2024-03-04T12:59:55.468793+0000","last_undegraded":"2024-03-04T12:59:55.468793+0000","last_fullsized":"2024-03-04T12:59:55.468793+0000","mapping_epoch":22,"log_start":"256'1200","ondisk_log_start":"256'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:30:59.966747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5403,"num_read_kb":4680,"num_write":1785,"num_write_kb":760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"256'283","reported_seq":884,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.999538+0000","last_change":"2024-03-04T12:36:05.290703+0000","last_active":"2024-03-04T13:00:15.999538+0000","last_peered":"2024-03-04T13:00:15.999538+0000","last_clean":"2024-03-04T13:00:15.999538+0000","last_became_active":"2024-03-04T12:36:05.290410+0000","last_became_peered":"2024-03-04T12:36:05.290410+0000","last_unstale":"2024-03-04T13:00:15.999538+0000","last_undegraded":"2024-03-04T13:00:15.999538+0000","last_fullsized":"2024-03-04T13:00:15.999538+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:59.309109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6390630,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":409,"num_read_kb":19682,"num_write":1167,"num_write_kb":25111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"256'274","reported_seq":1515,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.123078+0000","last_change":"2024-03-04T12:36:07.293973+0000","last_active":"2024-03-04T12:59:52.123078+0000","last_peered":"2024-03-04T12:59:52.123078+0000","last_clean":"2024-03-04T12:59:52.123078+0000","last_became_active":"2024-03-04T12:36:07.291583+0000","last_became_peered":"2024-03-04T12:36:07.291583+0000","last_unstale":"2024-03-04T12:59:52.123078+0000","last_undegraded":"2024-03-04T12:59:52.123078+0000","last_fullsized":"2024-03-04T12:59:52.123078+0000","mapping_epoch":22,"log_start":"256'200","ondisk_log_start":"256'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:30:48.818767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1552,"num_read_kb":1496,"num_write":324,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"256'353","reported_seq":969,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.006131+0000","last_change":"2024-03-04T12:36:05.290812+0000","last_active":"2024-03-04T13:00:16.006131+0000","last_peered":"2024-03-04T13:00:16.006131+0000","last_clean":"2024-03-04T13:00:16.006131+0000","last_became_active":"2024-03-04T12:36:05.290522+0000","last_became_peered":"2024-03-04T12:36:05.290522+0000","last_unstale":"2024-03-04T13:00:16.006131+0000","last_undegraded":"2024-03-04T13:00:16.006131+0000","last_fullsized":"2024-03-04T13:00:16.006131+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:11:55.799567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12166245,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":559,"num_read_kb":8191,"num_write":1159,"num_write_kb":30951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"256'1119","reported_seq":2696,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.020212+0000","last_change":"2024-03-04T12:36:07.294845+0000","last_active":"2024-03-04T12:59:56.020212+0000","last_peered":"2024-03-04T12:59:56.020212+0000","last_clean":"2024-03-04T12:59:56.020212+0000","last_became_active":"2024-03-04T12:36:07.294536+0000","last_became_peered":"2024-03-04T12:36:07.294536+0000","last_unstale":"2024-03-04T12:59:56.020212+0000","last_undegraded":"2024-03-04T12:59:56.020212+0000","last_fullsized":"2024-03-04T12:59:56.020212+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:59.121496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4737,"num_read_kb":4156,"num_write":1530,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"256'273","reported_seq":886,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.939081+0000","last_change":"2024-03-04T12:36:05.286225+0000","last_active":"2024-03-04T13:00:15.939081+0000","last_peered":"2024-03-04T13:00:15.939081+0000","last_clean":"2024-03-04T13:00:15.939081+0000","last_became_active":"2024-03-04T12:36:05.285924+0000","last_became_peered":"2024-03-04T12:36:05.285924+0000","last_unstale":"2024-03-04T13:00:15.939081+0000","last_undegraded":"2024-03-04T13:00:15.939081+0000","last_fullsized":"2024-03-04T13:00:15.939081+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:09.707595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5191234,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":370,"num_read_kb":22811,"num_write":1021,"num_write_kb":24147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"256'331","reported_seq":1637,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.899638+0000","last_change":"2024-03-04T12:36:07.302695+0000","last_active":"2024-03-04T12:59:54.899638+0000","last_peered":"2024-03-04T12:59:54.899638+0000","last_clean":"2024-03-04T12:59:54.899638+0000","last_became_active":"2024-03-04T12:36:07.302371+0000","last_became_peered":"2024-03-04T12:36:07.302371+0000","last_unstale":"2024-03-04T12:59:54.899638+0000","last_undegraded":"2024-03-04T12:59:54.899638+0000","last_fullsized":"2024-03-04T12:59:54.899638+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:05.080759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1728,"num_read_kb":1642,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"256'274","reported_seq":868,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.853582+0000","last_change":"2024-03-04T12:36:05.290406+0000","last_active":"2024-03-04T13:00:15.853582+0000","last_peered":"2024-03-04T13:00:15.853582+0000","last_clean":"2024-03-04T13:00:15.853582+0000","last_became_active":"2024-03-04T12:36:05.290032+0000","last_became_peered":"2024-03-04T12:36:05.290032+0000","last_unstale":"2024-03-04T13:00:15.853582+0000","last_undegraded":"2024-03-04T13:00:15.853582+0000","last_fullsized":"2024-03-04T13:00:15.853582+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:02.601501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6587184,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":379,"num_read_kb":31102,"num_write":1038,"num_write_kb":33345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"256'416","reported_seq":1942,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.903846+0000","last_change":"2024-03-04T12:36:07.300654+0000","last_active":"2024-03-04T12:59:54.903846+0000","last_peered":"2024-03-04T12:59:54.903846+0000","last_clean":"2024-03-04T12:59:54.903846+0000","last_became_active":"2024-03-04T12:36:07.299718+0000","last_became_peered":"2024-03-04T12:36:07.299718+0000","last_unstale":"2024-03-04T12:59:54.903846+0000","last_undegraded":"2024-03-04T12:59:54.903846+0000","last_fullsized":"2024-03-04T12:59:54.903846+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:35:20.788356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2289,"num_read_kb":2179,"num_write":520,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"256'340","reported_seq":998,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.954726+0000","last_change":"2024-03-04T12:36:05.279867+0000","last_active":"2024-03-04T13:00:15.954726+0000","last_peered":"2024-03-04T13:00:15.954726+0000","last_clean":"2024-03-04T13:00:15.954726+0000","last_became_active":"2024-03-04T12:36:05.279538+0000","last_became_peered":"2024-03-04T12:36:05.279538+0000","last_unstale":"2024-03-04T13:00:15.954726+0000","last_undegraded":"2024-03-04T13:00:15.954726+0000","last_fullsized":"2024-03-04T13:00:15.954726+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:35.650378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6918989,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":570,"num_read_kb":6796,"num_write":1473,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"256'748","reported_seq":2146,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.850080+0000","last_change":"2024-03-04T12:36:07.294946+0000","last_active":"2024-03-04T12:59:48.850080+0000","last_peered":"2024-03-04T12:59:48.850080+0000","last_clean":"2024-03-04T12:59:48.850080+0000","last_became_active":"2024-03-04T12:36:07.294274+0000","last_became_peered":"2024-03-04T12:36:07.294274+0000","last_unstale":"2024-03-04T12:59:48.850080+0000","last_undegraded":"2024-03-04T12:59:48.850080+0000","last_fullsized":"2024-03-04T12:59:48.850080+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:24.843354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3445,"num_read_kb":3067,"num_write":1017,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"256'327","reported_seq":909,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.962540+0000","last_change":"2024-03-04T12:36:40.391610+0000","last_active":"2024-03-04T13:00:15.962540+0000","last_peered":"2024-03-04T13:00:15.962540+0000","last_clean":"2024-03-04T13:00:15.962540+0000","last_became_active":"2024-03-04T12:36:40.391325+0000","last_became_peered":"2024-03-04T12:36:40.391325+0000","last_unstale":"2024-03-04T13:00:15.962540+0000","last_undegraded":"2024-03-04T13:00:15.962540+0000","last_fullsized":"2024-03-04T13:00:15.962540+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:12.401772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11385688,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":467,"num_read_kb":41620,"num_write":1209,"num_write_kb":38740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"256'326","reported_seq":1036,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.959228+0000","last_change":"2024-03-04T12:36:05.288067+0000","last_active":"2024-03-04T13:00:15.959228+0000","last_peered":"2024-03-04T13:00:15.959228+0000","last_clean":"2024-03-04T13:00:15.959228+0000","last_became_active":"2024-03-04T12:36:05.287744+0000","last_became_peered":"2024-03-04T12:36:05.287744+0000","last_unstale":"2024-03-04T13:00:15.959228+0000","last_undegraded":"2024-03-04T13:00:15.959228+0000","last_fullsized":"2024-03-04T13:00:15.959228+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:52.068699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4081952,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":754,"num_read_kb":29804,"num_write":1251,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"256'537","reported_seq":2091,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.609188+0000","last_change":"2024-03-04T12:36:07.302554+0000","last_active":"2024-03-04T12:59:47.609188+0000","last_peered":"2024-03-04T12:59:47.609188+0000","last_clean":"2024-03-04T12:59:47.609188+0000","last_became_active":"2024-03-04T12:36:07.302290+0000","last_became_peered":"2024-03-04T12:36:07.302290+0000","last_unstale":"2024-03-04T12:59:47.609188+0000","last_undegraded":"2024-03-04T12:59:47.609188+0000","last_fullsized":"2024-03-04T12:59:47.609188+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:53.412189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2955,"num_read_kb":2687,"num_write":726,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"256'406","reported_seq":1180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.999620+0000","last_change":"2024-03-04T12:36:05.284158+0000","last_active":"2024-03-04T13:00:15.999620+0000","last_peered":"2024-03-04T13:00:15.999620+0000","last_clean":"2024-03-04T13:00:15.999620+0000","last_became_active":"2024-03-04T12:36:05.283797+0000","last_became_peered":"2024-03-04T12:36:05.283797+0000","last_unstale":"2024-03-04T13:00:15.999620+0000","last_undegraded":"2024-03-04T13:00:15.999620+0000","last_fullsized":"2024-03-04T13:00:15.999620+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:29.801034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15904196,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":1071,"num_read_kb":38636,"num_write":1623,"num_write_kb":30809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"256'783","reported_seq":2208,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.901394+0000","last_change":"2024-03-04T12:36:07.301827+0000","last_active":"2024-03-04T12:59:54.901394+0000","last_peered":"2024-03-04T12:59:54.901394+0000","last_clean":"2024-03-04T12:59:54.901394+0000","last_became_active":"2024-03-04T12:36:07.301542+0000","last_became_peered":"2024-03-04T12:36:07.301542+0000","last_unstale":"2024-03-04T12:59:54.901394+0000","last_undegraded":"2024-03-04T12:59:54.901394+0000","last_fullsized":"2024-03-04T12:59:54.901394+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:45.175861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3434,"num_read_kb":3044,"num_write":1054,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":61919647,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":145,"num_read_kb":179702,"num_write":156,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122798080,"data_stored":122790718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5885,"num_read_kb":4252,"num_write":2245,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1077,"ondisk_log_size":1077,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":9441,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":12014,"num_read_kb":11868,"num_write":14038,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":18882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2352,"ondisk_log_size":2352,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":470,"ondisk_log_size":470,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1765411,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":15272,"num_read_kb":31264,"num_write":13026,"num_write_kb":10804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2318336,"data_stored":1877287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2190,"ondisk_log_size":2190,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1552,"num_read_kb":1546,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":187094,"num_read_kb":170304,"num_write":50851,"num_write_kb":17572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3861,"ondisk_log_size":3861,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":560694938,"num_objects":3061,"num_object_clones":0,"num_object_copies":6122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3061,"num_whiteouts":0,"num_read":32107,"num_read_kb":2210879,"num_write":75838,"num_write_kb":2282182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1146773504,"data_stored":1125152021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4086,"ondisk_log_size":4086,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":61492375,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":146,"num_read_kb":175660,"num_write":156,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122994688,"data_stored":122984750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575146,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":566116,"kb_used_data":291996,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93805724,"statfs":{"total":96636764160,"available":96057061376,"internally_reserved":0,"allocated":299003904,"data_stored":292894628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575147,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361432,"kb_used_data":109388,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94010408,"statfs":{"total":96636764160,"available":96266657792,"internally_reserved":0,"allocated":112013312,"data_stored":108598334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575147,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357592,"kb_used_data":245936,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94014248,"statfs":{"total":96636764160,"available":96270589952,"internally_reserved":0,"allocated":251838464,"data_stored":245965854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575145,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290636,"kb_used_data":223320,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94081204,"statfs":{"total":96636764160,"available":96339152896,"internally_reserved":0,"allocated":228679680,"data_stored":223855331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575145,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":461676,"kb_used_data":205620,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93910164,"statfs":{"total":96636764160,"available":96164007936,"internally_reserved":0,"allocated":210554880,"data_stored":205208502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262142407},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575146,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282108,"kb_used_data":196852,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94089732,"statfs":{"total":96636764160,"available":96347885568,"internally_reserved":0,"allocated":201576448,"data_stored":197312818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575149,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283840,"kb_used_data":176376,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94088000,"statfs":{"total":96636764160,"available":96346112000,"internally_reserved":0,"allocated":180609024,"data_stored":176119526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575146,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":476456,"kb_used_data":220440,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93895384,"statfs":{"total":96636764160,"available":96148873216,"internally_reserved":0,"allocated":225730560,"data_stored":220168485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":151445504,"data_stored":148281035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":97763328,"data_stored":95850048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":122564608,"data_stored":120666676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":148090880,"data_stored":144888191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":196055040,"data_stored":192769456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":162119680,"data_stored":159161227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92483584,"data_stored":90567117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":176250880,"data_stored":172968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":259557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":244102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":90869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":357717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":43735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":377061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":141578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":362668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28315648,"data_stored":28314756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14730523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25169028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16830464,"data_stored":16827675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19963904,"data_stored":19963089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12120064,"data_stored":12118699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22659072,"data_stored":22654918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":10525905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10539008,"data_stored":10536219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:00:19.086 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-04T13:00:19.086 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:00:19.431 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:19.443 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-03-04T13:00:19.445 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":986,"stamp":"2024-03-04T13:00:19.355923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":686473817,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":254339,"num_read_kb":2785583,"num_write":156503,"num_write_kb":2552438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14275,"ondisk_log_size":14275,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3079856,"kb_used_data":1669928,"kb_used_omap":12,"kb_used_meta":1409587,"kb_avail":751894864,"statfs":{"total":773094113280,"available":769940340736,"internally_reserved":0,"allocated":1710006272,"data_stored":1670123478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1443417648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-217867511,"num_objects":-1453,"num_object_clones":0,"num_object_copies":-2906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1453,"num_whiteouts":0,"num_read":1696,"num_read_kb":79345,"num_write":1608,"num_write_kb":39020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004979"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.981271+0000","last_change":"2024-03-04T12:51:01.353518+0000","last_active":"2024-03-04T12:56:00.981271+0000","last_peered":"2024-03-04T12:56:00.981271+0000","last_clean":"2024-03-04T12:56:00.981271+0000","last_became_active":"2024-03-04T12:51:01.353225+0000","last_became_peered":"2024-03-04T12:51:01.353225+0000","last_unstale":"2024-03-04T12:56:00.981271+0000","last_undegraded":"2024-03-04T12:56:00.981271+0000","last_fullsized":"2024-03-04T12:56:00.981271+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:20:07.047294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"256'1","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.982336+0000","last_change":"2024-03-04T12:44:53.484600+0000","last_active":"2024-03-04T12:57:25.982336+0000","last_peered":"2024-03-04T12:57:25.982336+0000","last_clean":"2024-03-04T12:57:25.982336+0000","last_became_active":"2024-03-04T12:44:53.484341+0000","last_became_peered":"2024-03-04T12:44:53.484341+0000","last_unstale":"2024-03-04T12:57:25.982336+0000","last_undegraded":"2024-03-04T12:57:25.982336+0000","last_fullsized":"2024-03-04T12:57:25.982336+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:26:14.610910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:50.981767+0000","last_change":"2024-03-04T12:44:50.455898+0000","last_active":"2024-03-04T12:56:50.981767+0000","last_peered":"2024-03-04T12:56:50.981767+0000","last_clean":"2024-03-04T12:56:50.981767+0000","last_became_active":"2024-03-04T12:44:50.455509+0000","last_became_peered":"2024-03-04T12:44:50.455509+0000","last_unstale":"2024-03-04T12:56:50.981767+0000","last_undegraded":"2024-03-04T12:56:50.981767+0000","last_fullsized":"2024-03-04T12:56:50.981767+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:49.453401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"256'40","reported_seq":137,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.123970+0000","last_change":"2024-03-04T12:43:27.060696+0000","last_active":"2024-03-04T12:58:30.123970+0000","last_peered":"2024-03-04T12:58:30.123970+0000","last_clean":"2024-03-04T12:58:30.123970+0000","last_became_active":"2024-03-04T12:43:27.060405+0000","last_became_peered":"2024-03-04T12:43:27.060405+0000","last_unstale":"2024-03-04T12:58:30.123970+0000","last_undegraded":"2024-03-04T12:58:30.123970+0000","last_fullsized":"2024-03-04T12:58:30.123970+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:44.787006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":118,"num_write":66,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.981316+0000","last_change":"2024-03-04T12:51:01.358434+0000","last_active":"2024-03-04T12:56:00.981316+0000","last_peered":"2024-03-04T12:56:00.981316+0000","last_clean":"2024-03-04T12:56:00.981316+0000","last_became_active":"2024-03-04T12:51:01.358005+0000","last_became_peered":"2024-03-04T12:51:01.358005+0000","last_unstale":"2024-03-04T12:56:00.981316+0000","last_undegraded":"2024-03-04T12:56:00.981316+0000","last_fullsized":"2024-03-04T12:56:00.981316+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:18:34.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"256'8","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.000903+0000","last_change":"2024-03-04T12:44:53.487686+0000","last_active":"2024-03-04T12:59:56.000903+0000","last_peered":"2024-03-04T12:59:56.000903+0000","last_clean":"2024-03-04T12:59:56.000903+0000","last_became_active":"2024-03-04T12:44:53.486168+0000","last_became_peered":"2024-03-04T12:44:53.486168+0000","last_unstale":"2024-03-04T12:59:56.000903+0000","last_undegraded":"2024-03-04T12:59:56.000903+0000","last_fullsized":"2024-03-04T12:59:56.000903+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:34.274997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":10242,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.998713+0000","last_change":"2024-03-04T12:44:50.450818+0000","last_active":"2024-03-04T12:57:20.998713+0000","last_peered":"2024-03-04T12:57:20.998713+0000","last_clean":"2024-03-04T12:57:20.998713+0000","last_became_active":"2024-03-04T12:44:50.450465+0000","last_became_peered":"2024-03-04T12:44:50.450465+0000","last_unstale":"2024-03-04T12:57:20.998713+0000","last_undegraded":"2024-03-04T12:57:20.998713+0000","last_fullsized":"2024-03-04T12:57:20.998713+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:20:08.194072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"250'33","reported_seq":127,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:31.000006+0000","last_change":"2024-03-04T12:43:27.060869+0000","last_active":"2024-03-04T12:57:31.000006+0000","last_peered":"2024-03-04T12:57:31.000006+0000","last_clean":"2024-03-04T12:57:31.000006+0000","last_became_active":"2024-03-04T12:43:27.060562+0000","last_became_peered":"2024-03-04T12:43:27.060562+0000","last_unstale":"2024-03-04T12:57:31.000006+0000","last_undegraded":"2024-03-04T12:57:31.000006+0000","last_fullsized":"2024-03-04T12:57:31.000006+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:48.410106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":113,"num_write":48,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.979605+0000","last_change":"2024-03-04T12:51:01.596745+0000","last_active":"2024-03-04T12:57:00.979605+0000","last_peered":"2024-03-04T12:57:00.979605+0000","last_clean":"2024-03-04T12:57:00.979605+0000","last_became_active":"2024-03-04T12:51:01.595776+0000","last_became_peered":"2024-03-04T12:51:01.595776+0000","last_unstale":"2024-03-04T12:57:00.979605+0000","last_undegraded":"2024-03-04T12:57:00.979605+0000","last_fullsized":"2024-03-04T12:57:00.979605+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:37.758945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"256'11","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.996043+0000","last_change":"2024-03-04T12:44:53.479265+0000","last_active":"2024-03-04T12:57:25.996043+0000","last_peered":"2024-03-04T12:57:25.996043+0000","last_clean":"2024-03-04T12:57:25.996043+0000","last_became_active":"2024-03-04T12:44:53.478864+0000","last_became_peered":"2024-03-04T12:44:53.478864+0000","last_unstale":"2024-03-04T12:57:25.996043+0000","last_undegraded":"2024-03-04T12:57:25.996043+0000","last_fullsized":"2024-03-04T12:57:25.996043+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:28:17.550698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":25,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.982244+0000","last_change":"2024-03-04T12:44:50.454109+0000","last_active":"2024-03-04T12:57:20.982244+0000","last_peered":"2024-03-04T12:57:20.982244+0000","last_clean":"2024-03-04T12:57:20.982244+0000","last_became_active":"2024-03-04T12:44:50.453830+0000","last_became_peered":"2024-03-04T12:44:50.453830+0000","last_unstale":"2024-03-04T12:57:20.982244+0000","last_undegraded":"2024-03-04T12:57:20.982244+0000","last_fullsized":"2024-03-04T12:57:20.982244+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:34.779841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"256'64","reported_seq":196,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:09.281547+0000","last_change":"2024-03-04T12:43:27.067573+0000","last_active":"2024-03-04T12:56:09.281547+0000","last_peered":"2024-03-04T12:56:09.281547+0000","last_clean":"2024-03-04T12:56:09.281547+0000","last_became_active":"2024-03-04T12:43:27.067330+0000","last_became_peered":"2024-03-04T12:43:27.067330+0000","last_unstale":"2024-03-04T12:56:09.281547+0000","last_undegraded":"2024-03-04T12:56:09.281547+0000","last_fullsized":"2024-03-04T12:56:09.281547+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:08.510342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":194,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998217+0000","last_change":"2024-03-04T12:51:01.596599+0000","last_active":"2024-03-04T12:57:15.998217+0000","last_peered":"2024-03-04T12:57:15.998217+0000","last_clean":"2024-03-04T12:57:15.998217+0000","last_became_active":"2024-03-04T12:51:01.596268+0000","last_became_peered":"2024-03-04T12:51:01.596268+0000","last_unstale":"2024-03-04T12:57:15.998217+0000","last_undegraded":"2024-03-04T12:57:15.998217+0000","last_fullsized":"2024-03-04T12:57:15.998217+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:07:16.190633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.982302+0000","last_change":"2024-03-04T12:44:53.482037+0000","last_active":"2024-03-04T12:56:55.982302+0000","last_peered":"2024-03-04T12:56:55.982302+0000","last_clean":"2024-03-04T12:56:55.982302+0000","last_became_active":"2024-03-04T12:44:53.481760+0000","last_became_peered":"2024-03-04T12:44:53.481760+0000","last_unstale":"2024-03-04T12:56:55.982302+0000","last_undegraded":"2024-03-04T12:56:55.982302+0000","last_fullsized":"2024-03-04T12:56:55.982302+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:44.305523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.998658+0000","last_change":"2024-03-04T12:44:50.456063+0000","last_active":"2024-03-04T12:57:20.998658+0000","last_peered":"2024-03-04T12:57:20.998658+0000","last_clean":"2024-03-04T12:57:20.998658+0000","last_became_active":"2024-03-04T12:44:50.455723+0000","last_became_peered":"2024-03-04T12:44:50.455723+0000","last_unstale":"2024-03-04T12:57:20.998658+0000","last_undegraded":"2024-03-04T12:57:20.998658+0000","last_fullsized":"2024-03-04T12:57:20.998658+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:10:27.178040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"256'150","reported_seq":499,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.311363+0000","last_change":"2024-03-04T12:43:27.067487+0000","last_active":"2024-03-04T12:57:45.311363+0000","last_peered":"2024-03-04T12:57:45.311363+0000","last_clean":"2024-03-04T12:57:45.311363+0000","last_became_active":"2024-03-04T12:43:27.067228+0000","last_became_peered":"2024-03-04T12:43:27.067228+0000","last_unstale":"2024-03-04T12:57:45.311363+0000","last_undegraded":"2024-03-04T12:57:45.311363+0000","last_fullsized":"2024-03-04T12:57:45.311363+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:38.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":889,"num_read_kb":655,"num_write":189,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.976872+0000","last_change":"2024-03-04T12:51:01.356736+0000","last_active":"2024-03-04T12:55:50.976872+0000","last_peered":"2024-03-04T12:55:50.976872+0000","last_clean":"2024-03-04T12:55:50.976872+0000","last_became_active":"2024-03-04T12:51:01.356572+0000","last_became_peered":"2024-03-04T12:51:01.356572+0000","last_unstale":"2024-03-04T12:55:50.976872+0000","last_undegraded":"2024-03-04T12:55:50.976872+0000","last_fullsized":"2024-03-04T12:55:50.976872+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:07.737968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"256'3","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991872+0000","last_change":"2024-03-04T12:44:53.477654+0000","last_active":"2024-03-04T12:57:00.991872+0000","last_peered":"2024-03-04T12:57:00.991872+0000","last_clean":"2024-03-04T12:57:00.991872+0000","last_became_active":"2024-03-04T12:44:53.477386+0000","last_became_peered":"2024-03-04T12:44:53.477386+0000","last_unstale":"2024-03-04T12:57:00.991872+0000","last_undegraded":"2024-03-04T12:57:00.991872+0000","last_fullsized":"2024-03-04T12:57:00.991872+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:49:31.357868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":418,"num_write":3,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.988386+0000","last_change":"2024-03-04T12:44:50.449002+0000","last_active":"2024-03-04T12:57:20.988386+0000","last_peered":"2024-03-04T12:57:20.988386+0000","last_clean":"2024-03-04T12:57:20.988386+0000","last_became_active":"2024-03-04T12:44:50.448683+0000","last_became_peered":"2024-03-04T12:44:50.448683+0000","last_unstale":"2024-03-04T12:57:20.988386+0000","last_undegraded":"2024-03-04T12:57:20.988386+0000","last_fullsized":"2024-03-04T12:57:20.988386+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:39.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"256'38","reported_seq":128,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:29.561426+0000","last_change":"2024-03-04T12:43:27.062948+0000","last_active":"2024-03-04T12:58:29.561426+0000","last_peered":"2024-03-04T12:58:29.561426+0000","last_clean":"2024-03-04T12:58:29.561426+0000","last_became_active":"2024-03-04T12:43:27.062623+0000","last_became_peered":"2024-03-04T12:43:27.062623+0000","last_unstale":"2024-03-04T12:58:29.561426+0000","last_undegraded":"2024-03-04T12:58:29.561426+0000","last_fullsized":"2024-03-04T12:58:29.561426+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:50.641970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.979565+0000","last_change":"2024-03-04T12:51:01.357400+0000","last_active":"2024-03-04T12:55:50.979565+0000","last_peered":"2024-03-04T12:55:50.979565+0000","last_clean":"2024-03-04T12:55:50.979565+0000","last_became_active":"2024-03-04T12:51:01.355578+0000","last_became_peered":"2024-03-04T12:51:01.355578+0000","last_unstale":"2024-03-04T12:55:50.979565+0000","last_undegraded":"2024-03-04T12:55:50.979565+0000","last_fullsized":"2024-03-04T12:55:50.979565+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:25.516318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"256'9","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996330+0000","last_change":"2024-03-04T12:44:53.477157+0000","last_active":"2024-03-04T12:57:00.996330+0000","last_peered":"2024-03-04T12:57:00.996330+0000","last_clean":"2024-03-04T12:57:00.996330+0000","last_became_active":"2024-03-04T12:44:53.476348+0000","last_became_peered":"2024-03-04T12:44:53.476348+0000","last_unstale":"2024-03-04T12:57:00.996330+0000","last_undegraded":"2024-03-04T12:57:00.996330+0000","last_fullsized":"2024-03-04T12:57:00.996330+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:43.436115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'5","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.982216+0000","last_change":"2024-03-04T12:44:50.454551+0000","last_active":"2024-03-04T12:57:20.982216+0000","last_peered":"2024-03-04T12:57:20.982216+0000","last_clean":"2024-03-04T12:57:20.982216+0000","last_became_active":"2024-03-04T12:44:50.454252+0000","last_became_peered":"2024-03-04T12:44:50.454252+0000","last_unstale":"2024-03-04T12:57:20.982216+0000","last_undegraded":"2024-03-04T12:57:20.982216+0000","last_fullsized":"2024-03-04T12:57:20.982216+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:16:14.575234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"256'25","reported_seq":96,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:27.547187+0000","last_change":"2024-03-04T12:43:27.061927+0000","last_active":"2024-03-04T12:56:27.547187+0000","last_peered":"2024-03-04T12:56:27.547187+0000","last_clean":"2024-03-04T12:56:27.547187+0000","last_became_active":"2024-03-04T12:43:27.061611+0000","last_became_peered":"2024-03-04T12:43:27.061611+0000","last_unstale":"2024-03-04T12:56:27.547187+0000","last_undegraded":"2024-03-04T12:56:27.547187+0000","last_fullsized":"2024-03-04T12:56:27.547187+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:29.841849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.972502+0000","last_change":"2024-03-04T12:51:01.351751+0000","last_active":"2024-03-04T12:56:00.972502+0000","last_peered":"2024-03-04T12:56:00.972502+0000","last_clean":"2024-03-04T12:56:00.972502+0000","last_became_active":"2024-03-04T12:51:01.351465+0000","last_became_peered":"2024-03-04T12:51:01.351465+0000","last_unstale":"2024-03-04T12:56:00.972502+0000","last_undegraded":"2024-03-04T12:56:00.972502+0000","last_fullsized":"2024-03-04T12:56:00.972502+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:15.131665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"256'3","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.999164+0000","last_change":"2024-03-04T12:44:53.483089+0000","last_active":"2024-03-04T12:57:25.999164+0000","last_peered":"2024-03-04T12:57:25.999164+0000","last_clean":"2024-03-04T12:57:25.999164+0000","last_became_active":"2024-03-04T12:44:53.482806+0000","last_became_peered":"2024-03-04T12:44:53.482806+0000","last_unstale":"2024-03-04T12:57:25.999164+0000","last_undegraded":"2024-03-04T12:57:25.999164+0000","last_fullsized":"2024-03-04T12:57:25.999164+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:48:39.848469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":36,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.978599+0000","last_change":"2024-03-04T12:44:50.457492+0000","last_active":"2024-03-04T12:56:55.978599+0000","last_peered":"2024-03-04T12:56:55.978599+0000","last_clean":"2024-03-04T12:56:55.978599+0000","last_became_active":"2024-03-04T12:44:50.457180+0000","last_became_peered":"2024-03-04T12:44:50.457180+0000","last_unstale":"2024-03-04T12:56:55.978599+0000","last_undegraded":"2024-03-04T12:56:55.978599+0000","last_fullsized":"2024-03-04T12:56:55.978599+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:05.748747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"256'43","reported_seq":131,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:08.070073+0000","last_change":"2024-03-04T12:43:27.063888+0000","last_active":"2024-03-04T12:58:08.070073+0000","last_peered":"2024-03-04T12:58:08.070073+0000","last_clean":"2024-03-04T12:58:08.070073+0000","last_became_active":"2024-03-04T12:43:27.063191+0000","last_became_peered":"2024-03-04T12:43:27.063191+0000","last_unstale":"2024-03-04T12:58:08.070073+0000","last_undegraded":"2024-03-04T12:58:08.070073+0000","last_fullsized":"2024-03-04T12:58:08.070073+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:06.499554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":76,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.978217+0000","last_change":"2024-03-04T12:51:01.353519+0000","last_active":"2024-03-04T12:56:00.978217+0000","last_peered":"2024-03-04T12:56:00.978217+0000","last_clean":"2024-03-04T12:56:00.978217+0000","last_became_active":"2024-03-04T12:51:01.353248+0000","last_became_peered":"2024-03-04T12:51:01.353248+0000","last_unstale":"2024-03-04T12:56:00.978217+0000","last_undegraded":"2024-03-04T12:56:00.978217+0000","last_fullsized":"2024-03-04T12:56:00.978217+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:08:04.830256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"250'5","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.995929+0000","last_change":"2024-03-04T12:44:53.483754+0000","last_active":"2024-03-04T12:57:25.995929+0000","last_peered":"2024-03-04T12:57:25.995929+0000","last_clean":"2024-03-04T12:57:25.995929+0000","last_became_active":"2024-03-04T12:44:53.483210+0000","last_became_peered":"2024-03-04T12:44:53.483210+0000","last_unstale":"2024-03-04T12:57:25.995929+0000","last_undegraded":"2024-03-04T12:57:25.995929+0000","last_fullsized":"2024-03-04T12:57:25.995929+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:13.903672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"256'7","reported_seq":51,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.995460+0000","last_change":"2024-03-04T12:44:50.449512+0000","last_active":"2024-03-04T12:56:55.995460+0000","last_peered":"2024-03-04T12:56:55.995460+0000","last_clean":"2024-03-04T12:56:55.995460+0000","last_became_active":"2024-03-04T12:44:50.449291+0000","last_became_peered":"2024-03-04T12:44:50.449291+0000","last_unstale":"2024-03-04T12:56:55.995460+0000","last_undegraded":"2024-03-04T12:56:55.995460+0000","last_fullsized":"2024-03-04T12:56:55.995460+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:31.117281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"256'42","reported_seq":129,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:11.125334+0000","last_change":"2024-03-04T12:43:27.061951+0000","last_active":"2024-03-04T12:58:11.125334+0000","last_peered":"2024-03-04T12:58:11.125334+0000","last_clean":"2024-03-04T12:58:11.125334+0000","last_became_active":"2024-03-04T12:43:27.061663+0000","last_became_peered":"2024-03-04T12:43:27.061663+0000","last_unstale":"2024-03-04T12:58:11.125334+0000","last_undegraded":"2024-03-04T12:58:11.125334+0000","last_fullsized":"2024-03-04T12:58:11.125334+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:27:00.046660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.970079+0000","last_change":"2024-03-04T12:51:01.596240+0000","last_active":"2024-03-04T12:55:40.970079+0000","last_peered":"2024-03-04T12:55:40.970079+0000","last_clean":"2024-03-04T12:55:40.970079+0000","last_became_active":"2024-03-04T12:51:01.595943+0000","last_became_peered":"2024-03-04T12:51:01.595943+0000","last_unstale":"2024-03-04T12:55:40.970079+0000","last_undegraded":"2024-03-04T12:55:40.970079+0000","last_fullsized":"2024-03-04T12:55:40.970079+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:05:52.818694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"256'1","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.876732+0000","last_change":"2024-03-04T12:44:53.486306+0000","last_active":"2024-03-04T12:57:00.876732+0000","last_peered":"2024-03-04T12:57:00.876732+0000","last_clean":"2024-03-04T12:57:00.876732+0000","last_became_active":"2024-03-04T12:44:53.485995+0000","last_became_peered":"2024-03-04T12:44:53.485995+0000","last_unstale":"2024-03-04T12:57:00.876732+0000","last_undegraded":"2024-03-04T12:57:00.876732+0000","last_fullsized":"2024-03-04T12:57:00.876732+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:08.363349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"256'4","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:20.996938+0000","last_change":"2024-03-04T12:44:50.454948+0000","last_active":"2024-03-04T12:59:20.996938+0000","last_peered":"2024-03-04T12:59:20.996938+0000","last_clean":"2024-03-04T12:59:20.996938+0000","last_became_active":"2024-03-04T12:44:50.454617+0000","last_became_peered":"2024-03-04T12:44:50.454617+0000","last_unstale":"2024-03-04T12:59:20.996938+0000","last_undegraded":"2024-03-04T12:59:20.996938+0000","last_fullsized":"2024-03-04T12:59:20.996938+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:25:07.798347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"256'41","reported_seq":134,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:02.415602+0000","last_change":"2024-03-04T12:43:27.050913+0000","last_active":"2024-03-04T12:58:02.415602+0000","last_peered":"2024-03-04T12:58:02.415602+0000","last_clean":"2024-03-04T12:58:02.415602+0000","last_became_active":"2024-03-04T12:43:27.050088+0000","last_became_peered":"2024-03-04T12:43:27.050088+0000","last_unstale":"2024-03-04T12:58:02.415602+0000","last_undegraded":"2024-03-04T12:58:02.415602+0000","last_fullsized":"2024-03-04T12:58:02.415602+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:10:21.742322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":112,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.971352+0000","last_change":"2024-03-04T12:51:01.595890+0000","last_active":"2024-03-04T12:55:50.971352+0000","last_peered":"2024-03-04T12:55:50.971352+0000","last_clean":"2024-03-04T12:55:50.971352+0000","last_became_active":"2024-03-04T12:51:01.595530+0000","last_became_peered":"2024-03-04T12:51:01.595530+0000","last_unstale":"2024-03-04T12:55:50.971352+0000","last_undegraded":"2024-03-04T12:55:50.971352+0000","last_fullsized":"2024-03-04T12:55:50.971352+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:42:04.439066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"256'4","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.814138+0000","last_change":"2024-03-04T12:44:53.478706+0000","last_active":"2024-03-04T13:00:15.814138+0000","last_peered":"2024-03-04T13:00:15.814138+0000","last_clean":"2024-03-04T13:00:15.814138+0000","last_became_active":"2024-03-04T12:44:53.478099+0000","last_became_peered":"2024-03-04T12:44:53.478099+0000","last_unstale":"2024-03-04T13:00:15.814138+0000","last_undegraded":"2024-03-04T13:00:15.814138+0000","last_fullsized":"2024-03-04T13:00:15.814138+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:06:14.838765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.995606+0000","last_change":"2024-03-04T12:44:50.449111+0000","last_active":"2024-03-04T12:56:55.995606+0000","last_peered":"2024-03-04T12:56:55.995606+0000","last_clean":"2024-03-04T12:56:55.995606+0000","last_became_active":"2024-03-04T12:44:50.448745+0000","last_became_peered":"2024-03-04T12:44:50.448745+0000","last_unstale":"2024-03-04T12:56:55.995606+0000","last_undegraded":"2024-03-04T12:56:55.995606+0000","last_fullsized":"2024-03-04T12:56:55.995606+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:10:12.812219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"256'16","reported_seq":80,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:14.293042+0000","last_change":"2024-03-04T12:43:27.059795+0000","last_active":"2024-03-04T12:58:14.293042+0000","last_peered":"2024-03-04T12:58:14.293042+0000","last_clean":"2024-03-04T12:58:14.293042+0000","last_became_active":"2024-03-04T12:43:27.059494+0000","last_became_peered":"2024-03-04T12:43:27.059494+0000","last_unstale":"2024-03-04T12:58:14.293042+0000","last_undegraded":"2024-03-04T12:58:14.293042+0000","last_fullsized":"2024-03-04T12:58:14.293042+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:49.787014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":48,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.979602+0000","last_change":"2024-03-04T12:51:01.355844+0000","last_active":"2024-03-04T12:55:50.979602+0000","last_peered":"2024-03-04T12:55:50.979602+0000","last_clean":"2024-03-04T12:55:50.979602+0000","last_became_active":"2024-03-04T12:51:01.355560+0000","last_became_peered":"2024-03-04T12:51:01.355560+0000","last_unstale":"2024-03-04T12:55:50.979602+0000","last_undegraded":"2024-03-04T12:55:50.979602+0000","last_fullsized":"2024-03-04T12:55:50.979602+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:05:47.161069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'3","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996437+0000","last_change":"2024-03-04T12:44:53.476693+0000","last_active":"2024-03-04T12:57:00.996437+0000","last_peered":"2024-03-04T12:57:00.996437+0000","last_clean":"2024-03-04T12:57:00.996437+0000","last_became_active":"2024-03-04T12:44:53.475861+0000","last_became_peered":"2024-03-04T12:44:53.475861+0000","last_unstale":"2024-03-04T12:57:00.996437+0000","last_undegraded":"2024-03-04T12:57:00.996437+0000","last_fullsized":"2024-03-04T12:57:00.996437+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.651931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"256'6","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.873133+0000","last_change":"2024-03-04T12:44:50.453813+0000","last_active":"2024-03-04T12:56:35.873133+0000","last_peered":"2024-03-04T12:56:35.873133+0000","last_clean":"2024-03-04T12:56:35.873133+0000","last_became_active":"2024-03-04T12:44:50.453541+0000","last_became_peered":"2024-03-04T12:44:50.453541+0000","last_unstale":"2024-03-04T12:56:35.873133+0000","last_undegraded":"2024-03-04T12:56:35.873133+0000","last_fullsized":"2024-03-04T12:56:35.873133+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:58.224158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"256'48","reported_seq":147,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.129302+0000","last_change":"2024-03-04T12:43:27.071953+0000","last_active":"2024-03-04T12:58:05.129302+0000","last_peered":"2024-03-04T12:58:05.129302+0000","last_clean":"2024-03-04T12:58:05.129302+0000","last_became_active":"2024-03-04T12:43:27.069664+0000","last_became_peered":"2024-03-04T12:43:27.069664+0000","last_unstale":"2024-03-04T12:58:05.129302+0000","last_undegraded":"2024-03-04T12:58:05.129302+0000","last_fullsized":"2024-03-04T12:58:05.129302+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:18:04.123917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":13,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.992618+0000","last_change":"2024-03-04T12:51:41.753110+0000","last_active":"2024-03-04T12:56:30.992618+0000","last_peered":"2024-03-04T12:56:30.992618+0000","last_clean":"2024-03-04T12:56:30.992618+0000","last_became_active":"2024-03-04T12:51:41.752775+0000","last_became_peered":"2024-03-04T12:51:41.752775+0000","last_unstale":"2024-03-04T12:56:30.992618+0000","last_undegraded":"2024-03-04T12:56:30.992618+0000","last_fullsized":"2024-03-04T12:56:30.992618+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:14.336520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"256'6","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.983024+0000","last_change":"2024-03-04T12:44:53.478491+0000","last_active":"2024-03-04T12:57:00.983024+0000","last_peered":"2024-03-04T12:57:00.983024+0000","last_clean":"2024-03-04T12:57:00.983024+0000","last_became_active":"2024-03-04T12:44:53.478126+0000","last_became_peered":"2024-03-04T12:44:53.478126+0000","last_unstale":"2024-03-04T12:57:00.983024+0000","last_undegraded":"2024-03-04T12:57:00.983024+0000","last_fullsized":"2024-03-04T12:57:00.983024+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:47.296637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":11793,"num_write":11,"num_write_kb":7697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'1","reported_seq":38,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.982270+0000","last_change":"2024-03-04T12:44:50.455922+0000","last_active":"2024-03-04T12:56:55.982270+0000","last_peered":"2024-03-04T12:56:55.982270+0000","last_clean":"2024-03-04T12:56:55.982270+0000","last_became_active":"2024-03-04T12:44:50.455571+0000","last_became_peered":"2024-03-04T12:44:50.455571+0000","last_unstale":"2024-03-04T12:56:55.982270+0000","last_undegraded":"2024-03-04T12:56:55.982270+0000","last_fullsized":"2024-03-04T12:56:55.982270+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:00.096593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"256'47","reported_seq":142,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.983079+0000","last_change":"2024-03-04T12:43:27.060510+0000","last_active":"2024-03-04T12:57:30.983079+0000","last_peered":"2024-03-04T12:57:30.983079+0000","last_clean":"2024-03-04T12:57:30.983079+0000","last_became_active":"2024-03-04T12:43:27.060225+0000","last_became_peered":"2024-03-04T12:43:27.060225+0000","last_unstale":"2024-03-04T12:57:30.983079+0000","last_undegraded":"2024-03-04T12:57:30.983079+0000","last_fullsized":"2024-03-04T12:57:30.983079+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:54.961280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":112,"num_write":82,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.969881+0000","last_change":"2024-03-04T12:51:01.353480+0000","last_active":"2024-03-04T12:55:40.969881+0000","last_peered":"2024-03-04T12:55:40.969881+0000","last_clean":"2024-03-04T12:55:40.969881+0000","last_became_active":"2024-03-04T12:51:01.353087+0000","last_became_peered":"2024-03-04T12:51:01.353087+0000","last_unstale":"2024-03-04T12:55:40.969881+0000","last_undegraded":"2024-03-04T12:55:40.969881+0000","last_fullsized":"2024-03-04T12:55:40.969881+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:41.880369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.976551+0000","last_change":"2024-03-04T12:44:53.486342+0000","last_active":"2024-03-04T12:56:35.976551+0000","last_peered":"2024-03-04T12:56:35.976551+0000","last_clean":"2024-03-04T12:56:35.976551+0000","last_became_active":"2024-03-04T12:44:53.485819+0000","last_became_peered":"2024-03-04T12:44:53.485819+0000","last_unstale":"2024-03-04T12:56:35.976551+0000","last_undegraded":"2024-03-04T12:56:35.976551+0000","last_fullsized":"2024-03-04T12:56:35.976551+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:16.679448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"256'15","reported_seq":69,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.992528+0000","last_change":"2024-03-04T12:44:50.451881+0000","last_active":"2024-03-04T12:56:30.992528+0000","last_peered":"2024-03-04T12:56:30.992528+0000","last_clean":"2024-03-04T12:56:30.992528+0000","last_became_active":"2024-03-04T12:44:50.451612+0000","last_became_peered":"2024-03-04T12:44:50.451612+0000","last_unstale":"2024-03-04T12:56:30.992528+0000","last_undegraded":"2024-03-04T12:56:30.992528+0000","last_fullsized":"2024-03-04T12:56:30.992528+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:32.014515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":29700,"num_write":23,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"256'29","reported_seq":109,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.986253+0000","last_change":"2024-03-04T12:43:27.067821+0000","last_active":"2024-03-04T12:57:30.986253+0000","last_peered":"2024-03-04T12:57:30.986253+0000","last_clean":"2024-03-04T12:57:30.986253+0000","last_became_active":"2024-03-04T12:43:27.067356+0000","last_became_peered":"2024-03-04T12:43:27.067356+0000","last_unstale":"2024-03-04T12:57:30.986253+0000","last_undegraded":"2024-03-04T12:57:30.986253+0000","last_fullsized":"2024-03-04T12:57:30.986253+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:08.857494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":50,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.969928+0000","last_change":"2024-03-04T12:51:01.353135+0000","last_active":"2024-03-04T12:55:40.969928+0000","last_peered":"2024-03-04T12:55:40.969928+0000","last_clean":"2024-03-04T12:55:40.969928+0000","last_became_active":"2024-03-04T12:51:01.352205+0000","last_became_peered":"2024-03-04T12:51:01.352205+0000","last_unstale":"2024-03-04T12:55:40.969928+0000","last_undegraded":"2024-03-04T12:55:40.969928+0000","last_fullsized":"2024-03-04T12:55:40.969928+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:10:58.627530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"256'8","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:56.009808+0000","last_change":"2024-03-04T12:44:53.480313+0000","last_active":"2024-03-04T12:58:56.009808+0000","last_peered":"2024-03-04T12:58:56.009808+0000","last_clean":"2024-03-04T12:58:56.009808+0000","last_became_active":"2024-03-04T12:44:53.479906+0000","last_became_peered":"2024-03-04T12:44:53.479906+0000","last_unstale":"2024-03-04T12:58:56.009808+0000","last_undegraded":"2024-03-04T12:58:56.009808+0000","last_fullsized":"2024-03-04T12:58:56.009808+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:21.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":8765,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"256'2","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:50.892362+0000","last_change":"2024-03-04T12:44:50.455993+0000","last_active":"2024-03-04T12:58:50.892362+0000","last_peered":"2024-03-04T12:58:50.892362+0000","last_clean":"2024-03-04T12:58:50.892362+0000","last_became_active":"2024-03-04T12:44:50.455705+0000","last_became_peered":"2024-03-04T12:44:50.455705+0000","last_unstale":"2024-03-04T12:58:50.892362+0000","last_undegraded":"2024-03-04T12:58:50.892362+0000","last_fullsized":"2024-03-04T12:58:50.892362+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:28:07.679290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"256'37","reported_seq":129,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996807+0000","last_change":"2024-03-04T12:43:27.050258+0000","last_active":"2024-03-04T12:57:30.996807+0000","last_peered":"2024-03-04T12:57:30.996807+0000","last_clean":"2024-03-04T12:57:30.996807+0000","last_became_active":"2024-03-04T12:43:27.049948+0000","last_became_peered":"2024-03-04T12:43:27.049948+0000","last_unstale":"2024-03-04T12:57:30.996807+0000","last_undegraded":"2024-03-04T12:57:30.996807+0000","last_fullsized":"2024-03-04T12:57:30.996807+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:58:15.839313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":102,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.975555+0000","last_change":"2024-03-04T12:51:01.355931+0000","last_active":"2024-03-04T12:55:40.975555+0000","last_peered":"2024-03-04T12:55:40.975555+0000","last_clean":"2024-03-04T12:55:40.975555+0000","last_became_active":"2024-03-04T12:51:01.355460+0000","last_became_peered":"2024-03-04T12:51:01.355460+0000","last_unstale":"2024-03-04T12:55:40.975555+0000","last_undegraded":"2024-03-04T12:55:40.975555+0000","last_fullsized":"2024-03-04T12:55:40.975555+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:17:13.384167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.987291+0000","last_change":"2024-03-04T12:44:53.483084+0000","last_active":"2024-03-04T12:56:35.987291+0000","last_peered":"2024-03-04T12:56:35.987291+0000","last_clean":"2024-03-04T12:56:35.987291+0000","last_became_active":"2024-03-04T12:44:53.482573+0000","last_became_peered":"2024-03-04T12:44:53.482573+0000","last_unstale":"2024-03-04T12:56:35.987291+0000","last_undegraded":"2024-03-04T12:56:35.987291+0000","last_fullsized":"2024-03-04T12:56:35.987291+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:53.724969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":36,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.975976+0000","last_change":"2024-03-04T12:44:50.453266+0000","last_active":"2024-03-04T12:56:30.975976+0000","last_peered":"2024-03-04T12:56:30.975976+0000","last_clean":"2024-03-04T12:56:30.975976+0000","last_became_active":"2024-03-04T12:44:50.450815+0000","last_became_peered":"2024-03-04T12:44:50.450815+0000","last_unstale":"2024-03-04T12:56:30.975976+0000","last_undegraded":"2024-03-04T12:56:30.975976+0000","last_fullsized":"2024-03-04T12:56:30.975976+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:55.139788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"256'28","reported_seq":105,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996809+0000","last_change":"2024-03-04T12:43:27.056330+0000","last_active":"2024-03-04T12:57:30.996809+0000","last_peered":"2024-03-04T12:57:30.996809+0000","last_clean":"2024-03-04T12:57:30.996809+0000","last_became_active":"2024-03-04T12:43:27.055932+0000","last_became_peered":"2024-03-04T12:43:27.055932+0000","last_unstale":"2024-03-04T12:57:30.996809+0000","last_undegraded":"2024-03-04T12:57:30.996809+0000","last_fullsized":"2024-03-04T12:57:30.996809+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:37.799617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"253'1","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:40.970059+0000","last_change":"2024-03-04T12:51:01.356544+0000","last_active":"2024-03-04T12:55:40.970059+0000","last_peered":"2024-03-04T12:55:40.970059+0000","last_clean":"2024-03-04T12:55:40.970059+0000","last_became_active":"2024-03-04T12:51:01.356234+0000","last_became_peered":"2024-03-04T12:51:01.356234+0000","last_unstale":"2024-03-04T12:55:40.970059+0000","last_undegraded":"2024-03-04T12:55:40.970059+0000","last_fullsized":"2024-03-04T12:55:40.970059+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:48:48.586485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.982336+0000","last_change":"2024-03-04T12:44:53.481928+0000","last_active":"2024-03-04T12:56:35.982336+0000","last_peered":"2024-03-04T12:56:35.982336+0000","last_clean":"2024-03-04T12:56:35.982336+0000","last_became_active":"2024-03-04T12:44:53.481628+0000","last_became_peered":"2024-03-04T12:44:53.481628+0000","last_unstale":"2024-03-04T12:56:35.982336+0000","last_undegraded":"2024-03-04T12:56:35.982336+0000","last_fullsized":"2024-03-04T12:56:35.982336+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:17.939017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.986374+0000","last_change":"2024-03-04T12:44:50.457916+0000","last_active":"2024-03-04T12:56:30.986374+0000","last_peered":"2024-03-04T12:56:30.986374+0000","last_clean":"2024-03-04T12:56:30.986374+0000","last_became_active":"2024-03-04T12:44:50.457629+0000","last_became_peered":"2024-03-04T12:44:50.457629+0000","last_unstale":"2024-03-04T12:56:30.986374+0000","last_undegraded":"2024-03-04T12:56:30.986374+0000","last_fullsized":"2024-03-04T12:56:30.986374+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:34.728903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"256'46","reported_seq":148,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.983328+0000","last_change":"2024-03-04T12:43:27.061563+0000","last_active":"2024-03-04T12:57:30.983328+0000","last_peered":"2024-03-04T12:57:30.983328+0000","last_clean":"2024-03-04T12:57:30.983328+0000","last_became_active":"2024-03-04T12:43:27.061268+0000","last_became_peered":"2024-03-04T12:43:27.061268+0000","last_unstale":"2024-03-04T12:57:30.983328+0000","last_undegraded":"2024-03-04T12:57:30.983328+0000","last_fullsized":"2024-03-04T12:57:30.983328+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:22.110813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":125,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"254'1","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985556+0000","last_change":"2024-03-04T12:51:01.352006+0000","last_active":"2024-03-04T12:57:45.985556+0000","last_peered":"2024-03-04T12:57:45.985556+0000","last_clean":"2024-03-04T12:57:45.985556+0000","last_became_active":"2024-03-04T12:51:01.351718+0000","last_became_peered":"2024-03-04T12:51:01.351718+0000","last_unstale":"2024-03-04T12:57:45.985556+0000","last_undegraded":"2024-03-04T12:57:45.985556+0000","last_fullsized":"2024-03-04T12:57:45.985556+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:24:57.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"256'6","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.977187+0000","last_change":"2024-03-04T12:44:53.480592+0000","last_active":"2024-03-04T12:56:10.977187+0000","last_peered":"2024-03-04T12:56:10.977187+0000","last_clean":"2024-03-04T12:56:10.977187+0000","last_became_active":"2024-03-04T12:44:53.480237+0000","last_became_peered":"2024-03-04T12:44:53.480237+0000","last_unstale":"2024-03-04T12:56:10.977187+0000","last_undegraded":"2024-03-04T12:56:10.977187+0000","last_fullsized":"2024-03-04T12:56:10.977187+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:42.531307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"256'3","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.982286+0000","last_change":"2024-03-04T12:44:50.451651+0000","last_active":"2024-03-04T12:56:05.982286+0000","last_peered":"2024-03-04T12:56:05.982286+0000","last_clean":"2024-03-04T12:56:05.982286+0000","last_became_active":"2024-03-04T12:44:50.451353+0000","last_became_peered":"2024-03-04T12:44:50.451353+0000","last_unstale":"2024-03-04T12:56:05.982286+0000","last_undegraded":"2024-03-04T12:56:05.982286+0000","last_fullsized":"2024-03-04T12:56:05.982286+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:38.552540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"256'22","reported_seq":88,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991999+0000","last_change":"2024-03-04T12:43:27.060928+0000","last_active":"2024-03-04T12:57:00.991999+0000","last_peered":"2024-03-04T12:57:00.991999+0000","last_clean":"2024-03-04T12:57:00.991999+0000","last_became_active":"2024-03-04T12:43:27.060626+0000","last_became_peered":"2024-03-04T12:43:27.060626+0000","last_unstale":"2024-03-04T12:57:00.991999+0000","last_undegraded":"2024-03-04T12:57:00.991999+0000","last_fullsized":"2024-03-04T12:57:00.991999+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:18.681323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":39,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985610+0000","last_change":"2024-03-04T12:51:01.356830+0000","last_active":"2024-03-04T12:57:45.985610+0000","last_peered":"2024-03-04T12:57:45.985610+0000","last_clean":"2024-03-04T12:57:45.985610+0000","last_became_active":"2024-03-04T12:51:01.356268+0000","last_became_peered":"2024-03-04T12:51:01.356268+0000","last_unstale":"2024-03-04T12:57:45.985610+0000","last_undegraded":"2024-03-04T12:57:45.985610+0000","last_fullsized":"2024-03-04T12:57:45.985610+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:55:16.934337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:25.889144+0000","last_change":"2024-03-04T12:44:53.489009+0000","last_active":"2024-03-04T12:58:25.889144+0000","last_peered":"2024-03-04T12:58:25.889144+0000","last_clean":"2024-03-04T12:58:25.889144+0000","last_became_active":"2024-03-04T12:44:53.488798+0000","last_became_peered":"2024-03-04T12:44:53.488798+0000","last_unstale":"2024-03-04T12:58:25.889144+0000","last_undegraded":"2024-03-04T12:58:25.889144+0000","last_fullsized":"2024-03-04T12:58:25.889144+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:57.438592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'7","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.973217+0000","last_change":"2024-03-04T12:44:50.449837+0000","last_active":"2024-03-04T12:56:05.973217+0000","last_peered":"2024-03-04T12:56:05.973217+0000","last_clean":"2024-03-04T12:56:05.973217+0000","last_became_active":"2024-03-04T12:44:50.449555+0000","last_became_peered":"2024-03-04T12:44:50.449555+0000","last_unstale":"2024-03-04T12:56:05.973217+0000","last_undegraded":"2024-03-04T12:56:05.973217+0000","last_fullsized":"2024-03-04T12:56:05.973217+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:28:29.864964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":9220,"num_write":12,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"256'38","reported_seq":131,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.628221+0000","last_change":"2024-03-04T12:43:27.062921+0000","last_active":"2024-03-04T12:58:30.628221+0000","last_peered":"2024-03-04T12:58:30.628221+0000","last_clean":"2024-03-04T12:58:30.628221+0000","last_became_active":"2024-03-04T12:43:27.062618+0000","last_became_peered":"2024-03-04T12:43:27.062618+0000","last_unstale":"2024-03-04T12:58:30.628221+0000","last_undegraded":"2024-03-04T12:58:30.628221+0000","last_fullsized":"2024-03-04T12:58:30.628221+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:15.108779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":110,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985636+0000","last_change":"2024-03-04T12:51:01.358213+0000","last_active":"2024-03-04T12:57:45.985636+0000","last_peered":"2024-03-04T12:57:45.985636+0000","last_clean":"2024-03-04T12:57:45.985636+0000","last_became_active":"2024-03-04T12:51:01.357842+0000","last_became_peered":"2024-03-04T12:51:01.357842+0000","last_unstale":"2024-03-04T12:57:45.985636+0000","last_undegraded":"2024-03-04T12:57:45.985636+0000","last_fullsized":"2024-03-04T12:57:45.985636+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:49:05.564345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"256'1","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.973737+0000","last_change":"2024-03-04T12:44:53.483502+0000","last_active":"2024-03-04T12:56:10.973737+0000","last_peered":"2024-03-04T12:56:10.973737+0000","last_clean":"2024-03-04T12:56:10.973737+0000","last_became_active":"2024-03-04T12:44:53.483209+0000","last_became_peered":"2024-03-04T12:44:53.483209+0000","last_unstale":"2024-03-04T12:56:10.973737+0000","last_undegraded":"2024-03-04T12:56:10.973737+0000","last_fullsized":"2024-03-04T12:56:10.973737+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:30.529782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"256'4","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.976647+0000","last_change":"2024-03-04T12:44:50.458501+0000","last_active":"2024-03-04T12:56:05.976647+0000","last_peered":"2024-03-04T12:56:05.976647+0000","last_clean":"2024-03-04T12:56:05.976647+0000","last_became_active":"2024-03-04T12:44:50.458158+0000","last_became_peered":"2024-03-04T12:44:50.458158+0000","last_unstale":"2024-03-04T12:56:05.976647+0000","last_undegraded":"2024-03-04T12:56:05.976647+0000","last_fullsized":"2024-03-04T12:56:05.976647+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:23.431721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"256'48","reported_seq":150,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991998+0000","last_change":"2024-03-04T12:43:27.058847+0000","last_active":"2024-03-04T12:57:00.991998+0000","last_peered":"2024-03-04T12:57:00.991998+0000","last_clean":"2024-03-04T12:57:00.991998+0000","last_became_active":"2024-03-04T12:43:27.058410+0000","last_became_peered":"2024-03-04T12:43:27.058410+0000","last_unstale":"2024-03-04T12:57:00.991998+0000","last_undegraded":"2024-03-04T12:57:00.991998+0000","last_fullsized":"2024-03-04T12:57:00.991998+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:41.466619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":132,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985014+0000","last_change":"2024-03-04T12:51:01.597461+0000","last_active":"2024-03-04T12:57:45.985014+0000","last_peered":"2024-03-04T12:57:45.985014+0000","last_clean":"2024-03-04T12:57:45.985014+0000","last_became_active":"2024-03-04T12:51:01.597162+0000","last_became_peered":"2024-03-04T12:51:01.597162+0000","last_unstale":"2024-03-04T12:57:45.985014+0000","last_undegraded":"2024-03-04T12:57:45.985014+0000","last_fullsized":"2024-03-04T12:57:45.985014+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:42:36.597535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.989977+0000","last_change":"2024-03-04T12:44:53.478668+0000","last_active":"2024-03-04T12:56:10.989977+0000","last_peered":"2024-03-04T12:56:10.989977+0000","last_clean":"2024-03-04T12:56:10.989977+0000","last_became_active":"2024-03-04T12:44:53.478352+0000","last_became_peered":"2024-03-04T12:44:53.478352+0000","last_unstale":"2024-03-04T12:56:10.989977+0000","last_undegraded":"2024-03-04T12:56:10.989977+0000","last_fullsized":"2024-03-04T12:56:10.989977+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:59:40.881954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"256'1","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.978806+0000","last_change":"2024-03-04T12:44:50.449921+0000","last_active":"2024-03-04T12:56:05.978806+0000","last_peered":"2024-03-04T12:56:05.978806+0000","last_clean":"2024-03-04T12:56:05.978806+0000","last_became_active":"2024-03-04T12:44:50.449627+0000","last_became_peered":"2024-03-04T12:44:50.449627+0000","last_unstale":"2024-03-04T12:56:05.978806+0000","last_undegraded":"2024-03-04T12:56:05.978806+0000","last_fullsized":"2024-03-04T12:56:05.978806+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:14:46.561998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"244'9","reported_seq":65,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991914+0000","last_change":"2024-03-04T12:43:27.057430+0000","last_active":"2024-03-04T12:57:00.991914+0000","last_peered":"2024-03-04T12:57:00.991914+0000","last_clean":"2024-03-04T12:57:00.991914+0000","last_became_active":"2024-03-04T12:43:27.057074+0000","last_became_peered":"2024-03-04T12:43:27.057074+0000","last_unstale":"2024-03-04T12:57:00.991914+0000","last_undegraded":"2024-03-04T12:57:00.991914+0000","last_fullsized":"2024-03-04T12:57:00.991914+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:45.722473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.881147+0000","last_change":"2024-03-04T12:51:01.595664+0000","last_active":"2024-03-04T12:57:30.881147+0000","last_peered":"2024-03-04T12:57:30.881147+0000","last_clean":"2024-03-04T12:57:30.881147+0000","last_became_active":"2024-03-04T12:51:01.595390+0000","last_became_peered":"2024-03-04T12:51:01.595390+0000","last_unstale":"2024-03-04T12:57:30.881147+0000","last_undegraded":"2024-03-04T12:57:30.881147+0000","last_fullsized":"2024-03-04T12:57:30.881147+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:23.043787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"256'6","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.986440+0000","last_change":"2024-03-04T12:44:53.484184+0000","last_active":"2024-03-04T12:57:55.986440+0000","last_peered":"2024-03-04T12:57:55.986440+0000","last_clean":"2024-03-04T12:57:55.986440+0000","last_became_active":"2024-03-04T12:44:53.482800+0000","last_became_peered":"2024-03-04T12:44:53.482800+0000","last_unstale":"2024-03-04T12:57:55.986440+0000","last_undegraded":"2024-03-04T12:57:55.986440+0000","last_fullsized":"2024-03-04T12:57:55.986440+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:58.026882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'6","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.884861+0000","last_change":"2024-03-04T12:44:50.456248+0000","last_active":"2024-03-04T12:57:55.884861+0000","last_peered":"2024-03-04T12:57:55.884861+0000","last_clean":"2024-03-04T12:57:55.884861+0000","last_became_active":"2024-03-04T12:44:50.455937+0000","last_became_peered":"2024-03-04T12:44:50.455937+0000","last_unstale":"2024-03-04T12:57:55.884861+0000","last_undegraded":"2024-03-04T12:57:55.884861+0000","last_fullsized":"2024-03-04T12:57:55.884861+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:23.581048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":5,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"256'148","reported_seq":390,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:44.913079+0000","last_change":"2024-03-04T12:43:27.065338+0000","last_active":"2024-03-04T12:57:44.913079+0000","last_peered":"2024-03-04T12:57:44.913079+0000","last_clean":"2024-03-04T12:57:44.913079+0000","last_became_active":"2024-03-04T12:43:27.065085+0000","last_became_peered":"2024-03-04T12:43:27.065085+0000","last_unstale":"2024-03-04T12:57:44.913079+0000","last_undegraded":"2024-03-04T12:57:44.913079+0000","last_fullsized":"2024-03-04T12:57:44.913079+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:46.662116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":610,"num_read_kb":432,"num_write":236,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996782+0000","last_change":"2024-03-04T12:51:01.353357+0000","last_active":"2024-03-04T12:57:30.996782+0000","last_peered":"2024-03-04T12:57:30.996782+0000","last_clean":"2024-03-04T12:57:30.996782+0000","last_became_active":"2024-03-04T12:51:01.353012+0000","last_became_peered":"2024-03-04T12:51:01.353012+0000","last_unstale":"2024-03-04T12:57:30.996782+0000","last_undegraded":"2024-03-04T12:57:30.996782+0000","last_fullsized":"2024-03-04T12:57:30.996782+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:49:18.123279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"256'5","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.003246+0000","last_change":"2024-03-04T12:44:53.484778+0000","last_active":"2024-03-04T12:57:56.003246+0000","last_peered":"2024-03-04T12:57:56.003246+0000","last_clean":"2024-03-04T12:57:56.003246+0000","last_became_active":"2024-03-04T12:44:53.484514+0000","last_became_peered":"2024-03-04T12:44:53.484514+0000","last_unstale":"2024-03-04T12:57:56.003246+0000","last_undegraded":"2024-03-04T12:57:56.003246+0000","last_fullsized":"2024-03-04T12:57:56.003246+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:17.495701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":4138,"num_write":4,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"256'3","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:05.989386+0000","last_change":"2024-03-04T12:44:50.450378+0000","last_active":"2024-03-04T12:56:05.989386+0000","last_peered":"2024-03-04T12:56:05.989386+0000","last_clean":"2024-03-04T12:56:05.989386+0000","last_became_active":"2024-03-04T12:44:50.450101+0000","last_became_peered":"2024-03-04T12:44:50.450101+0000","last_unstale":"2024-03-04T12:56:05.989386+0000","last_undegraded":"2024-03-04T12:56:05.989386+0000","last_fullsized":"2024-03-04T12:56:05.989386+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:55:05.158919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"256'27","reported_seq":98,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.979590+0000","last_change":"2024-03-04T12:43:27.068000+0000","last_active":"2024-03-04T12:56:30.979590+0000","last_peered":"2024-03-04T12:56:30.979590+0000","last_clean":"2024-03-04T12:56:30.979590+0000","last_became_active":"2024-03-04T12:43:27.067391+0000","last_became_peered":"2024-03-04T12:43:27.067391+0000","last_unstale":"2024-03-04T12:56:30.979590+0000","last_undegraded":"2024-03-04T12:56:30.979590+0000","last_fullsized":"2024-03-04T12:56:30.979590+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:51:04.022422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:35.881989+0000","last_change":"2024-03-04T12:51:01.352487+0000","last_active":"2024-03-04T12:57:35.881989+0000","last_peered":"2024-03-04T12:57:35.881989+0000","last_clean":"2024-03-04T12:57:35.881989+0000","last_became_active":"2024-03-04T12:51:01.352191+0000","last_became_peered":"2024-03-04T12:51:01.352191+0000","last_unstale":"2024-03-04T12:57:35.881989+0000","last_undegraded":"2024-03-04T12:57:35.881989+0000","last_fullsized":"2024-03-04T12:57:35.881989+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:22.391789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"256'1","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.983144+0000","last_change":"2024-03-04T12:44:53.482531+0000","last_active":"2024-03-04T12:56:10.983144+0000","last_peered":"2024-03-04T12:56:10.983144+0000","last_clean":"2024-03-04T12:56:10.983144+0000","last_became_active":"2024-03-04T12:44:53.482253+0000","last_became_peered":"2024-03-04T12:44:53.482253+0000","last_unstale":"2024-03-04T12:56:10.983144+0000","last_undegraded":"2024-03-04T12:56:10.983144+0000","last_fullsized":"2024-03-04T12:56:10.983144+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:55:37.720046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.992327+0000","last_change":"2024-03-04T12:44:50.449345+0000","last_active":"2024-03-04T12:57:50.992327+0000","last_peered":"2024-03-04T12:57:50.992327+0000","last_clean":"2024-03-04T12:57:50.992327+0000","last_became_active":"2024-03-04T12:44:50.449070+0000","last_became_peered":"2024-03-04T12:44:50.449070+0000","last_unstale":"2024-03-04T12:57:50.992327+0000","last_undegraded":"2024-03-04T12:57:50.992327+0000","last_fullsized":"2024-03-04T12:57:50.992327+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:55.637780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"256'13","reported_seq":71,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:31.228261+0000","last_change":"2024-03-04T12:43:27.061968+0000","last_active":"2024-03-04T12:56:31.228261+0000","last_peered":"2024-03-04T12:56:31.228261+0000","last_clean":"2024-03-04T12:56:31.228261+0000","last_became_active":"2024-03-04T12:43:27.061574+0000","last_became_peered":"2024-03-04T12:43:27.061574+0000","last_unstale":"2024-03-04T12:56:31.228261+0000","last_undegraded":"2024-03-04T12:56:31.228261+0000","last_fullsized":"2024-03-04T12:56:31.228261+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:18:07.868716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.984940+0000","last_change":"2024-03-04T12:51:01.356675+0000","last_active":"2024-03-04T12:57:45.984940+0000","last_peered":"2024-03-04T12:57:45.984940+0000","last_clean":"2024-03-04T12:57:45.984940+0000","last_became_active":"2024-03-04T12:51:01.356286+0000","last_became_peered":"2024-03-04T12:51:01.356286+0000","last_unstale":"2024-03-04T12:57:45.984940+0000","last_undegraded":"2024-03-04T12:57:45.984940+0000","last_fullsized":"2024-03-04T12:57:45.984940+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:02:42.855512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"256'5","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.018577+0000","last_change":"2024-03-04T12:44:53.478083+0000","last_active":"2024-03-04T13:00:06.018577+0000","last_peered":"2024-03-04T13:00:06.018577+0000","last_clean":"2024-03-04T13:00:06.018577+0000","last_became_active":"2024-03-04T12:44:53.477801+0000","last_became_peered":"2024-03-04T12:44:53.477801+0000","last_unstale":"2024-03-04T13:00:06.018577+0000","last_undegraded":"2024-03-04T13:00:06.018577+0000","last_fullsized":"2024-03-04T13:00:06.018577+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:23.298015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"256'3","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.001397+0000","last_change":"2024-03-04T12:44:50.456287+0000","last_active":"2024-03-04T13:00:01.001397+0000","last_peered":"2024-03-04T13:00:01.001397+0000","last_clean":"2024-03-04T13:00:01.001397+0000","last_became_active":"2024-03-04T12:44:50.456005+0000","last_became_peered":"2024-03-04T12:44:50.456005+0000","last_unstale":"2024-03-04T13:00:01.001397+0000","last_undegraded":"2024-03-04T13:00:01.001397+0000","last_fullsized":"2024-03-04T13:00:01.001397+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:59:09.950535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"256'19","reported_seq":84,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.981609+0000","last_change":"2024-03-04T12:43:27.055261+0000","last_active":"2024-03-04T12:56:30.981609+0000","last_peered":"2024-03-04T12:56:30.981609+0000","last_clean":"2024-03-04T12:56:30.981609+0000","last_became_active":"2024-03-04T12:43:27.054951+0000","last_became_peered":"2024-03-04T12:43:27.054951+0000","last_unstale":"2024-03-04T12:56:30.981609+0000","last_undegraded":"2024-03-04T12:56:30.981609+0000","last_fullsized":"2024-03-04T12:56:30.981609+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:25:39.570283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":48,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998179+0000","last_change":"2024-03-04T12:51:01.596612+0000","last_active":"2024-03-04T12:57:15.998179+0000","last_peered":"2024-03-04T12:57:15.998179+0000","last_clean":"2024-03-04T12:57:15.998179+0000","last_became_active":"2024-03-04T12:51:01.596248+0000","last_became_peered":"2024-03-04T12:51:01.596248+0000","last_unstale":"2024-03-04T12:57:15.998179+0000","last_undegraded":"2024-03-04T12:57:15.998179+0000","last_fullsized":"2024-03-04T12:57:15.998179+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:41:22.243454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.985709+0000","last_change":"2024-03-04T12:44:53.481249+0000","last_active":"2024-03-04T12:57:25.985709+0000","last_peered":"2024-03-04T12:57:25.985709+0000","last_clean":"2024-03-04T12:57:25.985709+0000","last_became_active":"2024-03-04T12:44:53.480987+0000","last_became_peered":"2024-03-04T12:44:53.480987+0000","last_unstale":"2024-03-04T12:57:25.985709+0000","last_undegraded":"2024-03-04T12:57:25.985709+0000","last_fullsized":"2024-03-04T12:57:25.985709+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:51:53.423493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"256'4","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.425589+0000","last_change":"2024-03-04T12:44:50.456748+0000","last_active":"2024-03-04T13:00:15.425589+0000","last_peered":"2024-03-04T13:00:15.425589+0000","last_clean":"2024-03-04T13:00:15.425589+0000","last_became_active":"2024-03-04T12:44:50.455944+0000","last_became_peered":"2024-03-04T12:44:50.455944+0000","last_unstale":"2024-03-04T13:00:15.425589+0000","last_undegraded":"2024-03-04T13:00:15.425589+0000","last_fullsized":"2024-03-04T13:00:15.425589+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:14:51.600085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"256'15","reported_seq":78,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.979646+0000","last_change":"2024-03-04T12:43:27.060487+0000","last_active":"2024-03-04T12:56:30.979646+0000","last_peered":"2024-03-04T12:56:30.979646+0000","last_clean":"2024-03-04T12:56:30.979646+0000","last_became_active":"2024-03-04T12:43:27.060180+0000","last_became_peered":"2024-03-04T12:43:27.060180+0000","last_unstale":"2024-03-04T12:56:30.979646+0000","last_undegraded":"2024-03-04T12:56:30.979646+0000","last_fullsized":"2024-03-04T12:56:30.979646+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:19.510448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998192+0000","last_change":"2024-03-04T12:51:01.350629+0000","last_active":"2024-03-04T12:57:15.998192+0000","last_peered":"2024-03-04T12:57:15.998192+0000","last_clean":"2024-03-04T12:57:15.998192+0000","last_became_active":"2024-03-04T12:51:01.350349+0000","last_became_peered":"2024-03-04T12:51:01.350349+0000","last_unstale":"2024-03-04T12:57:15.998192+0000","last_undegraded":"2024-03-04T12:57:15.998192+0000","last_fullsized":"2024-03-04T12:57:15.998192+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:57.667851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"256'5","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.880408+0000","last_change":"2024-03-04T12:44:53.485721+0000","last_active":"2024-03-04T12:57:25.880408+0000","last_peered":"2024-03-04T12:57:25.880408+0000","last_clean":"2024-03-04T12:57:25.880408+0000","last_became_active":"2024-03-04T12:44:53.485429+0000","last_became_peered":"2024-03-04T12:44:53.485429+0000","last_unstale":"2024-03-04T12:57:25.880408+0000","last_undegraded":"2024-03-04T12:57:25.880408+0000","last_fullsized":"2024-03-04T12:57:25.880408+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:41:33.023905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":5,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"250'5","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:51.002839+0000","last_change":"2024-03-04T12:44:50.452899+0000","last_active":"2024-03-04T12:57:51.002839+0000","last_peered":"2024-03-04T12:57:51.002839+0000","last_clean":"2024-03-04T12:57:51.002839+0000","last_became_active":"2024-03-04T12:44:50.452611+0000","last_became_peered":"2024-03-04T12:44:50.452611+0000","last_unstale":"2024-03-04T12:57:51.002839+0000","last_undegraded":"2024-03-04T12:57:51.002839+0000","last_fullsized":"2024-03-04T12:57:51.002839+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:51.414927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"256'20","reported_seq":91,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:13.481796+0000","last_change":"2024-03-04T12:43:27.064585+0000","last_active":"2024-03-04T12:58:13.481796+0000","last_peered":"2024-03-04T12:58:13.481796+0000","last_clean":"2024-03-04T12:58:13.481796+0000","last_became_active":"2024-03-04T12:43:27.064375+0000","last_became_peered":"2024-03-04T12:43:27.064375+0000","last_unstale":"2024-03-04T12:58:13.481796+0000","last_undegraded":"2024-03-04T12:58:13.481796+0000","last_fullsized":"2024-03-04T12:58:13.481796+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:39:12.810173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":61,"num_write":47,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"252'1","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996931+0000","last_change":"2024-03-04T12:51:01.350196+0000","last_active":"2024-03-04T12:57:30.996931+0000","last_peered":"2024-03-04T12:57:30.996931+0000","last_clean":"2024-03-04T12:57:30.996931+0000","last_became_active":"2024-03-04T12:51:01.349889+0000","last_became_peered":"2024-03-04T12:51:01.349889+0000","last_unstale":"2024-03-04T12:57:30.996931+0000","last_undegraded":"2024-03-04T12:57:30.996931+0000","last_fullsized":"2024-03-04T12:57:30.996931+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:26:14.298363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"256'1","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.884969+0000","last_change":"2024-03-04T12:44:53.489468+0000","last_active":"2024-03-04T12:57:55.884969+0000","last_peered":"2024-03-04T12:57:55.884969+0000","last_clean":"2024-03-04T12:57:55.884969+0000","last_became_active":"2024-03-04T12:44:53.489232+0000","last_became_peered":"2024-03-04T12:44:53.489232+0000","last_unstale":"2024-03-04T12:57:55.884969+0000","last_undegraded":"2024-03-04T12:57:55.884969+0000","last_fullsized":"2024-03-04T12:57:55.884969+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:26:44.977704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.981541+0000","last_change":"2024-03-04T12:44:50.459626+0000","last_active":"2024-03-04T12:57:20.981541+0000","last_peered":"2024-03-04T12:57:20.981541+0000","last_clean":"2024-03-04T12:57:20.981541+0000","last_became_active":"2024-03-04T12:44:50.459359+0000","last_became_peered":"2024-03-04T12:44:50.459359+0000","last_unstale":"2024-03-04T12:57:20.981541+0000","last_undegraded":"2024-03-04T12:57:20.981541+0000","last_fullsized":"2024-03-04T12:57:20.981541+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:42.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"256'25","reported_seq":106,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:06.002606+0000","last_change":"2024-03-04T12:43:27.060629+0000","last_active":"2024-03-04T12:58:06.002606+0000","last_peered":"2024-03-04T12:58:06.002606+0000","last_clean":"2024-03-04T12:58:06.002606+0000","last_became_active":"2024-03-04T12:43:27.060115+0000","last_became_peered":"2024-03-04T12:43:27.060115+0000","last_unstale":"2024-03-04T12:58:06.002606+0000","last_undegraded":"2024-03-04T12:58:06.002606+0000","last_fullsized":"2024-03-04T12:58:06.002606+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:15:16.480822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.881250+0000","last_change":"2024-03-04T12:51:01.596756+0000","last_active":"2024-03-04T12:57:30.881250+0000","last_peered":"2024-03-04T12:57:30.881250+0000","last_clean":"2024-03-04T12:57:30.881250+0000","last_became_active":"2024-03-04T12:51:01.596463+0000","last_became_peered":"2024-03-04T12:51:01.596463+0000","last_unstale":"2024-03-04T12:57:30.881250+0000","last_undegraded":"2024-03-04T12:57:30.881250+0000","last_fullsized":"2024-03-04T12:57:30.881250+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:47:44.675447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"256'5","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.001127+0000","last_change":"2024-03-04T12:44:53.479417+0000","last_active":"2024-03-04T12:57:56.001127+0000","last_peered":"2024-03-04T12:57:56.001127+0000","last_clean":"2024-03-04T12:57:56.001127+0000","last_became_active":"2024-03-04T12:44:53.479076+0000","last_became_peered":"2024-03-04T12:44:53.479076+0000","last_unstale":"2024-03-04T12:57:56.001127+0000","last_undegraded":"2024-03-04T12:57:56.001127+0000","last_fullsized":"2024-03-04T12:57:56.001127+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:57.384073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":15,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"256'1","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.880441+0000","last_change":"2024-03-04T12:44:50.454670+0000","last_active":"2024-03-04T12:57:25.880441+0000","last_peered":"2024-03-04T12:57:25.880441+0000","last_clean":"2024-03-04T12:57:25.880441+0000","last_became_active":"2024-03-04T12:44:50.454398+0000","last_became_peered":"2024-03-04T12:44:50.454398+0000","last_unstale":"2024-03-04T12:57:25.880441+0000","last_undegraded":"2024-03-04T12:57:25.880441+0000","last_fullsized":"2024-03-04T12:57:25.880441+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:24:18.356924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"256'33","reported_seq":117,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.886555+0000","last_change":"2024-03-04T12:43:27.060915+0000","last_active":"2024-03-04T12:58:05.886555+0000","last_peered":"2024-03-04T12:58:05.886555+0000","last_clean":"2024-03-04T12:58:05.886555+0000","last_became_active":"2024-03-04T12:43:27.060589+0000","last_became_peered":"2024-03-04T12:43:27.060589+0000","last_unstale":"2024-03-04T12:58:05.886555+0000","last_undegraded":"2024-03-04T12:58:05.886555+0000","last_fullsized":"2024-03-04T12:58:05.886555+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:52:13.475390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":90,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991815+0000","last_change":"2024-03-04T12:51:01.357439+0000","last_active":"2024-03-04T12:57:00.991815+0000","last_peered":"2024-03-04T12:57:00.991815+0000","last_clean":"2024-03-04T12:57:00.991815+0000","last_became_active":"2024-03-04T12:51:01.355416+0000","last_became_peered":"2024-03-04T12:51:01.355416+0000","last_unstale":"2024-03-04T12:57:00.991815+0000","last_undegraded":"2024-03-04T12:57:00.991815+0000","last_fullsized":"2024-03-04T12:57:00.991815+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:22:00.087119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"256'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.898812+0000","last_change":"2024-03-04T12:44:53.486527+0000","last_active":"2024-03-04T12:59:30.898812+0000","last_peered":"2024-03-04T12:59:30.898812+0000","last_clean":"2024-03-04T12:59:30.898812+0000","last_became_active":"2024-03-04T12:44:53.486235+0000","last_became_peered":"2024-03-04T12:44:53.486235+0000","last_unstale":"2024-03-04T12:59:30.898812+0000","last_undegraded":"2024-03-04T12:59:30.898812+0000","last_fullsized":"2024-03-04T12:59:30.898812+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:38:59.682681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"256'6","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:26.015244+0000","last_change":"2024-03-04T12:44:50.458855+0000","last_active":"2024-03-04T12:59:26.015244+0000","last_peered":"2024-03-04T12:59:26.015244+0000","last_clean":"2024-03-04T12:59:26.015244+0000","last_became_active":"2024-03-04T12:44:50.458610+0000","last_became_peered":"2024-03-04T12:44:50.458610+0000","last_unstale":"2024-03-04T12:59:26.015244+0000","last_undegraded":"2024-03-04T12:59:26.015244+0000","last_fullsized":"2024-03-04T12:59:26.015244+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:02:54.023215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":7739,"num_write":11,"num_write_kb":7739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"256'17","reported_seq":79,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.988149+0000","last_change":"2024-03-04T12:43:27.067610+0000","last_active":"2024-03-04T12:58:05.988149+0000","last_peered":"2024-03-04T12:58:05.988149+0000","last_clean":"2024-03-04T12:58:05.988149+0000","last_became_active":"2024-03-04T12:43:27.067223+0000","last_became_peered":"2024-03-04T12:43:27.067223+0000","last_unstale":"2024-03-04T12:58:05.988149+0000","last_undegraded":"2024-03-04T12:58:05.988149+0000","last_fullsized":"2024-03-04T12:58:05.988149+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:38:30.372407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":41,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.980872+0000","last_change":"2024-03-04T12:51:01.353788+0000","last_active":"2024-03-04T12:57:15.980872+0000","last_peered":"2024-03-04T12:57:15.980872+0000","last_clean":"2024-03-04T12:57:15.980872+0000","last_became_active":"2024-03-04T12:51:01.353432+0000","last_became_peered":"2024-03-04T12:51:01.353432+0000","last_unstale":"2024-03-04T12:57:15.980872+0000","last_undegraded":"2024-03-04T12:57:15.980872+0000","last_fullsized":"2024-03-04T12:57:15.980872+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:01:52.475724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"250'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.876625+0000","last_change":"2024-03-04T12:44:53.482645+0000","last_active":"2024-03-04T12:57:00.876625+0000","last_peered":"2024-03-04T12:57:00.876625+0000","last_clean":"2024-03-04T12:57:00.876625+0000","last_became_active":"2024-03-04T12:44:53.482370+0000","last_became_peered":"2024-03-04T12:44:53.482370+0000","last_unstale":"2024-03-04T12:57:00.876625+0000","last_undegraded":"2024-03-04T12:57:00.876625+0000","last_fullsized":"2024-03-04T12:57:00.876625+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:19:00.147319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"256'3","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.995188+0000","last_change":"2024-03-04T12:44:50.451000+0000","last_active":"2024-03-04T12:57:20.995188+0000","last_peered":"2024-03-04T12:57:20.995188+0000","last_clean":"2024-03-04T12:57:20.995188+0000","last_became_active":"2024-03-04T12:44:50.450681+0000","last_became_peered":"2024-03-04T12:44:50.450681+0000","last_unstale":"2024-03-04T12:57:20.995188+0000","last_undegraded":"2024-03-04T12:57:20.995188+0000","last_fullsized":"2024-03-04T12:57:20.995188+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:33:37.753695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":368,"num_write":3,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"256'61","reported_seq":196,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.994297+0000","last_change":"2024-03-04T12:43:27.057075+0000","last_active":"2024-03-04T12:58:05.994297+0000","last_peered":"2024-03-04T12:58:05.994297+0000","last_clean":"2024-03-04T12:58:05.994297+0000","last_became_active":"2024-03-04T12:43:27.056781+0000","last_became_peered":"2024-03-04T12:43:27.056781+0000","last_unstale":"2024-03-04T12:58:05.994297+0000","last_undegraded":"2024-03-04T12:58:05.994297+0000","last_fullsized":"2024-03-04T12:58:05.994297+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:46:26.120127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":203,"num_write":94,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.994328+0000","last_change":"2024-03-04T12:51:01.349501+0000","last_active":"2024-03-04T12:57:15.994328+0000","last_peered":"2024-03-04T12:57:15.994328+0000","last_clean":"2024-03-04T12:57:15.994328+0000","last_became_active":"2024-03-04T12:51:01.349216+0000","last_became_peered":"2024-03-04T12:51:01.349216+0000","last_unstale":"2024-03-04T12:57:15.994328+0000","last_undegraded":"2024-03-04T12:57:15.994328+0000","last_fullsized":"2024-03-04T12:57:15.994328+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:06.080102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.989012+0000","last_change":"2024-03-04T12:44:53.479666+0000","last_active":"2024-03-04T12:57:25.989012+0000","last_peered":"2024-03-04T12:57:25.989012+0000","last_clean":"2024-03-04T12:57:25.989012+0000","last_became_active":"2024-03-04T12:44:53.479411+0000","last_became_peered":"2024-03-04T12:44:53.479411+0000","last_unstale":"2024-03-04T12:57:25.989012+0000","last_undegraded":"2024-03-04T12:57:25.989012+0000","last_fullsized":"2024-03-04T12:57:25.989012+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:44.241135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'5","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:55.893128+0000","last_change":"2024-03-04T12:44:50.451910+0000","last_active":"2024-03-04T12:58:55.893128+0000","last_peered":"2024-03-04T12:58:55.893128+0000","last_clean":"2024-03-04T12:58:55.893128+0000","last_became_active":"2024-03-04T12:44:50.451626+0000","last_became_peered":"2024-03-04T12:44:50.451626+0000","last_unstale":"2024-03-04T12:58:55.893128+0000","last_undegraded":"2024-03-04T12:58:55.893128+0000","last_fullsized":"2024-03-04T12:58:55.893128+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:38.879751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"256'127","reported_seq":405,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:06.002489+0000","last_change":"2024-03-04T12:43:27.056721+0000","last_active":"2024-03-04T12:58:06.002489+0000","last_peered":"2024-03-04T12:58:06.002489+0000","last_clean":"2024-03-04T12:58:06.002489+0000","last_became_active":"2024-03-04T12:43:27.056007+0000","last_became_peered":"2024-03-04T12:43:27.056007+0000","last_unstale":"2024-03-04T12:58:06.002489+0000","last_undegraded":"2024-03-04T12:58:06.002489+0000","last_fullsized":"2024-03-04T12:58:06.002489+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:47.106941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":540,"num_write":158,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.987839+0000","last_change":"2024-03-04T12:51:01.354894+0000","last_active":"2024-03-04T12:57:15.987839+0000","last_peered":"2024-03-04T12:57:15.987839+0000","last_clean":"2024-03-04T12:57:15.987839+0000","last_became_active":"2024-03-04T12:51:01.354601+0000","last_became_peered":"2024-03-04T12:51:01.354601+0000","last_unstale":"2024-03-04T12:57:15.987839+0000","last_undegraded":"2024-03-04T12:57:15.987839+0000","last_fullsized":"2024-03-04T12:57:15.987839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:00:49.358407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.982297+0000","last_change":"2024-03-04T12:44:53.486591+0000","last_active":"2024-03-04T12:57:25.982297+0000","last_peered":"2024-03-04T12:57:25.982297+0000","last_clean":"2024-03-04T12:57:25.982297+0000","last_became_active":"2024-03-04T12:44:53.486321+0000","last_became_peered":"2024-03-04T12:44:53.486321+0000","last_unstale":"2024-03-04T12:57:25.982297+0000","last_undegraded":"2024-03-04T12:57:25.982297+0000","last_fullsized":"2024-03-04T12:57:25.982297+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:17:26.146570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"250'2","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.988362+0000","last_change":"2024-03-04T12:44:50.456615+0000","last_active":"2024-03-04T12:57:20.988362+0000","last_peered":"2024-03-04T12:57:20.988362+0000","last_clean":"2024-03-04T12:57:20.988362+0000","last_became_active":"2024-03-04T12:44:50.456315+0000","last_became_peered":"2024-03-04T12:44:50.456315+0000","last_unstale":"2024-03-04T12:57:20.988362+0000","last_undegraded":"2024-03-04T12:57:20.988362+0000","last_fullsized":"2024-03-04T12:57:20.988362+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:45.991675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"256'28","reported_seq":104,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:18.211202+0000","last_change":"2024-03-04T12:43:27.064503+0000","last_active":"2024-03-04T12:59:18.211202+0000","last_peered":"2024-03-04T12:59:18.211202+0000","last_clean":"2024-03-04T12:59:18.211202+0000","last_became_active":"2024-03-04T12:43:27.064141+0000","last_became_peered":"2024-03-04T12:43:27.064141+0000","last_unstale":"2024-03-04T12:59:18.211202+0000","last_undegraded":"2024-03-04T12:59:18.211202+0000","last_fullsized":"2024-03-04T12:59:18.211202+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:28:02.741960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"256'359","reported_seq":1005,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.945168+0000","last_change":"2024-03-04T12:36:40.392809+0000","last_active":"2024-03-04T13:00:15.945168+0000","last_peered":"2024-03-04T13:00:15.945168+0000","last_clean":"2024-03-04T13:00:15.945168+0000","last_became_active":"2024-03-04T12:36:40.392399+0000","last_became_peered":"2024-03-04T12:36:40.392399+0000","last_unstale":"2024-03-04T13:00:15.945168+0000","last_undegraded":"2024-03-04T13:00:15.945168+0000","last_fullsized":"2024-03-04T13:00:15.945168+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:58:34.780333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10488354,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":586,"num_read_kb":17405,"num_write":1435,"num_write_kb":42784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"256'1110","reported_seq":2693,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.838199+0000","last_change":"2024-03-04T12:36:07.296271+0000","last_active":"2024-03-04T12:59:48.838199+0000","last_peered":"2024-03-04T12:59:48.838199+0000","last_clean":"2024-03-04T12:59:48.838199+0000","last_became_active":"2024-03-04T12:36:07.295125+0000","last_became_peered":"2024-03-04T12:36:07.295125+0000","last_unstale":"2024-03-04T12:59:48.838199+0000","last_undegraded":"2024-03-04T12:59:48.838199+0000","last_fullsized":"2024-03-04T12:59:48.838199+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:37.876237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4869,"num_read_kb":4281,"num_write":1536,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"256'278","reported_seq":873,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.964076+0000","last_change":"2024-03-04T12:36:05.280982+0000","last_active":"2024-03-04T13:00:15.964076+0000","last_peered":"2024-03-04T13:00:15.964076+0000","last_clean":"2024-03-04T13:00:15.964076+0000","last_became_active":"2024-03-04T12:36:05.280695+0000","last_became_peered":"2024-03-04T12:36:05.280695+0000","last_unstale":"2024-03-04T13:00:15.964076+0000","last_undegraded":"2024-03-04T13:00:15.964076+0000","last_fullsized":"2024-03-04T13:00:15.964076+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:14.407483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256947,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":390,"num_read_kb":2412,"num_write":1104,"num_write_kb":20516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"256'544","reported_seq":1937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671828+0000","last_change":"2024-03-04T12:36:07.297041+0000","last_active":"2024-03-04T13:00:06.671828+0000","last_peered":"2024-03-04T13:00:06.671828+0000","last_clean":"2024-03-04T13:00:06.671828+0000","last_became_active":"2024-03-04T12:36:07.296651+0000","last_became_peered":"2024-03-04T12:36:07.296651+0000","last_unstale":"2024-03-04T13:00:06.671828+0000","last_undegraded":"2024-03-04T13:00:06.671828+0000","last_fullsized":"2024-03-04T13:00:06.671828+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:29:22.170255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2661,"num_read_kb":2496,"num_write":771,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"256'273","reported_seq":876,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.984613+0000","last_change":"2024-03-04T12:36:05.285321+0000","last_active":"2024-03-04T13:00:15.984613+0000","last_peered":"2024-03-04T13:00:15.984613+0000","last_clean":"2024-03-04T13:00:15.984613+0000","last_became_active":"2024-03-04T12:36:05.285054+0000","last_became_peered":"2024-03-04T12:36:05.285054+0000","last_unstale":"2024-03-04T13:00:15.984613+0000","last_undegraded":"2024-03-04T13:00:15.984613+0000","last_fullsized":"2024-03-04T13:00:15.984613+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:36.940053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5939385,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":380,"num_read_kb":27371,"num_write":985,"num_write_kb":18696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"256'594","reported_seq":2014,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:49.593829+0000","last_change":"2024-03-04T12:36:07.298949+0000","last_active":"2024-03-04T12:59:49.593829+0000","last_peered":"2024-03-04T12:59:49.593829+0000","last_clean":"2024-03-04T12:59:49.593829+0000","last_became_active":"2024-03-04T12:36:07.298528+0000","last_became_peered":"2024-03-04T12:36:07.298528+0000","last_unstale":"2024-03-04T12:59:49.593829+0000","last_undegraded":"2024-03-04T12:59:49.593829+0000","last_fullsized":"2024-03-04T12:59:49.593829+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":500,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:22.362410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2805,"num_read_kb":2500,"num_write":805,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"256'293","reported_seq":905,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.003906+0000","last_change":"2024-03-04T12:36:05.294821+0000","last_active":"2024-03-04T13:00:16.003906+0000","last_peered":"2024-03-04T13:00:16.003906+0000","last_clean":"2024-03-04T13:00:16.003906+0000","last_became_active":"2024-03-04T12:36:05.293768+0000","last_became_peered":"2024-03-04T12:36:05.293768+0000","last_unstale":"2024-03-04T13:00:16.003906+0000","last_undegraded":"2024-03-04T13:00:16.003906+0000","last_fullsized":"2024-03-04T13:00:16.003906+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:18.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446620,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":395,"num_read_kb":31950,"num_write":1041,"num_write_kb":37939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"256'777","reported_seq":2174,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:51.407901+0000","last_change":"2024-03-04T12:36:40.394056+0000","last_active":"2024-03-04T12:59:51.407901+0000","last_peered":"2024-03-04T12:59:51.407901+0000","last_clean":"2024-03-04T12:59:51.407901+0000","last_became_active":"2024-03-04T12:36:40.393715+0000","last_became_peered":"2024-03-04T12:36:40.393715+0000","last_unstale":"2024-03-04T12:59:51.407901+0000","last_undegraded":"2024-03-04T12:59:51.407901+0000","last_fullsized":"2024-03-04T12:59:51.407901+0000","mapping_epoch":33,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:36.183102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3436,"num_read_kb":3037,"num_write":1058,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"256'335","reported_seq":970,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.839104+0000","last_change":"2024-03-04T12:36:05.290798+0000","last_active":"2024-03-04T13:00:15.839104+0000","last_peered":"2024-03-04T13:00:15.839104+0000","last_clean":"2024-03-04T13:00:15.839104+0000","last_became_active":"2024-03-04T12:36:05.290178+0000","last_became_peered":"2024-03-04T12:36:05.290178+0000","last_unstale":"2024-03-04T13:00:15.839104+0000","last_undegraded":"2024-03-04T13:00:15.839104+0000","last_fullsized":"2024-03-04T13:00:15.839104+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:22.012412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19588171,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":547,"num_read_kb":36032,"num_write":1331,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"256'371","reported_seq":1918,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:37.805811+0000","last_change":"2024-03-04T12:36:07.301906+0000","last_active":"2024-03-04T12:59:37.805811+0000","last_peered":"2024-03-04T12:59:37.805811+0000","last_clean":"2024-03-04T12:59:37.805811+0000","last_became_active":"2024-03-04T12:36:07.301582+0000","last_became_peered":"2024-03-04T12:36:07.301582+0000","last_unstale":"2024-03-04T12:59:37.805811+0000","last_undegraded":"2024-03-04T12:59:37.805811+0000","last_fullsized":"2024-03-04T12:59:37.805811+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:15:02.915559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2123,"num_read_kb":2049,"num_write":405,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"256'246","reported_seq":854,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.014306+0000","last_change":"2024-03-04T12:36:05.296558+0000","last_active":"2024-03-04T13:00:16.014306+0000","last_peered":"2024-03-04T13:00:16.014306+0000","last_clean":"2024-03-04T13:00:16.014306+0000","last_became_active":"2024-03-04T12:36:05.296284+0000","last_became_peered":"2024-03-04T12:36:05.296284+0000","last_unstale":"2024-03-04T13:00:16.014306+0000","last_undegraded":"2024-03-04T13:00:16.014306+0000","last_fullsized":"2024-03-04T13:00:16.014306+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:09:57.839904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15939941,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":339,"num_read_kb":80579,"num_write":908,"num_write_kb":32166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"256'779","reported_seq":2021,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.066749+0000","last_change":"2024-03-04T12:36:07.298292+0000","last_active":"2024-03-04T12:59:53.066749+0000","last_peered":"2024-03-04T12:59:53.066749+0000","last_clean":"2024-03-04T12:59:53.066749+0000","last_became_active":"2024-03-04T12:36:07.297953+0000","last_became_peered":"2024-03-04T12:36:07.297953+0000","last_unstale":"2024-03-04T12:59:53.066749+0000","last_undegraded":"2024-03-04T12:59:53.066749+0000","last_fullsized":"2024-03-04T12:59:53.066749+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:58:58.998184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3335,"num_read_kb":2888,"num_write":1111,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"256'267","reported_seq":980,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.816903+0000","last_change":"2024-03-04T12:36:05.291622+0000","last_active":"2024-03-04T13:00:15.816903+0000","last_peered":"2024-03-04T13:00:15.816903+0000","last_clean":"2024-03-04T13:00:15.816903+0000","last_became_active":"2024-03-04T12:36:05.291041+0000","last_became_peered":"2024-03-04T12:36:05.291041+0000","last_unstale":"2024-03-04T13:00:15.816903+0000","last_undegraded":"2024-03-04T13:00:15.816903+0000","last_fullsized":"2024-03-04T13:00:15.816903+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:02:19.031345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3234101,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":733,"num_read_kb":12113,"num_write":1095,"num_write_kb":11806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"256'692","reported_seq":2091,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.675667+0000","last_change":"2024-03-04T12:36:07.297212+0000","last_active":"2024-03-04T13:00:06.675667+0000","last_peered":"2024-03-04T13:00:06.675667+0000","last_clean":"2024-03-04T13:00:06.675667+0000","last_became_active":"2024-03-04T12:36:07.296763+0000","last_became_peered":"2024-03-04T12:36:07.296763+0000","last_unstale":"2024-03-04T13:00:06.675667+0000","last_undegraded":"2024-03-04T13:00:06.675667+0000","last_fullsized":"2024-03-04T13:00:06.675667+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:44:52.510569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3139,"num_read_kb":2812,"num_write":915,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"256'251","reported_seq":853,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.952700+0000","last_change":"2024-03-04T12:36:05.295212+0000","last_active":"2024-03-04T13:00:15.952700+0000","last_peered":"2024-03-04T13:00:15.952700+0000","last_clean":"2024-03-04T13:00:15.952700+0000","last_became_active":"2024-03-04T12:36:05.294967+0000","last_became_peered":"2024-03-04T12:36:05.294967+0000","last_unstale":"2024-03-04T13:00:15.952700+0000","last_undegraded":"2024-03-04T13:00:15.952700+0000","last_fullsized":"2024-03-04T13:00:15.952700+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:35:51.469381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12867186,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":343,"num_read_kb":71068,"num_write":894,"num_write_kb":54955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"256'783","reported_seq":2195,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.517649+0000","last_change":"2024-03-04T12:36:07.296706+0000","last_active":"2024-03-04T12:59:55.517649+0000","last_peered":"2024-03-04T12:59:55.517649+0000","last_clean":"2024-03-04T12:59:55.517649+0000","last_became_active":"2024-03-04T12:36:07.295530+0000","last_became_peered":"2024-03-04T12:36:07.295530+0000","last_unstale":"2024-03-04T12:59:55.517649+0000","last_undegraded":"2024-03-04T12:59:55.517649+0000","last_fullsized":"2024-03-04T12:59:55.517649+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:26.858210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3415,"num_read_kb":3026,"num_write":1069,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"256'351","reported_seq":1806,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671750+0000","last_change":"2024-03-04T12:36:07.298974+0000","last_active":"2024-03-04T13:00:06.671750+0000","last_peered":"2024-03-04T13:00:06.671750+0000","last_clean":"2024-03-04T13:00:06.671750+0000","last_became_active":"2024-03-04T12:36:07.298539+0000","last_became_peered":"2024-03-04T12:36:07.298539+0000","last_unstale":"2024-03-04T13:00:06.671750+0000","last_undegraded":"2024-03-04T13:00:06.671750+0000","last_fullsized":"2024-03-04T13:00:06.671750+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:04.598502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1997,"num_read_kb":1912,"num_write":401,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"256'293","reported_seq":983,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.893241+0000","last_change":"2024-03-04T12:36:05.295348+0000","last_active":"2024-03-04T13:00:15.893241+0000","last_peered":"2024-03-04T13:00:15.893241+0000","last_clean":"2024-03-04T13:00:15.893241+0000","last_became_active":"2024-03-04T12:36:05.295060+0000","last_became_peered":"2024-03-04T12:36:05.295060+0000","last_unstale":"2024-03-04T13:00:15.893241+0000","last_undegraded":"2024-03-04T13:00:15.893241+0000","last_fullsized":"2024-03-04T13:00:15.893241+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:44.913316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4278746,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":559,"num_read_kb":26330,"num_write":1253,"num_write_kb":36495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"256'327","reported_seq":1788,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.122768+0000","last_change":"2024-03-04T12:36:07.300589+0000","last_active":"2024-03-04T12:59:52.122768+0000","last_peered":"2024-03-04T12:59:52.122768+0000","last_clean":"2024-03-04T12:59:52.122768+0000","last_became_active":"2024-03-04T12:36:07.300270+0000","last_became_peered":"2024-03-04T12:36:07.300270+0000","last_unstale":"2024-03-04T12:59:52.122768+0000","last_undegraded":"2024-03-04T12:59:52.122768+0000","last_fullsized":"2024-03-04T12:59:52.122768+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:00:00.682987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2015,"num_read_kb":1950,"num_write":359,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"256'247","reported_seq":837,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.952332+0000","last_change":"2024-03-04T12:36:05.296970+0000","last_active":"2024-03-04T13:00:15.952332+0000","last_peered":"2024-03-04T13:00:15.952332+0000","last_clean":"2024-03-04T13:00:15.952332+0000","last_became_active":"2024-03-04T12:36:05.296621+0000","last_became_peered":"2024-03-04T12:36:05.296621+0000","last_unstale":"2024-03-04T13:00:15.952332+0000","last_undegraded":"2024-03-04T13:00:15.952332+0000","last_fullsized":"2024-03-04T13:00:15.952332+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:34:53.750419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050492,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":367,"num_read_kb":30706,"num_write":937,"num_write_kb":28664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"256'400","reported_seq":1882,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.469640+0000","last_change":"2024-03-04T12:36:07.294272+0000","last_active":"2024-03-04T12:59:55.469640+0000","last_peered":"2024-03-04T12:59:55.469640+0000","last_clean":"2024-03-04T12:59:55.469640+0000","last_became_active":"2024-03-04T12:36:07.293952+0000","last_became_peered":"2024-03-04T12:36:07.293952+0000","last_unstale":"2024-03-04T12:59:55.469640+0000","last_undegraded":"2024-03-04T12:59:55.469640+0000","last_fullsized":"2024-03-04T12:59:55.469640+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:15:20.296845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2282,"num_read_kb":2164,"num_write":473,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"256'281","reported_seq":914,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.009674+0000","last_change":"2024-03-04T12:36:05.296143+0000","last_active":"2024-03-04T13:00:16.009674+0000","last_peered":"2024-03-04T13:00:16.009674+0000","last_clean":"2024-03-04T13:00:16.009674+0000","last_became_active":"2024-03-04T12:36:05.295832+0000","last_became_peered":"2024-03-04T12:36:05.295832+0000","last_unstale":"2024-03-04T13:00:16.009674+0000","last_undegraded":"2024-03-04T13:00:16.009674+0000","last_fullsized":"2024-03-04T13:00:16.009674+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:40.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13175493,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":496,"num_read_kb":48295,"num_write":1213,"num_write_kb":38980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"256'623","reported_seq":2325,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.903999+0000","last_change":"2024-03-04T12:36:07.296100+0000","last_active":"2024-03-04T12:59:54.903999+0000","last_peered":"2024-03-04T12:59:54.903999+0000","last_clean":"2024-03-04T12:59:54.903999+0000","last_became_active":"2024-03-04T12:36:07.295798+0000","last_became_peered":"2024-03-04T12:36:07.295798+0000","last_unstale":"2024-03-04T12:59:54.903999+0000","last_undegraded":"2024-03-04T12:59:54.903999+0000","last_fullsized":"2024-03-04T12:59:54.903999+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":600,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:42.532663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3253,"num_read_kb":2977,"num_write":842,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"256'306","reported_seq":912,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.017795+0000","last_change":"2024-03-04T12:36:05.292220+0000","last_active":"2024-03-04T13:00:16.017795+0000","last_peered":"2024-03-04T13:00:16.017795+0000","last_clean":"2024-03-04T13:00:16.017795+0000","last_became_active":"2024-03-04T12:36:05.291477+0000","last_became_peered":"2024-03-04T12:36:05.291477+0000","last_unstale":"2024-03-04T13:00:16.017795+0000","last_undegraded":"2024-03-04T13:00:16.017795+0000","last_fullsized":"2024-03-04T13:00:16.017795+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:51.540928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6379471,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":436,"num_read_kb":10302,"num_write":1186,"num_write_kb":24769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"256'368","reported_seq":1762,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:34.665766+0000","last_change":"2024-03-04T12:36:07.290412+0000","last_active":"2024-03-04T12:59:34.665766+0000","last_peered":"2024-03-04T12:59:34.665766+0000","last_clean":"2024-03-04T12:59:34.665766+0000","last_became_active":"2024-03-04T12:36:07.290104+0000","last_became_peered":"2024-03-04T12:36:07.290104+0000","last_unstale":"2024-03-04T12:59:34.665766+0000","last_undegraded":"2024-03-04T12:59:34.665766+0000","last_fullsized":"2024-03-04T12:59:34.665766+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:26.340789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2031,"num_read_kb":1912,"num_write":446,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"256'276","reported_seq":893,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.003020+0000","last_change":"2024-03-04T12:36:05.291422+0000","last_active":"2024-03-04T13:00:16.003020+0000","last_peered":"2024-03-04T13:00:16.003020+0000","last_clean":"2024-03-04T13:00:16.003020+0000","last_became_active":"2024-03-04T12:36:05.291096+0000","last_became_peered":"2024-03-04T12:36:05.291096+0000","last_unstale":"2024-03-04T13:00:16.003020+0000","last_undegraded":"2024-03-04T13:00:16.003020+0000","last_fullsized":"2024-03-04T13:00:16.003020+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:07.540177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194835,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":438,"num_read_kb":17846,"num_write":1169,"num_write_kb":33765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"256'451","reported_seq":2118,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.018123+0000","last_change":"2024-03-04T12:36:07.298549+0000","last_active":"2024-03-04T12:59:56.018123+0000","last_peered":"2024-03-04T12:59:56.018123+0000","last_clean":"2024-03-04T12:59:56.018123+0000","last_became_active":"2024-03-04T12:36:07.297989+0000","last_became_peered":"2024-03-04T12:36:07.297989+0000","last_unstale":"2024-03-04T12:59:56.018123+0000","last_undegraded":"2024-03-04T12:59:56.018123+0000","last_fullsized":"2024-03-04T12:59:56.018123+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:09.358594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2700,"num_read_kb":2549,"num_write":550,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"256'323","reported_seq":987,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.937623+0000","last_change":"2024-03-04T12:36:05.281235+0000","last_active":"2024-03-04T13:00:15.937623+0000","last_peered":"2024-03-04T13:00:15.937623+0000","last_clean":"2024-03-04T13:00:15.937623+0000","last_became_active":"2024-03-04T12:36:05.280944+0000","last_became_peered":"2024-03-04T12:36:05.280944+0000","last_unstale":"2024-03-04T13:00:15.937623+0000","last_undegraded":"2024-03-04T13:00:15.937623+0000","last_fullsized":"2024-03-04T13:00:15.937623+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:42:06.994361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9728040,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":684,"num_read_kb":21551,"num_write":1160,"num_write_kb":33499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"256'82","reported_seq":558,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.125585+0000","last_change":"2024-03-04T12:36:15.356602+0000","last_active":"2024-03-04T12:59:52.125585+0000","last_peered":"2024-03-04T12:59:52.125585+0000","last_clean":"2024-03-04T12:59:52.125585+0000","last_became_active":"2024-03-04T12:36:15.356314+0000","last_became_peered":"2024-03-04T12:36:15.356314+0000","last_unstale":"2024-03-04T12:59:52.125585+0000","last_undegraded":"2024-03-04T12:59:52.125585+0000","last_fullsized":"2024-03-04T12:59:52.125585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:18:50.970854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":197,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"256'1096","reported_seq":2695,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.183207+0000","last_change":"2024-03-04T12:36:07.298156+0000","last_active":"2024-03-04T12:59:47.183207+0000","last_peered":"2024-03-04T12:59:47.183207+0000","last_clean":"2024-03-04T12:59:47.183207+0000","last_became_active":"2024-03-04T12:36:07.297879+0000","last_became_peered":"2024-03-04T12:36:07.297879+0000","last_unstale":"2024-03-04T12:59:47.183207+0000","last_undegraded":"2024-03-04T12:59:47.183207+0000","last_fullsized":"2024-03-04T12:59:47.183207+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:20.102942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4860,"num_read_kb":4288,"num_write":1505,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"256'319","reported_seq":927,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.814323+0000","last_change":"2024-03-04T12:36:05.297435+0000","last_active":"2024-03-04T13:00:15.814323+0000","last_peered":"2024-03-04T13:00:15.814323+0000","last_clean":"2024-03-04T13:00:15.814323+0000","last_became_active":"2024-03-04T12:36:05.296939+0000","last_became_peered":"2024-03-04T12:36:05.296939+0000","last_unstale":"2024-03-04T13:00:15.814323+0000","last_undegraded":"2024-03-04T13:00:15.814323+0000","last_fullsized":"2024-03-04T13:00:15.814323+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:05.528631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360056,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":415,"num_read_kb":33218,"num_write":1154,"num_write_kb":53558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.976554+0000","last_change":"2024-03-04T12:36:09.314445+0000","last_active":"2024-03-04T12:55:30.976554+0000","last_peered":"2024-03-04T12:55:30.976554+0000","last_clean":"2024-03-04T12:55:30.976554+0000","last_became_active":"2024-03-04T12:36:09.314065+0000","last_became_peered":"2024-03-04T12:36:09.314065+0000","last_unstale":"2024-03-04T12:55:30.976554+0000","last_undegraded":"2024-03-04T12:55:30.976554+0000","last_fullsized":"2024-03-04T12:55:30.976554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:31.539306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"256'281","reported_seq":848,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.994646+0000","last_change":"2024-03-04T12:36:11.326254+0000","last_active":"2024-03-04T13:00:15.994646+0000","last_peered":"2024-03-04T13:00:15.994646+0000","last_clean":"2024-03-04T13:00:15.994646+0000","last_became_active":"2024-03-04T12:36:11.325995+0000","last_became_peered":"2024-03-04T12:36:11.325995+0000","last_unstale":"2024-03-04T13:00:15.994646+0000","last_undegraded":"2024-03-04T13:00:15.994646+0000","last_fullsized":"2024-03-04T13:00:15.994646+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:44.077134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54042,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":461,"num_read_kb":924,"num_write":361,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.864607+0000","last_change":"2024-03-04T12:36:13.339677+0000","last_active":"2024-03-04T12:55:35.864607+0000","last_peered":"2024-03-04T12:55:35.864607+0000","last_clean":"2024-03-04T12:55:35.864607+0000","last_became_active":"2024-03-04T12:36:13.339305+0000","last_became_peered":"2024-03-04T12:36:13.339305+0000","last_unstale":"2024-03-04T12:55:35.864607+0000","last_undegraded":"2024-03-04T12:55:35.864607+0000","last_fullsized":"2024-03-04T12:55:35.864607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:00:43.245373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"256'2370","reported_seq":4141,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.448462+0000","last_change":"2024-03-04T12:36:15.362735+0000","last_active":"2024-03-04T13:00:07.448462+0000","last_peered":"2024-03-04T13:00:07.448462+0000","last_clean":"2024-03-04T13:00:07.448462+0000","last_became_active":"2024-03-04T12:36:15.362434+0000","last_became_peered":"2024-03-04T12:36:15.362434+0000","last_unstale":"2024-03-04T13:00:07.448462+0000","last_undegraded":"2024-03-04T13:00:07.448462+0000","last_fullsized":"2024-03-04T13:00:07.448462+0000","mapping_epoch":30,"log_start":"256'2300","ondisk_log_start":"256'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":2300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:44:00.181398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5876,"num_read_kb":5881,"num_write":4713,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"256'831","reported_seq":2403,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:40.772778+0000","last_change":"2024-03-04T12:36:07.295827+0000","last_active":"2024-03-04T12:59:40.772778+0000","last_peered":"2024-03-04T12:59:40.772778+0000","last_clean":"2024-03-04T12:59:40.772778+0000","last_became_active":"2024-03-04T12:36:07.295522+0000","last_became_peered":"2024-03-04T12:36:07.295522+0000","last_unstale":"2024-03-04T12:59:40.772778+0000","last_undegraded":"2024-03-04T12:59:40.772778+0000","last_fullsized":"2024-03-04T12:59:40.772778+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:48:41.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3820,"num_read_kb":3411,"num_write":1118,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"256'322","reported_seq":937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.005883+0000","last_change":"2024-03-04T12:36:05.288481+0000","last_active":"2024-03-04T13:00:16.005883+0000","last_peered":"2024-03-04T13:00:16.005883+0000","last_clean":"2024-03-04T13:00:16.005883+0000","last_became_active":"2024-03-04T12:36:05.288208+0000","last_became_peered":"2024-03-04T12:36:05.288208+0000","last_unstale":"2024-03-04T13:00:16.005883+0000","last_undegraded":"2024-03-04T13:00:16.005883+0000","last_fullsized":"2024-03-04T13:00:16.005883+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:48.405825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4588272,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":513,"num_read_kb":34780,"num_write":1135,"num_write_kb":45508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.980972+0000","last_change":"2024-03-04T12:36:09.309834+0000","last_active":"2024-03-04T12:57:10.980972+0000","last_peered":"2024-03-04T12:57:10.980972+0000","last_clean":"2024-03-04T12:57:10.980972+0000","last_became_active":"2024-03-04T12:36:09.309583+0000","last_became_peered":"2024-03-04T12:36:09.309583+0000","last_unstale":"2024-03-04T12:57:10.980972+0000","last_undegraded":"2024-03-04T12:57:10.980972+0000","last_fullsized":"2024-03-04T12:57:10.980972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:07.871941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"256'70","reported_seq":569,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.001099+0000","last_change":"2024-03-04T12:36:11.325082+0000","last_active":"2024-03-04T12:57:56.001099+0000","last_peered":"2024-03-04T12:57:56.001099+0000","last_clean":"2024-03-04T12:57:56.001099+0000","last_became_active":"2024-03-04T12:36:11.324761+0000","last_became_peered":"2024-03-04T12:36:11.324761+0000","last_unstale":"2024-03-04T12:57:56.001099+0000","last_undegraded":"2024-03-04T12:57:56.001099+0000","last_fullsized":"2024-03-04T12:57:56.001099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:54.454757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":50,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":471,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.977378+0000","last_change":"2024-03-04T12:36:13.343424+0000","last_active":"2024-03-04T12:55:35.977378+0000","last_peered":"2024-03-04T12:55:35.977378+0000","last_clean":"2024-03-04T12:55:35.977378+0000","last_became_active":"2024-03-04T12:36:13.343072+0000","last_became_peered":"2024-03-04T12:36:13.343072+0000","last_unstale":"2024-03-04T12:55:35.977378+0000","last_undegraded":"2024-03-04T12:55:35.977378+0000","last_fullsized":"2024-03-04T12:55:35.977378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:57.168843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"256'98","reported_seq":584,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.906113+0000","last_change":"2024-03-04T12:36:15.362615+0000","last_active":"2024-03-04T12:59:54.906113+0000","last_peered":"2024-03-04T12:59:54.906113+0000","last_clean":"2024-03-04T12:59:54.906113+0000","last_became_active":"2024-03-04T12:36:15.362354+0000","last_became_peered":"2024-03-04T12:36:15.362354+0000","last_unstale":"2024-03-04T12:59:54.906113+0000","last_undegraded":"2024-03-04T12:59:54.906113+0000","last_fullsized":"2024-03-04T12:59:54.906113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:28.389546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":121,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"256'345","reported_seq":1724,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.037932+0000","last_change":"2024-03-04T12:36:07.294690+0000","last_active":"2024-03-04T12:59:53.037932+0000","last_peered":"2024-03-04T12:59:53.037932+0000","last_clean":"2024-03-04T12:59:53.037932+0000","last_became_active":"2024-03-04T12:36:07.294328+0000","last_became_peered":"2024-03-04T12:36:07.294328+0000","last_unstale":"2024-03-04T12:59:53.037932+0000","last_undegraded":"2024-03-04T12:59:53.037932+0000","last_fullsized":"2024-03-04T12:59:53.037932+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:21.872722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1913,"num_read_kb":1818,"num_write":399,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"256'245","reported_seq":858,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.826805+0000","last_change":"2024-03-04T12:36:05.291937+0000","last_active":"2024-03-04T13:00:15.826805+0000","last_peered":"2024-03-04T13:00:15.826805+0000","last_clean":"2024-03-04T13:00:15.826805+0000","last_became_active":"2024-03-04T12:36:05.291366+0000","last_became_peered":"2024-03-04T12:36:05.291366+0000","last_unstale":"2024-03-04T13:00:15.826805+0000","last_undegraded":"2024-03-04T13:00:15.826805+0000","last_fullsized":"2024-03-04T13:00:15.826805+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:51:33.987631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074518,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":408,"num_read_kb":10586,"num_write":1086,"num_write_kb":21097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.968727+0000","last_change":"2024-03-04T12:36:09.310004+0000","last_active":"2024-03-04T12:55:30.968727+0000","last_peered":"2024-03-04T12:55:30.968727+0000","last_clean":"2024-03-04T12:55:30.968727+0000","last_became_active":"2024-03-04T12:36:09.309749+0000","last_became_peered":"2024-03-04T12:36:09.309749+0000","last_unstale":"2024-03-04T12:55:30.968727+0000","last_undegraded":"2024-03-04T12:55:30.968727+0000","last_fullsized":"2024-03-04T12:55:30.968727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:03:13.417440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"256'81","reported_seq":584,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:49.593521+0000","last_change":"2024-03-04T12:36:11.324407+0000","last_active":"2024-03-04T12:58:49.593521+0000","last_peered":"2024-03-04T12:58:49.593521+0000","last_clean":"2024-03-04T12:58:49.593521+0000","last_became_active":"2024-03-04T12:36:11.324127+0000","last_became_peered":"2024-03-04T12:36:11.324127+0000","last_unstale":"2024-03-04T12:58:49.593521+0000","last_undegraded":"2024-03-04T12:58:49.593521+0000","last_fullsized":"2024-03-04T12:58:49.593521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:48.776107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"256'508","reported_seq":1456,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.236381+0000","last_change":"2024-03-04T12:36:13.338671+0000","last_active":"2024-03-04T13:00:15.236381+0000","last_peered":"2024-03-04T13:00:15.236381+0000","last_clean":"2024-03-04T13:00:15.236381+0000","last_became_active":"2024-03-04T12:36:13.338070+0000","last_became_peered":"2024-03-04T12:36:13.338070+0000","last_unstale":"2024-03-04T13:00:15.236381+0000","last_undegraded":"2024-03-04T13:00:15.236381+0000","last_fullsized":"2024-03-04T13:00:15.236381+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:33:55.908350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"256'103","reported_seq":572,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:31.188469+0000","last_change":"2024-03-04T12:36:15.356684+0000","last_active":"2024-03-04T12:59:31.188469+0000","last_peered":"2024-03-04T12:59:31.188469+0000","last_clean":"2024-03-04T12:59:31.188469+0000","last_became_active":"2024-03-04T12:36:15.356417+0000","last_became_peered":"2024-03-04T12:36:15.356417+0000","last_unstale":"2024-03-04T12:59:31.188469+0000","last_undegraded":"2024-03-04T12:59:31.188469+0000","last_fullsized":"2024-03-04T12:59:31.188469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:52:14.210704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"256'684","reported_seq":2108,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.017188+0000","last_change":"2024-03-04T12:36:07.293732+0000","last_active":"2024-03-04T12:59:56.017188+0000","last_peered":"2024-03-04T12:59:56.017188+0000","last_clean":"2024-03-04T12:59:56.017188+0000","last_became_active":"2024-03-04T12:36:07.293493+0000","last_became_peered":"2024-03-04T12:36:07.293493+0000","last_unstale":"2024-03-04T12:59:56.017188+0000","last_undegraded":"2024-03-04T12:59:56.017188+0000","last_fullsized":"2024-03-04T12:59:56.017188+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:57:53.084655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3120,"num_read_kb":2817,"num_write":901,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"256'348","reported_seq":968,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.991149+0000","last_change":"2024-03-04T12:36:05.283970+0000","last_active":"2024-03-04T13:00:15.991149+0000","last_peered":"2024-03-04T13:00:15.991149+0000","last_clean":"2024-03-04T13:00:15.991149+0000","last_became_active":"2024-03-04T12:36:05.283477+0000","last_became_peered":"2024-03-04T12:36:05.283477+0000","last_unstale":"2024-03-04T13:00:15.991149+0000","last_undegraded":"2024-03-04T13:00:15.991149+0000","last_fullsized":"2024-03-04T13:00:15.991149+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:34:48.169224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2135532,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":502,"num_read_kb":32578,"num_write":1414,"num_write_kb":46757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.976596+0000","last_change":"2024-03-04T12:36:09.314720+0000","last_active":"2024-03-04T12:55:30.976596+0000","last_peered":"2024-03-04T12:55:30.976596+0000","last_clean":"2024-03-04T12:55:30.976596+0000","last_became_active":"2024-03-04T12:36:09.314215+0000","last_became_peered":"2024-03-04T12:36:09.314215+0000","last_unstale":"2024-03-04T12:55:30.976596+0000","last_undegraded":"2024-03-04T12:55:30.976596+0000","last_fullsized":"2024-03-04T12:55:30.976596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:41.656458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"256'247","reported_seq":789,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.763809+0000","last_change":"2024-03-04T12:36:11.956620+0000","last_active":"2024-03-04T13:00:15.763809+0000","last_peered":"2024-03-04T13:00:15.763809+0000","last_clean":"2024-03-04T13:00:15.763809+0000","last_became_active":"2024-03-04T12:36:11.956371+0000","last_became_peered":"2024-03-04T12:36:11.956371+0000","last_unstale":"2024-03-04T13:00:15.763809+0000","last_undegraded":"2024-03-04T13:00:15.763809+0000","last_fullsized":"2024-03-04T13:00:15.763809+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:43.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44142,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1035,"num_write":354,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"256'533","reported_seq":3334,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.240304+0000","last_change":"2024-03-04T12:36:13.344846+0000","last_active":"2024-03-04T13:00:15.240304+0000","last_peered":"2024-03-04T13:00:15.240304+0000","last_clean":"2024-03-04T13:00:15.240304+0000","last_became_active":"2024-03-04T12:36:13.344498+0000","last_became_peered":"2024-03-04T12:36:13.344498+0000","last_unstale":"2024-03-04T13:00:15.240304+0000","last_undegraded":"2024-03-04T13:00:15.240304+0000","last_fullsized":"2024-03-04T13:00:15.240304+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:40:58.604976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"256'768","reported_seq":2298,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.130713+0000","last_change":"2024-03-04T12:36:07.297672+0000","last_active":"2024-03-04T12:59:52.130713+0000","last_peered":"2024-03-04T12:59:52.130713+0000","last_clean":"2024-03-04T12:59:52.130713+0000","last_became_active":"2024-03-04T12:36:07.297320+0000","last_became_peered":"2024-03-04T12:36:07.297320+0000","last_unstale":"2024-03-04T12:59:52.130713+0000","last_undegraded":"2024-03-04T12:59:52.130713+0000","last_fullsized":"2024-03-04T12:59:52.130713+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:40.204657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3660,"num_read_kb":3298,"num_write":1023,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"256'325","reported_seq":987,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.769791+0000","last_change":"2024-03-04T12:36:05.294150+0000","last_active":"2024-03-04T13:00:15.769791+0000","last_peered":"2024-03-04T13:00:15.769791+0000","last_clean":"2024-03-04T13:00:15.769791+0000","last_became_active":"2024-03-04T12:36:05.293882+0000","last_became_peered":"2024-03-04T12:36:05.293882+0000","last_unstale":"2024-03-04T13:00:15.769791+0000","last_undegraded":"2024-03-04T13:00:15.769791+0000","last_fullsized":"2024-03-04T13:00:15.769791+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:44:38.505106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25761744,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":517,"num_read_kb":60171,"num_write":1396,"num_write_kb":40158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.884043+0000","last_change":"2024-03-04T12:36:09.308808+0000","last_active":"2024-03-04T12:57:50.884043+0000","last_peered":"2024-03-04T12:57:50.884043+0000","last_clean":"2024-03-04T12:57:50.884043+0000","last_became_active":"2024-03-04T12:36:09.308538+0000","last_became_peered":"2024-03-04T12:36:09.308538+0000","last_unstale":"2024-03-04T12:57:50.884043+0000","last_undegraded":"2024-03-04T12:57:50.884043+0000","last_fullsized":"2024-03-04T12:57:50.884043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:29.862690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"256'308","reported_seq":874,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.684356+0000","last_change":"2024-03-04T12:36:11.954866+0000","last_active":"2024-03-04T13:00:08.684356+0000","last_peered":"2024-03-04T13:00:08.684356+0000","last_clean":"2024-03-04T13:00:08.684356+0000","last_became_active":"2024-03-04T12:36:11.954597+0000","last_became_peered":"2024-03-04T12:36:11.954597+0000","last_unstale":"2024-03-04T13:00:08.684356+0000","last_undegraded":"2024-03-04T13:00:08.684356+0000","last_fullsized":"2024-03-04T13:00:08.684356+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:12.925538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66828,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":513,"num_read_kb":1018,"num_write":416,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.975791+0000","last_change":"2024-03-04T12:36:13.340164+0000","last_active":"2024-03-04T12:56:30.975791+0000","last_peered":"2024-03-04T12:56:30.975791+0000","last_clean":"2024-03-04T12:56:30.975791+0000","last_became_active":"2024-03-04T12:36:13.339890+0000","last_became_peered":"2024-03-04T12:36:13.339890+0000","last_unstale":"2024-03-04T12:56:30.975791+0000","last_undegraded":"2024-03-04T12:56:30.975791+0000","last_fullsized":"2024-03-04T12:56:30.975791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:01:43.082809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"256'505","reported_seq":1289,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.702992+0000","last_change":"2024-03-04T12:36:15.363257+0000","last_active":"2024-03-04T13:00:08.702992+0000","last_peered":"2024-03-04T13:00:08.702992+0000","last_clean":"2024-03-04T13:00:08.702992+0000","last_became_active":"2024-03-04T12:36:15.362355+0000","last_became_peered":"2024-03-04T12:36:15.362355+0000","last_unstale":"2024-03-04T13:00:08.702992+0000","last_undegraded":"2024-03-04T13:00:08.702992+0000","last_fullsized":"2024-03-04T13:00:08.702992+0000","mapping_epoch":30,"log_start":"250'400","ondisk_log_start":"250'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:39:12.607478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1234,"num_read_kb":1233,"num_write":1042,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"256'404","reported_seq":1914,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.480892+0000","last_change":"2024-03-04T12:36:07.292415+0000","last_active":"2024-03-04T12:59:55.480892+0000","last_peered":"2024-03-04T12:59:55.480892+0000","last_clean":"2024-03-04T12:59:55.480892+0000","last_became_active":"2024-03-04T12:36:07.291507+0000","last_became_peered":"2024-03-04T12:36:07.291507+0000","last_unstale":"2024-03-04T12:59:55.480892+0000","last_undegraded":"2024-03-04T12:59:55.480892+0000","last_fullsized":"2024-03-04T12:59:55.480892+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:09:27.148690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2180,"num_read_kb":2067,"num_write":478,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"256'268","reported_seq":891,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.819590+0000","last_change":"2024-03-04T12:36:05.286750+0000","last_active":"2024-03-04T13:00:15.819590+0000","last_peered":"2024-03-04T13:00:15.819590+0000","last_clean":"2024-03-04T13:00:15.819590+0000","last_became_active":"2024-03-04T12:36:05.286438+0000","last_became_peered":"2024-03-04T12:36:05.286438+0000","last_unstale":"2024-03-04T13:00:15.819590+0000","last_undegraded":"2024-03-04T13:00:15.819590+0000","last_fullsized":"2024-03-04T13:00:15.819590+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:34:40.712814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561797,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":436,"num_read_kb":18655,"num_write":1164,"num_write_kb":23251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.988264+0000","last_change":"2024-03-04T12:36:09.304859+0000","last_active":"2024-03-04T12:57:50.988264+0000","last_peered":"2024-03-04T12:57:50.988264+0000","last_clean":"2024-03-04T12:57:50.988264+0000","last_became_active":"2024-03-04T12:36:09.304561+0000","last_became_peered":"2024-03-04T12:36:09.304561+0000","last_unstale":"2024-03-04T12:57:50.988264+0000","last_undegraded":"2024-03-04T12:57:50.988264+0000","last_fullsized":"2024-03-04T12:57:50.988264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:50:41.171488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"256'264","reported_seq":800,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.659812+0000","last_change":"2024-03-04T12:36:11.324431+0000","last_active":"2024-03-04T13:00:08.659812+0000","last_peered":"2024-03-04T13:00:08.659812+0000","last_clean":"2024-03-04T13:00:08.659812+0000","last_became_active":"2024-03-04T12:36:11.324147+0000","last_became_peered":"2024-03-04T12:36:11.324147+0000","last_unstale":"2024-03-04T13:00:08.659812+0000","last_undegraded":"2024-03-04T13:00:08.659812+0000","last_fullsized":"2024-03-04T13:00:08.659812+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:08.464149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":936,"num_write":360,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.987062+0000","last_change":"2024-03-04T12:36:13.346330+0000","last_active":"2024-03-04T12:57:55.987062+0000","last_peered":"2024-03-04T12:57:55.987062+0000","last_clean":"2024-03-04T12:57:55.987062+0000","last_became_active":"2024-03-04T12:36:13.346077+0000","last_became_peered":"2024-03-04T12:36:13.346077+0000","last_unstale":"2024-03-04T12:57:55.987062+0000","last_undegraded":"2024-03-04T12:57:55.987062+0000","last_fullsized":"2024-03-04T12:57:55.987062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:53:58.068981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"256'121","reported_seq":600,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.249351+0000","last_change":"2024-03-04T12:36:15.360124+0000","last_active":"2024-03-04T12:59:48.249351+0000","last_peered":"2024-03-04T12:59:48.249351+0000","last_clean":"2024-03-04T12:59:48.249351+0000","last_became_active":"2024-03-04T12:36:15.359839+0000","last_became_peered":"2024-03-04T12:36:15.359839+0000","last_unstale":"2024-03-04T12:59:48.249351+0000","last_undegraded":"2024-03-04T12:59:48.249351+0000","last_fullsized":"2024-03-04T12:59:48.249351+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:21:16.002994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":144,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"256'819","reported_seq":2263,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.910676+0000","last_change":"2024-03-04T12:36:40.395151+0000","last_active":"2024-03-04T12:59:54.910676+0000","last_peered":"2024-03-04T12:59:54.910676+0000","last_clean":"2024-03-04T12:59:54.910676+0000","last_became_active":"2024-03-04T12:36:40.394812+0000","last_became_peered":"2024-03-04T12:36:40.394812+0000","last_unstale":"2024-03-04T12:59:54.910676+0000","last_undegraded":"2024-03-04T12:59:54.910676+0000","last_fullsized":"2024-03-04T12:59:54.910676+0000","mapping_epoch":33,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:10.350765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3628,"num_read_kb":3191,"num_write":1140,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"256'304","reported_seq":953,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.850484+0000","last_change":"2024-03-04T12:36:05.297783+0000","last_active":"2024-03-04T13:00:15.850484+0000","last_peered":"2024-03-04T13:00:15.850484+0000","last_clean":"2024-03-04T13:00:15.850484+0000","last_became_active":"2024-03-04T12:36:05.297486+0000","last_became_peered":"2024-03-04T12:36:05.297486+0000","last_unstale":"2024-03-04T13:00:15.850484+0000","last_undegraded":"2024-03-04T13:00:15.850484+0000","last_fullsized":"2024-03-04T13:00:15.850484+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:45.296031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20994598,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":550,"num_read_kb":44586,"num_write":1336,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'5","reported_seq":787,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.206385+0000","last_change":"2024-03-04T12:36:09.303560+0000","last_active":"2024-03-04T13:00:15.206385+0000","last_peered":"2024-03-04T13:00:15.206385+0000","last_clean":"2024-03-04T13:00:15.206385+0000","last_became_active":"2024-03-04T12:36:09.303280+0000","last_became_peered":"2024-03-04T12:36:09.303280+0000","last_unstale":"2024-03-04T13:00:15.206385+0000","last_undegraded":"2024-03-04T13:00:15.206385+0000","last_fullsized":"2024-03-04T13:00:15.206385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:32:28.838095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":467,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"256'280","reported_seq":828,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.686589+0000","last_change":"2024-03-04T12:36:11.325461+0000","last_active":"2024-03-04T13:00:08.686589+0000","last_peered":"2024-03-04T13:00:08.686589+0000","last_clean":"2024-03-04T13:00:08.686589+0000","last_became_active":"2024-03-04T12:36:11.325109+0000","last_became_peered":"2024-03-04T12:36:11.325109+0000","last_unstale":"2024-03-04T13:00:08.686589+0000","last_undegraded":"2024-03-04T13:00:08.686589+0000","last_fullsized":"2024-03-04T13:00:08.686589+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:48.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63172,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":463,"num_read_kb":979,"num_write":388,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"256'514","reported_seq":1818,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.241267+0000","last_change":"2024-03-04T12:36:13.342932+0000","last_active":"2024-03-04T13:00:15.241267+0000","last_peered":"2024-03-04T13:00:15.241267+0000","last_clean":"2024-03-04T13:00:15.241267+0000","last_became_active":"2024-03-04T12:36:13.342604+0000","last_became_peered":"2024-03-04T12:36:13.342604+0000","last_unstale":"2024-03-04T13:00:15.241267+0000","last_undegraded":"2024-03-04T13:00:15.241267+0000","last_fullsized":"2024-03-04T13:00:15.241267+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:05.485830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"256'91","reported_seq":551,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:32.243920+0000","last_change":"2024-03-04T12:36:15.360260+0000","last_active":"2024-03-04T12:59:32.243920+0000","last_peered":"2024-03-04T12:59:32.243920+0000","last_clean":"2024-03-04T12:59:32.243920+0000","last_became_active":"2024-03-04T12:36:15.359959+0000","last_became_peered":"2024-03-04T12:36:15.359959+0000","last_unstale":"2024-03-04T12:59:32.243920+0000","last_undegraded":"2024-03-04T12:59:32.243920+0000","last_fullsized":"2024-03-04T12:59:32.243920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:09.867645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"256'355","reported_seq":1798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.121512+0000","last_change":"2024-03-04T12:36:07.301861+0000","last_active":"2024-03-04T12:59:52.121512+0000","last_peered":"2024-03-04T12:59:52.121512+0000","last_clean":"2024-03-04T12:59:52.121512+0000","last_became_active":"2024-03-04T12:36:07.301558+0000","last_became_peered":"2024-03-04T12:36:07.301558+0000","last_unstale":"2024-03-04T12:59:52.121512+0000","last_undegraded":"2024-03-04T12:59:52.121512+0000","last_fullsized":"2024-03-04T12:59:52.121512+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:41.166126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1943,"num_read_kb":1867,"num_write":395,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"256'308","reported_seq":1058,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.935433+0000","last_change":"2024-03-04T12:36:05.293965+0000","last_active":"2024-03-04T13:00:15.935433+0000","last_peered":"2024-03-04T13:00:15.935433+0000","last_clean":"2024-03-04T13:00:15.935433+0000","last_became_active":"2024-03-04T12:36:05.293649+0000","last_became_peered":"2024-03-04T12:36:05.293649+0000","last_unstale":"2024-03-04T13:00:15.935433+0000","last_undegraded":"2024-03-04T13:00:15.935433+0000","last_fullsized":"2024-03-04T13:00:15.935433+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:55.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9453378,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":654,"num_read_kb":39140,"num_write":1321,"num_write_kb":31517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.988287+0000","last_change":"2024-03-04T12:36:09.304187+0000","last_active":"2024-03-04T12:57:50.988287+0000","last_peered":"2024-03-04T12:57:50.988287+0000","last_clean":"2024-03-04T12:57:50.988287+0000","last_became_active":"2024-03-04T12:36:09.303908+0000","last_became_peered":"2024-03-04T12:36:09.303908+0000","last_unstale":"2024-03-04T12:57:50.988287+0000","last_undegraded":"2024-03-04T12:57:50.988287+0000","last_fullsized":"2024-03-04T12:57:50.988287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:55:34.254756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"256'419","reported_seq":1009,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.251650+0000","last_change":"2024-03-04T12:36:11.328487+0000","last_active":"2024-03-04T13:00:15.251650+0000","last_peered":"2024-03-04T13:00:15.251650+0000","last_clean":"2024-03-04T13:00:15.251650+0000","last_became_active":"2024-03-04T12:36:11.326014+0000","last_became_peered":"2024-03-04T12:36:11.326014+0000","last_unstale":"2024-03-04T13:00:15.251650+0000","last_undegraded":"2024-03-04T13:00:15.251650+0000","last_fullsized":"2024-03-04T13:00:15.251650+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:45:24.328565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109509,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":732,"num_read_kb":1607,"num_write":604,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.988698+0000","last_change":"2024-03-04T12:36:13.335911+0000","last_active":"2024-03-04T12:57:55.988698+0000","last_peered":"2024-03-04T12:57:55.988698+0000","last_clean":"2024-03-04T12:57:55.988698+0000","last_became_active":"2024-03-04T12:36:13.335586+0000","last_became_peered":"2024-03-04T12:36:13.335586+0000","last_unstale":"2024-03-04T12:57:55.988698+0000","last_undegraded":"2024-03-04T12:57:55.988698+0000","last_fullsized":"2024-03-04T12:57:55.988698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:25.484088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"256'107","reported_seq":600,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:01.349664+0000","last_change":"2024-03-04T12:36:15.356552+0000","last_active":"2024-03-04T12:59:01.349664+0000","last_peered":"2024-03-04T12:59:01.349664+0000","last_clean":"2024-03-04T12:59:01.349664+0000","last_became_active":"2024-03-04T12:36:15.356270+0000","last_became_peered":"2024-03-04T12:36:15.356270+0000","last_unstale":"2024-03-04T12:59:01.349664+0000","last_undegraded":"2024-03-04T12:59:01.349664+0000","last_fullsized":"2024-03-04T12:59:01.349664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:20.445838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":257,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"256'398","reported_seq":1973,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.675701+0000","last_change":"2024-03-04T12:36:07.293079+0000","last_active":"2024-03-04T13:00:06.675701+0000","last_peered":"2024-03-04T13:00:06.675701+0000","last_clean":"2024-03-04T13:00:06.675701+0000","last_became_active":"2024-03-04T12:36:07.292788+0000","last_became_peered":"2024-03-04T12:36:07.292788+0000","last_unstale":"2024-03-04T13:00:06.675701+0000","last_undegraded":"2024-03-04T13:00:06.675701+0000","last_fullsized":"2024-03-04T13:00:06.675701+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:54.824676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2359,"num_read_kb":2243,"num_write":467,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"256'264","reported_seq":966,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.939047+0000","last_change":"2024-03-04T12:36:05.286316+0000","last_active":"2024-03-04T13:00:15.939047+0000","last_peered":"2024-03-04T13:00:15.939047+0000","last_clean":"2024-03-04T13:00:15.939047+0000","last_became_active":"2024-03-04T12:36:05.284594+0000","last_became_peered":"2024-03-04T12:36:05.284594+0000","last_unstale":"2024-03-04T13:00:15.939047+0000","last_undegraded":"2024-03-04T13:00:15.939047+0000","last_fullsized":"2024-03-04T13:00:15.939047+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:06.773008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12161951,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":556,"num_read_kb":110861,"num_write":978,"num_write_kb":39283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:25.979146+0000","last_change":"2024-03-04T12:36:09.305629+0000","last_active":"2024-03-04T12:56:25.979146+0000","last_peered":"2024-03-04T12:56:25.979146+0000","last_clean":"2024-03-04T12:56:25.979146+0000","last_became_active":"2024-03-04T12:36:09.305363+0000","last_became_peered":"2024-03-04T12:36:09.305363+0000","last_unstale":"2024-03-04T12:56:25.979146+0000","last_undegraded":"2024-03-04T12:56:25.979146+0000","last_fullsized":"2024-03-04T12:56:25.979146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:49:38.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"256'258","reported_seq":807,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.355690+0000","last_change":"2024-03-04T12:36:11.320326+0000","last_active":"2024-03-04T13:00:15.355690+0000","last_peered":"2024-03-04T13:00:15.355690+0000","last_clean":"2024-03-04T13:00:15.355690+0000","last_became_active":"2024-03-04T12:36:11.319633+0000","last_became_peered":"2024-03-04T12:36:11.319633+0000","last_unstale":"2024-03-04T13:00:15.355690+0000","last_undegraded":"2024-03-04T13:00:15.355690+0000","last_fullsized":"2024-03-04T13:00:15.355690+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:00:21.398680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":990,"num_write":404,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":463,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.992632+0000","last_change":"2024-03-04T12:36:13.349289+0000","last_active":"2024-03-04T12:56:30.992632+0000","last_peered":"2024-03-04T12:56:30.992632+0000","last_clean":"2024-03-04T12:56:30.992632+0000","last_became_active":"2024-03-04T12:36:13.348999+0000","last_became_peered":"2024-03-04T12:36:13.348999+0000","last_unstale":"2024-03-04T12:56:30.992632+0000","last_undegraded":"2024-03-04T12:56:30.992632+0000","last_fullsized":"2024-03-04T12:56:30.992632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:01:23.408092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"256'97","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:39.238643+0000","last_change":"2024-03-04T12:36:15.360060+0000","last_active":"2024-03-04T12:59:39.238643+0000","last_peered":"2024-03-04T12:59:39.238643+0000","last_clean":"2024-03-04T12:59:39.238643+0000","last_became_active":"2024-03-04T12:36:15.359732+0000","last_became_peered":"2024-03-04T12:36:15.359732+0000","last_unstale":"2024-03-04T12:59:39.238643+0000","last_undegraded":"2024-03-04T12:59:39.238643+0000","last_fullsized":"2024-03-04T12:59:39.238643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:46.691644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"256'879","reported_seq":2433,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.129050+0000","last_change":"2024-03-04T12:36:07.299296+0000","last_active":"2024-03-04T12:59:50.129050+0000","last_peered":"2024-03-04T12:59:50.129050+0000","last_clean":"2024-03-04T12:59:50.129050+0000","last_became_active":"2024-03-04T12:36:07.298999+0000","last_became_peered":"2024-03-04T12:36:07.298999+0000","last_unstale":"2024-03-04T12:59:50.129050+0000","last_undegraded":"2024-03-04T12:59:50.129050+0000","last_fullsized":"2024-03-04T12:59:50.129050+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:15.755740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4068,"num_read_kb":3596,"num_write":1224,"num_write_kb":497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"256'308","reported_seq":908,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.940339+0000","last_change":"2024-03-04T12:36:05.289780+0000","last_active":"2024-03-04T13:00:15.940339+0000","last_peered":"2024-03-04T13:00:15.940339+0000","last_clean":"2024-03-04T13:00:15.940339+0000","last_became_active":"2024-03-04T12:36:05.289486+0000","last_became_peered":"2024-03-04T12:36:05.289486+0000","last_unstale":"2024-03-04T13:00:15.940339+0000","last_undegraded":"2024-03-04T13:00:15.940339+0000","last_fullsized":"2024-03-04T13:00:15.940339+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:54.563075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17286171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":403,"num_read_kb":48705,"num_write":1279,"num_write_kb":64123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:25.975316+0000","last_change":"2024-03-04T12:36:09.306337+0000","last_active":"2024-03-04T12:56:25.975316+0000","last_peered":"2024-03-04T12:56:25.975316+0000","last_clean":"2024-03-04T12:56:25.975316+0000","last_became_active":"2024-03-04T12:36:09.305880+0000","last_became_peered":"2024-03-04T12:36:09.305880+0000","last_unstale":"2024-03-04T12:56:25.975316+0000","last_undegraded":"2024-03-04T12:56:25.975316+0000","last_fullsized":"2024-03-04T12:56:25.975316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:12:13.954397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"256'261","reported_seq":808,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.700544+0000","last_change":"2024-03-04T12:36:11.327832+0000","last_active":"2024-03-04T13:00:08.700544+0000","last_peered":"2024-03-04T13:00:08.700544+0000","last_clean":"2024-03-04T13:00:08.700544+0000","last_became_active":"2024-03-04T12:36:11.327499+0000","last_became_peered":"2024-03-04T12:36:11.327499+0000","last_unstale":"2024-03-04T13:00:08.700544+0000","last_undegraded":"2024-03-04T13:00:08.700544+0000","last_fullsized":"2024-03-04T13:00:08.700544+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:11:36.354045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56466,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":427,"num_read_kb":893,"num_write":352,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"256'476","reported_seq":1624,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.236960+0000","last_change":"2024-03-04T12:36:13.338140+0000","last_active":"2024-03-04T13:00:15.236960+0000","last_peered":"2024-03-04T13:00:15.236960+0000","last_clean":"2024-03-04T13:00:15.236960+0000","last_became_active":"2024-03-04T12:36:13.337817+0000","last_became_peered":"2024-03-04T12:36:13.337817+0000","last_unstale":"2024-03-04T13:00:15.236960+0000","last_undegraded":"2024-03-04T13:00:15.236960+0000","last_fullsized":"2024-03-04T13:00:15.236960+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:48.478224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"256'95","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:51.103823+0000","last_change":"2024-03-04T12:36:15.349157+0000","last_active":"2024-03-04T12:58:51.103823+0000","last_peered":"2024-03-04T12:58:51.103823+0000","last_clean":"2024-03-04T12:58:51.103823+0000","last_became_active":"2024-03-04T12:36:15.348869+0000","last_became_peered":"2024-03-04T12:36:15.348869+0000","last_unstale":"2024-03-04T12:58:51.103823+0000","last_undegraded":"2024-03-04T12:58:51.103823+0000","last_fullsized":"2024-03-04T12:58:51.103823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:52:50.410936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":240,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"256'411","reported_seq":1952,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.247659+0000","last_change":"2024-03-04T12:36:07.293897+0000","last_active":"2024-03-04T12:59:48.247659+0000","last_peered":"2024-03-04T12:59:48.247659+0000","last_clean":"2024-03-04T12:59:48.247659+0000","last_became_active":"2024-03-04T12:36:07.293586+0000","last_became_peered":"2024-03-04T12:36:07.293586+0000","last_unstale":"2024-03-04T12:59:48.247659+0000","last_undegraded":"2024-03-04T12:59:48.247659+0000","last_fullsized":"2024-03-04T12:59:48.247659+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:31.445571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2259,"num_read_kb":2143,"num_write":486,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"256'294","reported_seq":901,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.958822+0000","last_change":"2024-03-04T12:36:05.288353+0000","last_active":"2024-03-04T13:00:15.958822+0000","last_peered":"2024-03-04T13:00:15.958822+0000","last_clean":"2024-03-04T13:00:15.958822+0000","last_became_active":"2024-03-04T12:36:05.288036+0000","last_became_peered":"2024-03-04T12:36:05.288036+0000","last_unstale":"2024-03-04T13:00:15.958822+0000","last_undegraded":"2024-03-04T13:00:15.958822+0000","last_fullsized":"2024-03-04T13:00:15.958822+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:01.290623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243366,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":450,"num_read_kb":10713,"num_write":1269,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1088,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.217652+0000","last_change":"2024-03-04T12:36:09.315046+0000","last_active":"2024-03-04T13:00:15.217652+0000","last_peered":"2024-03-04T13:00:15.217652+0000","last_clean":"2024-03-04T13:00:15.217652+0000","last_became_active":"2024-03-04T12:36:09.314474+0000","last_became_peered":"2024-03-04T12:36:09.314474+0000","last_unstale":"2024-03-04T13:00:15.217652+0000","last_undegraded":"2024-03-04T13:00:15.217652+0000","last_fullsized":"2024-03-04T13:00:15.217652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:46:57.713946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":612,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"256'50","reported_seq":536,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:38.607544+0000","last_change":"2024-03-04T12:36:11.954876+0000","last_active":"2024-03-04T12:58:38.607544+0000","last_peered":"2024-03-04T12:58:38.607544+0000","last_clean":"2024-03-04T12:58:38.607544+0000","last_became_active":"2024-03-04T12:36:11.954508+0000","last_became_peered":"2024-03-04T12:36:11.954508+0000","last_unstale":"2024-03-04T12:58:38.607544+0000","last_undegraded":"2024-03-04T12:58:38.607544+0000","last_fullsized":"2024-03-04T12:58:38.607544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:09.989384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"256'481","reported_seq":1496,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.238885+0000","last_change":"2024-03-04T12:36:13.343179+0000","last_active":"2024-03-04T13:00:15.238885+0000","last_peered":"2024-03-04T13:00:15.238885+0000","last_clean":"2024-03-04T13:00:15.238885+0000","last_became_active":"2024-03-04T12:36:13.342902+0000","last_became_peered":"2024-03-04T12:36:13.342902+0000","last_unstale":"2024-03-04T13:00:15.238885+0000","last_undegraded":"2024-03-04T13:00:15.238885+0000","last_fullsized":"2024-03-04T13:00:15.238885+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:58.981468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"256'93","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:34.781977+0000","last_change":"2024-03-04T12:36:15.352744+0000","last_active":"2024-03-04T12:59:34.781977+0000","last_peered":"2024-03-04T12:59:34.781977+0000","last_clean":"2024-03-04T12:59:34.781977+0000","last_became_active":"2024-03-04T12:36:15.352420+0000","last_became_peered":"2024-03-04T12:36:15.352420+0000","last_unstale":"2024-03-04T12:59:34.781977+0000","last_undegraded":"2024-03-04T12:59:34.781977+0000","last_fullsized":"2024-03-04T12:59:34.781977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:55.559823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":79,"num_write":205,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"256'1079","reported_seq":2453,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.904016+0000","last_change":"2024-03-04T12:36:07.304422+0000","last_active":"2024-03-04T12:59:54.904016+0000","last_peered":"2024-03-04T12:59:54.904016+0000","last_clean":"2024-03-04T12:59:54.904016+0000","last_became_active":"2024-03-04T12:36:07.304123+0000","last_became_peered":"2024-03-04T12:36:07.304123+0000","last_unstale":"2024-03-04T12:59:54.904016+0000","last_undegraded":"2024-03-04T12:59:54.904016+0000","last_fullsized":"2024-03-04T12:59:54.904016+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1000,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:23.435722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4358,"num_read_kb":3794,"num_write":1486,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'323","reported_seq":947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.000117+0000","last_change":"2024-03-04T12:36:05.286870+0000","last_active":"2024-03-04T13:00:16.000117+0000","last_peered":"2024-03-04T13:00:16.000117+0000","last_clean":"2024-03-04T13:00:16.000117+0000","last_became_active":"2024-03-04T12:36:05.286442+0000","last_became_peered":"2024-03-04T12:36:05.286442+0000","last_unstale":"2024-03-04T13:00:16.000117+0000","last_undegraded":"2024-03-04T13:00:16.000117+0000","last_fullsized":"2024-03-04T13:00:16.000117+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:25:34.379001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7354917,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":454,"num_read_kb":22844,"num_write":1262,"num_write_kb":40494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:25.985653+0000","last_change":"2024-03-04T12:36:09.314992+0000","last_active":"2024-03-04T12:56:25.985653+0000","last_peered":"2024-03-04T12:56:25.985653+0000","last_clean":"2024-03-04T12:56:25.985653+0000","last_became_active":"2024-03-04T12:36:09.314671+0000","last_became_peered":"2024-03-04T12:36:09.314671+0000","last_unstale":"2024-03-04T12:56:25.985653+0000","last_undegraded":"2024-03-04T12:56:25.985653+0000","last_fullsized":"2024-03-04T12:56:25.985653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:57:19.079487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"256'286","reported_seq":848,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.832296+0000","last_change":"2024-03-04T12:36:11.325717+0000","last_active":"2024-03-04T13:00:08.832296+0000","last_peered":"2024-03-04T13:00:08.832296+0000","last_clean":"2024-03-04T13:00:08.832296+0000","last_became_active":"2024-03-04T12:36:11.325372+0000","last_became_peered":"2024-03-04T12:36:11.325372+0000","last_unstale":"2024-03-04T13:00:08.832296+0000","last_undegraded":"2024-03-04T13:00:08.832296+0000","last_fullsized":"2024-03-04T13:00:08.832296+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:16:12.771232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49363,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1032,"num_read_kb":1454,"num_write":1520,"num_write_kb":1422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.981677+0000","last_change":"2024-03-04T12:36:13.349278+0000","last_active":"2024-03-04T12:56:30.981677+0000","last_peered":"2024-03-04T12:56:30.981677+0000","last_clean":"2024-03-04T12:56:30.981677+0000","last_became_active":"2024-03-04T12:36:13.348998+0000","last_became_peered":"2024-03-04T12:36:13.348998+0000","last_unstale":"2024-03-04T12:56:30.981677+0000","last_undegraded":"2024-03-04T12:56:30.981677+0000","last_fullsized":"2024-03-04T12:56:30.981677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:03:29.176425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"256'116","reported_seq":596,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:43.519813+0000","last_change":"2024-03-04T12:36:15.363113+0000","last_active":"2024-03-04T12:58:43.519813+0000","last_peered":"2024-03-04T12:58:43.519813+0000","last_clean":"2024-03-04T12:58:43.519813+0000","last_became_active":"2024-03-04T12:36:15.362792+0000","last_became_peered":"2024-03-04T12:36:15.362792+0000","last_unstale":"2024-03-04T12:58:43.519813+0000","last_undegraded":"2024-03-04T12:58:43.519813+0000","last_fullsized":"2024-03-04T12:58:43.519813+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:51:39.773670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":132,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"256'316","reported_seq":1674,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.469861+0000","last_change":"2024-03-04T12:36:07.300301+0000","last_active":"2024-03-04T12:59:55.469861+0000","last_peered":"2024-03-04T12:59:55.469861+0000","last_clean":"2024-03-04T12:59:55.469861+0000","last_became_active":"2024-03-04T12:36:07.299952+0000","last_became_peered":"2024-03-04T12:36:07.299952+0000","last_unstale":"2024-03-04T12:59:55.469861+0000","last_undegraded":"2024-03-04T12:59:55.469861+0000","last_fullsized":"2024-03-04T12:59:55.469861+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:58.864307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1855,"num_read_kb":1767,"num_write":364,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":649,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.884796+0000","last_change":"2024-03-04T12:35:47.950593+0000","last_active":"2024-03-04T12:57:55.884796+0000","last_peered":"2024-03-04T12:57:55.884796+0000","last_clean":"2024-03-04T12:57:55.884796+0000","last_became_active":"2024-03-04T12:35:47.950213+0000","last_became_peered":"2024-03-04T12:35:47.950213+0000","last_unstale":"2024-03-04T12:57:55.884796+0000","last_undegraded":"2024-03-04T12:57:55.884796+0000","last_fullsized":"2024-03-04T12:57:55.884796+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_clean_scrub_stamp":"2024-03-04T12:35:46.856449+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:52:59.823887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.989264+0000","last_change":"2024-03-04T12:35:54.235102+0000","last_active":"2024-03-04T12:56:45.989264+0000","last_peered":"2024-03-04T12:56:45.989264+0000","last_clean":"2024-03-04T12:56:45.989264+0000","last_became_active":"2024-03-04T12:35:54.234819+0000","last_became_peered":"2024-03-04T12:35:54.234819+0000","last_unstale":"2024-03-04T12:56:45.989264+0000","last_undegraded":"2024-03-04T12:56:45.989264+0000","last_fullsized":"2024-03-04T12:56:45.989264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:40.517488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"256'276","reported_seq":885,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.898239+0000","last_change":"2024-03-04T12:36:05.297146+0000","last_active":"2024-03-04T13:00:15.898239+0000","last_peered":"2024-03-04T13:00:15.898239+0000","last_clean":"2024-03-04T13:00:15.898239+0000","last_became_active":"2024-03-04T12:36:05.296783+0000","last_became_peered":"2024-03-04T12:36:05.296783+0000","last_unstale":"2024-03-04T13:00:15.898239+0000","last_undegraded":"2024-03-04T13:00:15.898239+0000","last_fullsized":"2024-03-04T13:00:15.898239+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:06:23.807756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437583,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":424,"num_read_kb":16803,"num_write":1112,"num_write_kb":27899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.876708+0000","last_change":"2024-03-04T12:36:09.306698+0000","last_active":"2024-03-04T12:57:00.876708+0000","last_peered":"2024-03-04T12:57:00.876708+0000","last_clean":"2024-03-04T12:57:00.876708+0000","last_became_active":"2024-03-04T12:36:09.306398+0000","last_became_peered":"2024-03-04T12:36:09.306398+0000","last_unstale":"2024-03-04T12:57:00.876708+0000","last_undegraded":"2024-03-04T12:57:00.876708+0000","last_fullsized":"2024-03-04T12:57:00.876708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:16.000870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"256'653","reported_seq":1318,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.925262+0000","last_change":"2024-03-04T12:36:11.327855+0000","last_active":"2024-03-04T13:00:15.925262+0000","last_peered":"2024-03-04T13:00:15.925262+0000","last_clean":"2024-03-04T13:00:15.925262+0000","last_became_active":"2024-03-04T12:36:11.327652+0000","last_became_peered":"2024-03-04T12:36:11.327652+0000","last_unstale":"2024-03-04T13:00:15.925262+0000","last_undegraded":"2024-03-04T13:00:15.925262+0000","last_fullsized":"2024-03-04T13:00:15.925262+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:41:37.539307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158967,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1269,"num_read_kb":2731,"num_write":1176,"num_write_kb":1053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.003351+0000","last_change":"2024-03-04T12:36:13.341910+0000","last_active":"2024-03-04T12:57:56.003351+0000","last_peered":"2024-03-04T12:57:56.003351+0000","last_clean":"2024-03-04T12:57:56.003351+0000","last_became_active":"2024-03-04T12:36:13.341629+0000","last_became_peered":"2024-03-04T12:36:13.341629+0000","last_unstale":"2024-03-04T12:57:56.003351+0000","last_undegraded":"2024-03-04T12:57:56.003351+0000","last_fullsized":"2024-03-04T12:57:56.003351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:27:23.583364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"256'95","reported_seq":571,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.010288+0000","last_change":"2024-03-04T12:36:15.363641+0000","last_active":"2024-03-04T13:00:06.010288+0000","last_peered":"2024-03-04T13:00:06.010288+0000","last_clean":"2024-03-04T13:00:06.010288+0000","last_became_active":"2024-03-04T12:36:15.363355+0000","last_became_peered":"2024-03-04T12:36:15.363355+0000","last_unstale":"2024-03-04T13:00:06.010288+0000","last_undegraded":"2024-03-04T13:00:06.010288+0000","last_fullsized":"2024-03-04T13:00:06.010288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:41:52.622760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"256'352","reported_seq":1786,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:46.629131+0000","last_change":"2024-03-04T12:36:07.302006+0000","last_active":"2024-03-04T12:59:46.629131+0000","last_peered":"2024-03-04T12:59:46.629131+0000","last_clean":"2024-03-04T12:59:46.629131+0000","last_became_active":"2024-03-04T12:36:07.301706+0000","last_became_peered":"2024-03-04T12:36:07.301706+0000","last_unstale":"2024-03-04T12:59:46.629131+0000","last_undegraded":"2024-03-04T12:59:46.629131+0000","last_fullsized":"2024-03-04T12:59:46.629131+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:39:55.323374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2015,"num_read_kb":1927,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:00.885742+0000","last_change":"2024-03-04T12:35:54.238692+0000","last_active":"2024-03-04T12:58:00.885742+0000","last_peered":"2024-03-04T12:58:00.885742+0000","last_clean":"2024-03-04T12:58:00.885742+0000","last_became_active":"2024-03-04T12:35:54.238351+0000","last_became_peered":"2024-03-04T12:35:54.238351+0000","last_unstale":"2024-03-04T12:58:00.885742+0000","last_undegraded":"2024-03-04T12:58:00.885742+0000","last_fullsized":"2024-03-04T12:58:00.885742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:37.144629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"256'328","reported_seq":992,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.962030+0000","last_change":"2024-03-04T12:36:05.285992+0000","last_active":"2024-03-04T13:00:15.962030+0000","last_peered":"2024-03-04T13:00:15.962030+0000","last_clean":"2024-03-04T13:00:15.962030+0000","last_became_active":"2024-03-04T12:36:05.285659+0000","last_became_peered":"2024-03-04T12:36:05.285659+0000","last_unstale":"2024-03-04T13:00:15.962030+0000","last_undegraded":"2024-03-04T13:00:15.962030+0000","last_fullsized":"2024-03-04T13:00:15.962030+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:45:04.076122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11600186,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":557,"num_read_kb":21915,"num_write":1242,"num_write_kb":32530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:51.000222+0000","last_change":"2024-03-04T12:36:09.314765+0000","last_active":"2024-03-04T12:57:51.000222+0000","last_peered":"2024-03-04T12:57:51.000222+0000","last_clean":"2024-03-04T12:57:51.000222+0000","last_became_active":"2024-03-04T12:36:09.314113+0000","last_became_peered":"2024-03-04T12:36:09.314113+0000","last_unstale":"2024-03-04T12:57:51.000222+0000","last_undegraded":"2024-03-04T12:57:51.000222+0000","last_fullsized":"2024-03-04T12:57:51.000222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:55.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"256'1008","reported_seq":2112,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.879794+0000","last_change":"2024-03-04T12:36:11.323823+0000","last_active":"2024-03-04T13:00:15.879794+0000","last_peered":"2024-03-04T13:00:15.879794+0000","last_clean":"2024-03-04T13:00:15.879794+0000","last_became_active":"2024-03-04T12:36:11.323543+0000","last_became_peered":"2024-03-04T12:36:11.323543+0000","last_unstale":"2024-03-04T13:00:15.879794+0000","last_undegraded":"2024-03-04T13:00:15.879794+0000","last_fullsized":"2024-03-04T13:00:15.879794+0000","mapping_epoch":26,"log_start":"256'900","ondisk_log_start":"256'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":900,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:18.828076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168633,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1588,"num_read_kb":3038,"num_write":960,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.878183+0000","last_change":"2024-03-04T12:36:13.339634+0000","last_active":"2024-03-04T12:57:10.878183+0000","last_peered":"2024-03-04T12:57:10.878183+0000","last_clean":"2024-03-04T12:57:10.878183+0000","last_became_active":"2024-03-04T12:36:13.339353+0000","last_became_peered":"2024-03-04T12:36:13.339353+0000","last_unstale":"2024-03-04T12:57:10.878183+0000","last_undegraded":"2024-03-04T12:57:10.878183+0000","last_fullsized":"2024-03-04T12:57:10.878183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:35.363812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"256'145","reported_seq":632,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:45.918673+0000","last_change":"2024-03-04T12:36:15.346836+0000","last_active":"2024-03-04T12:59:45.918673+0000","last_peered":"2024-03-04T12:59:45.918673+0000","last_clean":"2024-03-04T12:59:45.918673+0000","last_became_active":"2024-03-04T12:36:15.346516+0000","last_became_peered":"2024-03-04T12:36:15.346516+0000","last_unstale":"2024-03-04T12:59:45.918673+0000","last_undegraded":"2024-03-04T12:59:45.918673+0000","last_fullsized":"2024-03-04T12:59:45.918673+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:23:48.979559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":196,"num_read_kb":196,"num_write":318,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"256'397","reported_seq":1866,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.670858+0000","last_change":"2024-03-04T12:36:07.303682+0000","last_active":"2024-03-04T13:00:06.670858+0000","last_peered":"2024-03-04T13:00:06.670858+0000","last_clean":"2024-03-04T13:00:06.670858+0000","last_became_active":"2024-03-04T12:36:07.300039+0000","last_became_peered":"2024-03-04T12:36:07.300039+0000","last_unstale":"2024-03-04T13:00:06.670858+0000","last_undegraded":"2024-03-04T13:00:06.670858+0000","last_fullsized":"2024-03-04T13:00:06.670858+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:24.962188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2349,"num_read_kb":2220,"num_write":468,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":492,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.981094+0000","last_change":"2024-03-04T12:35:54.236078+0000","last_active":"2024-03-04T12:56:45.981094+0000","last_peered":"2024-03-04T12:56:45.981094+0000","last_clean":"2024-03-04T12:56:45.981094+0000","last_became_active":"2024-03-04T12:35:54.235738+0000","last_became_peered":"2024-03-04T12:35:54.235738+0000","last_unstale":"2024-03-04T12:56:45.981094+0000","last_undegraded":"2024-03-04T12:56:45.981094+0000","last_fullsized":"2024-03-04T12:56:45.981094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:36:28.049431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"256'337","reported_seq":1225,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.939543+0000","last_change":"2024-03-04T12:36:05.275101+0000","last_active":"2024-03-04T13:00:15.939543+0000","last_peered":"2024-03-04T13:00:15.939543+0000","last_clean":"2024-03-04T13:00:15.939543+0000","last_became_active":"2024-03-04T12:36:05.274788+0000","last_became_peered":"2024-03-04T12:36:05.274788+0000","last_unstale":"2024-03-04T13:00:15.939543+0000","last_undegraded":"2024-03-04T13:00:15.939543+0000","last_fullsized":"2024-03-04T13:00:15.939543+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:42.330697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9511894,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":1057,"num_read_kb":10802,"num_write":1404,"num_write_kb":39091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.988318+0000","last_change":"2024-03-04T12:36:09.315373+0000","last_active":"2024-03-04T12:57:50.988318+0000","last_peered":"2024-03-04T12:57:50.988318+0000","last_clean":"2024-03-04T12:57:50.988318+0000","last_became_active":"2024-03-04T12:36:09.315023+0000","last_became_peered":"2024-03-04T12:36:09.315023+0000","last_unstale":"2024-03-04T12:57:50.988318+0000","last_undegraded":"2024-03-04T12:57:50.988318+0000","last_fullsized":"2024-03-04T12:57:50.988318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:07:21.105335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"256'188","reported_seq":992,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.829479+0000","last_change":"2024-03-04T12:36:11.955503+0000","last_active":"2024-03-04T13:00:08.829479+0000","last_peered":"2024-03-04T13:00:08.829479+0000","last_clean":"2024-03-04T13:00:08.829479+0000","last_became_active":"2024-03-04T12:36:11.954554+0000","last_became_peered":"2024-03-04T12:36:11.954554+0000","last_unstale":"2024-03-04T13:00:08.829479+0000","last_undegraded":"2024-03-04T13:00:08.829479+0000","last_fullsized":"2024-03-04T13:00:08.829479+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:18:36.129703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:05.997035+0000","last_change":"2024-03-04T12:36:13.338785+0000","last_active":"2024-03-04T12:57:05.997035+0000","last_peered":"2024-03-04T12:57:05.997035+0000","last_clean":"2024-03-04T12:57:05.997035+0000","last_became_active":"2024-03-04T12:36:13.338388+0000","last_became_peered":"2024-03-04T12:36:13.338388+0000","last_unstale":"2024-03-04T12:57:05.997035+0000","last_undegraded":"2024-03-04T12:57:05.997035+0000","last_fullsized":"2024-03-04T12:57:05.997035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:15.536794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'192","reported_seq":682,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:17.459051+0000","last_change":"2024-03-04T12:36:15.354193+0000","last_active":"2024-03-04T12:59:17.459051+0000","last_peered":"2024-03-04T12:59:17.459051+0000","last_clean":"2024-03-04T12:59:17.459051+0000","last_became_active":"2024-03-04T12:36:15.353529+0000","last_became_peered":"2024-03-04T12:36:15.353529+0000","last_unstale":"2024-03-04T12:59:17.459051+0000","last_undegraded":"2024-03-04T12:59:17.459051+0000","last_fullsized":"2024-03-04T12:59:17.459051+0000","mapping_epoch":30,"log_start":"241'100","ondisk_log_start":"241'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:04.219643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":292,"num_read_kb":316,"num_write":426,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"256'393","reported_seq":1822,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671228+0000","last_change":"2024-03-04T12:36:07.299521+0000","last_active":"2024-03-04T13:00:06.671228+0000","last_peered":"2024-03-04T13:00:06.671228+0000","last_clean":"2024-03-04T13:00:06.671228+0000","last_became_active":"2024-03-04T12:36:07.298936+0000","last_became_peered":"2024-03-04T12:36:07.298936+0000","last_unstale":"2024-03-04T13:00:06.671228+0000","last_undegraded":"2024-03-04T13:00:06.671228+0000","last_fullsized":"2024-03-04T13:00:06.671228+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:42:23.027185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2152,"num_read_kb":2018,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.989215+0000","last_change":"2024-03-04T12:35:54.238657+0000","last_active":"2024-03-04T12:56:45.989215+0000","last_peered":"2024-03-04T12:56:45.989215+0000","last_clean":"2024-03-04T12:56:45.989215+0000","last_became_active":"2024-03-04T12:35:54.238357+0000","last_became_peered":"2024-03-04T12:35:54.238357+0000","last_unstale":"2024-03-04T12:56:45.989215+0000","last_undegraded":"2024-03-04T12:56:45.989215+0000","last_fullsized":"2024-03-04T12:56:45.989215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:33:05.241037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"256'289","reported_seq":937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.937621+0000","last_change":"2024-03-04T12:36:05.289667+0000","last_active":"2024-03-04T13:00:15.937621+0000","last_peered":"2024-03-04T13:00:15.937621+0000","last_clean":"2024-03-04T13:00:15.937621+0000","last_became_active":"2024-03-04T12:36:05.289374+0000","last_became_peered":"2024-03-04T12:36:05.289374+0000","last_unstale":"2024-03-04T13:00:15.937621+0000","last_undegraded":"2024-03-04T13:00:15.937621+0000","last_fullsized":"2024-03-04T13:00:15.937621+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:40:44.869761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10396162,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":493,"num_read_kb":54490,"num_write":1239,"num_write_kb":39662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996409+0000","last_change":"2024-03-04T12:36:09.304779+0000","last_active":"2024-03-04T12:57:00.996409+0000","last_peered":"2024-03-04T12:57:00.996409+0000","last_clean":"2024-03-04T12:57:00.996409+0000","last_became_active":"2024-03-04T12:36:09.304291+0000","last_became_peered":"2024-03-04T12:36:09.304291+0000","last_unstale":"2024-03-04T12:57:00.996409+0000","last_undegraded":"2024-03-04T12:57:00.996409+0000","last_fullsized":"2024-03-04T12:57:00.996409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:49.161718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"256'81","reported_seq":586,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:12.360275+0000","last_change":"2024-03-04T12:36:11.326239+0000","last_active":"2024-03-04T12:59:12.360275+0000","last_peered":"2024-03-04T12:59:12.360275+0000","last_clean":"2024-03-04T12:59:12.360275+0000","last_became_active":"2024-03-04T12:36:11.325957+0000","last_became_peered":"2024-03-04T12:36:11.325957+0000","last_unstale":"2024-03-04T12:59:12.360275+0000","last_undegraded":"2024-03-04T12:59:12.360275+0000","last_fullsized":"2024-03-04T12:59:12.360275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:45:15.387282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":66,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":466,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.993163+0000","last_change":"2024-03-04T12:36:13.345759+0000","last_active":"2024-03-04T12:57:55.993163+0000","last_peered":"2024-03-04T12:57:55.993163+0000","last_clean":"2024-03-04T12:57:55.993163+0000","last_became_active":"2024-03-04T12:36:13.345547+0000","last_became_peered":"2024-03-04T12:36:13.345547+0000","last_unstale":"2024-03-04T12:57:55.993163+0000","last_undegraded":"2024-03-04T12:57:55.993163+0000","last_fullsized":"2024-03-04T12:57:55.993163+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:20.602726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"256'111","reported_seq":598,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:17.289185+0000","last_change":"2024-03-04T12:36:15.363530+0000","last_active":"2024-03-04T12:59:17.289185+0000","last_peered":"2024-03-04T12:59:17.289185+0000","last_clean":"2024-03-04T12:59:17.289185+0000","last_became_active":"2024-03-04T12:36:15.363185+0000","last_became_peered":"2024-03-04T12:36:15.363185+0000","last_unstale":"2024-03-04T12:59:17.289185+0000","last_undegraded":"2024-03-04T12:59:17.289185+0000","last_fullsized":"2024-03-04T12:59:17.289185+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:16.150410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":251,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"256'464","reported_seq":2007,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.027056+0000","last_change":"2024-03-04T12:36:07.297241+0000","last_active":"2024-03-04T12:59:56.027056+0000","last_peered":"2024-03-04T12:59:56.027056+0000","last_clean":"2024-03-04T12:59:56.027056+0000","last_became_active":"2024-03-04T12:36:07.296433+0000","last_became_peered":"2024-03-04T12:36:07.296433+0000","last_unstale":"2024-03-04T12:59:56.027056+0000","last_undegraded":"2024-03-04T12:59:56.027056+0000","last_fullsized":"2024-03-04T12:59:56.027056+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:57:02.539909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2396,"num_read_kb":2259,"num_write":579,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"256'350","reported_seq":1003,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.997751+0000","last_change":"2024-03-04T12:36:40.965648+0000","last_active":"2024-03-04T13:00:15.997751+0000","last_peered":"2024-03-04T13:00:15.997751+0000","last_clean":"2024-03-04T13:00:15.997751+0000","last_became_active":"2024-03-04T12:36:40.965346+0000","last_became_peered":"2024-03-04T12:36:40.965346+0000","last_unstale":"2024-03-04T13:00:15.997751+0000","last_undegraded":"2024-03-04T13:00:15.997751+0000","last_fullsized":"2024-03-04T13:00:15.997751+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:34.208423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6319328,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":575,"num_read_kb":48879,"num_write":1423,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.977490+0000","last_change":"2024-03-04T12:35:54.470673+0000","last_active":"2024-03-04T12:56:45.977490+0000","last_peered":"2024-03-04T12:56:45.977490+0000","last_clean":"2024-03-04T12:56:45.977490+0000","last_became_active":"2024-03-04T12:35:54.470407+0000","last_became_peered":"2024-03-04T12:35:54.470407+0000","last_unstale":"2024-03-04T12:56:45.977490+0000","last_undegraded":"2024-03-04T12:56:45.977490+0000","last_fullsized":"2024-03-04T12:56:45.977490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:30:21.008474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996381+0000","last_change":"2024-03-04T12:36:09.308620+0000","last_active":"2024-03-04T12:57:00.996381+0000","last_peered":"2024-03-04T12:57:00.996381+0000","last_clean":"2024-03-04T12:57:00.996381+0000","last_became_active":"2024-03-04T12:36:09.308360+0000","last_became_peered":"2024-03-04T12:36:09.308360+0000","last_unstale":"2024-03-04T12:57:00.996381+0000","last_undegraded":"2024-03-04T12:57:00.996381+0000","last_fullsized":"2024-03-04T12:57:00.996381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:12:02.956921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"256'484","reported_seq":1103,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.807353+0000","last_change":"2024-03-04T12:36:11.329225+0000","last_active":"2024-03-04T13:00:15.807353+0000","last_peered":"2024-03-04T13:00:15.807353+0000","last_clean":"2024-03-04T13:00:15.807353+0000","last_became_active":"2024-03-04T12:36:11.328923+0000","last_became_peered":"2024-03-04T12:36:11.328923+0000","last_unstale":"2024-03-04T13:00:15.807353+0000","last_undegraded":"2024-03-04T13:00:15.807353+0000","last_fullsized":"2024-03-04T13:00:15.807353+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:50.151006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":830,"num_read_kb":1802,"num_write":674,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:05.992670+0000","last_change":"2024-03-04T12:36:13.347228+0000","last_active":"2024-03-04T12:57:05.992670+0000","last_peered":"2024-03-04T12:57:05.992670+0000","last_clean":"2024-03-04T12:57:05.992670+0000","last_became_active":"2024-03-04T12:36:13.346886+0000","last_became_peered":"2024-03-04T12:36:13.346886+0000","last_unstale":"2024-03-04T12:57:05.992670+0000","last_undegraded":"2024-03-04T12:57:05.992670+0000","last_fullsized":"2024-03-04T12:57:05.992670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:14.642237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"256'94","reported_seq":573,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.020901+0000","last_change":"2024-03-04T12:36:15.350589+0000","last_active":"2024-03-04T12:59:56.020901+0000","last_peered":"2024-03-04T12:59:56.020901+0000","last_clean":"2024-03-04T12:59:56.020901+0000","last_became_active":"2024-03-04T12:36:15.350185+0000","last_became_peered":"2024-03-04T12:36:15.350185+0000","last_unstale":"2024-03-04T12:59:56.020901+0000","last_undegraded":"2024-03-04T12:59:56.020901+0000","last_fullsized":"2024-03-04T12:59:56.020901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:06:50.695793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":228,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"256'646","reported_seq":2008,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.609894+0000","last_change":"2024-03-04T12:36:07.296955+0000","last_active":"2024-03-04T12:59:47.609894+0000","last_peered":"2024-03-04T12:59:47.609894+0000","last_clean":"2024-03-04T12:59:47.609894+0000","last_became_active":"2024-03-04T12:36:07.296657+0000","last_became_peered":"2024-03-04T12:36:07.296657+0000","last_unstale":"2024-03-04T12:59:47.609894+0000","last_undegraded":"2024-03-04T12:59:47.609894+0000","last_fullsized":"2024-03-04T12:59:47.609894+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":600,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:09.500092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3068,"num_read_kb":2828,"num_write":988,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"256'311","reported_seq":984,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.890225+0000","last_change":"2024-03-04T12:36:05.275545+0000","last_active":"2024-03-04T13:00:15.890225+0000","last_peered":"2024-03-04T13:00:15.890225+0000","last_clean":"2024-03-04T13:00:15.890225+0000","last_became_active":"2024-03-04T12:36:05.275263+0000","last_became_peered":"2024-03-04T12:36:05.275263+0000","last_unstale":"2024-03-04T13:00:15.890225+0000","last_undegraded":"2024-03-04T13:00:15.890225+0000","last_fullsized":"2024-03-04T13:00:15.890225+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:05.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14025863,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":601,"num_read_kb":62539,"num_write":1399,"num_write_kb":42561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":492,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:50.875403+0000","last_change":"2024-03-04T12:35:54.470913+0000","last_active":"2024-03-04T12:56:50.875403+0000","last_peered":"2024-03-04T12:56:50.875403+0000","last_clean":"2024-03-04T12:56:50.875403+0000","last_became_active":"2024-03-04T12:35:54.470620+0000","last_became_peered":"2024-03-04T12:35:54.470620+0000","last_unstale":"2024-03-04T12:56:50.875403+0000","last_undegraded":"2024-03-04T12:56:50.875403+0000","last_fullsized":"2024-03-04T12:56:50.875403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:00.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.985543+0000","last_change":"2024-03-04T12:36:09.312394+0000","last_active":"2024-03-04T12:57:00.985543+0000","last_peered":"2024-03-04T12:57:00.985543+0000","last_clean":"2024-03-04T12:57:00.985543+0000","last_became_active":"2024-03-04T12:36:09.312135+0000","last_became_peered":"2024-03-04T12:36:09.312135+0000","last_unstale":"2024-03-04T12:57:00.985543+0000","last_undegraded":"2024-03-04T12:57:00.985543+0000","last_fullsized":"2024-03-04T12:57:00.985543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:40:59.354604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"256'139","reported_seq":665,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.644974+0000","last_change":"2024-03-04T12:36:11.954977+0000","last_active":"2024-03-04T12:59:48.644974+0000","last_peered":"2024-03-04T12:59:48.644974+0000","last_clean":"2024-03-04T12:59:48.644974+0000","last_became_active":"2024-03-04T12:36:11.954579+0000","last_became_peered":"2024-03-04T12:36:11.954579+0000","last_unstale":"2024-03-04T12:59:48.644974+0000","last_undegraded":"2024-03-04T12:59:48.644974+0000","last_fullsized":"2024-03-04T12:59:48.644974+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:39.654798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":130,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"256'544","reported_seq":4062,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.236192+0000","last_change":"2024-03-04T12:36:13.342293+0000","last_active":"2024-03-04T13:00:15.236192+0000","last_peered":"2024-03-04T13:00:15.236192+0000","last_clean":"2024-03-04T13:00:15.236192+0000","last_became_active":"2024-03-04T12:36:13.341957+0000","last_became_peered":"2024-03-04T12:36:13.341957+0000","last_unstale":"2024-03-04T13:00:15.236192+0000","last_undegraded":"2024-03-04T13:00:15.236192+0000","last_fullsized":"2024-03-04T13:00:15.236192+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:06.453055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"256'123","reported_seq":596,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.050692+0000","last_change":"2024-03-04T12:36:15.355664+0000","last_active":"2024-03-04T12:59:53.050692+0000","last_peered":"2024-03-04T12:59:53.050692+0000","last_clean":"2024-03-04T12:59:53.050692+0000","last_became_active":"2024-03-04T12:36:15.355291+0000","last_became_peered":"2024-03-04T12:36:15.355291+0000","last_unstale":"2024-03-04T12:59:53.050692+0000","last_undegraded":"2024-03-04T12:59:53.050692+0000","last_fullsized":"2024-03-04T12:59:53.050692+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:08.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"256'743","reported_seq":2161,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.045676+0000","last_change":"2024-03-04T12:36:07.290212+0000","last_active":"2024-03-04T12:59:53.045676+0000","last_peered":"2024-03-04T12:59:53.045676+0000","last_clean":"2024-03-04T12:59:53.045676+0000","last_became_active":"2024-03-04T12:36:07.289884+0000","last_became_peered":"2024-03-04T12:36:07.289884+0000","last_unstale":"2024-03-04T12:59:53.045676+0000","last_undegraded":"2024-03-04T12:59:53.045676+0000","last_fullsized":"2024-03-04T12:59:53.045676+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:07.678104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3351,"num_read_kb":2980,"num_write":997,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"256'280","reported_seq":886,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.946811+0000","last_change":"2024-03-04T12:36:05.291839+0000","last_active":"2024-03-04T13:00:15.946811+0000","last_peered":"2024-03-04T13:00:15.946811+0000","last_clean":"2024-03-04T13:00:15.946811+0000","last_became_active":"2024-03-04T12:36:05.291549+0000","last_became_peered":"2024-03-04T12:36:05.291549+0000","last_unstale":"2024-03-04T13:00:15.946811+0000","last_undegraded":"2024-03-04T13:00:15.946811+0000","last_fullsized":"2024-03-04T13:00:15.946811+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:39.785480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9454214,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":408,"num_read_kb":36332,"num_write":1088,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:35.983734+0000","last_change":"2024-03-04T12:35:54.239060+0000","last_active":"2024-03-04T12:57:35.983734+0000","last_peered":"2024-03-04T12:57:35.983734+0000","last_clean":"2024-03-04T12:57:35.983734+0000","last_became_active":"2024-03-04T12:35:54.238802+0000","last_became_peered":"2024-03-04T12:35:54.238802+0000","last_unstale":"2024-03-04T12:57:35.983734+0000","last_undegraded":"2024-03-04T12:57:35.983734+0000","last_fullsized":"2024-03-04T12:57:35.983734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:29.643511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991892+0000","last_change":"2024-03-04T12:36:09.307816+0000","last_active":"2024-03-04T12:57:00.991892+0000","last_peered":"2024-03-04T12:57:00.991892+0000","last_clean":"2024-03-04T12:57:00.991892+0000","last_became_active":"2024-03-04T12:36:09.307467+0000","last_became_peered":"2024-03-04T12:36:09.307467+0000","last_unstale":"2024-03-04T12:57:00.991892+0000","last_undegraded":"2024-03-04T12:57:00.991892+0000","last_fullsized":"2024-03-04T12:57:00.991892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:30:08.145067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"256'78","reported_seq":585,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:34.753384+0000","last_change":"2024-03-04T12:36:11.326288+0000","last_active":"2024-03-04T12:58:34.753384+0000","last_peered":"2024-03-04T12:58:34.753384+0000","last_clean":"2024-03-04T12:58:34.753384+0000","last_became_active":"2024-03-04T12:36:11.325955+0000","last_became_peered":"2024-03-04T12:36:11.325955+0000","last_unstale":"2024-03-04T12:58:34.753384+0000","last_undegraded":"2024-03-04T12:58:34.753384+0000","last_fullsized":"2024-03-04T12:58:34.753384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:39:41.658332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"256'533","reported_seq":1565,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.239222+0000","last_change":"2024-03-04T12:36:13.349703+0000","last_active":"2024-03-04T13:00:15.239222+0000","last_peered":"2024-03-04T13:00:15.239222+0000","last_clean":"2024-03-04T13:00:15.239222+0000","last_became_active":"2024-03-04T12:36:13.349421+0000","last_became_peered":"2024-03-04T12:36:13.349421+0000","last_unstale":"2024-03-04T13:00:15.239222+0000","last_undegraded":"2024-03-04T13:00:15.239222+0000","last_fullsized":"2024-03-04T13:00:15.239222+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:52:42.138224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"256'96","reported_seq":565,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.767846+0000","last_change":"2024-03-04T12:36:15.356492+0000","last_active":"2024-03-04T12:59:50.767846+0000","last_peered":"2024-03-04T12:59:50.767846+0000","last_clean":"2024-03-04T12:59:50.767846+0000","last_became_active":"2024-03-04T12:36:15.356192+0000","last_became_peered":"2024-03-04T12:36:15.356192+0000","last_unstale":"2024-03-04T12:59:50.767846+0000","last_undegraded":"2024-03-04T12:59:50.767846+0000","last_fullsized":"2024-03-04T12:59:50.767846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:15:40.455972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":232,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"256'390","reported_seq":1911,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.017107+0000","last_change":"2024-03-04T12:36:07.299701+0000","last_active":"2024-03-04T12:59:54.017107+0000","last_peered":"2024-03-04T12:59:54.017107+0000","last_clean":"2024-03-04T12:59:54.017107+0000","last_became_active":"2024-03-04T12:36:07.298963+0000","last_became_peered":"2024-03-04T12:36:07.298963+0000","last_unstale":"2024-03-04T12:59:54.017107+0000","last_undegraded":"2024-03-04T12:59:54.017107+0000","last_fullsized":"2024-03-04T12:59:54.017107+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:26.582084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2139,"num_write":463,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"256'288","reported_seq":898,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.013530+0000","last_change":"2024-03-04T12:36:05.282071+0000","last_active":"2024-03-04T13:00:16.013530+0000","last_peered":"2024-03-04T13:00:16.013530+0000","last_clean":"2024-03-04T13:00:16.013530+0000","last_became_active":"2024-03-04T12:36:05.281790+0000","last_became_peered":"2024-03-04T12:36:05.281790+0000","last_unstale":"2024-03-04T13:00:16.013530+0000","last_undegraded":"2024-03-04T13:00:16.013530+0000","last_fullsized":"2024-03-04T13:00:16.013530+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:07.529352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1779838,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":425,"num_read_kb":33441,"num_write":1152,"num_write_kb":31732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":488,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:35.990462+0000","last_change":"2024-03-04T12:35:54.239095+0000","last_active":"2024-03-04T12:57:35.990462+0000","last_peered":"2024-03-04T12:57:35.990462+0000","last_clean":"2024-03-04T12:57:35.990462+0000","last_became_active":"2024-03-04T12:35:54.238580+0000","last_became_peered":"2024-03-04T12:35:54.238580+0000","last_unstale":"2024-03-04T12:57:35.990462+0000","last_undegraded":"2024-03-04T12:57:35.990462+0000","last_fullsized":"2024-03-04T12:57:35.990462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:51.568234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:10.988802+0000","last_change":"2024-03-04T12:36:09.308483+0000","last_active":"2024-03-04T12:58:10.988802+0000","last_peered":"2024-03-04T12:58:10.988802+0000","last_clean":"2024-03-04T12:58:10.988802+0000","last_became_active":"2024-03-04T12:36:09.308162+0000","last_became_peered":"2024-03-04T12:36:09.308162+0000","last_unstale":"2024-03-04T12:58:10.988802+0000","last_undegraded":"2024-03-04T12:58:10.988802+0000","last_fullsized":"2024-03-04T12:58:10.988802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:27.690789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"256'696","reported_seq":1373,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.607555+0000","last_change":"2024-03-04T12:36:11.955174+0000","last_active":"2024-03-04T13:00:15.607555+0000","last_peered":"2024-03-04T13:00:15.607555+0000","last_clean":"2024-03-04T13:00:15.607555+0000","last_became_active":"2024-03-04T12:36:11.954569+0000","last_became_peered":"2024-03-04T12:36:11.954569+0000","last_unstale":"2024-03-04T13:00:15.607555+0000","last_undegraded":"2024-03-04T13:00:15.607555+0000","last_fullsized":"2024-03-04T13:00:15.607555+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:12.036941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161442,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1251,"num_read_kb":2835,"num_write":1034,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:05.980274+0000","last_change":"2024-03-04T12:36:13.346191+0000","last_active":"2024-03-04T12:57:05.980274+0000","last_peered":"2024-03-04T12:57:05.980274+0000","last_clean":"2024-03-04T12:57:05.980274+0000","last_became_active":"2024-03-04T12:36:13.345919+0000","last_became_peered":"2024-03-04T12:36:13.345919+0000","last_unstale":"2024-03-04T12:57:05.980274+0000","last_undegraded":"2024-03-04T12:57:05.980274+0000","last_fullsized":"2024-03-04T12:57:05.980274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:25.153970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"256'128","reported_seq":591,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:40.768192+0000","last_change":"2024-03-04T12:36:15.363169+0000","last_active":"2024-03-04T12:59:40.768192+0000","last_peered":"2024-03-04T12:59:40.768192+0000","last_clean":"2024-03-04T12:59:40.768192+0000","last_became_active":"2024-03-04T12:36:15.362710+0000","last_became_peered":"2024-03-04T12:36:15.362710+0000","last_unstale":"2024-03-04T12:59:40.768192+0000","last_undegraded":"2024-03-04T12:59:40.768192+0000","last_fullsized":"2024-03-04T12:59:40.768192+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:18:23.671452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"256'110","reported_seq":571,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.681038+0000","last_change":"2024-03-04T12:36:15.363367+0000","last_active":"2024-03-04T13:00:06.681038+0000","last_peered":"2024-03-04T13:00:06.681038+0000","last_clean":"2024-03-04T13:00:06.681038+0000","last_became_active":"2024-03-04T12:36:15.363057+0000","last_became_peered":"2024-03-04T12:36:15.363057+0000","last_unstale":"2024-03-04T13:00:06.681038+0000","last_undegraded":"2024-03-04T13:00:06.681038+0000","last_fullsized":"2024-03-04T13:00:06.681038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:35.204210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":263,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"256'521","reported_seq":2070,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:45.901603+0000","last_change":"2024-03-04T12:36:07.294876+0000","last_active":"2024-03-04T12:59:45.901603+0000","last_peered":"2024-03-04T12:59:45.901603+0000","last_clean":"2024-03-04T12:59:45.901603+0000","last_became_active":"2024-03-04T12:36:07.292930+0000","last_became_peered":"2024-03-04T12:36:07.292930+0000","last_unstale":"2024-03-04T12:59:45.901603+0000","last_undegraded":"2024-03-04T12:59:45.901603+0000","last_fullsized":"2024-03-04T12:59:45.901603+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:15:17.193064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2723,"num_read_kb":2502,"num_write":698,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"256'284","reported_seq":920,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.974266+0000","last_change":"2024-03-04T12:36:05.287586+0000","last_active":"2024-03-04T13:00:15.974266+0000","last_peered":"2024-03-04T13:00:15.974266+0000","last_clean":"2024-03-04T13:00:15.974266+0000","last_became_active":"2024-03-04T12:36:05.287299+0000","last_became_peered":"2024-03-04T12:36:05.287299+0000","last_unstale":"2024-03-04T13:00:15.974266+0000","last_undegraded":"2024-03-04T13:00:15.974266+0000","last_fullsized":"2024-03-04T13:00:15.974266+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:40.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3828104,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":463,"num_read_kb":31884,"num_write":1224,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"32'3","reported_seq":788,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.206991+0000","last_change":"2024-03-04T12:36:09.315302+0000","last_active":"2024-03-04T13:00:15.206991+0000","last_peered":"2024-03-04T13:00:15.206991+0000","last_clean":"2024-03-04T13:00:15.206991+0000","last_became_active":"2024-03-04T12:36:09.314810+0000","last_became_peered":"2024-03-04T12:36:09.314810+0000","last_unstale":"2024-03-04T13:00:15.206991+0000","last_undegraded":"2024-03-04T13:00:15.206991+0000","last_fullsized":"2024-03-04T13:00:15.206991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:17:00.218822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"256'241","reported_seq":780,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.684756+0000","last_change":"2024-03-04T12:36:11.324996+0000","last_active":"2024-03-04T13:00:08.684756+0000","last_peered":"2024-03-04T13:00:08.684756+0000","last_clean":"2024-03-04T13:00:08.684756+0000","last_became_active":"2024-03-04T12:36:11.323046+0000","last_became_peered":"2024-03-04T12:36:11.323046+0000","last_unstale":"2024-03-04T13:00:08.684756+0000","last_undegraded":"2024-03-04T13:00:08.684756+0000","last_fullsized":"2024-03-04T13:00:08.684756+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:10:29.009516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":394,"num_read_kb":838,"num_write":324,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":467,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.981601+0000","last_change":"2024-03-04T12:36:13.349171+0000","last_active":"2024-03-04T12:57:15.981601+0000","last_peered":"2024-03-04T12:57:15.981601+0000","last_clean":"2024-03-04T12:57:15.981601+0000","last_became_active":"2024-03-04T12:36:13.348696+0000","last_became_peered":"2024-03-04T12:36:13.348696+0000","last_unstale":"2024-03-04T12:57:15.981601+0000","last_undegraded":"2024-03-04T12:57:15.981601+0000","last_fullsized":"2024-03-04T12:57:15.981601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:01:19.715486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"256'83","reported_seq":554,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:20.071261+0000","last_change":"2024-03-04T12:36:15.354645+0000","last_active":"2024-03-04T12:59:20.071261+0000","last_peered":"2024-03-04T12:59:20.071261+0000","last_clean":"2024-03-04T12:59:20.071261+0000","last_became_active":"2024-03-04T12:36:15.354258+0000","last_became_peered":"2024-03-04T12:36:15.354258+0000","last_unstale":"2024-03-04T12:59:20.071261+0000","last_undegraded":"2024-03-04T12:59:20.071261+0000","last_fullsized":"2024-03-04T12:59:20.071261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:30.504574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":75,"num_write":188,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"256'355","reported_seq":1704,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.956805+0000","last_change":"2024-03-04T12:36:07.296187+0000","last_active":"2024-03-04T13:00:06.956805+0000","last_peered":"2024-03-04T13:00:06.956805+0000","last_clean":"2024-03-04T13:00:06.956805+0000","last_became_active":"2024-03-04T12:36:07.295803+0000","last_became_peered":"2024-03-04T12:36:07.295803+0000","last_unstale":"2024-03-04T13:00:06.956805+0000","last_undegraded":"2024-03-04T13:00:06.956805+0000","last_fullsized":"2024-03-04T13:00:06.956805+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:19:02.700056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1867,"num_read_kb":1777,"num_write":399,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"256'289","reported_seq":904,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.902010+0000","last_change":"2024-03-04T12:36:05.296316+0000","last_active":"2024-03-04T13:00:15.902010+0000","last_peered":"2024-03-04T13:00:15.902010+0000","last_clean":"2024-03-04T13:00:15.902010+0000","last_became_active":"2024-03-04T12:36:05.296032+0000","last_became_peered":"2024-03-04T12:36:05.296032+0000","last_unstale":"2024-03-04T13:00:15.902010+0000","last_undegraded":"2024-03-04T13:00:15.902010+0000","last_fullsized":"2024-03-04T13:00:15.902010+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:48:22.903820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4590334,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":441,"num_read_kb":28471,"num_write":1095,"num_write_kb":37420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.980941+0000","last_change":"2024-03-04T12:36:09.312289+0000","last_active":"2024-03-04T12:57:10.980941+0000","last_peered":"2024-03-04T12:57:10.980941+0000","last_clean":"2024-03-04T12:57:10.980941+0000","last_became_active":"2024-03-04T12:36:09.311953+0000","last_became_peered":"2024-03-04T12:36:09.311953+0000","last_unstale":"2024-03-04T12:57:10.980941+0000","last_undegraded":"2024-03-04T12:57:10.980941+0000","last_fullsized":"2024-03-04T12:57:10.980941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:21:39.688491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"256'31","reported_seq":504,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.950097+0000","last_change":"2024-03-04T12:36:11.326600+0000","last_active":"2024-03-04T12:58:30.950097+0000","last_peered":"2024-03-04T12:58:30.950097+0000","last_clean":"2024-03-04T12:58:30.950097+0000","last_became_active":"2024-03-04T12:36:11.326313+0000","last_became_peered":"2024-03-04T12:36:11.326313+0000","last_unstale":"2024-03-04T12:58:30.950097+0000","last_undegraded":"2024-03-04T12:58:30.950097+0000","last_fullsized":"2024-03-04T12:58:30.950097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:52.781748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":469,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.878921+0000","last_change":"2024-03-04T12:36:13.340743+0000","last_active":"2024-03-04T12:57:15.878921+0000","last_peered":"2024-03-04T12:57:15.878921+0000","last_clean":"2024-03-04T12:57:15.878921+0000","last_became_active":"2024-03-04T12:36:13.340203+0000","last_became_peered":"2024-03-04T12:36:13.340203+0000","last_unstale":"2024-03-04T12:57:15.878921+0000","last_undegraded":"2024-03-04T12:57:15.878921+0000","last_fullsized":"2024-03-04T12:57:15.878921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:09:09.659186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"256'90","reported_seq":564,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:47.266263+0000","last_change":"2024-03-04T12:36:15.353818+0000","last_active":"2024-03-04T12:58:47.266263+0000","last_peered":"2024-03-04T12:58:47.266263+0000","last_clean":"2024-03-04T12:58:47.266263+0000","last_became_active":"2024-03-04T12:36:15.353545+0000","last_became_peered":"2024-03-04T12:36:15.353545+0000","last_unstale":"2024-03-04T12:58:47.266263+0000","last_undegraded":"2024-03-04T12:58:47.266263+0000","last_fullsized":"2024-03-04T12:58:47.266263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:10.906970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":106,"num_write":213,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"256'994","reported_seq":2543,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.899888+0000","last_change":"2024-03-04T12:36:07.300137+0000","last_active":"2024-03-04T12:59:54.899888+0000","last_peered":"2024-03-04T12:59:54.899888+0000","last_clean":"2024-03-04T12:59:54.899888+0000","last_became_active":"2024-03-04T12:36:07.299326+0000","last_became_peered":"2024-03-04T12:36:07.299326+0000","last_unstale":"2024-03-04T12:59:54.899888+0000","last_undegraded":"2024-03-04T12:59:54.899888+0000","last_fullsized":"2024-03-04T12:59:54.899888+0000","mapping_epoch":22,"log_start":"256'900","ondisk_log_start":"256'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:59:41.402010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4343,"num_read_kb":3801,"num_write":1436,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"256'280","reported_seq":918,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.900172+0000","last_change":"2024-03-04T12:36:05.287491+0000","last_active":"2024-03-04T13:00:15.900172+0000","last_peered":"2024-03-04T13:00:15.900172+0000","last_clean":"2024-03-04T13:00:15.900172+0000","last_became_active":"2024-03-04T12:36:05.287185+0000","last_became_peered":"2024-03-04T12:36:05.287185+0000","last_unstale":"2024-03-04T13:00:15.900172+0000","last_undegraded":"2024-03-04T13:00:15.900172+0000","last_fullsized":"2024-03-04T13:00:15.900172+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:44.742710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2801863,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":486,"num_read_kb":7343,"num_write":1141,"num_write_kb":36636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.878079+0000","last_change":"2024-03-04T12:36:09.305577+0000","last_active":"2024-03-04T12:57:10.878079+0000","last_peered":"2024-03-04T12:57:10.878079+0000","last_clean":"2024-03-04T12:57:10.878079+0000","last_became_active":"2024-03-04T12:36:09.305288+0000","last_became_peered":"2024-03-04T12:36:09.305288+0000","last_unstale":"2024-03-04T12:57:10.878079+0000","last_undegraded":"2024-03-04T12:57:10.878079+0000","last_fullsized":"2024-03-04T12:57:10.878079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:02.570493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"256'291","reported_seq":850,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.684298+0000","last_change":"2024-03-04T12:36:11.325238+0000","last_active":"2024-03-04T13:00:15.684298+0000","last_peered":"2024-03-04T13:00:15.684298+0000","last_clean":"2024-03-04T13:00:15.684298+0000","last_became_active":"2024-03-04T12:36:11.324758+0000","last_became_peered":"2024-03-04T12:36:11.324758+0000","last_unstale":"2024-03-04T13:00:15.684298+0000","last_undegraded":"2024-03-04T13:00:15.684298+0000","last_fullsized":"2024-03-04T13:00:15.684298+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:41:09.027646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":483,"num_read_kb":1065,"num_write":390,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.987790+0000","last_change":"2024-03-04T12:36:13.345775+0000","last_active":"2024-03-04T12:57:15.987790+0000","last_peered":"2024-03-04T12:57:15.987790+0000","last_clean":"2024-03-04T12:57:15.987790+0000","last_became_active":"2024-03-04T12:36:13.345556+0000","last_became_peered":"2024-03-04T12:36:13.345556+0000","last_unstale":"2024-03-04T12:57:15.987790+0000","last_undegraded":"2024-03-04T12:57:15.987790+0000","last_fullsized":"2024-03-04T12:57:15.987790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:08.155061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"256'172","reported_seq":658,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:44.896942+0000","last_change":"2024-03-04T12:36:15.363805+0000","last_active":"2024-03-04T12:59:44.896942+0000","last_peered":"2024-03-04T12:59:44.896942+0000","last_clean":"2024-03-04T12:59:44.896942+0000","last_became_active":"2024-03-04T12:36:15.363544+0000","last_became_peered":"2024-03-04T12:36:15.363544+0000","last_unstale":"2024-03-04T12:59:44.896942+0000","last_undegraded":"2024-03-04T12:59:44.896942+0000","last_fullsized":"2024-03-04T12:59:44.896942+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:22:01.710579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":198,"num_write":386,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"256'401","reported_seq":1833,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.674646+0000","last_change":"2024-03-04T12:36:07.293124+0000","last_active":"2024-03-04T13:00:06.674646+0000","last_peered":"2024-03-04T13:00:06.674646+0000","last_clean":"2024-03-04T13:00:06.674646+0000","last_became_active":"2024-03-04T12:36:07.292814+0000","last_became_peered":"2024-03-04T12:36:07.292814+0000","last_unstale":"2024-03-04T13:00:06.674646+0000","last_undegraded":"2024-03-04T13:00:06.674646+0000","last_fullsized":"2024-03-04T13:00:06.674646+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:39.960903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2067,"num_read_kb":1953,"num_write":480,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"256'275","reported_seq":869,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.969508+0000","last_change":"2024-03-04T12:36:40.965263+0000","last_active":"2024-03-04T13:00:15.969508+0000","last_peered":"2024-03-04T13:00:15.969508+0000","last_clean":"2024-03-04T13:00:15.969508+0000","last_became_active":"2024-03-04T12:36:40.964989+0000","last_became_peered":"2024-03-04T12:36:40.964989+0000","last_unstale":"2024-03-04T13:00:15.969508+0000","last_undegraded":"2024-03-04T13:00:15.969508+0000","last_fullsized":"2024-03-04T13:00:15.969508+0000","mapping_epoch":33,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:02:05.061569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343052,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":408,"num_read_kb":22171,"num_write":1146,"num_write_kb":35457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.987012+0000","last_change":"2024-03-04T12:36:09.310197+0000","last_active":"2024-03-04T12:57:10.987012+0000","last_peered":"2024-03-04T12:57:10.987012+0000","last_clean":"2024-03-04T12:57:10.987012+0000","last_became_active":"2024-03-04T12:36:09.309883+0000","last_became_peered":"2024-03-04T12:36:09.309883+0000","last_unstale":"2024-03-04T12:57:10.987012+0000","last_undegraded":"2024-03-04T12:57:10.987012+0000","last_fullsized":"2024-03-04T12:57:10.987012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:50.413280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"256'252","reported_seq":795,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.482392+0000","last_change":"2024-03-04T12:36:11.325094+0000","last_active":"2024-03-04T13:00:15.482392+0000","last_peered":"2024-03-04T13:00:15.482392+0000","last_clean":"2024-03-04T13:00:15.482392+0000","last_became_active":"2024-03-04T12:36:11.324784+0000","last_became_peered":"2024-03-04T12:36:11.324784+0000","last_unstale":"2024-03-04T13:00:15.482392+0000","last_undegraded":"2024-03-04T13:00:15.482392+0000","last_fullsized":"2024-03-04T13:00:15.482392+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:27:03.628739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54138,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":1067,"num_write":352,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":463,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998151+0000","last_change":"2024-03-04T12:36:13.343536+0000","last_active":"2024-03-04T12:57:15.998151+0000","last_peered":"2024-03-04T12:57:15.998151+0000","last_clean":"2024-03-04T12:57:15.998151+0000","last_became_active":"2024-03-04T12:36:13.343030+0000","last_became_peered":"2024-03-04T12:36:13.343030+0000","last_unstale":"2024-03-04T12:57:15.998151+0000","last_undegraded":"2024-03-04T12:57:15.998151+0000","last_fullsized":"2024-03-04T12:57:15.998151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.616451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"256'687","reported_seq":2134,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.015184+0000","last_change":"2024-03-04T12:36:07.298429+0000","last_active":"2024-03-04T12:59:56.015184+0000","last_peered":"2024-03-04T12:59:56.015184+0000","last_clean":"2024-03-04T12:59:56.015184+0000","last_became_active":"2024-03-04T12:36:07.298154+0000","last_became_peered":"2024-03-04T12:36:07.298154+0000","last_unstale":"2024-03-04T12:59:56.015184+0000","last_undegraded":"2024-03-04T12:59:56.015184+0000","last_fullsized":"2024-03-04T12:59:56.015184+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":600,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:51:00.776425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3209,"num_read_kb":2902,"num_write":904,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"256'272","reported_seq":974,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.966882+0000","last_change":"2024-03-04T12:36:05.287614+0000","last_active":"2024-03-04T13:00:15.966882+0000","last_peered":"2024-03-04T13:00:15.966882+0000","last_clean":"2024-03-04T13:00:15.966882+0000","last_became_active":"2024-03-04T12:36:05.287329+0000","last_became_peered":"2024-03-04T12:36:05.287329+0000","last_unstale":"2024-03-04T13:00:15.966882+0000","last_undegraded":"2024-03-04T13:00:15.966882+0000","last_fullsized":"2024-03-04T13:00:15.966882+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:30.987377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389106,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":508,"num_read_kb":51332,"num_write":1158,"num_write_kb":22699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:11.005371+0000","last_change":"2024-03-04T12:36:09.307589+0000","last_active":"2024-03-04T12:58:11.005371+0000","last_peered":"2024-03-04T12:58:11.005371+0000","last_clean":"2024-03-04T12:58:11.005371+0000","last_became_active":"2024-03-04T12:36:09.307329+0000","last_became_peered":"2024-03-04T12:36:09.307329+0000","last_unstale":"2024-03-04T12:58:11.005371+0000","last_undegraded":"2024-03-04T12:58:11.005371+0000","last_fullsized":"2024-03-04T12:58:11.005371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:30.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"256'409","reported_seq":1008,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.419225+0000","last_change":"2024-03-04T12:36:11.323790+0000","last_active":"2024-03-04T13:00:15.419225+0000","last_peered":"2024-03-04T13:00:15.419225+0000","last_clean":"2024-03-04T13:00:15.419225+0000","last_became_active":"2024-03-04T12:36:11.323506+0000","last_became_peered":"2024-03-04T12:36:11.323506+0000","last_unstale":"2024-03-04T13:00:15.419225+0000","last_undegraded":"2024-03-04T13:00:15.419225+0000","last_fullsized":"2024-03-04T13:00:15.419225+0000","mapping_epoch":26,"log_start":"256'300","ondisk_log_start":"256'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:50:55.242458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115418,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":721,"num_read_kb":1701,"num_write":586,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.983858+0000","last_change":"2024-03-04T12:36:13.346933+0000","last_active":"2024-03-04T12:56:15.983858+0000","last_peered":"2024-03-04T12:56:15.983858+0000","last_clean":"2024-03-04T12:56:15.983858+0000","last_became_active":"2024-03-04T12:36:13.346628+0000","last_became_peered":"2024-03-04T12:36:13.346628+0000","last_unstale":"2024-03-04T12:56:15.983858+0000","last_undegraded":"2024-03-04T12:56:15.983858+0000","last_fullsized":"2024-03-04T12:56:15.983858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:37.000939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"256'165","reported_seq":643,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:49.594745+0000","last_change":"2024-03-04T12:36:15.354834+0000","last_active":"2024-03-04T12:59:49.594745+0000","last_peered":"2024-03-04T12:59:49.594745+0000","last_clean":"2024-03-04T12:59:49.594745+0000","last_became_active":"2024-03-04T12:36:15.354125+0000","last_became_peered":"2024-03-04T12:36:15.354125+0000","last_unstale":"2024-03-04T12:59:49.594745+0000","last_undegraded":"2024-03-04T12:59:49.594745+0000","last_fullsized":"2024-03-04T12:59:49.594745+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:35:56.991813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":203,"num_write":373,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"256'1141","reported_seq":2714,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.045130+0000","last_change":"2024-03-04T12:36:07.298750+0000","last_active":"2024-03-04T12:59:53.045130+0000","last_peered":"2024-03-04T12:59:53.045130+0000","last_clean":"2024-03-04T12:59:53.045130+0000","last_became_active":"2024-03-04T12:36:07.298434+0000","last_became_peered":"2024-03-04T12:36:07.298434+0000","last_unstale":"2024-03-04T12:59:53.045130+0000","last_undegraded":"2024-03-04T12:59:53.045130+0000","last_fullsized":"2024-03-04T12:59:53.045130+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:09:16.843310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4934,"num_read_kb":4324,"num_write":1585,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"256'338","reported_seq":981,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.997430+0000","last_change":"2024-03-04T12:36:05.287853+0000","last_active":"2024-03-04T13:00:15.997430+0000","last_peered":"2024-03-04T13:00:15.997430+0000","last_clean":"2024-03-04T13:00:15.997430+0000","last_became_active":"2024-03-04T12:36:05.287506+0000","last_became_peered":"2024-03-04T12:36:05.287506+0000","last_unstale":"2024-03-04T13:00:15.997430+0000","last_undegraded":"2024-03-04T13:00:15.997430+0000","last_fullsized":"2024-03-04T13:00:15.997430+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:32:38.606578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16098274,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":545,"num_read_kb":47013,"num_write":1100,"num_write_kb":33887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.985615+0000","last_change":"2024-03-04T12:36:09.309433+0000","last_active":"2024-03-04T12:57:00.985615+0000","last_peered":"2024-03-04T12:57:00.985615+0000","last_clean":"2024-03-04T12:57:00.985615+0000","last_became_active":"2024-03-04T12:36:09.309155+0000","last_became_peered":"2024-03-04T12:36:09.309155+0000","last_unstale":"2024-03-04T12:57:00.985615+0000","last_undegraded":"2024-03-04T12:57:00.985615+0000","last_fullsized":"2024-03-04T12:57:00.985615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:54:56.170543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"256'274","reported_seq":825,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.552159+0000","last_change":"2024-03-04T12:36:11.323679+0000","last_active":"2024-03-04T13:00:15.552159+0000","last_peered":"2024-03-04T13:00:15.552159+0000","last_clean":"2024-03-04T13:00:15.552159+0000","last_became_active":"2024-03-04T12:36:11.323320+0000","last_became_peered":"2024-03-04T12:36:11.323320+0000","last_unstale":"2024-03-04T13:00:15.552159+0000","last_undegraded":"2024-03-04T13:00:15.552159+0000","last_fullsized":"2024-03-04T13:00:15.552159+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:42.811474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44965,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":1036,"num_write":392,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":469,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.974256+0000","last_change":"2024-03-04T12:36:13.340810+0000","last_active":"2024-03-04T12:56:15.974256+0000","last_peered":"2024-03-04T12:56:15.974256+0000","last_clean":"2024-03-04T12:56:15.974256+0000","last_became_active":"2024-03-04T12:36:13.340525+0000","last_became_peered":"2024-03-04T12:36:13.340525+0000","last_unstale":"2024-03-04T12:56:15.974256+0000","last_undegraded":"2024-03-04T12:56:15.974256+0000","last_fullsized":"2024-03-04T12:56:15.974256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:06:28.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"256'155","reported_seq":980,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.538717+0000","last_change":"2024-03-04T12:36:15.363212+0000","last_active":"2024-03-04T13:00:07.538717+0000","last_peered":"2024-03-04T13:00:07.538717+0000","last_clean":"2024-03-04T13:00:07.538717+0000","last_became_active":"2024-03-04T12:36:15.362749+0000","last_became_peered":"2024-03-04T12:36:15.362749+0000","last_unstale":"2024-03-04T13:00:07.538717+0000","last_undegraded":"2024-03-04T13:00:07.538717+0000","last_fullsized":"2024-03-04T13:00:07.538717+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:19.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":549,"num_write":456,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"256'352","reported_seq":1696,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.292917+0000","last_change":"2024-03-04T12:36:07.293117+0000","last_active":"2024-03-04T12:59:48.292917+0000","last_peered":"2024-03-04T12:59:48.292917+0000","last_clean":"2024-03-04T12:59:48.292917+0000","last_became_active":"2024-03-04T12:36:07.292806+0000","last_became_peered":"2024-03-04T12:36:07.292806+0000","last_unstale":"2024-03-04T12:59:48.292917+0000","last_undegraded":"2024-03-04T12:59:48.292917+0000","last_fullsized":"2024-03-04T12:59:48.292917+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:31.918878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1929,"num_read_kb":1816,"num_write":430,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"256'283","reported_seq":919,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.000403+0000","last_change":"2024-03-04T12:36:05.289335+0000","last_active":"2024-03-04T13:00:16.000403+0000","last_peered":"2024-03-04T13:00:16.000403+0000","last_clean":"2024-03-04T13:00:16.000403+0000","last_became_active":"2024-03-04T12:36:05.289053+0000","last_became_peered":"2024-03-04T12:36:05.289053+0000","last_unstale":"2024-03-04T13:00:16.000403+0000","last_undegraded":"2024-03-04T13:00:16.000403+0000","last_fullsized":"2024-03-04T13:00:16.000403+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:54.563075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11429888,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":435,"num_read_kb":60644,"num_write":1156,"num_write_kb":49301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.983196+0000","last_change":"2024-03-04T12:36:09.308491+0000","last_active":"2024-03-04T12:56:10.983196+0000","last_peered":"2024-03-04T12:56:10.983196+0000","last_clean":"2024-03-04T12:56:10.983196+0000","last_became_active":"2024-03-04T12:36:09.308231+0000","last_became_peered":"2024-03-04T12:36:09.308231+0000","last_unstale":"2024-03-04T12:56:10.983196+0000","last_undegraded":"2024-03-04T12:56:10.983196+0000","last_fullsized":"2024-03-04T12:56:10.983196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:10:29.969171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"256'272","reported_seq":812,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.691138+0000","last_change":"2024-03-04T12:36:11.954917+0000","last_active":"2024-03-04T13:00:08.691138+0000","last_peered":"2024-03-04T13:00:08.691138+0000","last_clean":"2024-03-04T13:00:08.691138+0000","last_became_active":"2024-03-04T12:36:11.954568+0000","last_became_peered":"2024-03-04T12:36:11.954568+0000","last_unstale":"2024-03-04T13:00:08.691138+0000","last_undegraded":"2024-03-04T13:00:08.691138+0000","last_fullsized":"2024-03-04T13:00:08.691138+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:56.500891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64514,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":989,"num_write":386,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:15.988694+0000","last_change":"2024-03-04T12:36:13.346950+0000","last_active":"2024-03-04T12:58:15.988694+0000","last_peered":"2024-03-04T12:58:15.988694+0000","last_clean":"2024-03-04T12:58:15.988694+0000","last_became_active":"2024-03-04T12:36:13.346665+0000","last_became_peered":"2024-03-04T12:36:13.346665+0000","last_unstale":"2024-03-04T12:58:15.988694+0000","last_undegraded":"2024-03-04T12:58:15.988694+0000","last_fullsized":"2024-03-04T12:58:15.988694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:14.332069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'103","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.702492+0000","last_change":"2024-03-04T12:36:15.364059+0000","last_active":"2024-03-04T13:00:08.702492+0000","last_peered":"2024-03-04T13:00:08.702492+0000","last_clean":"2024-03-04T13:00:08.702492+0000","last_became_active":"2024-03-04T12:36:15.363269+0000","last_became_peered":"2024-03-04T12:36:15.363269+0000","last_unstale":"2024-03-04T13:00:08.702492+0000","last_undegraded":"2024-03-04T13:00:08.702492+0000","last_fullsized":"2024-03-04T13:00:08.702492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:56.078288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"256'427","reported_seq":1936,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.685753+0000","last_change":"2024-03-04T12:36:07.296189+0000","last_active":"2024-03-04T13:00:06.685753+0000","last_peered":"2024-03-04T13:00:06.685753+0000","last_clean":"2024-03-04T13:00:06.685753+0000","last_became_active":"2024-03-04T12:36:07.295353+0000","last_became_peered":"2024-03-04T12:36:07.295353+0000","last_unstale":"2024-03-04T13:00:06.685753+0000","last_undegraded":"2024-03-04T13:00:06.685753+0000","last_fullsized":"2024-03-04T13:00:06.685753+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:59:38.626041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2362,"num_read_kb":2211,"num_write":524,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"256'455","reported_seq":1101,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.976438+0000","last_change":"2024-03-04T12:36:05.293958+0000","last_active":"2024-03-04T13:00:15.976438+0000","last_peered":"2024-03-04T13:00:15.976438+0000","last_clean":"2024-03-04T13:00:15.976438+0000","last_became_active":"2024-03-04T12:36:05.293646+0000","last_became_peered":"2024-03-04T12:36:05.293646+0000","last_unstale":"2024-03-04T13:00:15.976438+0000","last_undegraded":"2024-03-04T13:00:15.976438+0000","last_fullsized":"2024-03-04T13:00:15.976438+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:32:24.040601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22047979,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":797,"num_read_kb":46886,"num_write":1400,"num_write_kb":44359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.973688+0000","last_change":"2024-03-04T12:36:09.305622+0000","last_active":"2024-03-04T12:56:10.973688+0000","last_peered":"2024-03-04T12:56:10.973688+0000","last_clean":"2024-03-04T12:56:10.973688+0000","last_became_active":"2024-03-04T12:36:09.305073+0000","last_became_peered":"2024-03-04T12:36:09.305073+0000","last_unstale":"2024-03-04T12:56:10.973688+0000","last_undegraded":"2024-03-04T12:56:10.973688+0000","last_fullsized":"2024-03-04T12:56:10.973688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:49.014929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"256'63","reported_seq":556,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:42.294211+0000","last_change":"2024-03-04T12:36:11.955268+0000","last_active":"2024-03-04T12:58:42.294211+0000","last_peered":"2024-03-04T12:58:42.294211+0000","last_clean":"2024-03-04T12:58:42.294211+0000","last_became_active":"2024-03-04T12:36:11.954563+0000","last_became_peered":"2024-03-04T12:36:11.954563+0000","last_unstale":"2024-03-04T12:58:42.294211+0000","last_undegraded":"2024-03-04T12:58:42.294211+0000","last_fullsized":"2024-03-04T12:58:42.294211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:42:13.043294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":71,"num_read_kb":64,"num_write":78,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"256'481","reported_seq":1806,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.233620+0000","last_change":"2024-03-04T12:36:13.340544+0000","last_active":"2024-03-04T13:00:15.233620+0000","last_peered":"2024-03-04T13:00:15.233620+0000","last_clean":"2024-03-04T13:00:15.233620+0000","last_became_active":"2024-03-04T12:36:13.340221+0000","last_became_peered":"2024-03-04T12:36:13.340221+0000","last_unstale":"2024-03-04T13:00:15.233620+0000","last_undegraded":"2024-03-04T13:00:15.233620+0000","last_fullsized":"2024-03-04T13:00:15.233620+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:34.550746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"256'132","reported_seq":606,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.133500+0000","last_change":"2024-03-04T12:36:15.364987+0000","last_active":"2024-03-04T12:59:50.133500+0000","last_peered":"2024-03-04T12:59:50.133500+0000","last_clean":"2024-03-04T12:59:50.133500+0000","last_became_active":"2024-03-04T12:36:15.364688+0000","last_became_peered":"2024-03-04T12:36:15.364688+0000","last_unstale":"2024-03-04T12:59:50.133500+0000","last_undegraded":"2024-03-04T12:59:50.133500+0000","last_fullsized":"2024-03-04T12:59:50.133500+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:22.015151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":294,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"256'357","reported_seq":1820,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.904913+0000","last_change":"2024-03-04T12:36:07.291346+0000","last_active":"2024-03-04T12:59:54.904913+0000","last_peered":"2024-03-04T12:59:54.904913+0000","last_clean":"2024-03-04T12:59:54.904913+0000","last_became_active":"2024-03-04T12:36:07.290637+0000","last_became_peered":"2024-03-04T12:36:07.290637+0000","last_unstale":"2024-03-04T12:59:54.904913+0000","last_undegraded":"2024-03-04T12:59:54.904913+0000","last_fullsized":"2024-03-04T12:59:54.904913+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:40:51.943588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1998,"num_read_kb":1913,"num_write":399,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"256'375","reported_seq":1028,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.974163+0000","last_change":"2024-03-04T12:36:05.294852+0000","last_active":"2024-03-04T13:00:15.974163+0000","last_peered":"2024-03-04T13:00:15.974163+0000","last_clean":"2024-03-04T13:00:15.974163+0000","last_became_active":"2024-03-04T12:36:05.294568+0000","last_became_peered":"2024-03-04T12:36:05.294568+0000","last_unstale":"2024-03-04T13:00:15.974163+0000","last_undegraded":"2024-03-04T13:00:15.974163+0000","last_fullsized":"2024-03-04T13:00:15.974163+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:30:30.652308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13300435,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":641,"num_read_kb":37257,"num_write":1320,"num_write_kb":50791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.869484+0000","last_change":"2024-03-04T12:36:09.306310+0000","last_active":"2024-03-04T12:56:10.869484+0000","last_peered":"2024-03-04T12:56:10.869484+0000","last_clean":"2024-03-04T12:56:10.869484+0000","last_became_active":"2024-03-04T12:36:09.306005+0000","last_became_peered":"2024-03-04T12:36:09.306005+0000","last_unstale":"2024-03-04T12:56:10.869484+0000","last_undegraded":"2024-03-04T12:56:10.869484+0000","last_fullsized":"2024-03-04T12:56:10.869484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:36:38.545939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"256'268","reported_seq":811,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.658146+0000","last_change":"2024-03-04T12:36:11.325797+0000","last_active":"2024-03-04T13:00:08.658146+0000","last_peered":"2024-03-04T13:00:08.658146+0000","last_clean":"2024-03-04T13:00:08.658146+0000","last_became_active":"2024-03-04T12:36:11.325503+0000","last_became_peered":"2024-03-04T12:36:11.325503+0000","last_unstale":"2024-03-04T13:00:08.658146+0000","last_undegraded":"2024-03-04T13:00:08.658146+0000","last_fullsized":"2024-03-04T13:00:08.658146+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:37.864953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64489,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":946,"num_write":368,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":462,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.986011+0000","last_change":"2024-03-04T12:36:13.339697+0000","last_active":"2024-03-04T12:55:35.986011+0000","last_peered":"2024-03-04T12:55:35.986011+0000","last_clean":"2024-03-04T12:55:35.986011+0000","last_became_active":"2024-03-04T12:36:13.339349+0000","last_became_peered":"2024-03-04T12:36:13.339349+0000","last_unstale":"2024-03-04T12:55:35.986011+0000","last_undegraded":"2024-03-04T12:55:35.986011+0000","last_fullsized":"2024-03-04T12:55:35.986011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:11.712690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"256'111","reported_seq":637,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:11.247234+0000","last_change":"2024-03-04T12:36:15.352689+0000","last_active":"2024-03-04T12:59:11.247234+0000","last_peered":"2024-03-04T12:59:11.247234+0000","last_clean":"2024-03-04T12:59:11.247234+0000","last_became_active":"2024-03-04T12:36:15.352383+0000","last_became_peered":"2024-03-04T12:36:15.352383+0000","last_unstale":"2024-03-04T12:59:11.247234+0000","last_undegraded":"2024-03-04T12:59:11.247234+0000","last_fullsized":"2024-03-04T12:59:11.247234+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:10:26.974662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":264,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"256'405","reported_seq":1774,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.045644+0000","last_change":"2024-03-04T12:36:07.296237+0000","last_active":"2024-03-04T12:59:56.045644+0000","last_peered":"2024-03-04T12:59:56.045644+0000","last_clean":"2024-03-04T12:59:56.045644+0000","last_became_active":"2024-03-04T12:36:07.295956+0000","last_became_peered":"2024-03-04T12:36:07.295956+0000","last_unstale":"2024-03-04T12:59:56.045644+0000","last_undegraded":"2024-03-04T12:59:56.045644+0000","last_fullsized":"2024-03-04T12:59:56.045644+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:07.889506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2057,"num_read_kb":1911,"num_write":497,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"256'251","reported_seq":843,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.004624+0000","last_change":"2024-03-04T12:36:05.294942+0000","last_active":"2024-03-04T13:00:16.004624+0000","last_peered":"2024-03-04T13:00:16.004624+0000","last_clean":"2024-03-04T13:00:16.004624+0000","last_became_active":"2024-03-04T12:36:05.294686+0000","last_became_peered":"2024-03-04T12:36:05.294686+0000","last_unstale":"2024-03-04T13:00:16.004624+0000","last_undegraded":"2024-03-04T13:00:16.004624+0000","last_fullsized":"2024-03-04T13:00:16.004624+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:40:07.056496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11121196,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":377,"num_read_kb":38414,"num_write":962,"num_write_kb":48852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.983094+0000","last_change":"2024-03-04T12:36:09.315306+0000","last_active":"2024-03-04T12:56:10.983094+0000","last_peered":"2024-03-04T12:56:10.983094+0000","last_clean":"2024-03-04T12:56:10.983094+0000","last_became_active":"2024-03-04T12:36:09.314912+0000","last_became_peered":"2024-03-04T12:36:09.314912+0000","last_unstale":"2024-03-04T12:56:10.983094+0000","last_undegraded":"2024-03-04T12:56:10.983094+0000","last_fullsized":"2024-03-04T12:56:10.983094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:28.512512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"256'261","reported_seq":792,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.658482+0000","last_change":"2024-03-04T12:36:11.325501+0000","last_active":"2024-03-04T13:00:08.658482+0000","last_peered":"2024-03-04T13:00:08.658482+0000","last_clean":"2024-03-04T13:00:08.658482+0000","last_became_active":"2024-03-04T12:36:11.325238+0000","last_became_peered":"2024-03-04T12:36:11.325238+0000","last_unstale":"2024-03-04T13:00:08.658482+0000","last_undegraded":"2024-03-04T13:00:08.658482+0000","last_fullsized":"2024-03-04T13:00:08.658482+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:52:12.180477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58120,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":904,"num_write":354,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.974979+0000","last_change":"2024-03-04T12:36:13.341948+0000","last_active":"2024-03-04T12:55:35.974979+0000","last_peered":"2024-03-04T12:55:35.974979+0000","last_clean":"2024-03-04T12:55:35.974979+0000","last_became_active":"2024-03-04T12:36:13.341689+0000","last_became_peered":"2024-03-04T12:36:13.341689+0000","last_unstale":"2024-03-04T12:55:35.974979+0000","last_undegraded":"2024-03-04T12:55:35.974979+0000","last_fullsized":"2024-03-04T12:55:35.974979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:02:47.747861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"256'98","reported_seq":590,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:37.800761+0000","last_change":"2024-03-04T12:36:15.353744+0000","last_active":"2024-03-04T12:59:37.800761+0000","last_peered":"2024-03-04T12:59:37.800761+0000","last_clean":"2024-03-04T12:59:37.800761+0000","last_became_active":"2024-03-04T12:36:15.353418+0000","last_became_peered":"2024-03-04T12:36:15.353418+0000","last_unstale":"2024-03-04T12:59:37.800761+0000","last_undegraded":"2024-03-04T12:59:37.800761+0000","last_fullsized":"2024-03-04T12:59:37.800761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:31:22.073567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"256'1443","reported_seq":2774,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:34.666144+0000","last_change":"2024-03-04T12:36:07.300609+0000","last_active":"2024-03-04T12:59:34.666144+0000","last_peered":"2024-03-04T12:59:34.666144+0000","last_clean":"2024-03-04T12:59:34.666144+0000","last_became_active":"2024-03-04T12:36:07.300067+0000","last_became_peered":"2024-03-04T12:36:07.300067+0000","last_unstale":"2024-03-04T12:59:34.666144+0000","last_undegraded":"2024-03-04T12:59:34.666144+0000","last_fullsized":"2024-03-04T12:59:34.666144+0000","mapping_epoch":22,"log_start":"256'1400","ondisk_log_start":"256'1400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:54:29.408852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5752,"num_read_kb":4912,"num_write":2067,"num_write_kb":923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"256'344","reported_seq":1000,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.982100+0000","last_change":"2024-03-04T12:36:05.284059+0000","last_active":"2024-03-04T13:00:15.982100+0000","last_peered":"2024-03-04T13:00:15.982100+0000","last_clean":"2024-03-04T13:00:15.982100+0000","last_became_active":"2024-03-04T12:36:05.283142+0000","last_became_peered":"2024-03-04T12:36:05.283142+0000","last_unstale":"2024-03-04T13:00:15.982100+0000","last_undegraded":"2024-03-04T13:00:15.982100+0000","last_fullsized":"2024-03-04T13:00:15.982100+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:42:53.872503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1513,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":623,"num_read_kb":1438,"num_write":1711,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.976430+0000","last_change":"2024-03-04T12:36:09.305585+0000","last_active":"2024-03-04T12:55:30.976430+0000","last_peered":"2024-03-04T12:55:30.976430+0000","last_clean":"2024-03-04T12:55:30.976430+0000","last_became_active":"2024-03-04T12:36:09.305182+0000","last_became_peered":"2024-03-04T12:36:09.305182+0000","last_unstale":"2024-03-04T12:55:30.976430+0000","last_undegraded":"2024-03-04T12:55:30.976430+0000","last_fullsized":"2024-03-04T12:55:30.976430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:08:29.761455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"256'234","reported_seq":763,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.688891+0000","last_change":"2024-03-04T12:36:11.324706+0000","last_active":"2024-03-04T13:00:08.688891+0000","last_peered":"2024-03-04T13:00:08.688891+0000","last_clean":"2024-03-04T13:00:08.688891+0000","last_became_active":"2024-03-04T12:36:11.324394+0000","last_became_peered":"2024-03-04T12:36:11.324394+0000","last_unstale":"2024-03-04T13:00:08.688891+0000","last_undegraded":"2024-03-04T13:00:08.688891+0000","last_fullsized":"2024-03-04T13:00:08.688891+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:55.889459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55992,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":875,"num_write":338,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":471,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.983889+0000","last_change":"2024-03-04T12:36:13.341181+0000","last_active":"2024-03-04T12:56:15.983889+0000","last_peered":"2024-03-04T12:56:15.983889+0000","last_clean":"2024-03-04T12:56:15.983889+0000","last_became_active":"2024-03-04T12:36:13.340897+0000","last_became_peered":"2024-03-04T12:36:13.340897+0000","last_unstale":"2024-03-04T12:56:15.983889+0000","last_undegraded":"2024-03-04T12:56:15.983889+0000","last_fullsized":"2024-03-04T12:56:15.983889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:02:05.268444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"256'169","reported_seq":1167,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.492529+0000","last_change":"2024-03-04T12:36:15.357808+0000","last_active":"2024-03-04T13:00:07.492529+0000","last_peered":"2024-03-04T13:00:07.492529+0000","last_clean":"2024-03-04T13:00:07.492529+0000","last_became_active":"2024-03-04T12:36:15.357141+0000","last_became_peered":"2024-03-04T12:36:15.357141+0000","last_unstale":"2024-03-04T13:00:07.492529+0000","last_undegraded":"2024-03-04T13:00:07.492529+0000","last_fullsized":"2024-03-04T13:00:07.492529+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:59:35.782871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":655,"num_read_kb":655,"num_write":360,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"256'1105","reported_seq":2587,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.017005+0000","last_change":"2024-03-04T12:36:07.291118+0000","last_active":"2024-03-04T12:59:54.017005+0000","last_peered":"2024-03-04T12:59:54.017005+0000","last_clean":"2024-03-04T12:59:54.017005+0000","last_became_active":"2024-03-04T12:36:07.290820+0000","last_became_peered":"2024-03-04T12:36:07.290820+0000","last_unstale":"2024-03-04T12:59:54.017005+0000","last_undegraded":"2024-03-04T12:59:54.017005+0000","last_fullsized":"2024-03-04T12:59:54.017005+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:04.696551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4641,"num_read_kb":4049,"num_write":1526,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"256'269","reported_seq":936,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.007499+0000","last_change":"2024-03-04T12:36:05.290216+0000","last_active":"2024-03-04T13:00:16.007499+0000","last_peered":"2024-03-04T13:00:16.007499+0000","last_clean":"2024-03-04T13:00:16.007499+0000","last_became_active":"2024-03-04T12:36:05.289897+0000","last_became_peered":"2024-03-04T12:36:05.289897+0000","last_unstale":"2024-03-04T13:00:16.007499+0000","last_undegraded":"2024-03-04T13:00:16.007499+0000","last_fullsized":"2024-03-04T13:00:16.007499+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:29.554222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5631842,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":540,"num_read_kb":14927,"num_write":990,"num_write_kb":32177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:30.968279+0000","last_change":"2024-03-04T12:36:09.311068+0000","last_active":"2024-03-04T12:55:30.968279+0000","last_peered":"2024-03-04T12:55:30.968279+0000","last_clean":"2024-03-04T12:55:30.968279+0000","last_became_active":"2024-03-04T12:36:09.310855+0000","last_became_peered":"2024-03-04T12:36:09.310855+0000","last_unstale":"2024-03-04T12:55:30.968279+0000","last_undegraded":"2024-03-04T12:55:30.968279+0000","last_fullsized":"2024-03-04T12:55:30.968279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:22.965213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"256'262","reported_seq":817,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.693001+0000","last_change":"2024-03-04T12:36:11.323707+0000","last_active":"2024-03-04T13:00:08.693001+0000","last_peered":"2024-03-04T13:00:08.693001+0000","last_clean":"2024-03-04T13:00:08.693001+0000","last_became_active":"2024-03-04T12:36:11.323352+0000","last_became_peered":"2024-03-04T12:36:11.323352+0000","last_unstale":"2024-03-04T13:00:08.693001+0000","last_undegraded":"2024-03-04T13:00:08.693001+0000","last_fullsized":"2024-03-04T13:00:08.693001+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:15.465595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":879,"num_write":344,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":462,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.990494+0000","last_change":"2024-03-04T12:36:13.343303+0000","last_active":"2024-03-04T12:56:15.990494+0000","last_peered":"2024-03-04T12:56:15.990494+0000","last_clean":"2024-03-04T12:56:15.990494+0000","last_became_active":"2024-03-04T12:36:13.342656+0000","last_became_peered":"2024-03-04T12:36:13.342656+0000","last_unstale":"2024-03-04T12:56:15.990494+0000","last_undegraded":"2024-03-04T12:56:15.990494+0000","last_fullsized":"2024-03-04T12:56:15.990494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:43.617222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"256'102","reported_seq":575,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:36.553742+0000","last_change":"2024-03-04T12:36:15.352666+0000","last_active":"2024-03-04T12:59:36.553742+0000","last_peered":"2024-03-04T12:59:36.553742+0000","last_clean":"2024-03-04T12:59:36.553742+0000","last_became_active":"2024-03-04T12:36:15.352333+0000","last_became_peered":"2024-03-04T12:36:15.352333+0000","last_unstale":"2024-03-04T12:59:36.553742+0000","last_undegraded":"2024-03-04T12:59:36.553742+0000","last_fullsized":"2024-03-04T12:59:36.553742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:36.600244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":93,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"256'392","reported_seq":1887,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.047579+0000","last_change":"2024-03-04T12:36:07.298617+0000","last_active":"2024-03-04T12:59:53.047579+0000","last_peered":"2024-03-04T12:59:53.047579+0000","last_clean":"2024-03-04T12:59:53.047579+0000","last_became_active":"2024-03-04T12:36:07.297660+0000","last_became_peered":"2024-03-04T12:36:07.297660+0000","last_unstale":"2024-03-04T12:59:53.047579+0000","last_undegraded":"2024-03-04T12:59:53.047579+0000","last_fullsized":"2024-03-04T12:59:53.047579+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:32.101783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":478,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"256'240","reported_seq":825,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.977272+0000","last_change":"2024-03-04T12:36:05.279913+0000","last_active":"2024-03-04T13:00:15.977272+0000","last_peered":"2024-03-04T13:00:15.977272+0000","last_clean":"2024-03-04T13:00:15.977272+0000","last_became_active":"2024-03-04T12:36:05.279576+0000","last_became_peered":"2024-03-04T12:36:05.279576+0000","last_unstale":"2024-03-04T13:00:15.977272+0000","last_undegraded":"2024-03-04T13:00:15.977272+0000","last_fullsized":"2024-03-04T13:00:15.977272+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:18.604604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6640307,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":344,"num_read_kb":32300,"num_write":1048,"num_write_kb":15765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"256'425","reported_seq":1850,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.047677+0000","last_change":"2024-03-04T12:36:07.300437+0000","last_active":"2024-03-04T12:59:53.047677+0000","last_peered":"2024-03-04T12:59:53.047677+0000","last_clean":"2024-03-04T12:59:53.047677+0000","last_became_active":"2024-03-04T12:36:07.300168+0000","last_became_peered":"2024-03-04T12:36:07.300168+0000","last_unstale":"2024-03-04T12:59:53.047677+0000","last_undegraded":"2024-03-04T12:59:53.047677+0000","last_fullsized":"2024-03-04T12:59:53.047677+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:16.225236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2082,"num_write":535,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"256'261","reported_seq":877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.946419+0000","last_change":"2024-03-04T12:36:05.287650+0000","last_active":"2024-03-04T13:00:15.946419+0000","last_peered":"2024-03-04T13:00:15.946419+0000","last_clean":"2024-03-04T13:00:15.946419+0000","last_became_active":"2024-03-04T12:36:05.287233+0000","last_became_peered":"2024-03-04T12:36:05.287233+0000","last_unstale":"2024-03-04T13:00:15.946419+0000","last_undegraded":"2024-03-04T13:00:15.946419+0000","last_fullsized":"2024-03-04T13:00:15.946419+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:20:52.908914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16232749,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":421,"num_read_kb":46552,"num_write":1150,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"256'338","reported_seq":1830,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.139327+0000","last_change":"2024-03-04T12:36:07.296382+0000","last_active":"2024-03-04T12:59:50.139327+0000","last_peered":"2024-03-04T12:59:50.139327+0000","last_clean":"2024-03-04T12:59:50.139327+0000","last_became_active":"2024-03-04T12:36:07.296104+0000","last_became_peered":"2024-03-04T12:36:07.296104+0000","last_unstale":"2024-03-04T12:59:50.139327+0000","last_undegraded":"2024-03-04T12:59:50.139327+0000","last_fullsized":"2024-03-04T12:59:50.139327+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:56.868284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1942,"num_read_kb":1888,"num_write":368,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"256'298","reported_seq":918,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.958438+0000","last_change":"2024-03-04T12:36:41.075779+0000","last_active":"2024-03-04T13:00:15.958438+0000","last_peered":"2024-03-04T13:00:15.958438+0000","last_clean":"2024-03-04T13:00:15.958438+0000","last_became_active":"2024-03-04T12:36:41.075381+0000","last_became_peered":"2024-03-04T12:36:41.075381+0000","last_unstale":"2024-03-04T13:00:15.958438+0000","last_undegraded":"2024-03-04T13:00:15.958438+0000","last_fullsized":"2024-03-04T13:00:15.958438+0000","mapping_epoch":33,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:58.826959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745056,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":477,"num_read_kb":52899,"num_write":1246,"num_write_kb":57282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"256'1024","reported_seq":2573,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.027302+0000","last_change":"2024-03-04T12:36:07.299735+0000","last_active":"2024-03-04T12:59:56.027302+0000","last_peered":"2024-03-04T12:59:56.027302+0000","last_clean":"2024-03-04T12:59:56.027302+0000","last_became_active":"2024-03-04T12:36:07.299282+0000","last_became_peered":"2024-03-04T12:36:07.299282+0000","last_unstale":"2024-03-04T12:59:56.027302+0000","last_undegraded":"2024-03-04T12:59:56.027302+0000","last_fullsized":"2024-03-04T12:59:56.027302+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:42:39.813252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4484,"num_read_kb":3892,"num_write":1521,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"256'254","reported_seq":906,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.966935+0000","last_change":"2024-03-04T12:36:05.283738+0000","last_active":"2024-03-04T13:00:15.966935+0000","last_peered":"2024-03-04T13:00:15.966935+0000","last_clean":"2024-03-04T13:00:15.966935+0000","last_became_active":"2024-03-04T12:36:05.283327+0000","last_became_peered":"2024-03-04T12:36:05.283327+0000","last_unstale":"2024-03-04T13:00:15.966935+0000","last_undegraded":"2024-03-04T13:00:15.966935+0000","last_fullsized":"2024-03-04T13:00:15.966935+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:26:39.224528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10220281,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":450,"num_read_kb":66598,"num_write":957,"num_write_kb":37083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"256'426","reported_seq":1880,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671263+0000","last_change":"2024-03-04T12:36:07.293252+0000","last_active":"2024-03-04T13:00:06.671263+0000","last_peered":"2024-03-04T13:00:06.671263+0000","last_clean":"2024-03-04T13:00:06.671263+0000","last_became_active":"2024-03-04T12:36:07.292950+0000","last_became_peered":"2024-03-04T12:36:07.292950+0000","last_unstale":"2024-03-04T13:00:06.671263+0000","last_undegraded":"2024-03-04T13:00:06.671263+0000","last_fullsized":"2024-03-04T13:00:06.671263+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:06.362966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2086,"num_write":515,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"256'240","reported_seq":854,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.978814+0000","last_change":"2024-03-04T12:36:05.287013+0000","last_active":"2024-03-04T13:00:15.978814+0000","last_peered":"2024-03-04T13:00:15.978814+0000","last_clean":"2024-03-04T13:00:15.978814+0000","last_became_active":"2024-03-04T12:36:05.286745+0000","last_became_peered":"2024-03-04T12:36:05.286745+0000","last_unstale":"2024-03-04T13:00:15.978814+0000","last_undegraded":"2024-03-04T13:00:15.978814+0000","last_fullsized":"2024-03-04T13:00:15.978814+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:28.246766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11547099,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":396,"num_read_kb":38207,"num_write":998,"num_write_kb":19360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"256'355","reported_seq":1889,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.837911+0000","last_change":"2024-03-04T12:36:07.291981+0000","last_active":"2024-03-04T12:59:48.837911+0000","last_peered":"2024-03-04T12:59:48.837911+0000","last_clean":"2024-03-04T12:59:48.837911+0000","last_became_active":"2024-03-04T12:36:07.291690+0000","last_became_peered":"2024-03-04T12:36:07.291690+0000","last_unstale":"2024-03-04T12:59:48.837911+0000","last_undegraded":"2024-03-04T12:59:48.837911+0000","last_fullsized":"2024-03-04T12:59:48.837911+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:27:20.656871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2163,"num_read_kb":2091,"num_write":400,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"256'260","reported_seq":877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.912989+0000","last_change":"2024-03-04T12:36:05.287869+0000","last_active":"2024-03-04T13:00:15.912989+0000","last_peered":"2024-03-04T13:00:15.912989+0000","last_clean":"2024-03-04T13:00:15.912989+0000","last_became_active":"2024-03-04T12:36:05.287529+0000","last_became_peered":"2024-03-04T12:36:05.287529+0000","last_unstale":"2024-03-04T13:00:15.912989+0000","last_undegraded":"2024-03-04T13:00:15.912989+0000","last_fullsized":"2024-03-04T13:00:15.912989+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:48.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097782,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":439,"num_read_kb":37296,"num_write":1054,"num_write_kb":36513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"256'739","reported_seq":2222,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.017452+0000","last_change":"2024-03-04T12:36:07.300374+0000","last_active":"2024-03-04T12:59:56.017452+0000","last_peered":"2024-03-04T12:59:56.017452+0000","last_clean":"2024-03-04T12:59:56.017452+0000","last_became_active":"2024-03-04T12:36:07.299881+0000","last_became_peered":"2024-03-04T12:36:07.299881+0000","last_unstale":"2024-03-04T12:59:56.017452+0000","last_undegraded":"2024-03-04T12:59:56.017452+0000","last_fullsized":"2024-03-04T12:59:56.017452+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:55:08.815424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3309,"num_read_kb":2983,"num_write":974,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"256'285","reported_seq":909,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.976782+0000","last_change":"2024-03-04T12:36:05.286690+0000","last_active":"2024-03-04T13:00:15.976782+0000","last_peered":"2024-03-04T13:00:15.976782+0000","last_clean":"2024-03-04T13:00:15.976782+0000","last_became_active":"2024-03-04T12:36:05.286397+0000","last_became_peered":"2024-03-04T12:36:05.286397+0000","last_unstale":"2024-03-04T13:00:15.976782+0000","last_undegraded":"2024-03-04T13:00:15.976782+0000","last_fullsized":"2024-03-04T13:00:15.976782+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:20:08.942318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104717,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":420,"num_read_kb":103287,"num_write":1181,"num_write_kb":47023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"256'475","reported_seq":2071,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.610564+0000","last_change":"2024-03-04T12:36:07.292858+0000","last_active":"2024-03-04T12:59:47.610564+0000","last_peered":"2024-03-04T12:59:47.610564+0000","last_clean":"2024-03-04T12:59:47.610564+0000","last_became_active":"2024-03-04T12:36:07.292501+0000","last_became_peered":"2024-03-04T12:36:07.292501+0000","last_unstale":"2024-03-04T12:59:47.610564+0000","last_undegraded":"2024-03-04T12:59:47.610564+0000","last_fullsized":"2024-03-04T12:59:47.610564+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:35.770287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2330,"num_write":558,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"256'280","reported_seq":877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.955320+0000","last_change":"2024-03-04T12:36:05.294285+0000","last_active":"2024-03-04T13:00:15.955320+0000","last_peered":"2024-03-04T13:00:15.955320+0000","last_clean":"2024-03-04T13:00:15.955320+0000","last_became_active":"2024-03-04T12:36:05.294007+0000","last_became_peered":"2024-03-04T12:36:05.294007+0000","last_unstale":"2024-03-04T13:00:15.955320+0000","last_undegraded":"2024-03-04T13:00:15.955320+0000","last_fullsized":"2024-03-04T13:00:15.955320+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:06.848739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924970,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":399,"num_read_kb":23598,"num_write":1150,"num_write_kb":28139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"256'446","reported_seq":1957,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.468689+0000","last_change":"2024-03-04T12:36:07.294584+0000","last_active":"2024-03-04T12:59:55.468689+0000","last_peered":"2024-03-04T12:59:55.468689+0000","last_clean":"2024-03-04T12:59:55.468689+0000","last_became_active":"2024-03-04T12:36:07.294283+0000","last_became_peered":"2024-03-04T12:36:07.294283+0000","last_unstale":"2024-03-04T12:59:55.468689+0000","last_undegraded":"2024-03-04T12:59:55.468689+0000","last_fullsized":"2024-03-04T12:59:55.468689+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:44:00.573776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2476,"num_read_kb":2316,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"256'291","reported_seq":904,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.003309+0000","last_change":"2024-03-04T12:36:05.290249+0000","last_active":"2024-03-04T13:00:16.003309+0000","last_peered":"2024-03-04T13:00:16.003309+0000","last_clean":"2024-03-04T13:00:16.003309+0000","last_became_active":"2024-03-04T12:36:05.289882+0000","last_became_peered":"2024-03-04T12:36:05.289882+0000","last_unstale":"2024-03-04T13:00:16.003309+0000","last_undegraded":"2024-03-04T13:00:16.003309+0000","last_fullsized":"2024-03-04T13:00:16.003309+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:30.035250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5637358,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":433,"num_read_kb":35092,"num_write":1050,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"256'454","reported_seq":1937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671932+0000","last_change":"2024-03-04T12:36:07.294765+0000","last_active":"2024-03-04T13:00:06.671932+0000","last_peered":"2024-03-04T13:00:06.671932+0000","last_clean":"2024-03-04T13:00:06.671932+0000","last_became_active":"2024-03-04T12:36:07.292904+0000","last_became_peered":"2024-03-04T12:36:07.292904+0000","last_unstale":"2024-03-04T13:00:06.671932+0000","last_undegraded":"2024-03-04T13:00:06.671932+0000","last_fullsized":"2024-03-04T13:00:06.671932+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:02.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2160,"num_write":550,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"256'265","reported_seq":851,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.962326+0000","last_change":"2024-03-04T12:36:05.294662+0000","last_active":"2024-03-04T13:00:15.962326+0000","last_peered":"2024-03-04T13:00:15.962326+0000","last_clean":"2024-03-04T13:00:15.962326+0000","last_became_active":"2024-03-04T12:36:05.294338+0000","last_became_peered":"2024-03-04T12:36:05.294338+0000","last_unstale":"2024-03-04T13:00:15.962326+0000","last_undegraded":"2024-03-04T13:00:15.962326+0000","last_fullsized":"2024-03-04T13:00:15.962326+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:09.803465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265765,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":394,"num_read_kb":2630,"num_write":1096,"num_write_kb":25999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"256'1251","reported_seq":2837,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.468793+0000","last_change":"2024-03-04T12:36:07.292610+0000","last_active":"2024-03-04T12:59:55.468793+0000","last_peered":"2024-03-04T12:59:55.468793+0000","last_clean":"2024-03-04T12:59:55.468793+0000","last_became_active":"2024-03-04T12:36:07.292294+0000","last_became_peered":"2024-03-04T12:36:07.292294+0000","last_unstale":"2024-03-04T12:59:55.468793+0000","last_undegraded":"2024-03-04T12:59:55.468793+0000","last_fullsized":"2024-03-04T12:59:55.468793+0000","mapping_epoch":22,"log_start":"256'1200","ondisk_log_start":"256'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:30:59.966747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5403,"num_read_kb":4680,"num_write":1785,"num_write_kb":760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"256'283","reported_seq":884,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.999538+0000","last_change":"2024-03-04T12:36:05.290703+0000","last_active":"2024-03-04T13:00:15.999538+0000","last_peered":"2024-03-04T13:00:15.999538+0000","last_clean":"2024-03-04T13:00:15.999538+0000","last_became_active":"2024-03-04T12:36:05.290410+0000","last_became_peered":"2024-03-04T12:36:05.290410+0000","last_unstale":"2024-03-04T13:00:15.999538+0000","last_undegraded":"2024-03-04T13:00:15.999538+0000","last_fullsized":"2024-03-04T13:00:15.999538+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:59.309109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6390630,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":409,"num_read_kb":19682,"num_write":1167,"num_write_kb":25111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"256'274","reported_seq":1515,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.123078+0000","last_change":"2024-03-04T12:36:07.293973+0000","last_active":"2024-03-04T12:59:52.123078+0000","last_peered":"2024-03-04T12:59:52.123078+0000","last_clean":"2024-03-04T12:59:52.123078+0000","last_became_active":"2024-03-04T12:36:07.291583+0000","last_became_peered":"2024-03-04T12:36:07.291583+0000","last_unstale":"2024-03-04T12:59:52.123078+0000","last_undegraded":"2024-03-04T12:59:52.123078+0000","last_fullsized":"2024-03-04T12:59:52.123078+0000","mapping_epoch":22,"log_start":"256'200","ondisk_log_start":"256'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:30:48.818767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1552,"num_read_kb":1496,"num_write":324,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"256'353","reported_seq":969,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.006131+0000","last_change":"2024-03-04T12:36:05.290812+0000","last_active":"2024-03-04T13:00:16.006131+0000","last_peered":"2024-03-04T13:00:16.006131+0000","last_clean":"2024-03-04T13:00:16.006131+0000","last_became_active":"2024-03-04T12:36:05.290522+0000","last_became_peered":"2024-03-04T12:36:05.290522+0000","last_unstale":"2024-03-04T13:00:16.006131+0000","last_undegraded":"2024-03-04T13:00:16.006131+0000","last_fullsized":"2024-03-04T13:00:16.006131+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:11:55.799567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12166245,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":559,"num_read_kb":8191,"num_write":1159,"num_write_kb":30951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"256'1119","reported_seq":2696,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.020212+0000","last_change":"2024-03-04T12:36:07.294845+0000","last_active":"2024-03-04T12:59:56.020212+0000","last_peered":"2024-03-04T12:59:56.020212+0000","last_clean":"2024-03-04T12:59:56.020212+0000","last_became_active":"2024-03-04T12:36:07.294536+0000","last_became_peered":"2024-03-04T12:36:07.294536+0000","last_unstale":"2024-03-04T12:59:56.020212+0000","last_undegraded":"2024-03-04T12:59:56.020212+0000","last_fullsized":"2024-03-04T12:59:56.020212+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:59.121496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4737,"num_read_kb":4156,"num_write":1530,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"256'273","reported_seq":886,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.939081+0000","last_change":"2024-03-04T12:36:05.286225+0000","last_active":"2024-03-04T13:00:15.939081+0000","last_peered":"2024-03-04T13:00:15.939081+0000","last_clean":"2024-03-04T13:00:15.939081+0000","last_became_active":"2024-03-04T12:36:05.285924+0000","last_became_peered":"2024-03-04T12:36:05.285924+0000","last_unstale":"2024-03-04T13:00:15.939081+0000","last_undegraded":"2024-03-04T13:00:15.939081+0000","last_fullsized":"2024-03-04T13:00:15.939081+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:09.707595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5191234,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":370,"num_read_kb":22811,"num_write":1021,"num_write_kb":24147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"256'331","reported_seq":1637,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.899638+0000","last_change":"2024-03-04T12:36:07.302695+0000","last_active":"2024-03-04T12:59:54.899638+0000","last_peered":"2024-03-04T12:59:54.899638+0000","last_clean":"2024-03-04T12:59:54.899638+0000","last_became_active":"2024-03-04T12:36:07.302371+0000","last_became_peered":"2024-03-04T12:36:07.302371+0000","last_unstale":"2024-03-04T12:59:54.899638+0000","last_undegraded":"2024-03-04T12:59:54.899638+0000","last_fullsized":"2024-03-04T12:59:54.899638+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:05.080759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1728,"num_read_kb":1642,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"256'274","reported_seq":868,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.853582+0000","last_change":"2024-03-04T12:36:05.290406+0000","last_active":"2024-03-04T13:00:15.853582+0000","last_peered":"2024-03-04T13:00:15.853582+0000","last_clean":"2024-03-04T13:00:15.853582+0000","last_became_active":"2024-03-04T12:36:05.290032+0000","last_became_peered":"2024-03-04T12:36:05.290032+0000","last_unstale":"2024-03-04T13:00:15.853582+0000","last_undegraded":"2024-03-04T13:00:15.853582+0000","last_fullsized":"2024-03-04T13:00:15.853582+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:02.601501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6587184,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":379,"num_read_kb":31102,"num_write":1038,"num_write_kb":33345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"256'416","reported_seq":1942,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.903846+0000","last_change":"2024-03-04T12:36:07.300654+0000","last_active":"2024-03-04T12:59:54.903846+0000","last_peered":"2024-03-04T12:59:54.903846+0000","last_clean":"2024-03-04T12:59:54.903846+0000","last_became_active":"2024-03-04T12:36:07.299718+0000","last_became_peered":"2024-03-04T12:36:07.299718+0000","last_unstale":"2024-03-04T12:59:54.903846+0000","last_undegraded":"2024-03-04T12:59:54.903846+0000","last_fullsized":"2024-03-04T12:59:54.903846+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:35:20.788356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2289,"num_read_kb":2179,"num_write":520,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"256'340","reported_seq":998,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.954726+0000","last_change":"2024-03-04T12:36:05.279867+0000","last_active":"2024-03-04T13:00:15.954726+0000","last_peered":"2024-03-04T13:00:15.954726+0000","last_clean":"2024-03-04T13:00:15.954726+0000","last_became_active":"2024-03-04T12:36:05.279538+0000","last_became_peered":"2024-03-04T12:36:05.279538+0000","last_unstale":"2024-03-04T13:00:15.954726+0000","last_undegraded":"2024-03-04T13:00:15.954726+0000","last_fullsized":"2024-03-04T13:00:15.954726+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:35.650378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6918989,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":570,"num_read_kb":6796,"num_write":1473,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"256'748","reported_seq":2146,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.850080+0000","last_change":"2024-03-04T12:36:07.294946+0000","last_active":"2024-03-04T12:59:48.850080+0000","last_peered":"2024-03-04T12:59:48.850080+0000","last_clean":"2024-03-04T12:59:48.850080+0000","last_became_active":"2024-03-04T12:36:07.294274+0000","last_became_peered":"2024-03-04T12:36:07.294274+0000","last_unstale":"2024-03-04T12:59:48.850080+0000","last_undegraded":"2024-03-04T12:59:48.850080+0000","last_fullsized":"2024-03-04T12:59:48.850080+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:24.843354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3445,"num_read_kb":3067,"num_write":1017,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"256'327","reported_seq":909,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.962540+0000","last_change":"2024-03-04T12:36:40.391610+0000","last_active":"2024-03-04T13:00:15.962540+0000","last_peered":"2024-03-04T13:00:15.962540+0000","last_clean":"2024-03-04T13:00:15.962540+0000","last_became_active":"2024-03-04T12:36:40.391325+0000","last_became_peered":"2024-03-04T12:36:40.391325+0000","last_unstale":"2024-03-04T13:00:15.962540+0000","last_undegraded":"2024-03-04T13:00:15.962540+0000","last_fullsized":"2024-03-04T13:00:15.962540+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:12.401772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11385688,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":467,"num_read_kb":41620,"num_write":1209,"num_write_kb":38740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"256'326","reported_seq":1036,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.959228+0000","last_change":"2024-03-04T12:36:05.288067+0000","last_active":"2024-03-04T13:00:15.959228+0000","last_peered":"2024-03-04T13:00:15.959228+0000","last_clean":"2024-03-04T13:00:15.959228+0000","last_became_active":"2024-03-04T12:36:05.287744+0000","last_became_peered":"2024-03-04T12:36:05.287744+0000","last_unstale":"2024-03-04T13:00:15.959228+0000","last_undegraded":"2024-03-04T13:00:15.959228+0000","last_fullsized":"2024-03-04T13:00:15.959228+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:52.068699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4081952,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":754,"num_read_kb":29804,"num_write":1251,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"256'537","reported_seq":2091,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.609188+0000","last_change":"2024-03-04T12:36:07.302554+0000","last_active":"2024-03-04T12:59:47.609188+0000","last_peered":"2024-03-04T12:59:47.609188+0000","last_clean":"2024-03-04T12:59:47.609188+0000","last_became_active":"2024-03-04T12:36:07.302290+0000","last_became_peered":"2024-03-04T12:36:07.302290+0000","last_unstale":"2024-03-04T12:59:47.609188+0000","last_undegraded":"2024-03-04T12:59:47.609188+0000","last_fullsized":"2024-03-04T12:59:47.609188+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:53.412189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2955,"num_read_kb":2687,"num_write":726,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"256'406","reported_seq":1180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.999620+0000","last_change":"2024-03-04T12:36:05.284158+0000","last_active":"2024-03-04T13:00:15.999620+0000","last_peered":"2024-03-04T13:00:15.999620+0000","last_clean":"2024-03-04T13:00:15.999620+0000","last_became_active":"2024-03-04T12:36:05.283797+0000","last_became_peered":"2024-03-04T12:36:05.283797+0000","last_unstale":"2024-03-04T13:00:15.999620+0000","last_undegraded":"2024-03-04T13:00:15.999620+0000","last_fullsized":"2024-03-04T13:00:15.999620+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:29.801034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15904196,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":1071,"num_read_kb":38636,"num_write":1623,"num_write_kb":30809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"256'783","reported_seq":2208,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.901394+0000","last_change":"2024-03-04T12:36:07.301827+0000","last_active":"2024-03-04T12:59:54.901394+0000","last_peered":"2024-03-04T12:59:54.901394+0000","last_clean":"2024-03-04T12:59:54.901394+0000","last_became_active":"2024-03-04T12:36:07.301542+0000","last_became_peered":"2024-03-04T12:36:07.301542+0000","last_unstale":"2024-03-04T12:59:54.901394+0000","last_undegraded":"2024-03-04T12:59:54.901394+0000","last_fullsized":"2024-03-04T12:59:54.901394+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:45.175861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3434,"num_read_kb":3044,"num_write":1054,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":61919647,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":145,"num_read_kb":179702,"num_write":156,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122798080,"data_stored":122790718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5885,"num_read_kb":4252,"num_write":2245,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1077,"ondisk_log_size":1077,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":9441,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":12014,"num_read_kb":11868,"num_write":14038,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":18882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2352,"ondisk_log_size":2352,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":470,"ondisk_log_size":470,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1765411,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":15272,"num_read_kb":31264,"num_write":13026,"num_write_kb":10804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2318336,"data_stored":1877287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2190,"ondisk_log_size":2190,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1552,"num_read_kb":1546,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":187094,"num_read_kb":170304,"num_write":50851,"num_write_kb":17572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3861,"ondisk_log_size":3861,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":560694938,"num_objects":3061,"num_object_clones":0,"num_object_copies":6122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3061,"num_whiteouts":0,"num_read":32107,"num_read_kb":2210879,"num_write":75838,"num_write_kb":2282182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1146773504,"data_stored":1125152021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4086,"ondisk_log_size":4086,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":61492375,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":146,"num_read_kb":175660,"num_write":156,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122994688,"data_stored":122984750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575146,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":566116,"kb_used_data":291996,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93805724,"statfs":{"total":96636764160,"available":96057061376,"internally_reserved":0,"allocated":299003904,"data_stored":292894628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575147,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361432,"kb_used_data":109388,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94010408,"statfs":{"total":96636764160,"available":96266657792,"internally_reserved":0,"allocated":112013312,"data_stored":108598334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575147,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357592,"kb_used_data":245936,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94014248,"statfs":{"total":96636764160,"available":96270589952,"internally_reserved":0,"allocated":251838464,"data_stored":245965854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575145,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290636,"kb_used_data":223320,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94081204,"statfs":{"total":96636764160,"available":96339152896,"internally_reserved":0,"allocated":228679680,"data_stored":223855331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575145,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":461676,"kb_used_data":205620,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93910164,"statfs":{"total":96636764160,"available":96164007936,"internally_reserved":0,"allocated":210554880,"data_stored":205208502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262142407},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575146,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282108,"kb_used_data":196852,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94089732,"statfs":{"total":96636764160,"available":96347885568,"internally_reserved":0,"allocated":201576448,"data_stored":197312818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575149,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283840,"kb_used_data":176376,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94088000,"statfs":{"total":96636764160,"available":96346112000,"internally_reserved":0,"allocated":180609024,"data_stored":176119526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575146,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":476456,"kb_used_data":220440,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93895384,"statfs":{"total":96636764160,"available":96148873216,"internally_reserved":0,"allocated":225730560,"data_stored":220168485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":151445504,"data_stored":148281035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":97763328,"data_stored":95850048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":122564608,"data_stored":120666676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":148090880,"data_stored":144888191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":196055040,"data_stored":192769456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":162119680,"data_stored":159161227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92483584,"data_stored":90567117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":176250880,"data_stored":172968271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":259557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":244102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":90869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":357717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":43735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":377061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":141578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":362668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28315648,"data_stored":28314756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14730523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25169028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16830464,"data_stored":16827675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19963904,"data_stored":19963089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12120064,"data_stored":12118699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22659072,"data_stored":22654918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":10525905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10539008,"data_stored":10536219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:00:19.459 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T13:00:19.782 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:19.782 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":256,"fsid":"0f6a7118-f776-445e-bdfb-0ec0be103287","created":"2024-03-04T12:35:34.533330+0000","modified":"2024-03-04T12:51:41.419649+0000","last_up_change":"2024-03-04T12:35:45.797580+0000","last_in_change":"2024-03-04T12:35:37.037125+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":67,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T12:35:46.856371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-04T12:35:52.808458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-03-04T12:36:03.994347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-03-04T12:36:05.618319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-03-04T12:36:07.462545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-03-04T12:36:09.384281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-03-04T12:36:11.348355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-03-04T12:36:13.422356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":64,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-03-04T12:43:25.628590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"244","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-03-04T12:44:48.989688+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"247","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-03-04T12:44:51.557878+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"250","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.otp","create_time":"2024-03-04T12:51:00.318298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"253","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8c7f3cf2-45d3-45de-9e96-f23658118260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":255,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6809","nonce":2300499759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6811","nonce":2300499759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6815","nonce":2300499759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2300499759},{"type":"v1","addr":"172.21.15.90:6813","nonce":2300499759}]},"public_addr":"172.21.15.90:6809/2300499759","cluster_addr":"172.21.15.90:6811/2300499759","heartbeat_back_addr":"172.21.15.90:6815/2300499759","heartbeat_front_addr":"172.21.15.90:6813/2300499759","state":["exists","up"]},{"osd":1,"uuid":"b89dd9e5-ffdd-4b15-b6d0-c676f7f43bdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6801","nonce":1270080005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6803","nonce":1270080005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6807","nonce":1270080005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1270080005},{"type":"v1","addr":"172.21.15.90:6805","nonce":1270080005}]},"public_addr":"172.21.15.90:6801/1270080005","cluster_addr":"172.21.15.90:6803/1270080005","heartbeat_back_addr":"172.21.15.90:6807/1270080005","heartbeat_front_addr":"172.21.15.90:6805/1270080005","state":["exists","up"]},{"osd":2,"uuid":"ed82599b-7c3e-43e5-ba21-297d07356a35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":248,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6817","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6819","nonce":137526376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6824","nonce":137526376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6831","nonce":137526376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6827","nonce":137526376},{"type":"v1","addr":"172.21.15.90:6829","nonce":137526376}]},"public_addr":"172.21.15.90:6819/137526376","cluster_addr":"172.21.15.90:6824/137526376","heartbeat_back_addr":"172.21.15.90:6831/137526376","heartbeat_front_addr":"172.21.15.90:6829/137526376","state":["exists","up"]},{"osd":3,"uuid":"a4a85bc4-ad7a-4304-ab73-3048e867e8ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6818","nonce":543891292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6821","nonce":543891292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6828","nonce":543891292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6823","nonce":543891292},{"type":"v1","addr":"172.21.15.90:6825","nonce":543891292}]},"public_addr":"172.21.15.90:6818/543891292","cluster_addr":"172.21.15.90:6821/543891292","heartbeat_back_addr":"172.21.15.90:6828/543891292","heartbeat_front_addr":"172.21.15.90:6825/543891292","state":["exists","up"]},{"osd":4,"uuid":"5a7d2b60-bf44-4630-9c7a-423a1fbcb44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6801","nonce":1721853619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6803","nonce":1721853619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6807","nonce":1721853619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1721853619},{"type":"v1","addr":"172.21.15.184:6805","nonce":1721853619}]},"public_addr":"172.21.15.184:6801/1721853619","cluster_addr":"172.21.15.184:6803/1721853619","heartbeat_back_addr":"172.21.15.184:6807/1721853619","heartbeat_front_addr":"172.21.15.184:6805/1721853619","state":["exists","up"]},{"osd":5,"uuid":"85c4324f-a91a-4fa2-9a6a-4dbe8ffb7e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6825","nonce":1880219084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6827","nonce":1880219084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6831","nonce":1880219084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1880219084},{"type":"v1","addr":"172.21.15.184:6829","nonce":1880219084}]},"public_addr":"172.21.15.184:6825/1880219084","cluster_addr":"172.21.15.184:6827/1880219084","heartbeat_back_addr":"172.21.15.184:6831/1880219084","heartbeat_front_addr":"172.21.15.184:6829/1880219084","state":["exists","up"]},{"osd":6,"uuid":"b645ef8b-e719-4c5d-b1db-f23fd3072384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6809","nonce":2808753711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6811","nonce":2808753711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6815","nonce":2808753711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2808753711},{"type":"v1","addr":"172.21.15.184:6813","nonce":2808753711}]},"public_addr":"172.21.15.184:6809/2808753711","cluster_addr":"172.21.15.184:6811/2808753711","heartbeat_back_addr":"172.21.15.184:6815/2808753711","heartbeat_front_addr":"172.21.15.184:6813/2808753711","state":["exists","up"]},{"osd":7,"uuid":"c4bfe9ed-2753-4115-b557-ed757f670346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6817","nonce":2607900362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6819","nonce":2607900362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6823","nonce":2607900362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2607900362},{"type":"v1","addr":"172.21.15.184:6821","nonce":2607900362}]},"public_addr":"172.21.15.184:6817/2607900362","cluster_addr":"172.21.15.184:6819/2607900362","heartbeat_back_addr":"172.21.15.184:6823/2607900362","heartbeat_front_addr":"172.21.15.184:6821/2607900362","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.155792+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:41.963927+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.190840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.200510+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.172570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.204375+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:35:42.250992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"67.17","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T13:00:20.796 INFO:tasks.ceph:Scrubbing osd.0 2024-03-04T13:00:20.796 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:00:20.947 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T13:00:20.947 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:00:20.947 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T13:00:20.958 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-04T13:00:21.253 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 0 to deep-scrub 2024-03-04T13:00:21.267 INFO:tasks.ceph:Scrubbing osd.1 2024-03-04T13:00:21.267 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:00:21.408 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T13:00:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:00:21.409 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T13:00:21.419 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-04T13:00:21.723 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 1 to deep-scrub 2024-03-04T13:00:21.736 INFO:tasks.ceph:Scrubbing osd.2 2024-03-04T13:00:21.737 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:00:21.875 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T13:00:21.876 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:00:21.876 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T13:00:21.886 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-04T13:00:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 2 to deep-scrub 2024-03-04T13:00:22.194 INFO:tasks.ceph:Scrubbing osd.3 2024-03-04T13:00:22.194 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:00:22.330 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T13:00:22.331 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:00:22.331 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T13:00:22.341 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-04T13:00:22.639 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 3 to deep-scrub 2024-03-04T13:00:22.653 INFO:tasks.ceph:Scrubbing osd.4 2024-03-04T13:00:22.653 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:00:22.791 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T13:00:22.792 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:00:22.792 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T13:00:22.802 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-04T13:00:23.099 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 4 to deep-scrub 2024-03-04T13:00:23.112 INFO:tasks.ceph:Scrubbing osd.5 2024-03-04T13:00:23.112 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:00:23.251 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T13:00:23.251 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:00:23.252 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T13:00:23.263 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-04T13:00:23.565 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 5 to deep-scrub 2024-03-04T13:00:23.578 INFO:tasks.ceph:Scrubbing osd.6 2024-03-04T13:00:23.578 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:00:23.717 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T13:00:23.717 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:00:23.717 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T13:00:23.728 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-04T13:00:24.028 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 6 to deep-scrub 2024-03-04T13:00:24.041 INFO:tasks.ceph:Scrubbing osd.7 2024-03-04T13:00:24.042 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:00:24.179 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-03-04T13:00:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:00:24.180 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-03-04T13:00:24.190 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-04T13:00:24.488 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 7 to deep-scrub 2024-03-04T13:00:24.503 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:00:24.834 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:24.846 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-03-04T13:00:24.848 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":988,"stamp":"2024-03-04T13:00:23.357834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":211431760,"num_objects":820,"num_object_clones":0,"num_object_copies":1640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":820,"num_whiteouts":0,"num_read":257353,"num_read_kb":2788402,"num_write":159314,"num_write_kb":2552482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13713,"ondisk_log_size":13713,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1839112,"kb_used_data":439144,"kb_used_omap":12,"kb_used_meta":1398515,"kb_avail":753135608,"statfs":{"total":773094113280,"available":771210862592,"internally_reserved":0,"allocated":449683456,"data_stored":436517838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1432079920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-732820409,"num_objects":-4124,"num_object_clones":0,"num_object_copies":-8248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4124,"num_whiteouts":0,"num_read":4635,"num_read_kb":4159,"num_write":4341,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005131"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.981271+0000","last_change":"2024-03-04T12:51:01.353518+0000","last_active":"2024-03-04T12:56:00.981271+0000","last_peered":"2024-03-04T12:56:00.981271+0000","last_clean":"2024-03-04T12:56:00.981271+0000","last_became_active":"2024-03-04T12:51:01.353225+0000","last_became_peered":"2024-03-04T12:51:01.353225+0000","last_unstale":"2024-03-04T12:56:00.981271+0000","last_undegraded":"2024-03-04T12:56:00.981271+0000","last_fullsized":"2024-03-04T12:56:00.981271+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:20:07.047294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.000301+0000","last_change":"2024-03-04T12:44:53.484600+0000","last_active":"2024-03-04T12:59:56.000301+0000","last_peered":"2024-03-04T12:59:56.000301+0000","last_clean":"2024-03-04T12:59:56.000301+0000","last_became_active":"2024-03-04T12:44:53.484341+0000","last_became_peered":"2024-03-04T12:44:53.484341+0000","last_unstale":"2024-03-04T12:59:56.000301+0000","last_undegraded":"2024-03-04T12:59:56.000301+0000","last_fullsized":"2024-03-04T12:59:56.000301+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:26:14.610910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:50.981767+0000","last_change":"2024-03-04T12:44:50.455898+0000","last_active":"2024-03-04T12:56:50.981767+0000","last_peered":"2024-03-04T12:56:50.981767+0000","last_clean":"2024-03-04T12:56:50.981767+0000","last_became_active":"2024-03-04T12:44:50.455509+0000","last_became_peered":"2024-03-04T12:44:50.455509+0000","last_unstale":"2024-03-04T12:56:50.981767+0000","last_undegraded":"2024-03-04T12:56:50.981767+0000","last_fullsized":"2024-03-04T12:56:50.981767+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:49.453401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"256'40","reported_seq":137,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.123970+0000","last_change":"2024-03-04T12:43:27.060696+0000","last_active":"2024-03-04T12:58:30.123970+0000","last_peered":"2024-03-04T12:58:30.123970+0000","last_clean":"2024-03-04T12:58:30.123970+0000","last_became_active":"2024-03-04T12:43:27.060405+0000","last_became_peered":"2024-03-04T12:43:27.060405+0000","last_unstale":"2024-03-04T12:58:30.123970+0000","last_undegraded":"2024-03-04T12:58:30.123970+0000","last_fullsized":"2024-03-04T12:58:30.123970+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:44.787006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":118,"num_write":66,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.981316+0000","last_change":"2024-03-04T12:51:01.358434+0000","last_active":"2024-03-04T12:56:00.981316+0000","last_peered":"2024-03-04T12:56:00.981316+0000","last_clean":"2024-03-04T12:56:00.981316+0000","last_became_active":"2024-03-04T12:51:01.358005+0000","last_became_peered":"2024-03-04T12:51:01.358005+0000","last_unstale":"2024-03-04T12:56:00.981316+0000","last_undegraded":"2024-03-04T12:56:00.981316+0000","last_fullsized":"2024-03-04T12:56:00.981316+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:18:34.856742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"256'8","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.000903+0000","last_change":"2024-03-04T12:44:53.487686+0000","last_active":"2024-03-04T12:59:56.000903+0000","last_peered":"2024-03-04T12:59:56.000903+0000","last_clean":"2024-03-04T12:59:56.000903+0000","last_became_active":"2024-03-04T12:44:53.486168+0000","last_became_peered":"2024-03-04T12:44:53.486168+0000","last_unstale":"2024-03-04T12:59:56.000903+0000","last_undegraded":"2024-03-04T12:59:56.000903+0000","last_fullsized":"2024-03-04T12:59:56.000903+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:34.274997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":10242,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.998713+0000","last_change":"2024-03-04T12:44:50.450818+0000","last_active":"2024-03-04T12:57:20.998713+0000","last_peered":"2024-03-04T12:57:20.998713+0000","last_clean":"2024-03-04T12:57:20.998713+0000","last_became_active":"2024-03-04T12:44:50.450465+0000","last_became_peered":"2024-03-04T12:44:50.450465+0000","last_unstale":"2024-03-04T12:57:20.998713+0000","last_undegraded":"2024-03-04T12:57:20.998713+0000","last_fullsized":"2024-03-04T12:57:20.998713+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:20:08.194072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"250'33","reported_seq":127,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:31.000006+0000","last_change":"2024-03-04T12:43:27.060869+0000","last_active":"2024-03-04T12:57:31.000006+0000","last_peered":"2024-03-04T12:57:31.000006+0000","last_clean":"2024-03-04T12:57:31.000006+0000","last_became_active":"2024-03-04T12:43:27.060562+0000","last_became_peered":"2024-03-04T12:43:27.060562+0000","last_unstale":"2024-03-04T12:57:31.000006+0000","last_undegraded":"2024-03-04T12:57:31.000006+0000","last_fullsized":"2024-03-04T12:57:31.000006+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:48.410106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":113,"num_write":48,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.979605+0000","last_change":"2024-03-04T12:51:01.596745+0000","last_active":"2024-03-04T12:57:00.979605+0000","last_peered":"2024-03-04T12:57:00.979605+0000","last_clean":"2024-03-04T12:57:00.979605+0000","last_became_active":"2024-03-04T12:51:01.595776+0000","last_became_peered":"2024-03-04T12:51:01.595776+0000","last_unstale":"2024-03-04T12:57:00.979605+0000","last_undegraded":"2024-03-04T12:57:00.979605+0000","last_fullsized":"2024-03-04T12:57:00.979605+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:37.758945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"256'13","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.328948+0000","last_change":"2024-03-04T12:44:53.479265+0000","last_active":"2024-03-04T13:00:16.328948+0000","last_peered":"2024-03-04T13:00:16.328948+0000","last_clean":"2024-03-04T13:00:16.328948+0000","last_became_active":"2024-03-04T12:44:53.478864+0000","last_became_peered":"2024-03-04T12:44:53.478864+0000","last_unstale":"2024-03-04T13:00:16.328948+0000","last_undegraded":"2024-03-04T13:00:16.328948+0000","last_fullsized":"2024-03-04T13:00:16.328948+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:28:17.550698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":27,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.982244+0000","last_change":"2024-03-04T12:44:50.454109+0000","last_active":"2024-03-04T12:57:20.982244+0000","last_peered":"2024-03-04T12:57:20.982244+0000","last_clean":"2024-03-04T12:57:20.982244+0000","last_became_active":"2024-03-04T12:44:50.453830+0000","last_became_peered":"2024-03-04T12:44:50.453830+0000","last_unstale":"2024-03-04T12:57:20.982244+0000","last_undegraded":"2024-03-04T12:57:20.982244+0000","last_fullsized":"2024-03-04T12:57:20.982244+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:34.779841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"256'64","reported_seq":196,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:09.281547+0000","last_change":"2024-03-04T12:43:27.067573+0000","last_active":"2024-03-04T12:56:09.281547+0000","last_peered":"2024-03-04T12:56:09.281547+0000","last_clean":"2024-03-04T12:56:09.281547+0000","last_became_active":"2024-03-04T12:43:27.067330+0000","last_became_peered":"2024-03-04T12:43:27.067330+0000","last_unstale":"2024-03-04T12:56:09.281547+0000","last_undegraded":"2024-03-04T12:56:09.281547+0000","last_fullsized":"2024-03-04T12:56:09.281547+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:08.510342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":194,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998217+0000","last_change":"2024-03-04T12:51:01.596599+0000","last_active":"2024-03-04T12:57:15.998217+0000","last_peered":"2024-03-04T12:57:15.998217+0000","last_clean":"2024-03-04T12:57:15.998217+0000","last_became_active":"2024-03-04T12:51:01.596268+0000","last_became_peered":"2024-03-04T12:51:01.596268+0000","last_unstale":"2024-03-04T12:57:15.998217+0000","last_undegraded":"2024-03-04T12:57:15.998217+0000","last_fullsized":"2024-03-04T12:57:15.998217+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:07:16.190633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.982302+0000","last_change":"2024-03-04T12:44:53.482037+0000","last_active":"2024-03-04T12:56:55.982302+0000","last_peered":"2024-03-04T12:56:55.982302+0000","last_clean":"2024-03-04T12:56:55.982302+0000","last_became_active":"2024-03-04T12:44:53.481760+0000","last_became_peered":"2024-03-04T12:44:53.481760+0000","last_unstale":"2024-03-04T12:56:55.982302+0000","last_undegraded":"2024-03-04T12:56:55.982302+0000","last_fullsized":"2024-03-04T12:56:55.982302+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:44.305523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.998658+0000","last_change":"2024-03-04T12:44:50.456063+0000","last_active":"2024-03-04T12:57:20.998658+0000","last_peered":"2024-03-04T12:57:20.998658+0000","last_clean":"2024-03-04T12:57:20.998658+0000","last_became_active":"2024-03-04T12:44:50.455723+0000","last_became_peered":"2024-03-04T12:44:50.455723+0000","last_unstale":"2024-03-04T12:57:20.998658+0000","last_undegraded":"2024-03-04T12:57:20.998658+0000","last_fullsized":"2024-03-04T12:57:20.998658+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:10:27.178040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"256'150","reported_seq":499,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.311363+0000","last_change":"2024-03-04T12:43:27.067487+0000","last_active":"2024-03-04T12:57:45.311363+0000","last_peered":"2024-03-04T12:57:45.311363+0000","last_clean":"2024-03-04T12:57:45.311363+0000","last_became_active":"2024-03-04T12:43:27.067228+0000","last_became_peered":"2024-03-04T12:43:27.067228+0000","last_unstale":"2024-03-04T12:57:45.311363+0000","last_undegraded":"2024-03-04T12:57:45.311363+0000","last_fullsized":"2024-03-04T12:57:45.311363+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:38.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":889,"num_read_kb":655,"num_write":189,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.976872+0000","last_change":"2024-03-04T12:51:01.356736+0000","last_active":"2024-03-04T12:55:50.976872+0000","last_peered":"2024-03-04T12:55:50.976872+0000","last_clean":"2024-03-04T12:55:50.976872+0000","last_became_active":"2024-03-04T12:51:01.356572+0000","last_became_peered":"2024-03-04T12:51:01.356572+0000","last_unstale":"2024-03-04T12:55:50.976872+0000","last_undegraded":"2024-03-04T12:55:50.976872+0000","last_fullsized":"2024-03-04T12:55:50.976872+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:07.737968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"256'4","reported_seq":38,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:26.015207+0000","last_change":"2024-03-04T12:44:53.477654+0000","last_active":"2024-03-04T12:59:26.015207+0000","last_peered":"2024-03-04T12:59:26.015207+0000","last_clean":"2024-03-04T12:59:26.015207+0000","last_became_active":"2024-03-04T12:44:53.477386+0000","last_became_peered":"2024-03-04T12:44:53.477386+0000","last_unstale":"2024-03-04T12:59:26.015207+0000","last_undegraded":"2024-03-04T12:59:26.015207+0000","last_fullsized":"2024-03-04T12:59:26.015207+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:49:31.357868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":418,"num_write":4,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.988386+0000","last_change":"2024-03-04T12:44:50.449002+0000","last_active":"2024-03-04T12:57:20.988386+0000","last_peered":"2024-03-04T12:57:20.988386+0000","last_clean":"2024-03-04T12:57:20.988386+0000","last_became_active":"2024-03-04T12:44:50.448683+0000","last_became_peered":"2024-03-04T12:44:50.448683+0000","last_unstale":"2024-03-04T12:57:20.988386+0000","last_undegraded":"2024-03-04T12:57:20.988386+0000","last_fullsized":"2024-03-04T12:57:20.988386+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:39.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"256'38","reported_seq":128,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:29.561426+0000","last_change":"2024-03-04T12:43:27.062948+0000","last_active":"2024-03-04T12:58:29.561426+0000","last_peered":"2024-03-04T12:58:29.561426+0000","last_clean":"2024-03-04T12:58:29.561426+0000","last_became_active":"2024-03-04T12:43:27.062623+0000","last_became_peered":"2024-03-04T12:43:27.062623+0000","last_unstale":"2024-03-04T12:58:29.561426+0000","last_undegraded":"2024-03-04T12:58:29.561426+0000","last_fullsized":"2024-03-04T12:58:29.561426+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:50.641970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.979565+0000","last_change":"2024-03-04T12:51:01.357400+0000","last_active":"2024-03-04T12:55:50.979565+0000","last_peered":"2024-03-04T12:55:50.979565+0000","last_clean":"2024-03-04T12:55:50.979565+0000","last_became_active":"2024-03-04T12:51:01.355578+0000","last_became_peered":"2024-03-04T12:51:01.355578+0000","last_unstale":"2024-03-04T12:55:50.979565+0000","last_undegraded":"2024-03-04T12:55:50.979565+0000","last_fullsized":"2024-03-04T12:55:50.979565+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:25.516318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"256'11","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.328128+0000","last_change":"2024-03-04T12:44:53.477157+0000","last_active":"2024-03-04T13:00:16.328128+0000","last_peered":"2024-03-04T13:00:16.328128+0000","last_clean":"2024-03-04T13:00:16.328128+0000","last_became_active":"2024-03-04T12:44:53.476348+0000","last_became_peered":"2024-03-04T12:44:53.476348+0000","last_unstale":"2024-03-04T13:00:16.328128+0000","last_undegraded":"2024-03-04T13:00:16.328128+0000","last_fullsized":"2024-03-04T13:00:16.328128+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:43.436115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13312,"num_write":16,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'6","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:51.000389+0000","last_change":"2024-03-04T12:44:50.454551+0000","last_active":"2024-03-04T12:59:51.000389+0000","last_peered":"2024-03-04T12:59:51.000389+0000","last_clean":"2024-03-04T12:59:51.000389+0000","last_became_active":"2024-03-04T12:44:50.454252+0000","last_became_peered":"2024-03-04T12:44:50.454252+0000","last_unstale":"2024-03-04T12:59:51.000389+0000","last_undegraded":"2024-03-04T12:59:51.000389+0000","last_fullsized":"2024-03-04T12:59:51.000389+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:16:14.575234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"256'25","reported_seq":96,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:27.547187+0000","last_change":"2024-03-04T12:43:27.061927+0000","last_active":"2024-03-04T12:56:27.547187+0000","last_peered":"2024-03-04T12:56:27.547187+0000","last_clean":"2024-03-04T12:56:27.547187+0000","last_became_active":"2024-03-04T12:43:27.061611+0000","last_became_peered":"2024-03-04T12:43:27.061611+0000","last_unstale":"2024-03-04T12:56:27.547187+0000","last_undegraded":"2024-03-04T12:56:27.547187+0000","last_fullsized":"2024-03-04T12:56:27.547187+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:29.841849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.972502+0000","last_change":"2024-03-04T12:51:01.351751+0000","last_active":"2024-03-04T12:56:00.972502+0000","last_peered":"2024-03-04T12:56:00.972502+0000","last_clean":"2024-03-04T12:56:00.972502+0000","last_became_active":"2024-03-04T12:51:01.351465+0000","last_became_peered":"2024-03-04T12:51:01.351465+0000","last_unstale":"2024-03-04T12:56:00.972502+0000","last_undegraded":"2024-03-04T12:56:00.972502+0000","last_fullsized":"2024-03-04T12:56:00.972502+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:15.131665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"256'4","reported_seq":36,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.017514+0000","last_change":"2024-03-04T12:44:53.483089+0000","last_active":"2024-03-04T12:59:56.017514+0000","last_peered":"2024-03-04T12:59:56.017514+0000","last_clean":"2024-03-04T12:59:56.017514+0000","last_became_active":"2024-03-04T12:44:53.482806+0000","last_became_peered":"2024-03-04T12:44:53.482806+0000","last_unstale":"2024-03-04T12:59:56.017514+0000","last_undegraded":"2024-03-04T12:59:56.017514+0000","last_fullsized":"2024-03-04T12:59:56.017514+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:48:39.848469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":36,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.978599+0000","last_change":"2024-03-04T12:44:50.457492+0000","last_active":"2024-03-04T12:56:55.978599+0000","last_peered":"2024-03-04T12:56:55.978599+0000","last_clean":"2024-03-04T12:56:55.978599+0000","last_became_active":"2024-03-04T12:44:50.457180+0000","last_became_peered":"2024-03-04T12:44:50.457180+0000","last_unstale":"2024-03-04T12:56:55.978599+0000","last_undegraded":"2024-03-04T12:56:55.978599+0000","last_fullsized":"2024-03-04T12:56:55.978599+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:05.748747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"256'43","reported_seq":131,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:08.070073+0000","last_change":"2024-03-04T12:43:27.063888+0000","last_active":"2024-03-04T12:58:08.070073+0000","last_peered":"2024-03-04T12:58:08.070073+0000","last_clean":"2024-03-04T12:58:08.070073+0000","last_became_active":"2024-03-04T12:43:27.063191+0000","last_became_peered":"2024-03-04T12:43:27.063191+0000","last_unstale":"2024-03-04T12:58:08.070073+0000","last_undegraded":"2024-03-04T12:58:08.070073+0000","last_fullsized":"2024-03-04T12:58:08.070073+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:06.499554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":76,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:00.978217+0000","last_change":"2024-03-04T12:51:01.353519+0000","last_active":"2024-03-04T12:56:00.978217+0000","last_peered":"2024-03-04T12:56:00.978217+0000","last_clean":"2024-03-04T12:56:00.978217+0000","last_became_active":"2024-03-04T12:51:01.353248+0000","last_became_peered":"2024-03-04T12:51:01.353248+0000","last_unstale":"2024-03-04T12:56:00.978217+0000","last_undegraded":"2024-03-04T12:56:00.978217+0000","last_fullsized":"2024-03-04T12:56:00.978217+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:08:04.830256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"250'5","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.995929+0000","last_change":"2024-03-04T12:44:53.483754+0000","last_active":"2024-03-04T12:57:25.995929+0000","last_peered":"2024-03-04T12:57:25.995929+0000","last_clean":"2024-03-04T12:57:25.995929+0000","last_became_active":"2024-03-04T12:44:53.483210+0000","last_became_peered":"2024-03-04T12:44:53.483210+0000","last_unstale":"2024-03-04T12:57:25.995929+0000","last_undegraded":"2024-03-04T12:57:25.995929+0000","last_fullsized":"2024-03-04T12:57:25.995929+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:13.903672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"256'8","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:21.013507+0000","last_change":"2024-03-04T12:44:50.449512+0000","last_active":"2024-03-04T12:59:21.013507+0000","last_peered":"2024-03-04T12:59:21.013507+0000","last_clean":"2024-03-04T12:59:21.013507+0000","last_became_active":"2024-03-04T12:44:50.449291+0000","last_became_peered":"2024-03-04T12:44:50.449291+0000","last_unstale":"2024-03-04T12:59:21.013507+0000","last_undegraded":"2024-03-04T12:59:21.013507+0000","last_fullsized":"2024-03-04T12:59:21.013507+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:31.117281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"256'42","reported_seq":129,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:11.125334+0000","last_change":"2024-03-04T12:43:27.061951+0000","last_active":"2024-03-04T12:58:11.125334+0000","last_peered":"2024-03-04T12:58:11.125334+0000","last_clean":"2024-03-04T12:58:11.125334+0000","last_became_active":"2024-03-04T12:43:27.061663+0000","last_became_peered":"2024-03-04T12:43:27.061663+0000","last_unstale":"2024-03-04T12:58:11.125334+0000","last_undegraded":"2024-03-04T12:58:11.125334+0000","last_fullsized":"2024-03-04T12:58:11.125334+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:27:00.046660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:00.987648+0000","last_change":"2024-03-04T12:51:01.596240+0000","last_active":"2024-03-04T12:58:00.987648+0000","last_peered":"2024-03-04T12:58:00.987648+0000","last_clean":"2024-03-04T12:58:00.987648+0000","last_became_active":"2024-03-04T12:51:01.595943+0000","last_became_peered":"2024-03-04T12:51:01.595943+0000","last_unstale":"2024-03-04T12:58:00.987648+0000","last_undegraded":"2024-03-04T12:58:00.987648+0000","last_fullsized":"2024-03-04T12:58:00.987648+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:05:52.818694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"256'2","reported_seq":34,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:25.897958+0000","last_change":"2024-03-04T12:44:53.486306+0000","last_active":"2024-03-04T12:59:25.897958+0000","last_peered":"2024-03-04T12:59:25.897958+0000","last_clean":"2024-03-04T12:59:25.897958+0000","last_became_active":"2024-03-04T12:44:53.485995+0000","last_became_peered":"2024-03-04T12:44:53.485995+0000","last_unstale":"2024-03-04T12:59:25.897958+0000","last_undegraded":"2024-03-04T12:59:25.897958+0000","last_fullsized":"2024-03-04T12:59:25.897958+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:08.363349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"256'4","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:20.996938+0000","last_change":"2024-03-04T12:44:50.454948+0000","last_active":"2024-03-04T12:59:20.996938+0000","last_peered":"2024-03-04T12:59:20.996938+0000","last_clean":"2024-03-04T12:59:20.996938+0000","last_became_active":"2024-03-04T12:44:50.454617+0000","last_became_peered":"2024-03-04T12:44:50.454617+0000","last_unstale":"2024-03-04T12:59:20.996938+0000","last_undegraded":"2024-03-04T12:59:20.996938+0000","last_fullsized":"2024-03-04T12:59:20.996938+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:25:07.798347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"256'41","reported_seq":134,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:02.415602+0000","last_change":"2024-03-04T12:43:27.050913+0000","last_active":"2024-03-04T12:58:02.415602+0000","last_peered":"2024-03-04T12:58:02.415602+0000","last_clean":"2024-03-04T12:58:02.415602+0000","last_became_active":"2024-03-04T12:43:27.050088+0000","last_became_peered":"2024-03-04T12:43:27.050088+0000","last_unstale":"2024-03-04T12:58:02.415602+0000","last_undegraded":"2024-03-04T12:58:02.415602+0000","last_fullsized":"2024-03-04T12:58:02.415602+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:10:21.742322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":112,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.971352+0000","last_change":"2024-03-04T12:51:01.595890+0000","last_active":"2024-03-04T12:55:50.971352+0000","last_peered":"2024-03-04T12:55:50.971352+0000","last_clean":"2024-03-04T12:55:50.971352+0000","last_became_active":"2024-03-04T12:51:01.595530+0000","last_became_peered":"2024-03-04T12:51:01.595530+0000","last_unstale":"2024-03-04T12:55:50.971352+0000","last_undegraded":"2024-03-04T12:55:50.971352+0000","last_fullsized":"2024-03-04T12:55:50.971352+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:42:04.439066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"256'4","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.814138+0000","last_change":"2024-03-04T12:44:53.478706+0000","last_active":"2024-03-04T13:00:15.814138+0000","last_peered":"2024-03-04T13:00:15.814138+0000","last_clean":"2024-03-04T13:00:15.814138+0000","last_became_active":"2024-03-04T12:44:53.478099+0000","last_became_peered":"2024-03-04T12:44:53.478099+0000","last_unstale":"2024-03-04T13:00:15.814138+0000","last_undegraded":"2024-03-04T13:00:15.814138+0000","last_fullsized":"2024-03-04T13:00:15.814138+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:06:14.838765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:55.995606+0000","last_change":"2024-03-04T12:44:50.449111+0000","last_active":"2024-03-04T12:56:55.995606+0000","last_peered":"2024-03-04T12:56:55.995606+0000","last_clean":"2024-03-04T12:56:55.995606+0000","last_became_active":"2024-03-04T12:44:50.448745+0000","last_became_peered":"2024-03-04T12:44:50.448745+0000","last_unstale":"2024-03-04T12:56:55.995606+0000","last_undegraded":"2024-03-04T12:56:55.995606+0000","last_fullsized":"2024-03-04T12:56:55.995606+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:10:12.812219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"256'16","reported_seq":80,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:14.293042+0000","last_change":"2024-03-04T12:43:27.059795+0000","last_active":"2024-03-04T12:58:14.293042+0000","last_peered":"2024-03-04T12:58:14.293042+0000","last_clean":"2024-03-04T12:58:14.293042+0000","last_became_active":"2024-03-04T12:43:27.059494+0000","last_became_peered":"2024-03-04T12:43:27.059494+0000","last_unstale":"2024-03-04T12:58:14.293042+0000","last_undegraded":"2024-03-04T12:58:14.293042+0000","last_fullsized":"2024-03-04T12:58:14.293042+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:49.787014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":48,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":21,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:50.979602+0000","last_change":"2024-03-04T12:51:01.355844+0000","last_active":"2024-03-04T12:55:50.979602+0000","last_peered":"2024-03-04T12:55:50.979602+0000","last_clean":"2024-03-04T12:55:50.979602+0000","last_became_active":"2024-03-04T12:51:01.355560+0000","last_became_peered":"2024-03-04T12:51:01.355560+0000","last_unstale":"2024-03-04T12:55:50.979602+0000","last_undegraded":"2024-03-04T12:55:50.979602+0000","last_fullsized":"2024-03-04T12:55:50.979602+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:05:47.161069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'3","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996437+0000","last_change":"2024-03-04T12:44:53.476693+0000","last_active":"2024-03-04T12:57:00.996437+0000","last_peered":"2024-03-04T12:57:00.996437+0000","last_clean":"2024-03-04T12:57:00.996437+0000","last_became_active":"2024-03-04T12:44:53.475861+0000","last_became_peered":"2024-03-04T12:44:53.475861+0000","last_unstale":"2024-03-04T12:57:00.996437+0000","last_undegraded":"2024-03-04T12:57:00.996437+0000","last_fullsized":"2024-03-04T12:57:00.996437+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:17.651931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"256'7","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:55.893212+0000","last_change":"2024-03-04T12:44:50.453813+0000","last_active":"2024-03-04T12:58:55.893212+0000","last_peered":"2024-03-04T12:58:55.893212+0000","last_clean":"2024-03-04T12:58:55.893212+0000","last_became_active":"2024-03-04T12:44:50.453541+0000","last_became_peered":"2024-03-04T12:44:50.453541+0000","last_unstale":"2024-03-04T12:58:55.893212+0000","last_undegraded":"2024-03-04T12:58:55.893212+0000","last_fullsized":"2024-03-04T12:58:55.893212+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:58.224158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"256'48","reported_seq":147,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.129302+0000","last_change":"2024-03-04T12:43:27.071953+0000","last_active":"2024-03-04T12:58:05.129302+0000","last_peered":"2024-03-04T12:58:05.129302+0000","last_clean":"2024-03-04T12:58:05.129302+0000","last_became_active":"2024-03-04T12:43:27.069664+0000","last_became_peered":"2024-03-04T12:43:27.069664+0000","last_unstale":"2024-03-04T12:58:05.129302+0000","last_undegraded":"2024-03-04T12:58:05.129302+0000","last_fullsized":"2024-03-04T12:58:05.129302+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:18:04.123917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":13,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.992618+0000","last_change":"2024-03-04T12:51:41.753110+0000","last_active":"2024-03-04T12:56:30.992618+0000","last_peered":"2024-03-04T12:56:30.992618+0000","last_clean":"2024-03-04T12:56:30.992618+0000","last_became_active":"2024-03-04T12:51:41.752775+0000","last_became_peered":"2024-03-04T12:51:41.752775+0000","last_unstale":"2024-03-04T12:56:30.992618+0000","last_undegraded":"2024-03-04T12:56:30.992618+0000","last_fullsized":"2024-03-04T12:56:30.992618+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:14.336520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"256'7","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:25.997558+0000","last_change":"2024-03-04T12:44:53.478491+0000","last_active":"2024-03-04T12:59:25.997558+0000","last_peered":"2024-03-04T12:59:25.997558+0000","last_clean":"2024-03-04T12:59:25.997558+0000","last_became_active":"2024-03-04T12:44:53.478126+0000","last_became_peered":"2024-03-04T12:44:53.478126+0000","last_unstale":"2024-03-04T12:59:25.997558+0000","last_undegraded":"2024-03-04T12:59:25.997558+0000","last_fullsized":"2024-03-04T12:59:25.997558+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:47.296637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11793,"num_write":12,"num_write_kb":7697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'2","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:20.997042+0000","last_change":"2024-03-04T12:44:50.455922+0000","last_active":"2024-03-04T12:59:20.997042+0000","last_peered":"2024-03-04T12:59:20.997042+0000","last_clean":"2024-03-04T12:59:20.997042+0000","last_became_active":"2024-03-04T12:44:50.455571+0000","last_became_peered":"2024-03-04T12:44:50.455571+0000","last_unstale":"2024-03-04T12:59:20.997042+0000","last_undegraded":"2024-03-04T12:59:20.997042+0000","last_fullsized":"2024-03-04T12:59:20.997042+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:00.096593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"256'47","reported_seq":142,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.983079+0000","last_change":"2024-03-04T12:43:27.060510+0000","last_active":"2024-03-04T12:57:30.983079+0000","last_peered":"2024-03-04T12:57:30.983079+0000","last_clean":"2024-03-04T12:57:30.983079+0000","last_became_active":"2024-03-04T12:43:27.060225+0000","last_became_peered":"2024-03-04T12:43:27.060225+0000","last_unstale":"2024-03-04T12:57:30.983079+0000","last_undegraded":"2024-03-04T12:57:30.983079+0000","last_fullsized":"2024-03-04T12:57:30.983079+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:54.961280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":112,"num_write":82,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:00.987040+0000","last_change":"2024-03-04T12:51:01.353480+0000","last_active":"2024-03-04T12:58:00.987040+0000","last_peered":"2024-03-04T12:58:00.987040+0000","last_clean":"2024-03-04T12:58:00.987040+0000","last_became_active":"2024-03-04T12:51:01.353087+0000","last_became_peered":"2024-03-04T12:51:01.353087+0000","last_unstale":"2024-03-04T12:58:00.987040+0000","last_undegraded":"2024-03-04T12:58:00.987040+0000","last_fullsized":"2024-03-04T12:58:00.987040+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:41.880369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.976551+0000","last_change":"2024-03-04T12:44:53.486342+0000","last_active":"2024-03-04T12:56:35.976551+0000","last_peered":"2024-03-04T12:56:35.976551+0000","last_clean":"2024-03-04T12:56:35.976551+0000","last_became_active":"2024-03-04T12:44:53.485819+0000","last_became_peered":"2024-03-04T12:44:53.485819+0000","last_unstale":"2024-03-04T12:56:35.976551+0000","last_undegraded":"2024-03-04T12:56:35.976551+0000","last_fullsized":"2024-03-04T12:56:35.976551+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:16.679448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"256'16","reported_seq":70,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:51.009503+0000","last_change":"2024-03-04T12:44:50.451881+0000","last_active":"2024-03-04T12:58:51.009503+0000","last_peered":"2024-03-04T12:58:51.009503+0000","last_clean":"2024-03-04T12:58:51.009503+0000","last_became_active":"2024-03-04T12:44:50.451612+0000","last_became_peered":"2024-03-04T12:44:50.451612+0000","last_unstale":"2024-03-04T12:58:51.009503+0000","last_undegraded":"2024-03-04T12:58:51.009503+0000","last_fullsized":"2024-03-04T12:58:51.009503+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:32.014515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":29700,"num_write":24,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"256'29","reported_seq":109,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.986253+0000","last_change":"2024-03-04T12:43:27.067821+0000","last_active":"2024-03-04T12:57:30.986253+0000","last_peered":"2024-03-04T12:57:30.986253+0000","last_clean":"2024-03-04T12:57:30.986253+0000","last_became_active":"2024-03-04T12:43:27.067356+0000","last_became_peered":"2024-03-04T12:43:27.067356+0000","last_unstale":"2024-03-04T12:57:30.986253+0000","last_undegraded":"2024-03-04T12:57:30.986253+0000","last_fullsized":"2024-03-04T12:57:30.986253+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:08.857494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":50,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:00.987065+0000","last_change":"2024-03-04T12:51:01.353135+0000","last_active":"2024-03-04T12:58:00.987065+0000","last_peered":"2024-03-04T12:58:00.987065+0000","last_clean":"2024-03-04T12:58:00.987065+0000","last_became_active":"2024-03-04T12:51:01.352205+0000","last_became_peered":"2024-03-04T12:51:01.352205+0000","last_unstale":"2024-03-04T12:58:00.987065+0000","last_undegraded":"2024-03-04T12:58:00.987065+0000","last_fullsized":"2024-03-04T12:58:00.987065+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:10:58.627530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"256'9","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.816844+0000","last_change":"2024-03-04T12:44:53.480313+0000","last_active":"2024-03-04T13:00:15.816844+0000","last_peered":"2024-03-04T13:00:15.816844+0000","last_clean":"2024-03-04T13:00:15.816844+0000","last_became_active":"2024-03-04T12:44:53.479906+0000","last_became_peered":"2024-03-04T12:44:53.479906+0000","last_unstale":"2024-03-04T13:00:15.816844+0000","last_undegraded":"2024-03-04T13:00:15.816844+0000","last_fullsized":"2024-03-04T13:00:15.816844+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:53:21.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8765,"num_write":13,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"256'2","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:50.892362+0000","last_change":"2024-03-04T12:44:50.455993+0000","last_active":"2024-03-04T12:58:50.892362+0000","last_peered":"2024-03-04T12:58:50.892362+0000","last_clean":"2024-03-04T12:58:50.892362+0000","last_became_active":"2024-03-04T12:44:50.455705+0000","last_became_peered":"2024-03-04T12:44:50.455705+0000","last_unstale":"2024-03-04T12:58:50.892362+0000","last_undegraded":"2024-03-04T12:58:50.892362+0000","last_fullsized":"2024-03-04T12:58:50.892362+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:28:07.679290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"256'37","reported_seq":129,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996807+0000","last_change":"2024-03-04T12:43:27.050258+0000","last_active":"2024-03-04T12:57:30.996807+0000","last_peered":"2024-03-04T12:57:30.996807+0000","last_clean":"2024-03-04T12:57:30.996807+0000","last_became_active":"2024-03-04T12:43:27.049948+0000","last_became_peered":"2024-03-04T12:43:27.049948+0000","last_unstale":"2024-03-04T12:57:30.996807+0000","last_undegraded":"2024-03-04T12:57:30.996807+0000","last_fullsized":"2024-03-04T12:57:30.996807+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:58:15.839313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":102,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:00.993662+0000","last_change":"2024-03-04T12:51:01.355931+0000","last_active":"2024-03-04T12:58:00.993662+0000","last_peered":"2024-03-04T12:58:00.993662+0000","last_clean":"2024-03-04T12:58:00.993662+0000","last_became_active":"2024-03-04T12:51:01.355460+0000","last_became_peered":"2024-03-04T12:51:01.355460+0000","last_unstale":"2024-03-04T12:58:00.993662+0000","last_undegraded":"2024-03-04T12:58:00.993662+0000","last_fullsized":"2024-03-04T12:58:00.993662+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:17:13.384167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.987291+0000","last_change":"2024-03-04T12:44:53.483084+0000","last_active":"2024-03-04T12:56:35.987291+0000","last_peered":"2024-03-04T12:56:35.987291+0000","last_clean":"2024-03-04T12:56:35.987291+0000","last_became_active":"2024-03-04T12:44:53.482573+0000","last_became_peered":"2024-03-04T12:44:53.482573+0000","last_unstale":"2024-03-04T12:56:35.987291+0000","last_undegraded":"2024-03-04T12:56:35.987291+0000","last_fullsized":"2024-03-04T12:56:35.987291+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:53.724969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":36,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.975976+0000","last_change":"2024-03-04T12:44:50.453266+0000","last_active":"2024-03-04T12:56:30.975976+0000","last_peered":"2024-03-04T12:56:30.975976+0000","last_clean":"2024-03-04T12:56:30.975976+0000","last_became_active":"2024-03-04T12:44:50.450815+0000","last_became_peered":"2024-03-04T12:44:50.450815+0000","last_unstale":"2024-03-04T12:56:30.975976+0000","last_undegraded":"2024-03-04T12:56:30.975976+0000","last_fullsized":"2024-03-04T12:56:30.975976+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:55.139788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"256'28","reported_seq":105,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996809+0000","last_change":"2024-03-04T12:43:27.056330+0000","last_active":"2024-03-04T12:57:30.996809+0000","last_peered":"2024-03-04T12:57:30.996809+0000","last_clean":"2024-03-04T12:57:30.996809+0000","last_became_active":"2024-03-04T12:43:27.055932+0000","last_became_peered":"2024-03-04T12:43:27.055932+0000","last_unstale":"2024-03-04T12:57:30.996809+0000","last_undegraded":"2024-03-04T12:57:30.996809+0000","last_fullsized":"2024-03-04T12:57:30.996809+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:37.799617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"253'1","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:00.987629+0000","last_change":"2024-03-04T12:51:01.356544+0000","last_active":"2024-03-04T12:58:00.987629+0000","last_peered":"2024-03-04T12:58:00.987629+0000","last_clean":"2024-03-04T12:58:00.987629+0000","last_became_active":"2024-03-04T12:51:01.356234+0000","last_became_peered":"2024-03-04T12:51:01.356234+0000","last_unstale":"2024-03-04T12:58:00.987629+0000","last_undegraded":"2024-03-04T12:58:00.987629+0000","last_fullsized":"2024-03-04T12:58:00.987629+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:48:48.586485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:35.982336+0000","last_change":"2024-03-04T12:44:53.481928+0000","last_active":"2024-03-04T12:56:35.982336+0000","last_peered":"2024-03-04T12:56:35.982336+0000","last_clean":"2024-03-04T12:56:35.982336+0000","last_became_active":"2024-03-04T12:44:53.481628+0000","last_became_peered":"2024-03-04T12:44:53.481628+0000","last_unstale":"2024-03-04T12:56:35.982336+0000","last_undegraded":"2024-03-04T12:56:35.982336+0000","last_fullsized":"2024-03-04T12:56:35.982336+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:17.939017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"250'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.986374+0000","last_change":"2024-03-04T12:44:50.457916+0000","last_active":"2024-03-04T12:56:30.986374+0000","last_peered":"2024-03-04T12:56:30.986374+0000","last_clean":"2024-03-04T12:56:30.986374+0000","last_became_active":"2024-03-04T12:44:50.457629+0000","last_became_peered":"2024-03-04T12:44:50.457629+0000","last_unstale":"2024-03-04T12:56:30.986374+0000","last_undegraded":"2024-03-04T12:56:30.986374+0000","last_fullsized":"2024-03-04T12:56:30.986374+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:34.728903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"256'46","reported_seq":148,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.983328+0000","last_change":"2024-03-04T12:43:27.061563+0000","last_active":"2024-03-04T12:57:30.983328+0000","last_peered":"2024-03-04T12:57:30.983328+0000","last_clean":"2024-03-04T12:57:30.983328+0000","last_became_active":"2024-03-04T12:43:27.061268+0000","last_became_peered":"2024-03-04T12:43:27.061268+0000","last_unstale":"2024-03-04T12:57:30.983328+0000","last_undegraded":"2024-03-04T12:57:30.983328+0000","last_fullsized":"2024-03-04T12:57:30.983328+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:22.110813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":125,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"254'1","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985556+0000","last_change":"2024-03-04T12:51:01.352006+0000","last_active":"2024-03-04T12:57:45.985556+0000","last_peered":"2024-03-04T12:57:45.985556+0000","last_clean":"2024-03-04T12:57:45.985556+0000","last_became_active":"2024-03-04T12:51:01.351718+0000","last_became_peered":"2024-03-04T12:51:01.351718+0000","last_unstale":"2024-03-04T12:57:45.985556+0000","last_undegraded":"2024-03-04T12:57:45.985556+0000","last_fullsized":"2024-03-04T12:57:45.985556+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:24:57.533969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"256'7","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:25.991502+0000","last_change":"2024-03-04T12:44:53.480592+0000","last_active":"2024-03-04T12:58:25.991502+0000","last_peered":"2024-03-04T12:58:25.991502+0000","last_clean":"2024-03-04T12:58:25.991502+0000","last_became_active":"2024-03-04T12:44:53.480237+0000","last_became_peered":"2024-03-04T12:44:53.480237+0000","last_unstale":"2024-03-04T12:58:25.991502+0000","last_undegraded":"2024-03-04T12:58:25.991502+0000","last_fullsized":"2024-03-04T12:58:25.991502+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:42.531307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"256'4","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:21.004604+0000","last_change":"2024-03-04T12:44:50.451651+0000","last_active":"2024-03-04T12:58:21.004604+0000","last_peered":"2024-03-04T12:58:21.004604+0000","last_clean":"2024-03-04T12:58:21.004604+0000","last_became_active":"2024-03-04T12:44:50.451353+0000","last_became_peered":"2024-03-04T12:44:50.451353+0000","last_unstale":"2024-03-04T12:58:21.004604+0000","last_undegraded":"2024-03-04T12:58:21.004604+0000","last_fullsized":"2024-03-04T12:58:21.004604+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:38.552540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"256'22","reported_seq":88,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991999+0000","last_change":"2024-03-04T12:43:27.060928+0000","last_active":"2024-03-04T12:57:00.991999+0000","last_peered":"2024-03-04T12:57:00.991999+0000","last_clean":"2024-03-04T12:57:00.991999+0000","last_became_active":"2024-03-04T12:43:27.060626+0000","last_became_peered":"2024-03-04T12:43:27.060626+0000","last_unstale":"2024-03-04T12:57:00.991999+0000","last_undegraded":"2024-03-04T12:57:00.991999+0000","last_fullsized":"2024-03-04T12:57:00.991999+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:18.681323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":39,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985610+0000","last_change":"2024-03-04T12:51:01.356830+0000","last_active":"2024-03-04T12:57:45.985610+0000","last_peered":"2024-03-04T12:57:45.985610+0000","last_clean":"2024-03-04T12:57:45.985610+0000","last_became_active":"2024-03-04T12:51:01.356268+0000","last_became_peered":"2024-03-04T12:51:01.356268+0000","last_unstale":"2024-03-04T12:57:45.985610+0000","last_undegraded":"2024-03-04T12:57:45.985610+0000","last_fullsized":"2024-03-04T12:57:45.985610+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:55:16.934337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:25.889144+0000","last_change":"2024-03-04T12:44:53.489009+0000","last_active":"2024-03-04T12:58:25.889144+0000","last_peered":"2024-03-04T12:58:25.889144+0000","last_clean":"2024-03-04T12:58:25.889144+0000","last_became_active":"2024-03-04T12:44:53.488798+0000","last_became_peered":"2024-03-04T12:44:53.488798+0000","last_unstale":"2024-03-04T12:58:25.889144+0000","last_undegraded":"2024-03-04T12:58:25.889144+0000","last_fullsized":"2024-03-04T12:58:25.889144+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:57.438592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'9","reported_seq":51,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.425181+0000","last_change":"2024-03-04T12:44:50.449837+0000","last_active":"2024-03-04T13:00:16.425181+0000","last_peered":"2024-03-04T13:00:16.425181+0000","last_clean":"2024-03-04T13:00:16.425181+0000","last_became_active":"2024-03-04T12:44:50.449555+0000","last_became_peered":"2024-03-04T12:44:50.449555+0000","last_unstale":"2024-03-04T13:00:16.425181+0000","last_undegraded":"2024-03-04T13:00:16.425181+0000","last_fullsized":"2024-03-04T13:00:16.425181+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:28:29.864964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9220,"num_write":14,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"256'38","reported_seq":131,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.628221+0000","last_change":"2024-03-04T12:43:27.062921+0000","last_active":"2024-03-04T12:58:30.628221+0000","last_peered":"2024-03-04T12:58:30.628221+0000","last_clean":"2024-03-04T12:58:30.628221+0000","last_became_active":"2024-03-04T12:43:27.062618+0000","last_became_peered":"2024-03-04T12:43:27.062618+0000","last_unstale":"2024-03-04T12:58:30.628221+0000","last_undegraded":"2024-03-04T12:58:30.628221+0000","last_fullsized":"2024-03-04T12:58:30.628221+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:15.108779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":110,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985636+0000","last_change":"2024-03-04T12:51:01.358213+0000","last_active":"2024-03-04T12:57:45.985636+0000","last_peered":"2024-03-04T12:57:45.985636+0000","last_clean":"2024-03-04T12:57:45.985636+0000","last_became_active":"2024-03-04T12:51:01.357842+0000","last_became_peered":"2024-03-04T12:51:01.357842+0000","last_unstale":"2024-03-04T12:57:45.985636+0000","last_undegraded":"2024-03-04T12:57:45.985636+0000","last_fullsized":"2024-03-04T12:57:45.985636+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:49:05.564345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:25.989739+0000","last_change":"2024-03-04T12:44:53.483502+0000","last_active":"2024-03-04T12:58:25.989739+0000","last_peered":"2024-03-04T12:58:25.989739+0000","last_clean":"2024-03-04T12:58:25.989739+0000","last_became_active":"2024-03-04T12:44:53.483209+0000","last_became_peered":"2024-03-04T12:44:53.483209+0000","last_unstale":"2024-03-04T12:58:25.989739+0000","last_undegraded":"2024-03-04T12:58:25.989739+0000","last_fullsized":"2024-03-04T12:58:25.989739+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:30.529782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"256'6","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.248716+0000","last_change":"2024-03-04T12:44:50.458501+0000","last_active":"2024-03-04T13:00:16.248716+0000","last_peered":"2024-03-04T13:00:16.248716+0000","last_clean":"2024-03-04T13:00:16.248716+0000","last_became_active":"2024-03-04T12:44:50.458158+0000","last_became_peered":"2024-03-04T12:44:50.458158+0000","last_unstale":"2024-03-04T13:00:16.248716+0000","last_undegraded":"2024-03-04T13:00:16.248716+0000","last_fullsized":"2024-03-04T13:00:16.248716+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:23.431721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"256'48","reported_seq":150,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991998+0000","last_change":"2024-03-04T12:43:27.058847+0000","last_active":"2024-03-04T12:57:00.991998+0000","last_peered":"2024-03-04T12:57:00.991998+0000","last_clean":"2024-03-04T12:57:00.991998+0000","last_became_active":"2024-03-04T12:43:27.058410+0000","last_became_peered":"2024-03-04T12:43:27.058410+0000","last_unstale":"2024-03-04T12:57:00.991998+0000","last_undegraded":"2024-03-04T12:57:00.991998+0000","last_fullsized":"2024-03-04T12:57:00.991998+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:41.466619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":132,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.985014+0000","last_change":"2024-03-04T12:51:01.597461+0000","last_active":"2024-03-04T12:57:45.985014+0000","last_peered":"2024-03-04T12:57:45.985014+0000","last_clean":"2024-03-04T12:57:45.985014+0000","last_became_active":"2024-03-04T12:51:01.597162+0000","last_became_peered":"2024-03-04T12:51:01.597162+0000","last_unstale":"2024-03-04T12:57:45.985014+0000","last_undegraded":"2024-03-04T12:57:45.985014+0000","last_fullsized":"2024-03-04T12:57:45.985014+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:42:36.597535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":30,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.989977+0000","last_change":"2024-03-04T12:44:53.478668+0000","last_active":"2024-03-04T12:56:10.989977+0000","last_peered":"2024-03-04T12:56:10.989977+0000","last_clean":"2024-03-04T12:56:10.989977+0000","last_became_active":"2024-03-04T12:44:53.478352+0000","last_became_peered":"2024-03-04T12:44:53.478352+0000","last_unstale":"2024-03-04T12:56:10.989977+0000","last_undegraded":"2024-03-04T12:56:10.989977+0000","last_fullsized":"2024-03-04T12:56:10.989977+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:59:40.881954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"256'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:20.996511+0000","last_change":"2024-03-04T12:44:50.449921+0000","last_active":"2024-03-04T12:58:20.996511+0000","last_peered":"2024-03-04T12:58:20.996511+0000","last_clean":"2024-03-04T12:58:20.996511+0000","last_became_active":"2024-03-04T12:44:50.449627+0000","last_became_peered":"2024-03-04T12:44:50.449627+0000","last_unstale":"2024-03-04T12:58:20.996511+0000","last_undegraded":"2024-03-04T12:58:20.996511+0000","last_fullsized":"2024-03-04T12:58:20.996511+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:14:46.561998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"244'9","reported_seq":65,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991914+0000","last_change":"2024-03-04T12:43:27.057430+0000","last_active":"2024-03-04T12:57:00.991914+0000","last_peered":"2024-03-04T12:57:00.991914+0000","last_clean":"2024-03-04T12:57:00.991914+0000","last_became_active":"2024-03-04T12:43:27.057074+0000","last_became_peered":"2024-03-04T12:43:27.057074+0000","last_unstale":"2024-03-04T12:57:00.991914+0000","last_undegraded":"2024-03-04T12:57:00.991914+0000","last_fullsized":"2024-03-04T12:57:00.991914+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:45.722473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.881147+0000","last_change":"2024-03-04T12:51:01.595664+0000","last_active":"2024-03-04T12:57:30.881147+0000","last_peered":"2024-03-04T12:57:30.881147+0000","last_clean":"2024-03-04T12:57:30.881147+0000","last_became_active":"2024-03-04T12:51:01.595390+0000","last_became_peered":"2024-03-04T12:51:01.595390+0000","last_unstale":"2024-03-04T12:57:30.881147+0000","last_undegraded":"2024-03-04T12:57:30.881147+0000","last_fullsized":"2024-03-04T12:57:30.881147+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:23.043787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"256'7","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.001532+0000","last_change":"2024-03-04T12:44:53.484184+0000","last_active":"2024-03-04T13:00:06.001532+0000","last_peered":"2024-03-04T13:00:06.001532+0000","last_clean":"2024-03-04T13:00:06.001532+0000","last_became_active":"2024-03-04T12:44:53.482800+0000","last_became_peered":"2024-03-04T12:44:53.482800+0000","last_unstale":"2024-03-04T13:00:06.001532+0000","last_undegraded":"2024-03-04T13:00:06.001532+0000","last_fullsized":"2024-03-04T13:00:06.001532+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:58.026882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'8","reported_seq":51,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.248729+0000","last_change":"2024-03-04T12:44:50.456248+0000","last_active":"2024-03-04T13:00:16.248729+0000","last_peered":"2024-03-04T13:00:16.248729+0000","last_clean":"2024-03-04T13:00:16.248729+0000","last_became_active":"2024-03-04T12:44:50.455937+0000","last_became_peered":"2024-03-04T12:44:50.455937+0000","last_unstale":"2024-03-04T13:00:16.248729+0000","last_undegraded":"2024-03-04T13:00:16.248729+0000","last_fullsized":"2024-03-04T13:00:16.248729+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:23.581048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":7,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"256'148","reported_seq":390,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:44.913079+0000","last_change":"2024-03-04T12:43:27.065338+0000","last_active":"2024-03-04T12:57:44.913079+0000","last_peered":"2024-03-04T12:57:44.913079+0000","last_clean":"2024-03-04T12:57:44.913079+0000","last_became_active":"2024-03-04T12:43:27.065085+0000","last_became_peered":"2024-03-04T12:43:27.065085+0000","last_unstale":"2024-03-04T12:57:44.913079+0000","last_undegraded":"2024-03-04T12:57:44.913079+0000","last_fullsized":"2024-03-04T12:57:44.913079+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:46.662116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":610,"num_read_kb":432,"num_write":236,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996782+0000","last_change":"2024-03-04T12:51:01.353357+0000","last_active":"2024-03-04T12:57:30.996782+0000","last_peered":"2024-03-04T12:57:30.996782+0000","last_clean":"2024-03-04T12:57:30.996782+0000","last_became_active":"2024-03-04T12:51:01.353012+0000","last_became_peered":"2024-03-04T12:51:01.353012+0000","last_unstale":"2024-03-04T12:57:30.996782+0000","last_undegraded":"2024-03-04T12:57:30.996782+0000","last_fullsized":"2024-03-04T12:57:30.996782+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:49:18.123279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"256'6","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.018524+0000","last_change":"2024-03-04T12:44:53.484778+0000","last_active":"2024-03-04T13:00:06.018524+0000","last_peered":"2024-03-04T13:00:06.018524+0000","last_clean":"2024-03-04T13:00:06.018524+0000","last_became_active":"2024-03-04T12:44:53.484514+0000","last_became_peered":"2024-03-04T12:44:53.484514+0000","last_unstale":"2024-03-04T13:00:06.018524+0000","last_undegraded":"2024-03-04T13:00:06.018524+0000","last_fullsized":"2024-03-04T13:00:06.018524+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:17.495701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4138,"num_write":5,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"256'5","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.673315+0000","last_change":"2024-03-04T12:44:50.450378+0000","last_active":"2024-03-04T13:00:16.673315+0000","last_peered":"2024-03-04T13:00:16.673315+0000","last_clean":"2024-03-04T13:00:16.673315+0000","last_became_active":"2024-03-04T12:44:50.450101+0000","last_became_peered":"2024-03-04T12:44:50.450101+0000","last_unstale":"2024-03-04T13:00:16.673315+0000","last_undegraded":"2024-03-04T13:00:16.673315+0000","last_fullsized":"2024-03-04T13:00:16.673315+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:55:05.158919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"256'27","reported_seq":98,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.979590+0000","last_change":"2024-03-04T12:43:27.068000+0000","last_active":"2024-03-04T12:56:30.979590+0000","last_peered":"2024-03-04T12:56:30.979590+0000","last_clean":"2024-03-04T12:56:30.979590+0000","last_became_active":"2024-03-04T12:43:27.067391+0000","last_became_peered":"2024-03-04T12:43:27.067391+0000","last_unstale":"2024-03-04T12:56:30.979590+0000","last_undegraded":"2024-03-04T12:56:30.979590+0000","last_fullsized":"2024-03-04T12:56:30.979590+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:51:04.022422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:35.881989+0000","last_change":"2024-03-04T12:51:01.352487+0000","last_active":"2024-03-04T12:57:35.881989+0000","last_peered":"2024-03-04T12:57:35.881989+0000","last_clean":"2024-03-04T12:57:35.881989+0000","last_became_active":"2024-03-04T12:51:01.352191+0000","last_became_peered":"2024-03-04T12:51:01.352191+0000","last_unstale":"2024-03-04T12:57:35.881989+0000","last_undegraded":"2024-03-04T12:57:35.881989+0000","last_fullsized":"2024-03-04T12:57:35.881989+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:22.391789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:26.005350+0000","last_change":"2024-03-04T12:44:53.482531+0000","last_active":"2024-03-04T12:58:26.005350+0000","last_peered":"2024-03-04T12:58:26.005350+0000","last_clean":"2024-03-04T12:58:26.005350+0000","last_became_active":"2024-03-04T12:44:53.482253+0000","last_became_peered":"2024-03-04T12:44:53.482253+0000","last_unstale":"2024-03-04T12:58:26.005350+0000","last_undegraded":"2024-03-04T12:58:26.005350+0000","last_fullsized":"2024-03-04T12:58:26.005350+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:55:37.720046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.992327+0000","last_change":"2024-03-04T12:44:50.449345+0000","last_active":"2024-03-04T12:57:50.992327+0000","last_peered":"2024-03-04T12:57:50.992327+0000","last_clean":"2024-03-04T12:57:50.992327+0000","last_became_active":"2024-03-04T12:44:50.449070+0000","last_became_peered":"2024-03-04T12:44:50.449070+0000","last_unstale":"2024-03-04T12:57:50.992327+0000","last_undegraded":"2024-03-04T12:57:50.992327+0000","last_fullsized":"2024-03-04T12:57:50.992327+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:55.637780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"256'13","reported_seq":71,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:31.228261+0000","last_change":"2024-03-04T12:43:27.061968+0000","last_active":"2024-03-04T12:56:31.228261+0000","last_peered":"2024-03-04T12:56:31.228261+0000","last_clean":"2024-03-04T12:56:31.228261+0000","last_became_active":"2024-03-04T12:43:27.061574+0000","last_became_peered":"2024-03-04T12:43:27.061574+0000","last_unstale":"2024-03-04T12:56:31.228261+0000","last_undegraded":"2024-03-04T12:56:31.228261+0000","last_fullsized":"2024-03-04T12:56:31.228261+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:18:07.868716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:45.984940+0000","last_change":"2024-03-04T12:51:01.356675+0000","last_active":"2024-03-04T12:57:45.984940+0000","last_peered":"2024-03-04T12:57:45.984940+0000","last_clean":"2024-03-04T12:57:45.984940+0000","last_became_active":"2024-03-04T12:51:01.356286+0000","last_became_peered":"2024-03-04T12:51:01.356286+0000","last_unstale":"2024-03-04T12:57:45.984940+0000","last_undegraded":"2024-03-04T12:57:45.984940+0000","last_fullsized":"2024-03-04T12:57:45.984940+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:02:42.855512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"256'6","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.490817+0000","last_change":"2024-03-04T12:44:53.478083+0000","last_active":"2024-03-04T13:00:15.490817+0000","last_peered":"2024-03-04T13:00:15.490817+0000","last_clean":"2024-03-04T13:00:15.490817+0000","last_became_active":"2024-03-04T12:44:53.477801+0000","last_became_peered":"2024-03-04T12:44:53.477801+0000","last_unstale":"2024-03-04T13:00:15.490817+0000","last_undegraded":"2024-03-04T13:00:15.490817+0000","last_fullsized":"2024-03-04T13:00:15.490817+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:23.298015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"256'4","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.425672+0000","last_change":"2024-03-04T12:44:50.456287+0000","last_active":"2024-03-04T13:00:15.425672+0000","last_peered":"2024-03-04T13:00:15.425672+0000","last_clean":"2024-03-04T13:00:15.425672+0000","last_became_active":"2024-03-04T12:44:50.456005+0000","last_became_peered":"2024-03-04T12:44:50.456005+0000","last_unstale":"2024-03-04T13:00:15.425672+0000","last_undegraded":"2024-03-04T13:00:15.425672+0000","last_fullsized":"2024-03-04T13:00:15.425672+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:59:09.950535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"256'19","reported_seq":84,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.981609+0000","last_change":"2024-03-04T12:43:27.055261+0000","last_active":"2024-03-04T12:56:30.981609+0000","last_peered":"2024-03-04T12:56:30.981609+0000","last_clean":"2024-03-04T12:56:30.981609+0000","last_became_active":"2024-03-04T12:43:27.054951+0000","last_became_peered":"2024-03-04T12:43:27.054951+0000","last_unstale":"2024-03-04T12:56:30.981609+0000","last_undegraded":"2024-03-04T12:56:30.981609+0000","last_fullsized":"2024-03-04T12:56:30.981609+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:25:39.570283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":48,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998179+0000","last_change":"2024-03-04T12:51:01.596612+0000","last_active":"2024-03-04T12:57:15.998179+0000","last_peered":"2024-03-04T12:57:15.998179+0000","last_clean":"2024-03-04T12:57:15.998179+0000","last_became_active":"2024-03-04T12:51:01.596248+0000","last_became_peered":"2024-03-04T12:51:01.596248+0000","last_unstale":"2024-03-04T12:57:15.998179+0000","last_undegraded":"2024-03-04T12:57:15.998179+0000","last_fullsized":"2024-03-04T12:57:15.998179+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:41:22.243454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.985709+0000","last_change":"2024-03-04T12:44:53.481249+0000","last_active":"2024-03-04T12:57:25.985709+0000","last_peered":"2024-03-04T12:57:25.985709+0000","last_clean":"2024-03-04T12:57:25.985709+0000","last_became_active":"2024-03-04T12:44:53.480987+0000","last_became_peered":"2024-03-04T12:44:53.480987+0000","last_unstale":"2024-03-04T12:57:25.985709+0000","last_undegraded":"2024-03-04T12:57:25.985709+0000","last_fullsized":"2024-03-04T12:57:25.985709+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:51:53.423493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"256'4","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.425589+0000","last_change":"2024-03-04T12:44:50.456748+0000","last_active":"2024-03-04T13:00:15.425589+0000","last_peered":"2024-03-04T13:00:15.425589+0000","last_clean":"2024-03-04T13:00:15.425589+0000","last_became_active":"2024-03-04T12:44:50.455944+0000","last_became_peered":"2024-03-04T12:44:50.455944+0000","last_unstale":"2024-03-04T13:00:15.425589+0000","last_undegraded":"2024-03-04T13:00:15.425589+0000","last_fullsized":"2024-03-04T13:00:15.425589+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:14:51.600085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"256'15","reported_seq":78,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.979646+0000","last_change":"2024-03-04T12:43:27.060487+0000","last_active":"2024-03-04T12:56:30.979646+0000","last_peered":"2024-03-04T12:56:30.979646+0000","last_clean":"2024-03-04T12:56:30.979646+0000","last_became_active":"2024-03-04T12:43:27.060180+0000","last_became_peered":"2024-03-04T12:43:27.060180+0000","last_unstale":"2024-03-04T12:56:30.979646+0000","last_undegraded":"2024-03-04T12:56:30.979646+0000","last_fullsized":"2024-03-04T12:56:30.979646+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:19.510448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998192+0000","last_change":"2024-03-04T12:51:01.350629+0000","last_active":"2024-03-04T12:57:15.998192+0000","last_peered":"2024-03-04T12:57:15.998192+0000","last_clean":"2024-03-04T12:57:15.998192+0000","last_became_active":"2024-03-04T12:51:01.350349+0000","last_became_peered":"2024-03-04T12:51:01.350349+0000","last_unstale":"2024-03-04T12:57:15.998192+0000","last_undegraded":"2024-03-04T12:57:15.998192+0000","last_fullsized":"2024-03-04T12:57:15.998192+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:57.667851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"256'6","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.898868+0000","last_change":"2024-03-04T12:44:53.485721+0000","last_active":"2024-03-04T12:59:30.898868+0000","last_peered":"2024-03-04T12:59:30.898868+0000","last_clean":"2024-03-04T12:59:30.898868+0000","last_became_active":"2024-03-04T12:44:53.485429+0000","last_became_peered":"2024-03-04T12:44:53.485429+0000","last_unstale":"2024-03-04T12:59:30.898868+0000","last_undegraded":"2024-03-04T12:59:30.898868+0000","last_fullsized":"2024-03-04T12:59:30.898868+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:41:33.023905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"250'5","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:51.002839+0000","last_change":"2024-03-04T12:44:50.452899+0000","last_active":"2024-03-04T12:57:51.002839+0000","last_peered":"2024-03-04T12:57:51.002839+0000","last_clean":"2024-03-04T12:57:51.002839+0000","last_became_active":"2024-03-04T12:44:50.452611+0000","last_became_peered":"2024-03-04T12:44:50.452611+0000","last_unstale":"2024-03-04T12:57:51.002839+0000","last_undegraded":"2024-03-04T12:57:51.002839+0000","last_fullsized":"2024-03-04T12:57:51.002839+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:06:51.414927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"256'20","reported_seq":91,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:13.481796+0000","last_change":"2024-03-04T12:43:27.064585+0000","last_active":"2024-03-04T12:58:13.481796+0000","last_peered":"2024-03-04T12:58:13.481796+0000","last_clean":"2024-03-04T12:58:13.481796+0000","last_became_active":"2024-03-04T12:43:27.064375+0000","last_became_peered":"2024-03-04T12:43:27.064375+0000","last_unstale":"2024-03-04T12:58:13.481796+0000","last_undegraded":"2024-03-04T12:58:13.481796+0000","last_fullsized":"2024-03-04T12:58:13.481796+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:39:12.810173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":61,"num_write":47,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"252'1","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.996931+0000","last_change":"2024-03-04T12:51:01.350196+0000","last_active":"2024-03-04T12:57:30.996931+0000","last_peered":"2024-03-04T12:57:30.996931+0000","last_clean":"2024-03-04T12:57:30.996931+0000","last_became_active":"2024-03-04T12:51:01.349889+0000","last_became_peered":"2024-03-04T12:51:01.349889+0000","last_unstale":"2024-03-04T12:57:30.996931+0000","last_undegraded":"2024-03-04T12:57:30.996931+0000","last_fullsized":"2024-03-04T12:57:30.996931+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:26:14.298363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"256'2","reported_seq":34,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:05.904115+0000","last_change":"2024-03-04T12:44:53.489468+0000","last_active":"2024-03-04T13:00:05.904115+0000","last_peered":"2024-03-04T13:00:05.904115+0000","last_clean":"2024-03-04T13:00:05.904115+0000","last_became_active":"2024-03-04T12:44:53.489232+0000","last_became_peered":"2024-03-04T12:44:53.489232+0000","last_unstale":"2024-03-04T13:00:05.904115+0000","last_undegraded":"2024-03-04T13:00:05.904115+0000","last_fullsized":"2024-03-04T13:00:05.904115+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:26:44.977704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.981541+0000","last_change":"2024-03-04T12:44:50.459626+0000","last_active":"2024-03-04T12:57:20.981541+0000","last_peered":"2024-03-04T12:57:20.981541+0000","last_clean":"2024-03-04T12:57:20.981541+0000","last_became_active":"2024-03-04T12:44:50.459359+0000","last_became_peered":"2024-03-04T12:44:50.459359+0000","last_unstale":"2024-03-04T12:57:20.981541+0000","last_undegraded":"2024-03-04T12:57:20.981541+0000","last_fullsized":"2024-03-04T12:57:20.981541+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:42.852613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"256'25","reported_seq":106,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:06.002606+0000","last_change":"2024-03-04T12:43:27.060629+0000","last_active":"2024-03-04T12:58:06.002606+0000","last_peered":"2024-03-04T12:58:06.002606+0000","last_clean":"2024-03-04T12:58:06.002606+0000","last_became_active":"2024-03-04T12:43:27.060115+0000","last_became_peered":"2024-03-04T12:43:27.060115+0000","last_unstale":"2024-03-04T12:58:06.002606+0000","last_undegraded":"2024-03-04T12:58:06.002606+0000","last_fullsized":"2024-03-04T12:58:06.002606+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:15:16.480822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:30.881250+0000","last_change":"2024-03-04T12:51:01.596756+0000","last_active":"2024-03-04T12:57:30.881250+0000","last_peered":"2024-03-04T12:57:30.881250+0000","last_clean":"2024-03-04T12:57:30.881250+0000","last_became_active":"2024-03-04T12:51:01.596463+0000","last_became_peered":"2024-03-04T12:51:01.596463+0000","last_unstale":"2024-03-04T12:57:30.881250+0000","last_undegraded":"2024-03-04T12:57:30.881250+0000","last_fullsized":"2024-03-04T12:57:30.881250+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:47:44.675447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"256'6","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.022136+0000","last_change":"2024-03-04T12:44:53.479417+0000","last_active":"2024-03-04T13:00:06.022136+0000","last_peered":"2024-03-04T13:00:06.022136+0000","last_clean":"2024-03-04T13:00:06.022136+0000","last_became_active":"2024-03-04T12:44:53.479076+0000","last_became_peered":"2024-03-04T12:44:53.479076+0000","last_unstale":"2024-03-04T13:00:06.022136+0000","last_undegraded":"2024-03-04T13:00:06.022136+0000","last_fullsized":"2024-03-04T13:00:06.022136+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:57.384073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"256'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.898889+0000","last_change":"2024-03-04T12:44:50.454670+0000","last_active":"2024-03-04T12:59:30.898889+0000","last_peered":"2024-03-04T12:59:30.898889+0000","last_clean":"2024-03-04T12:59:30.898889+0000","last_became_active":"2024-03-04T12:44:50.454398+0000","last_became_peered":"2024-03-04T12:44:50.454398+0000","last_unstale":"2024-03-04T12:59:30.898889+0000","last_undegraded":"2024-03-04T12:59:30.898889+0000","last_fullsized":"2024-03-04T12:59:30.898889+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:24:18.356924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"256'33","reported_seq":117,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.886555+0000","last_change":"2024-03-04T12:43:27.060915+0000","last_active":"2024-03-04T12:58:05.886555+0000","last_peered":"2024-03-04T12:58:05.886555+0000","last_clean":"2024-03-04T12:58:05.886555+0000","last_became_active":"2024-03-04T12:43:27.060589+0000","last_became_peered":"2024-03-04T12:43:27.060589+0000","last_unstale":"2024-03-04T12:58:05.886555+0000","last_undegraded":"2024-03-04T12:58:05.886555+0000","last_fullsized":"2024-03-04T12:58:05.886555+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:52:13.475390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":90,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991815+0000","last_change":"2024-03-04T12:51:01.357439+0000","last_active":"2024-03-04T12:57:00.991815+0000","last_peered":"2024-03-04T12:57:00.991815+0000","last_clean":"2024-03-04T12:57:00.991815+0000","last_became_active":"2024-03-04T12:51:01.355416+0000","last_became_peered":"2024-03-04T12:51:01.355416+0000","last_unstale":"2024-03-04T12:57:00.991815+0000","last_undegraded":"2024-03-04T12:57:00.991815+0000","last_fullsized":"2024-03-04T12:57:00.991815+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:22:00.087119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"256'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.898812+0000","last_change":"2024-03-04T12:44:53.486527+0000","last_active":"2024-03-04T12:59:30.898812+0000","last_peered":"2024-03-04T12:59:30.898812+0000","last_clean":"2024-03-04T12:59:30.898812+0000","last_became_active":"2024-03-04T12:44:53.486235+0000","last_became_peered":"2024-03-04T12:44:53.486235+0000","last_unstale":"2024-03-04T12:59:30.898812+0000","last_undegraded":"2024-03-04T12:59:30.898812+0000","last_fullsized":"2024-03-04T12:59:30.898812+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:38:59.682681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"256'7","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.697967+0000","last_change":"2024-03-04T12:44:50.458855+0000","last_active":"2024-03-04T13:00:15.697967+0000","last_peered":"2024-03-04T13:00:15.697967+0000","last_clean":"2024-03-04T13:00:15.697967+0000","last_became_active":"2024-03-04T12:44:50.458610+0000","last_became_peered":"2024-03-04T12:44:50.458610+0000","last_unstale":"2024-03-04T13:00:15.697967+0000","last_undegraded":"2024-03-04T13:00:15.697967+0000","last_fullsized":"2024-03-04T13:00:15.697967+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:02:54.023215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7739,"num_write":12,"num_write_kb":7739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"256'17","reported_seq":79,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.988149+0000","last_change":"2024-03-04T12:43:27.067610+0000","last_active":"2024-03-04T12:58:05.988149+0000","last_peered":"2024-03-04T12:58:05.988149+0000","last_clean":"2024-03-04T12:58:05.988149+0000","last_became_active":"2024-03-04T12:43:27.067223+0000","last_became_peered":"2024-03-04T12:43:27.067223+0000","last_unstale":"2024-03-04T12:58:05.988149+0000","last_undegraded":"2024-03-04T12:58:05.988149+0000","last_fullsized":"2024-03-04T12:58:05.988149+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:38:30.372407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":41,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.980872+0000","last_change":"2024-03-04T12:51:01.353788+0000","last_active":"2024-03-04T12:57:15.980872+0000","last_peered":"2024-03-04T12:57:15.980872+0000","last_clean":"2024-03-04T12:57:15.980872+0000","last_became_active":"2024-03-04T12:51:01.353432+0000","last_became_peered":"2024-03-04T12:51:01.353432+0000","last_unstale":"2024-03-04T12:57:15.980872+0000","last_undegraded":"2024-03-04T12:57:15.980872+0000","last_fullsized":"2024-03-04T12:57:15.980872+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:01:52.475724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"250'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.876625+0000","last_change":"2024-03-04T12:44:53.482645+0000","last_active":"2024-03-04T12:57:00.876625+0000","last_peered":"2024-03-04T12:57:00.876625+0000","last_clean":"2024-03-04T12:57:00.876625+0000","last_became_active":"2024-03-04T12:44:53.482370+0000","last_became_peered":"2024-03-04T12:44:53.482370+0000","last_unstale":"2024-03-04T12:57:00.876625+0000","last_undegraded":"2024-03-04T12:57:00.876625+0000","last_fullsized":"2024-03-04T12:57:00.876625+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:19:00.147319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"256'4","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:26.015264+0000","last_change":"2024-03-04T12:44:50.451000+0000","last_active":"2024-03-04T12:59:26.015264+0000","last_peered":"2024-03-04T12:59:26.015264+0000","last_clean":"2024-03-04T12:59:26.015264+0000","last_became_active":"2024-03-04T12:44:50.450681+0000","last_became_peered":"2024-03-04T12:44:50.450681+0000","last_unstale":"2024-03-04T12:59:26.015264+0000","last_undegraded":"2024-03-04T12:59:26.015264+0000","last_fullsized":"2024-03-04T12:59:26.015264+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:33:37.753695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":368,"num_write":4,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"256'61","reported_seq":196,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:05.994297+0000","last_change":"2024-03-04T12:43:27.057075+0000","last_active":"2024-03-04T12:58:05.994297+0000","last_peered":"2024-03-04T12:58:05.994297+0000","last_clean":"2024-03-04T12:58:05.994297+0000","last_became_active":"2024-03-04T12:43:27.056781+0000","last_became_peered":"2024-03-04T12:43:27.056781+0000","last_unstale":"2024-03-04T12:58:05.994297+0000","last_undegraded":"2024-03-04T12:58:05.994297+0000","last_fullsized":"2024-03-04T12:58:05.994297+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:46:26.120127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":203,"num_write":94,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.994328+0000","last_change":"2024-03-04T12:51:01.349501+0000","last_active":"2024-03-04T12:57:15.994328+0000","last_peered":"2024-03-04T12:57:15.994328+0000","last_clean":"2024-03-04T12:57:15.994328+0000","last_became_active":"2024-03-04T12:51:01.349216+0000","last_became_peered":"2024-03-04T12:51:01.349216+0000","last_unstale":"2024-03-04T12:57:15.994328+0000","last_undegraded":"2024-03-04T12:57:15.994328+0000","last_fullsized":"2024-03-04T12:57:15.994328+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:06.080102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.989012+0000","last_change":"2024-03-04T12:44:53.479666+0000","last_active":"2024-03-04T12:57:25.989012+0000","last_peered":"2024-03-04T12:57:25.989012+0000","last_clean":"2024-03-04T12:57:25.989012+0000","last_became_active":"2024-03-04T12:44:53.479411+0000","last_became_peered":"2024-03-04T12:44:53.479411+0000","last_unstale":"2024-03-04T12:57:25.989012+0000","last_undegraded":"2024-03-04T12:57:25.989012+0000","last_fullsized":"2024-03-04T12:57:25.989012+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:44.241135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'5","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:55.893128+0000","last_change":"2024-03-04T12:44:50.451910+0000","last_active":"2024-03-04T12:58:55.893128+0000","last_peered":"2024-03-04T12:58:55.893128+0000","last_clean":"2024-03-04T12:58:55.893128+0000","last_became_active":"2024-03-04T12:44:50.451626+0000","last_became_peered":"2024-03-04T12:44:50.451626+0000","last_unstale":"2024-03-04T12:58:55.893128+0000","last_undegraded":"2024-03-04T12:58:55.893128+0000","last_fullsized":"2024-03-04T12:58:55.893128+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:38.879751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"256'127","reported_seq":405,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:06.002489+0000","last_change":"2024-03-04T12:43:27.056721+0000","last_active":"2024-03-04T12:58:06.002489+0000","last_peered":"2024-03-04T12:58:06.002489+0000","last_clean":"2024-03-04T12:58:06.002489+0000","last_became_active":"2024-03-04T12:43:27.056007+0000","last_became_peered":"2024-03-04T12:43:27.056007+0000","last_unstale":"2024-03-04T12:58:06.002489+0000","last_undegraded":"2024-03-04T12:58:06.002489+0000","last_fullsized":"2024-03-04T12:58:06.002489+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:47.106941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":540,"num_write":158,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.987839+0000","last_change":"2024-03-04T12:51:01.354894+0000","last_active":"2024-03-04T12:57:15.987839+0000","last_peered":"2024-03-04T12:57:15.987839+0000","last_clean":"2024-03-04T12:57:15.987839+0000","last_became_active":"2024-03-04T12:51:01.354601+0000","last_became_peered":"2024-03-04T12:51:01.354601+0000","last_unstale":"2024-03-04T12:57:15.987839+0000","last_undegraded":"2024-03-04T12:57:15.987839+0000","last_fullsized":"2024-03-04T12:57:15.987839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:00:49.358407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:25.982297+0000","last_change":"2024-03-04T12:44:53.486591+0000","last_active":"2024-03-04T12:57:25.982297+0000","last_peered":"2024-03-04T12:57:25.982297+0000","last_clean":"2024-03-04T12:57:25.982297+0000","last_became_active":"2024-03-04T12:44:53.486321+0000","last_became_peered":"2024-03-04T12:44:53.486321+0000","last_unstale":"2024-03-04T12:57:25.982297+0000","last_undegraded":"2024-03-04T12:57:25.982297+0000","last_fullsized":"2024-03-04T12:57:25.982297+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:17:26.146570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"250'2","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:20.988362+0000","last_change":"2024-03-04T12:44:50.456615+0000","last_active":"2024-03-04T12:57:20.988362+0000","last_peered":"2024-03-04T12:57:20.988362+0000","last_clean":"2024-03-04T12:57:20.988362+0000","last_became_active":"2024-03-04T12:44:50.456315+0000","last_became_peered":"2024-03-04T12:44:50.456315+0000","last_unstale":"2024-03-04T12:57:20.988362+0000","last_undegraded":"2024-03-04T12:57:20.988362+0000","last_fullsized":"2024-03-04T12:57:20.988362+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:45.991675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"256'28","reported_seq":104,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:18.211202+0000","last_change":"2024-03-04T12:43:27.064503+0000","last_active":"2024-03-04T12:59:18.211202+0000","last_peered":"2024-03-04T12:59:18.211202+0000","last_clean":"2024-03-04T12:59:18.211202+0000","last_became_active":"2024-03-04T12:43:27.064141+0000","last_became_peered":"2024-03-04T12:43:27.064141+0000","last_unstale":"2024-03-04T12:59:18.211202+0000","last_undegraded":"2024-03-04T12:59:18.211202+0000","last_fullsized":"2024-03-04T12:59:18.211202+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:28:02.741960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"256'410","reported_seq":1056,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.105426+0000","last_change":"2024-03-04T12:36:40.392809+0000","last_active":"2024-03-04T13:00:17.105426+0000","last_peered":"2024-03-04T13:00:17.105426+0000","last_clean":"2024-03-04T13:00:17.105426+0000","last_became_active":"2024-03-04T12:36:40.392399+0000","last_became_peered":"2024-03-04T12:36:40.392399+0000","last_unstale":"2024-03-04T13:00:17.105426+0000","last_undegraded":"2024-03-04T13:00:17.105426+0000","last_fullsized":"2024-03-04T13:00:17.105426+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:58:34.780333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194364,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":637,"num_read_kb":17405,"num_write":1486,"num_write_kb":42784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"256'1110","reported_seq":2693,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.838199+0000","last_change":"2024-03-04T12:36:07.296271+0000","last_active":"2024-03-04T12:59:48.838199+0000","last_peered":"2024-03-04T12:59:48.838199+0000","last_clean":"2024-03-04T12:59:48.838199+0000","last_became_active":"2024-03-04T12:36:07.295125+0000","last_became_peered":"2024-03-04T12:36:07.295125+0000","last_unstale":"2024-03-04T12:59:48.838199+0000","last_undegraded":"2024-03-04T12:59:48.838199+0000","last_fullsized":"2024-03-04T12:59:48.838199+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:01:37.876237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4869,"num_read_kb":4281,"num_write":1536,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"256'315","reported_seq":910,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.046244+0000","last_change":"2024-03-04T12:36:05.280982+0000","last_active":"2024-03-04T13:00:17.046244+0000","last_peered":"2024-03-04T13:00:17.046244+0000","last_clean":"2024-03-04T13:00:17.046244+0000","last_became_active":"2024-03-04T12:36:05.280695+0000","last_became_peered":"2024-03-04T12:36:05.280695+0000","last_unstale":"2024-03-04T13:00:17.046244+0000","last_undegraded":"2024-03-04T13:00:17.046244+0000","last_fullsized":"2024-03-04T13:00:17.046244+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:14.407483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256487,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":427,"num_read_kb":2412,"num_write":1141,"num_write_kb":20516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"256'544","reported_seq":1937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671828+0000","last_change":"2024-03-04T12:36:07.297041+0000","last_active":"2024-03-04T13:00:06.671828+0000","last_peered":"2024-03-04T13:00:06.671828+0000","last_clean":"2024-03-04T13:00:06.671828+0000","last_became_active":"2024-03-04T12:36:07.296651+0000","last_became_peered":"2024-03-04T12:36:07.296651+0000","last_unstale":"2024-03-04T13:00:06.671828+0000","last_undegraded":"2024-03-04T13:00:06.671828+0000","last_fullsized":"2024-03-04T13:00:06.671828+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:29:22.170255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2661,"num_read_kb":2496,"num_write":771,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"256'328","reported_seq":931,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.116957+0000","last_change":"2024-03-04T12:36:05.285321+0000","last_active":"2024-03-04T13:00:17.116957+0000","last_peered":"2024-03-04T13:00:17.116957+0000","last_clean":"2024-03-04T13:00:17.116957+0000","last_became_active":"2024-03-04T12:36:05.285054+0000","last_became_peered":"2024-03-04T12:36:05.285054+0000","last_unstale":"2024-03-04T13:00:17.116957+0000","last_undegraded":"2024-03-04T13:00:17.116957+0000","last_fullsized":"2024-03-04T13:00:17.116957+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:36.940053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695847,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":27372,"num_write":1039,"num_write_kb":18696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"256'594","reported_seq":2014,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:49.593829+0000","last_change":"2024-03-04T12:36:07.298949+0000","last_active":"2024-03-04T12:59:49.593829+0000","last_peered":"2024-03-04T12:59:49.593829+0000","last_clean":"2024-03-04T12:59:49.593829+0000","last_became_active":"2024-03-04T12:36:07.298528+0000","last_became_peered":"2024-03-04T12:36:07.298528+0000","last_unstale":"2024-03-04T12:59:49.593829+0000","last_undegraded":"2024-03-04T12:59:49.593829+0000","last_fullsized":"2024-03-04T12:59:49.593829+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":500,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:22.362410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2805,"num_read_kb":2500,"num_write":805,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"256'341","reported_seq":953,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.117407+0000","last_change":"2024-03-04T12:36:05.294821+0000","last_active":"2024-03-04T13:00:17.117407+0000","last_peered":"2024-03-04T13:00:17.117407+0000","last_clean":"2024-03-04T13:00:17.117407+0000","last_became_active":"2024-03-04T12:36:05.293768+0000","last_became_peered":"2024-03-04T12:36:05.293768+0000","last_unstale":"2024-03-04T13:00:17.117407+0000","last_undegraded":"2024-03-04T13:00:17.117407+0000","last_fullsized":"2024-03-04T13:00:17.117407+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:18.097279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436929,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":443,"num_read_kb":31950,"num_write":1089,"num_write_kb":37939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"256'777","reported_seq":2174,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:51.407901+0000","last_change":"2024-03-04T12:36:40.394056+0000","last_active":"2024-03-04T12:59:51.407901+0000","last_peered":"2024-03-04T12:59:51.407901+0000","last_clean":"2024-03-04T12:59:51.407901+0000","last_became_active":"2024-03-04T12:36:40.393715+0000","last_became_peered":"2024-03-04T12:36:40.393715+0000","last_unstale":"2024-03-04T12:59:51.407901+0000","last_undegraded":"2024-03-04T12:59:51.407901+0000","last_fullsized":"2024-03-04T12:59:51.407901+0000","mapping_epoch":33,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:36.183102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3436,"num_read_kb":3037,"num_write":1058,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"256'377","reported_seq":1012,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.044553+0000","last_change":"2024-03-04T12:36:05.290798+0000","last_active":"2024-03-04T13:00:17.044553+0000","last_peered":"2024-03-04T13:00:17.044553+0000","last_clean":"2024-03-04T13:00:17.044553+0000","last_became_active":"2024-03-04T12:36:05.290178+0000","last_became_peered":"2024-03-04T12:36:05.290178+0000","last_unstale":"2024-03-04T13:00:17.044553+0000","last_undegraded":"2024-03-04T13:00:17.044553+0000","last_fullsized":"2024-03-04T13:00:17.044553+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:22.012412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":589,"num_read_kb":36032,"num_write":1373,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"256'371","reported_seq":1918,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:37.805811+0000","last_change":"2024-03-04T12:36:07.301906+0000","last_active":"2024-03-04T12:59:37.805811+0000","last_peered":"2024-03-04T12:59:37.805811+0000","last_clean":"2024-03-04T12:59:37.805811+0000","last_became_active":"2024-03-04T12:36:07.301582+0000","last_became_peered":"2024-03-04T12:36:07.301582+0000","last_unstale":"2024-03-04T12:59:37.805811+0000","last_undegraded":"2024-03-04T12:59:37.805811+0000","last_fullsized":"2024-03-04T12:59:37.805811+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:15:02.915559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2123,"num_read_kb":2049,"num_write":405,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"256'288","reported_seq":896,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.086009+0000","last_change":"2024-03-04T12:36:05.296558+0000","last_active":"2024-03-04T13:00:17.086009+0000","last_peered":"2024-03-04T13:00:17.086009+0000","last_clean":"2024-03-04T13:00:17.086009+0000","last_became_active":"2024-03-04T12:36:05.296284+0000","last_became_peered":"2024-03-04T12:36:05.296284+0000","last_unstale":"2024-03-04T13:00:17.086009+0000","last_undegraded":"2024-03-04T13:00:17.086009+0000","last_fullsized":"2024-03-04T13:00:17.086009+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:09:57.839904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3348453,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":381,"num_read_kb":80579,"num_write":950,"num_write_kb":32166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"256'779","reported_seq":2021,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.066749+0000","last_change":"2024-03-04T12:36:07.298292+0000","last_active":"2024-03-04T12:59:53.066749+0000","last_peered":"2024-03-04T12:59:53.066749+0000","last_clean":"2024-03-04T12:59:53.066749+0000","last_became_active":"2024-03-04T12:36:07.297953+0000","last_became_peered":"2024-03-04T12:36:07.297953+0000","last_unstale":"2024-03-04T12:59:53.066749+0000","last_undegraded":"2024-03-04T12:59:53.066749+0000","last_fullsized":"2024-03-04T12:59:53.066749+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:58:58.998184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3335,"num_read_kb":2888,"num_write":1111,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"256'309","reported_seq":1022,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.113944+0000","last_change":"2024-03-04T12:36:05.291622+0000","last_active":"2024-03-04T13:00:17.113944+0000","last_peered":"2024-03-04T13:00:17.113944+0000","last_clean":"2024-03-04T13:00:17.113944+0000","last_became_active":"2024-03-04T12:36:05.291041+0000","last_became_peered":"2024-03-04T12:36:05.291041+0000","last_unstale":"2024-03-04T13:00:17.113944+0000","last_undegraded":"2024-03-04T13:00:17.113944+0000","last_fullsized":"2024-03-04T13:00:17.113944+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:02:19.031345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2107533,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":775,"num_read_kb":12113,"num_write":1137,"num_write_kb":11806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"256'692","reported_seq":2091,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.675667+0000","last_change":"2024-03-04T12:36:07.297212+0000","last_active":"2024-03-04T13:00:06.675667+0000","last_peered":"2024-03-04T13:00:06.675667+0000","last_clean":"2024-03-04T13:00:06.675667+0000","last_became_active":"2024-03-04T12:36:07.296763+0000","last_became_peered":"2024-03-04T12:36:07.296763+0000","last_unstale":"2024-03-04T13:00:06.675667+0000","last_undegraded":"2024-03-04T13:00:06.675667+0000","last_fullsized":"2024-03-04T13:00:06.675667+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:44:52.510569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3139,"num_read_kb":2812,"num_write":915,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"256'291","reported_seq":893,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.104769+0000","last_change":"2024-03-04T12:36:05.295212+0000","last_active":"2024-03-04T13:00:17.104769+0000","last_peered":"2024-03-04T13:00:17.104769+0000","last_clean":"2024-03-04T13:00:17.104769+0000","last_became_active":"2024-03-04T12:36:05.294967+0000","last_became_peered":"2024-03-04T12:36:05.294967+0000","last_unstale":"2024-03-04T13:00:17.104769+0000","last_undegraded":"2024-03-04T13:00:17.104769+0000","last_fullsized":"2024-03-04T13:00:17.104769+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:35:51.469381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1332404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":383,"num_read_kb":71068,"num_write":934,"num_write_kb":54955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"256'783","reported_seq":2195,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.517649+0000","last_change":"2024-03-04T12:36:07.296706+0000","last_active":"2024-03-04T12:59:55.517649+0000","last_peered":"2024-03-04T12:59:55.517649+0000","last_clean":"2024-03-04T12:59:55.517649+0000","last_became_active":"2024-03-04T12:36:07.295530+0000","last_became_peered":"2024-03-04T12:36:07.295530+0000","last_unstale":"2024-03-04T12:59:55.517649+0000","last_undegraded":"2024-03-04T12:59:55.517649+0000","last_fullsized":"2024-03-04T12:59:55.517649+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:26.858210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3415,"num_read_kb":3026,"num_write":1069,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"256'351","reported_seq":1806,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671750+0000","last_change":"2024-03-04T12:36:07.298974+0000","last_active":"2024-03-04T13:00:06.671750+0000","last_peered":"2024-03-04T13:00:06.671750+0000","last_clean":"2024-03-04T13:00:06.671750+0000","last_became_active":"2024-03-04T12:36:07.298539+0000","last_became_peered":"2024-03-04T12:36:07.298539+0000","last_unstale":"2024-03-04T13:00:06.671750+0000","last_undegraded":"2024-03-04T13:00:06.671750+0000","last_fullsized":"2024-03-04T13:00:06.671750+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:04.598502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1997,"num_read_kb":1912,"num_write":401,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"256'346","reported_seq":1037,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.117791+0000","last_change":"2024-03-04T12:36:05.295348+0000","last_active":"2024-03-04T13:00:17.117791+0000","last_peered":"2024-03-04T13:00:17.117791+0000","last_clean":"2024-03-04T13:00:17.117791+0000","last_became_active":"2024-03-04T12:36:05.295060+0000","last_became_peered":"2024-03-04T12:36:05.295060+0000","last_unstale":"2024-03-04T13:00:17.117791+0000","last_undegraded":"2024-03-04T13:00:17.117791+0000","last_fullsized":"2024-03-04T13:00:17.117791+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:44.913316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2255527,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":26330,"num_write":1306,"num_write_kb":36495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"256'327","reported_seq":1788,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.122768+0000","last_change":"2024-03-04T12:36:07.300589+0000","last_active":"2024-03-04T12:59:52.122768+0000","last_peered":"2024-03-04T12:59:52.122768+0000","last_clean":"2024-03-04T12:59:52.122768+0000","last_became_active":"2024-03-04T12:36:07.300270+0000","last_became_peered":"2024-03-04T12:36:07.300270+0000","last_unstale":"2024-03-04T12:59:52.122768+0000","last_undegraded":"2024-03-04T12:59:52.122768+0000","last_fullsized":"2024-03-04T12:59:52.122768+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:00:00.682987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2015,"num_read_kb":1950,"num_write":359,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"256'286","reported_seq":876,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.049917+0000","last_change":"2024-03-04T12:36:05.296970+0000","last_active":"2024-03-04T13:00:17.049917+0000","last_peered":"2024-03-04T13:00:17.049917+0000","last_clean":"2024-03-04T13:00:17.049917+0000","last_became_active":"2024-03-04T12:36:05.296621+0000","last_became_peered":"2024-03-04T12:36:05.296621+0000","last_unstale":"2024-03-04T13:00:17.049917+0000","last_undegraded":"2024-03-04T13:00:17.049917+0000","last_fullsized":"2024-03-04T13:00:17.049917+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:34:53.750419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":406,"num_read_kb":30709,"num_write":973,"num_write_kb":28664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"256'400","reported_seq":1882,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.469640+0000","last_change":"2024-03-04T12:36:07.294272+0000","last_active":"2024-03-04T12:59:55.469640+0000","last_peered":"2024-03-04T12:59:55.469640+0000","last_clean":"2024-03-04T12:59:55.469640+0000","last_became_active":"2024-03-04T12:36:07.293952+0000","last_became_peered":"2024-03-04T12:36:07.293952+0000","last_unstale":"2024-03-04T12:59:55.469640+0000","last_undegraded":"2024-03-04T12:59:55.469640+0000","last_fullsized":"2024-03-04T12:59:55.469640+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:15:20.296845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2282,"num_read_kb":2164,"num_write":473,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"256'311","reported_seq":944,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.099201+0000","last_change":"2024-03-04T12:36:05.296143+0000","last_active":"2024-03-04T13:00:17.099201+0000","last_peered":"2024-03-04T13:00:17.099201+0000","last_clean":"2024-03-04T13:00:17.099201+0000","last_became_active":"2024-03-04T12:36:05.295832+0000","last_became_peered":"2024-03-04T12:36:05.295832+0000","last_unstale":"2024-03-04T13:00:17.099201+0000","last_undegraded":"2024-03-04T13:00:17.099201+0000","last_fullsized":"2024-03-04T13:00:17.099201+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:40.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456555,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":48295,"num_write":1243,"num_write_kb":38980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"256'623","reported_seq":2326,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.913868+0000","last_change":"2024-03-04T12:36:07.296100+0000","last_active":"2024-03-04T12:59:54.913868+0000","last_peered":"2024-03-04T12:59:54.913868+0000","last_clean":"2024-03-04T12:59:54.913868+0000","last_became_active":"2024-03-04T12:36:07.295798+0000","last_became_peered":"2024-03-04T12:36:07.295798+0000","last_unstale":"2024-03-04T12:59:54.913868+0000","last_undegraded":"2024-03-04T12:59:54.913868+0000","last_fullsized":"2024-03-04T12:59:54.913868+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":600,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:42.532663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3253,"num_read_kb":2977,"num_write":842,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"256'344","reported_seq":951,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.098796+0000","last_change":"2024-03-04T12:36:05.292220+0000","last_active":"2024-03-04T13:00:17.098796+0000","last_peered":"2024-03-04T13:00:17.098796+0000","last_clean":"2024-03-04T13:00:17.098796+0000","last_became_active":"2024-03-04T12:36:05.291477+0000","last_became_peered":"2024-03-04T12:36:05.291477+0000","last_unstale":"2024-03-04T13:00:17.098796+0000","last_undegraded":"2024-03-04T13:00:17.098796+0000","last_fullsized":"2024-03-04T13:00:17.098796+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:51.540928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730225,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":474,"num_read_kb":10302,"num_write":1224,"num_write_kb":24769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"256'368","reported_seq":1763,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:34.671685+0000","last_change":"2024-03-04T12:36:07.290412+0000","last_active":"2024-03-04T12:59:34.671685+0000","last_peered":"2024-03-04T12:59:34.671685+0000","last_clean":"2024-03-04T12:59:34.671685+0000","last_became_active":"2024-03-04T12:36:07.290104+0000","last_became_peered":"2024-03-04T12:36:07.290104+0000","last_unstale":"2024-03-04T12:59:34.671685+0000","last_undegraded":"2024-03-04T12:59:34.671685+0000","last_fullsized":"2024-03-04T12:59:34.671685+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:26.340789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2031,"num_read_kb":1912,"num_write":446,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"256'309","reported_seq":926,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.081438+0000","last_change":"2024-03-04T12:36:05.291422+0000","last_active":"2024-03-04T13:00:17.081438+0000","last_peered":"2024-03-04T13:00:17.081438+0000","last_clean":"2024-03-04T13:00:17.081438+0000","last_became_active":"2024-03-04T12:36:05.291096+0000","last_became_peered":"2024-03-04T12:36:05.291096+0000","last_unstale":"2024-03-04T13:00:17.081438+0000","last_undegraded":"2024-03-04T13:00:17.081438+0000","last_fullsized":"2024-03-04T13:00:17.081438+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:07.540177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":471,"num_read_kb":17846,"num_write":1202,"num_write_kb":33765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"256'451","reported_seq":2119,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.026834+0000","last_change":"2024-03-04T12:36:07.298549+0000","last_active":"2024-03-04T12:59:56.026834+0000","last_peered":"2024-03-04T12:59:56.026834+0000","last_clean":"2024-03-04T12:59:56.026834+0000","last_became_active":"2024-03-04T12:36:07.297989+0000","last_became_peered":"2024-03-04T12:36:07.297989+0000","last_unstale":"2024-03-04T12:59:56.026834+0000","last_undegraded":"2024-03-04T12:59:56.026834+0000","last_fullsized":"2024-03-04T12:59:56.026834+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:09.358594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2700,"num_read_kb":2549,"num_write":550,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"256'363","reported_seq":1027,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.015355+0000","last_change":"2024-03-04T12:36:05.281235+0000","last_active":"2024-03-04T13:00:17.015355+0000","last_peered":"2024-03-04T13:00:17.015355+0000","last_clean":"2024-03-04T13:00:17.015355+0000","last_became_active":"2024-03-04T12:36:05.280944+0000","last_became_peered":"2024-03-04T12:36:05.280944+0000","last_unstale":"2024-03-04T13:00:17.015355+0000","last_undegraded":"2024-03-04T13:00:17.015355+0000","last_fullsized":"2024-03-04T13:00:17.015355+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:42:06.994361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290369,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":724,"num_read_kb":21552,"num_write":1199,"num_write_kb":33499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"256'82","reported_seq":558,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.125585+0000","last_change":"2024-03-04T12:36:15.356602+0000","last_active":"2024-03-04T12:59:52.125585+0000","last_peered":"2024-03-04T12:59:52.125585+0000","last_clean":"2024-03-04T12:59:52.125585+0000","last_became_active":"2024-03-04T12:36:15.356314+0000","last_became_peered":"2024-03-04T12:36:15.356314+0000","last_unstale":"2024-03-04T12:59:52.125585+0000","last_undegraded":"2024-03-04T12:59:52.125585+0000","last_fullsized":"2024-03-04T12:59:52.125585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:18:50.970854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":197,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"256'1096","reported_seq":2695,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.183207+0000","last_change":"2024-03-04T12:36:07.298156+0000","last_active":"2024-03-04T12:59:47.183207+0000","last_peered":"2024-03-04T12:59:47.183207+0000","last_clean":"2024-03-04T12:59:47.183207+0000","last_became_active":"2024-03-04T12:36:07.297879+0000","last_became_peered":"2024-03-04T12:36:07.297879+0000","last_unstale":"2024-03-04T12:59:47.183207+0000","last_undegraded":"2024-03-04T12:59:47.183207+0000","last_fullsized":"2024-03-04T12:59:47.183207+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:20.102942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4860,"num_read_kb":4288,"num_write":1505,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"256'377","reported_seq":985,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.100673+0000","last_change":"2024-03-04T12:36:05.297435+0000","last_active":"2024-03-04T13:00:17.100673+0000","last_peered":"2024-03-04T13:00:17.100673+0000","last_clean":"2024-03-04T13:00:17.100673+0000","last_became_active":"2024-03-04T12:36:05.296939+0000","last_became_peered":"2024-03-04T12:36:05.296939+0000","last_unstale":"2024-03-04T13:00:17.100673+0000","last_undegraded":"2024-03-04T13:00:17.100673+0000","last_fullsized":"2024-03-04T13:00:17.100673+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:05.528631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10962332,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":473,"num_read_kb":33218,"num_write":1212,"num_write_kb":53558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.001071+0000","last_change":"2024-03-04T12:36:09.314445+0000","last_active":"2024-03-04T12:57:56.001071+0000","last_peered":"2024-03-04T12:57:56.001071+0000","last_clean":"2024-03-04T12:57:56.001071+0000","last_became_active":"2024-03-04T12:36:09.314065+0000","last_became_peered":"2024-03-04T12:36:09.314065+0000","last_unstale":"2024-03-04T12:57:56.001071+0000","last_undegraded":"2024-03-04T12:57:56.001071+0000","last_fullsized":"2024-03-04T12:57:56.001071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:31.539306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"256'284","reported_seq":853,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.043695+0000","last_change":"2024-03-04T12:36:11.326254+0000","last_active":"2024-03-04T13:00:16.043695+0000","last_peered":"2024-03-04T13:00:16.043695+0000","last_clean":"2024-03-04T13:00:16.043695+0000","last_became_active":"2024-03-04T12:36:11.325995+0000","last_became_peered":"2024-03-04T12:36:11.325995+0000","last_unstale":"2024-03-04T13:00:16.043695+0000","last_undegraded":"2024-03-04T13:00:16.043695+0000","last_fullsized":"2024-03-04T13:00:16.043695+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:44.077134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43297,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1002,"num_write":366,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.864607+0000","last_change":"2024-03-04T12:36:13.339677+0000","last_active":"2024-03-04T12:55:35.864607+0000","last_peered":"2024-03-04T12:55:35.864607+0000","last_clean":"2024-03-04T12:55:35.864607+0000","last_became_active":"2024-03-04T12:36:13.339305+0000","last_became_peered":"2024-03-04T12:36:13.339305+0000","last_unstale":"2024-03-04T12:55:35.864607+0000","last_undegraded":"2024-03-04T12:55:35.864607+0000","last_fullsized":"2024-03-04T12:55:35.864607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:00:43.245373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"256'2370","reported_seq":4141,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.448462+0000","last_change":"2024-03-04T12:36:15.362735+0000","last_active":"2024-03-04T13:00:07.448462+0000","last_peered":"2024-03-04T13:00:07.448462+0000","last_clean":"2024-03-04T13:00:07.448462+0000","last_became_active":"2024-03-04T12:36:15.362434+0000","last_became_peered":"2024-03-04T12:36:15.362434+0000","last_unstale":"2024-03-04T13:00:07.448462+0000","last_undegraded":"2024-03-04T13:00:07.448462+0000","last_fullsized":"2024-03-04T13:00:07.448462+0000","mapping_epoch":30,"log_start":"256'2300","ondisk_log_start":"256'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":2300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:44:00.181398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5876,"num_read_kb":5881,"num_write":4713,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"256'831","reported_seq":2404,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:40.773044+0000","last_change":"2024-03-04T12:36:07.295827+0000","last_active":"2024-03-04T12:59:40.773044+0000","last_peered":"2024-03-04T12:59:40.773044+0000","last_clean":"2024-03-04T12:59:40.773044+0000","last_became_active":"2024-03-04T12:36:07.295522+0000","last_became_peered":"2024-03-04T12:36:07.295522+0000","last_unstale":"2024-03-04T12:59:40.773044+0000","last_undegraded":"2024-03-04T12:59:40.773044+0000","last_fullsized":"2024-03-04T12:59:40.773044+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:48:41.009511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3820,"num_read_kb":3411,"num_write":1118,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"256'363","reported_seq":978,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.101232+0000","last_change":"2024-03-04T12:36:05.288481+0000","last_active":"2024-03-04T13:00:17.101232+0000","last_peered":"2024-03-04T13:00:17.101232+0000","last_clean":"2024-03-04T13:00:17.101232+0000","last_became_active":"2024-03-04T12:36:05.288208+0000","last_became_peered":"2024-03-04T12:36:05.288208+0000","last_unstale":"2024-03-04T13:00:17.101232+0000","last_undegraded":"2024-03-04T13:00:17.101232+0000","last_fullsized":"2024-03-04T13:00:17.101232+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:48.405825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":34780,"num_write":1176,"num_write_kb":45508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.980972+0000","last_change":"2024-03-04T12:36:09.309834+0000","last_active":"2024-03-04T12:57:10.980972+0000","last_peered":"2024-03-04T12:57:10.980972+0000","last_clean":"2024-03-04T12:57:10.980972+0000","last_became_active":"2024-03-04T12:36:09.309583+0000","last_became_peered":"2024-03-04T12:36:09.309583+0000","last_unstale":"2024-03-04T12:57:10.980972+0000","last_undegraded":"2024-03-04T12:57:10.980972+0000","last_fullsized":"2024-03-04T12:57:10.980972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:07.871941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"256'70","reported_seq":570,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:01.794170+0000","last_change":"2024-03-04T12:36:11.325082+0000","last_active":"2024-03-04T12:59:01.794170+0000","last_peered":"2024-03-04T12:59:01.794170+0000","last_clean":"2024-03-04T12:59:01.794170+0000","last_became_active":"2024-03-04T12:36:11.324761+0000","last_became_peered":"2024-03-04T12:36:11.324761+0000","last_unstale":"2024-03-04T12:59:01.794170+0000","last_undegraded":"2024-03-04T12:59:01.794170+0000","last_fullsized":"2024-03-04T12:59:01.794170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:54.454757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":50,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":471,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.977378+0000","last_change":"2024-03-04T12:36:13.343424+0000","last_active":"2024-03-04T12:55:35.977378+0000","last_peered":"2024-03-04T12:55:35.977378+0000","last_clean":"2024-03-04T12:55:35.977378+0000","last_became_active":"2024-03-04T12:36:13.343072+0000","last_became_peered":"2024-03-04T12:36:13.343072+0000","last_unstale":"2024-03-04T12:55:35.977378+0000","last_undegraded":"2024-03-04T12:55:35.977378+0000","last_fullsized":"2024-03-04T12:55:35.977378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:57.168843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"256'98","reported_seq":584,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.906113+0000","last_change":"2024-03-04T12:36:15.362615+0000","last_active":"2024-03-04T12:59:54.906113+0000","last_peered":"2024-03-04T12:59:54.906113+0000","last_clean":"2024-03-04T12:59:54.906113+0000","last_became_active":"2024-03-04T12:36:15.362354+0000","last_became_peered":"2024-03-04T12:36:15.362354+0000","last_unstale":"2024-03-04T12:59:54.906113+0000","last_undegraded":"2024-03-04T12:59:54.906113+0000","last_fullsized":"2024-03-04T12:59:54.906113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:28.389546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":121,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"256'345","reported_seq":1725,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.049617+0000","last_change":"2024-03-04T12:36:07.294690+0000","last_active":"2024-03-04T12:59:53.049617+0000","last_peered":"2024-03-04T12:59:53.049617+0000","last_clean":"2024-03-04T12:59:53.049617+0000","last_became_active":"2024-03-04T12:36:07.294328+0000","last_became_peered":"2024-03-04T12:36:07.294328+0000","last_unstale":"2024-03-04T12:59:53.049617+0000","last_undegraded":"2024-03-04T12:59:53.049617+0000","last_fullsized":"2024-03-04T12:59:53.049617+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:21.872722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1913,"num_read_kb":1818,"num_write":399,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"256'282","reported_seq":895,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.100471+0000","last_change":"2024-03-04T12:36:05.291937+0000","last_active":"2024-03-04T13:00:17.100471+0000","last_peered":"2024-03-04T13:00:17.100471+0000","last_clean":"2024-03-04T13:00:17.100471+0000","last_became_active":"2024-03-04T12:36:05.291366+0000","last_became_peered":"2024-03-04T12:36:05.291366+0000","last_unstale":"2024-03-04T13:00:17.100471+0000","last_undegraded":"2024-03-04T13:00:17.100471+0000","last_fullsized":"2024-03-04T13:00:17.100471+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:51:33.987631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":749491,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":10592,"num_write":1118,"num_write_kb":21097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.987172+0000","last_change":"2024-03-04T12:36:09.310004+0000","last_active":"2024-03-04T12:57:55.987172+0000","last_peered":"2024-03-04T12:57:55.987172+0000","last_clean":"2024-03-04T12:57:55.987172+0000","last_became_active":"2024-03-04T12:36:09.309749+0000","last_became_peered":"2024-03-04T12:36:09.309749+0000","last_unstale":"2024-03-04T12:57:55.987172+0000","last_undegraded":"2024-03-04T12:57:55.987172+0000","last_fullsized":"2024-03-04T12:57:55.987172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:03:13.417440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"256'81","reported_seq":584,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:49.593521+0000","last_change":"2024-03-04T12:36:11.324407+0000","last_active":"2024-03-04T12:58:49.593521+0000","last_peered":"2024-03-04T12:58:49.593521+0000","last_clean":"2024-03-04T12:58:49.593521+0000","last_became_active":"2024-03-04T12:36:11.324127+0000","last_became_peered":"2024-03-04T12:36:11.324127+0000","last_unstale":"2024-03-04T12:58:49.593521+0000","last_undegraded":"2024-03-04T12:58:49.593521+0000","last_fullsized":"2024-03-04T12:58:49.593521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:48.776107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"256'510","reported_seq":1458,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.822757+0000","last_change":"2024-03-04T12:36:13.338671+0000","last_active":"2024-03-04T13:00:16.822757+0000","last_peered":"2024-03-04T13:00:16.822757+0000","last_clean":"2024-03-04T13:00:16.822757+0000","last_became_active":"2024-03-04T12:36:13.338070+0000","last_became_peered":"2024-03-04T12:36:13.338070+0000","last_unstale":"2024-03-04T13:00:16.822757+0000","last_undegraded":"2024-03-04T13:00:16.822757+0000","last_fullsized":"2024-03-04T13:00:16.822757+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:33:55.908350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"256'103","reported_seq":572,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:31.188469+0000","last_change":"2024-03-04T12:36:15.356684+0000","last_active":"2024-03-04T12:59:31.188469+0000","last_peered":"2024-03-04T12:59:31.188469+0000","last_clean":"2024-03-04T12:59:31.188469+0000","last_became_active":"2024-03-04T12:36:15.356417+0000","last_became_peered":"2024-03-04T12:36:15.356417+0000","last_unstale":"2024-03-04T12:59:31.188469+0000","last_undegraded":"2024-03-04T12:59:31.188469+0000","last_fullsized":"2024-03-04T12:59:31.188469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:52:14.210704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"256'684","reported_seq":2109,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.027321+0000","last_change":"2024-03-04T12:36:07.293732+0000","last_active":"2024-03-04T12:59:56.027321+0000","last_peered":"2024-03-04T12:59:56.027321+0000","last_clean":"2024-03-04T12:59:56.027321+0000","last_became_active":"2024-03-04T12:36:07.293493+0000","last_became_peered":"2024-03-04T12:36:07.293493+0000","last_unstale":"2024-03-04T12:59:56.027321+0000","last_undegraded":"2024-03-04T12:59:56.027321+0000","last_fullsized":"2024-03-04T12:59:56.027321+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:57:53.084655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3120,"num_read_kb":2817,"num_write":901,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"256'392","reported_seq":1012,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.113202+0000","last_change":"2024-03-04T12:36:05.283970+0000","last_active":"2024-03-04T13:00:17.113202+0000","last_peered":"2024-03-04T13:00:17.113202+0000","last_clean":"2024-03-04T13:00:17.113202+0000","last_became_active":"2024-03-04T12:36:05.283477+0000","last_became_peered":"2024-03-04T12:36:05.283477+0000","last_unstale":"2024-03-04T13:00:17.113202+0000","last_undegraded":"2024-03-04T13:00:17.113202+0000","last_fullsized":"2024-03-04T13:00:17.113202+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:34:48.169224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048764,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":32578,"num_write":1458,"num_write_kb":46757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.001112+0000","last_change":"2024-03-04T12:36:09.314720+0000","last_active":"2024-03-04T12:57:56.001112+0000","last_peered":"2024-03-04T12:57:56.001112+0000","last_clean":"2024-03-04T12:57:56.001112+0000","last_became_active":"2024-03-04T12:36:09.314215+0000","last_became_peered":"2024-03-04T12:36:09.314215+0000","last_unstale":"2024-03-04T12:57:56.001112+0000","last_undegraded":"2024-03-04T12:57:56.001112+0000","last_fullsized":"2024-03-04T12:57:56.001112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:41.656458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"256'247","reported_seq":790,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.764803+0000","last_change":"2024-03-04T12:36:11.956620+0000","last_active":"2024-03-04T13:00:15.764803+0000","last_peered":"2024-03-04T13:00:15.764803+0000","last_clean":"2024-03-04T13:00:15.764803+0000","last_became_active":"2024-03-04T12:36:11.956371+0000","last_became_peered":"2024-03-04T12:36:11.956371+0000","last_unstale":"2024-03-04T13:00:15.764803+0000","last_undegraded":"2024-03-04T13:00:15.764803+0000","last_fullsized":"2024-03-04T13:00:15.764803+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:43.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44142,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1035,"num_write":354,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"256'535","reported_seq":3336,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.606819+0000","last_change":"2024-03-04T12:36:13.344846+0000","last_active":"2024-03-04T13:00:16.606819+0000","last_peered":"2024-03-04T13:00:16.606819+0000","last_clean":"2024-03-04T13:00:16.606819+0000","last_became_active":"2024-03-04T12:36:13.344498+0000","last_became_peered":"2024-03-04T12:36:13.344498+0000","last_unstale":"2024-03-04T13:00:16.606819+0000","last_undegraded":"2024-03-04T13:00:16.606819+0000","last_fullsized":"2024-03-04T13:00:16.606819+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:40:58.604976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"256'768","reported_seq":2298,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.130713+0000","last_change":"2024-03-04T12:36:07.297672+0000","last_active":"2024-03-04T12:59:52.130713+0000","last_peered":"2024-03-04T12:59:52.130713+0000","last_clean":"2024-03-04T12:59:52.130713+0000","last_became_active":"2024-03-04T12:36:07.297320+0000","last_became_peered":"2024-03-04T12:36:07.297320+0000","last_unstale":"2024-03-04T12:59:52.130713+0000","last_undegraded":"2024-03-04T12:59:52.130713+0000","last_fullsized":"2024-03-04T12:59:52.130713+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:40.204657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3660,"num_read_kb":3298,"num_write":1023,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"256'386","reported_seq":1048,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.112794+0000","last_change":"2024-03-04T12:36:05.294150+0000","last_active":"2024-03-04T13:00:17.112794+0000","last_peered":"2024-03-04T13:00:17.112794+0000","last_clean":"2024-03-04T13:00:17.112794+0000","last_became_active":"2024-03-04T12:36:05.293882+0000","last_became_peered":"2024-03-04T12:36:05.293882+0000","last_unstale":"2024-03-04T13:00:17.112794+0000","last_undegraded":"2024-03-04T13:00:17.112794+0000","last_fullsized":"2024-03-04T13:00:17.112794+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:44:38.505106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5179671,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":578,"num_read_kb":60173,"num_write":1456,"num_write_kb":40158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.884043+0000","last_change":"2024-03-04T12:36:09.308808+0000","last_active":"2024-03-04T12:57:50.884043+0000","last_peered":"2024-03-04T12:57:50.884043+0000","last_clean":"2024-03-04T12:57:50.884043+0000","last_became_active":"2024-03-04T12:36:09.308538+0000","last_became_peered":"2024-03-04T12:36:09.308538+0000","last_unstale":"2024-03-04T12:57:50.884043+0000","last_undegraded":"2024-03-04T12:57:50.884043+0000","last_fullsized":"2024-03-04T12:57:50.884043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:29.862690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"256'312","reported_seq":883,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.318675+0000","last_change":"2024-03-04T12:36:11.954866+0000","last_active":"2024-03-04T13:00:16.318675+0000","last_peered":"2024-03-04T13:00:16.318675+0000","last_clean":"2024-03-04T13:00:16.318675+0000","last_became_active":"2024-03-04T12:36:11.954597+0000","last_became_peered":"2024-03-04T12:36:11.954597+0000","last_unstale":"2024-03-04T13:00:16.318675+0000","last_undegraded":"2024-03-04T13:00:16.318675+0000","last_fullsized":"2024-03-04T13:00:16.318675+0000","mapping_epoch":26,"log_start":"256'300","ondisk_log_start":"256'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:12.925538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51312,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":526,"num_read_kb":1169,"num_write":422,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.975791+0000","last_change":"2024-03-04T12:36:13.340164+0000","last_active":"2024-03-04T12:56:30.975791+0000","last_peered":"2024-03-04T12:56:30.975791+0000","last_clean":"2024-03-04T12:56:30.975791+0000","last_became_active":"2024-03-04T12:36:13.339890+0000","last_became_peered":"2024-03-04T12:36:13.339890+0000","last_unstale":"2024-03-04T12:56:30.975791+0000","last_undegraded":"2024-03-04T12:56:30.975791+0000","last_fullsized":"2024-03-04T12:56:30.975791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:01:43.082809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"256'505","reported_seq":1289,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.702992+0000","last_change":"2024-03-04T12:36:15.363257+0000","last_active":"2024-03-04T13:00:08.702992+0000","last_peered":"2024-03-04T13:00:08.702992+0000","last_clean":"2024-03-04T13:00:08.702992+0000","last_became_active":"2024-03-04T12:36:15.362355+0000","last_became_peered":"2024-03-04T12:36:15.362355+0000","last_unstale":"2024-03-04T13:00:08.702992+0000","last_undegraded":"2024-03-04T13:00:08.702992+0000","last_fullsized":"2024-03-04T13:00:08.702992+0000","mapping_epoch":30,"log_start":"250'400","ondisk_log_start":"250'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:39:12.607478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1234,"num_read_kb":1233,"num_write":1042,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"256'404","reported_seq":1914,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.480892+0000","last_change":"2024-03-04T12:36:07.292415+0000","last_active":"2024-03-04T12:59:55.480892+0000","last_peered":"2024-03-04T12:59:55.480892+0000","last_clean":"2024-03-04T12:59:55.480892+0000","last_became_active":"2024-03-04T12:36:07.291507+0000","last_became_peered":"2024-03-04T12:36:07.291507+0000","last_unstale":"2024-03-04T12:59:55.480892+0000","last_undegraded":"2024-03-04T12:59:55.480892+0000","last_fullsized":"2024-03-04T12:59:55.480892+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:09:27.148690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2180,"num_read_kb":2067,"num_write":478,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"256'311","reported_seq":934,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.110582+0000","last_change":"2024-03-04T12:36:05.286750+0000","last_active":"2024-03-04T13:00:17.110582+0000","last_peered":"2024-03-04T13:00:17.110582+0000","last_clean":"2024-03-04T13:00:17.110582+0000","last_became_active":"2024-03-04T12:36:05.286438+0000","last_became_peered":"2024-03-04T12:36:05.286438+0000","last_unstale":"2024-03-04T13:00:17.110582+0000","last_undegraded":"2024-03-04T13:00:17.110582+0000","last_fullsized":"2024-03-04T13:00:17.110582+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:34:40.712814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21141,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":18655,"num_write":1207,"num_write_kb":23251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.988264+0000","last_change":"2024-03-04T12:36:09.304859+0000","last_active":"2024-03-04T12:57:50.988264+0000","last_peered":"2024-03-04T12:57:50.988264+0000","last_clean":"2024-03-04T12:57:50.988264+0000","last_became_active":"2024-03-04T12:36:09.304561+0000","last_became_peered":"2024-03-04T12:36:09.304561+0000","last_unstale":"2024-03-04T12:57:50.988264+0000","last_undegraded":"2024-03-04T12:57:50.988264+0000","last_fullsized":"2024-03-04T12:57:50.988264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:50:41.171488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"256'268","reported_seq":809,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.033009+0000","last_change":"2024-03-04T12:36:11.324431+0000","last_active":"2024-03-04T13:00:17.033009+0000","last_peered":"2024-03-04T13:00:17.033009+0000","last_clean":"2024-03-04T13:00:17.033009+0000","last_became_active":"2024-03-04T12:36:11.324147+0000","last_became_peered":"2024-03-04T12:36:11.324147+0000","last_unstale":"2024-03-04T13:00:17.033009+0000","last_undegraded":"2024-03-04T13:00:17.033009+0000","last_fullsized":"2024-03-04T13:00:17.033009+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:08.464149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":439,"num_read_kb":1077,"num_write":366,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.987062+0000","last_change":"2024-03-04T12:36:13.346330+0000","last_active":"2024-03-04T12:57:55.987062+0000","last_peered":"2024-03-04T12:57:55.987062+0000","last_clean":"2024-03-04T12:57:55.987062+0000","last_became_active":"2024-03-04T12:36:13.346077+0000","last_became_peered":"2024-03-04T12:36:13.346077+0000","last_unstale":"2024-03-04T12:57:55.987062+0000","last_undegraded":"2024-03-04T12:57:55.987062+0000","last_fullsized":"2024-03-04T12:57:55.987062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:53:58.068981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"256'121","reported_seq":600,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.249351+0000","last_change":"2024-03-04T12:36:15.360124+0000","last_active":"2024-03-04T12:59:48.249351+0000","last_peered":"2024-03-04T12:59:48.249351+0000","last_clean":"2024-03-04T12:59:48.249351+0000","last_became_active":"2024-03-04T12:36:15.359839+0000","last_became_peered":"2024-03-04T12:36:15.359839+0000","last_unstale":"2024-03-04T12:59:48.249351+0000","last_undegraded":"2024-03-04T12:59:48.249351+0000","last_fullsized":"2024-03-04T12:59:48.249351+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:21:16.002994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":144,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"256'819","reported_seq":2263,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.910676+0000","last_change":"2024-03-04T12:36:40.395151+0000","last_active":"2024-03-04T12:59:54.910676+0000","last_peered":"2024-03-04T12:59:54.910676+0000","last_clean":"2024-03-04T12:59:54.910676+0000","last_became_active":"2024-03-04T12:36:40.394812+0000","last_became_peered":"2024-03-04T12:36:40.394812+0000","last_unstale":"2024-03-04T12:59:54.910676+0000","last_undegraded":"2024-03-04T12:59:54.910676+0000","last_fullsized":"2024-03-04T12:59:54.910676+0000","mapping_epoch":33,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:10.350765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3628,"num_read_kb":3191,"num_write":1140,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"256'341","reported_seq":990,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.050385+0000","last_change":"2024-03-04T12:36:05.297783+0000","last_active":"2024-03-04T13:00:17.050385+0000","last_peered":"2024-03-04T13:00:17.050385+0000","last_clean":"2024-03-04T13:00:17.050385+0000","last_became_active":"2024-03-04T12:36:05.297486+0000","last_became_peered":"2024-03-04T12:36:05.297486+0000","last_unstale":"2024-03-04T13:00:17.050385+0000","last_undegraded":"2024-03-04T13:00:17.050385+0000","last_fullsized":"2024-03-04T13:00:17.050385+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:45.296031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":44586,"num_write":1373,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"32'5","reported_seq":787,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.206385+0000","last_change":"2024-03-04T12:36:09.303560+0000","last_active":"2024-03-04T13:00:15.206385+0000","last_peered":"2024-03-04T13:00:15.206385+0000","last_clean":"2024-03-04T13:00:15.206385+0000","last_became_active":"2024-03-04T12:36:09.303280+0000","last_became_peered":"2024-03-04T12:36:09.303280+0000","last_unstale":"2024-03-04T13:00:15.206385+0000","last_undegraded":"2024-03-04T13:00:15.206385+0000","last_fullsized":"2024-03-04T13:00:15.206385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:32:28.838095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":467,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"256'284","reported_seq":837,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.417317+0000","last_change":"2024-03-04T12:36:11.325461+0000","last_active":"2024-03-04T13:00:16.417317+0000","last_peered":"2024-03-04T13:00:16.417317+0000","last_clean":"2024-03-04T13:00:16.417317+0000","last_became_active":"2024-03-04T12:36:11.325109+0000","last_became_peered":"2024-03-04T12:36:11.325109+0000","last_unstale":"2024-03-04T13:00:16.417317+0000","last_undegraded":"2024-03-04T13:00:16.417317+0000","last_fullsized":"2024-03-04T13:00:16.417317+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:48.960420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48663,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":476,"num_read_kb":1126,"num_write":394,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"256'518","reported_seq":1822,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.673895+0000","last_change":"2024-03-04T12:36:13.342932+0000","last_active":"2024-03-04T13:00:16.673895+0000","last_peered":"2024-03-04T13:00:16.673895+0000","last_clean":"2024-03-04T13:00:16.673895+0000","last_became_active":"2024-03-04T12:36:13.342604+0000","last_became_peered":"2024-03-04T12:36:13.342604+0000","last_unstale":"2024-03-04T13:00:16.673895+0000","last_undegraded":"2024-03-04T13:00:16.673895+0000","last_fullsized":"2024-03-04T13:00:16.673895+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:05.485830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"256'91","reported_seq":551,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:32.243920+0000","last_change":"2024-03-04T12:36:15.360260+0000","last_active":"2024-03-04T12:59:32.243920+0000","last_peered":"2024-03-04T12:59:32.243920+0000","last_clean":"2024-03-04T12:59:32.243920+0000","last_became_active":"2024-03-04T12:36:15.359959+0000","last_became_peered":"2024-03-04T12:36:15.359959+0000","last_unstale":"2024-03-04T12:59:32.243920+0000","last_undegraded":"2024-03-04T12:59:32.243920+0000","last_fullsized":"2024-03-04T12:59:32.243920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:09.867645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"256'355","reported_seq":1798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.121512+0000","last_change":"2024-03-04T12:36:07.301861+0000","last_active":"2024-03-04T12:59:52.121512+0000","last_peered":"2024-03-04T12:59:52.121512+0000","last_clean":"2024-03-04T12:59:52.121512+0000","last_became_active":"2024-03-04T12:36:07.301558+0000","last_became_peered":"2024-03-04T12:36:07.301558+0000","last_unstale":"2024-03-04T12:59:52.121512+0000","last_undegraded":"2024-03-04T12:59:52.121512+0000","last_fullsized":"2024-03-04T12:59:52.121512+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:41.166126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1943,"num_read_kb":1867,"num_write":395,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"256'357","reported_seq":1107,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.106895+0000","last_change":"2024-03-04T12:36:05.293965+0000","last_active":"2024-03-04T13:00:17.106895+0000","last_peered":"2024-03-04T13:00:17.106895+0000","last_clean":"2024-03-04T13:00:17.106895+0000","last_became_active":"2024-03-04T12:36:05.293649+0000","last_became_peered":"2024-03-04T12:36:05.293649+0000","last_unstale":"2024-03-04T13:00:17.106895+0000","last_undegraded":"2024-03-04T13:00:17.106895+0000","last_fullsized":"2024-03-04T13:00:17.106895+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:55.683730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3134195,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":703,"num_read_kb":39148,"num_write":1364,"num_write_kb":31517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.988287+0000","last_change":"2024-03-04T12:36:09.304187+0000","last_active":"2024-03-04T12:57:50.988287+0000","last_peered":"2024-03-04T12:57:50.988287+0000","last_clean":"2024-03-04T12:57:50.988287+0000","last_became_active":"2024-03-04T12:36:09.303908+0000","last_became_peered":"2024-03-04T12:36:09.303908+0000","last_unstale":"2024-03-04T12:57:50.988287+0000","last_undegraded":"2024-03-04T12:57:50.988287+0000","last_fullsized":"2024-03-04T12:57:50.988287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:55:34.254756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"256'427","reported_seq":1027,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.130510+0000","last_change":"2024-03-04T12:36:11.328487+0000","last_active":"2024-03-04T13:00:17.130510+0000","last_peered":"2024-03-04T13:00:17.130510+0000","last_clean":"2024-03-04T13:00:17.130510+0000","last_became_active":"2024-03-04T12:36:11.326014+0000","last_became_peered":"2024-03-04T12:36:11.326014+0000","last_unstale":"2024-03-04T13:00:17.130510+0000","last_undegraded":"2024-03-04T13:00:17.130510+0000","last_fullsized":"2024-03-04T13:00:17.130510+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:45:24.328565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":758,"num_read_kb":1853,"num_write":616,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.988698+0000","last_change":"2024-03-04T12:36:13.335911+0000","last_active":"2024-03-04T12:57:55.988698+0000","last_peered":"2024-03-04T12:57:55.988698+0000","last_clean":"2024-03-04T12:57:55.988698+0000","last_became_active":"2024-03-04T12:36:13.335586+0000","last_became_peered":"2024-03-04T12:36:13.335586+0000","last_unstale":"2024-03-04T12:57:55.988698+0000","last_undegraded":"2024-03-04T12:57:55.988698+0000","last_fullsized":"2024-03-04T12:57:55.988698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:25.484088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"256'107","reported_seq":600,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:01.349664+0000","last_change":"2024-03-04T12:36:15.356552+0000","last_active":"2024-03-04T12:59:01.349664+0000","last_peered":"2024-03-04T12:59:01.349664+0000","last_clean":"2024-03-04T12:59:01.349664+0000","last_became_active":"2024-03-04T12:36:15.356270+0000","last_became_peered":"2024-03-04T12:36:15.356270+0000","last_unstale":"2024-03-04T12:59:01.349664+0000","last_undegraded":"2024-03-04T12:59:01.349664+0000","last_fullsized":"2024-03-04T12:59:01.349664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:20.445838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":257,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"256'398","reported_seq":1973,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.675701+0000","last_change":"2024-03-04T12:36:07.293079+0000","last_active":"2024-03-04T13:00:06.675701+0000","last_peered":"2024-03-04T13:00:06.675701+0000","last_clean":"2024-03-04T13:00:06.675701+0000","last_became_active":"2024-03-04T12:36:07.292788+0000","last_became_peered":"2024-03-04T12:36:07.292788+0000","last_unstale":"2024-03-04T13:00:06.675701+0000","last_undegraded":"2024-03-04T13:00:06.675701+0000","last_fullsized":"2024-03-04T13:00:06.675701+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:54.824676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2359,"num_read_kb":2243,"num_write":467,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"256'305","reported_seq":1007,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.104441+0000","last_change":"2024-03-04T12:36:05.286316+0000","last_active":"2024-03-04T13:00:17.104441+0000","last_peered":"2024-03-04T13:00:17.104441+0000","last_clean":"2024-03-04T13:00:17.104441+0000","last_became_active":"2024-03-04T12:36:05.284594+0000","last_became_peered":"2024-03-04T12:36:05.284594+0000","last_unstale":"2024-03-04T13:00:17.104441+0000","last_undegraded":"2024-03-04T13:00:17.104441+0000","last_fullsized":"2024-03-04T13:00:17.104441+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:06.773008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398941,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":597,"num_read_kb":110861,"num_write":1019,"num_write_kb":39283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:25.979146+0000","last_change":"2024-03-04T12:36:09.305629+0000","last_active":"2024-03-04T12:56:25.979146+0000","last_peered":"2024-03-04T12:56:25.979146+0000","last_clean":"2024-03-04T12:56:25.979146+0000","last_became_active":"2024-03-04T12:36:09.305363+0000","last_became_peered":"2024-03-04T12:36:09.305363+0000","last_unstale":"2024-03-04T12:56:25.979146+0000","last_undegraded":"2024-03-04T12:56:25.979146+0000","last_fullsized":"2024-03-04T12:56:25.979146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:49:38.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"256'258","reported_seq":807,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.355690+0000","last_change":"2024-03-04T12:36:11.320326+0000","last_active":"2024-03-04T13:00:15.355690+0000","last_peered":"2024-03-04T13:00:15.355690+0000","last_clean":"2024-03-04T13:00:15.355690+0000","last_became_active":"2024-03-04T12:36:11.319633+0000","last_became_peered":"2024-03-04T12:36:11.319633+0000","last_unstale":"2024-03-04T13:00:15.355690+0000","last_undegraded":"2024-03-04T13:00:15.355690+0000","last_fullsized":"2024-03-04T13:00:15.355690+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:00:21.398680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":990,"num_write":404,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":463,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.992632+0000","last_change":"2024-03-04T12:36:13.349289+0000","last_active":"2024-03-04T12:56:30.992632+0000","last_peered":"2024-03-04T12:56:30.992632+0000","last_clean":"2024-03-04T12:56:30.992632+0000","last_became_active":"2024-03-04T12:36:13.348999+0000","last_became_peered":"2024-03-04T12:36:13.348999+0000","last_unstale":"2024-03-04T12:56:30.992632+0000","last_undegraded":"2024-03-04T12:56:30.992632+0000","last_fullsized":"2024-03-04T12:56:30.992632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:01:23.408092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"256'97","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:39.238643+0000","last_change":"2024-03-04T12:36:15.360060+0000","last_active":"2024-03-04T12:59:39.238643+0000","last_peered":"2024-03-04T12:59:39.238643+0000","last_clean":"2024-03-04T12:59:39.238643+0000","last_became_active":"2024-03-04T12:36:15.359732+0000","last_became_peered":"2024-03-04T12:36:15.359732+0000","last_unstale":"2024-03-04T12:59:39.238643+0000","last_undegraded":"2024-03-04T12:59:39.238643+0000","last_fullsized":"2024-03-04T12:59:39.238643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:46.691644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"256'879","reported_seq":2433,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.129050+0000","last_change":"2024-03-04T12:36:07.299296+0000","last_active":"2024-03-04T12:59:50.129050+0000","last_peered":"2024-03-04T12:59:50.129050+0000","last_clean":"2024-03-04T12:59:50.129050+0000","last_became_active":"2024-03-04T12:36:07.298999+0000","last_became_peered":"2024-03-04T12:36:07.298999+0000","last_unstale":"2024-03-04T12:59:50.129050+0000","last_undegraded":"2024-03-04T12:59:50.129050+0000","last_fullsized":"2024-03-04T12:59:50.129050+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:15.755740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4068,"num_read_kb":3596,"num_write":1224,"num_write_kb":497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"256'346","reported_seq":946,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.079689+0000","last_change":"2024-03-04T12:36:05.289780+0000","last_active":"2024-03-04T13:00:17.079689+0000","last_peered":"2024-03-04T13:00:17.079689+0000","last_clean":"2024-03-04T13:00:17.079689+0000","last_became_active":"2024-03-04T12:36:05.289486+0000","last_became_peered":"2024-03-04T12:36:05.289486+0000","last_unstale":"2024-03-04T13:00:17.079689+0000","last_undegraded":"2024-03-04T13:00:17.079689+0000","last_fullsized":"2024-03-04T13:00:17.079689+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:54.563075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456599,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":441,"num_read_kb":48705,"num_write":1317,"num_write_kb":64123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:25.975316+0000","last_change":"2024-03-04T12:36:09.306337+0000","last_active":"2024-03-04T12:56:25.975316+0000","last_peered":"2024-03-04T12:56:25.975316+0000","last_clean":"2024-03-04T12:56:25.975316+0000","last_became_active":"2024-03-04T12:36:09.305880+0000","last_became_peered":"2024-03-04T12:36:09.305880+0000","last_unstale":"2024-03-04T12:56:25.975316+0000","last_undegraded":"2024-03-04T12:56:25.975316+0000","last_fullsized":"2024-03-04T12:56:25.975316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:12:13.954397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"256'265","reported_seq":817,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.919391+0000","last_change":"2024-03-04T12:36:11.327832+0000","last_active":"2024-03-04T13:00:16.919391+0000","last_peered":"2024-03-04T13:00:16.919391+0000","last_clean":"2024-03-04T13:00:16.919391+0000","last_became_active":"2024-03-04T12:36:11.327499+0000","last_became_peered":"2024-03-04T12:36:11.327499+0000","last_unstale":"2024-03-04T13:00:16.919391+0000","last_undegraded":"2024-03-04T13:00:16.919391+0000","last_fullsized":"2024-03-04T13:00:16.919391+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:11:36.354045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48450,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":440,"num_read_kb":1012,"num_write":358,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"256'478","reported_seq":1626,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.650190+0000","last_change":"2024-03-04T12:36:13.338140+0000","last_active":"2024-03-04T13:00:16.650190+0000","last_peered":"2024-03-04T13:00:16.650190+0000","last_clean":"2024-03-04T13:00:16.650190+0000","last_became_active":"2024-03-04T12:36:13.337817+0000","last_became_peered":"2024-03-04T12:36:13.337817+0000","last_unstale":"2024-03-04T13:00:16.650190+0000","last_undegraded":"2024-03-04T13:00:16.650190+0000","last_fullsized":"2024-03-04T13:00:16.650190+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:48.478224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"256'95","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:51.103823+0000","last_change":"2024-03-04T12:36:15.349157+0000","last_active":"2024-03-04T12:58:51.103823+0000","last_peered":"2024-03-04T12:58:51.103823+0000","last_clean":"2024-03-04T12:58:51.103823+0000","last_became_active":"2024-03-04T12:36:15.348869+0000","last_became_peered":"2024-03-04T12:36:15.348869+0000","last_unstale":"2024-03-04T12:58:51.103823+0000","last_undegraded":"2024-03-04T12:58:51.103823+0000","last_fullsized":"2024-03-04T12:58:51.103823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:52:50.410936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":240,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"256'411","reported_seq":1952,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.247659+0000","last_change":"2024-03-04T12:36:07.293897+0000","last_active":"2024-03-04T12:59:48.247659+0000","last_peered":"2024-03-04T12:59:48.247659+0000","last_clean":"2024-03-04T12:59:48.247659+0000","last_became_active":"2024-03-04T12:36:07.293586+0000","last_became_peered":"2024-03-04T12:36:07.293586+0000","last_unstale":"2024-03-04T12:59:48.247659+0000","last_undegraded":"2024-03-04T12:59:48.247659+0000","last_fullsized":"2024-03-04T12:59:48.247659+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:31.445571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2259,"num_read_kb":2143,"num_write":486,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"256'335","reported_seq":942,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.112789+0000","last_change":"2024-03-04T12:36:05.288353+0000","last_active":"2024-03-04T13:00:17.112789+0000","last_peered":"2024-03-04T13:00:17.112789+0000","last_clean":"2024-03-04T13:00:17.112789+0000","last_became_active":"2024-03-04T12:36:05.288036+0000","last_became_peered":"2024-03-04T12:36:05.288036+0000","last_unstale":"2024-03-04T13:00:17.112789+0000","last_undegraded":"2024-03-04T13:00:17.112789+0000","last_fullsized":"2024-03-04T13:00:17.112789+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:01.290623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":10713,"num_write":1310,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1088,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.217652+0000","last_change":"2024-03-04T12:36:09.315046+0000","last_active":"2024-03-04T13:00:15.217652+0000","last_peered":"2024-03-04T13:00:15.217652+0000","last_clean":"2024-03-04T13:00:15.217652+0000","last_became_active":"2024-03-04T12:36:09.314474+0000","last_became_peered":"2024-03-04T12:36:09.314474+0000","last_unstale":"2024-03-04T13:00:15.217652+0000","last_undegraded":"2024-03-04T13:00:15.217652+0000","last_fullsized":"2024-03-04T13:00:15.217652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:46:57.713946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":612,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"256'50","reported_seq":536,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:38.607544+0000","last_change":"2024-03-04T12:36:11.954876+0000","last_active":"2024-03-04T12:58:38.607544+0000","last_peered":"2024-03-04T12:58:38.607544+0000","last_clean":"2024-03-04T12:58:38.607544+0000","last_became_active":"2024-03-04T12:36:11.954508+0000","last_became_peered":"2024-03-04T12:36:11.954508+0000","last_unstale":"2024-03-04T12:58:38.607544+0000","last_undegraded":"2024-03-04T12:58:38.607544+0000","last_fullsized":"2024-03-04T12:58:38.607544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:09.989384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"256'482","reported_seq":1497,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.240025+0000","last_change":"2024-03-04T12:36:13.343179+0000","last_active":"2024-03-04T13:00:15.240025+0000","last_peered":"2024-03-04T13:00:15.240025+0000","last_clean":"2024-03-04T13:00:15.240025+0000","last_became_active":"2024-03-04T12:36:13.342902+0000","last_became_peered":"2024-03-04T12:36:13.342902+0000","last_unstale":"2024-03-04T13:00:15.240025+0000","last_undegraded":"2024-03-04T13:00:15.240025+0000","last_fullsized":"2024-03-04T13:00:15.240025+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:58.981468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"256'93","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:34.781977+0000","last_change":"2024-03-04T12:36:15.352744+0000","last_active":"2024-03-04T12:59:34.781977+0000","last_peered":"2024-03-04T12:59:34.781977+0000","last_clean":"2024-03-04T12:59:34.781977+0000","last_became_active":"2024-03-04T12:36:15.352420+0000","last_became_peered":"2024-03-04T12:36:15.352420+0000","last_unstale":"2024-03-04T12:59:34.781977+0000","last_undegraded":"2024-03-04T12:59:34.781977+0000","last_fullsized":"2024-03-04T12:59:34.781977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:55.559823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":79,"num_write":205,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"256'1079","reported_seq":2453,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.904016+0000","last_change":"2024-03-04T12:36:07.304422+0000","last_active":"2024-03-04T12:59:54.904016+0000","last_peered":"2024-03-04T12:59:54.904016+0000","last_clean":"2024-03-04T12:59:54.904016+0000","last_became_active":"2024-03-04T12:36:07.304123+0000","last_became_peered":"2024-03-04T12:36:07.304123+0000","last_unstale":"2024-03-04T12:59:54.904016+0000","last_undegraded":"2024-03-04T12:59:54.904016+0000","last_fullsized":"2024-03-04T12:59:54.904016+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1000,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:23.435722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4358,"num_read_kb":3794,"num_write":1486,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'366","reported_seq":990,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.100383+0000","last_change":"2024-03-04T12:36:05.286870+0000","last_active":"2024-03-04T13:00:17.100383+0000","last_peered":"2024-03-04T13:00:17.100383+0000","last_clean":"2024-03-04T13:00:17.100383+0000","last_became_active":"2024-03-04T12:36:05.286442+0000","last_became_peered":"2024-03-04T12:36:05.286442+0000","last_unstale":"2024-03-04T13:00:17.100383+0000","last_undegraded":"2024-03-04T13:00:17.100383+0000","last_fullsized":"2024-03-04T13:00:17.100383+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:25:34.379001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":497,"num_read_kb":22844,"num_write":1305,"num_write_kb":40494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:25.985653+0000","last_change":"2024-03-04T12:36:09.314992+0000","last_active":"2024-03-04T12:56:25.985653+0000","last_peered":"2024-03-04T12:56:25.985653+0000","last_clean":"2024-03-04T12:56:25.985653+0000","last_became_active":"2024-03-04T12:36:09.314671+0000","last_became_peered":"2024-03-04T12:36:09.314671+0000","last_unstale":"2024-03-04T12:56:25.985653+0000","last_undegraded":"2024-03-04T12:56:25.985653+0000","last_fullsized":"2024-03-04T12:56:25.985653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:57:19.079487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"256'290","reported_seq":857,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.102043+0000","last_change":"2024-03-04T12:36:11.325717+0000","last_active":"2024-03-04T13:00:16.102043+0000","last_peered":"2024-03-04T13:00:16.102043+0000","last_clean":"2024-03-04T13:00:16.102043+0000","last_became_active":"2024-03-04T12:36:11.325372+0000","last_became_peered":"2024-03-04T12:36:11.325372+0000","last_unstale":"2024-03-04T13:00:16.102043+0000","last_undegraded":"2024-03-04T13:00:16.102043+0000","last_fullsized":"2024-03-04T13:00:16.102043+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:16:12.771232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47142,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1045,"num_read_kb":1555,"num_write":1526,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:30.981677+0000","last_change":"2024-03-04T12:36:13.349278+0000","last_active":"2024-03-04T12:56:30.981677+0000","last_peered":"2024-03-04T12:56:30.981677+0000","last_clean":"2024-03-04T12:56:30.981677+0000","last_became_active":"2024-03-04T12:36:13.348998+0000","last_became_peered":"2024-03-04T12:36:13.348998+0000","last_unstale":"2024-03-04T12:56:30.981677+0000","last_undegraded":"2024-03-04T12:56:30.981677+0000","last_fullsized":"2024-03-04T12:56:30.981677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:03:29.176425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"256'116","reported_seq":596,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:43.519813+0000","last_change":"2024-03-04T12:36:15.363113+0000","last_active":"2024-03-04T12:58:43.519813+0000","last_peered":"2024-03-04T12:58:43.519813+0000","last_clean":"2024-03-04T12:58:43.519813+0000","last_became_active":"2024-03-04T12:36:15.362792+0000","last_became_peered":"2024-03-04T12:36:15.362792+0000","last_unstale":"2024-03-04T12:58:43.519813+0000","last_undegraded":"2024-03-04T12:58:43.519813+0000","last_fullsized":"2024-03-04T12:58:43.519813+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:51:39.773670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":132,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"256'316","reported_seq":1674,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.469861+0000","last_change":"2024-03-04T12:36:07.300301+0000","last_active":"2024-03-04T12:59:55.469861+0000","last_peered":"2024-03-04T12:59:55.469861+0000","last_clean":"2024-03-04T12:59:55.469861+0000","last_became_active":"2024-03-04T12:36:07.299952+0000","last_became_peered":"2024-03-04T12:36:07.299952+0000","last_unstale":"2024-03-04T12:59:55.469861+0000","last_undegraded":"2024-03-04T12:59:55.469861+0000","last_fullsized":"2024-03-04T12:59:55.469861+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:58.864307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1855,"num_read_kb":1767,"num_write":364,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":649,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.884796+0000","last_change":"2024-03-04T12:35:47.950593+0000","last_active":"2024-03-04T12:57:55.884796+0000","last_peered":"2024-03-04T12:57:55.884796+0000","last_clean":"2024-03-04T12:57:55.884796+0000","last_became_active":"2024-03-04T12:35:47.950213+0000","last_became_peered":"2024-03-04T12:35:47.950213+0000","last_unstale":"2024-03-04T12:57:55.884796+0000","last_undegraded":"2024-03-04T12:57:55.884796+0000","last_fullsized":"2024-03-04T12:57:55.884796+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_clean_scrub_stamp":"2024-03-04T12:35:46.856449+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:52:59.823887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.989264+0000","last_change":"2024-03-04T12:35:54.235102+0000","last_active":"2024-03-04T12:56:45.989264+0000","last_peered":"2024-03-04T12:56:45.989264+0000","last_clean":"2024-03-04T12:56:45.989264+0000","last_became_active":"2024-03-04T12:35:54.234819+0000","last_became_peered":"2024-03-04T12:35:54.234819+0000","last_unstale":"2024-03-04T12:56:45.989264+0000","last_undegraded":"2024-03-04T12:56:45.989264+0000","last_fullsized":"2024-03-04T12:56:45.989264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:40.517488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"256'312","reported_seq":921,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.128572+0000","last_change":"2024-03-04T12:36:05.297146+0000","last_active":"2024-03-04T13:00:17.128572+0000","last_peered":"2024-03-04T13:00:17.128572+0000","last_clean":"2024-03-04T13:00:17.128572+0000","last_became_active":"2024-03-04T12:36:05.296783+0000","last_became_peered":"2024-03-04T12:36:05.296783+0000","last_unstale":"2024-03-04T13:00:17.128572+0000","last_undegraded":"2024-03-04T13:00:17.128572+0000","last_fullsized":"2024-03-04T13:00:17.128572+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:06:23.807756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":460,"num_read_kb":16805,"num_write":1147,"num_write_kb":27899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.876708+0000","last_change":"2024-03-04T12:36:09.306698+0000","last_active":"2024-03-04T12:57:00.876708+0000","last_peered":"2024-03-04T12:57:00.876708+0000","last_clean":"2024-03-04T12:57:00.876708+0000","last_became_active":"2024-03-04T12:36:09.306398+0000","last_became_peered":"2024-03-04T12:36:09.306398+0000","last_unstale":"2024-03-04T12:57:00.876708+0000","last_undegraded":"2024-03-04T12:57:00.876708+0000","last_fullsized":"2024-03-04T12:57:00.876708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:16.000870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"256'661","reported_seq":1336,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.825225+0000","last_change":"2024-03-04T12:36:11.327855+0000","last_active":"2024-03-04T13:00:16.825225+0000","last_peered":"2024-03-04T13:00:16.825225+0000","last_clean":"2024-03-04T13:00:16.825225+0000","last_became_active":"2024-03-04T12:36:11.327652+0000","last_became_peered":"2024-03-04T12:36:11.327652+0000","last_unstale":"2024-03-04T13:00:16.825225+0000","last_undegraded":"2024-03-04T13:00:16.825225+0000","last_fullsized":"2024-03-04T13:00:16.825225+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":600,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:41:37.539307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140555,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1295,"num_read_kb":2979,"num_write":1188,"num_write_kb":1057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.003351+0000","last_change":"2024-03-04T12:36:13.341910+0000","last_active":"2024-03-04T12:57:56.003351+0000","last_peered":"2024-03-04T12:57:56.003351+0000","last_clean":"2024-03-04T12:57:56.003351+0000","last_became_active":"2024-03-04T12:36:13.341629+0000","last_became_peered":"2024-03-04T12:36:13.341629+0000","last_unstale":"2024-03-04T12:57:56.003351+0000","last_undegraded":"2024-03-04T12:57:56.003351+0000","last_fullsized":"2024-03-04T12:57:56.003351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:27:23.583364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"256'95","reported_seq":571,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.010288+0000","last_change":"2024-03-04T12:36:15.363641+0000","last_active":"2024-03-04T13:00:06.010288+0000","last_peered":"2024-03-04T13:00:06.010288+0000","last_clean":"2024-03-04T13:00:06.010288+0000","last_became_active":"2024-03-04T12:36:15.363355+0000","last_became_peered":"2024-03-04T12:36:15.363355+0000","last_unstale":"2024-03-04T13:00:06.010288+0000","last_undegraded":"2024-03-04T13:00:06.010288+0000","last_fullsized":"2024-03-04T13:00:06.010288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:41:52.622760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"256'352","reported_seq":1786,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:46.629131+0000","last_change":"2024-03-04T12:36:07.302006+0000","last_active":"2024-03-04T12:59:46.629131+0000","last_peered":"2024-03-04T12:59:46.629131+0000","last_clean":"2024-03-04T12:59:46.629131+0000","last_became_active":"2024-03-04T12:36:07.301706+0000","last_became_peered":"2024-03-04T12:36:07.301706+0000","last_unstale":"2024-03-04T12:59:46.629131+0000","last_undegraded":"2024-03-04T12:59:46.629131+0000","last_fullsized":"2024-03-04T12:59:46.629131+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:39:55.323374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2015,"num_read_kb":1927,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:00.885742+0000","last_change":"2024-03-04T12:35:54.238692+0000","last_active":"2024-03-04T12:58:00.885742+0000","last_peered":"2024-03-04T12:58:00.885742+0000","last_clean":"2024-03-04T12:58:00.885742+0000","last_became_active":"2024-03-04T12:35:54.238351+0000","last_became_peered":"2024-03-04T12:35:54.238351+0000","last_unstale":"2024-03-04T12:58:00.885742+0000","last_undegraded":"2024-03-04T12:58:00.885742+0000","last_fullsized":"2024-03-04T12:58:00.885742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:37.144629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"256'386","reported_seq":1050,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.089941+0000","last_change":"2024-03-04T12:36:05.285992+0000","last_active":"2024-03-04T13:00:17.089941+0000","last_peered":"2024-03-04T13:00:17.089941+0000","last_clean":"2024-03-04T13:00:17.089941+0000","last_became_active":"2024-03-04T12:36:05.285659+0000","last_became_peered":"2024-03-04T12:36:05.285659+0000","last_unstale":"2024-03-04T13:00:17.089941+0000","last_undegraded":"2024-03-04T13:00:17.089941+0000","last_fullsized":"2024-03-04T13:00:17.089941+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:45:04.076122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2160246,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":21923,"num_write":1294,"num_write_kb":32530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:51.000222+0000","last_change":"2024-03-04T12:36:09.314765+0000","last_active":"2024-03-04T12:57:51.000222+0000","last_peered":"2024-03-04T12:57:51.000222+0000","last_clean":"2024-03-04T12:57:51.000222+0000","last_became_active":"2024-03-04T12:36:09.314113+0000","last_became_peered":"2024-03-04T12:36:09.314113+0000","last_unstale":"2024-03-04T12:57:51.000222+0000","last_undegraded":"2024-03-04T12:57:51.000222+0000","last_fullsized":"2024-03-04T12:57:51.000222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:55.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"256'1017","reported_seq":2131,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.063419+0000","last_change":"2024-03-04T12:36:11.323823+0000","last_active":"2024-03-04T13:00:17.063419+0000","last_peered":"2024-03-04T13:00:17.063419+0000","last_clean":"2024-03-04T13:00:17.063419+0000","last_became_active":"2024-03-04T12:36:11.323543+0000","last_became_peered":"2024-03-04T12:36:11.323543+0000","last_unstale":"2024-03-04T13:00:17.063419+0000","last_undegraded":"2024-03-04T13:00:17.063419+0000","last_fullsized":"2024-03-04T13:00:17.063419+0000","mapping_epoch":26,"log_start":"256'1000","ondisk_log_start":"256'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":1000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:18.828076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157019,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1614,"num_read_kb":3260,"num_write":972,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.878183+0000","last_change":"2024-03-04T12:36:13.339634+0000","last_active":"2024-03-04T12:57:10.878183+0000","last_peered":"2024-03-04T12:57:10.878183+0000","last_clean":"2024-03-04T12:57:10.878183+0000","last_became_active":"2024-03-04T12:36:13.339353+0000","last_became_peered":"2024-03-04T12:36:13.339353+0000","last_unstale":"2024-03-04T12:57:10.878183+0000","last_undegraded":"2024-03-04T12:57:10.878183+0000","last_fullsized":"2024-03-04T12:57:10.878183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:35.363812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"256'145","reported_seq":632,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:45.918673+0000","last_change":"2024-03-04T12:36:15.346836+0000","last_active":"2024-03-04T12:59:45.918673+0000","last_peered":"2024-03-04T12:59:45.918673+0000","last_clean":"2024-03-04T12:59:45.918673+0000","last_became_active":"2024-03-04T12:36:15.346516+0000","last_became_peered":"2024-03-04T12:36:15.346516+0000","last_unstale":"2024-03-04T12:59:45.918673+0000","last_undegraded":"2024-03-04T12:59:45.918673+0000","last_fullsized":"2024-03-04T12:59:45.918673+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:23:48.979559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":196,"num_read_kb":196,"num_write":318,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"256'397","reported_seq":1866,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.670858+0000","last_change":"2024-03-04T12:36:07.303682+0000","last_active":"2024-03-04T13:00:06.670858+0000","last_peered":"2024-03-04T13:00:06.670858+0000","last_clean":"2024-03-04T13:00:06.670858+0000","last_became_active":"2024-03-04T12:36:07.300039+0000","last_became_peered":"2024-03-04T12:36:07.300039+0000","last_unstale":"2024-03-04T13:00:06.670858+0000","last_undegraded":"2024-03-04T13:00:06.670858+0000","last_fullsized":"2024-03-04T13:00:06.670858+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:24.962188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2349,"num_read_kb":2220,"num_write":468,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":492,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.981094+0000","last_change":"2024-03-04T12:35:54.236078+0000","last_active":"2024-03-04T12:56:45.981094+0000","last_peered":"2024-03-04T12:56:45.981094+0000","last_clean":"2024-03-04T12:56:45.981094+0000","last_became_active":"2024-03-04T12:35:54.235738+0000","last_became_peered":"2024-03-04T12:35:54.235738+0000","last_unstale":"2024-03-04T12:56:45.981094+0000","last_undegraded":"2024-03-04T12:56:45.981094+0000","last_fullsized":"2024-03-04T12:56:45.981094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:36:28.049431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"256'380","reported_seq":1268,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.116040+0000","last_change":"2024-03-04T12:36:05.275101+0000","last_active":"2024-03-04T13:00:17.116040+0000","last_peered":"2024-03-04T13:00:17.116040+0000","last_clean":"2024-03-04T13:00:17.116040+0000","last_became_active":"2024-03-04T12:36:05.274788+0000","last_became_peered":"2024-03-04T12:36:05.274788+0000","last_unstale":"2024-03-04T13:00:17.116040+0000","last_undegraded":"2024-03-04T13:00:17.116040+0000","last_fullsized":"2024-03-04T13:00:17.116040+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:42.330697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069328,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1100,"num_read_kb":10802,"num_write":1447,"num_write_kb":39091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:50.988318+0000","last_change":"2024-03-04T12:36:09.315373+0000","last_active":"2024-03-04T12:57:50.988318+0000","last_peered":"2024-03-04T12:57:50.988318+0000","last_clean":"2024-03-04T12:57:50.988318+0000","last_became_active":"2024-03-04T12:36:09.315023+0000","last_became_peered":"2024-03-04T12:36:09.315023+0000","last_unstale":"2024-03-04T12:57:50.988318+0000","last_undegraded":"2024-03-04T12:57:50.988318+0000","last_fullsized":"2024-03-04T12:57:50.988318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:07:21.105335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"256'188","reported_seq":992,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.829479+0000","last_change":"2024-03-04T12:36:11.955503+0000","last_active":"2024-03-04T13:00:08.829479+0000","last_peered":"2024-03-04T13:00:08.829479+0000","last_clean":"2024-03-04T13:00:08.829479+0000","last_became_active":"2024-03-04T12:36:11.954554+0000","last_became_peered":"2024-03-04T12:36:11.954554+0000","last_unstale":"2024-03-04T13:00:08.829479+0000","last_undegraded":"2024-03-04T13:00:08.829479+0000","last_fullsized":"2024-03-04T13:00:08.829479+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:18:36.129703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:05.997035+0000","last_change":"2024-03-04T12:36:13.338785+0000","last_active":"2024-03-04T12:57:05.997035+0000","last_peered":"2024-03-04T12:57:05.997035+0000","last_clean":"2024-03-04T12:57:05.997035+0000","last_became_active":"2024-03-04T12:36:13.338388+0000","last_became_peered":"2024-03-04T12:36:13.338388+0000","last_unstale":"2024-03-04T12:57:05.997035+0000","last_undegraded":"2024-03-04T12:57:05.997035+0000","last_fullsized":"2024-03-04T12:57:05.997035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:15.536794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'192","reported_seq":682,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:17.459051+0000","last_change":"2024-03-04T12:36:15.354193+0000","last_active":"2024-03-04T12:59:17.459051+0000","last_peered":"2024-03-04T12:59:17.459051+0000","last_clean":"2024-03-04T12:59:17.459051+0000","last_became_active":"2024-03-04T12:36:15.353529+0000","last_became_peered":"2024-03-04T12:36:15.353529+0000","last_unstale":"2024-03-04T12:59:17.459051+0000","last_undegraded":"2024-03-04T12:59:17.459051+0000","last_fullsized":"2024-03-04T12:59:17.459051+0000","mapping_epoch":30,"log_start":"241'100","ondisk_log_start":"241'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:04.219643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":292,"num_read_kb":316,"num_write":426,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"256'393","reported_seq":1822,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671228+0000","last_change":"2024-03-04T12:36:07.299521+0000","last_active":"2024-03-04T13:00:06.671228+0000","last_peered":"2024-03-04T13:00:06.671228+0000","last_clean":"2024-03-04T13:00:06.671228+0000","last_became_active":"2024-03-04T12:36:07.298936+0000","last_became_peered":"2024-03-04T12:36:07.298936+0000","last_unstale":"2024-03-04T13:00:06.671228+0000","last_undegraded":"2024-03-04T13:00:06.671228+0000","last_fullsized":"2024-03-04T13:00:06.671228+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:42:23.027185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2152,"num_read_kb":2018,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.989215+0000","last_change":"2024-03-04T12:35:54.238657+0000","last_active":"2024-03-04T12:56:45.989215+0000","last_peered":"2024-03-04T12:56:45.989215+0000","last_clean":"2024-03-04T12:56:45.989215+0000","last_became_active":"2024-03-04T12:35:54.238357+0000","last_became_peered":"2024-03-04T12:35:54.238357+0000","last_unstale":"2024-03-04T12:56:45.989215+0000","last_undegraded":"2024-03-04T12:56:45.989215+0000","last_fullsized":"2024-03-04T12:56:45.989215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:33:05.241037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"256'327","reported_seq":975,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.108938+0000","last_change":"2024-03-04T12:36:05.289667+0000","last_active":"2024-03-04T13:00:17.108938+0000","last_peered":"2024-03-04T13:00:17.108938+0000","last_clean":"2024-03-04T13:00:17.108938+0000","last_became_active":"2024-03-04T12:36:05.289374+0000","last_became_peered":"2024-03-04T12:36:05.289374+0000","last_unstale":"2024-03-04T13:00:17.108938+0000","last_undegraded":"2024-03-04T13:00:17.108938+0000","last_fullsized":"2024-03-04T13:00:17.108938+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:40:44.869761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007111,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":531,"num_read_kb":54492,"num_write":1276,"num_write_kb":39662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996409+0000","last_change":"2024-03-04T12:36:09.304779+0000","last_active":"2024-03-04T12:57:00.996409+0000","last_peered":"2024-03-04T12:57:00.996409+0000","last_clean":"2024-03-04T12:57:00.996409+0000","last_became_active":"2024-03-04T12:36:09.304291+0000","last_became_peered":"2024-03-04T12:36:09.304291+0000","last_unstale":"2024-03-04T12:57:00.996409+0000","last_undegraded":"2024-03-04T12:57:00.996409+0000","last_fullsized":"2024-03-04T12:57:00.996409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:49.161718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"256'81","reported_seq":586,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:12.360275+0000","last_change":"2024-03-04T12:36:11.326239+0000","last_active":"2024-03-04T12:59:12.360275+0000","last_peered":"2024-03-04T12:59:12.360275+0000","last_clean":"2024-03-04T12:59:12.360275+0000","last_became_active":"2024-03-04T12:36:11.325957+0000","last_became_peered":"2024-03-04T12:36:11.325957+0000","last_unstale":"2024-03-04T12:59:12.360275+0000","last_undegraded":"2024-03-04T12:59:12.360275+0000","last_fullsized":"2024-03-04T12:59:12.360275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:45:15.387282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":66,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":466,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.993163+0000","last_change":"2024-03-04T12:36:13.345759+0000","last_active":"2024-03-04T12:57:55.993163+0000","last_peered":"2024-03-04T12:57:55.993163+0000","last_clean":"2024-03-04T12:57:55.993163+0000","last_became_active":"2024-03-04T12:36:13.345547+0000","last_became_peered":"2024-03-04T12:36:13.345547+0000","last_unstale":"2024-03-04T12:57:55.993163+0000","last_undegraded":"2024-03-04T12:57:55.993163+0000","last_fullsized":"2024-03-04T12:57:55.993163+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:20.602726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"256'111","reported_seq":598,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:17.289185+0000","last_change":"2024-03-04T12:36:15.363530+0000","last_active":"2024-03-04T12:59:17.289185+0000","last_peered":"2024-03-04T12:59:17.289185+0000","last_clean":"2024-03-04T12:59:17.289185+0000","last_became_active":"2024-03-04T12:36:15.363185+0000","last_became_peered":"2024-03-04T12:36:15.363185+0000","last_unstale":"2024-03-04T12:59:17.289185+0000","last_undegraded":"2024-03-04T12:59:17.289185+0000","last_fullsized":"2024-03-04T12:59:17.289185+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:16.150410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":251,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"256'464","reported_seq":2007,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.027056+0000","last_change":"2024-03-04T12:36:07.297241+0000","last_active":"2024-03-04T12:59:56.027056+0000","last_peered":"2024-03-04T12:59:56.027056+0000","last_clean":"2024-03-04T12:59:56.027056+0000","last_became_active":"2024-03-04T12:36:07.296433+0000","last_became_peered":"2024-03-04T12:36:07.296433+0000","last_unstale":"2024-03-04T12:59:56.027056+0000","last_undegraded":"2024-03-04T12:59:56.027056+0000","last_fullsized":"2024-03-04T12:59:56.027056+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:57:02.539909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2396,"num_read_kb":2259,"num_write":579,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"256'394","reported_seq":1047,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.110873+0000","last_change":"2024-03-04T12:36:40.965648+0000","last_active":"2024-03-04T13:00:17.110873+0000","last_peered":"2024-03-04T13:00:17.110873+0000","last_clean":"2024-03-04T13:00:17.110873+0000","last_became_active":"2024-03-04T12:36:40.965346+0000","last_became_peered":"2024-03-04T12:36:40.965346+0000","last_unstale":"2024-03-04T13:00:17.110873+0000","last_undegraded":"2024-03-04T13:00:17.110873+0000","last_fullsized":"2024-03-04T13:00:17.110873+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:34.208423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":48879,"num_write":1467,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:45.977490+0000","last_change":"2024-03-04T12:35:54.470673+0000","last_active":"2024-03-04T12:56:45.977490+0000","last_peered":"2024-03-04T12:56:45.977490+0000","last_clean":"2024-03-04T12:56:45.977490+0000","last_became_active":"2024-03-04T12:35:54.470407+0000","last_became_peered":"2024-03-04T12:35:54.470407+0000","last_unstale":"2024-03-04T12:56:45.977490+0000","last_undegraded":"2024-03-04T12:56:45.977490+0000","last_fullsized":"2024-03-04T12:56:45.977490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:30:21.008474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.996381+0000","last_change":"2024-03-04T12:36:09.308620+0000","last_active":"2024-03-04T12:57:00.996381+0000","last_peered":"2024-03-04T12:57:00.996381+0000","last_clean":"2024-03-04T12:57:00.996381+0000","last_became_active":"2024-03-04T12:36:09.308360+0000","last_became_peered":"2024-03-04T12:36:09.308360+0000","last_unstale":"2024-03-04T12:57:00.996381+0000","last_undegraded":"2024-03-04T12:57:00.996381+0000","last_fullsized":"2024-03-04T12:57:00.996381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:12:02.956921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"256'488","reported_seq":1112,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.880020+0000","last_change":"2024-03-04T12:36:11.329225+0000","last_active":"2024-03-04T13:00:16.880020+0000","last_peered":"2024-03-04T13:00:16.880020+0000","last_clean":"2024-03-04T13:00:16.880020+0000","last_became_active":"2024-03-04T12:36:11.328923+0000","last_became_peered":"2024-03-04T12:36:11.328923+0000","last_unstale":"2024-03-04T13:00:16.880020+0000","last_undegraded":"2024-03-04T13:00:16.880020+0000","last_fullsized":"2024-03-04T13:00:16.880020+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:50.151006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93633,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":843,"num_read_kb":1937,"num_write":680,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:05.992670+0000","last_change":"2024-03-04T12:36:13.347228+0000","last_active":"2024-03-04T12:57:05.992670+0000","last_peered":"2024-03-04T12:57:05.992670+0000","last_clean":"2024-03-04T12:57:05.992670+0000","last_became_active":"2024-03-04T12:36:13.346886+0000","last_became_peered":"2024-03-04T12:36:13.346886+0000","last_unstale":"2024-03-04T12:57:05.992670+0000","last_undegraded":"2024-03-04T12:57:05.992670+0000","last_fullsized":"2024-03-04T12:57:05.992670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:14.642237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"256'94","reported_seq":573,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.020901+0000","last_change":"2024-03-04T12:36:15.350589+0000","last_active":"2024-03-04T12:59:56.020901+0000","last_peered":"2024-03-04T12:59:56.020901+0000","last_clean":"2024-03-04T12:59:56.020901+0000","last_became_active":"2024-03-04T12:36:15.350185+0000","last_became_peered":"2024-03-04T12:36:15.350185+0000","last_unstale":"2024-03-04T12:59:56.020901+0000","last_undegraded":"2024-03-04T12:59:56.020901+0000","last_fullsized":"2024-03-04T12:59:56.020901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:06:50.695793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":228,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"256'646","reported_seq":2008,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.609894+0000","last_change":"2024-03-04T12:36:07.296955+0000","last_active":"2024-03-04T12:59:47.609894+0000","last_peered":"2024-03-04T12:59:47.609894+0000","last_clean":"2024-03-04T12:59:47.609894+0000","last_became_active":"2024-03-04T12:36:07.296657+0000","last_became_peered":"2024-03-04T12:36:07.296657+0000","last_unstale":"2024-03-04T12:59:47.609894+0000","last_undegraded":"2024-03-04T12:59:47.609894+0000","last_fullsized":"2024-03-04T12:59:47.609894+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":600,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:09.500092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3068,"num_read_kb":2828,"num_write":988,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"256'347","reported_seq":1020,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.109523+0000","last_change":"2024-03-04T12:36:05.275545+0000","last_active":"2024-03-04T13:00:17.109523+0000","last_peered":"2024-03-04T13:00:17.109523+0000","last_clean":"2024-03-04T13:00:17.109523+0000","last_became_active":"2024-03-04T12:36:05.275263+0000","last_became_peered":"2024-03-04T12:36:05.275263+0000","last_unstale":"2024-03-04T13:00:17.109523+0000","last_undegraded":"2024-03-04T13:00:17.109523+0000","last_fullsized":"2024-03-04T13:00:17.109523+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:05.000491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":637,"num_read_kb":62539,"num_write":1435,"num_write_kb":42561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":492,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:50.875403+0000","last_change":"2024-03-04T12:35:54.470913+0000","last_active":"2024-03-04T12:56:50.875403+0000","last_peered":"2024-03-04T12:56:50.875403+0000","last_clean":"2024-03-04T12:56:50.875403+0000","last_became_active":"2024-03-04T12:35:54.470620+0000","last_became_peered":"2024-03-04T12:35:54.470620+0000","last_unstale":"2024-03-04T12:56:50.875403+0000","last_undegraded":"2024-03-04T12:56:50.875403+0000","last_fullsized":"2024-03-04T12:56:50.875403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:00.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.985543+0000","last_change":"2024-03-04T12:36:09.312394+0000","last_active":"2024-03-04T12:57:00.985543+0000","last_peered":"2024-03-04T12:57:00.985543+0000","last_clean":"2024-03-04T12:57:00.985543+0000","last_became_active":"2024-03-04T12:36:09.312135+0000","last_became_peered":"2024-03-04T12:36:09.312135+0000","last_unstale":"2024-03-04T12:57:00.985543+0000","last_undegraded":"2024-03-04T12:57:00.985543+0000","last_fullsized":"2024-03-04T12:57:00.985543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:40:59.354604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"256'139","reported_seq":665,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.644974+0000","last_change":"2024-03-04T12:36:11.954977+0000","last_active":"2024-03-04T12:59:48.644974+0000","last_peered":"2024-03-04T12:59:48.644974+0000","last_clean":"2024-03-04T12:59:48.644974+0000","last_became_active":"2024-03-04T12:36:11.954579+0000","last_became_peered":"2024-03-04T12:36:11.954579+0000","last_unstale":"2024-03-04T12:59:48.644974+0000","last_undegraded":"2024-03-04T12:59:48.644974+0000","last_fullsized":"2024-03-04T12:59:48.644974+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:39.654798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":130,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"256'546","reported_seq":4064,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.661104+0000","last_change":"2024-03-04T12:36:13.342293+0000","last_active":"2024-03-04T13:00:16.661104+0000","last_peered":"2024-03-04T13:00:16.661104+0000","last_clean":"2024-03-04T13:00:16.661104+0000","last_became_active":"2024-03-04T12:36:13.341957+0000","last_became_peered":"2024-03-04T12:36:13.341957+0000","last_unstale":"2024-03-04T13:00:16.661104+0000","last_undegraded":"2024-03-04T13:00:16.661104+0000","last_fullsized":"2024-03-04T13:00:16.661104+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:06.453055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"256'123","reported_seq":596,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.050692+0000","last_change":"2024-03-04T12:36:15.355664+0000","last_active":"2024-03-04T12:59:53.050692+0000","last_peered":"2024-03-04T12:59:53.050692+0000","last_clean":"2024-03-04T12:59:53.050692+0000","last_became_active":"2024-03-04T12:36:15.355291+0000","last_became_peered":"2024-03-04T12:36:15.355291+0000","last_unstale":"2024-03-04T12:59:53.050692+0000","last_undegraded":"2024-03-04T12:59:53.050692+0000","last_fullsized":"2024-03-04T12:59:53.050692+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:08.603654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"256'743","reported_seq":2161,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.045676+0000","last_change":"2024-03-04T12:36:07.290212+0000","last_active":"2024-03-04T12:59:53.045676+0000","last_peered":"2024-03-04T12:59:53.045676+0000","last_clean":"2024-03-04T12:59:53.045676+0000","last_became_active":"2024-03-04T12:36:07.289884+0000","last_became_peered":"2024-03-04T12:36:07.289884+0000","last_unstale":"2024-03-04T12:59:53.045676+0000","last_undegraded":"2024-03-04T12:59:53.045676+0000","last_fullsized":"2024-03-04T12:59:53.045676+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:01:07.678104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3351,"num_read_kb":2980,"num_write":997,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"256'320","reported_seq":926,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.083330+0000","last_change":"2024-03-04T12:36:05.291839+0000","last_active":"2024-03-04T13:00:17.083330+0000","last_peered":"2024-03-04T13:00:17.083330+0000","last_clean":"2024-03-04T13:00:17.083330+0000","last_became_active":"2024-03-04T12:36:05.291549+0000","last_became_peered":"2024-03-04T12:36:05.291549+0000","last_unstale":"2024-03-04T13:00:17.083330+0000","last_undegraded":"2024-03-04T13:00:17.083330+0000","last_fullsized":"2024-03-04T13:00:17.083330+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:39.785480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194348,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":36332,"num_write":1128,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:35.983734+0000","last_change":"2024-03-04T12:35:54.239060+0000","last_active":"2024-03-04T12:57:35.983734+0000","last_peered":"2024-03-04T12:57:35.983734+0000","last_clean":"2024-03-04T12:57:35.983734+0000","last_became_active":"2024-03-04T12:35:54.238802+0000","last_became_peered":"2024-03-04T12:35:54.238802+0000","last_unstale":"2024-03-04T12:57:35.983734+0000","last_undegraded":"2024-03-04T12:57:35.983734+0000","last_fullsized":"2024-03-04T12:57:35.983734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:29.643511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.991892+0000","last_change":"2024-03-04T12:36:09.307816+0000","last_active":"2024-03-04T12:57:00.991892+0000","last_peered":"2024-03-04T12:57:00.991892+0000","last_clean":"2024-03-04T12:57:00.991892+0000","last_became_active":"2024-03-04T12:36:09.307467+0000","last_became_peered":"2024-03-04T12:36:09.307467+0000","last_unstale":"2024-03-04T12:57:00.991892+0000","last_undegraded":"2024-03-04T12:57:00.991892+0000","last_fullsized":"2024-03-04T12:57:00.991892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:30:08.145067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"256'78","reported_seq":585,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:34.753384+0000","last_change":"2024-03-04T12:36:11.326288+0000","last_active":"2024-03-04T12:58:34.753384+0000","last_peered":"2024-03-04T12:58:34.753384+0000","last_clean":"2024-03-04T12:58:34.753384+0000","last_became_active":"2024-03-04T12:36:11.325955+0000","last_became_peered":"2024-03-04T12:36:11.325955+0000","last_unstale":"2024-03-04T12:58:34.753384+0000","last_undegraded":"2024-03-04T12:58:34.753384+0000","last_fullsized":"2024-03-04T12:58:34.753384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:39:41.658332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"256'535","reported_seq":1567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.606535+0000","last_change":"2024-03-04T12:36:13.349703+0000","last_active":"2024-03-04T13:00:16.606535+0000","last_peered":"2024-03-04T13:00:16.606535+0000","last_clean":"2024-03-04T13:00:16.606535+0000","last_became_active":"2024-03-04T12:36:13.349421+0000","last_became_peered":"2024-03-04T12:36:13.349421+0000","last_unstale":"2024-03-04T13:00:16.606535+0000","last_undegraded":"2024-03-04T13:00:16.606535+0000","last_fullsized":"2024-03-04T13:00:16.606535+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:52:42.138224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"256'96","reported_seq":565,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.767846+0000","last_change":"2024-03-04T12:36:15.356492+0000","last_active":"2024-03-04T12:59:50.767846+0000","last_peered":"2024-03-04T12:59:50.767846+0000","last_clean":"2024-03-04T12:59:50.767846+0000","last_became_active":"2024-03-04T12:36:15.356192+0000","last_became_peered":"2024-03-04T12:36:15.356192+0000","last_unstale":"2024-03-04T12:59:50.767846+0000","last_undegraded":"2024-03-04T12:59:50.767846+0000","last_fullsized":"2024-03-04T12:59:50.767846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:15:40.455972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":232,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"256'390","reported_seq":1911,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.017107+0000","last_change":"2024-03-04T12:36:07.299701+0000","last_active":"2024-03-04T12:59:54.017107+0000","last_peered":"2024-03-04T12:59:54.017107+0000","last_clean":"2024-03-04T12:59:54.017107+0000","last_became_active":"2024-03-04T12:36:07.298963+0000","last_became_peered":"2024-03-04T12:36:07.298963+0000","last_unstale":"2024-03-04T12:59:54.017107+0000","last_undegraded":"2024-03-04T12:59:54.017107+0000","last_fullsized":"2024-03-04T12:59:54.017107+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:26.582084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2139,"num_write":463,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"256'321","reported_seq":931,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.091143+0000","last_change":"2024-03-04T12:36:05.282071+0000","last_active":"2024-03-04T13:00:17.091143+0000","last_peered":"2024-03-04T13:00:17.091143+0000","last_clean":"2024-03-04T13:00:17.091143+0000","last_became_active":"2024-03-04T12:36:05.281790+0000","last_became_peered":"2024-03-04T12:36:05.281790+0000","last_unstale":"2024-03-04T13:00:17.091143+0000","last_undegraded":"2024-03-04T13:00:17.091143+0000","last_fullsized":"2024-03-04T13:00:17.091143+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:07.529352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1778947,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":33441,"num_write":1185,"num_write_kb":31732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":488,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:35.990462+0000","last_change":"2024-03-04T12:35:54.239095+0000","last_active":"2024-03-04T12:57:35.990462+0000","last_peered":"2024-03-04T12:57:35.990462+0000","last_clean":"2024-03-04T12:57:35.990462+0000","last_became_active":"2024-03-04T12:35:54.238580+0000","last_became_peered":"2024-03-04T12:35:54.238580+0000","last_unstale":"2024-03-04T12:57:35.990462+0000","last_undegraded":"2024-03-04T12:57:35.990462+0000","last_fullsized":"2024-03-04T12:57:35.990462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:51.568234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:10.988802+0000","last_change":"2024-03-04T12:36:09.308483+0000","last_active":"2024-03-04T12:58:10.988802+0000","last_peered":"2024-03-04T12:58:10.988802+0000","last_clean":"2024-03-04T12:58:10.988802+0000","last_became_active":"2024-03-04T12:36:09.308162+0000","last_became_peered":"2024-03-04T12:36:09.308162+0000","last_unstale":"2024-03-04T12:58:10.988802+0000","last_undegraded":"2024-03-04T12:58:10.988802+0000","last_fullsized":"2024-03-04T12:58:10.988802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:27.690789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"256'704","reported_seq":1391,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.093631+0000","last_change":"2024-03-04T12:36:11.955174+0000","last_active":"2024-03-04T13:00:17.093631+0000","last_peered":"2024-03-04T13:00:17.093631+0000","last_clean":"2024-03-04T13:00:17.093631+0000","last_became_active":"2024-03-04T12:36:11.954569+0000","last_became_peered":"2024-03-04T12:36:11.954569+0000","last_unstale":"2024-03-04T13:00:17.093631+0000","last_undegraded":"2024-03-04T13:00:17.093631+0000","last_fullsized":"2024-03-04T13:00:17.093631+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:12.036941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140875,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1277,"num_read_kb":3093,"num_write":1046,"num_write_kb":893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:05.980274+0000","last_change":"2024-03-04T12:36:13.346191+0000","last_active":"2024-03-04T12:57:05.980274+0000","last_peered":"2024-03-04T12:57:05.980274+0000","last_clean":"2024-03-04T12:57:05.980274+0000","last_became_active":"2024-03-04T12:36:13.345919+0000","last_became_peered":"2024-03-04T12:36:13.345919+0000","last_unstale":"2024-03-04T12:57:05.980274+0000","last_undegraded":"2024-03-04T12:57:05.980274+0000","last_fullsized":"2024-03-04T12:57:05.980274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:25.153970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"256'128","reported_seq":591,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:40.768192+0000","last_change":"2024-03-04T12:36:15.363169+0000","last_active":"2024-03-04T12:59:40.768192+0000","last_peered":"2024-03-04T12:59:40.768192+0000","last_clean":"2024-03-04T12:59:40.768192+0000","last_became_active":"2024-03-04T12:36:15.362710+0000","last_became_peered":"2024-03-04T12:36:15.362710+0000","last_unstale":"2024-03-04T12:59:40.768192+0000","last_undegraded":"2024-03-04T12:59:40.768192+0000","last_fullsized":"2024-03-04T12:59:40.768192+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:18:23.671452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"256'110","reported_seq":571,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.681038+0000","last_change":"2024-03-04T12:36:15.363367+0000","last_active":"2024-03-04T13:00:06.681038+0000","last_peered":"2024-03-04T13:00:06.681038+0000","last_clean":"2024-03-04T13:00:06.681038+0000","last_became_active":"2024-03-04T12:36:15.363057+0000","last_became_peered":"2024-03-04T12:36:15.363057+0000","last_unstale":"2024-03-04T13:00:06.681038+0000","last_undegraded":"2024-03-04T13:00:06.681038+0000","last_fullsized":"2024-03-04T13:00:06.681038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:35.204210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":263,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"256'521","reported_seq":2070,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:45.901603+0000","last_change":"2024-03-04T12:36:07.294876+0000","last_active":"2024-03-04T12:59:45.901603+0000","last_peered":"2024-03-04T12:59:45.901603+0000","last_clean":"2024-03-04T12:59:45.901603+0000","last_became_active":"2024-03-04T12:36:07.292930+0000","last_became_peered":"2024-03-04T12:36:07.292930+0000","last_unstale":"2024-03-04T12:59:45.901603+0000","last_undegraded":"2024-03-04T12:59:45.901603+0000","last_fullsized":"2024-03-04T12:59:45.901603+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:15:17.193064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2723,"num_read_kb":2502,"num_write":698,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"256'323","reported_seq":959,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.103851+0000","last_change":"2024-03-04T12:36:05.287586+0000","last_active":"2024-03-04T13:00:17.103851+0000","last_peered":"2024-03-04T13:00:17.103851+0000","last_clean":"2024-03-04T13:00:17.103851+0000","last_became_active":"2024-03-04T12:36:05.287299+0000","last_became_peered":"2024-03-04T12:36:05.287299+0000","last_unstale":"2024-03-04T13:00:17.103851+0000","last_undegraded":"2024-03-04T13:00:17.103851+0000","last_fullsized":"2024-03-04T13:00:17.103851+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:40.123883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2779056,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":31884,"num_write":1263,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"32'3","reported_seq":788,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.206991+0000","last_change":"2024-03-04T12:36:09.315302+0000","last_active":"2024-03-04T13:00:15.206991+0000","last_peered":"2024-03-04T13:00:15.206991+0000","last_clean":"2024-03-04T13:00:15.206991+0000","last_became_active":"2024-03-04T12:36:09.314810+0000","last_became_peered":"2024-03-04T12:36:09.314810+0000","last_unstale":"2024-03-04T13:00:15.206991+0000","last_undegraded":"2024-03-04T13:00:15.206991+0000","last_fullsized":"2024-03-04T13:00:15.206991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:17:00.218822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"256'245","reported_seq":789,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.364466+0000","last_change":"2024-03-04T12:36:11.324996+0000","last_active":"2024-03-04T13:00:16.364466+0000","last_peered":"2024-03-04T13:00:16.364466+0000","last_clean":"2024-03-04T13:00:16.364466+0000","last_became_active":"2024-03-04T12:36:11.323046+0000","last_became_peered":"2024-03-04T12:36:11.323046+0000","last_unstale":"2024-03-04T13:00:16.364466+0000","last_undegraded":"2024-03-04T13:00:16.364466+0000","last_fullsized":"2024-03-04T13:00:16.364466+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:10:29.009516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51487,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":943,"num_write":330,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":467,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.981601+0000","last_change":"2024-03-04T12:36:13.349171+0000","last_active":"2024-03-04T12:57:15.981601+0000","last_peered":"2024-03-04T12:57:15.981601+0000","last_clean":"2024-03-04T12:57:15.981601+0000","last_became_active":"2024-03-04T12:36:13.348696+0000","last_became_peered":"2024-03-04T12:36:13.348696+0000","last_unstale":"2024-03-04T12:57:15.981601+0000","last_undegraded":"2024-03-04T12:57:15.981601+0000","last_fullsized":"2024-03-04T12:57:15.981601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:01:19.715486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"256'83","reported_seq":554,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:20.071261+0000","last_change":"2024-03-04T12:36:15.354645+0000","last_active":"2024-03-04T12:59:20.071261+0000","last_peered":"2024-03-04T12:59:20.071261+0000","last_clean":"2024-03-04T12:59:20.071261+0000","last_became_active":"2024-03-04T12:36:15.354258+0000","last_became_peered":"2024-03-04T12:36:15.354258+0000","last_unstale":"2024-03-04T12:59:20.071261+0000","last_undegraded":"2024-03-04T12:59:20.071261+0000","last_fullsized":"2024-03-04T12:59:20.071261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:30.504574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":75,"num_write":188,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"256'355","reported_seq":1704,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.956805+0000","last_change":"2024-03-04T12:36:07.296187+0000","last_active":"2024-03-04T13:00:06.956805+0000","last_peered":"2024-03-04T13:00:06.956805+0000","last_clean":"2024-03-04T13:00:06.956805+0000","last_became_active":"2024-03-04T12:36:07.295803+0000","last_became_peered":"2024-03-04T12:36:07.295803+0000","last_unstale":"2024-03-04T13:00:06.956805+0000","last_undegraded":"2024-03-04T13:00:06.956805+0000","last_fullsized":"2024-03-04T13:00:06.956805+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:19:02.700056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1867,"num_read_kb":1777,"num_write":399,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"256'333","reported_seq":948,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.103199+0000","last_change":"2024-03-04T12:36:05.296316+0000","last_active":"2024-03-04T13:00:17.103199+0000","last_peered":"2024-03-04T13:00:17.103199+0000","last_clean":"2024-03-04T13:00:17.103199+0000","last_became_active":"2024-03-04T12:36:05.296032+0000","last_became_peered":"2024-03-04T12:36:05.296032+0000","last_unstale":"2024-03-04T13:00:17.103199+0000","last_undegraded":"2024-03-04T13:00:17.103199+0000","last_fullsized":"2024-03-04T13:00:17.103199+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:48:22.903820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2492708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":28471,"num_write":1139,"num_write_kb":37420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.980941+0000","last_change":"2024-03-04T12:36:09.312289+0000","last_active":"2024-03-04T12:57:10.980941+0000","last_peered":"2024-03-04T12:57:10.980941+0000","last_clean":"2024-03-04T12:57:10.980941+0000","last_became_active":"2024-03-04T12:36:09.311953+0000","last_became_peered":"2024-03-04T12:36:09.311953+0000","last_unstale":"2024-03-04T12:57:10.980941+0000","last_undegraded":"2024-03-04T12:57:10.980941+0000","last_fullsized":"2024-03-04T12:57:10.980941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:21:39.688491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"256'31","reported_seq":504,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.950097+0000","last_change":"2024-03-04T12:36:11.326600+0000","last_active":"2024-03-04T12:58:30.950097+0000","last_peered":"2024-03-04T12:58:30.950097+0000","last_clean":"2024-03-04T12:58:30.950097+0000","last_became_active":"2024-03-04T12:36:11.326313+0000","last_became_peered":"2024-03-04T12:36:11.326313+0000","last_unstale":"2024-03-04T12:58:30.950097+0000","last_undegraded":"2024-03-04T12:58:30.950097+0000","last_fullsized":"2024-03-04T12:58:30.950097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:52.781748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":469,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.878921+0000","last_change":"2024-03-04T12:36:13.340743+0000","last_active":"2024-03-04T12:57:15.878921+0000","last_peered":"2024-03-04T12:57:15.878921+0000","last_clean":"2024-03-04T12:57:15.878921+0000","last_became_active":"2024-03-04T12:36:13.340203+0000","last_became_peered":"2024-03-04T12:36:13.340203+0000","last_unstale":"2024-03-04T12:57:15.878921+0000","last_undegraded":"2024-03-04T12:57:15.878921+0000","last_fullsized":"2024-03-04T12:57:15.878921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:09:09.659186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"256'90","reported_seq":564,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:47.266263+0000","last_change":"2024-03-04T12:36:15.353818+0000","last_active":"2024-03-04T12:58:47.266263+0000","last_peered":"2024-03-04T12:58:47.266263+0000","last_clean":"2024-03-04T12:58:47.266263+0000","last_became_active":"2024-03-04T12:36:15.353545+0000","last_became_peered":"2024-03-04T12:36:15.353545+0000","last_unstale":"2024-03-04T12:58:47.266263+0000","last_undegraded":"2024-03-04T12:58:47.266263+0000","last_fullsized":"2024-03-04T12:58:47.266263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:10.906970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":106,"num_write":213,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"256'994","reported_seq":2543,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.899888+0000","last_change":"2024-03-04T12:36:07.300137+0000","last_active":"2024-03-04T12:59:54.899888+0000","last_peered":"2024-03-04T12:59:54.899888+0000","last_clean":"2024-03-04T12:59:54.899888+0000","last_became_active":"2024-03-04T12:36:07.299326+0000","last_became_peered":"2024-03-04T12:36:07.299326+0000","last_unstale":"2024-03-04T12:59:54.899888+0000","last_undegraded":"2024-03-04T12:59:54.899888+0000","last_fullsized":"2024-03-04T12:59:54.899888+0000","mapping_epoch":22,"log_start":"256'900","ondisk_log_start":"256'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:59:41.402010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4343,"num_read_kb":3801,"num_write":1436,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"256'322","reported_seq":960,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.102072+0000","last_change":"2024-03-04T12:36:05.287491+0000","last_active":"2024-03-04T13:00:17.102072+0000","last_peered":"2024-03-04T13:00:17.102072+0000","last_clean":"2024-03-04T13:00:17.102072+0000","last_became_active":"2024-03-04T12:36:05.287185+0000","last_became_peered":"2024-03-04T12:36:05.287185+0000","last_unstale":"2024-03-04T13:00:17.102072+0000","last_undegraded":"2024-03-04T13:00:17.102072+0000","last_fullsized":"2024-03-04T13:00:17.102072+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:44.742710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730133,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":528,"num_read_kb":7345,"num_write":1182,"num_write_kb":36636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.878079+0000","last_change":"2024-03-04T12:36:09.305577+0000","last_active":"2024-03-04T12:57:10.878079+0000","last_peered":"2024-03-04T12:57:10.878079+0000","last_clean":"2024-03-04T12:57:10.878079+0000","last_became_active":"2024-03-04T12:36:09.305288+0000","last_became_peered":"2024-03-04T12:36:09.305288+0000","last_unstale":"2024-03-04T12:57:10.878079+0000","last_undegraded":"2024-03-04T12:57:10.878079+0000","last_fullsized":"2024-03-04T12:57:10.878079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:02.570493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"256'291","reported_seq":850,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.684298+0000","last_change":"2024-03-04T12:36:11.325238+0000","last_active":"2024-03-04T13:00:15.684298+0000","last_peered":"2024-03-04T13:00:15.684298+0000","last_clean":"2024-03-04T13:00:15.684298+0000","last_became_active":"2024-03-04T12:36:11.324758+0000","last_became_peered":"2024-03-04T12:36:11.324758+0000","last_unstale":"2024-03-04T13:00:15.684298+0000","last_undegraded":"2024-03-04T13:00:15.684298+0000","last_fullsized":"2024-03-04T13:00:15.684298+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:41:09.027646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":483,"num_read_kb":1065,"num_write":390,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.987790+0000","last_change":"2024-03-04T12:36:13.345775+0000","last_active":"2024-03-04T12:57:15.987790+0000","last_peered":"2024-03-04T12:57:15.987790+0000","last_clean":"2024-03-04T12:57:15.987790+0000","last_became_active":"2024-03-04T12:36:13.345556+0000","last_became_peered":"2024-03-04T12:36:13.345556+0000","last_unstale":"2024-03-04T12:57:15.987790+0000","last_undegraded":"2024-03-04T12:57:15.987790+0000","last_fullsized":"2024-03-04T12:57:15.987790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:08.155061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"256'172","reported_seq":658,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:44.896942+0000","last_change":"2024-03-04T12:36:15.363805+0000","last_active":"2024-03-04T12:59:44.896942+0000","last_peered":"2024-03-04T12:59:44.896942+0000","last_clean":"2024-03-04T12:59:44.896942+0000","last_became_active":"2024-03-04T12:36:15.363544+0000","last_became_peered":"2024-03-04T12:36:15.363544+0000","last_unstale":"2024-03-04T12:59:44.896942+0000","last_undegraded":"2024-03-04T12:59:44.896942+0000","last_fullsized":"2024-03-04T12:59:44.896942+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:22:01.710579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":198,"num_write":386,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"256'401","reported_seq":1833,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.674646+0000","last_change":"2024-03-04T12:36:07.293124+0000","last_active":"2024-03-04T13:00:06.674646+0000","last_peered":"2024-03-04T13:00:06.674646+0000","last_clean":"2024-03-04T13:00:06.674646+0000","last_became_active":"2024-03-04T12:36:07.292814+0000","last_became_peered":"2024-03-04T12:36:07.292814+0000","last_unstale":"2024-03-04T13:00:06.674646+0000","last_undegraded":"2024-03-04T13:00:06.674646+0000","last_fullsized":"2024-03-04T13:00:06.674646+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:39.960903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2067,"num_read_kb":1953,"num_write":480,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"256'307","reported_seq":901,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.076999+0000","last_change":"2024-03-04T12:36:40.965263+0000","last_active":"2024-03-04T13:00:17.076999+0000","last_peered":"2024-03-04T13:00:17.076999+0000","last_clean":"2024-03-04T13:00:17.076999+0000","last_became_active":"2024-03-04T12:36:40.964989+0000","last_became_peered":"2024-03-04T12:36:40.964989+0000","last_unstale":"2024-03-04T13:00:17.076999+0000","last_undegraded":"2024-03-04T13:00:17.076999+0000","last_fullsized":"2024-03-04T13:00:17.076999+0000","mapping_epoch":33,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:02:05.061569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":22171,"num_write":1178,"num_write_kb":35457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:10.987012+0000","last_change":"2024-03-04T12:36:09.310197+0000","last_active":"2024-03-04T12:57:10.987012+0000","last_peered":"2024-03-04T12:57:10.987012+0000","last_clean":"2024-03-04T12:57:10.987012+0000","last_became_active":"2024-03-04T12:36:09.309883+0000","last_became_peered":"2024-03-04T12:36:09.309883+0000","last_unstale":"2024-03-04T12:57:10.987012+0000","last_undegraded":"2024-03-04T12:57:10.987012+0000","last_fullsized":"2024-03-04T12:57:10.987012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:50.413280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"256'252","reported_seq":795,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.482392+0000","last_change":"2024-03-04T12:36:11.325094+0000","last_active":"2024-03-04T13:00:15.482392+0000","last_peered":"2024-03-04T13:00:15.482392+0000","last_clean":"2024-03-04T13:00:15.482392+0000","last_became_active":"2024-03-04T12:36:11.324784+0000","last_became_peered":"2024-03-04T12:36:11.324784+0000","last_unstale":"2024-03-04T13:00:15.482392+0000","last_undegraded":"2024-03-04T13:00:15.482392+0000","last_fullsized":"2024-03-04T13:00:15.482392+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:27:03.628739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54138,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":1067,"num_write":352,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":463,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:15.998151+0000","last_change":"2024-03-04T12:36:13.343536+0000","last_active":"2024-03-04T12:57:15.998151+0000","last_peered":"2024-03-04T12:57:15.998151+0000","last_clean":"2024-03-04T12:57:15.998151+0000","last_became_active":"2024-03-04T12:36:13.343030+0000","last_became_peered":"2024-03-04T12:36:13.343030+0000","last_unstale":"2024-03-04T12:57:15.998151+0000","last_undegraded":"2024-03-04T12:57:15.998151+0000","last_fullsized":"2024-03-04T12:57:15.998151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:40.616451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"256'687","reported_seq":2134,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.015184+0000","last_change":"2024-03-04T12:36:07.298429+0000","last_active":"2024-03-04T12:59:56.015184+0000","last_peered":"2024-03-04T12:59:56.015184+0000","last_clean":"2024-03-04T12:59:56.015184+0000","last_became_active":"2024-03-04T12:36:07.298154+0000","last_became_peered":"2024-03-04T12:36:07.298154+0000","last_unstale":"2024-03-04T12:59:56.015184+0000","last_undegraded":"2024-03-04T12:59:56.015184+0000","last_fullsized":"2024-03-04T12:59:56.015184+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":600,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:51:00.776425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3209,"num_read_kb":2902,"num_write":904,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"256'315","reported_seq":1017,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.113090+0000","last_change":"2024-03-04T12:36:05.287614+0000","last_active":"2024-03-04T13:00:17.113090+0000","last_peered":"2024-03-04T13:00:17.113090+0000","last_clean":"2024-03-04T13:00:17.113090+0000","last_became_active":"2024-03-04T12:36:05.287329+0000","last_became_peered":"2024-03-04T12:36:05.287329+0000","last_unstale":"2024-03-04T13:00:17.113090+0000","last_undegraded":"2024-03-04T13:00:17.113090+0000","last_fullsized":"2024-03-04T13:00:17.113090+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:30.987377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":51334,"num_write":1200,"num_write_kb":22699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:11.005371+0000","last_change":"2024-03-04T12:36:09.307589+0000","last_active":"2024-03-04T12:58:11.005371+0000","last_peered":"2024-03-04T12:58:11.005371+0000","last_clean":"2024-03-04T12:58:11.005371+0000","last_became_active":"2024-03-04T12:36:09.307329+0000","last_became_peered":"2024-03-04T12:36:09.307329+0000","last_unstale":"2024-03-04T12:58:11.005371+0000","last_undegraded":"2024-03-04T12:58:11.005371+0000","last_fullsized":"2024-03-04T12:58:11.005371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:53:30.806037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"256'413","reported_seq":1017,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.781350+0000","last_change":"2024-03-04T12:36:11.323790+0000","last_active":"2024-03-04T13:00:16.781350+0000","last_peered":"2024-03-04T13:00:16.781350+0000","last_clean":"2024-03-04T13:00:16.781350+0000","last_became_active":"2024-03-04T12:36:11.323506+0000","last_became_peered":"2024-03-04T12:36:11.323506+0000","last_unstale":"2024-03-04T13:00:16.781350+0000","last_undegraded":"2024-03-04T13:00:16.781350+0000","last_fullsized":"2024-03-04T13:00:16.781350+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:50:55.242458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114357,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":734,"num_read_kb":1796,"num_write":592,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.983858+0000","last_change":"2024-03-04T12:36:13.346933+0000","last_active":"2024-03-04T12:56:15.983858+0000","last_peered":"2024-03-04T12:56:15.983858+0000","last_clean":"2024-03-04T12:56:15.983858+0000","last_became_active":"2024-03-04T12:36:13.346628+0000","last_became_peered":"2024-03-04T12:36:13.346628+0000","last_unstale":"2024-03-04T12:56:15.983858+0000","last_undegraded":"2024-03-04T12:56:15.983858+0000","last_fullsized":"2024-03-04T12:56:15.983858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:58:37.000939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"256'165","reported_seq":643,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:49.594745+0000","last_change":"2024-03-04T12:36:15.354834+0000","last_active":"2024-03-04T12:59:49.594745+0000","last_peered":"2024-03-04T12:59:49.594745+0000","last_clean":"2024-03-04T12:59:49.594745+0000","last_became_active":"2024-03-04T12:36:15.354125+0000","last_became_peered":"2024-03-04T12:36:15.354125+0000","last_unstale":"2024-03-04T12:59:49.594745+0000","last_undegraded":"2024-03-04T12:59:49.594745+0000","last_fullsized":"2024-03-04T12:59:49.594745+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:35:56.991813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":203,"num_write":373,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"256'1141","reported_seq":2714,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.045130+0000","last_change":"2024-03-04T12:36:07.298750+0000","last_active":"2024-03-04T12:59:53.045130+0000","last_peered":"2024-03-04T12:59:53.045130+0000","last_clean":"2024-03-04T12:59:53.045130+0000","last_became_active":"2024-03-04T12:36:07.298434+0000","last_became_peered":"2024-03-04T12:36:07.298434+0000","last_unstale":"2024-03-04T12:59:53.045130+0000","last_undegraded":"2024-03-04T12:59:53.045130+0000","last_fullsized":"2024-03-04T12:59:53.045130+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:09:16.843310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4934,"num_read_kb":4324,"num_write":1585,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"256'396","reported_seq":1039,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.121515+0000","last_change":"2024-03-04T12:36:05.287853+0000","last_active":"2024-03-04T13:00:17.121515+0000","last_peered":"2024-03-04T13:00:17.121515+0000","last_clean":"2024-03-04T13:00:17.121515+0000","last_became_active":"2024-03-04T12:36:05.287506+0000","last_became_peered":"2024-03-04T12:36:05.287506+0000","last_unstale":"2024-03-04T13:00:17.121515+0000","last_undegraded":"2024-03-04T13:00:17.121515+0000","last_fullsized":"2024-03-04T13:00:17.121515+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:32:38.606578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6658491,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":603,"num_read_kb":47023,"num_write":1149,"num_write_kb":33887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:00.985615+0000","last_change":"2024-03-04T12:36:09.309433+0000","last_active":"2024-03-04T12:57:00.985615+0000","last_peered":"2024-03-04T12:57:00.985615+0000","last_clean":"2024-03-04T12:57:00.985615+0000","last_became_active":"2024-03-04T12:36:09.309155+0000","last_became_peered":"2024-03-04T12:36:09.309155+0000","last_unstale":"2024-03-04T12:57:00.985615+0000","last_undegraded":"2024-03-04T12:57:00.985615+0000","last_fullsized":"2024-03-04T12:57:00.985615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:54:56.170543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"256'274","reported_seq":825,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.552159+0000","last_change":"2024-03-04T12:36:11.323679+0000","last_active":"2024-03-04T13:00:15.552159+0000","last_peered":"2024-03-04T13:00:15.552159+0000","last_clean":"2024-03-04T13:00:15.552159+0000","last_became_active":"2024-03-04T12:36:11.323320+0000","last_became_peered":"2024-03-04T12:36:11.323320+0000","last_unstale":"2024-03-04T13:00:15.552159+0000","last_undegraded":"2024-03-04T13:00:15.552159+0000","last_fullsized":"2024-03-04T13:00:15.552159+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:06:42.811474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44965,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":1036,"num_write":392,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":469,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.974256+0000","last_change":"2024-03-04T12:36:13.340810+0000","last_active":"2024-03-04T12:56:15.974256+0000","last_peered":"2024-03-04T12:56:15.974256+0000","last_clean":"2024-03-04T12:56:15.974256+0000","last_became_active":"2024-03-04T12:36:13.340525+0000","last_became_peered":"2024-03-04T12:36:13.340525+0000","last_unstale":"2024-03-04T12:56:15.974256+0000","last_undegraded":"2024-03-04T12:56:15.974256+0000","last_fullsized":"2024-03-04T12:56:15.974256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:06:28.640427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"256'155","reported_seq":980,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.538717+0000","last_change":"2024-03-04T12:36:15.363212+0000","last_active":"2024-03-04T13:00:07.538717+0000","last_peered":"2024-03-04T13:00:07.538717+0000","last_clean":"2024-03-04T13:00:07.538717+0000","last_became_active":"2024-03-04T12:36:15.362749+0000","last_became_peered":"2024-03-04T12:36:15.362749+0000","last_unstale":"2024-03-04T13:00:07.538717+0000","last_undegraded":"2024-03-04T13:00:07.538717+0000","last_fullsized":"2024-03-04T13:00:07.538717+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:19.493504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":549,"num_write":456,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"256'352","reported_seq":1696,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.292917+0000","last_change":"2024-03-04T12:36:07.293117+0000","last_active":"2024-03-04T12:59:48.292917+0000","last_peered":"2024-03-04T12:59:48.292917+0000","last_clean":"2024-03-04T12:59:48.292917+0000","last_became_active":"2024-03-04T12:36:07.292806+0000","last_became_peered":"2024-03-04T12:36:07.292806+0000","last_unstale":"2024-03-04T12:59:48.292917+0000","last_undegraded":"2024-03-04T12:59:48.292917+0000","last_fullsized":"2024-03-04T12:59:48.292917+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:31.918878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1929,"num_read_kb":1816,"num_write":430,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"256'316","reported_seq":952,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.125884+0000","last_change":"2024-03-04T12:36:05.289335+0000","last_active":"2024-03-04T13:00:17.125884+0000","last_peered":"2024-03-04T13:00:17.125884+0000","last_clean":"2024-03-04T13:00:17.125884+0000","last_became_active":"2024-03-04T12:36:05.289053+0000","last_became_peered":"2024-03-04T12:36:05.289053+0000","last_unstale":"2024-03-04T13:00:17.125884+0000","last_undegraded":"2024-03-04T13:00:17.125884+0000","last_fullsized":"2024-03-04T13:00:17.125884+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:54.563075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2688993,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":60644,"num_write":1189,"num_write_kb":49301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.983196+0000","last_change":"2024-03-04T12:36:09.308491+0000","last_active":"2024-03-04T12:56:10.983196+0000","last_peered":"2024-03-04T12:56:10.983196+0000","last_clean":"2024-03-04T12:56:10.983196+0000","last_became_active":"2024-03-04T12:36:09.308231+0000","last_became_peered":"2024-03-04T12:36:09.308231+0000","last_unstale":"2024-03-04T12:56:10.983196+0000","last_undegraded":"2024-03-04T12:56:10.983196+0000","last_fullsized":"2024-03-04T12:56:10.983196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:10:29.969171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"256'276","reported_seq":821,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.607215+0000","last_change":"2024-03-04T12:36:11.954917+0000","last_active":"2024-03-04T13:00:16.607215+0000","last_peered":"2024-03-04T13:00:16.607215+0000","last_clean":"2024-03-04T13:00:16.607215+0000","last_became_active":"2024-03-04T12:36:11.954568+0000","last_became_peered":"2024-03-04T12:36:11.954568+0000","last_unstale":"2024-03-04T13:00:16.607215+0000","last_undegraded":"2024-03-04T13:00:16.607215+0000","last_fullsized":"2024-03-04T13:00:16.607215+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:56:56.500891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47143,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":469,"num_read_kb":1144,"num_write":392,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:15.988694+0000","last_change":"2024-03-04T12:36:13.346950+0000","last_active":"2024-03-04T12:58:15.988694+0000","last_peered":"2024-03-04T12:58:15.988694+0000","last_clean":"2024-03-04T12:58:15.988694+0000","last_became_active":"2024-03-04T12:36:13.346665+0000","last_became_peered":"2024-03-04T12:36:13.346665+0000","last_unstale":"2024-03-04T12:58:15.988694+0000","last_undegraded":"2024-03-04T12:58:15.988694+0000","last_fullsized":"2024-03-04T12:58:15.988694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:14.332069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'103","reported_seq":567,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.702492+0000","last_change":"2024-03-04T12:36:15.364059+0000","last_active":"2024-03-04T13:00:08.702492+0000","last_peered":"2024-03-04T13:00:08.702492+0000","last_clean":"2024-03-04T13:00:08.702492+0000","last_became_active":"2024-03-04T12:36:15.363269+0000","last_became_peered":"2024-03-04T12:36:15.363269+0000","last_unstale":"2024-03-04T13:00:08.702492+0000","last_undegraded":"2024-03-04T13:00:08.702492+0000","last_fullsized":"2024-03-04T13:00:08.702492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:56.078288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"256'427","reported_seq":1936,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.685753+0000","last_change":"2024-03-04T12:36:07.296189+0000","last_active":"2024-03-04T13:00:06.685753+0000","last_peered":"2024-03-04T13:00:06.685753+0000","last_clean":"2024-03-04T13:00:06.685753+0000","last_became_active":"2024-03-04T12:36:07.295353+0000","last_became_peered":"2024-03-04T12:36:07.295353+0000","last_unstale":"2024-03-04T13:00:06.685753+0000","last_undegraded":"2024-03-04T13:00:06.685753+0000","last_fullsized":"2024-03-04T13:00:06.685753+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:59:38.626041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2362,"num_read_kb":2211,"num_write":524,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"256'511","reported_seq":1157,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.106072+0000","last_change":"2024-03-04T12:36:05.293958+0000","last_active":"2024-03-04T13:00:17.106072+0000","last_peered":"2024-03-04T13:00:17.106072+0000","last_clean":"2024-03-04T13:00:17.106072+0000","last_became_active":"2024-03-04T12:36:05.293646+0000","last_became_peered":"2024-03-04T12:36:05.293646+0000","last_unstale":"2024-03-04T13:00:17.106072+0000","last_undegraded":"2024-03-04T13:00:17.106072+0000","last_fullsized":"2024-03-04T13:00:17.106072+0000","mapping_epoch":20,"log_start":"256'500","ondisk_log_start":"256'500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:32:24.040601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242951,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":853,"num_read_kb":46890,"num_write":1453,"num_write_kb":44359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.973688+0000","last_change":"2024-03-04T12:36:09.305622+0000","last_active":"2024-03-04T12:56:10.973688+0000","last_peered":"2024-03-04T12:56:10.973688+0000","last_clean":"2024-03-04T12:56:10.973688+0000","last_became_active":"2024-03-04T12:36:09.305073+0000","last_became_peered":"2024-03-04T12:36:09.305073+0000","last_unstale":"2024-03-04T12:56:10.973688+0000","last_undegraded":"2024-03-04T12:56:10.973688+0000","last_fullsized":"2024-03-04T12:56:10.973688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:49.014929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"256'63","reported_seq":556,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:42.294211+0000","last_change":"2024-03-04T12:36:11.955268+0000","last_active":"2024-03-04T12:58:42.294211+0000","last_peered":"2024-03-04T12:58:42.294211+0000","last_clean":"2024-03-04T12:58:42.294211+0000","last_became_active":"2024-03-04T12:36:11.954563+0000","last_became_peered":"2024-03-04T12:36:11.954563+0000","last_unstale":"2024-03-04T12:58:42.294211+0000","last_undegraded":"2024-03-04T12:58:42.294211+0000","last_fullsized":"2024-03-04T12:58:42.294211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:42:13.043294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":71,"num_read_kb":64,"num_write":78,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"256'482","reported_seq":1807,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.234823+0000","last_change":"2024-03-04T12:36:13.340544+0000","last_active":"2024-03-04T13:00:15.234823+0000","last_peered":"2024-03-04T13:00:15.234823+0000","last_clean":"2024-03-04T13:00:15.234823+0000","last_became_active":"2024-03-04T12:36:13.340221+0000","last_became_peered":"2024-03-04T12:36:13.340221+0000","last_unstale":"2024-03-04T13:00:15.234823+0000","last_undegraded":"2024-03-04T13:00:15.234823+0000","last_fullsized":"2024-03-04T13:00:15.234823+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:34.550746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"256'132","reported_seq":606,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.133500+0000","last_change":"2024-03-04T12:36:15.364987+0000","last_active":"2024-03-04T12:59:50.133500+0000","last_peered":"2024-03-04T12:59:50.133500+0000","last_clean":"2024-03-04T12:59:50.133500+0000","last_became_active":"2024-03-04T12:36:15.364688+0000","last_became_peered":"2024-03-04T12:36:15.364688+0000","last_unstale":"2024-03-04T12:59:50.133500+0000","last_undegraded":"2024-03-04T12:59:50.133500+0000","last_fullsized":"2024-03-04T12:59:50.133500+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:22.015151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":294,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"256'357","reported_seq":1820,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.904913+0000","last_change":"2024-03-04T12:36:07.291346+0000","last_active":"2024-03-04T12:59:54.904913+0000","last_peered":"2024-03-04T12:59:54.904913+0000","last_clean":"2024-03-04T12:59:54.904913+0000","last_became_active":"2024-03-04T12:36:07.290637+0000","last_became_peered":"2024-03-04T12:36:07.290637+0000","last_unstale":"2024-03-04T12:59:54.904913+0000","last_undegraded":"2024-03-04T12:59:54.904913+0000","last_fullsized":"2024-03-04T12:59:54.904913+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:40:51.943588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1998,"num_read_kb":1913,"num_write":399,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"256'421","reported_seq":1074,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.112466+0000","last_change":"2024-03-04T12:36:05.294852+0000","last_active":"2024-03-04T13:00:17.112466+0000","last_peered":"2024-03-04T13:00:17.112466+0000","last_clean":"2024-03-04T13:00:17.112466+0000","last_became_active":"2024-03-04T12:36:05.294568+0000","last_became_peered":"2024-03-04T12:36:05.294568+0000","last_unstale":"2024-03-04T13:00:17.112466+0000","last_undegraded":"2024-03-04T13:00:17.112466+0000","last_fullsized":"2024-03-04T13:00:17.112466+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:30:30.652308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6680724,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":37257,"num_write":1366,"num_write_kb":50791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.869484+0000","last_change":"2024-03-04T12:36:09.306310+0000","last_active":"2024-03-04T12:56:10.869484+0000","last_peered":"2024-03-04T12:56:10.869484+0000","last_clean":"2024-03-04T12:56:10.869484+0000","last_became_active":"2024-03-04T12:36:09.306005+0000","last_became_peered":"2024-03-04T12:36:09.306005+0000","last_unstale":"2024-03-04T12:56:10.869484+0000","last_undegraded":"2024-03-04T12:56:10.869484+0000","last_fullsized":"2024-03-04T12:56:10.869484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:36:38.545939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"256'272","reported_seq":821,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.961411+0000","last_change":"2024-03-04T12:36:11.325797+0000","last_active":"2024-03-04T13:00:16.961411+0000","last_peered":"2024-03-04T13:00:16.961411+0000","last_clean":"2024-03-04T13:00:16.961411+0000","last_became_active":"2024-03-04T12:36:11.325503+0000","last_became_peered":"2024-03-04T12:36:11.325503+0000","last_unstale":"2024-03-04T13:00:16.961411+0000","last_undegraded":"2024-03-04T13:00:16.961411+0000","last_fullsized":"2024-03-04T13:00:16.961411+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:37.864953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52232,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":458,"num_read_kb":1083,"num_write":374,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":462,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.986011+0000","last_change":"2024-03-04T12:36:13.339697+0000","last_active":"2024-03-04T12:55:35.986011+0000","last_peered":"2024-03-04T12:55:35.986011+0000","last_clean":"2024-03-04T12:55:35.986011+0000","last_became_active":"2024-03-04T12:36:13.339349+0000","last_became_peered":"2024-03-04T12:36:13.339349+0000","last_unstale":"2024-03-04T12:55:35.986011+0000","last_undegraded":"2024-03-04T12:55:35.986011+0000","last_fullsized":"2024-03-04T12:55:35.986011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:58:11.712690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"256'111","reported_seq":637,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:11.247234+0000","last_change":"2024-03-04T12:36:15.352689+0000","last_active":"2024-03-04T12:59:11.247234+0000","last_peered":"2024-03-04T12:59:11.247234+0000","last_clean":"2024-03-04T12:59:11.247234+0000","last_became_active":"2024-03-04T12:36:15.352383+0000","last_became_peered":"2024-03-04T12:36:15.352383+0000","last_unstale":"2024-03-04T12:59:11.247234+0000","last_undegraded":"2024-03-04T12:59:11.247234+0000","last_fullsized":"2024-03-04T12:59:11.247234+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:10:26.974662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":264,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"256'405","reported_seq":1774,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.045644+0000","last_change":"2024-03-04T12:36:07.296237+0000","last_active":"2024-03-04T12:59:56.045644+0000","last_peered":"2024-03-04T12:59:56.045644+0000","last_clean":"2024-03-04T12:59:56.045644+0000","last_became_active":"2024-03-04T12:36:07.295956+0000","last_became_peered":"2024-03-04T12:36:07.295956+0000","last_unstale":"2024-03-04T12:59:56.045644+0000","last_undegraded":"2024-03-04T12:59:56.045644+0000","last_fullsized":"2024-03-04T12:59:56.045644+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:07.889506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2057,"num_read_kb":1911,"num_write":497,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"256'290","reported_seq":882,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.125770+0000","last_change":"2024-03-04T12:36:05.294942+0000","last_active":"2024-03-04T13:00:17.125770+0000","last_peered":"2024-03-04T13:00:17.125770+0000","last_clean":"2024-03-04T13:00:17.125770+0000","last_became_active":"2024-03-04T12:36:05.294686+0000","last_became_peered":"2024-03-04T12:36:05.294686+0000","last_unstale":"2024-03-04T13:00:17.125770+0000","last_undegraded":"2024-03-04T13:00:17.125770+0000","last_fullsized":"2024-03-04T13:00:17.125770+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:40:07.056496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":38414,"num_write":1001,"num_write_kb":48852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:10.983094+0000","last_change":"2024-03-04T12:36:09.315306+0000","last_active":"2024-03-04T12:56:10.983094+0000","last_peered":"2024-03-04T12:56:10.983094+0000","last_clean":"2024-03-04T12:56:10.983094+0000","last_became_active":"2024-03-04T12:36:09.314912+0000","last_became_peered":"2024-03-04T12:36:09.314912+0000","last_unstale":"2024-03-04T12:56:10.983094+0000","last_undegraded":"2024-03-04T12:56:10.983094+0000","last_fullsized":"2024-03-04T12:56:10.983094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:28.512512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"256'265","reported_seq":802,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.996619+0000","last_change":"2024-03-04T12:36:11.325501+0000","last_active":"2024-03-04T13:00:16.996619+0000","last_peered":"2024-03-04T13:00:16.996619+0000","last_clean":"2024-03-04T13:00:16.996619+0000","last_became_active":"2024-03-04T12:36:11.325238+0000","last_became_peered":"2024-03-04T12:36:11.325238+0000","last_unstale":"2024-03-04T13:00:16.996619+0000","last_undegraded":"2024-03-04T13:00:16.996619+0000","last_fullsized":"2024-03-04T13:00:16.996619+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:52:12.180477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45924,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1039,"num_write":360,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:55:35.974979+0000","last_change":"2024-03-04T12:36:13.341948+0000","last_active":"2024-03-04T12:55:35.974979+0000","last_peered":"2024-03-04T12:55:35.974979+0000","last_clean":"2024-03-04T12:55:35.974979+0000","last_became_active":"2024-03-04T12:36:13.341689+0000","last_became_peered":"2024-03-04T12:36:13.341689+0000","last_unstale":"2024-03-04T12:55:35.974979+0000","last_undegraded":"2024-03-04T12:55:35.974979+0000","last_fullsized":"2024-03-04T12:55:35.974979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:02:47.747861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"256'98","reported_seq":590,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:37.800761+0000","last_change":"2024-03-04T12:36:15.353744+0000","last_active":"2024-03-04T12:59:37.800761+0000","last_peered":"2024-03-04T12:59:37.800761+0000","last_clean":"2024-03-04T12:59:37.800761+0000","last_became_active":"2024-03-04T12:36:15.353418+0000","last_became_peered":"2024-03-04T12:36:15.353418+0000","last_unstale":"2024-03-04T12:59:37.800761+0000","last_undegraded":"2024-03-04T12:59:37.800761+0000","last_fullsized":"2024-03-04T12:59:37.800761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:31:22.073567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"256'1443","reported_seq":2775,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:34.672308+0000","last_change":"2024-03-04T12:36:07.300609+0000","last_active":"2024-03-04T12:59:34.672308+0000","last_peered":"2024-03-04T12:59:34.672308+0000","last_clean":"2024-03-04T12:59:34.672308+0000","last_became_active":"2024-03-04T12:36:07.300067+0000","last_became_peered":"2024-03-04T12:36:07.300067+0000","last_unstale":"2024-03-04T12:59:34.672308+0000","last_undegraded":"2024-03-04T12:59:34.672308+0000","last_fullsized":"2024-03-04T12:59:34.672308+0000","mapping_epoch":22,"log_start":"256'1400","ondisk_log_start":"256'1400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:54:29.408852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5752,"num_read_kb":4912,"num_write":2067,"num_write_kb":923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"256'381","reported_seq":1037,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.091844+0000","last_change":"2024-03-04T12:36:05.284059+0000","last_active":"2024-03-04T13:00:17.091844+0000","last_peered":"2024-03-04T13:00:17.091844+0000","last_clean":"2024-03-04T13:00:17.091844+0000","last_became_active":"2024-03-04T12:36:05.283142+0000","last_became_peered":"2024-03-04T12:36:05.283142+0000","last_unstale":"2024-03-04T13:00:17.091844+0000","last_undegraded":"2024-03-04T13:00:17.091844+0000","last_fullsized":"2024-03-04T13:00:17.091844+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:42:53.872503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":1440,"num_write":1747,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:56.000917+0000","last_change":"2024-03-04T12:36:09.305585+0000","last_active":"2024-03-04T12:57:56.000917+0000","last_peered":"2024-03-04T12:57:56.000917+0000","last_clean":"2024-03-04T12:57:56.000917+0000","last_became_active":"2024-03-04T12:36:09.305182+0000","last_became_peered":"2024-03-04T12:36:09.305182+0000","last_unstale":"2024-03-04T12:57:56.000917+0000","last_undegraded":"2024-03-04T12:57:56.000917+0000","last_fullsized":"2024-03-04T12:57:56.000917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:08:29.761455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"256'238","reported_seq":772,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.489608+0000","last_change":"2024-03-04T12:36:11.324706+0000","last_active":"2024-03-04T13:00:16.489608+0000","last_peered":"2024-03-04T13:00:16.489608+0000","last_clean":"2024-03-04T13:00:16.489608+0000","last_became_active":"2024-03-04T12:36:11.324394+0000","last_became_peered":"2024-03-04T12:36:11.324394+0000","last_unstale":"2024-03-04T13:00:16.489608+0000","last_undegraded":"2024-03-04T13:00:16.489608+0000","last_fullsized":"2024-03-04T13:00:16.489608+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:55.889459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":411,"num_read_kb":1022,"num_write":344,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":471,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.983889+0000","last_change":"2024-03-04T12:36:13.341181+0000","last_active":"2024-03-04T12:56:15.983889+0000","last_peered":"2024-03-04T12:56:15.983889+0000","last_clean":"2024-03-04T12:56:15.983889+0000","last_became_active":"2024-03-04T12:36:13.340897+0000","last_became_peered":"2024-03-04T12:36:13.340897+0000","last_unstale":"2024-03-04T12:56:15.983889+0000","last_undegraded":"2024-03-04T12:56:15.983889+0000","last_fullsized":"2024-03-04T12:56:15.983889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:02:05.268444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"256'169","reported_seq":1167,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.492529+0000","last_change":"2024-03-04T12:36:15.357808+0000","last_active":"2024-03-04T13:00:07.492529+0000","last_peered":"2024-03-04T13:00:07.492529+0000","last_clean":"2024-03-04T13:00:07.492529+0000","last_became_active":"2024-03-04T12:36:15.357141+0000","last_became_peered":"2024-03-04T12:36:15.357141+0000","last_unstale":"2024-03-04T13:00:07.492529+0000","last_undegraded":"2024-03-04T13:00:07.492529+0000","last_fullsized":"2024-03-04T13:00:07.492529+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:59:35.782871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":655,"num_read_kb":655,"num_write":360,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"256'1105","reported_seq":2588,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.033247+0000","last_change":"2024-03-04T12:36:07.291118+0000","last_active":"2024-03-04T12:59:54.033247+0000","last_peered":"2024-03-04T12:59:54.033247+0000","last_clean":"2024-03-04T12:59:54.033247+0000","last_became_active":"2024-03-04T12:36:07.290820+0000","last_became_peered":"2024-03-04T12:36:07.290820+0000","last_unstale":"2024-03-04T12:59:54.033247+0000","last_undegraded":"2024-03-04T12:59:54.033247+0000","last_fullsized":"2024-03-04T12:59:54.033247+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:04.696551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4641,"num_read_kb":4049,"num_write":1526,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"256'314","reported_seq":981,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.056173+0000","last_change":"2024-03-04T12:36:05.290216+0000","last_active":"2024-03-04T13:00:17.056173+0000","last_peered":"2024-03-04T13:00:17.056173+0000","last_clean":"2024-03-04T13:00:17.056173+0000","last_became_active":"2024-03-04T12:36:05.289897+0000","last_became_peered":"2024-03-04T12:36:05.289897+0000","last_unstale":"2024-03-04T13:00:17.056173+0000","last_undegraded":"2024-03-04T13:00:17.056173+0000","last_fullsized":"2024-03-04T13:00:17.056173+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:29.554222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525438,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":585,"num_read_kb":14927,"num_write":1035,"num_write_kb":32177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:57:55.986471+0000","last_change":"2024-03-04T12:36:09.311068+0000","last_active":"2024-03-04T12:57:55.986471+0000","last_peered":"2024-03-04T12:57:55.986471+0000","last_clean":"2024-03-04T12:57:55.986471+0000","last_became_active":"2024-03-04T12:36:09.310855+0000","last_became_peered":"2024-03-04T12:36:09.310855+0000","last_unstale":"2024-03-04T12:57:55.986471+0000","last_undegraded":"2024-03-04T12:57:55.986471+0000","last_fullsized":"2024-03-04T12:57:55.986471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:22.965213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"256'266","reported_seq":826,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.667750+0000","last_change":"2024-03-04T12:36:11.323707+0000","last_active":"2024-03-04T13:00:16.667750+0000","last_peered":"2024-03-04T13:00:16.667750+0000","last_clean":"2024-03-04T13:00:16.667750+0000","last_became_active":"2024-03-04T12:36:11.323352+0000","last_became_peered":"2024-03-04T12:36:11.323352+0000","last_unstale":"2024-03-04T13:00:16.667750+0000","last_undegraded":"2024-03-04T13:00:16.667750+0000","last_fullsized":"2024-03-04T13:00:16.667750+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:15.465595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":1008,"num_write":350,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":462,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:56:15.990494+0000","last_change":"2024-03-04T12:36:13.343303+0000","last_active":"2024-03-04T12:56:15.990494+0000","last_peered":"2024-03-04T12:56:15.990494+0000","last_clean":"2024-03-04T12:56:15.990494+0000","last_became_active":"2024-03-04T12:36:13.342656+0000","last_became_peered":"2024-03-04T12:36:13.342656+0000","last_unstale":"2024-03-04T12:56:15.990494+0000","last_undegraded":"2024-03-04T12:56:15.990494+0000","last_fullsized":"2024-03-04T12:56:15.990494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:43.617222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"256'102","reported_seq":575,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:36.553742+0000","last_change":"2024-03-04T12:36:15.352666+0000","last_active":"2024-03-04T12:59:36.553742+0000","last_peered":"2024-03-04T12:59:36.553742+0000","last_clean":"2024-03-04T12:59:36.553742+0000","last_became_active":"2024-03-04T12:36:15.352333+0000","last_became_peered":"2024-03-04T12:36:15.352333+0000","last_unstale":"2024-03-04T12:59:36.553742+0000","last_undegraded":"2024-03-04T12:59:36.553742+0000","last_fullsized":"2024-03-04T12:59:36.553742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:36.600244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":93,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"256'392","reported_seq":1887,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.047579+0000","last_change":"2024-03-04T12:36:07.298617+0000","last_active":"2024-03-04T12:59:53.047579+0000","last_peered":"2024-03-04T12:59:53.047579+0000","last_clean":"2024-03-04T12:59:53.047579+0000","last_became_active":"2024-03-04T12:36:07.297660+0000","last_became_peered":"2024-03-04T12:36:07.297660+0000","last_unstale":"2024-03-04T12:59:53.047579+0000","last_undegraded":"2024-03-04T12:59:53.047579+0000","last_fullsized":"2024-03-04T12:59:53.047579+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:32.101783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":478,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"256'271","reported_seq":856,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.106560+0000","last_change":"2024-03-04T12:36:05.279913+0000","last_active":"2024-03-04T13:00:17.106560+0000","last_peered":"2024-03-04T13:00:17.106560+0000","last_clean":"2024-03-04T13:00:17.106560+0000","last_became_active":"2024-03-04T12:36:05.279576+0000","last_became_peered":"2024-03-04T12:36:05.279576+0000","last_unstale":"2024-03-04T13:00:17.106560+0000","last_undegraded":"2024-03-04T13:00:17.106560+0000","last_fullsized":"2024-03-04T13:00:17.106560+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:18.604604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5591378,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":375,"num_read_kb":32300,"num_write":1079,"num_write_kb":15765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"256'425","reported_seq":1850,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.047677+0000","last_change":"2024-03-04T12:36:07.300437+0000","last_active":"2024-03-04T12:59:53.047677+0000","last_peered":"2024-03-04T12:59:53.047677+0000","last_clean":"2024-03-04T12:59:53.047677+0000","last_became_active":"2024-03-04T12:36:07.300168+0000","last_became_peered":"2024-03-04T12:36:07.300168+0000","last_unstale":"2024-03-04T12:59:53.047677+0000","last_undegraded":"2024-03-04T12:59:53.047677+0000","last_fullsized":"2024-03-04T12:59:53.047677+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:16.225236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2082,"num_write":535,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"256'307","reported_seq":923,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.102342+0000","last_change":"2024-03-04T12:36:05.287650+0000","last_active":"2024-03-04T13:00:17.102342+0000","last_peered":"2024-03-04T13:00:17.102342+0000","last_clean":"2024-03-04T13:00:17.102342+0000","last_became_active":"2024-03-04T12:36:05.287233+0000","last_became_peered":"2024-03-04T12:36:05.287233+0000","last_unstale":"2024-03-04T13:00:17.102342+0000","last_undegraded":"2024-03-04T13:00:17.102342+0000","last_fullsized":"2024-03-04T13:00:17.102342+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:20:52.908914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1355534,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":467,"num_read_kb":46552,"num_write":1196,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"256'338","reported_seq":1830,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.139327+0000","last_change":"2024-03-04T12:36:07.296382+0000","last_active":"2024-03-04T12:59:50.139327+0000","last_peered":"2024-03-04T12:59:50.139327+0000","last_clean":"2024-03-04T12:59:50.139327+0000","last_became_active":"2024-03-04T12:36:07.296104+0000","last_became_peered":"2024-03-04T12:36:07.296104+0000","last_unstale":"2024-03-04T12:59:50.139327+0000","last_undegraded":"2024-03-04T12:59:50.139327+0000","last_fullsized":"2024-03-04T12:59:50.139327+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:56.868284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1942,"num_read_kb":1888,"num_write":368,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"256'341","reported_seq":961,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.085251+0000","last_change":"2024-03-04T12:36:41.075779+0000","last_active":"2024-03-04T13:00:17.085251+0000","last_peered":"2024-03-04T13:00:17.085251+0000","last_clean":"2024-03-04T13:00:17.085251+0000","last_became_active":"2024-03-04T12:36:41.075381+0000","last_became_peered":"2024-03-04T12:36:41.075381+0000","last_unstale":"2024-03-04T13:00:17.085251+0000","last_undegraded":"2024-03-04T13:00:17.085251+0000","last_fullsized":"2024-03-04T13:00:17.085251+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:58.826959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8448064,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":52899,"num_write":1289,"num_write_kb":57282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"256'1024","reported_seq":2573,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.027302+0000","last_change":"2024-03-04T12:36:07.299735+0000","last_active":"2024-03-04T12:59:56.027302+0000","last_peered":"2024-03-04T12:59:56.027302+0000","last_clean":"2024-03-04T12:59:56.027302+0000","last_became_active":"2024-03-04T12:36:07.299282+0000","last_became_peered":"2024-03-04T12:36:07.299282+0000","last_unstale":"2024-03-04T12:59:56.027302+0000","last_undegraded":"2024-03-04T12:59:56.027302+0000","last_fullsized":"2024-03-04T12:59:56.027302+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:42:39.813252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4484,"num_read_kb":3892,"num_write":1521,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"256'291","reported_seq":943,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.098214+0000","last_change":"2024-03-04T12:36:05.283738+0000","last_active":"2024-03-04T13:00:17.098214+0000","last_peered":"2024-03-04T13:00:17.098214+0000","last_clean":"2024-03-04T13:00:17.098214+0000","last_became_active":"2024-03-04T12:36:05.283327+0000","last_became_peered":"2024-03-04T12:36:05.283327+0000","last_unstale":"2024-03-04T13:00:17.098214+0000","last_undegraded":"2024-03-04T13:00:17.098214+0000","last_fullsized":"2024-03-04T13:00:17.098214+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:26:39.224528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6002849,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":66598,"num_write":994,"num_write_kb":37083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"256'426","reported_seq":1880,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671263+0000","last_change":"2024-03-04T12:36:07.293252+0000","last_active":"2024-03-04T13:00:06.671263+0000","last_peered":"2024-03-04T13:00:06.671263+0000","last_clean":"2024-03-04T13:00:06.671263+0000","last_became_active":"2024-03-04T12:36:07.292950+0000","last_became_peered":"2024-03-04T12:36:07.292950+0000","last_unstale":"2024-03-04T13:00:06.671263+0000","last_undegraded":"2024-03-04T13:00:06.671263+0000","last_fullsized":"2024-03-04T13:00:06.671263+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:57:06.362966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2086,"num_write":515,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"256'283","reported_seq":897,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.083426+0000","last_change":"2024-03-04T12:36:05.287013+0000","last_active":"2024-03-04T13:00:17.083426+0000","last_peered":"2024-03-04T13:00:17.083426+0000","last_clean":"2024-03-04T13:00:17.083426+0000","last_became_active":"2024-03-04T12:36:05.286745+0000","last_became_peered":"2024-03-04T12:36:05.286745+0000","last_unstale":"2024-03-04T13:00:17.083426+0000","last_undegraded":"2024-03-04T13:00:17.083426+0000","last_fullsized":"2024-03-04T13:00:17.083426+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:28.246766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":38207,"num_write":1041,"num_write_kb":19360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"256'355","reported_seq":1889,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.837911+0000","last_change":"2024-03-04T12:36:07.291981+0000","last_active":"2024-03-04T12:59:48.837911+0000","last_peered":"2024-03-04T12:59:48.837911+0000","last_clean":"2024-03-04T12:59:48.837911+0000","last_became_active":"2024-03-04T12:36:07.291690+0000","last_became_peered":"2024-03-04T12:36:07.291690+0000","last_unstale":"2024-03-04T12:59:48.837911+0000","last_undegraded":"2024-03-04T12:59:48.837911+0000","last_fullsized":"2024-03-04T12:59:48.837911+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:27:20.656871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2163,"num_read_kb":2091,"num_write":400,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"256'296","reported_seq":913,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.081319+0000","last_change":"2024-03-04T12:36:05.287869+0000","last_active":"2024-03-04T13:00:17.081319+0000","last_peered":"2024-03-04T13:00:17.081319+0000","last_clean":"2024-03-04T13:00:17.081319+0000","last_became_active":"2024-03-04T12:36:05.287529+0000","last_became_peered":"2024-03-04T12:36:05.287529+0000","last_unstale":"2024-03-04T13:00:17.081319+0000","last_undegraded":"2024-03-04T13:00:17.081319+0000","last_fullsized":"2024-03-04T13:00:17.081319+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:48.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":37296,"num_write":1090,"num_write_kb":36513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"256'739","reported_seq":2222,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.017452+0000","last_change":"2024-03-04T12:36:07.300374+0000","last_active":"2024-03-04T12:59:56.017452+0000","last_peered":"2024-03-04T12:59:56.017452+0000","last_clean":"2024-03-04T12:59:56.017452+0000","last_became_active":"2024-03-04T12:36:07.299881+0000","last_became_peered":"2024-03-04T12:36:07.299881+0000","last_unstale":"2024-03-04T12:59:56.017452+0000","last_undegraded":"2024-03-04T12:59:56.017452+0000","last_fullsized":"2024-03-04T12:59:56.017452+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:55:08.815424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3309,"num_read_kb":2983,"num_write":974,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"256'324","reported_seq":948,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.092446+0000","last_change":"2024-03-04T12:36:05.286690+0000","last_active":"2024-03-04T13:00:17.092446+0000","last_peered":"2024-03-04T13:00:17.092446+0000","last_clean":"2024-03-04T13:00:17.092446+0000","last_became_active":"2024-03-04T12:36:05.286397+0000","last_became_peered":"2024-03-04T12:36:05.286397+0000","last_unstale":"2024-03-04T13:00:17.092446+0000","last_undegraded":"2024-03-04T13:00:17.092446+0000","last_fullsized":"2024-03-04T13:00:17.092446+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:20:08.942318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472549,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":459,"num_read_kb":103287,"num_write":1220,"num_write_kb":47023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"256'475","reported_seq":2071,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.610564+0000","last_change":"2024-03-04T12:36:07.292858+0000","last_active":"2024-03-04T12:59:47.610564+0000","last_peered":"2024-03-04T12:59:47.610564+0000","last_clean":"2024-03-04T12:59:47.610564+0000","last_became_active":"2024-03-04T12:36:07.292501+0000","last_became_peered":"2024-03-04T12:36:07.292501+0000","last_unstale":"2024-03-04T12:59:47.610564+0000","last_undegraded":"2024-03-04T12:59:47.610564+0000","last_fullsized":"2024-03-04T12:59:47.610564+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:35.770287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2330,"num_write":558,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"256'323","reported_seq":920,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.054206+0000","last_change":"2024-03-04T12:36:05.294285+0000","last_active":"2024-03-04T13:00:17.054206+0000","last_peered":"2024-03-04T13:00:17.054206+0000","last_clean":"2024-03-04T13:00:17.054206+0000","last_became_active":"2024-03-04T12:36:05.294007+0000","last_became_peered":"2024-03-04T12:36:05.294007+0000","last_unstale":"2024-03-04T13:00:17.054206+0000","last_undegraded":"2024-03-04T13:00:17.054206+0000","last_fullsized":"2024-03-04T13:00:17.054206+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:06.848739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":23598,"num_write":1193,"num_write_kb":28139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"256'446","reported_seq":1957,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.468689+0000","last_change":"2024-03-04T12:36:07.294584+0000","last_active":"2024-03-04T12:59:55.468689+0000","last_peered":"2024-03-04T12:59:55.468689+0000","last_clean":"2024-03-04T12:59:55.468689+0000","last_became_active":"2024-03-04T12:36:07.294283+0000","last_became_peered":"2024-03-04T12:36:07.294283+0000","last_unstale":"2024-03-04T12:59:55.468689+0000","last_undegraded":"2024-03-04T12:59:55.468689+0000","last_fullsized":"2024-03-04T12:59:55.468689+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:44:00.573776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2476,"num_read_kb":2316,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"256'339","reported_seq":952,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.123826+0000","last_change":"2024-03-04T12:36:05.290249+0000","last_active":"2024-03-04T13:00:17.123826+0000","last_peered":"2024-03-04T13:00:17.123826+0000","last_clean":"2024-03-04T13:00:17.123826+0000","last_became_active":"2024-03-04T12:36:05.289882+0000","last_became_peered":"2024-03-04T12:36:05.289882+0000","last_unstale":"2024-03-04T13:00:17.123826+0000","last_undegraded":"2024-03-04T13:00:17.123826+0000","last_fullsized":"2024-03-04T13:00:17.123826+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:30.035250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":35092,"num_write":1098,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"256'454","reported_seq":1937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.671932+0000","last_change":"2024-03-04T12:36:07.294765+0000","last_active":"2024-03-04T13:00:06.671932+0000","last_peered":"2024-03-04T13:00:06.671932+0000","last_clean":"2024-03-04T13:00:06.671932+0000","last_became_active":"2024-03-04T12:36:07.292904+0000","last_became_peered":"2024-03-04T12:36:07.292904+0000","last_unstale":"2024-03-04T13:00:06.671932+0000","last_undegraded":"2024-03-04T13:00:06.671932+0000","last_fullsized":"2024-03-04T13:00:06.671932+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:02.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2160,"num_write":550,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"256'305","reported_seq":891,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.043759+0000","last_change":"2024-03-04T12:36:05.294662+0000","last_active":"2024-03-04T13:00:17.043759+0000","last_peered":"2024-03-04T13:00:17.043759+0000","last_clean":"2024-03-04T13:00:17.043759+0000","last_became_active":"2024-03-04T12:36:05.294338+0000","last_became_peered":"2024-03-04T12:36:05.294338+0000","last_unstale":"2024-03-04T13:00:17.043759+0000","last_undegraded":"2024-03-04T13:00:17.043759+0000","last_fullsized":"2024-03-04T13:00:17.043759+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:09.803465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263242,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":434,"num_read_kb":2630,"num_write":1136,"num_write_kb":25999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"256'1251","reported_seq":2837,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.468793+0000","last_change":"2024-03-04T12:36:07.292610+0000","last_active":"2024-03-04T12:59:55.468793+0000","last_peered":"2024-03-04T12:59:55.468793+0000","last_clean":"2024-03-04T12:59:55.468793+0000","last_became_active":"2024-03-04T12:36:07.292294+0000","last_became_peered":"2024-03-04T12:36:07.292294+0000","last_unstale":"2024-03-04T12:59:55.468793+0000","last_undegraded":"2024-03-04T12:59:55.468793+0000","last_fullsized":"2024-03-04T12:59:55.468793+0000","mapping_epoch":22,"log_start":"256'1200","ondisk_log_start":"256'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:30:59.966747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5403,"num_read_kb":4680,"num_write":1785,"num_write_kb":760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"256'323","reported_seq":924,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.100697+0000","last_change":"2024-03-04T12:36:05.290703+0000","last_active":"2024-03-04T13:00:17.100697+0000","last_peered":"2024-03-04T13:00:17.100697+0000","last_clean":"2024-03-04T13:00:17.100697+0000","last_became_active":"2024-03-04T12:36:05.290410+0000","last_became_peered":"2024-03-04T12:36:05.290410+0000","last_unstale":"2024-03-04T13:00:17.100697+0000","last_undegraded":"2024-03-04T13:00:17.100697+0000","last_fullsized":"2024-03-04T13:00:17.100697+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:59.309109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2168155,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":19682,"num_write":1207,"num_write_kb":25111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"256'274","reported_seq":1515,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.123078+0000","last_change":"2024-03-04T12:36:07.293973+0000","last_active":"2024-03-04T12:59:52.123078+0000","last_peered":"2024-03-04T12:59:52.123078+0000","last_clean":"2024-03-04T12:59:52.123078+0000","last_became_active":"2024-03-04T12:36:07.291583+0000","last_became_peered":"2024-03-04T12:36:07.291583+0000","last_unstale":"2024-03-04T12:59:52.123078+0000","last_undegraded":"2024-03-04T12:59:52.123078+0000","last_fullsized":"2024-03-04T12:59:52.123078+0000","mapping_epoch":22,"log_start":"256'200","ondisk_log_start":"256'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:30:48.818767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1552,"num_read_kb":1496,"num_write":324,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"256'389","reported_seq":1005,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.089810+0000","last_change":"2024-03-04T12:36:05.290812+0000","last_active":"2024-03-04T13:00:17.089810+0000","last_peered":"2024-03-04T13:00:17.089810+0000","last_clean":"2024-03-04T13:00:17.089810+0000","last_became_active":"2024-03-04T12:36:05.290522+0000","last_became_peered":"2024-03-04T12:36:05.290522+0000","last_unstale":"2024-03-04T13:00:17.089810+0000","last_undegraded":"2024-03-04T13:00:17.089810+0000","last_fullsized":"2024-03-04T13:00:17.089810+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:11:55.799567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11113900,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":595,"num_read_kb":8197,"num_write":1190,"num_write_kb":30951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"256'1119","reported_seq":2696,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.020212+0000","last_change":"2024-03-04T12:36:07.294845+0000","last_active":"2024-03-04T12:59:56.020212+0000","last_peered":"2024-03-04T12:59:56.020212+0000","last_clean":"2024-03-04T12:59:56.020212+0000","last_became_active":"2024-03-04T12:36:07.294536+0000","last_became_peered":"2024-03-04T12:36:07.294536+0000","last_unstale":"2024-03-04T12:59:56.020212+0000","last_undegraded":"2024-03-04T12:59:56.020212+0000","last_fullsized":"2024-03-04T12:59:56.020212+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:59.121496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4737,"num_read_kb":4156,"num_write":1530,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"256'316","reported_seq":929,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.079719+0000","last_change":"2024-03-04T12:36:05.286225+0000","last_active":"2024-03-04T13:00:17.079719+0000","last_peered":"2024-03-04T13:00:17.079719+0000","last_clean":"2024-03-04T13:00:17.079719+0000","last_became_active":"2024-03-04T12:36:05.285924+0000","last_became_peered":"2024-03-04T12:36:05.285924+0000","last_unstale":"2024-03-04T13:00:17.079719+0000","last_undegraded":"2024-03-04T13:00:17.079719+0000","last_fullsized":"2024-03-04T13:00:17.079719+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:09.707595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671806,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":413,"num_read_kb":22814,"num_write":1062,"num_write_kb":24147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"256'331","reported_seq":1637,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.899638+0000","last_change":"2024-03-04T12:36:07.302695+0000","last_active":"2024-03-04T12:59:54.899638+0000","last_peered":"2024-03-04T12:59:54.899638+0000","last_clean":"2024-03-04T12:59:54.899638+0000","last_became_active":"2024-03-04T12:36:07.302371+0000","last_became_peered":"2024-03-04T12:36:07.302371+0000","last_unstale":"2024-03-04T12:59:54.899638+0000","last_undegraded":"2024-03-04T12:59:54.899638+0000","last_fullsized":"2024-03-04T12:59:54.899638+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:05.080759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1728,"num_read_kb":1642,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"256'317","reported_seq":911,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.117801+0000","last_change":"2024-03-04T12:36:05.290406+0000","last_active":"2024-03-04T13:00:17.117801+0000","last_peered":"2024-03-04T13:00:17.117801+0000","last_clean":"2024-03-04T13:00:17.117801+0000","last_became_active":"2024-03-04T12:36:05.290032+0000","last_became_peered":"2024-03-04T12:36:05.290032+0000","last_unstale":"2024-03-04T13:00:17.117801+0000","last_undegraded":"2024-03-04T13:00:17.117801+0000","last_fullsized":"2024-03-04T13:00:17.117801+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:02.601501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489519,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":31102,"num_write":1081,"num_write_kb":33345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"256'416","reported_seq":1942,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.903846+0000","last_change":"2024-03-04T12:36:07.300654+0000","last_active":"2024-03-04T12:59:54.903846+0000","last_peered":"2024-03-04T12:59:54.903846+0000","last_clean":"2024-03-04T12:59:54.903846+0000","last_became_active":"2024-03-04T12:36:07.299718+0000","last_became_peered":"2024-03-04T12:36:07.299718+0000","last_unstale":"2024-03-04T12:59:54.903846+0000","last_undegraded":"2024-03-04T12:59:54.903846+0000","last_fullsized":"2024-03-04T12:59:54.903846+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:35:20.788356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2289,"num_read_kb":2179,"num_write":520,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"256'385","reported_seq":1043,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.114323+0000","last_change":"2024-03-04T12:36:05.279867+0000","last_active":"2024-03-04T13:00:17.114323+0000","last_peered":"2024-03-04T13:00:17.114323+0000","last_clean":"2024-03-04T13:00:17.114323+0000","last_became_active":"2024-03-04T12:36:05.279538+0000","last_became_peered":"2024-03-04T12:36:05.279538+0000","last_unstale":"2024-03-04T13:00:17.114323+0000","last_undegraded":"2024-03-04T13:00:17.114323+0000","last_fullsized":"2024-03-04T13:00:17.114323+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:35.650378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4781240,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":615,"num_read_kb":6803,"num_write":1512,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"256'748","reported_seq":2146,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.850080+0000","last_change":"2024-03-04T12:36:07.294946+0000","last_active":"2024-03-04T12:59:48.850080+0000","last_peered":"2024-03-04T12:59:48.850080+0000","last_clean":"2024-03-04T12:59:48.850080+0000","last_became_active":"2024-03-04T12:36:07.294274+0000","last_became_peered":"2024-03-04T12:36:07.294274+0000","last_unstale":"2024-03-04T12:59:48.850080+0000","last_undegraded":"2024-03-04T12:59:48.850080+0000","last_fullsized":"2024-03-04T12:59:48.850080+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:21:24.843354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3445,"num_read_kb":3067,"num_write":1017,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"256'365","reported_seq":947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.114617+0000","last_change":"2024-03-04T12:36:40.391610+0000","last_active":"2024-03-04T13:00:17.114617+0000","last_peered":"2024-03-04T13:00:17.114617+0000","last_clean":"2024-03-04T13:00:17.114617+0000","last_became_active":"2024-03-04T12:36:40.391325+0000","last_became_peered":"2024-03-04T12:36:40.391325+0000","last_unstale":"2024-03-04T13:00:17.114617+0000","last_undegraded":"2024-03-04T13:00:17.114617+0000","last_fullsized":"2024-03-04T13:00:17.114617+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:12.401772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2969477,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":505,"num_read_kb":41621,"num_write":1246,"num_write_kb":38740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"256'363","reported_seq":1073,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.102617+0000","last_change":"2024-03-04T12:36:05.288067+0000","last_active":"2024-03-04T13:00:17.102617+0000","last_peered":"2024-03-04T13:00:17.102617+0000","last_clean":"2024-03-04T13:00:17.102617+0000","last_became_active":"2024-03-04T12:36:05.287744+0000","last_became_peered":"2024-03-04T12:36:05.287744+0000","last_unstale":"2024-03-04T13:00:17.102617+0000","last_undegraded":"2024-03-04T13:00:17.102617+0000","last_fullsized":"2024-03-04T13:00:17.102617+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:52.068699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984340,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":791,"num_read_kb":29804,"num_write":1288,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"256'537","reported_seq":2092,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.620382+0000","last_change":"2024-03-04T12:36:07.302554+0000","last_active":"2024-03-04T12:59:47.620382+0000","last_peered":"2024-03-04T12:59:47.620382+0000","last_clean":"2024-03-04T12:59:47.620382+0000","last_became_active":"2024-03-04T12:36:07.302290+0000","last_became_peered":"2024-03-04T12:36:07.302290+0000","last_unstale":"2024-03-04T12:59:47.620382+0000","last_undegraded":"2024-03-04T12:59:47.620382+0000","last_fullsized":"2024-03-04T12:59:47.620382+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:53.412189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2955,"num_read_kb":2687,"num_write":726,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"256'449","reported_seq":1223,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.085211+0000","last_change":"2024-03-04T12:36:05.284158+0000","last_active":"2024-03-04T13:00:17.085211+0000","last_peered":"2024-03-04T13:00:17.085211+0000","last_clean":"2024-03-04T13:00:17.085211+0000","last_became_active":"2024-03-04T12:36:05.283797+0000","last_became_peered":"2024-03-04T12:36:05.283797+0000","last_unstale":"2024-03-04T13:00:17.085211+0000","last_undegraded":"2024-03-04T13:00:17.085211+0000","last_fullsized":"2024-03-04T13:00:17.085211+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:29.801034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5417905,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1114,"num_read_kb":38636,"num_write":1666,"num_write_kb":30809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"256'783","reported_seq":2209,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.912703+0000","last_change":"2024-03-04T12:36:07.301827+0000","last_active":"2024-03-04T12:59:54.912703+0000","last_peered":"2024-03-04T12:59:54.912703+0000","last_clean":"2024-03-04T12:59:54.912703+0000","last_became_active":"2024-03-04T12:36:07.301542+0000","last_became_peered":"2024-03-04T12:36:07.301542+0000","last_unstale":"2024-03-04T12:59:54.912703+0000","last_undegraded":"2024-03-04T12:59:54.912703+0000","last_fullsized":"2024-03-04T12:59:54.912703+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:45.175861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3434,"num_read_kb":3044,"num_write":1054,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":164,"num_read_kb":179702,"num_write":175,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5885,"num_read_kb":4252,"num_write":2245,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1077,"ondisk_log_size":1077,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":9441,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":12014,"num_read_kb":11868,"num_write":14038,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":18882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2352,"ondisk_log_size":2352,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":486,"ondisk_log_size":486,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1548695,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":15552,"num_read_kb":34013,"num_write":13157,"num_write_kb":10848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1978,"ondisk_log_size":1978,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1552,"num_read_kb":1546,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":187094,"num_read_kb":170304,"num_write":50851,"num_write_kb":17572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3861,"ondisk_log_size":3861,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":175727187,"num_objects":435,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":0,"num_read":34803,"num_read_kb":2210949,"num_write":78480,"num_write_kb":2282182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":353116160,"data_stored":351454374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3682,"ondisk_log_size":3682,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":165,"num_read_kb":175660,"num_write":175,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575147,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333368,"kb_used_data":71544,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94038472,"statfs":{"total":96636764160,"available":96295395328,"internally_reserved":0,"allocated":73261056,"data_stored":71540111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575148,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290592,"kb_used_data":38384,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94081248,"statfs":{"total":96636764160,"available":96339197952,"internally_reserved":0,"allocated":39305216,"data_stored":37695435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575148,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151232,"kb_used_data":51876,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94220608,"statfs":{"total":96636764160,"available":96481902592,"internally_reserved":0,"allocated":53121024,"data_stored":51449109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575146,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144140,"kb_used_data":72664,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94227700,"statfs":{"total":96636764160,"available":96489164800,"internally_reserved":0,"allocated":74407936,"data_stored":72693947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575146,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310956,"kb_used_data":49240,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94060884,"statfs":{"total":96636764160,"available":96318345216,"internally_reserved":0,"allocated":50421760,"data_stored":48746373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575147,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140468,"kb_used_data":51008,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94231372,"statfs":{"total":96636764160,"available":96492924928,"internally_reserved":0,"allocated":52232192,"data_stored":50704146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575150,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148660,"kb_used_data":41020,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94223180,"statfs":{"total":96636764160,"available":96484536320,"internally_reserved":0,"allocated":42004480,"data_stored":40455223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575147,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319696,"kb_used_data":63408,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":94052144,"statfs":{"total":96636764160,"available":96309395456,"internally_reserved":0,"allocated":64929792,"data_stored":63233494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45060096,"data_stored":44816819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30089216,"data_stored":29970475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42442752,"data_stored":42316441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38498304,"data_stored":38260992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62513152,"data_stored":62209723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39063552,"data_stored":38866277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31576064,"data_stored":31403645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":63873024,"data_stored":63610002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:00:24.864 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.865 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.865 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.865 INFO:tasks.ceph:pgid 64.1f last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.865 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.865 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.865 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.866 INFO:tasks.ceph:pgid 64.1e last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.866 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.866 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.866 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.866 INFO:tasks.ceph:pgid 64.1d last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.866 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.867 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.867 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.867 INFO:tasks.ceph:pgid 64.1c last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.867 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.867 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.868 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.868 INFO:tasks.ceph:pgid 64.1b last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.868 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.868 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.868 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.868 INFO:tasks.ceph:pgid 64.1a last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.869 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.869 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.869 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.869 INFO:tasks.ceph:pgid 64.19 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.869 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.869 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.869 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.870 INFO:tasks.ceph:pgid 64.18 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.870 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.870 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.870 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.870 INFO:tasks.ceph:pgid 64.17 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.870 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.870 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.871 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.871 INFO:tasks.ceph:pgid 64.16 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.871 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.871 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.871 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.871 INFO:tasks.ceph:pgid 64.15 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.872 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.872 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.872 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.872 INFO:tasks.ceph:pgid 64.14 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.872 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.872 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.873 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.873 INFO:tasks.ceph:pgid 64.13 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.873 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.873 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.873 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.873 INFO:tasks.ceph:pgid 64.12 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.873 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.874 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.874 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.874 INFO:tasks.ceph:pgid 64.11 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.874 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.874 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.874 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.875 INFO:tasks.ceph:pgid 64.10 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.875 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.875 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.875 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.875 INFO:tasks.ceph:pgid 64.f last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.875 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.875 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.876 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.876 INFO:tasks.ceph:pgid 64.e last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.876 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.876 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.876 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.876 INFO:tasks.ceph:pgid 64.d last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.876 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.877 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.877 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.877 INFO:tasks.ceph:pgid 64.c last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.877 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.877 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.877 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.878 INFO:tasks.ceph:pgid 64.b last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.878 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.878 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.878 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.878 INFO:tasks.ceph:pgid 64.a last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.878 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.879 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.879 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.879 INFO:tasks.ceph:pgid 64.9 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.879 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.879 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.879 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.879 INFO:tasks.ceph:pgid 64.8 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.880 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.880 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.880 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.880 INFO:tasks.ceph:pgid 64.7 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.880 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.880 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.881 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.881 INFO:tasks.ceph:pgid 64.6 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.881 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.881 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.881 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.881 INFO:tasks.ceph:pgid 64.5 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.881 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.882 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.882 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.882 INFO:tasks.ceph:pgid 64.4 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.882 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.882 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.882 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.883 INFO:tasks.ceph:pgid 64.3 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.883 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.883 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.883 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.883 INFO:tasks.ceph:pgid 64.2 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.883 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.883 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.884 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.884 INFO:tasks.ceph:pgid 64.1 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.884 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.884 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.884 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.884 INFO:tasks.ceph:pgid 64.0 last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.885 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.885 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.885 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.885 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.885 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.885 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.885 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.886 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.886 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.886 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.886 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.886 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.886 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.886 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.887 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.887 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.887 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.887 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.887 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.887 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.888 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.888 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.888 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.888 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.888 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.888 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.889 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.889 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.889 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.889 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.889 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.889 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.889 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.890 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.890 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.890 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.890 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.890 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.890 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.891 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.891 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.891 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.891 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.891 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.891 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.891 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.892 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.892 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.892 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.892 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.892 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.892 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.893 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.893 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.893 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.893 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.893 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.893 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.894 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.894 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.894 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.894 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.894 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.894 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.894 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.895 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.895 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.895 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.895 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.895 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.895 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.895 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.896 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.896 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.896 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.896 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.896 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.896 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.896 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.897 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.897 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.897 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.897 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.897 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.897 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.897 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.898 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.898 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.898 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.898 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.898 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.898 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.898 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.899 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.899 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.899 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.899 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.899 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.899 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.899 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.900 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.900 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-04T12:35:46.856449+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=46, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.900 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.900 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.900 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.900 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.901 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.901 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.901 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.901 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.901 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.901 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.901 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.902 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.902 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.902 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.902 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.902 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.902 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.903 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.903 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.903 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.903 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.903 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.903 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.903 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.904 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.904 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.904 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.904 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.904 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.904 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.904 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.905 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.905 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.905 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.905 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.905 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.905 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.906 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.906 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.906 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.906 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.906 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.906 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.906 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.907 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.907 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.907 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.907 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.907 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.907 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.907 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.908 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.908 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.908 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.908 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.908 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.908 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.909 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.909 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.909 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.909 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.909 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.909 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.909 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.910 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.910 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.910 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.910 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.910 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.910 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.910 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.911 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.911 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.911 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.911 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.911 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.912 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.912 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.912 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.912 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.912 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.912 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.913 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.913 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.913 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.913 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.915 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.915 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.915 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.915 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.915 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.916 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.916 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.916 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.916 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.916 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.916 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.917 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.917 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.917 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.917 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.917 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.917 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.917 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.918 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.918 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.918 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.918 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.918 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.918 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.918 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.919 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.919 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.919 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.919 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.919 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.919 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.920 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.920 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.920 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.920 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.920 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.920 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.921 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.921 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.921 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.921 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.921 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.921 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.922 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.922 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.922 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.922 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.922 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.922 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.923 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.923 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.923 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.923 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.923 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.923 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.924 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.924 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.924 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.924 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.924 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.924 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.925 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.925 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.925 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.925 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.925 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.925 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.926 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.926 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.926 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.926 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.926 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.926 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.927 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.927 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.927 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.927 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:24.927 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-04T13:00:44.929 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:00:45.274 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:00:45.285 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-03-04T13:00:45.288 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":998,"stamp":"2024-03-04T13:00:43.366479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":211431760,"num_objects":820,"num_object_clones":0,"num_object_copies":1640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":820,"num_whiteouts":0,"num_read":257353,"num_read_kb":2788402,"num_write":159314,"num_write_kb":2552482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21932,"num_omap_keys":58,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13749,"ondisk_log_size":13749,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1837736,"kb_used_data":439144,"kb_used_omap":12,"kb_used_meta":1398515,"kb_avail":753136984,"statfs":{"total":773094113280,"available":771212271616,"internally_reserved":0,"allocated":449683456,"data_stored":436517838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1432079920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12840,"num_omap_keys":39,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005567"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:31.006058+0000","last_change":"2024-03-04T12:51:01.353518+0000","last_active":"2024-03-04T12:58:31.006058+0000","last_peered":"2024-03-04T12:58:31.006058+0000","last_clean":"2024-03-04T12:58:31.006058+0000","last_became_active":"2024-03-04T12:51:01.353225+0000","last_became_peered":"2024-03-04T12:51:01.353225+0000","last_unstale":"2024-03-04T12:58:31.006058+0000","last_undegraded":"2024-03-04T12:58:31.006058+0000","last_fullsized":"2024-03-04T12:58:31.006058+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"256'2","reported_seq":34,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.496410+0000","last_change":"2024-03-04T12:44:53.484600+0000","last_active":"2024-03-04T13:00:16.496410+0000","last_peered":"2024-03-04T13:00:16.496410+0000","last_clean":"2024-03-04T13:00:16.496410+0000","last_became_active":"2024-03-04T12:44:53.484341+0000","last_became_peered":"2024-03-04T12:44:53.484341+0000","last_unstale":"2024-03-04T13:00:16.496410+0000","last_undegraded":"2024-03-04T13:00:16.496410+0000","last_fullsized":"2024-03-04T13:00:16.496410+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":38,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:50.993866+0000","last_change":"2024-03-04T12:44:50.455898+0000","last_active":"2024-03-04T12:58:50.993866+0000","last_peered":"2024-03-04T12:58:50.993866+0000","last_clean":"2024-03-04T12:58:50.993866+0000","last_became_active":"2024-03-04T12:44:50.455509+0000","last_became_peered":"2024-03-04T12:44:50.455509+0000","last_unstale":"2024-03-04T12:58:50.993866+0000","last_undegraded":"2024-03-04T12:58:50.993866+0000","last_fullsized":"2024-03-04T12:58:50.993866+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"256'40","reported_seq":146,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.596410+0000","last_change":"2024-03-04T13:00:27.596439+0000","last_active":"2024-03-04T13:00:27.596410+0000","last_peered":"2024-03-04T13:00:27.596410+0000","last_clean":"2024-03-04T13:00:27.596410+0000","last_became_active":"2024-03-04T12:43:27.060405+0000","last_became_peered":"2024-03-04T12:43:27.060405+0000","last_unstale":"2024-03-04T13:00:27.596410+0000","last_undegraded":"2024-03-04T13:00:27.596410+0000","last_fullsized":"2024-03-04T13:00:27.596410+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'40","last_scrub_stamp":"2024-03-04T13:00:27.596312+0000","last_deep_scrub":"256'40","last_deep_scrub_stamp":"2024-03-04T13:00:27.596312+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.596312+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:52.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":118,"num_write":66,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:31.006045+0000","last_change":"2024-03-04T12:51:01.358434+0000","last_active":"2024-03-04T12:58:31.006045+0000","last_peered":"2024-03-04T12:58:31.006045+0000","last_clean":"2024-03-04T12:58:31.006045+0000","last_became_active":"2024-03-04T12:51:01.358005+0000","last_became_peered":"2024-03-04T12:51:01.358005+0000","last_unstale":"2024-03-04T12:58:31.006045+0000","last_undegraded":"2024-03-04T12:58:31.006045+0000","last_fullsized":"2024-03-04T12:58:31.006045+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"256'8","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.488248+0000","last_change":"2024-03-04T12:44:53.487686+0000","last_active":"2024-03-04T13:00:15.488248+0000","last_peered":"2024-03-04T13:00:15.488248+0000","last_clean":"2024-03-04T13:00:15.488248+0000","last_became_active":"2024-03-04T12:44:53.486168+0000","last_became_peered":"2024-03-04T12:44:53.486168+0000","last_unstale":"2024-03-04T13:00:15.488248+0000","last_undegraded":"2024-03-04T13:00:15.488248+0000","last_fullsized":"2024-03-04T13:00:15.488248+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":10242,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.629649+0000","last_change":"2024-03-04T13:00:22.629669+0000","last_active":"2024-03-04T13:00:22.629649+0000","last_peered":"2024-03-04T13:00:22.629649+0000","last_clean":"2024-03-04T13:00:22.629649+0000","last_became_active":"2024-03-04T12:44:50.450465+0000","last_became_peered":"2024-03-04T12:44:50.450465+0000","last_unstale":"2024-03-04T13:00:22.629649+0000","last_undegraded":"2024-03-04T13:00:22.629649+0000","last_fullsized":"2024-03-04T13:00:22.629649+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:22.629555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:22.629555+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.629555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:10.681596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"250'33","reported_seq":136,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.541479+0000","last_change":"2024-03-04T13:00:25.541501+0000","last_active":"2024-03-04T13:00:25.541479+0000","last_peered":"2024-03-04T13:00:25.541479+0000","last_clean":"2024-03-04T13:00:25.541479+0000","last_became_active":"2024-03-04T12:43:27.060562+0000","last_became_peered":"2024-03-04T12:43:27.060562+0000","last_unstale":"2024-03-04T13:00:25.541479+0000","last_undegraded":"2024-03-04T13:00:25.541479+0000","last_fullsized":"2024-03-04T13:00:25.541479+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'33","last_scrub_stamp":"2024-03-04T13:00:25.541401+0000","last_deep_scrub":"250'33","last_deep_scrub_stamp":"2024-03-04T13:00:25.541401+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.541401+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:43.219942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":113,"num_write":48,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:00.994466+0000","last_change":"2024-03-04T12:51:01.596745+0000","last_active":"2024-03-04T12:59:00.994466+0000","last_peered":"2024-03-04T12:59:00.994466+0000","last_clean":"2024-03-04T12:59:00.994466+0000","last_became_active":"2024-03-04T12:51:01.595776+0000","last_became_peered":"2024-03-04T12:51:01.595776+0000","last_unstale":"2024-03-04T12:59:00.994466+0000","last_undegraded":"2024-03-04T12:59:00.994466+0000","last_fullsized":"2024-03-04T12:59:00.994466+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"256'14","reported_seq":64,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.116502+0000","last_change":"2024-03-04T13:00:36.116531+0000","last_active":"2024-03-04T13:00:36.116502+0000","last_peered":"2024-03-04T13:00:36.116502+0000","last_clean":"2024-03-04T13:00:36.116502+0000","last_became_active":"2024-03-04T12:44:53.478864+0000","last_became_peered":"2024-03-04T12:44:53.478864+0000","last_unstale":"2024-03-04T13:00:36.116502+0000","last_undegraded":"2024-03-04T13:00:36.116502+0000","last_fullsized":"2024-03-04T13:00:36.116502+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'14","last_scrub_stamp":"2024-03-04T13:00:36.116377+0000","last_deep_scrub":"256'14","last_deep_scrub_stamp":"2024-03-04T13:00:36.116377+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.116377+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:25:47.800519+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":27,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.687649+0000","last_change":"2024-03-04T13:00:26.687673+0000","last_active":"2024-03-04T13:00:26.687649+0000","last_peered":"2024-03-04T13:00:26.687649+0000","last_clean":"2024-03-04T13:00:26.687649+0000","last_became_active":"2024-03-04T12:44:50.453830+0000","last_became_peered":"2024-03-04T12:44:50.453830+0000","last_unstale":"2024-03-04T13:00:26.687649+0000","last_undegraded":"2024-03-04T13:00:26.687649+0000","last_fullsized":"2024-03-04T13:00:26.687649+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:26.687563+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:26.687563+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.687563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:43.300798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"256'64","reported_seq":205,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.295664+0000","last_change":"2024-03-04T13:00:28.295688+0000","last_active":"2024-03-04T13:00:28.295664+0000","last_peered":"2024-03-04T13:00:28.295664+0000","last_clean":"2024-03-04T13:00:28.295664+0000","last_became_active":"2024-03-04T12:43:27.067330+0000","last_became_peered":"2024-03-04T12:43:27.067330+0000","last_unstale":"2024-03-04T13:00:28.295664+0000","last_undegraded":"2024-03-04T13:00:28.295664+0000","last_fullsized":"2024-03-04T13:00:28.295664+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'64","last_scrub_stamp":"2024-03-04T13:00:28.295569+0000","last_deep_scrub":"256'64","last_deep_scrub_stamp":"2024-03-04T13:00:28.295569+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.295569+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:35:07.847340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":194,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:21.013626+0000","last_change":"2024-03-04T12:51:01.596599+0000","last_active":"2024-03-04T12:59:21.013626+0000","last_peered":"2024-03-04T12:59:21.013626+0000","last_clean":"2024-03-04T12:59:21.013626+0000","last_became_active":"2024-03-04T12:51:01.596268+0000","last_became_peered":"2024-03-04T12:51:01.596268+0000","last_unstale":"2024-03-04T12:59:21.013626+0000","last_undegraded":"2024-03-04T12:59:21.013626+0000","last_fullsized":"2024-03-04T12:59:21.013626+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:55.994347+0000","last_change":"2024-03-04T12:44:53.482037+0000","last_active":"2024-03-04T12:58:55.994347+0000","last_peered":"2024-03-04T12:58:55.994347+0000","last_clean":"2024-03-04T12:58:55.994347+0000","last_became_active":"2024-03-04T12:44:53.481760+0000","last_became_peered":"2024-03-04T12:44:53.481760+0000","last_unstale":"2024-03-04T12:58:55.994347+0000","last_undegraded":"2024-03-04T12:58:55.994347+0000","last_fullsized":"2024-03-04T12:58:55.994347+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.584224+0000","last_change":"2024-03-04T13:00:34.584252+0000","last_active":"2024-03-04T13:00:34.584224+0000","last_peered":"2024-03-04T13:00:34.584224+0000","last_clean":"2024-03-04T13:00:34.584224+0000","last_became_active":"2024-03-04T12:44:50.455723+0000","last_became_peered":"2024-03-04T12:44:50.455723+0000","last_unstale":"2024-03-04T13:00:34.584224+0000","last_undegraded":"2024-03-04T13:00:34.584224+0000","last_fullsized":"2024-03-04T13:00:34.584224+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:34.584103+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:34.584103+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.584103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:47.957581+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"256'151","reported_seq":509,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.376892+0000","last_change":"2024-03-04T13:00:23.376916+0000","last_active":"2024-03-04T13:00:23.376892+0000","last_peered":"2024-03-04T13:00:23.376892+0000","last_clean":"2024-03-04T13:00:23.376892+0000","last_became_active":"2024-03-04T12:43:27.067228+0000","last_became_peered":"2024-03-04T12:43:27.067228+0000","last_unstale":"2024-03-04T13:00:23.376892+0000","last_undegraded":"2024-03-04T13:00:23.376892+0000","last_fullsized":"2024-03-04T13:00:23.376892+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'151","last_scrub_stamp":"2024-03-04T13:00:23.376811+0000","last_deep_scrub":"256'151","last_deep_scrub_stamp":"2024-03-04T13:00:23.376811+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.376811+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:55:13.549907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":889,"num_read_kb":655,"num_write":189,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4940,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.023677+0000","last_change":"2024-03-04T12:51:01.356736+0000","last_active":"2024-03-04T13:00:24.023677+0000","last_peered":"2024-03-04T13:00:24.023677+0000","last_clean":"2024-03-04T13:00:24.023677+0000","last_became_active":"2024-03-04T12:51:01.356572+0000","last_became_peered":"2024-03-04T12:51:01.356572+0000","last_unstale":"2024-03-04T13:00:24.023677+0000","last_undegraded":"2024-03-04T13:00:24.023677+0000","last_fullsized":"2024-03-04T13:00:24.023677+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"256'4","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.151000+0000","last_change":"2024-03-04T13:00:32.151061+0000","last_active":"2024-03-04T13:00:32.151000+0000","last_peered":"2024-03-04T13:00:32.151000+0000","last_clean":"2024-03-04T13:00:32.151000+0000","last_became_active":"2024-03-04T12:44:53.477386+0000","last_became_peered":"2024-03-04T12:44:53.477386+0000","last_unstale":"2024-03-04T13:00:32.151000+0000","last_undegraded":"2024-03-04T13:00:32.151000+0000","last_fullsized":"2024-03-04T13:00:32.151000+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:32.150910+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:32.150910+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.150910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:35.067029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":418,"num_write":4,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.868900+0000","last_change":"2024-03-04T13:00:25.868970+0000","last_active":"2024-03-04T13:00:25.868900+0000","last_peered":"2024-03-04T13:00:25.868900+0000","last_clean":"2024-03-04T13:00:25.868900+0000","last_became_active":"2024-03-04T12:44:50.448683+0000","last_became_peered":"2024-03-04T12:44:50.448683+0000","last_unstale":"2024-03-04T13:00:25.868900+0000","last_undegraded":"2024-03-04T13:00:25.868900+0000","last_fullsized":"2024-03-04T13:00:25.868900+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:25.868786+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:25.868786+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.868786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:06.732143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"256'38","reported_seq":137,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.367287+0000","last_change":"2024-03-04T13:00:25.367310+0000","last_active":"2024-03-04T13:00:25.367287+0000","last_peered":"2024-03-04T13:00:25.367287+0000","last_clean":"2024-03-04T13:00:25.367287+0000","last_became_active":"2024-03-04T12:43:27.062623+0000","last_became_peered":"2024-03-04T12:43:27.062623+0000","last_unstale":"2024-03-04T13:00:25.367287+0000","last_undegraded":"2024-03-04T13:00:25.367287+0000","last_fullsized":"2024-03-04T13:00:25.367287+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'38","last_scrub_stamp":"2024-03-04T13:00:25.367217+0000","last_deep_scrub":"256'38","last_deep_scrub_stamp":"2024-03-04T13:00:25.367217+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.367217+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:18:32.757230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.560461+0000","last_change":"2024-03-04T12:51:01.357400+0000","last_active":"2024-03-04T13:00:23.560461+0000","last_peered":"2024-03-04T13:00:23.560461+0000","last_clean":"2024-03-04T13:00:23.560461+0000","last_became_active":"2024-03-04T12:51:01.355578+0000","last_became_peered":"2024-03-04T12:51:01.355578+0000","last_unstale":"2024-03-04T13:00:23.560461+0000","last_undegraded":"2024-03-04T13:00:23.560461+0000","last_fullsized":"2024-03-04T13:00:23.560461+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"256'11","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.965909+0000","last_change":"2024-03-04T12:44:53.477157+0000","last_active":"2024-03-04T13:00:16.965909+0000","last_peered":"2024-03-04T13:00:16.965909+0000","last_clean":"2024-03-04T13:00:16.965909+0000","last_became_active":"2024-03-04T12:44:53.476348+0000","last_became_peered":"2024-03-04T12:44:53.476348+0000","last_unstale":"2024-03-04T13:00:16.965909+0000","last_undegraded":"2024-03-04T13:00:16.965909+0000","last_fullsized":"2024-03-04T13:00:16.965909+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13312,"num_write":16,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'7","reported_seq":60,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.741695+0000","last_change":"2024-03-04T13:00:30.741727+0000","last_active":"2024-03-04T13:00:30.741695+0000","last_peered":"2024-03-04T13:00:30.741695+0000","last_clean":"2024-03-04T13:00:30.741695+0000","last_became_active":"2024-03-04T12:44:50.454252+0000","last_became_peered":"2024-03-04T12:44:50.454252+0000","last_unstale":"2024-03-04T13:00:30.741695+0000","last_undegraded":"2024-03-04T13:00:30.741695+0000","last_fullsized":"2024-03-04T13:00:30.741695+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:00:30.741607+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:00:30.741607+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.741607+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:27.692537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"256'25","reported_seq":105,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.237500+0000","last_change":"2024-03-04T13:00:30.237546+0000","last_active":"2024-03-04T13:00:30.237500+0000","last_peered":"2024-03-04T13:00:30.237500+0000","last_clean":"2024-03-04T13:00:30.237500+0000","last_became_active":"2024-03-04T12:43:27.061611+0000","last_became_peered":"2024-03-04T12:43:27.061611+0000","last_unstale":"2024-03-04T13:00:30.237500+0000","last_undegraded":"2024-03-04T13:00:30.237500+0000","last_fullsized":"2024-03-04T13:00:30.237500+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'25","last_scrub_stamp":"2024-03-04T13:00:30.237361+0000","last_deep_scrub":"256'25","last_deep_scrub_stamp":"2024-03-04T13:00:30.237361+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.237361+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:40.824012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.990863+0000","last_change":"2024-03-04T12:51:01.351751+0000","last_active":"2024-03-04T12:58:30.990863+0000","last_peered":"2024-03-04T12:58:30.990863+0000","last_clean":"2024-03-04T12:58:30.990863+0000","last_became_active":"2024-03-04T12:51:01.351465+0000","last_became_peered":"2024-03-04T12:51:01.351465+0000","last_unstale":"2024-03-04T12:58:30.990863+0000","last_undegraded":"2024-03-04T12:58:30.990863+0000","last_fullsized":"2024-03-04T12:58:30.990863+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"256'4","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.325676+0000","last_change":"2024-03-04T12:44:53.483089+0000","last_active":"2024-03-04T13:00:16.325676+0000","last_peered":"2024-03-04T13:00:16.325676+0000","last_clean":"2024-03-04T13:00:16.325676+0000","last_became_active":"2024-03-04T12:44:53.482806+0000","last_became_peered":"2024-03-04T12:44:53.482806+0000","last_unstale":"2024-03-04T13:00:16.325676+0000","last_undegraded":"2024-03-04T13:00:16.325676+0000","last_fullsized":"2024-03-04T13:00:16.325676+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.377211+0000","last_change":"2024-03-04T13:00:22.377229+0000","last_active":"2024-03-04T13:00:22.377211+0000","last_peered":"2024-03-04T13:00:22.377211+0000","last_clean":"2024-03-04T13:00:22.377211+0000","last_became_active":"2024-03-04T12:44:50.457180+0000","last_became_peered":"2024-03-04T12:44:50.457180+0000","last_unstale":"2024-03-04T13:00:22.377211+0000","last_undegraded":"2024-03-04T13:00:22.377211+0000","last_fullsized":"2024-03-04T13:00:22.377211+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:22.377126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:22.377126+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.377126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:53.011158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"256'43","reported_seq":141,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.659958+0000","last_change":"2024-03-04T13:00:25.659958+0000","last_active":"2024-03-04T13:00:25.659958+0000","last_peered":"2024-03-04T13:00:25.659958+0000","last_clean":"2024-03-04T13:00:25.659958+0000","last_became_active":"2024-03-04T12:43:27.063191+0000","last_became_peered":"2024-03-04T12:43:27.063191+0000","last_unstale":"2024-03-04T13:00:25.659958+0000","last_undegraded":"2024-03-04T13:00:25.659958+0000","last_fullsized":"2024-03-04T13:00:25.659958+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'43","last_scrub_stamp":"2024-03-04T13:00:25.659791+0000","last_deep_scrub":"256'43","last_deep_scrub_stamp":"2024-03-04T13:00:25.659791+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.659791+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:44:08.536513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":76,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":22,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:30.997762+0000","last_change":"2024-03-04T12:51:01.353519+0000","last_active":"2024-03-04T12:58:30.997762+0000","last_peered":"2024-03-04T12:58:30.997762+0000","last_clean":"2024-03-04T12:58:30.997762+0000","last_became_active":"2024-03-04T12:51:01.353248+0000","last_became_peered":"2024-03-04T12:51:01.353248+0000","last_unstale":"2024-03-04T12:58:30.997762+0000","last_undegraded":"2024-03-04T12:58:30.997762+0000","last_fullsized":"2024-03-04T12:58:30.997762+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"250'5","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.020336+0000","last_change":"2024-03-04T12:44:53.483754+0000","last_active":"2024-03-04T12:59:56.020336+0000","last_peered":"2024-03-04T12:59:56.020336+0000","last_clean":"2024-03-04T12:59:56.020336+0000","last_became_active":"2024-03-04T12:44:53.483210+0000","last_became_peered":"2024-03-04T12:44:53.483210+0000","last_unstale":"2024-03-04T12:59:56.020336+0000","last_undegraded":"2024-03-04T12:59:56.020336+0000","last_fullsized":"2024-03-04T12:59:56.020336+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"256'9","reported_seq":62,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.633368+0000","last_change":"2024-03-04T13:00:23.633396+0000","last_active":"2024-03-04T13:00:23.633368+0000","last_peered":"2024-03-04T13:00:23.633368+0000","last_clean":"2024-03-04T13:00:23.633368+0000","last_became_active":"2024-03-04T12:44:50.449291+0000","last_became_peered":"2024-03-04T12:44:50.449291+0000","last_unstale":"2024-03-04T13:00:23.633368+0000","last_undegraded":"2024-03-04T13:00:23.633368+0000","last_fullsized":"2024-03-04T13:00:23.633368+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:23.633297+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:23.633297+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.633297+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:09.478343+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"256'42","reported_seq":139,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.413406+0000","last_change":"2024-03-04T13:00:36.413430+0000","last_active":"2024-03-04T13:00:36.413406+0000","last_peered":"2024-03-04T13:00:36.413406+0000","last_clean":"2024-03-04T13:00:36.413406+0000","last_became_active":"2024-03-04T12:43:27.061663+0000","last_became_peered":"2024-03-04T12:43:27.061663+0000","last_unstale":"2024-03-04T13:00:36.413406+0000","last_undegraded":"2024-03-04T13:00:36.413406+0000","last_fullsized":"2024-03-04T13:00:36.413406+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'42","last_scrub_stamp":"2024-03-04T13:00:36.413321+0000","last_deep_scrub":"256'42","last_deep_scrub_stamp":"2024-03-04T13:00:36.413321+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.413321+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:53.818525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":24,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.004187+0000","last_change":"2024-03-04T12:51:01.596240+0000","last_active":"2024-03-04T13:00:21.004187+0000","last_peered":"2024-03-04T13:00:21.004187+0000","last_clean":"2024-03-04T13:00:21.004187+0000","last_became_active":"2024-03-04T12:51:01.595943+0000","last_became_peered":"2024-03-04T12:51:01.595943+0000","last_unstale":"2024-03-04T13:00:21.004187+0000","last_undegraded":"2024-03-04T13:00:21.004187+0000","last_fullsized":"2024-03-04T13:00:21.004187+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"256'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.371280+0000","last_change":"2024-03-04T12:44:53.486306+0000","last_active":"2024-03-04T13:00:16.371280+0000","last_peered":"2024-03-04T13:00:16.371280+0000","last_clean":"2024-03-04T13:00:16.371280+0000","last_became_active":"2024-03-04T12:44:53.485995+0000","last_became_peered":"2024-03-04T12:44:53.485995+0000","last_unstale":"2024-03-04T13:00:16.371280+0000","last_undegraded":"2024-03-04T13:00:16.371280+0000","last_fullsized":"2024-03-04T13:00:16.371280+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"256'4","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.794012+0000","last_change":"2024-03-04T13:00:34.794073+0000","last_active":"2024-03-04T13:00:34.794012+0000","last_peered":"2024-03-04T13:00:34.794012+0000","last_clean":"2024-03-04T13:00:34.794012+0000","last_became_active":"2024-03-04T12:44:50.454617+0000","last_became_peered":"2024-03-04T12:44:50.454617+0000","last_unstale":"2024-03-04T13:00:34.794012+0000","last_undegraded":"2024-03-04T13:00:34.794012+0000","last_fullsized":"2024-03-04T13:00:34.794012+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:34.793901+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:34.793901+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.793901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:05.781091+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"256'41","reported_seq":144,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.757303+0000","last_change":"2024-03-04T13:00:31.757332+0000","last_active":"2024-03-04T13:00:31.757303+0000","last_peered":"2024-03-04T13:00:31.757303+0000","last_clean":"2024-03-04T13:00:31.757303+0000","last_became_active":"2024-03-04T12:43:27.050088+0000","last_became_peered":"2024-03-04T12:43:27.050088+0000","last_unstale":"2024-03-04T13:00:31.757303+0000","last_undegraded":"2024-03-04T13:00:31.757303+0000","last_fullsized":"2024-03-04T13:00:31.757303+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'41","last_scrub_stamp":"2024-03-04T13:00:31.757200+0000","last_deep_scrub":"256'41","last_deep_scrub_stamp":"2024-03-04T13:00:31.757200+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.757200+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:30:26.807415+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":112,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.633949+0000","last_change":"2024-03-04T12:51:01.595890+0000","last_active":"2024-03-04T13:00:22.633949+0000","last_peered":"2024-03-04T13:00:22.633949+0000","last_clean":"2024-03-04T13:00:22.633949+0000","last_became_active":"2024-03-04T12:51:01.595530+0000","last_became_peered":"2024-03-04T12:51:01.595530+0000","last_unstale":"2024-03-04T13:00:22.633949+0000","last_undegraded":"2024-03-04T13:00:22.633949+0000","last_fullsized":"2024-03-04T13:00:22.633949+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"256'4","reported_seq":38,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.814492+0000","last_change":"2024-03-04T12:44:53.478706+0000","last_active":"2024-03-04T13:00:15.814492+0000","last_peered":"2024-03-04T13:00:15.814492+0000","last_clean":"2024-03-04T13:00:15.814492+0000","last_became_active":"2024-03-04T12:44:53.478099+0000","last_became_peered":"2024-03-04T12:44:53.478099+0000","last_unstale":"2024-03-04T13:00:15.814492+0000","last_undegraded":"2024-03-04T13:00:15.814492+0000","last_fullsized":"2024-03-04T13:00:15.814492+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.588764+0000","last_change":"2024-03-04T13:00:24.588802+0000","last_active":"2024-03-04T13:00:24.588764+0000","last_peered":"2024-03-04T13:00:24.588764+0000","last_clean":"2024-03-04T13:00:24.588764+0000","last_became_active":"2024-03-04T12:44:50.448745+0000","last_became_peered":"2024-03-04T12:44:50.448745+0000","last_unstale":"2024-03-04T13:00:24.588764+0000","last_undegraded":"2024-03-04T13:00:24.588764+0000","last_fullsized":"2024-03-04T13:00:24.588764+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:24.588654+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:24.588654+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.588654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:49:36.928946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"256'16","reported_seq":90,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.456547+0000","last_change":"2024-03-04T13:00:28.456571+0000","last_active":"2024-03-04T13:00:28.456547+0000","last_peered":"2024-03-04T13:00:28.456547+0000","last_clean":"2024-03-04T13:00:28.456547+0000","last_became_active":"2024-03-04T12:43:27.059494+0000","last_became_peered":"2024-03-04T12:43:27.059494+0000","last_unstale":"2024-03-04T13:00:28.456547+0000","last_undegraded":"2024-03-04T13:00:28.456547+0000","last_fullsized":"2024-03-04T13:00:28.456547+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'16","last_scrub_stamp":"2024-03-04T13:00:28.456461+0000","last_deep_scrub":"256'16","last_deep_scrub_stamp":"2024-03-04T13:00:28.456461+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.456461+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:06.545751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":48,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.094382+0000","last_change":"2024-03-04T12:51:01.355844+0000","last_active":"2024-03-04T13:00:23.094382+0000","last_peered":"2024-03-04T13:00:23.094382+0000","last_clean":"2024-03-04T13:00:23.094382+0000","last_became_active":"2024-03-04T12:51:01.355560+0000","last_became_peered":"2024-03-04T12:51:01.355560+0000","last_unstale":"2024-03-04T13:00:23.094382+0000","last_undegraded":"2024-03-04T13:00:23.094382+0000","last_fullsized":"2024-03-04T13:00:23.094382+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'3","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.548095+0000","last_change":"2024-03-04T13:00:38.548121+0000","last_active":"2024-03-04T13:00:38.548095+0000","last_peered":"2024-03-04T13:00:38.548095+0000","last_clean":"2024-03-04T13:00:38.548095+0000","last_became_active":"2024-03-04T12:44:53.475861+0000","last_became_peered":"2024-03-04T12:44:53.475861+0000","last_unstale":"2024-03-04T13:00:38.548095+0000","last_undegraded":"2024-03-04T13:00:38.548095+0000","last_fullsized":"2024-03-04T13:00:38.548095+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'3","last_scrub_stamp":"2024-03-04T13:00:38.548004+0000","last_deep_scrub":"250'3","last_deep_scrub_stamp":"2024-03-04T13:00:38.548004+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.548004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:54:35.955700+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"256'8","reported_seq":59,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.305336+0000","last_change":"2024-03-04T13:00:25.305365+0000","last_active":"2024-03-04T13:00:25.305336+0000","last_peered":"2024-03-04T13:00:25.305336+0000","last_clean":"2024-03-04T13:00:25.305336+0000","last_became_active":"2024-03-04T12:44:50.453541+0000","last_became_peered":"2024-03-04T12:44:50.453541+0000","last_unstale":"2024-03-04T13:00:25.305336+0000","last_undegraded":"2024-03-04T13:00:25.305336+0000","last_fullsized":"2024-03-04T13:00:25.305336+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'8","last_scrub_stamp":"2024-03-04T13:00:25.305244+0000","last_deep_scrub":"256'8","last_deep_scrub_stamp":"2024-03-04T13:00:25.305244+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.305244+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:50.904960+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"256'48","reported_seq":157,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.235467+0000","last_change":"2024-03-04T13:00:22.235467+0000","last_active":"2024-03-04T13:00:22.235467+0000","last_peered":"2024-03-04T13:00:22.235467+0000","last_clean":"2024-03-04T13:00:22.235467+0000","last_became_active":"2024-03-04T12:43:27.069664+0000","last_became_peered":"2024-03-04T12:43:27.069664+0000","last_unstale":"2024-03-04T13:00:22.235467+0000","last_undegraded":"2024-03-04T13:00:22.235467+0000","last_fullsized":"2024-03-04T13:00:22.235467+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'48","last_scrub_stamp":"2024-03-04T13:00:22.235365+0000","last_deep_scrub":"256'48","last_deep_scrub_stamp":"2024-03-04T13:00:22.235365+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.235365+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:38:42.140621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":14,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:56.010344+0000","last_change":"2024-03-04T12:51:41.753110+0000","last_active":"2024-03-04T12:58:56.010344+0000","last_peered":"2024-03-04T12:58:56.010344+0000","last_clean":"2024-03-04T12:58:56.010344+0000","last_became_active":"2024-03-04T12:51:41.752775+0000","last_became_peered":"2024-03-04T12:51:41.752775+0000","last_unstale":"2024-03-04T12:58:56.010344+0000","last_undegraded":"2024-03-04T12:58:56.010344+0000","last_fullsized":"2024-03-04T12:58:56.010344+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"256'7","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.372222+0000","last_change":"2024-03-04T12:44:53.478491+0000","last_active":"2024-03-04T13:00:16.372222+0000","last_peered":"2024-03-04T13:00:16.372222+0000","last_clean":"2024-03-04T13:00:16.372222+0000","last_became_active":"2024-03-04T12:44:53.478126+0000","last_became_peered":"2024-03-04T12:44:53.478126+0000","last_unstale":"2024-03-04T13:00:16.372222+0000","last_undegraded":"2024-03-04T13:00:16.372222+0000","last_fullsized":"2024-03-04T13:00:16.372222+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11793,"num_write":12,"num_write_kb":7697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'2","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.422683+0000","last_change":"2024-03-04T12:44:50.455922+0000","last_active":"2024-03-04T13:00:16.422683+0000","last_peered":"2024-03-04T13:00:16.422683+0000","last_clean":"2024-03-04T13:00:16.422683+0000","last_became_active":"2024-03-04T12:44:50.455571+0000","last_became_peered":"2024-03-04T12:44:50.455571+0000","last_unstale":"2024-03-04T13:00:16.422683+0000","last_undegraded":"2024-03-04T13:00:16.422683+0000","last_fullsized":"2024-03-04T13:00:16.422683+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"256'47","reported_seq":151,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.409207+0000","last_change":"2024-03-04T13:00:27.409254+0000","last_active":"2024-03-04T13:00:27.409207+0000","last_peered":"2024-03-04T13:00:27.409207+0000","last_clean":"2024-03-04T13:00:27.409207+0000","last_became_active":"2024-03-04T12:43:27.060225+0000","last_became_peered":"2024-03-04T12:43:27.060225+0000","last_unstale":"2024-03-04T13:00:27.409207+0000","last_undegraded":"2024-03-04T13:00:27.409207+0000","last_fullsized":"2024-03-04T13:00:27.409207+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'47","last_scrub_stamp":"2024-03-04T13:00:27.409102+0000","last_deep_scrub":"256'47","last_deep_scrub_stamp":"2024-03-04T13:00:27.409102+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.409102+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:54:12.358389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":112,"num_write":82,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.003461+0000","last_change":"2024-03-04T12:51:01.353480+0000","last_active":"2024-03-04T13:00:21.003461+0000","last_peered":"2024-03-04T13:00:21.003461+0000","last_clean":"2024-03-04T13:00:21.003461+0000","last_became_active":"2024-03-04T12:51:01.353087+0000","last_became_peered":"2024-03-04T12:51:01.353087+0000","last_unstale":"2024-03-04T13:00:21.003461+0000","last_undegraded":"2024-03-04T13:00:21.003461+0000","last_fullsized":"2024-03-04T13:00:21.003461+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:55.993709+0000","last_change":"2024-03-04T12:44:53.486342+0000","last_active":"2024-03-04T12:58:55.993709+0000","last_peered":"2024-03-04T12:58:55.993709+0000","last_clean":"2024-03-04T12:58:55.993709+0000","last_became_active":"2024-03-04T12:44:53.485819+0000","last_became_peered":"2024-03-04T12:44:53.485819+0000","last_unstale":"2024-03-04T12:58:55.993709+0000","last_undegraded":"2024-03-04T12:58:55.993709+0000","last_fullsized":"2024-03-04T12:58:55.993709+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"256'18","reported_seq":81,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.562350+0000","last_change":"2024-03-04T13:00:26.562385+0000","last_active":"2024-03-04T13:00:26.562350+0000","last_peered":"2024-03-04T13:00:26.562350+0000","last_clean":"2024-03-04T13:00:26.562350+0000","last_became_active":"2024-03-04T12:44:50.451612+0000","last_became_peered":"2024-03-04T12:44:50.451612+0000","last_unstale":"2024-03-04T13:00:26.562350+0000","last_undegraded":"2024-03-04T13:00:26.562350+0000","last_fullsized":"2024-03-04T13:00:26.562350+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'18","last_scrub_stamp":"2024-03-04T13:00:26.562265+0000","last_deep_scrub":"256'18","last_deep_scrub_stamp":"2024-03-04T13:00:26.562265+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.562265+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:30:31.690140+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":29700,"num_write":24,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"256'29","reported_seq":118,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.267423+0000","last_change":"2024-03-04T13:00:37.267495+0000","last_active":"2024-03-04T13:00:37.267423+0000","last_peered":"2024-03-04T13:00:37.267423+0000","last_clean":"2024-03-04T13:00:37.267423+0000","last_became_active":"2024-03-04T12:43:27.067356+0000","last_became_peered":"2024-03-04T12:43:27.067356+0000","last_unstale":"2024-03-04T13:00:37.267423+0000","last_undegraded":"2024-03-04T13:00:37.267423+0000","last_fullsized":"2024-03-04T13:00:37.267423+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'29","last_scrub_stamp":"2024-03-04T13:00:37.267297+0000","last_deep_scrub":"256'29","last_deep_scrub_stamp":"2024-03-04T13:00:37.267297+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.267297+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:05.403189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":50,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.003502+0000","last_change":"2024-03-04T12:51:01.353135+0000","last_active":"2024-03-04T13:00:21.003502+0000","last_peered":"2024-03-04T13:00:21.003502+0000","last_clean":"2024-03-04T13:00:21.003502+0000","last_became_active":"2024-03-04T12:51:01.352205+0000","last_became_peered":"2024-03-04T12:51:01.352205+0000","last_unstale":"2024-03-04T13:00:21.003502+0000","last_undegraded":"2024-03-04T13:00:21.003502+0000","last_fullsized":"2024-03-04T13:00:21.003502+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"256'10","reported_seq":57,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.111850+0000","last_change":"2024-03-04T13:00:40.111906+0000","last_active":"2024-03-04T13:00:40.111850+0000","last_peered":"2024-03-04T13:00:40.111850+0000","last_clean":"2024-03-04T13:00:40.111850+0000","last_became_active":"2024-03-04T12:44:53.479906+0000","last_became_peered":"2024-03-04T12:44:53.479906+0000","last_unstale":"2024-03-04T13:00:40.111850+0000","last_undegraded":"2024-03-04T13:00:40.111850+0000","last_fullsized":"2024-03-04T13:00:40.111850+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'10","last_scrub_stamp":"2024-03-04T13:00:40.111726+0000","last_deep_scrub":"256'10","last_deep_scrub_stamp":"2024-03-04T13:00:40.111726+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.111726+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:53.009649+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8765,"num_write":13,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"256'2","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.233487+0000","last_change":"2024-03-04T13:00:31.233511+0000","last_active":"2024-03-04T13:00:31.233487+0000","last_peered":"2024-03-04T13:00:31.233487+0000","last_clean":"2024-03-04T13:00:31.233487+0000","last_became_active":"2024-03-04T12:44:50.455705+0000","last_became_peered":"2024-03-04T12:44:50.455705+0000","last_unstale":"2024-03-04T13:00:31.233487+0000","last_undegraded":"2024-03-04T13:00:31.233487+0000","last_fullsized":"2024-03-04T13:00:31.233487+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:31.233395+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:31.233395+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.233395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:43:28.071292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"256'37","reported_seq":138,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.483753+0000","last_change":"2024-03-04T13:00:26.483782+0000","last_active":"2024-03-04T13:00:26.483753+0000","last_peered":"2024-03-04T13:00:26.483753+0000","last_clean":"2024-03-04T13:00:26.483753+0000","last_became_active":"2024-03-04T12:43:27.049948+0000","last_became_peered":"2024-03-04T12:43:27.049948+0000","last_unstale":"2024-03-04T13:00:26.483753+0000","last_undegraded":"2024-03-04T13:00:26.483753+0000","last_fullsized":"2024-03-04T13:00:26.483753+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'37","last_scrub_stamp":"2024-03-04T13:00:26.483653+0000","last_deep_scrub":"256'37","last_deep_scrub_stamp":"2024-03-04T13:00:26.483653+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.483653+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:53:44.304398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":102,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.012716+0000","last_change":"2024-03-04T12:51:01.355931+0000","last_active":"2024-03-04T13:00:21.012716+0000","last_peered":"2024-03-04T13:00:21.012716+0000","last_clean":"2024-03-04T13:00:21.012716+0000","last_became_active":"2024-03-04T12:51:01.355460+0000","last_became_peered":"2024-03-04T12:51:01.355460+0000","last_unstale":"2024-03-04T13:00:21.012716+0000","last_undegraded":"2024-03-04T13:00:21.012716+0000","last_fullsized":"2024-03-04T13:00:21.012716+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:56.009864+0000","last_change":"2024-03-04T12:44:53.483084+0000","last_active":"2024-03-04T12:58:56.009864+0000","last_peered":"2024-03-04T12:58:56.009864+0000","last_clean":"2024-03-04T12:58:56.009864+0000","last_became_active":"2024-03-04T12:44:53.482573+0000","last_became_peered":"2024-03-04T12:44:53.482573+0000","last_unstale":"2024-03-04T12:58:56.009864+0000","last_undegraded":"2024-03-04T12:58:56.009864+0000","last_fullsized":"2024-03-04T12:58:56.009864+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.707467+0000","last_change":"2024-03-04T13:00:22.707500+0000","last_active":"2024-03-04T13:00:22.707467+0000","last_peered":"2024-03-04T13:00:22.707467+0000","last_clean":"2024-03-04T13:00:22.707467+0000","last_became_active":"2024-03-04T12:44:50.450815+0000","last_became_peered":"2024-03-04T12:44:50.450815+0000","last_unstale":"2024-03-04T13:00:22.707467+0000","last_undegraded":"2024-03-04T13:00:22.707467+0000","last_fullsized":"2024-03-04T13:00:22.707467+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:22.707367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:22.707367+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.707367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:12:35.310838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"256'28","reported_seq":114,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.098819+0000","last_change":"2024-03-04T13:00:25.098849+0000","last_active":"2024-03-04T13:00:25.098819+0000","last_peered":"2024-03-04T13:00:25.098819+0000","last_clean":"2024-03-04T13:00:25.098819+0000","last_became_active":"2024-03-04T12:43:27.055932+0000","last_became_peered":"2024-03-04T12:43:27.055932+0000","last_unstale":"2024-03-04T13:00:25.098819+0000","last_undegraded":"2024-03-04T13:00:25.098819+0000","last_fullsized":"2024-03-04T13:00:25.098819+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'28","last_scrub_stamp":"2024-03-04T13:00:25.098717+0000","last_deep_scrub":"256'28","last_deep_scrub_stamp":"2024-03-04T13:00:25.098717+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.098717+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:13.975808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"253'1","reported_seq":24,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.004154+0000","last_change":"2024-03-04T12:51:01.356544+0000","last_active":"2024-03-04T13:00:21.004154+0000","last_peered":"2024-03-04T13:00:21.004154+0000","last_clean":"2024-03-04T13:00:21.004154+0000","last_became_active":"2024-03-04T12:51:01.356234+0000","last_became_peered":"2024-03-04T12:51:01.356234+0000","last_unstale":"2024-03-04T13:00:21.004154+0000","last_undegraded":"2024-03-04T13:00:21.004154+0000","last_fullsized":"2024-03-04T13:00:21.004154+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:56.000727+0000","last_change":"2024-03-04T12:44:53.481928+0000","last_active":"2024-03-04T12:58:56.000727+0000","last_peered":"2024-03-04T12:58:56.000727+0000","last_clean":"2024-03-04T12:58:56.000727+0000","last_became_active":"2024-03-04T12:44:53.481628+0000","last_became_peered":"2024-03-04T12:44:53.481628+0000","last_unstale":"2024-03-04T12:58:56.000727+0000","last_undegraded":"2024-03-04T12:58:56.000727+0000","last_fullsized":"2024-03-04T12:58:56.000727+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.076842+0000","last_change":"2024-03-04T13:00:24.076868+0000","last_active":"2024-03-04T13:00:24.076842+0000","last_peered":"2024-03-04T13:00:24.076842+0000","last_clean":"2024-03-04T13:00:24.076842+0000","last_became_active":"2024-03-04T12:44:50.457629+0000","last_became_peered":"2024-03-04T12:44:50.457629+0000","last_unstale":"2024-03-04T13:00:24.076842+0000","last_undegraded":"2024-03-04T13:00:24.076842+0000","last_fullsized":"2024-03-04T13:00:24.076842+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:24.076745+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:24.076745+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.076745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:23:15.455149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"256'46","reported_seq":157,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.678497+0000","last_change":"2024-03-04T13:00:27.678522+0000","last_active":"2024-03-04T13:00:27.678497+0000","last_peered":"2024-03-04T13:00:27.678497+0000","last_clean":"2024-03-04T13:00:27.678497+0000","last_became_active":"2024-03-04T12:43:27.061268+0000","last_became_peered":"2024-03-04T12:43:27.061268+0000","last_unstale":"2024-03-04T13:00:27.678497+0000","last_undegraded":"2024-03-04T13:00:27.678497+0000","last_fullsized":"2024-03-04T13:00:27.678497+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'46","last_scrub_stamp":"2024-03-04T13:00:27.678408+0000","last_deep_scrub":"256'46","last_deep_scrub_stamp":"2024-03-04T13:00:27.678408+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.678408+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:22.425866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":125,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"254'1","reported_seq":24,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.001457+0000","last_change":"2024-03-04T12:51:01.352006+0000","last_active":"2024-03-04T13:00:01.001457+0000","last_peered":"2024-03-04T13:00:01.001457+0000","last_clean":"2024-03-04T13:00:01.001457+0000","last_became_active":"2024-03-04T12:51:01.351718+0000","last_became_peered":"2024-03-04T12:51:01.351718+0000","last_unstale":"2024-03-04T13:00:01.001457+0000","last_undegraded":"2024-03-04T13:00:01.001457+0000","last_fullsized":"2024-03-04T13:00:01.001457+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"256'7","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.175102+0000","last_change":"2024-03-04T12:44:53.480592+0000","last_active":"2024-03-04T13:00:22.175102+0000","last_peered":"2024-03-04T13:00:22.175102+0000","last_clean":"2024-03-04T13:00:22.175102+0000","last_became_active":"2024-03-04T12:44:53.480237+0000","last_became_peered":"2024-03-04T12:44:53.480237+0000","last_unstale":"2024-03-04T13:00:22.175102+0000","last_undegraded":"2024-03-04T13:00:22.175102+0000","last_fullsized":"2024-03-04T13:00:22.175102+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"256'4","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.560377+0000","last_change":"2024-03-04T12:44:50.451651+0000","last_active":"2024-03-04T13:00:23.560377+0000","last_peered":"2024-03-04T13:00:23.560377+0000","last_clean":"2024-03-04T13:00:23.560377+0000","last_became_active":"2024-03-04T12:44:50.451353+0000","last_became_peered":"2024-03-04T12:44:50.451353+0000","last_unstale":"2024-03-04T13:00:23.560377+0000","last_undegraded":"2024-03-04T13:00:23.560377+0000","last_fullsized":"2024-03-04T13:00:23.560377+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"256'22","reported_seq":97,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.408305+0000","last_change":"2024-03-04T13:00:32.408351+0000","last_active":"2024-03-04T13:00:32.408305+0000","last_peered":"2024-03-04T13:00:32.408305+0000","last_clean":"2024-03-04T13:00:32.408305+0000","last_became_active":"2024-03-04T12:43:27.060626+0000","last_became_peered":"2024-03-04T12:43:27.060626+0000","last_unstale":"2024-03-04T13:00:32.408305+0000","last_undegraded":"2024-03-04T13:00:32.408305+0000","last_fullsized":"2024-03-04T13:00:32.408305+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'22","last_scrub_stamp":"2024-03-04T13:00:32.408218+0000","last_deep_scrub":"256'22","last_deep_scrub_stamp":"2024-03-04T13:00:32.408218+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.408218+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:27:11.399231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":39,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.001486+0000","last_change":"2024-03-04T12:51:01.356830+0000","last_active":"2024-03-04T13:00:01.001486+0000","last_peered":"2024-03-04T13:00:01.001486+0000","last_clean":"2024-03-04T13:00:01.001486+0000","last_became_active":"2024-03-04T12:51:01.356268+0000","last_became_peered":"2024-03-04T12:51:01.356268+0000","last_unstale":"2024-03-04T13:00:01.001486+0000","last_undegraded":"2024-03-04T13:00:01.001486+0000","last_fullsized":"2024-03-04T13:00:01.001486+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"256'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.483956+0000","last_change":"2024-03-04T12:44:53.489009+0000","last_active":"2024-03-04T13:00:24.483956+0000","last_peered":"2024-03-04T13:00:24.483956+0000","last_clean":"2024-03-04T13:00:24.483956+0000","last_became_active":"2024-03-04T12:44:53.488798+0000","last_became_peered":"2024-03-04T12:44:53.488798+0000","last_unstale":"2024-03-04T13:00:24.483956+0000","last_undegraded":"2024-03-04T13:00:24.483956+0000","last_fullsized":"2024-03-04T13:00:24.483956+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'9","reported_seq":61,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.712653+0000","last_change":"2024-03-04T13:00:23.712653+0000","last_active":"2024-03-04T13:00:23.712653+0000","last_peered":"2024-03-04T13:00:23.712653+0000","last_clean":"2024-03-04T13:00:23.712653+0000","last_became_active":"2024-03-04T12:44:50.449555+0000","last_became_peered":"2024-03-04T12:44:50.449555+0000","last_unstale":"2024-03-04T13:00:23.712653+0000","last_undegraded":"2024-03-04T13:00:23.712653+0000","last_fullsized":"2024-03-04T13:00:23.712653+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:23.712551+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:23.712551+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.712551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:19.679050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9220,"num_write":14,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"256'38","reported_seq":140,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.809948+0000","last_change":"2024-03-04T13:00:27.809977+0000","last_active":"2024-03-04T13:00:27.809948+0000","last_peered":"2024-03-04T13:00:27.809948+0000","last_clean":"2024-03-04T13:00:27.809948+0000","last_became_active":"2024-03-04T12:43:27.062618+0000","last_became_peered":"2024-03-04T12:43:27.062618+0000","last_unstale":"2024-03-04T13:00:27.809948+0000","last_undegraded":"2024-03-04T13:00:27.809948+0000","last_fullsized":"2024-03-04T13:00:27.809948+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'38","last_scrub_stamp":"2024-03-04T13:00:27.809856+0000","last_deep_scrub":"256'38","last_deep_scrub_stamp":"2024-03-04T13:00:27.809856+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.809856+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:07.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":110,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.001507+0000","last_change":"2024-03-04T12:51:01.358213+0000","last_active":"2024-03-04T13:00:01.001507+0000","last_peered":"2024-03-04T13:00:01.001507+0000","last_clean":"2024-03-04T13:00:01.001507+0000","last_became_active":"2024-03-04T12:51:01.357842+0000","last_became_peered":"2024-03-04T12:51:01.357842+0000","last_unstale":"2024-03-04T13:00:01.001507+0000","last_undegraded":"2024-03-04T13:00:01.001507+0000","last_fullsized":"2024-03-04T13:00:01.001507+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"256'2","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.389682+0000","last_change":"2024-03-04T13:00:30.389682+0000","last_active":"2024-03-04T13:00:30.389682+0000","last_peered":"2024-03-04T13:00:30.389682+0000","last_clean":"2024-03-04T13:00:30.389682+0000","last_became_active":"2024-03-04T12:44:53.483209+0000","last_became_peered":"2024-03-04T12:44:53.483209+0000","last_unstale":"2024-03-04T13:00:30.389682+0000","last_undegraded":"2024-03-04T13:00:30.389682+0000","last_fullsized":"2024-03-04T13:00:30.389682+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:30.389535+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:30.389535+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.389535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:42:25.469104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"256'6","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.175015+0000","last_change":"2024-03-04T12:44:50.458501+0000","last_active":"2024-03-04T13:00:22.175015+0000","last_peered":"2024-03-04T13:00:22.175015+0000","last_clean":"2024-03-04T13:00:22.175015+0000","last_became_active":"2024-03-04T12:44:50.458158+0000","last_became_peered":"2024-03-04T12:44:50.458158+0000","last_unstale":"2024-03-04T13:00:22.175015+0000","last_undegraded":"2024-03-04T13:00:22.175015+0000","last_fullsized":"2024-03-04T13:00:22.175015+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"256'48","reported_seq":159,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.106713+0000","last_change":"2024-03-04T13:00:23.106771+0000","last_active":"2024-03-04T13:00:23.106713+0000","last_peered":"2024-03-04T13:00:23.106713+0000","last_clean":"2024-03-04T13:00:23.106713+0000","last_became_active":"2024-03-04T12:43:27.058410+0000","last_became_peered":"2024-03-04T12:43:27.058410+0000","last_unstale":"2024-03-04T13:00:23.106713+0000","last_undegraded":"2024-03-04T13:00:23.106713+0000","last_fullsized":"2024-03-04T13:00:23.106713+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'48","last_scrub_stamp":"2024-03-04T13:00:23.106608+0000","last_deep_scrub":"256'48","last_deep_scrub_stamp":"2024-03-04T13:00:23.106608+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.106608+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:14:06.376944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":132,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.000985+0000","last_change":"2024-03-04T12:51:01.597461+0000","last_active":"2024-03-04T13:00:01.000985+0000","last_peered":"2024-03-04T13:00:01.000985+0000","last_clean":"2024-03-04T13:00:01.000985+0000","last_became_active":"2024-03-04T12:51:01.597162+0000","last_became_peered":"2024-03-04T12:51:01.597162+0000","last_unstale":"2024-03-04T13:00:01.000985+0000","last_undegraded":"2024-03-04T13:00:01.000985+0000","last_fullsized":"2024-03-04T13:00:01.000985+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.248049+0000","last_change":"2024-03-04T12:44:53.478668+0000","last_active":"2024-03-04T13:00:21.248049+0000","last_peered":"2024-03-04T13:00:21.248049+0000","last_clean":"2024-03-04T13:00:21.248049+0000","last_became_active":"2024-03-04T12:44:53.478352+0000","last_became_peered":"2024-03-04T12:44:53.478352+0000","last_unstale":"2024-03-04T13:00:21.248049+0000","last_undegraded":"2024-03-04T13:00:21.248049+0000","last_fullsized":"2024-03-04T13:00:21.248049+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"256'2","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.853284+0000","last_change":"2024-03-04T13:00:26.853284+0000","last_active":"2024-03-04T13:00:26.853284+0000","last_peered":"2024-03-04T13:00:26.853284+0000","last_clean":"2024-03-04T13:00:26.853284+0000","last_became_active":"2024-03-04T12:44:50.449627+0000","last_became_peered":"2024-03-04T12:44:50.449627+0000","last_unstale":"2024-03-04T13:00:26.853284+0000","last_undegraded":"2024-03-04T13:00:26.853284+0000","last_fullsized":"2024-03-04T13:00:26.853284+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:26.853152+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:26.853152+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.853152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:58:13.931570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"244'9","reported_seq":74,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.490326+0000","last_change":"2024-03-04T13:00:24.490356+0000","last_active":"2024-03-04T13:00:24.490326+0000","last_peered":"2024-03-04T13:00:24.490326+0000","last_clean":"2024-03-04T13:00:24.490326+0000","last_became_active":"2024-03-04T12:43:27.057074+0000","last_became_peered":"2024-03-04T12:43:27.057074+0000","last_unstale":"2024-03-04T13:00:24.490326+0000","last_undegraded":"2024-03-04T13:00:24.490326+0000","last_fullsized":"2024-03-04T13:00:24.490326+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'9","last_scrub_stamp":"2024-03-04T13:00:24.490225+0000","last_deep_scrub":"244'9","last_deep_scrub_stamp":"2024-03-04T13:00:24.490225+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.490225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:02:04.720591+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:40.900296+0000","last_change":"2024-03-04T12:51:01.595664+0000","last_active":"2024-03-04T12:59:40.900296+0000","last_peered":"2024-03-04T12:59:40.900296+0000","last_clean":"2024-03-04T12:59:40.900296+0000","last_became_active":"2024-03-04T12:51:01.595390+0000","last_became_peered":"2024-03-04T12:51:01.595390+0000","last_unstale":"2024-03-04T12:59:40.900296+0000","last_undegraded":"2024-03-04T12:59:40.900296+0000","last_fullsized":"2024-03-04T12:59:40.900296+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"256'8","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.388528+0000","last_change":"2024-03-04T13:00:34.388557+0000","last_active":"2024-03-04T13:00:34.388528+0000","last_peered":"2024-03-04T13:00:34.388528+0000","last_clean":"2024-03-04T13:00:34.388528+0000","last_became_active":"2024-03-04T12:44:53.482800+0000","last_became_peered":"2024-03-04T12:44:53.482800+0000","last_unstale":"2024-03-04T13:00:34.388528+0000","last_undegraded":"2024-03-04T13:00:34.388528+0000","last_fullsized":"2024-03-04T13:00:34.388528+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'8","last_scrub_stamp":"2024-03-04T13:00:34.388440+0000","last_deep_scrub":"256'8","last_deep_scrub_stamp":"2024-03-04T13:00:34.388440+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.388440+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:24.212679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'9","reported_seq":61,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.307581+0000","last_change":"2024-03-04T13:00:35.307629+0000","last_active":"2024-03-04T13:00:35.307581+0000","last_peered":"2024-03-04T13:00:35.307581+0000","last_clean":"2024-03-04T13:00:35.307581+0000","last_became_active":"2024-03-04T12:44:50.455937+0000","last_became_peered":"2024-03-04T12:44:50.455937+0000","last_unstale":"2024-03-04T13:00:35.307581+0000","last_undegraded":"2024-03-04T13:00:35.307581+0000","last_fullsized":"2024-03-04T13:00:35.307581+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:35.307447+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:35.307447+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.307447+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:52:38.354029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":7,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"256'148","reported_seq":399,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.394377+0000","last_change":"2024-03-04T13:00:24.394420+0000","last_active":"2024-03-04T13:00:24.394377+0000","last_peered":"2024-03-04T13:00:24.394377+0000","last_clean":"2024-03-04T13:00:24.394377+0000","last_became_active":"2024-03-04T12:43:27.065085+0000","last_became_peered":"2024-03-04T12:43:27.065085+0000","last_unstale":"2024-03-04T13:00:24.394377+0000","last_undegraded":"2024-03-04T13:00:24.394377+0000","last_fullsized":"2024-03-04T13:00:24.394377+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'148","last_scrub_stamp":"2024-03-04T13:00:24.394285+0000","last_deep_scrub":"256'148","last_deep_scrub_stamp":"2024-03-04T13:00:24.394285+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.394285+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:09:50.870191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":610,"num_read_kb":432,"num_write":236,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:41.017706+0000","last_change":"2024-03-04T12:51:01.353357+0000","last_active":"2024-03-04T12:59:41.017706+0000","last_peered":"2024-03-04T12:59:41.017706+0000","last_clean":"2024-03-04T12:59:41.017706+0000","last_became_active":"2024-03-04T12:51:01.353012+0000","last_became_peered":"2024-03-04T12:51:01.353012+0000","last_unstale":"2024-03-04T12:59:41.017706+0000","last_undegraded":"2024-03-04T12:59:41.017706+0000","last_fullsized":"2024-03-04T12:59:41.017706+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"256'6","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.371098+0000","last_change":"2024-03-04T12:44:53.484778+0000","last_active":"2024-03-04T13:00:16.371098+0000","last_peered":"2024-03-04T13:00:16.371098+0000","last_clean":"2024-03-04T13:00:16.371098+0000","last_became_active":"2024-03-04T12:44:53.484514+0000","last_became_peered":"2024-03-04T12:44:53.484514+0000","last_unstale":"2024-03-04T13:00:16.371098+0000","last_undegraded":"2024-03-04T13:00:16.371098+0000","last_fullsized":"2024-03-04T13:00:16.371098+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4138,"num_write":5,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"256'5","reported_seq":55,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.650563+0000","last_change":"2024-03-04T13:00:21.650563+0000","last_active":"2024-03-04T13:00:21.650563+0000","last_peered":"2024-03-04T13:00:21.650563+0000","last_clean":"2024-03-04T13:00:21.650563+0000","last_became_active":"2024-03-04T12:44:50.450101+0000","last_became_peered":"2024-03-04T12:44:50.450101+0000","last_unstale":"2024-03-04T13:00:21.650563+0000","last_undegraded":"2024-03-04T13:00:21.650563+0000","last_fullsized":"2024-03-04T13:00:21.650563+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'5","last_scrub_stamp":"2024-03-04T13:00:21.650477+0000","last_deep_scrub":"256'5","last_deep_scrub_stamp":"2024-03-04T13:00:21.650477+0000","last_clean_scrub_stamp":"2024-03-04T13:00:21.650477+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:03.543521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"256'27","reported_seq":99,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:40.992848+0000","last_change":"2024-03-04T12:43:27.068000+0000","last_active":"2024-03-04T12:58:40.992848+0000","last_peered":"2024-03-04T12:58:40.992848+0000","last_clean":"2024-03-04T12:58:40.992848+0000","last_became_active":"2024-03-04T12:43:27.067391+0000","last_became_peered":"2024-03-04T12:43:27.067391+0000","last_unstale":"2024-03-04T12:58:40.992848+0000","last_undegraded":"2024-03-04T12:58:40.992848+0000","last_fullsized":"2024-03-04T12:58:40.992848+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:43:26.030121+0000","last_clean_scrub_stamp":"2024-03-04T12:43:26.030121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:45.901089+0000","last_change":"2024-03-04T12:51:01.352487+0000","last_active":"2024-03-04T12:59:45.901089+0000","last_peered":"2024-03-04T12:59:45.901089+0000","last_clean":"2024-03-04T12:59:45.901089+0000","last_became_active":"2024-03-04T12:51:01.352191+0000","last_became_peered":"2024-03-04T12:51:01.352191+0000","last_unstale":"2024-03-04T12:59:45.901089+0000","last_undegraded":"2024-03-04T12:59:45.901089+0000","last_fullsized":"2024-03-04T12:59:45.901089+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"256'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.094241+0000","last_change":"2024-03-04T12:44:53.482531+0000","last_active":"2024-03-04T13:00:23.094241+0000","last_peered":"2024-03-04T13:00:23.094241+0000","last_clean":"2024-03-04T13:00:23.094241+0000","last_became_active":"2024-03-04T12:44:53.482253+0000","last_became_peered":"2024-03-04T12:44:53.482253+0000","last_unstale":"2024-03-04T13:00:23.094241+0000","last_undegraded":"2024-03-04T13:00:23.094241+0000","last_fullsized":"2024-03-04T13:00:23.094241+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.881073+0000","last_change":"2024-03-04T13:00:24.881117+0000","last_active":"2024-03-04T13:00:24.881073+0000","last_peered":"2024-03-04T13:00:24.881073+0000","last_clean":"2024-03-04T13:00:24.881073+0000","last_became_active":"2024-03-04T12:44:50.449070+0000","last_became_peered":"2024-03-04T12:44:50.449070+0000","last_unstale":"2024-03-04T13:00:24.881073+0000","last_undegraded":"2024-03-04T13:00:24.881073+0000","last_fullsized":"2024-03-04T13:00:24.881073+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:24.880951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:24.880951+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.880951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:20:20.554220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"256'13","reported_seq":80,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.330231+0000","last_change":"2024-03-04T13:00:33.330260+0000","last_active":"2024-03-04T13:00:33.330231+0000","last_peered":"2024-03-04T13:00:33.330231+0000","last_clean":"2024-03-04T13:00:33.330231+0000","last_became_active":"2024-03-04T12:43:27.061574+0000","last_became_peered":"2024-03-04T12:43:27.061574+0000","last_unstale":"2024-03-04T13:00:33.330231+0000","last_undegraded":"2024-03-04T13:00:33.330231+0000","last_fullsized":"2024-03-04T13:00:33.330231+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'13","last_scrub_stamp":"2024-03-04T13:00:33.330135+0000","last_deep_scrub":"256'13","last_deep_scrub_stamp":"2024-03-04T13:00:33.330135+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.330135+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:29:30.807030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.000860+0000","last_change":"2024-03-04T12:51:01.356675+0000","last_active":"2024-03-04T13:00:01.000860+0000","last_peered":"2024-03-04T13:00:01.000860+0000","last_clean":"2024-03-04T13:00:01.000860+0000","last_became_active":"2024-03-04T12:51:01.356286+0000","last_became_peered":"2024-03-04T12:51:01.356286+0000","last_unstale":"2024-03-04T13:00:01.000860+0000","last_undegraded":"2024-03-04T13:00:01.000860+0000","last_fullsized":"2024-03-04T13:00:01.000860+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"256'6","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.371386+0000","last_change":"2024-03-04T12:44:53.478083+0000","last_active":"2024-03-04T13:00:16.371386+0000","last_peered":"2024-03-04T13:00:16.371386+0000","last_clean":"2024-03-04T13:00:16.371386+0000","last_became_active":"2024-03-04T12:44:53.477801+0000","last_became_peered":"2024-03-04T12:44:53.477801+0000","last_unstale":"2024-03-04T13:00:16.371386+0000","last_undegraded":"2024-03-04T13:00:16.371386+0000","last_fullsized":"2024-03-04T13:00:16.371386+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"256'4","reported_seq":53,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.751624+0000","last_change":"2024-03-04T13:00:38.751670+0000","last_active":"2024-03-04T13:00:38.751624+0000","last_peered":"2024-03-04T13:00:38.751624+0000","last_clean":"2024-03-04T13:00:38.751624+0000","last_became_active":"2024-03-04T12:44:50.456005+0000","last_became_peered":"2024-03-04T12:44:50.456005+0000","last_unstale":"2024-03-04T13:00:38.751624+0000","last_undegraded":"2024-03-04T13:00:38.751624+0000","last_fullsized":"2024-03-04T13:00:38.751624+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:38.751516+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:38.751516+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.751516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:09.546730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"256'19","reported_seq":93,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.842045+0000","last_change":"2024-03-04T13:00:29.842089+0000","last_active":"2024-03-04T13:00:29.842045+0000","last_peered":"2024-03-04T13:00:29.842045+0000","last_clean":"2024-03-04T13:00:29.842045+0000","last_became_active":"2024-03-04T12:43:27.054951+0000","last_became_peered":"2024-03-04T12:43:27.054951+0000","last_unstale":"2024-03-04T13:00:29.842045+0000","last_undegraded":"2024-03-04T13:00:29.842045+0000","last_fullsized":"2024-03-04T13:00:29.842045+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'19","last_scrub_stamp":"2024-03-04T13:00:29.841916+0000","last_deep_scrub":"256'19","last_deep_scrub_stamp":"2024-03-04T13:00:29.841916+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.841916+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:10.346801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":48,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:21.013563+0000","last_change":"2024-03-04T12:51:01.596612+0000","last_active":"2024-03-04T12:59:21.013563+0000","last_peered":"2024-03-04T12:59:21.013563+0000","last_clean":"2024-03-04T12:59:21.013563+0000","last_became_active":"2024-03-04T12:51:01.596248+0000","last_became_peered":"2024-03-04T12:51:01.596248+0000","last_unstale":"2024-03-04T12:59:21.013563+0000","last_undegraded":"2024-03-04T12:59:21.013563+0000","last_fullsized":"2024-03-04T12:59:21.013563+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.998109+0000","last_change":"2024-03-04T12:44:53.481249+0000","last_active":"2024-03-04T12:59:30.998109+0000","last_peered":"2024-03-04T12:59:30.998109+0000","last_clean":"2024-03-04T12:59:30.998109+0000","last_became_active":"2024-03-04T12:44:53.480987+0000","last_became_peered":"2024-03-04T12:44:53.480987+0000","last_unstale":"2024-03-04T12:59:30.998109+0000","last_undegraded":"2024-03-04T12:59:30.998109+0000","last_fullsized":"2024-03-04T12:59:30.998109+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"256'4","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.932157+0000","last_change":"2024-03-04T12:44:50.456748+0000","last_active":"2024-03-04T13:00:15.932157+0000","last_peered":"2024-03-04T13:00:15.932157+0000","last_clean":"2024-03-04T13:00:15.932157+0000","last_became_active":"2024-03-04T12:44:50.455944+0000","last_became_peered":"2024-03-04T12:44:50.455944+0000","last_unstale":"2024-03-04T13:00:15.932157+0000","last_undegraded":"2024-03-04T13:00:15.932157+0000","last_fullsized":"2024-03-04T13:00:15.932157+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"256'15","reported_seq":87,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.306557+0000","last_change":"2024-03-04T13:00:31.306584+0000","last_active":"2024-03-04T13:00:31.306557+0000","last_peered":"2024-03-04T13:00:31.306557+0000","last_clean":"2024-03-04T13:00:31.306557+0000","last_became_active":"2024-03-04T12:43:27.060180+0000","last_became_peered":"2024-03-04T12:43:27.060180+0000","last_unstale":"2024-03-04T13:00:31.306557+0000","last_undegraded":"2024-03-04T13:00:31.306557+0000","last_fullsized":"2024-03-04T13:00:31.306557+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'15","last_scrub_stamp":"2024-03-04T13:00:31.306462+0000","last_deep_scrub":"256'15","last_deep_scrub_stamp":"2024-03-04T13:00:31.306462+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.306462+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:02.641888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:21.013593+0000","last_change":"2024-03-04T12:51:01.350629+0000","last_active":"2024-03-04T12:59:21.013593+0000","last_peered":"2024-03-04T12:59:21.013593+0000","last_clean":"2024-03-04T12:59:21.013593+0000","last_became_active":"2024-03-04T12:51:01.350349+0000","last_became_peered":"2024-03-04T12:51:01.350349+0000","last_unstale":"2024-03-04T12:59:21.013593+0000","last_undegraded":"2024-03-04T12:59:21.013593+0000","last_fullsized":"2024-03-04T12:59:21.013593+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"256'6","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.496718+0000","last_change":"2024-03-04T12:44:53.485721+0000","last_active":"2024-03-04T13:00:16.496718+0000","last_peered":"2024-03-04T13:00:16.496718+0000","last_clean":"2024-03-04T13:00:16.496718+0000","last_became_active":"2024-03-04T12:44:53.485429+0000","last_became_peered":"2024-03-04T12:44:53.485429+0000","last_unstale":"2024-03-04T13:00:16.496718+0000","last_undegraded":"2024-03-04T13:00:16.496718+0000","last_fullsized":"2024-03-04T13:00:16.496718+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"256'6","reported_seq":58,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.607925+0000","last_change":"2024-03-04T13:00:30.607966+0000","last_active":"2024-03-04T13:00:30.607925+0000","last_peered":"2024-03-04T13:00:30.607925+0000","last_clean":"2024-03-04T13:00:30.607925+0000","last_became_active":"2024-03-04T12:44:50.452611+0000","last_became_peered":"2024-03-04T12:44:50.452611+0000","last_unstale":"2024-03-04T13:00:30.607925+0000","last_undegraded":"2024-03-04T13:00:30.607925+0000","last_fullsized":"2024-03-04T13:00:30.607925+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:30.607817+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:30.607817+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.607817+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:57.889690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"256'20","reported_seq":100,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.270297+0000","last_change":"2024-03-04T13:00:29.270359+0000","last_active":"2024-03-04T13:00:29.270297+0000","last_peered":"2024-03-04T13:00:29.270297+0000","last_clean":"2024-03-04T13:00:29.270297+0000","last_became_active":"2024-03-04T12:43:27.064375+0000","last_became_peered":"2024-03-04T12:43:27.064375+0000","last_unstale":"2024-03-04T13:00:29.270297+0000","last_undegraded":"2024-03-04T13:00:29.270297+0000","last_fullsized":"2024-03-04T13:00:29.270297+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'20","last_scrub_stamp":"2024-03-04T13:00:29.270196+0000","last_deep_scrub":"256'20","last_deep_scrub_stamp":"2024-03-04T13:00:29.270196+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.270196+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:33:53.986271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":61,"num_write":47,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"252'1","reported_seq":24,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:41.017834+0000","last_change":"2024-03-04T12:51:01.350196+0000","last_active":"2024-03-04T12:59:41.017834+0000","last_peered":"2024-03-04T12:59:41.017834+0000","last_clean":"2024-03-04T12:59:41.017834+0000","last_became_active":"2024-03-04T12:51:01.349889+0000","last_became_peered":"2024-03-04T12:51:01.349889+0000","last_unstale":"2024-03-04T12:59:41.017834+0000","last_undegraded":"2024-03-04T12:59:41.017834+0000","last_fullsized":"2024-03-04T12:59:41.017834+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"256'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.966225+0000","last_change":"2024-03-04T12:44:53.489468+0000","last_active":"2024-03-04T13:00:16.966225+0000","last_peered":"2024-03-04T13:00:16.966225+0000","last_clean":"2024-03-04T13:00:16.966225+0000","last_became_active":"2024-03-04T12:44:53.489232+0000","last_became_peered":"2024-03-04T12:44:53.489232+0000","last_unstale":"2024-03-04T13:00:16.966225+0000","last_undegraded":"2024-03-04T13:00:16.966225+0000","last_fullsized":"2024-03-04T13:00:16.966225+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.377159+0000","last_change":"2024-03-04T13:00:26.377182+0000","last_active":"2024-03-04T13:00:26.377159+0000","last_peered":"2024-03-04T13:00:26.377159+0000","last_clean":"2024-03-04T13:00:26.377159+0000","last_became_active":"2024-03-04T12:44:50.459359+0000","last_became_peered":"2024-03-04T12:44:50.459359+0000","last_unstale":"2024-03-04T13:00:26.377159+0000","last_undegraded":"2024-03-04T13:00:26.377159+0000","last_fullsized":"2024-03-04T13:00:26.377159+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:26.377070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:26.377070+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.377070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:23.336645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"256'25","reported_seq":115,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.519803+0000","last_change":"2024-03-04T13:00:28.519828+0000","last_active":"2024-03-04T13:00:28.519803+0000","last_peered":"2024-03-04T13:00:28.519803+0000","last_clean":"2024-03-04T13:00:28.519803+0000","last_became_active":"2024-03-04T12:43:27.060115+0000","last_became_peered":"2024-03-04T12:43:27.060115+0000","last_unstale":"2024-03-04T13:00:28.519803+0000","last_undegraded":"2024-03-04T13:00:28.519803+0000","last_fullsized":"2024-03-04T13:00:28.519803+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'25","last_scrub_stamp":"2024-03-04T13:00:28.519719+0000","last_deep_scrub":"256'25","last_deep_scrub_stamp":"2024-03-04T13:00:28.519719+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.519719+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:26.466728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:40.900395+0000","last_change":"2024-03-04T12:51:01.596756+0000","last_active":"2024-03-04T12:59:40.900395+0000","last_peered":"2024-03-04T12:59:40.900395+0000","last_clean":"2024-03-04T12:59:40.900395+0000","last_became_active":"2024-03-04T12:51:01.596463+0000","last_became_peered":"2024-03-04T12:51:01.596463+0000","last_unstale":"2024-03-04T12:59:40.900395+0000","last_undegraded":"2024-03-04T12:59:40.900395+0000","last_fullsized":"2024-03-04T12:59:40.900395+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"256'6","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.373630+0000","last_change":"2024-03-04T12:44:53.479417+0000","last_active":"2024-03-04T13:00:16.373630+0000","last_peered":"2024-03-04T13:00:16.373630+0000","last_clean":"2024-03-04T13:00:16.373630+0000","last_became_active":"2024-03-04T12:44:53.479076+0000","last_became_peered":"2024-03-04T12:44:53.479076+0000","last_unstale":"2024-03-04T13:00:16.373630+0000","last_undegraded":"2024-03-04T13:00:16.373630+0000","last_fullsized":"2024-03-04T13:00:16.373630+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"256'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.266006+0000","last_change":"2024-03-04T13:00:27.266052+0000","last_active":"2024-03-04T13:00:27.266006+0000","last_peered":"2024-03-04T13:00:27.266006+0000","last_clean":"2024-03-04T13:00:27.266006+0000","last_became_active":"2024-03-04T12:44:50.454398+0000","last_became_peered":"2024-03-04T12:44:50.454398+0000","last_unstale":"2024-03-04T13:00:27.266006+0000","last_undegraded":"2024-03-04T13:00:27.266006+0000","last_fullsized":"2024-03-04T13:00:27.266006+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:27.265871+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:27.265871+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.265871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:12:37.304071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"256'33","reported_seq":126,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.266710+0000","last_change":"2024-03-04T13:00:32.266736+0000","last_active":"2024-03-04T13:00:32.266710+0000","last_peered":"2024-03-04T13:00:32.266710+0000","last_clean":"2024-03-04T13:00:32.266710+0000","last_became_active":"2024-03-04T12:43:27.060589+0000","last_became_peered":"2024-03-04T12:43:27.060589+0000","last_unstale":"2024-03-04T13:00:32.266710+0000","last_undegraded":"2024-03-04T13:00:32.266710+0000","last_fullsized":"2024-03-04T13:00:32.266710+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'33","last_scrub_stamp":"2024-03-04T13:00:32.266584+0000","last_deep_scrub":"256'33","last_deep_scrub_stamp":"2024-03-04T13:00:32.266584+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.266584+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:51:33.406291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":90,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:01.010574+0000","last_change":"2024-03-04T12:51:01.357439+0000","last_active":"2024-03-04T12:59:01.010574+0000","last_peered":"2024-03-04T12:59:01.010574+0000","last_clean":"2024-03-04T12:59:01.010574+0000","last_became_active":"2024-03-04T12:51:01.355416+0000","last_became_peered":"2024-03-04T12:51:01.355416+0000","last_unstale":"2024-03-04T12:59:01.010574+0000","last_undegraded":"2024-03-04T12:59:01.010574+0000","last_fullsized":"2024-03-04T12:59:01.010574+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"256'2","reported_seq":36,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.494462+0000","last_change":"2024-03-04T12:44:53.486527+0000","last_active":"2024-03-04T13:00:15.494462+0000","last_peered":"2024-03-04T13:00:15.494462+0000","last_clean":"2024-03-04T13:00:15.494462+0000","last_became_active":"2024-03-04T12:44:53.486235+0000","last_became_peered":"2024-03-04T12:44:53.486235+0000","last_unstale":"2024-03-04T13:00:15.494462+0000","last_undegraded":"2024-03-04T13:00:15.494462+0000","last_fullsized":"2024-03-04T13:00:15.494462+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"256'7","reported_seq":57,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.126064+0000","last_change":"2024-03-04T13:00:28.126118+0000","last_active":"2024-03-04T13:00:28.126064+0000","last_peered":"2024-03-04T13:00:28.126064+0000","last_clean":"2024-03-04T13:00:28.126064+0000","last_became_active":"2024-03-04T12:44:50.458610+0000","last_became_peered":"2024-03-04T12:44:50.458610+0000","last_unstale":"2024-03-04T13:00:28.126064+0000","last_undegraded":"2024-03-04T13:00:28.126064+0000","last_fullsized":"2024-03-04T13:00:28.126064+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:00:28.125955+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:00:28.125955+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.125955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:00.483454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7739,"num_write":12,"num_write_kb":7739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"256'17","reported_seq":88,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.665270+0000","last_change":"2024-03-04T13:00:24.665292+0000","last_active":"2024-03-04T13:00:24.665270+0000","last_peered":"2024-03-04T13:00:24.665270+0000","last_clean":"2024-03-04T13:00:24.665270+0000","last_became_active":"2024-03-04T12:43:27.067223+0000","last_became_peered":"2024-03-04T12:43:27.067223+0000","last_unstale":"2024-03-04T13:00:24.665270+0000","last_undegraded":"2024-03-04T13:00:24.665270+0000","last_fullsized":"2024-03-04T13:00:24.665270+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'17","last_scrub_stamp":"2024-03-04T13:00:24.665191+0000","last_deep_scrub":"256'17","last_deep_scrub_stamp":"2024-03-04T13:00:24.665191+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.665191+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:39.414488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":41,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:20.996344+0000","last_change":"2024-03-04T12:51:01.353788+0000","last_active":"2024-03-04T12:59:20.996344+0000","last_peered":"2024-03-04T12:59:20.996344+0000","last_clean":"2024-03-04T12:59:20.996344+0000","last_became_active":"2024-03-04T12:51:01.353432+0000","last_became_peered":"2024-03-04T12:51:01.353432+0000","last_unstale":"2024-03-04T12:59:20.996344+0000","last_undegraded":"2024-03-04T12:59:20.996344+0000","last_fullsized":"2024-03-04T12:59:20.996344+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"250'2","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.252461+0000","last_change":"2024-03-04T13:00:39.252491+0000","last_active":"2024-03-04T13:00:39.252461+0000","last_peered":"2024-03-04T13:00:39.252461+0000","last_clean":"2024-03-04T13:00:39.252461+0000","last_became_active":"2024-03-04T12:44:53.482370+0000","last_became_peered":"2024-03-04T12:44:53.482370+0000","last_unstale":"2024-03-04T13:00:39.252461+0000","last_undegraded":"2024-03-04T13:00:39.252461+0000","last_fullsized":"2024-03-04T13:00:39.252461+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:39.252370+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:39.252370+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.252370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:34.221417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"256'4","reported_seq":53,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.342117+0000","last_change":"2024-03-04T13:00:40.342144+0000","last_active":"2024-03-04T13:00:40.342117+0000","last_peered":"2024-03-04T13:00:40.342117+0000","last_clean":"2024-03-04T13:00:40.342117+0000","last_became_active":"2024-03-04T12:44:50.450681+0000","last_became_peered":"2024-03-04T12:44:50.450681+0000","last_unstale":"2024-03-04T13:00:40.342117+0000","last_undegraded":"2024-03-04T13:00:40.342117+0000","last_fullsized":"2024-03-04T13:00:40.342117+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:40.342026+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:40.342026+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.342026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:02.619334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":368,"num_write":4,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"256'61","reported_seq":205,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.795512+0000","last_change":"2024-03-04T13:00:28.795546+0000","last_active":"2024-03-04T13:00:28.795512+0000","last_peered":"2024-03-04T13:00:28.795512+0000","last_clean":"2024-03-04T13:00:28.795512+0000","last_became_active":"2024-03-04T12:43:27.056781+0000","last_became_peered":"2024-03-04T12:43:27.056781+0000","last_unstale":"2024-03-04T13:00:28.795512+0000","last_undegraded":"2024-03-04T13:00:28.795512+0000","last_fullsized":"2024-03-04T13:00:28.795512+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'61","last_scrub_stamp":"2024-03-04T13:00:28.795405+0000","last_deep_scrub":"256'61","last_deep_scrub_stamp":"2024-03-04T13:00:28.795405+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.795405+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:36.779728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":203,"num_write":94,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:21.014357+0000","last_change":"2024-03-04T12:51:01.349501+0000","last_active":"2024-03-04T12:59:21.014357+0000","last_peered":"2024-03-04T12:59:21.014357+0000","last_clean":"2024-03-04T12:59:21.014357+0000","last_became_active":"2024-03-04T12:51:01.349216+0000","last_became_peered":"2024-03-04T12:51:01.349216+0000","last_unstale":"2024-03-04T12:59:21.014357+0000","last_undegraded":"2024-03-04T12:59:21.014357+0000","last_fullsized":"2024-03-04T12:59:21.014357+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:31.005605+0000","last_change":"2024-03-04T12:44:53.479666+0000","last_active":"2024-03-04T12:59:31.005605+0000","last_peered":"2024-03-04T12:59:31.005605+0000","last_clean":"2024-03-04T12:59:31.005605+0000","last_became_active":"2024-03-04T12:44:53.479411+0000","last_became_peered":"2024-03-04T12:44:53.479411+0000","last_unstale":"2024-03-04T12:59:31.005605+0000","last_undegraded":"2024-03-04T12:59:31.005605+0000","last_fullsized":"2024-03-04T12:59:31.005605+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'5","reported_seq":55,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.248123+0000","last_change":"2024-03-04T13:00:26.248147+0000","last_active":"2024-03-04T13:00:26.248123+0000","last_peered":"2024-03-04T13:00:26.248123+0000","last_clean":"2024-03-04T13:00:26.248123+0000","last_became_active":"2024-03-04T12:44:50.451626+0000","last_became_peered":"2024-03-04T12:44:50.451626+0000","last_unstale":"2024-03-04T13:00:26.248123+0000","last_undegraded":"2024-03-04T13:00:26.248123+0000","last_fullsized":"2024-03-04T13:00:26.248123+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'5","last_scrub_stamp":"2024-03-04T13:00:26.248033+0000","last_deep_scrub":"256'5","last_deep_scrub_stamp":"2024-03-04T13:00:26.248033+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.248033+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:13:53.495710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"256'128","reported_seq":415,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.484418+0000","last_change":"2024-03-04T13:00:25.484470+0000","last_active":"2024-03-04T13:00:25.484418+0000","last_peered":"2024-03-04T13:00:25.484418+0000","last_clean":"2024-03-04T13:00:25.484418+0000","last_became_active":"2024-03-04T12:43:27.056007+0000","last_became_peered":"2024-03-04T12:43:27.056007+0000","last_unstale":"2024-03-04T13:00:25.484418+0000","last_undegraded":"2024-03-04T13:00:25.484418+0000","last_fullsized":"2024-03-04T13:00:25.484418+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'128","last_scrub_stamp":"2024-03-04T13:00:25.484311+0000","last_deep_scrub":"256'128","last_deep_scrub_stamp":"2024-03-04T13:00:25.484311+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.484311+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:29.733934+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":540,"num_write":158,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3984,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:21.004177+0000","last_change":"2024-03-04T12:51:01.354894+0000","last_active":"2024-03-04T12:59:21.004177+0000","last_peered":"2024-03-04T12:59:21.004177+0000","last_clean":"2024-03-04T12:59:21.004177+0000","last_became_active":"2024-03-04T12:51:01.354601+0000","last_became_peered":"2024-03-04T12:51:01.354601+0000","last_unstale":"2024-03-04T12:59:21.004177+0000","last_undegraded":"2024-03-04T12:59:21.004177+0000","last_fullsized":"2024-03-04T12:59:21.004177+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.997585+0000","last_change":"2024-03-04T12:44:53.486591+0000","last_active":"2024-03-04T12:59:30.997585+0000","last_peered":"2024-03-04T12:59:30.997585+0000","last_clean":"2024-03-04T12:59:30.997585+0000","last_became_active":"2024-03-04T12:44:53.486321+0000","last_became_peered":"2024-03-04T12:44:53.486321+0000","last_unstale":"2024-03-04T12:59:30.997585+0000","last_undegraded":"2024-03-04T12:59:30.997585+0000","last_fullsized":"2024-03-04T12:59:30.997585+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"250'2","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.800909+0000","last_change":"2024-03-04T13:00:30.800957+0000","last_active":"2024-03-04T13:00:30.800909+0000","last_peered":"2024-03-04T13:00:30.800909+0000","last_clean":"2024-03-04T13:00:30.800909+0000","last_became_active":"2024-03-04T12:44:50.456315+0000","last_became_peered":"2024-03-04T12:44:50.456315+0000","last_unstale":"2024-03-04T13:00:30.800909+0000","last_undegraded":"2024-03-04T13:00:30.800909+0000","last_fullsized":"2024-03-04T13:00:30.800909+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:30.800805+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:30.800805+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.800805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:08:28.741353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"256'28","reported_seq":113,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.336331+0000","last_change":"2024-03-04T13:00:35.336372+0000","last_active":"2024-03-04T13:00:35.336331+0000","last_peered":"2024-03-04T13:00:35.336331+0000","last_clean":"2024-03-04T13:00:35.336331+0000","last_became_active":"2024-03-04T12:43:27.064141+0000","last_became_peered":"2024-03-04T12:43:27.064141+0000","last_unstale":"2024-03-04T13:00:35.336331+0000","last_undegraded":"2024-03-04T13:00:35.336331+0000","last_fullsized":"2024-03-04T13:00:35.336331+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'28","last_scrub_stamp":"2024-03-04T13:00:35.336234+0000","last_deep_scrub":"256'28","last_deep_scrub_stamp":"2024-03-04T13:00:35.336234+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.336234+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:07.884382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"256'416","reported_seq":1071,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.315398+0000","last_change":"2024-03-04T13:00:27.315458+0000","last_active":"2024-03-04T13:00:27.315398+0000","last_peered":"2024-03-04T13:00:27.315398+0000","last_clean":"2024-03-04T13:00:27.315398+0000","last_became_active":"2024-03-04T12:36:40.392399+0000","last_became_peered":"2024-03-04T12:36:40.392399+0000","last_unstale":"2024-03-04T13:00:27.315398+0000","last_undegraded":"2024-03-04T13:00:27.315398+0000","last_fullsized":"2024-03-04T13:00:27.315398+0000","mapping_epoch":33,"log_start":"256'401","ondisk_log_start":"256'401","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'416","last_scrub_stamp":"2024-03-04T13:00:27.315312+0000","last_deep_scrub":"256'416","last_deep_scrub_stamp":"2024-03-04T13:00:27.315312+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.315312+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":401,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:33.045930+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194364,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":637,"num_read_kb":17405,"num_write":1486,"num_write_kb":42784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"256'1110","reported_seq":2694,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.847741+0000","last_change":"2024-03-04T12:36:07.296271+0000","last_active":"2024-03-04T12:59:48.847741+0000","last_peered":"2024-03-04T12:59:48.847741+0000","last_clean":"2024-03-04T12:59:48.847741+0000","last_became_active":"2024-03-04T12:36:07.295125+0000","last_became_peered":"2024-03-04T12:36:07.295125+0000","last_unstale":"2024-03-04T12:59:48.847741+0000","last_undegraded":"2024-03-04T12:59:48.847741+0000","last_fullsized":"2024-03-04T12:59:48.847741+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4869,"num_read_kb":4281,"num_write":1536,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"256'315","reported_seq":911,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.048856+0000","last_change":"2024-03-04T12:36:05.280982+0000","last_active":"2024-03-04T13:00:17.048856+0000","last_peered":"2024-03-04T13:00:17.048856+0000","last_clean":"2024-03-04T13:00:17.048856+0000","last_became_active":"2024-03-04T12:36:05.280695+0000","last_became_peered":"2024-03-04T12:36:05.280695+0000","last_unstale":"2024-03-04T13:00:17.048856+0000","last_undegraded":"2024-03-04T13:00:17.048856+0000","last_fullsized":"2024-03-04T13:00:17.048856+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256487,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":427,"num_read_kb":2412,"num_write":1141,"num_write_kb":20516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"256'544","reported_seq":1938,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.686473+0000","last_change":"2024-03-04T12:36:07.297041+0000","last_active":"2024-03-04T13:00:06.686473+0000","last_peered":"2024-03-04T13:00:06.686473+0000","last_clean":"2024-03-04T13:00:06.686473+0000","last_became_active":"2024-03-04T12:36:07.296651+0000","last_became_peered":"2024-03-04T12:36:07.296651+0000","last_unstale":"2024-03-04T13:00:06.686473+0000","last_undegraded":"2024-03-04T13:00:06.686473+0000","last_fullsized":"2024-03-04T13:00:06.686473+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2661,"num_read_kb":2496,"num_write":771,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"256'328","reported_seq":932,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.123923+0000","last_change":"2024-03-04T12:36:05.285321+0000","last_active":"2024-03-04T13:00:17.123923+0000","last_peered":"2024-03-04T13:00:17.123923+0000","last_clean":"2024-03-04T13:00:17.123923+0000","last_became_active":"2024-03-04T12:36:05.285054+0000","last_became_peered":"2024-03-04T12:36:05.285054+0000","last_unstale":"2024-03-04T13:00:17.123923+0000","last_undegraded":"2024-03-04T13:00:17.123923+0000","last_fullsized":"2024-03-04T13:00:17.123923+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695847,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":27372,"num_write":1039,"num_write_kb":18696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"256'594","reported_seq":2015,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:49.601829+0000","last_change":"2024-03-04T12:36:07.298949+0000","last_active":"2024-03-04T12:59:49.601829+0000","last_peered":"2024-03-04T12:59:49.601829+0000","last_clean":"2024-03-04T12:59:49.601829+0000","last_became_active":"2024-03-04T12:36:07.298528+0000","last_became_peered":"2024-03-04T12:36:07.298528+0000","last_unstale":"2024-03-04T12:59:49.601829+0000","last_undegraded":"2024-03-04T12:59:49.601829+0000","last_fullsized":"2024-03-04T12:59:49.601829+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":500,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2805,"num_read_kb":2500,"num_write":805,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"256'341","reported_seq":954,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.122087+0000","last_change":"2024-03-04T12:36:05.294821+0000","last_active":"2024-03-04T13:00:17.122087+0000","last_peered":"2024-03-04T13:00:17.122087+0000","last_clean":"2024-03-04T13:00:17.122087+0000","last_became_active":"2024-03-04T12:36:05.293768+0000","last_became_peered":"2024-03-04T12:36:05.293768+0000","last_unstale":"2024-03-04T13:00:17.122087+0000","last_undegraded":"2024-03-04T13:00:17.122087+0000","last_fullsized":"2024-03-04T13:00:17.122087+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436929,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":443,"num_read_kb":31950,"num_write":1089,"num_write_kb":37939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"256'778","reported_seq":2184,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.593025+0000","last_change":"2024-03-04T13:00:29.593056+0000","last_active":"2024-03-04T13:00:29.593025+0000","last_peered":"2024-03-04T13:00:29.593025+0000","last_clean":"2024-03-04T13:00:29.593025+0000","last_became_active":"2024-03-04T12:36:40.393715+0000","last_became_peered":"2024-03-04T12:36:40.393715+0000","last_unstale":"2024-03-04T13:00:29.593025+0000","last_undegraded":"2024-03-04T13:00:29.593025+0000","last_fullsized":"2024-03-04T13:00:29.593025+0000","mapping_epoch":33,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'778","last_scrub_stamp":"2024-03-04T13:00:29.592929+0000","last_deep_scrub":"256'778","last_deep_scrub_stamp":"2024-03-04T13:00:29.592929+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.592929+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:11:41.602243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3436,"num_read_kb":3037,"num_write":1058,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"256'377","reported_seq":1013,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.069712+0000","last_change":"2024-03-04T12:36:05.290798+0000","last_active":"2024-03-04T13:00:17.069712+0000","last_peered":"2024-03-04T13:00:17.069712+0000","last_clean":"2024-03-04T13:00:17.069712+0000","last_became_active":"2024-03-04T12:36:05.290178+0000","last_became_peered":"2024-03-04T12:36:05.290178+0000","last_unstale":"2024-03-04T13:00:17.069712+0000","last_undegraded":"2024-03-04T13:00:17.069712+0000","last_fullsized":"2024-03-04T13:00:17.069712+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":589,"num_read_kb":36032,"num_write":1373,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"256'371","reported_seq":1919,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:11.011165+0000","last_change":"2024-03-04T12:36:07.301906+0000","last_active":"2024-03-04T13:00:11.011165+0000","last_peered":"2024-03-04T13:00:11.011165+0000","last_clean":"2024-03-04T13:00:11.011165+0000","last_became_active":"2024-03-04T12:36:07.301582+0000","last_became_peered":"2024-03-04T12:36:07.301582+0000","last_unstale":"2024-03-04T13:00:11.011165+0000","last_undegraded":"2024-03-04T13:00:11.011165+0000","last_fullsized":"2024-03-04T13:00:11.011165+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2123,"num_read_kb":2049,"num_write":405,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"256'288","reported_seq":897,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.129212+0000","last_change":"2024-03-04T12:36:05.296558+0000","last_active":"2024-03-04T13:00:17.129212+0000","last_peered":"2024-03-04T13:00:17.129212+0000","last_clean":"2024-03-04T13:00:17.129212+0000","last_became_active":"2024-03-04T12:36:05.296284+0000","last_became_peered":"2024-03-04T12:36:05.296284+0000","last_unstale":"2024-03-04T13:00:17.129212+0000","last_undegraded":"2024-03-04T13:00:17.129212+0000","last_fullsized":"2024-03-04T13:00:17.129212+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3348453,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":381,"num_read_kb":80579,"num_write":950,"num_write_kb":32166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"256'779","reported_seq":2022,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:53.069657+0000","last_change":"2024-03-04T12:36:07.298292+0000","last_active":"2024-03-04T12:59:53.069657+0000","last_peered":"2024-03-04T12:59:53.069657+0000","last_clean":"2024-03-04T12:59:53.069657+0000","last_became_active":"2024-03-04T12:36:07.297953+0000","last_became_peered":"2024-03-04T12:36:07.297953+0000","last_unstale":"2024-03-04T12:59:53.069657+0000","last_undegraded":"2024-03-04T12:59:53.069657+0000","last_fullsized":"2024-03-04T12:59:53.069657+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3335,"num_read_kb":2888,"num_write":1111,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"256'309","reported_seq":1023,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.117581+0000","last_change":"2024-03-04T12:36:05.291622+0000","last_active":"2024-03-04T13:00:17.117581+0000","last_peered":"2024-03-04T13:00:17.117581+0000","last_clean":"2024-03-04T13:00:17.117581+0000","last_became_active":"2024-03-04T12:36:05.291041+0000","last_became_peered":"2024-03-04T12:36:05.291041+0000","last_unstale":"2024-03-04T13:00:17.117581+0000","last_undegraded":"2024-03-04T13:00:17.117581+0000","last_fullsized":"2024-03-04T13:00:17.117581+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2107533,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":775,"num_read_kb":12113,"num_write":1137,"num_write_kb":11806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"256'692","reported_seq":2092,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.690398+0000","last_change":"2024-03-04T12:36:07.297212+0000","last_active":"2024-03-04T13:00:06.690398+0000","last_peered":"2024-03-04T13:00:06.690398+0000","last_clean":"2024-03-04T13:00:06.690398+0000","last_became_active":"2024-03-04T12:36:07.296763+0000","last_became_peered":"2024-03-04T12:36:07.296763+0000","last_unstale":"2024-03-04T13:00:06.690398+0000","last_undegraded":"2024-03-04T13:00:06.690398+0000","last_fullsized":"2024-03-04T13:00:06.690398+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3139,"num_read_kb":2812,"num_write":915,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"256'291","reported_seq":894,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.112697+0000","last_change":"2024-03-04T12:36:05.295212+0000","last_active":"2024-03-04T13:00:17.112697+0000","last_peered":"2024-03-04T13:00:17.112697+0000","last_clean":"2024-03-04T13:00:17.112697+0000","last_became_active":"2024-03-04T12:36:05.294967+0000","last_became_peered":"2024-03-04T12:36:05.294967+0000","last_unstale":"2024-03-04T13:00:17.112697+0000","last_undegraded":"2024-03-04T13:00:17.112697+0000","last_fullsized":"2024-03-04T13:00:17.112697+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1332404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":383,"num_read_kb":71068,"num_write":934,"num_write_kb":54955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"256'783","reported_seq":2196,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.520036+0000","last_change":"2024-03-04T12:36:07.296706+0000","last_active":"2024-03-04T12:59:55.520036+0000","last_peered":"2024-03-04T12:59:55.520036+0000","last_clean":"2024-03-04T12:59:55.520036+0000","last_became_active":"2024-03-04T12:36:07.295530+0000","last_became_peered":"2024-03-04T12:36:07.295530+0000","last_unstale":"2024-03-04T12:59:55.520036+0000","last_undegraded":"2024-03-04T12:59:55.520036+0000","last_fullsized":"2024-03-04T12:59:55.520036+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3415,"num_read_kb":3026,"num_write":1069,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"256'351","reported_seq":1807,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.686413+0000","last_change":"2024-03-04T12:36:07.298974+0000","last_active":"2024-03-04T13:00:06.686413+0000","last_peered":"2024-03-04T13:00:06.686413+0000","last_clean":"2024-03-04T13:00:06.686413+0000","last_became_active":"2024-03-04T12:36:07.298539+0000","last_became_peered":"2024-03-04T12:36:07.298539+0000","last_unstale":"2024-03-04T13:00:06.686413+0000","last_undegraded":"2024-03-04T13:00:06.686413+0000","last_fullsized":"2024-03-04T13:00:06.686413+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1997,"num_read_kb":1912,"num_write":401,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"256'346","reported_seq":1038,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:20.906389+0000","last_change":"2024-03-04T12:36:05.295348+0000","last_active":"2024-03-04T13:00:20.906389+0000","last_peered":"2024-03-04T13:00:20.906389+0000","last_clean":"2024-03-04T13:00:20.906389+0000","last_became_active":"2024-03-04T12:36:05.295060+0000","last_became_peered":"2024-03-04T12:36:05.295060+0000","last_unstale":"2024-03-04T13:00:20.906389+0000","last_undegraded":"2024-03-04T13:00:20.906389+0000","last_fullsized":"2024-03-04T13:00:20.906389+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2255527,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":26330,"num_write":1306,"num_write_kb":36495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"256'327","reported_seq":1789,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.130427+0000","last_change":"2024-03-04T12:36:07.300589+0000","last_active":"2024-03-04T12:59:52.130427+0000","last_peered":"2024-03-04T12:59:52.130427+0000","last_clean":"2024-03-04T12:59:52.130427+0000","last_became_active":"2024-03-04T12:36:07.300270+0000","last_became_peered":"2024-03-04T12:36:07.300270+0000","last_unstale":"2024-03-04T12:59:52.130427+0000","last_undegraded":"2024-03-04T12:59:52.130427+0000","last_fullsized":"2024-03-04T12:59:52.130427+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2015,"num_read_kb":1950,"num_write":359,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"256'286","reported_seq":877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.054414+0000","last_change":"2024-03-04T12:36:05.296970+0000","last_active":"2024-03-04T13:00:17.054414+0000","last_peered":"2024-03-04T13:00:17.054414+0000","last_clean":"2024-03-04T13:00:17.054414+0000","last_became_active":"2024-03-04T12:36:05.296621+0000","last_became_peered":"2024-03-04T12:36:05.296621+0000","last_unstale":"2024-03-04T13:00:17.054414+0000","last_undegraded":"2024-03-04T13:00:17.054414+0000","last_fullsized":"2024-03-04T13:00:17.054414+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":406,"num_read_kb":30709,"num_write":973,"num_write_kb":28664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"256'400","reported_seq":1883,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.480885+0000","last_change":"2024-03-04T12:36:07.294272+0000","last_active":"2024-03-04T12:59:55.480885+0000","last_peered":"2024-03-04T12:59:55.480885+0000","last_clean":"2024-03-04T12:59:55.480885+0000","last_became_active":"2024-03-04T12:36:07.293952+0000","last_became_peered":"2024-03-04T12:36:07.293952+0000","last_unstale":"2024-03-04T12:59:55.480885+0000","last_undegraded":"2024-03-04T12:59:55.480885+0000","last_fullsized":"2024-03-04T12:59:55.480885+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2282,"num_read_kb":2164,"num_write":473,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"256'311","reported_seq":945,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.126411+0000","last_change":"2024-03-04T12:36:05.296143+0000","last_active":"2024-03-04T13:00:17.126411+0000","last_peered":"2024-03-04T13:00:17.126411+0000","last_clean":"2024-03-04T13:00:17.126411+0000","last_became_active":"2024-03-04T12:36:05.295832+0000","last_became_peered":"2024-03-04T12:36:05.295832+0000","last_unstale":"2024-03-04T13:00:17.126411+0000","last_undegraded":"2024-03-04T13:00:17.126411+0000","last_fullsized":"2024-03-04T13:00:17.126411+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456555,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":48295,"num_write":1243,"num_write_kb":38980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"256'623","reported_seq":2327,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.003275+0000","last_change":"2024-03-04T12:36:07.296100+0000","last_active":"2024-03-04T13:00:21.003275+0000","last_peered":"2024-03-04T13:00:21.003275+0000","last_clean":"2024-03-04T13:00:21.003275+0000","last_became_active":"2024-03-04T12:36:07.295798+0000","last_became_peered":"2024-03-04T12:36:07.295798+0000","last_unstale":"2024-03-04T13:00:21.003275+0000","last_undegraded":"2024-03-04T13:00:21.003275+0000","last_fullsized":"2024-03-04T13:00:21.003275+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":600,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3253,"num_read_kb":2977,"num_write":842,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"256'344","reported_seq":952,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.110830+0000","last_change":"2024-03-04T12:36:05.292220+0000","last_active":"2024-03-04T13:00:17.110830+0000","last_peered":"2024-03-04T13:00:17.110830+0000","last_clean":"2024-03-04T13:00:17.110830+0000","last_became_active":"2024-03-04T12:36:05.291477+0000","last_became_peered":"2024-03-04T12:36:05.291477+0000","last_unstale":"2024-03-04T13:00:17.110830+0000","last_undegraded":"2024-03-04T13:00:17.110830+0000","last_fullsized":"2024-03-04T13:00:17.110830+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730225,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":474,"num_read_kb":10302,"num_write":1224,"num_write_kb":24769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"256'368","reported_seq":1764,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.003304+0000","last_change":"2024-03-04T12:36:07.290412+0000","last_active":"2024-03-04T13:00:21.003304+0000","last_peered":"2024-03-04T13:00:21.003304+0000","last_clean":"2024-03-04T13:00:21.003304+0000","last_became_active":"2024-03-04T12:36:07.290104+0000","last_became_peered":"2024-03-04T12:36:07.290104+0000","last_unstale":"2024-03-04T13:00:21.003304+0000","last_undegraded":"2024-03-04T13:00:21.003304+0000","last_fullsized":"2024-03-04T13:00:21.003304+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2031,"num_read_kb":1912,"num_write":446,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"256'309","reported_seq":927,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.123420+0000","last_change":"2024-03-04T12:36:05.291422+0000","last_active":"2024-03-04T13:00:17.123420+0000","last_peered":"2024-03-04T13:00:17.123420+0000","last_clean":"2024-03-04T13:00:17.123420+0000","last_became_active":"2024-03-04T12:36:05.291096+0000","last_became_peered":"2024-03-04T12:36:05.291096+0000","last_unstale":"2024-03-04T13:00:17.123420+0000","last_undegraded":"2024-03-04T13:00:17.123420+0000","last_fullsized":"2024-03-04T13:00:17.123420+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":471,"num_read_kb":17846,"num_write":1202,"num_write_kb":33765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"256'451","reported_seq":2120,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.024043+0000","last_change":"2024-03-04T12:36:07.298549+0000","last_active":"2024-03-04T13:00:21.024043+0000","last_peered":"2024-03-04T13:00:21.024043+0000","last_clean":"2024-03-04T13:00:21.024043+0000","last_became_active":"2024-03-04T12:36:07.297989+0000","last_became_peered":"2024-03-04T12:36:07.297989+0000","last_unstale":"2024-03-04T13:00:21.024043+0000","last_undegraded":"2024-03-04T13:00:21.024043+0000","last_fullsized":"2024-03-04T13:00:21.024043+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2700,"num_read_kb":2549,"num_write":550,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"256'363","reported_seq":1028,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.027612+0000","last_change":"2024-03-04T12:36:05.281235+0000","last_active":"2024-03-04T13:00:17.027612+0000","last_peered":"2024-03-04T13:00:17.027612+0000","last_clean":"2024-03-04T13:00:17.027612+0000","last_became_active":"2024-03-04T12:36:05.280944+0000","last_became_peered":"2024-03-04T12:36:05.280944+0000","last_unstale":"2024-03-04T13:00:17.027612+0000","last_undegraded":"2024-03-04T13:00:17.027612+0000","last_fullsized":"2024-03-04T13:00:17.027612+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290369,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":724,"num_read_kb":21552,"num_write":1199,"num_write_kb":33499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"256'83","reported_seq":569,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.117129+0000","last_change":"2024-03-04T13:00:27.117158+0000","last_active":"2024-03-04T13:00:27.117129+0000","last_peered":"2024-03-04T13:00:27.117129+0000","last_clean":"2024-03-04T13:00:27.117129+0000","last_became_active":"2024-03-04T12:36:15.356314+0000","last_became_peered":"2024-03-04T12:36:15.356314+0000","last_unstale":"2024-03-04T13:00:27.117129+0000","last_undegraded":"2024-03-04T13:00:27.117129+0000","last_fullsized":"2024-03-04T13:00:27.117129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'83","last_scrub_stamp":"2024-03-04T13:00:27.117037+0000","last_deep_scrub":"256'83","last_deep_scrub_stamp":"2024-03-04T13:00:27.117037+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.117037+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:45.219404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":197,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"256'1096","reported_seq":2696,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.193884+0000","last_change":"2024-03-04T12:36:07.298156+0000","last_active":"2024-03-04T12:59:47.193884+0000","last_peered":"2024-03-04T12:59:47.193884+0000","last_clean":"2024-03-04T12:59:47.193884+0000","last_became_active":"2024-03-04T12:36:07.297879+0000","last_became_peered":"2024-03-04T12:36:07.297879+0000","last_unstale":"2024-03-04T12:59:47.193884+0000","last_undegraded":"2024-03-04T12:59:47.193884+0000","last_fullsized":"2024-03-04T12:59:47.193884+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4860,"num_read_kb":4288,"num_write":1505,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"256'377","reported_seq":986,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.117584+0000","last_change":"2024-03-04T12:36:05.297435+0000","last_active":"2024-03-04T13:00:17.117584+0000","last_peered":"2024-03-04T13:00:17.117584+0000","last_clean":"2024-03-04T13:00:17.117584+0000","last_became_active":"2024-03-04T12:36:05.296939+0000","last_became_peered":"2024-03-04T12:36:05.296939+0000","last_unstale":"2024-03-04T13:00:17.117584+0000","last_undegraded":"2024-03-04T13:00:17.117584+0000","last_fullsized":"2024-03-04T13:00:17.117584+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10962332,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":473,"num_read_kb":33218,"num_write":1212,"num_write_kb":53558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.024807+0000","last_change":"2024-03-04T12:36:09.314445+0000","last_active":"2024-03-04T13:00:21.024807+0000","last_peered":"2024-03-04T13:00:21.024807+0000","last_clean":"2024-03-04T13:00:21.024807+0000","last_became_active":"2024-03-04T12:36:09.314065+0000","last_became_peered":"2024-03-04T12:36:09.314065+0000","last_unstale":"2024-03-04T13:00:21.024807+0000","last_undegraded":"2024-03-04T13:00:21.024807+0000","last_fullsized":"2024-03-04T13:00:21.024807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"256'284","reported_seq":854,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.020489+0000","last_change":"2024-03-04T12:36:11.326254+0000","last_active":"2024-03-04T13:00:21.020489+0000","last_peered":"2024-03-04T13:00:21.020489+0000","last_clean":"2024-03-04T13:00:21.020489+0000","last_became_active":"2024-03-04T12:36:11.325995+0000","last_became_peered":"2024-03-04T12:36:11.325995+0000","last_unstale":"2024-03-04T13:00:21.020489+0000","last_undegraded":"2024-03-04T13:00:21.020489+0000","last_fullsized":"2024-03-04T13:00:21.020489+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43297,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1002,"num_write":366,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.250619+0000","last_change":"2024-03-04T13:00:38.250645+0000","last_active":"2024-03-04T13:00:38.250619+0000","last_peered":"2024-03-04T13:00:38.250619+0000","last_clean":"2024-03-04T13:00:38.250619+0000","last_became_active":"2024-03-04T12:36:13.339305+0000","last_became_peered":"2024-03-04T12:36:13.339305+0000","last_unstale":"2024-03-04T13:00:38.250619+0000","last_undegraded":"2024-03-04T13:00:38.250619+0000","last_fullsized":"2024-03-04T13:00:38.250619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:38.250535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:38.250535+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.250535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:52.534010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"256'2371","reported_seq":4152,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.436326+0000","last_change":"2024-03-04T13:00:35.436362+0000","last_active":"2024-03-04T13:00:35.436326+0000","last_peered":"2024-03-04T13:00:35.436326+0000","last_clean":"2024-03-04T13:00:35.436326+0000","last_became_active":"2024-03-04T12:36:15.362434+0000","last_became_peered":"2024-03-04T12:36:15.362434+0000","last_unstale":"2024-03-04T13:00:35.436326+0000","last_undegraded":"2024-03-04T13:00:35.436326+0000","last_fullsized":"2024-03-04T13:00:35.436326+0000","mapping_epoch":30,"log_start":"256'2300","ondisk_log_start":"256'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2371","last_scrub_stamp":"2024-03-04T13:00:35.436238+0000","last_deep_scrub":"256'2371","last_deep_scrub_stamp":"2024-03-04T13:00:35.436238+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.436238+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":2300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:04.019436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5876,"num_read_kb":5881,"num_write":4713,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"256'831","reported_seq":2405,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.024793+0000","last_change":"2024-03-04T12:36:07.295827+0000","last_active":"2024-03-04T13:00:21.024793+0000","last_peered":"2024-03-04T13:00:21.024793+0000","last_clean":"2024-03-04T13:00:21.024793+0000","last_became_active":"2024-03-04T12:36:07.295522+0000","last_became_peered":"2024-03-04T12:36:07.295522+0000","last_unstale":"2024-03-04T13:00:21.024793+0000","last_undegraded":"2024-03-04T13:00:21.024793+0000","last_fullsized":"2024-03-04T13:00:21.024793+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3820,"num_read_kb":3411,"num_write":1118,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"256'363","reported_seq":979,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.110038+0000","last_change":"2024-03-04T12:36:05.288481+0000","last_active":"2024-03-04T13:00:17.110038+0000","last_peered":"2024-03-04T13:00:17.110038+0000","last_clean":"2024-03-04T13:00:17.110038+0000","last_became_active":"2024-03-04T12:36:05.288208+0000","last_became_peered":"2024-03-04T12:36:05.288208+0000","last_unstale":"2024-03-04T13:00:17.110038+0000","last_undegraded":"2024-03-04T13:00:17.110038+0000","last_fullsized":"2024-03-04T13:00:17.110038+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":34780,"num_write":1176,"num_write_kb":45508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.998047+0000","last_change":"2024-03-04T12:36:09.309834+0000","last_active":"2024-03-04T12:59:30.998047+0000","last_peered":"2024-03-04T12:59:30.998047+0000","last_clean":"2024-03-04T12:59:30.998047+0000","last_became_active":"2024-03-04T12:36:09.309583+0000","last_became_peered":"2024-03-04T12:36:09.309583+0000","last_unstale":"2024-03-04T12:59:30.998047+0000","last_undegraded":"2024-03-04T12:59:30.998047+0000","last_fullsized":"2024-03-04T12:59:30.998047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"256'74","reported_seq":583,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.107034+0000","last_change":"2024-03-04T13:00:38.107070+0000","last_active":"2024-03-04T13:00:38.107034+0000","last_peered":"2024-03-04T13:00:38.107034+0000","last_clean":"2024-03-04T13:00:38.107034+0000","last_became_active":"2024-03-04T12:36:11.324761+0000","last_became_peered":"2024-03-04T12:36:11.324761+0000","last_unstale":"2024-03-04T13:00:38.107034+0000","last_undegraded":"2024-03-04T13:00:38.107034+0000","last_fullsized":"2024-03-04T13:00:38.107034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'74","last_scrub_stamp":"2024-03-04T13:00:38.106947+0000","last_deep_scrub":"256'74","last_deep_scrub_stamp":"2024-03-04T13:00:38.106947+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.106947+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:56:51.502742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":50,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.118375+0000","last_change":"2024-03-04T13:00:33.118401+0000","last_active":"2024-03-04T13:00:33.118375+0000","last_peered":"2024-03-04T13:00:33.118375+0000","last_clean":"2024-03-04T13:00:33.118375+0000","last_became_active":"2024-03-04T12:36:13.343072+0000","last_became_peered":"2024-03-04T12:36:13.343072+0000","last_unstale":"2024-03-04T13:00:33.118375+0000","last_undegraded":"2024-03-04T13:00:33.118375+0000","last_fullsized":"2024-03-04T13:00:33.118375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:33.118287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:33.118287+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.118287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:36:41.186234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"256'104","reported_seq":599,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.614263+0000","last_change":"2024-03-04T13:00:32.614323+0000","last_active":"2024-03-04T13:00:32.614263+0000","last_peered":"2024-03-04T13:00:32.614263+0000","last_clean":"2024-03-04T13:00:32.614263+0000","last_became_active":"2024-03-04T12:36:15.362354+0000","last_became_peered":"2024-03-04T12:36:15.362354+0000","last_unstale":"2024-03-04T13:00:32.614263+0000","last_undegraded":"2024-03-04T13:00:32.614263+0000","last_fullsized":"2024-03-04T13:00:32.614263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'104","last_scrub_stamp":"2024-03-04T13:00:32.614142+0000","last_deep_scrub":"256'104","last_deep_scrub_stamp":"2024-03-04T13:00:32.614142+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.614142+0000","objects_scrubbed":6,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:02:52.498658+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":121,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"256'345","reported_seq":1726,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.020472+0000","last_change":"2024-03-04T12:36:07.294690+0000","last_active":"2024-03-04T13:00:21.020472+0000","last_peered":"2024-03-04T13:00:21.020472+0000","last_clean":"2024-03-04T13:00:21.020472+0000","last_became_active":"2024-03-04T12:36:07.294328+0000","last_became_peered":"2024-03-04T12:36:07.294328+0000","last_unstale":"2024-03-04T13:00:21.020472+0000","last_undegraded":"2024-03-04T13:00:21.020472+0000","last_fullsized":"2024-03-04T13:00:21.020472+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1913,"num_read_kb":1818,"num_write":399,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"256'282","reported_seq":896,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.121058+0000","last_change":"2024-03-04T12:36:05.291937+0000","last_active":"2024-03-04T13:00:17.121058+0000","last_peered":"2024-03-04T13:00:17.121058+0000","last_clean":"2024-03-04T13:00:17.121058+0000","last_became_active":"2024-03-04T12:36:05.291366+0000","last_became_peered":"2024-03-04T12:36:05.291366+0000","last_unstale":"2024-03-04T13:00:17.121058+0000","last_undegraded":"2024-03-04T13:00:17.121058+0000","last_fullsized":"2024-03-04T13:00:17.121058+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":749491,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":10592,"num_write":1118,"num_write_kb":21097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.004303+0000","last_change":"2024-03-04T12:36:09.310004+0000","last_active":"2024-03-04T13:00:21.004303+0000","last_peered":"2024-03-04T13:00:21.004303+0000","last_clean":"2024-03-04T13:00:21.004303+0000","last_became_active":"2024-03-04T12:36:09.309749+0000","last_became_peered":"2024-03-04T12:36:09.309749+0000","last_unstale":"2024-03-04T13:00:21.004303+0000","last_undegraded":"2024-03-04T13:00:21.004303+0000","last_fullsized":"2024-03-04T13:00:21.004303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"256'86","reported_seq":598,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.298417+0000","last_change":"2024-03-04T13:00:28.298481+0000","last_active":"2024-03-04T13:00:28.298417+0000","last_peered":"2024-03-04T13:00:28.298417+0000","last_clean":"2024-03-04T13:00:28.298417+0000","last_became_active":"2024-03-04T12:36:11.324127+0000","last_became_peered":"2024-03-04T12:36:11.324127+0000","last_unstale":"2024-03-04T13:00:28.298417+0000","last_undegraded":"2024-03-04T13:00:28.298417+0000","last_fullsized":"2024-03-04T13:00:28.298417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'86","last_scrub_stamp":"2024-03-04T13:00:28.298332+0000","last_deep_scrub":"256'86","last_deep_scrub_stamp":"2024-03-04T13:00:28.298332+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.298332+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:29.180417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"256'510","reported_seq":1460,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.483641+0000","last_change":"2024-03-04T12:36:13.338671+0000","last_active":"2024-03-04T13:00:24.483641+0000","last_peered":"2024-03-04T13:00:24.483641+0000","last_clean":"2024-03-04T13:00:24.483641+0000","last_became_active":"2024-03-04T12:36:13.338070+0000","last_became_peered":"2024-03-04T12:36:13.338070+0000","last_unstale":"2024-03-04T13:00:24.483641+0000","last_undegraded":"2024-03-04T13:00:24.483641+0000","last_fullsized":"2024-03-04T13:00:24.483641+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"256'104","reported_seq":582,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.068360+0000","last_change":"2024-03-04T13:00:26.068390+0000","last_active":"2024-03-04T13:00:26.068360+0000","last_peered":"2024-03-04T13:00:26.068360+0000","last_clean":"2024-03-04T13:00:26.068360+0000","last_became_active":"2024-03-04T12:36:15.356417+0000","last_became_peered":"2024-03-04T12:36:15.356417+0000","last_unstale":"2024-03-04T13:00:26.068360+0000","last_undegraded":"2024-03-04T13:00:26.068360+0000","last_fullsized":"2024-03-04T13:00:26.068360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'104","last_scrub_stamp":"2024-03-04T13:00:26.068269+0000","last_deep_scrub":"256'104","last_deep_scrub_stamp":"2024-03-04T13:00:26.068269+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.068269+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:57.908639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"256'684","reported_seq":2110,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.004263+0000","last_change":"2024-03-04T12:36:07.293732+0000","last_active":"2024-03-04T13:00:21.004263+0000","last_peered":"2024-03-04T13:00:21.004263+0000","last_clean":"2024-03-04T13:00:21.004263+0000","last_became_active":"2024-03-04T12:36:07.293493+0000","last_became_peered":"2024-03-04T12:36:07.293493+0000","last_unstale":"2024-03-04T13:00:21.004263+0000","last_undegraded":"2024-03-04T13:00:21.004263+0000","last_fullsized":"2024-03-04T13:00:21.004263+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3120,"num_read_kb":2817,"num_write":901,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"256'392","reported_seq":1013,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.123768+0000","last_change":"2024-03-04T12:36:05.283970+0000","last_active":"2024-03-04T13:00:17.123768+0000","last_peered":"2024-03-04T13:00:17.123768+0000","last_clean":"2024-03-04T13:00:17.123768+0000","last_became_active":"2024-03-04T12:36:05.283477+0000","last_became_peered":"2024-03-04T12:36:05.283477+0000","last_unstale":"2024-03-04T13:00:17.123768+0000","last_undegraded":"2024-03-04T13:00:17.123768+0000","last_fullsized":"2024-03-04T13:00:17.123768+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048764,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":32578,"num_write":1458,"num_write_kb":46757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.024835+0000","last_change":"2024-03-04T12:36:09.314720+0000","last_active":"2024-03-04T13:00:21.024835+0000","last_peered":"2024-03-04T13:00:21.024835+0000","last_clean":"2024-03-04T13:00:21.024835+0000","last_became_active":"2024-03-04T12:36:09.314215+0000","last_became_peered":"2024-03-04T12:36:09.314215+0000","last_unstale":"2024-03-04T13:00:21.024835+0000","last_undegraded":"2024-03-04T13:00:21.024835+0000","last_fullsized":"2024-03-04T13:00:21.024835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"256'247","reported_seq":791,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:20.906323+0000","last_change":"2024-03-04T12:36:11.956620+0000","last_active":"2024-03-04T13:00:20.906323+0000","last_peered":"2024-03-04T13:00:20.906323+0000","last_clean":"2024-03-04T13:00:20.906323+0000","last_became_active":"2024-03-04T12:36:11.956371+0000","last_became_peered":"2024-03-04T12:36:11.956371+0000","last_unstale":"2024-03-04T13:00:20.906323+0000","last_undegraded":"2024-03-04T13:00:20.906323+0000","last_fullsized":"2024-03-04T13:00:20.906323+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44142,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1035,"num_write":354,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"256'535","reported_seq":3337,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.140406+0000","last_change":"2024-03-04T12:36:13.344846+0000","last_active":"2024-03-04T13:00:17.140406+0000","last_peered":"2024-03-04T13:00:17.140406+0000","last_clean":"2024-03-04T13:00:17.140406+0000","last_became_active":"2024-03-04T12:36:13.344498+0000","last_became_peered":"2024-03-04T12:36:13.344498+0000","last_unstale":"2024-03-04T13:00:17.140406+0000","last_undegraded":"2024-03-04T13:00:17.140406+0000","last_fullsized":"2024-03-04T13:00:17.140406+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"256'768","reported_seq":2299,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.021175+0000","last_change":"2024-03-04T12:36:07.297672+0000","last_active":"2024-03-04T13:00:01.021175+0000","last_peered":"2024-03-04T13:00:01.021175+0000","last_clean":"2024-03-04T13:00:01.021175+0000","last_became_active":"2024-03-04T12:36:07.297320+0000","last_became_peered":"2024-03-04T12:36:07.297320+0000","last_unstale":"2024-03-04T13:00:01.021175+0000","last_undegraded":"2024-03-04T13:00:01.021175+0000","last_fullsized":"2024-03-04T13:00:01.021175+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3660,"num_read_kb":3298,"num_write":1023,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"256'386","reported_seq":1049,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.116332+0000","last_change":"2024-03-04T12:36:05.294150+0000","last_active":"2024-03-04T13:00:17.116332+0000","last_peered":"2024-03-04T13:00:17.116332+0000","last_clean":"2024-03-04T13:00:17.116332+0000","last_became_active":"2024-03-04T12:36:05.293882+0000","last_became_peered":"2024-03-04T12:36:05.293882+0000","last_unstale":"2024-03-04T13:00:17.116332+0000","last_undegraded":"2024-03-04T13:00:17.116332+0000","last_fullsized":"2024-03-04T13:00:17.116332+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5179671,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":578,"num_read_kb":60173,"num_write":1456,"num_write_kb":40158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:00.903337+0000","last_change":"2024-03-04T12:36:09.308808+0000","last_active":"2024-03-04T13:00:00.903337+0000","last_peered":"2024-03-04T13:00:00.903337+0000","last_clean":"2024-03-04T13:00:00.903337+0000","last_became_active":"2024-03-04T12:36:09.308538+0000","last_became_peered":"2024-03-04T12:36:09.308538+0000","last_unstale":"2024-03-04T13:00:00.903337+0000","last_undegraded":"2024-03-04T13:00:00.903337+0000","last_fullsized":"2024-03-04T13:00:00.903337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"256'321","reported_seq":901,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.391819+0000","last_change":"2024-03-04T13:00:39.391867+0000","last_active":"2024-03-04T13:00:39.391819+0000","last_peered":"2024-03-04T13:00:39.391819+0000","last_clean":"2024-03-04T13:00:39.391819+0000","last_became_active":"2024-03-04T12:36:11.954597+0000","last_became_peered":"2024-03-04T12:36:11.954597+0000","last_unstale":"2024-03-04T13:00:39.391819+0000","last_undegraded":"2024-03-04T13:00:39.391819+0000","last_fullsized":"2024-03-04T13:00:39.391819+0000","mapping_epoch":26,"log_start":"256'300","ondisk_log_start":"256'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'321","last_scrub_stamp":"2024-03-04T13:00:39.391733+0000","last_deep_scrub":"256'321","last_deep_scrub_stamp":"2024-03-04T13:00:39.391733+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.391733+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:46.694056+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51312,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":526,"num_read_kb":1169,"num_write":422,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":471,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:45.991951+0000","last_change":"2024-03-04T12:36:13.340164+0000","last_active":"2024-03-04T12:58:45.991951+0000","last_peered":"2024-03-04T12:58:45.991951+0000","last_clean":"2024-03-04T12:58:45.991951+0000","last_became_active":"2024-03-04T12:36:13.339890+0000","last_became_peered":"2024-03-04T12:36:13.339890+0000","last_unstale":"2024-03-04T12:58:45.991951+0000","last_undegraded":"2024-03-04T12:58:45.991951+0000","last_fullsized":"2024-03-04T12:58:45.991951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"256'507","reported_seq":1300,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.396141+0000","last_change":"2024-03-04T13:00:33.396173+0000","last_active":"2024-03-04T13:00:33.396141+0000","last_peered":"2024-03-04T13:00:33.396141+0000","last_clean":"2024-03-04T13:00:33.396141+0000","last_became_active":"2024-03-04T12:36:15.362355+0000","last_became_peered":"2024-03-04T12:36:15.362355+0000","last_unstale":"2024-03-04T13:00:33.396141+0000","last_undegraded":"2024-03-04T13:00:33.396141+0000","last_fullsized":"2024-03-04T13:00:33.396141+0000","mapping_epoch":30,"log_start":"250'400","ondisk_log_start":"250'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'507","last_scrub_stamp":"2024-03-04T13:00:33.396041+0000","last_deep_scrub":"256'507","last_deep_scrub_stamp":"2024-03-04T13:00:33.396041+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.396041+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:55.241746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1234,"num_read_kb":1233,"num_write":1042,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"256'404","reported_seq":1915,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.021167+0000","last_change":"2024-03-04T12:36:07.292415+0000","last_active":"2024-03-04T13:00:01.021167+0000","last_peered":"2024-03-04T13:00:01.021167+0000","last_clean":"2024-03-04T13:00:01.021167+0000","last_became_active":"2024-03-04T12:36:07.291507+0000","last_became_peered":"2024-03-04T12:36:07.291507+0000","last_unstale":"2024-03-04T13:00:01.021167+0000","last_undegraded":"2024-03-04T13:00:01.021167+0000","last_fullsized":"2024-03-04T13:00:01.021167+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2180,"num_read_kb":2067,"num_write":478,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"256'311","reported_seq":935,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.110717+0000","last_change":"2024-03-04T12:36:05.286750+0000","last_active":"2024-03-04T13:00:17.110717+0000","last_peered":"2024-03-04T13:00:17.110717+0000","last_clean":"2024-03-04T13:00:17.110717+0000","last_became_active":"2024-03-04T12:36:05.286438+0000","last_became_peered":"2024-03-04T12:36:05.286438+0000","last_unstale":"2024-03-04T13:00:17.110717+0000","last_undegraded":"2024-03-04T13:00:17.110717+0000","last_fullsized":"2024-03-04T13:00:17.110717+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21141,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":18655,"num_write":1207,"num_write_kb":23251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.325802+0000","last_change":"2024-03-04T13:00:34.325853+0000","last_active":"2024-03-04T13:00:34.325802+0000","last_peered":"2024-03-04T13:00:34.325802+0000","last_clean":"2024-03-04T13:00:34.325802+0000","last_became_active":"2024-03-04T12:36:09.304561+0000","last_became_peered":"2024-03-04T12:36:09.304561+0000","last_unstale":"2024-03-04T13:00:34.325802+0000","last_undegraded":"2024-03-04T13:00:34.325802+0000","last_fullsized":"2024-03-04T13:00:34.325802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:34.325699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:34.325699+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.325699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:45:29.332360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"256'268","reported_seq":810,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.033910+0000","last_change":"2024-03-04T12:36:11.324431+0000","last_active":"2024-03-04T13:00:17.033910+0000","last_peered":"2024-03-04T13:00:17.033910+0000","last_clean":"2024-03-04T13:00:17.033910+0000","last_became_active":"2024-03-04T12:36:11.324147+0000","last_became_peered":"2024-03-04T12:36:11.324147+0000","last_unstale":"2024-03-04T13:00:17.033910+0000","last_undegraded":"2024-03-04T13:00:17.033910+0000","last_fullsized":"2024-03-04T13:00:17.033910+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":439,"num_read_kb":1077,"num_write":366,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.746156+0000","last_change":"2024-03-04T13:00:39.746181+0000","last_active":"2024-03-04T13:00:39.746156+0000","last_peered":"2024-03-04T13:00:39.746156+0000","last_clean":"2024-03-04T13:00:39.746156+0000","last_became_active":"2024-03-04T12:36:13.346077+0000","last_became_peered":"2024-03-04T12:36:13.346077+0000","last_unstale":"2024-03-04T13:00:39.746156+0000","last_undegraded":"2024-03-04T13:00:39.746156+0000","last_fullsized":"2024-03-04T13:00:39.746156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.746057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.746057+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.746057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:38.016628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"256'121","reported_seq":601,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.258306+0000","last_change":"2024-03-04T12:36:15.360124+0000","last_active":"2024-03-04T12:59:48.258306+0000","last_peered":"2024-03-04T12:59:48.258306+0000","last_clean":"2024-03-04T12:59:48.258306+0000","last_became_active":"2024-03-04T12:36:15.359839+0000","last_became_peered":"2024-03-04T12:36:15.359839+0000","last_unstale":"2024-03-04T12:59:48.258306+0000","last_undegraded":"2024-03-04T12:59:48.258306+0000","last_fullsized":"2024-03-04T12:59:48.258306+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":144,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"256'819","reported_seq":2264,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.009609+0000","last_change":"2024-03-04T12:36:40.395151+0000","last_active":"2024-03-04T13:00:01.009609+0000","last_peered":"2024-03-04T13:00:01.009609+0000","last_clean":"2024-03-04T13:00:01.009609+0000","last_became_active":"2024-03-04T12:36:40.394812+0000","last_became_peered":"2024-03-04T12:36:40.394812+0000","last_unstale":"2024-03-04T13:00:01.009609+0000","last_undegraded":"2024-03-04T13:00:01.009609+0000","last_fullsized":"2024-03-04T13:00:01.009609+0000","mapping_epoch":33,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3628,"num_read_kb":3191,"num_write":1140,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"256'341","reported_seq":991,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.113429+0000","last_change":"2024-03-04T12:36:05.297783+0000","last_active":"2024-03-04T13:00:17.113429+0000","last_peered":"2024-03-04T13:00:17.113429+0000","last_clean":"2024-03-04T13:00:17.113429+0000","last_became_active":"2024-03-04T12:36:05.297486+0000","last_became_peered":"2024-03-04T12:36:05.297486+0000","last_unstale":"2024-03-04T13:00:17.113429+0000","last_undegraded":"2024-03-04T13:00:17.113429+0000","last_fullsized":"2024-03-04T13:00:17.113429+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":44586,"num_write":1373,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"256'6","reported_seq":797,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.257707+0000","last_change":"2024-03-04T13:00:38.257746+0000","last_active":"2024-03-04T13:00:38.257707+0000","last_peered":"2024-03-04T13:00:38.257707+0000","last_clean":"2024-03-04T13:00:38.257707+0000","last_became_active":"2024-03-04T12:36:09.303280+0000","last_became_peered":"2024-03-04T12:36:09.303280+0000","last_unstale":"2024-03-04T13:00:38.257707+0000","last_undegraded":"2024-03-04T13:00:38.257707+0000","last_fullsized":"2024-03-04T13:00:38.257707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:38.257611+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:38.257611+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.257611+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:40.037724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":467,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"256'284","reported_seq":838,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.418206+0000","last_change":"2024-03-04T12:36:11.325461+0000","last_active":"2024-03-04T13:00:16.418206+0000","last_peered":"2024-03-04T13:00:16.418206+0000","last_clean":"2024-03-04T13:00:16.418206+0000","last_became_active":"2024-03-04T12:36:11.325109+0000","last_became_peered":"2024-03-04T12:36:11.325109+0000","last_unstale":"2024-03-04T13:00:16.418206+0000","last_undegraded":"2024-03-04T13:00:16.418206+0000","last_fullsized":"2024-03-04T13:00:16.418206+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48663,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":476,"num_read_kb":1126,"num_write":394,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"256'518","reported_seq":1823,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.141285+0000","last_change":"2024-03-04T12:36:13.342932+0000","last_active":"2024-03-04T13:00:17.141285+0000","last_peered":"2024-03-04T13:00:17.141285+0000","last_clean":"2024-03-04T13:00:17.141285+0000","last_became_active":"2024-03-04T12:36:13.342604+0000","last_became_peered":"2024-03-04T12:36:13.342604+0000","last_unstale":"2024-03-04T13:00:17.141285+0000","last_undegraded":"2024-03-04T13:00:17.141285+0000","last_fullsized":"2024-03-04T13:00:17.141285+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"256'92","reported_seq":561,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.636159+0000","last_change":"2024-03-04T13:00:33.636203+0000","last_active":"2024-03-04T13:00:33.636159+0000","last_peered":"2024-03-04T13:00:33.636159+0000","last_clean":"2024-03-04T13:00:33.636159+0000","last_became_active":"2024-03-04T12:36:15.359959+0000","last_became_peered":"2024-03-04T12:36:15.359959+0000","last_unstale":"2024-03-04T13:00:33.636159+0000","last_undegraded":"2024-03-04T13:00:33.636159+0000","last_fullsized":"2024-03-04T13:00:33.636159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'92","last_scrub_stamp":"2024-03-04T13:00:33.636037+0000","last_deep_scrub":"256'92","last_deep_scrub_stamp":"2024-03-04T13:00:33.636037+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.636037+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:05:11.396356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"256'355","reported_seq":1799,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.129671+0000","last_change":"2024-03-04T12:36:07.301861+0000","last_active":"2024-03-04T12:59:52.129671+0000","last_peered":"2024-03-04T12:59:52.129671+0000","last_clean":"2024-03-04T12:59:52.129671+0000","last_became_active":"2024-03-04T12:36:07.301558+0000","last_became_peered":"2024-03-04T12:36:07.301558+0000","last_unstale":"2024-03-04T12:59:52.129671+0000","last_undegraded":"2024-03-04T12:59:52.129671+0000","last_fullsized":"2024-03-04T12:59:52.129671+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1943,"num_read_kb":1867,"num_write":395,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"256'357","reported_seq":1108,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.122061+0000","last_change":"2024-03-04T12:36:05.293965+0000","last_active":"2024-03-04T13:00:17.122061+0000","last_peered":"2024-03-04T13:00:17.122061+0000","last_clean":"2024-03-04T13:00:17.122061+0000","last_became_active":"2024-03-04T12:36:05.293649+0000","last_became_peered":"2024-03-04T12:36:05.293649+0000","last_unstale":"2024-03-04T13:00:17.122061+0000","last_undegraded":"2024-03-04T13:00:17.122061+0000","last_fullsized":"2024-03-04T13:00:17.122061+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3134195,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":703,"num_read_kb":39148,"num_write":1364,"num_write_kb":31517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.312815+0000","last_change":"2024-03-04T13:00:36.312878+0000","last_active":"2024-03-04T13:00:36.312815+0000","last_peered":"2024-03-04T13:00:36.312815+0000","last_clean":"2024-03-04T13:00:36.312815+0000","last_became_active":"2024-03-04T12:36:09.303908+0000","last_became_peered":"2024-03-04T12:36:09.303908+0000","last_unstale":"2024-03-04T13:00:36.312815+0000","last_undegraded":"2024-03-04T13:00:36.312815+0000","last_fullsized":"2024-03-04T13:00:36.312815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:36.312703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:36.312703+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.312703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:24:52.339144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"256'427","reported_seq":1028,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.131473+0000","last_change":"2024-03-04T12:36:11.328487+0000","last_active":"2024-03-04T13:00:17.131473+0000","last_peered":"2024-03-04T13:00:17.131473+0000","last_clean":"2024-03-04T13:00:17.131473+0000","last_became_active":"2024-03-04T12:36:11.326014+0000","last_became_peered":"2024-03-04T12:36:11.326014+0000","last_unstale":"2024-03-04T13:00:17.131473+0000","last_undegraded":"2024-03-04T13:00:17.131473+0000","last_fullsized":"2024-03-04T13:00:17.131473+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":758,"num_read_kb":1853,"num_write":616,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.200373+0000","last_change":"2024-03-04T13:00:24.200396+0000","last_active":"2024-03-04T13:00:24.200373+0000","last_peered":"2024-03-04T13:00:24.200373+0000","last_clean":"2024-03-04T13:00:24.200373+0000","last_became_active":"2024-03-04T12:36:13.335586+0000","last_became_peered":"2024-03-04T12:36:13.335586+0000","last_unstale":"2024-03-04T13:00:24.200373+0000","last_undegraded":"2024-03-04T13:00:24.200373+0000","last_fullsized":"2024-03-04T13:00:24.200373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:24.200285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:24.200285+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.200285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:42:37.768082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"256'108","reported_seq":610,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.374380+0000","last_change":"2024-03-04T13:00:31.374407+0000","last_active":"2024-03-04T13:00:31.374380+0000","last_peered":"2024-03-04T13:00:31.374380+0000","last_clean":"2024-03-04T13:00:31.374380+0000","last_became_active":"2024-03-04T12:36:15.356270+0000","last_became_peered":"2024-03-04T12:36:15.356270+0000","last_unstale":"2024-03-04T13:00:31.374380+0000","last_undegraded":"2024-03-04T13:00:31.374380+0000","last_fullsized":"2024-03-04T13:00:31.374380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'108","last_scrub_stamp":"2024-03-04T13:00:31.374294+0000","last_deep_scrub":"256'108","last_deep_scrub_stamp":"2024-03-04T13:00:31.374294+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.374294+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:34:36.455950+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":257,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"256'398","reported_seq":1974,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.690423+0000","last_change":"2024-03-04T12:36:07.293079+0000","last_active":"2024-03-04T13:00:06.690423+0000","last_peered":"2024-03-04T13:00:06.690423+0000","last_clean":"2024-03-04T13:00:06.690423+0000","last_became_active":"2024-03-04T12:36:07.292788+0000","last_became_peered":"2024-03-04T12:36:07.292788+0000","last_unstale":"2024-03-04T13:00:06.690423+0000","last_undegraded":"2024-03-04T13:00:06.690423+0000","last_fullsized":"2024-03-04T13:00:06.690423+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2359,"num_read_kb":2243,"num_write":467,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"256'305","reported_seq":1008,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.128897+0000","last_change":"2024-03-04T12:36:05.286316+0000","last_active":"2024-03-04T13:00:17.128897+0000","last_peered":"2024-03-04T13:00:17.128897+0000","last_clean":"2024-03-04T13:00:17.128897+0000","last_became_active":"2024-03-04T12:36:05.284594+0000","last_became_peered":"2024-03-04T12:36:05.284594+0000","last_unstale":"2024-03-04T13:00:17.128897+0000","last_undegraded":"2024-03-04T13:00:17.128897+0000","last_fullsized":"2024-03-04T13:00:17.128897+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398941,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":597,"num_read_kb":110861,"num_write":1019,"num_write_kb":39283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":486,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.286111+0000","last_change":"2024-03-04T13:00:32.286134+0000","last_active":"2024-03-04T13:00:32.286111+0000","last_peered":"2024-03-04T13:00:32.286111+0000","last_clean":"2024-03-04T13:00:32.286111+0000","last_became_active":"2024-03-04T12:36:09.305363+0000","last_became_peered":"2024-03-04T12:36:09.305363+0000","last_unstale":"2024-03-04T13:00:32.286111+0000","last_undegraded":"2024-03-04T13:00:32.286111+0000","last_fullsized":"2024-03-04T13:00:32.286111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:32.286026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:32.286026+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.286026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:59:46.692288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"256'258","reported_seq":808,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.356727+0000","last_change":"2024-03-04T12:36:11.320326+0000","last_active":"2024-03-04T13:00:15.356727+0000","last_peered":"2024-03-04T13:00:15.356727+0000","last_clean":"2024-03-04T13:00:15.356727+0000","last_became_active":"2024-03-04T12:36:11.319633+0000","last_became_peered":"2024-03-04T12:36:11.319633+0000","last_unstale":"2024-03-04T13:00:15.356727+0000","last_undegraded":"2024-03-04T13:00:15.356727+0000","last_fullsized":"2024-03-04T13:00:15.356727+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":990,"num_write":404,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.595478+0000","last_change":"2024-03-04T13:00:39.595505+0000","last_active":"2024-03-04T13:00:39.595478+0000","last_peered":"2024-03-04T13:00:39.595478+0000","last_clean":"2024-03-04T13:00:39.595478+0000","last_became_active":"2024-03-04T12:36:13.348999+0000","last_became_peered":"2024-03-04T12:36:13.348999+0000","last_unstale":"2024-03-04T13:00:39.595478+0000","last_undegraded":"2024-03-04T13:00:39.595478+0000","last_fullsized":"2024-03-04T13:00:39.595478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.595386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.595386+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.595386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:30.057599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"256'99","reported_seq":578,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.668602+0000","last_change":"2024-03-04T13:00:28.668630+0000","last_active":"2024-03-04T13:00:28.668602+0000","last_peered":"2024-03-04T13:00:28.668602+0000","last_clean":"2024-03-04T13:00:28.668602+0000","last_became_active":"2024-03-04T12:36:15.359732+0000","last_became_peered":"2024-03-04T12:36:15.359732+0000","last_unstale":"2024-03-04T13:00:28.668602+0000","last_undegraded":"2024-03-04T13:00:28.668602+0000","last_fullsized":"2024-03-04T13:00:28.668602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'99","last_scrub_stamp":"2024-03-04T13:00:28.668521+0000","last_deep_scrub":"256'99","last_deep_scrub_stamp":"2024-03-04T13:00:28.668521+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.668521+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:02:41.542443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"256'879","reported_seq":2434,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:50.138755+0000","last_change":"2024-03-04T12:36:07.299296+0000","last_active":"2024-03-04T12:59:50.138755+0000","last_peered":"2024-03-04T12:59:50.138755+0000","last_clean":"2024-03-04T12:59:50.138755+0000","last_became_active":"2024-03-04T12:36:07.298999+0000","last_became_peered":"2024-03-04T12:36:07.298999+0000","last_unstale":"2024-03-04T12:59:50.138755+0000","last_undegraded":"2024-03-04T12:59:50.138755+0000","last_fullsized":"2024-03-04T12:59:50.138755+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4068,"num_read_kb":3596,"num_write":1224,"num_write_kb":497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"256'346","reported_seq":947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.086364+0000","last_change":"2024-03-04T12:36:05.289780+0000","last_active":"2024-03-04T13:00:17.086364+0000","last_peered":"2024-03-04T13:00:17.086364+0000","last_clean":"2024-03-04T13:00:17.086364+0000","last_became_active":"2024-03-04T12:36:05.289486+0000","last_became_peered":"2024-03-04T12:36:05.289486+0000","last_unstale":"2024-03-04T13:00:17.086364+0000","last_undegraded":"2024-03-04T13:00:17.086364+0000","last_fullsized":"2024-03-04T13:00:17.086364+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456599,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":441,"num_read_kb":48705,"num_write":1317,"num_write_kb":64123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.384733+0000","last_change":"2024-03-04T13:00:38.384771+0000","last_active":"2024-03-04T13:00:38.384733+0000","last_peered":"2024-03-04T13:00:38.384733+0000","last_clean":"2024-03-04T13:00:38.384733+0000","last_became_active":"2024-03-04T12:36:09.305880+0000","last_became_peered":"2024-03-04T12:36:09.305880+0000","last_unstale":"2024-03-04T13:00:38.384733+0000","last_undegraded":"2024-03-04T13:00:38.384733+0000","last_fullsized":"2024-03-04T13:00:38.384733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:38.384641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:38.384641+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.384641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:47.356519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"256'271","reported_seq":832,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.267258+0000","last_change":"2024-03-04T13:00:26.267303+0000","last_active":"2024-03-04T13:00:26.267258+0000","last_peered":"2024-03-04T13:00:26.267258+0000","last_clean":"2024-03-04T13:00:26.267258+0000","last_became_active":"2024-03-04T12:36:11.327499+0000","last_became_peered":"2024-03-04T12:36:11.327499+0000","last_unstale":"2024-03-04T13:00:26.267258+0000","last_undegraded":"2024-03-04T13:00:26.267258+0000","last_fullsized":"2024-03-04T13:00:26.267258+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'271","last_scrub_stamp":"2024-03-04T13:00:26.267170+0000","last_deep_scrub":"256'271","last_deep_scrub_stamp":"2024-03-04T13:00:26.267170+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.267170+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:41:13.037206+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48450,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":440,"num_read_kb":1012,"num_write":358,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"256'478","reported_seq":1635,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.208545+0000","last_change":"2024-03-04T13:00:23.208567+0000","last_active":"2024-03-04T13:00:23.208545+0000","last_peered":"2024-03-04T13:00:23.208545+0000","last_clean":"2024-03-04T13:00:23.208545+0000","last_became_active":"2024-03-04T12:36:13.337817+0000","last_became_peered":"2024-03-04T12:36:13.337817+0000","last_unstale":"2024-03-04T13:00:23.208545+0000","last_undegraded":"2024-03-04T13:00:23.208545+0000","last_fullsized":"2024-03-04T13:00:23.208545+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'478","last_scrub_stamp":"2024-03-04T13:00:23.208470+0000","last_deep_scrub":"256'478","last_deep_scrub_stamp":"2024-03-04T13:00:23.208470+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.208470+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:45.708499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"256'98","reported_seq":579,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.397842+0000","last_change":"2024-03-04T13:00:32.397876+0000","last_active":"2024-03-04T13:00:32.397842+0000","last_peered":"2024-03-04T13:00:32.397842+0000","last_clean":"2024-03-04T13:00:32.397842+0000","last_became_active":"2024-03-04T12:36:15.348869+0000","last_became_peered":"2024-03-04T12:36:15.348869+0000","last_unstale":"2024-03-04T13:00:32.397842+0000","last_undegraded":"2024-03-04T13:00:32.397842+0000","last_fullsized":"2024-03-04T13:00:32.397842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'98","last_scrub_stamp":"2024-03-04T13:00:32.397750+0000","last_deep_scrub":"256'98","last_deep_scrub_stamp":"2024-03-04T13:00:32.397750+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.397750+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:30.191883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":240,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"256'411","reported_seq":1953,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.254991+0000","last_change":"2024-03-04T12:36:07.293897+0000","last_active":"2024-03-04T12:59:48.254991+0000","last_peered":"2024-03-04T12:59:48.254991+0000","last_clean":"2024-03-04T12:59:48.254991+0000","last_became_active":"2024-03-04T12:36:07.293586+0000","last_became_peered":"2024-03-04T12:36:07.293586+0000","last_unstale":"2024-03-04T12:59:48.254991+0000","last_undegraded":"2024-03-04T12:59:48.254991+0000","last_fullsized":"2024-03-04T12:59:48.254991+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2259,"num_read_kb":2143,"num_write":486,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"256'335","reported_seq":943,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.112959+0000","last_change":"2024-03-04T12:36:05.288353+0000","last_active":"2024-03-04T13:00:17.112959+0000","last_peered":"2024-03-04T13:00:17.112959+0000","last_clean":"2024-03-04T13:00:17.112959+0000","last_became_active":"2024-03-04T12:36:05.288036+0000","last_became_peered":"2024-03-04T12:36:05.288036+0000","last_unstale":"2024-03-04T13:00:17.112959+0000","last_undegraded":"2024-03-04T13:00:17.112959+0000","last_fullsized":"2024-03-04T13:00:17.112959+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":10713,"num_write":1310,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1089,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.231216+0000","last_change":"2024-03-04T12:36:09.315046+0000","last_active":"2024-03-04T13:00:15.231216+0000","last_peered":"2024-03-04T13:00:15.231216+0000","last_clean":"2024-03-04T13:00:15.231216+0000","last_became_active":"2024-03-04T12:36:09.314474+0000","last_became_peered":"2024-03-04T12:36:09.314474+0000","last_unstale":"2024-03-04T13:00:15.231216+0000","last_undegraded":"2024-03-04T13:00:15.231216+0000","last_fullsized":"2024-03-04T13:00:15.231216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":612,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"256'50","reported_seq":537,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:40.991954+0000","last_change":"2024-03-04T12:36:11.954876+0000","last_active":"2024-03-04T12:58:40.991954+0000","last_peered":"2024-03-04T12:58:40.991954+0000","last_clean":"2024-03-04T12:58:40.991954+0000","last_became_active":"2024-03-04T12:36:11.954508+0000","last_became_peered":"2024-03-04T12:36:11.954508+0000","last_unstale":"2024-03-04T12:58:40.991954+0000","last_undegraded":"2024-03-04T12:58:40.991954+0000","last_fullsized":"2024-03-04T12:58:40.991954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"256'482","reported_seq":1506,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.725743+0000","last_change":"2024-03-04T13:00:34.725817+0000","last_active":"2024-03-04T13:00:34.725743+0000","last_peered":"2024-03-04T13:00:34.725743+0000","last_clean":"2024-03-04T13:00:34.725743+0000","last_became_active":"2024-03-04T12:36:13.342902+0000","last_became_peered":"2024-03-04T12:36:13.342902+0000","last_unstale":"2024-03-04T13:00:34.725743+0000","last_undegraded":"2024-03-04T13:00:34.725743+0000","last_fullsized":"2024-03-04T13:00:34.725743+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'482","last_scrub_stamp":"2024-03-04T13:00:34.725632+0000","last_deep_scrub":"256'482","last_deep_scrub_stamp":"2024-03-04T13:00:34.725632+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.725632+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:32:27.798918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"256'94","reported_seq":577,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.163741+0000","last_change":"2024-03-04T13:00:29.163768+0000","last_active":"2024-03-04T13:00:29.163741+0000","last_peered":"2024-03-04T13:00:29.163741+0000","last_clean":"2024-03-04T13:00:29.163741+0000","last_became_active":"2024-03-04T12:36:15.352420+0000","last_became_peered":"2024-03-04T12:36:15.352420+0000","last_unstale":"2024-03-04T13:00:29.163741+0000","last_undegraded":"2024-03-04T13:00:29.163741+0000","last_fullsized":"2024-03-04T13:00:29.163741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'94","last_scrub_stamp":"2024-03-04T13:00:29.163620+0000","last_deep_scrub":"256'94","last_deep_scrub_stamp":"2024-03-04T13:00:29.163620+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.163620+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:10.290561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":79,"num_write":205,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"256'1080","reported_seq":2463,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.358753+0000","last_change":"2024-03-04T13:00:37.358804+0000","last_active":"2024-03-04T13:00:37.358753+0000","last_peered":"2024-03-04T13:00:37.358753+0000","last_clean":"2024-03-04T13:00:37.358753+0000","last_became_active":"2024-03-04T12:36:07.304123+0000","last_became_peered":"2024-03-04T12:36:07.304123+0000","last_unstale":"2024-03-04T13:00:37.358753+0000","last_undegraded":"2024-03-04T13:00:37.358753+0000","last_fullsized":"2024-03-04T13:00:37.358753+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1080","last_scrub_stamp":"2024-03-04T13:00:37.358634+0000","last_deep_scrub":"256'1080","last_deep_scrub_stamp":"2024-03-04T13:00:37.358634+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.358634+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":1000,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:25:48.734892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4358,"num_read_kb":3794,"num_write":1486,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'366","reported_seq":991,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.104112+0000","last_change":"2024-03-04T12:36:05.286870+0000","last_active":"2024-03-04T13:00:17.104112+0000","last_peered":"2024-03-04T13:00:17.104112+0000","last_clean":"2024-03-04T13:00:17.104112+0000","last_became_active":"2024-03-04T12:36:05.286442+0000","last_became_peered":"2024-03-04T12:36:05.286442+0000","last_unstale":"2024-03-04T13:00:17.104112+0000","last_undegraded":"2024-03-04T13:00:17.104112+0000","last_fullsized":"2024-03-04T13:00:17.104112+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":497,"num_read_kb":22844,"num_write":1305,"num_write_kb":40494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:41.007515+0000","last_change":"2024-03-04T12:36:09.314992+0000","last_active":"2024-03-04T12:58:41.007515+0000","last_peered":"2024-03-04T12:58:41.007515+0000","last_clean":"2024-03-04T12:58:41.007515+0000","last_became_active":"2024-03-04T12:36:09.314671+0000","last_became_peered":"2024-03-04T12:36:09.314671+0000","last_unstale":"2024-03-04T12:58:41.007515+0000","last_undegraded":"2024-03-04T12:58:41.007515+0000","last_fullsized":"2024-03-04T12:58:41.007515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"256'290","reported_seq":858,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.102963+0000","last_change":"2024-03-04T12:36:11.325717+0000","last_active":"2024-03-04T13:00:16.102963+0000","last_peered":"2024-03-04T13:00:16.102963+0000","last_clean":"2024-03-04T13:00:16.102963+0000","last_became_active":"2024-03-04T12:36:11.325372+0000","last_became_peered":"2024-03-04T12:36:11.325372+0000","last_unstale":"2024-03-04T13:00:16.102963+0000","last_undegraded":"2024-03-04T13:00:16.102963+0000","last_fullsized":"2024-03-04T13:00:16.102963+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47142,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1045,"num_read_kb":1555,"num_write":1526,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.746168+0000","last_change":"2024-03-04T13:00:40.746192+0000","last_active":"2024-03-04T13:00:40.746168+0000","last_peered":"2024-03-04T13:00:40.746168+0000","last_clean":"2024-03-04T13:00:40.746168+0000","last_became_active":"2024-03-04T12:36:13.348998+0000","last_became_peered":"2024-03-04T12:36:13.348998+0000","last_unstale":"2024-03-04T13:00:40.746168+0000","last_undegraded":"2024-03-04T13:00:40.746168+0000","last_fullsized":"2024-03-04T13:00:40.746168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.746068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.746068+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.746068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:09.551212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"256'117","reported_seq":606,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.417321+0000","last_change":"2024-03-04T13:00:29.417352+0000","last_active":"2024-03-04T13:00:29.417321+0000","last_peered":"2024-03-04T13:00:29.417321+0000","last_clean":"2024-03-04T13:00:29.417321+0000","last_became_active":"2024-03-04T12:36:15.362792+0000","last_became_peered":"2024-03-04T12:36:15.362792+0000","last_unstale":"2024-03-04T13:00:29.417321+0000","last_undegraded":"2024-03-04T13:00:29.417321+0000","last_fullsized":"2024-03-04T13:00:29.417321+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'117","last_scrub_stamp":"2024-03-04T13:00:29.417189+0000","last_deep_scrub":"256'117","last_deep_scrub_stamp":"2024-03-04T13:00:29.417189+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.417189+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:57.741359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":132,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"256'316","reported_seq":1675,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.482307+0000","last_change":"2024-03-04T12:36:07.300301+0000","last_active":"2024-03-04T12:59:55.482307+0000","last_peered":"2024-03-04T12:59:55.482307+0000","last_clean":"2024-03-04T12:59:55.482307+0000","last_became_active":"2024-03-04T12:36:07.299952+0000","last_became_peered":"2024-03-04T12:36:07.299952+0000","last_unstale":"2024-03-04T12:59:55.482307+0000","last_undegraded":"2024-03-04T12:59:55.482307+0000","last_fullsized":"2024-03-04T12:59:55.482307+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1855,"num_read_kb":1767,"num_write":364,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":650,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.902521+0000","last_change":"2024-03-04T12:35:47.950593+0000","last_active":"2024-03-04T12:59:55.902521+0000","last_peered":"2024-03-04T12:59:55.902521+0000","last_clean":"2024-03-04T12:59:55.902521+0000","last_became_active":"2024-03-04T12:35:47.950213+0000","last_became_peered":"2024-03-04T12:35:47.950213+0000","last_unstale":"2024-03-04T12:59:55.902521+0000","last_undegraded":"2024-03-04T12:59:55.902521+0000","last_fullsized":"2024-03-04T12:59:55.902521+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_clean_scrub_stamp":"2024-03-04T12:35:46.856449+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":490,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:51.009029+0000","last_change":"2024-03-04T12:35:54.235102+0000","last_active":"2024-03-04T12:58:51.009029+0000","last_peered":"2024-03-04T12:58:51.009029+0000","last_clean":"2024-03-04T12:58:51.009029+0000","last_became_active":"2024-03-04T12:35:54.234819+0000","last_became_peered":"2024-03-04T12:35:54.234819+0000","last_unstale":"2024-03-04T12:58:51.009029+0000","last_undegraded":"2024-03-04T12:58:51.009029+0000","last_fullsized":"2024-03-04T12:58:51.009029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"256'312","reported_seq":922,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.128673+0000","last_change":"2024-03-04T12:36:05.297146+0000","last_active":"2024-03-04T13:00:17.128673+0000","last_peered":"2024-03-04T13:00:17.128673+0000","last_clean":"2024-03-04T13:00:17.128673+0000","last_became_active":"2024-03-04T12:36:05.296783+0000","last_became_peered":"2024-03-04T12:36:05.296783+0000","last_unstale":"2024-03-04T13:00:17.128673+0000","last_undegraded":"2024-03-04T13:00:17.128673+0000","last_fullsized":"2024-03-04T13:00:17.128673+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":460,"num_read_kb":16805,"num_write":1147,"num_write_kb":27899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:05.894790+0000","last_change":"2024-03-04T12:36:09.306698+0000","last_active":"2024-03-04T12:59:05.894790+0000","last_peered":"2024-03-04T12:59:05.894790+0000","last_clean":"2024-03-04T12:59:05.894790+0000","last_became_active":"2024-03-04T12:36:09.306398+0000","last_became_peered":"2024-03-04T12:36:09.306398+0000","last_unstale":"2024-03-04T12:59:05.894790+0000","last_undegraded":"2024-03-04T12:59:05.894790+0000","last_fullsized":"2024-03-04T12:59:05.894790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"256'661","reported_seq":1337,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.826047+0000","last_change":"2024-03-04T12:36:11.327855+0000","last_active":"2024-03-04T13:00:16.826047+0000","last_peered":"2024-03-04T13:00:16.826047+0000","last_clean":"2024-03-04T13:00:16.826047+0000","last_became_active":"2024-03-04T12:36:11.327652+0000","last_became_peered":"2024-03-04T12:36:11.327652+0000","last_unstale":"2024-03-04T13:00:16.826047+0000","last_undegraded":"2024-03-04T13:00:16.826047+0000","last_fullsized":"2024-03-04T13:00:16.826047+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":600,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140555,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1295,"num_read_kb":2979,"num_write":1188,"num_write_kb":1057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.018641+0000","last_change":"2024-03-04T12:36:13.341910+0000","last_active":"2024-03-04T13:00:06.018641+0000","last_peered":"2024-03-04T13:00:06.018641+0000","last_clean":"2024-03-04T13:00:06.018641+0000","last_became_active":"2024-03-04T12:36:13.341629+0000","last_became_peered":"2024-03-04T12:36:13.341629+0000","last_unstale":"2024-03-04T13:00:06.018641+0000","last_undegraded":"2024-03-04T13:00:06.018641+0000","last_fullsized":"2024-03-04T13:00:06.018641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"256'95","reported_seq":572,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.704284+0000","last_change":"2024-03-04T12:36:15.363641+0000","last_active":"2024-03-04T13:00:08.704284+0000","last_peered":"2024-03-04T13:00:08.704284+0000","last_clean":"2024-03-04T13:00:08.704284+0000","last_became_active":"2024-03-04T12:36:15.363355+0000","last_became_peered":"2024-03-04T12:36:15.363355+0000","last_unstale":"2024-03-04T13:00:08.704284+0000","last_undegraded":"2024-03-04T13:00:08.704284+0000","last_fullsized":"2024-03-04T13:00:08.704284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"256'352","reported_seq":1787,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.018093+0000","last_change":"2024-03-04T12:36:07.302006+0000","last_active":"2024-03-04T13:00:01.018093+0000","last_peered":"2024-03-04T13:00:01.018093+0000","last_clean":"2024-03-04T13:00:01.018093+0000","last_became_active":"2024-03-04T12:36:07.301706+0000","last_became_peered":"2024-03-04T12:36:07.301706+0000","last_unstale":"2024-03-04T13:00:01.018093+0000","last_undegraded":"2024-03-04T13:00:01.018093+0000","last_fullsized":"2024-03-04T13:00:01.018093+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2015,"num_read_kb":1927,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":494,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:00.903311+0000","last_change":"2024-03-04T12:35:54.238692+0000","last_active":"2024-03-04T13:00:00.903311+0000","last_peered":"2024-03-04T13:00:00.903311+0000","last_clean":"2024-03-04T13:00:00.903311+0000","last_became_active":"2024-03-04T12:35:54.238351+0000","last_became_peered":"2024-03-04T12:35:54.238351+0000","last_unstale":"2024-03-04T13:00:00.903311+0000","last_undegraded":"2024-03-04T13:00:00.903311+0000","last_fullsized":"2024-03-04T13:00:00.903311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"256'386","reported_seq":1051,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.120813+0000","last_change":"2024-03-04T12:36:05.285992+0000","last_active":"2024-03-04T13:00:17.120813+0000","last_peered":"2024-03-04T13:00:17.120813+0000","last_clean":"2024-03-04T13:00:17.120813+0000","last_became_active":"2024-03-04T12:36:05.285659+0000","last_became_peered":"2024-03-04T12:36:05.285659+0000","last_unstale":"2024-03-04T13:00:17.120813+0000","last_undegraded":"2024-03-04T13:00:17.120813+0000","last_fullsized":"2024-03-04T13:00:17.120813+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2160246,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":21923,"num_write":1294,"num_write_kb":32530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.021356+0000","last_change":"2024-03-04T12:36:09.314765+0000","last_active":"2024-03-04T13:00:01.021356+0000","last_peered":"2024-03-04T13:00:01.021356+0000","last_clean":"2024-03-04T13:00:01.021356+0000","last_became_active":"2024-03-04T12:36:09.314113+0000","last_became_peered":"2024-03-04T12:36:09.314113+0000","last_unstale":"2024-03-04T13:00:01.021356+0000","last_undegraded":"2024-03-04T13:00:01.021356+0000","last_fullsized":"2024-03-04T13:00:01.021356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"256'1017","reported_seq":2132,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.133414+0000","last_change":"2024-03-04T12:36:11.323823+0000","last_active":"2024-03-04T13:00:17.133414+0000","last_peered":"2024-03-04T13:00:17.133414+0000","last_clean":"2024-03-04T13:00:17.133414+0000","last_became_active":"2024-03-04T12:36:11.323543+0000","last_became_peered":"2024-03-04T12:36:11.323543+0000","last_unstale":"2024-03-04T13:00:17.133414+0000","last_undegraded":"2024-03-04T13:00:17.133414+0000","last_fullsized":"2024-03-04T13:00:17.133414+0000","mapping_epoch":26,"log_start":"256'1000","ondisk_log_start":"256'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":1000,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157019,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1614,"num_read_kb":3260,"num_write":972,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.288069+0000","last_change":"2024-03-04T13:00:40.288095+0000","last_active":"2024-03-04T13:00:40.288069+0000","last_peered":"2024-03-04T13:00:40.288069+0000","last_clean":"2024-03-04T13:00:40.288069+0000","last_became_active":"2024-03-04T12:36:13.339353+0000","last_became_peered":"2024-03-04T12:36:13.339353+0000","last_unstale":"2024-03-04T13:00:40.288069+0000","last_undegraded":"2024-03-04T13:00:40.288069+0000","last_fullsized":"2024-03-04T13:00:40.288069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.287960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.287960+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.287960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:16:46.922748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"256'147","reported_seq":643,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.399242+0000","last_change":"2024-03-04T13:00:33.399271+0000","last_active":"2024-03-04T13:00:33.399242+0000","last_peered":"2024-03-04T13:00:33.399242+0000","last_clean":"2024-03-04T13:00:33.399242+0000","last_became_active":"2024-03-04T12:36:15.346516+0000","last_became_peered":"2024-03-04T12:36:15.346516+0000","last_unstale":"2024-03-04T13:00:33.399242+0000","last_undegraded":"2024-03-04T13:00:33.399242+0000","last_fullsized":"2024-03-04T13:00:33.399242+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'147","last_scrub_stamp":"2024-03-04T13:00:33.399158+0000","last_deep_scrub":"256'147","last_deep_scrub_stamp":"2024-03-04T13:00:33.399158+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.399158+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:04.057962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":196,"num_read_kb":196,"num_write":318,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"256'399","reported_seq":1877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.414666+0000","last_change":"2024-03-04T13:00:39.414706+0000","last_active":"2024-03-04T13:00:39.414666+0000","last_peered":"2024-03-04T13:00:39.414666+0000","last_clean":"2024-03-04T13:00:39.414666+0000","last_became_active":"2024-03-04T12:36:07.300039+0000","last_became_peered":"2024-03-04T12:36:07.300039+0000","last_unstale":"2024-03-04T13:00:39.414666+0000","last_undegraded":"2024-03-04T13:00:39.414666+0000","last_fullsized":"2024-03-04T13:00:39.414666+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'399","last_scrub_stamp":"2024-03-04T13:00:39.414579+0000","last_deep_scrub":"256'399","last_deep_scrub_stamp":"2024-03-04T13:00:39.414579+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.414579+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:09.710256+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2349,"num_read_kb":2220,"num_write":468,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":238,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":501,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.223887+0000","last_change":"2024-03-04T13:00:39.223911+0000","last_active":"2024-03-04T13:00:39.223887+0000","last_peered":"2024-03-04T13:00:39.223887+0000","last_clean":"2024-03-04T13:00:39.223887+0000","last_became_active":"2024-03-04T12:35:54.235738+0000","last_became_peered":"2024-03-04T12:35:54.235738+0000","last_unstale":"2024-03-04T13:00:39.223887+0000","last_undegraded":"2024-03-04T13:00:39.223887+0000","last_fullsized":"2024-03-04T13:00:39.223887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.223775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.223775+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.223775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:54:59.767057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"256'380","reported_seq":1269,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.120612+0000","last_change":"2024-03-04T12:36:05.275101+0000","last_active":"2024-03-04T13:00:17.120612+0000","last_peered":"2024-03-04T13:00:17.120612+0000","last_clean":"2024-03-04T13:00:17.120612+0000","last_became_active":"2024-03-04T12:36:05.274788+0000","last_became_peered":"2024-03-04T12:36:05.274788+0000","last_unstale":"2024-03-04T13:00:17.120612+0000","last_undegraded":"2024-03-04T13:00:17.120612+0000","last_fullsized":"2024-03-04T13:00:17.120612+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069328,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1100,"num_read_kb":10802,"num_write":1447,"num_write_kb":39091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"256'2","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.318641+0000","last_change":"2024-03-04T13:00:30.318672+0000","last_active":"2024-03-04T13:00:30.318641+0000","last_peered":"2024-03-04T13:00:30.318641+0000","last_clean":"2024-03-04T13:00:30.318641+0000","last_became_active":"2024-03-04T12:36:09.315023+0000","last_became_peered":"2024-03-04T12:36:09.315023+0000","last_unstale":"2024-03-04T13:00:30.318641+0000","last_undegraded":"2024-03-04T13:00:30.318641+0000","last_fullsized":"2024-03-04T13:00:30.318641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:30.318544+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:30.318544+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.318544+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:46.009625+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"256'188","reported_seq":993,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.833506+0000","last_change":"2024-03-04T12:36:11.955503+0000","last_active":"2024-03-04T13:00:08.833506+0000","last_peered":"2024-03-04T13:00:08.833506+0000","last_clean":"2024-03-04T13:00:08.833506+0000","last_became_active":"2024-03-04T12:36:11.954554+0000","last_became_peered":"2024-03-04T12:36:11.954554+0000","last_unstale":"2024-03-04T13:00:08.833506+0000","last_undegraded":"2024-03-04T13:00:08.833506+0000","last_fullsized":"2024-03-04T13:00:08.833506+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":465,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:11.012256+0000","last_change":"2024-03-04T12:36:13.338785+0000","last_active":"2024-03-04T12:59:11.012256+0000","last_peered":"2024-03-04T12:59:11.012256+0000","last_clean":"2024-03-04T12:59:11.012256+0000","last_became_active":"2024-03-04T12:36:13.338388+0000","last_became_peered":"2024-03-04T12:36:13.338388+0000","last_unstale":"2024-03-04T12:59:11.012256+0000","last_undegraded":"2024-03-04T12:59:11.012256+0000","last_fullsized":"2024-03-04T12:59:11.012256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'194","reported_seq":693,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.827471+0000","last_change":"2024-03-04T13:00:33.827539+0000","last_active":"2024-03-04T13:00:33.827471+0000","last_peered":"2024-03-04T13:00:33.827471+0000","last_clean":"2024-03-04T13:00:33.827471+0000","last_became_active":"2024-03-04T12:36:15.353529+0000","last_became_peered":"2024-03-04T12:36:15.353529+0000","last_unstale":"2024-03-04T13:00:33.827471+0000","last_undegraded":"2024-03-04T13:00:33.827471+0000","last_fullsized":"2024-03-04T13:00:33.827471+0000","mapping_epoch":30,"log_start":"241'100","ondisk_log_start":"241'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'194","last_scrub_stamp":"2024-03-04T13:00:33.827362+0000","last_deep_scrub":"256'194","last_deep_scrub_stamp":"2024-03-04T13:00:33.827362+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.827362+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:43.745434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":292,"num_read_kb":316,"num_write":426,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"256'393","reported_seq":1823,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.685710+0000","last_change":"2024-03-04T12:36:07.299521+0000","last_active":"2024-03-04T13:00:06.685710+0000","last_peered":"2024-03-04T13:00:06.685710+0000","last_clean":"2024-03-04T13:00:06.685710+0000","last_became_active":"2024-03-04T12:36:07.298936+0000","last_became_peered":"2024-03-04T12:36:07.298936+0000","last_unstale":"2024-03-04T13:00:06.685710+0000","last_undegraded":"2024-03-04T13:00:06.685710+0000","last_fullsized":"2024-03-04T13:00:06.685710+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2152,"num_read_kb":2018,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":490,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:51.008984+0000","last_change":"2024-03-04T12:35:54.238657+0000","last_active":"2024-03-04T12:58:51.008984+0000","last_peered":"2024-03-04T12:58:51.008984+0000","last_clean":"2024-03-04T12:58:51.008984+0000","last_became_active":"2024-03-04T12:35:54.238357+0000","last_became_peered":"2024-03-04T12:35:54.238357+0000","last_unstale":"2024-03-04T12:58:51.008984+0000","last_undegraded":"2024-03-04T12:58:51.008984+0000","last_fullsized":"2024-03-04T12:58:51.008984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"256'327","reported_seq":976,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.109540+0000","last_change":"2024-03-04T12:36:05.289667+0000","last_active":"2024-03-04T13:00:17.109540+0000","last_peered":"2024-03-04T13:00:17.109540+0000","last_clean":"2024-03-04T13:00:17.109540+0000","last_became_active":"2024-03-04T12:36:05.289374+0000","last_became_peered":"2024-03-04T12:36:05.289374+0000","last_unstale":"2024-03-04T13:00:17.109540+0000","last_undegraded":"2024-03-04T13:00:17.109540+0000","last_fullsized":"2024-03-04T13:00:17.109540+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007111,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":531,"num_read_kb":54492,"num_write":1276,"num_write_kb":39662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:06.011671+0000","last_change":"2024-03-04T12:36:09.304779+0000","last_active":"2024-03-04T12:59:06.011671+0000","last_peered":"2024-03-04T12:59:06.011671+0000","last_clean":"2024-03-04T12:59:06.011671+0000","last_became_active":"2024-03-04T12:36:09.304291+0000","last_became_peered":"2024-03-04T12:36:09.304291+0000","last_unstale":"2024-03-04T12:59:06.011671+0000","last_undegraded":"2024-03-04T12:59:06.011671+0000","last_fullsized":"2024-03-04T12:59:06.011671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"256'81","reported_seq":587,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.001517+0000","last_change":"2024-03-04T12:36:11.326239+0000","last_active":"2024-03-04T13:00:01.001517+0000","last_peered":"2024-03-04T13:00:01.001517+0000","last_clean":"2024-03-04T13:00:01.001517+0000","last_became_active":"2024-03-04T12:36:11.325957+0000","last_became_peered":"2024-03-04T12:36:11.325957+0000","last_unstale":"2024-03-04T13:00:01.001517+0000","last_undegraded":"2024-03-04T13:00:01.001517+0000","last_fullsized":"2024-03-04T13:00:01.001517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":66,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.754977+0000","last_change":"2024-03-04T13:00:36.755000+0000","last_active":"2024-03-04T13:00:36.754977+0000","last_peered":"2024-03-04T13:00:36.754977+0000","last_clean":"2024-03-04T13:00:36.754977+0000","last_became_active":"2024-03-04T12:36:13.345547+0000","last_became_peered":"2024-03-04T12:36:13.345547+0000","last_unstale":"2024-03-04T13:00:36.754977+0000","last_undegraded":"2024-03-04T13:00:36.754977+0000","last_fullsized":"2024-03-04T13:00:36.754977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:36.754882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:36.754882+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.754882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:11.105892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"256'111","reported_seq":607,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.437171+0000","last_change":"2024-03-04T13:00:31.437195+0000","last_active":"2024-03-04T13:00:31.437171+0000","last_peered":"2024-03-04T13:00:31.437171+0000","last_clean":"2024-03-04T13:00:31.437171+0000","last_became_active":"2024-03-04T12:36:15.363185+0000","last_became_peered":"2024-03-04T12:36:15.363185+0000","last_unstale":"2024-03-04T13:00:31.437171+0000","last_undegraded":"2024-03-04T13:00:31.437171+0000","last_fullsized":"2024-03-04T13:00:31.437171+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'111","last_scrub_stamp":"2024-03-04T13:00:31.437082+0000","last_deep_scrub":"256'111","last_deep_scrub_stamp":"2024-03-04T13:00:31.437082+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.437082+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:45.642975+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":251,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"256'464","reported_seq":2008,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.027742+0000","last_change":"2024-03-04T12:36:07.297241+0000","last_active":"2024-03-04T12:59:56.027742+0000","last_peered":"2024-03-04T12:59:56.027742+0000","last_clean":"2024-03-04T12:59:56.027742+0000","last_became_active":"2024-03-04T12:36:07.296433+0000","last_became_peered":"2024-03-04T12:36:07.296433+0000","last_unstale":"2024-03-04T12:59:56.027742+0000","last_undegraded":"2024-03-04T12:59:56.027742+0000","last_fullsized":"2024-03-04T12:59:56.027742+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2396,"num_read_kb":2259,"num_write":579,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"256'399","reported_seq":1061,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.531144+0000","last_change":"2024-03-04T13:00:27.531193+0000","last_active":"2024-03-04T13:00:27.531144+0000","last_peered":"2024-03-04T13:00:27.531144+0000","last_clean":"2024-03-04T13:00:27.531144+0000","last_became_active":"2024-03-04T12:36:40.965346+0000","last_became_peered":"2024-03-04T12:36:40.965346+0000","last_unstale":"2024-03-04T13:00:27.531144+0000","last_undegraded":"2024-03-04T13:00:27.531144+0000","last_fullsized":"2024-03-04T13:00:27.531144+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'399","last_scrub_stamp":"2024-03-04T13:00:27.531051+0000","last_deep_scrub":"256'399","last_deep_scrub_stamp":"2024-03-04T13:00:27.531051+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.531051+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:45:37.677827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":48879,"num_write":1467,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":494,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:50.992508+0000","last_change":"2024-03-04T12:35:54.470673+0000","last_active":"2024-03-04T12:58:50.992508+0000","last_peered":"2024-03-04T12:58:50.992508+0000","last_clean":"2024-03-04T12:58:50.992508+0000","last_became_active":"2024-03-04T12:35:54.470407+0000","last_became_peered":"2024-03-04T12:35:54.470407+0000","last_unstale":"2024-03-04T12:58:50.992508+0000","last_undegraded":"2024-03-04T12:58:50.992508+0000","last_fullsized":"2024-03-04T12:58:50.992508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:06.011626+0000","last_change":"2024-03-04T12:36:09.308620+0000","last_active":"2024-03-04T12:59:06.011626+0000","last_peered":"2024-03-04T12:59:06.011626+0000","last_clean":"2024-03-04T12:59:06.011626+0000","last_became_active":"2024-03-04T12:36:09.308360+0000","last_became_peered":"2024-03-04T12:36:09.308360+0000","last_unstale":"2024-03-04T12:59:06.011626+0000","last_undegraded":"2024-03-04T12:59:06.011626+0000","last_fullsized":"2024-03-04T12:59:06.011626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"256'488","reported_seq":1113,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.880966+0000","last_change":"2024-03-04T12:36:11.329225+0000","last_active":"2024-03-04T13:00:16.880966+0000","last_peered":"2024-03-04T13:00:16.880966+0000","last_clean":"2024-03-04T13:00:16.880966+0000","last_became_active":"2024-03-04T12:36:11.328923+0000","last_became_peered":"2024-03-04T12:36:11.328923+0000","last_unstale":"2024-03-04T13:00:16.880966+0000","last_undegraded":"2024-03-04T13:00:16.880966+0000","last_fullsized":"2024-03-04T13:00:16.880966+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93633,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":843,"num_read_kb":1937,"num_write":680,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.115413+0000","last_change":"2024-03-04T13:00:31.115438+0000","last_active":"2024-03-04T13:00:31.115413+0000","last_peered":"2024-03-04T13:00:31.115413+0000","last_clean":"2024-03-04T13:00:31.115413+0000","last_became_active":"2024-03-04T12:36:13.346886+0000","last_became_peered":"2024-03-04T12:36:13.346886+0000","last_unstale":"2024-03-04T13:00:31.115413+0000","last_undegraded":"2024-03-04T13:00:31.115413+0000","last_fullsized":"2024-03-04T13:00:31.115413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:31.115320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:31.115320+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.115320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:25:44.557397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"256'95","reported_seq":583,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.588536+0000","last_change":"2024-03-04T13:00:37.588562+0000","last_active":"2024-03-04T13:00:37.588536+0000","last_peered":"2024-03-04T13:00:37.588536+0000","last_clean":"2024-03-04T13:00:37.588536+0000","last_became_active":"2024-03-04T12:36:15.350185+0000","last_became_peered":"2024-03-04T12:36:15.350185+0000","last_unstale":"2024-03-04T13:00:37.588536+0000","last_undegraded":"2024-03-04T13:00:37.588536+0000","last_fullsized":"2024-03-04T13:00:37.588536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'95","last_scrub_stamp":"2024-03-04T13:00:37.588450+0000","last_deep_scrub":"256'95","last_deep_scrub_stamp":"2024-03-04T13:00:37.588450+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.588450+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:31.645524+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":228,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"256'646","reported_seq":2009,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.620039+0000","last_change":"2024-03-04T12:36:07.296955+0000","last_active":"2024-03-04T12:59:47.620039+0000","last_peered":"2024-03-04T12:59:47.620039+0000","last_clean":"2024-03-04T12:59:47.620039+0000","last_became_active":"2024-03-04T12:36:07.296657+0000","last_became_peered":"2024-03-04T12:36:07.296657+0000","last_unstale":"2024-03-04T12:59:47.620039+0000","last_undegraded":"2024-03-04T12:59:47.620039+0000","last_fullsized":"2024-03-04T12:59:47.620039+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":600,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3068,"num_read_kb":2828,"num_write":988,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"256'347","reported_seq":1021,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.128096+0000","last_change":"2024-03-04T12:36:05.275545+0000","last_active":"2024-03-04T13:00:17.128096+0000","last_peered":"2024-03-04T13:00:17.128096+0000","last_clean":"2024-03-04T13:00:17.128096+0000","last_became_active":"2024-03-04T12:36:05.275263+0000","last_became_peered":"2024-03-04T12:36:05.275263+0000","last_unstale":"2024-03-04T13:00:17.128096+0000","last_undegraded":"2024-03-04T13:00:17.128096+0000","last_fullsized":"2024-03-04T13:00:17.128096+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":637,"num_read_kb":62539,"num_write":1435,"num_write_kb":42561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":493,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:55.893243+0000","last_change":"2024-03-04T12:35:54.470913+0000","last_active":"2024-03-04T12:58:55.893243+0000","last_peered":"2024-03-04T12:58:55.893243+0000","last_clean":"2024-03-04T12:58:55.893243+0000","last_became_active":"2024-03-04T12:35:54.470620+0000","last_became_peered":"2024-03-04T12:35:54.470620+0000","last_unstale":"2024-03-04T12:58:55.893243+0000","last_undegraded":"2024-03-04T12:58:55.893243+0000","last_fullsized":"2024-03-04T12:58:55.893243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.717088+0000","last_change":"2024-03-04T13:00:35.717113+0000","last_active":"2024-03-04T13:00:35.717088+0000","last_peered":"2024-03-04T13:00:35.717088+0000","last_clean":"2024-03-04T13:00:35.717088+0000","last_became_active":"2024-03-04T12:36:09.312135+0000","last_became_peered":"2024-03-04T12:36:09.312135+0000","last_unstale":"2024-03-04T13:00:35.717088+0000","last_undegraded":"2024-03-04T13:00:35.717088+0000","last_fullsized":"2024-03-04T13:00:35.717088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:35.716987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:35.716987+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.716987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:24.039129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"256'139","reported_seq":666,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:08.834044+0000","last_change":"2024-03-04T12:36:11.954977+0000","last_active":"2024-03-04T13:00:08.834044+0000","last_peered":"2024-03-04T13:00:08.834044+0000","last_clean":"2024-03-04T13:00:08.834044+0000","last_became_active":"2024-03-04T12:36:11.954579+0000","last_became_peered":"2024-03-04T12:36:11.954579+0000","last_unstale":"2024-03-04T13:00:08.834044+0000","last_undegraded":"2024-03-04T13:00:08.834044+0000","last_fullsized":"2024-03-04T13:00:08.834044+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":130,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"256'546","reported_seq":4073,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.400731+0000","last_change":"2024-03-04T13:00:38.400757+0000","last_active":"2024-03-04T13:00:38.400731+0000","last_peered":"2024-03-04T13:00:38.400731+0000","last_clean":"2024-03-04T13:00:38.400731+0000","last_became_active":"2024-03-04T12:36:13.341957+0000","last_became_peered":"2024-03-04T12:36:13.341957+0000","last_unstale":"2024-03-04T13:00:38.400731+0000","last_undegraded":"2024-03-04T13:00:38.400731+0000","last_fullsized":"2024-03-04T13:00:38.400731+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'546","last_scrub_stamp":"2024-03-04T13:00:38.400627+0000","last_deep_scrub":"256'546","last_deep_scrub_stamp":"2024-03-04T13:00:38.400627+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.400627+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:17.663169+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"256'125","reported_seq":607,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.712797+0000","last_change":"2024-03-04T13:00:29.712845+0000","last_active":"2024-03-04T13:00:29.712797+0000","last_peered":"2024-03-04T13:00:29.712797+0000","last_clean":"2024-03-04T13:00:29.712797+0000","last_became_active":"2024-03-04T12:36:15.355291+0000","last_became_peered":"2024-03-04T12:36:15.355291+0000","last_unstale":"2024-03-04T13:00:29.712797+0000","last_undegraded":"2024-03-04T13:00:29.712797+0000","last_fullsized":"2024-03-04T13:00:29.712797+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'125","last_scrub_stamp":"2024-03-04T13:00:29.712708+0000","last_deep_scrub":"256'125","last_deep_scrub_stamp":"2024-03-04T13:00:29.712708+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.712708+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:28:17.484104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"256'743","reported_seq":2162,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:11.002606+0000","last_change":"2024-03-04T12:36:07.290212+0000","last_active":"2024-03-04T13:00:11.002606+0000","last_peered":"2024-03-04T13:00:11.002606+0000","last_clean":"2024-03-04T13:00:11.002606+0000","last_became_active":"2024-03-04T12:36:07.289884+0000","last_became_peered":"2024-03-04T12:36:07.289884+0000","last_unstale":"2024-03-04T13:00:11.002606+0000","last_undegraded":"2024-03-04T13:00:11.002606+0000","last_fullsized":"2024-03-04T13:00:11.002606+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3351,"num_read_kb":2980,"num_write":997,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"256'320","reported_seq":927,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.098256+0000","last_change":"2024-03-04T12:36:05.291839+0000","last_active":"2024-03-04T13:00:17.098256+0000","last_peered":"2024-03-04T13:00:17.098256+0000","last_clean":"2024-03-04T13:00:17.098256+0000","last_became_active":"2024-03-04T12:36:05.291549+0000","last_became_peered":"2024-03-04T12:36:05.291549+0000","last_unstale":"2024-03-04T13:00:17.098256+0000","last_undegraded":"2024-03-04T13:00:17.098256+0000","last_fullsized":"2024-03-04T13:00:17.098256+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194348,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":36332,"num_write":1128,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":494,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:45.999213+0000","last_change":"2024-03-04T12:35:54.239060+0000","last_active":"2024-03-04T12:59:45.999213+0000","last_peered":"2024-03-04T12:59:45.999213+0000","last_clean":"2024-03-04T12:59:45.999213+0000","last_became_active":"2024-03-04T12:35:54.238802+0000","last_became_peered":"2024-03-04T12:35:54.238802+0000","last_unstale":"2024-03-04T12:59:45.999213+0000","last_undegraded":"2024-03-04T12:59:45.999213+0000","last_fullsized":"2024-03-04T12:59:45.999213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:06.011614+0000","last_change":"2024-03-04T12:36:09.307816+0000","last_active":"2024-03-04T12:59:06.011614+0000","last_peered":"2024-03-04T12:59:06.011614+0000","last_clean":"2024-03-04T12:59:06.011614+0000","last_became_active":"2024-03-04T12:36:09.307467+0000","last_became_peered":"2024-03-04T12:36:09.307467+0000","last_unstale":"2024-03-04T12:59:06.011614+0000","last_undegraded":"2024-03-04T12:59:06.011614+0000","last_fullsized":"2024-03-04T12:59:06.011614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"256'83","reported_seq":599,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.149562+0000","last_change":"2024-03-04T13:00:37.149599+0000","last_active":"2024-03-04T13:00:37.149562+0000","last_peered":"2024-03-04T13:00:37.149562+0000","last_clean":"2024-03-04T13:00:37.149562+0000","last_became_active":"2024-03-04T12:36:11.325955+0000","last_became_peered":"2024-03-04T12:36:11.325955+0000","last_unstale":"2024-03-04T13:00:37.149562+0000","last_undegraded":"2024-03-04T13:00:37.149562+0000","last_fullsized":"2024-03-04T13:00:37.149562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'83","last_scrub_stamp":"2024-03-04T13:00:37.149473+0000","last_deep_scrub":"256'83","last_deep_scrub_stamp":"2024-03-04T13:00:37.149473+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.149473+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:46:01.882397+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"256'535","reported_seq":1576,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.796520+0000","last_change":"2024-03-04T13:00:36.796546+0000","last_active":"2024-03-04T13:00:36.796520+0000","last_peered":"2024-03-04T13:00:36.796520+0000","last_clean":"2024-03-04T13:00:36.796520+0000","last_became_active":"2024-03-04T12:36:13.349421+0000","last_became_peered":"2024-03-04T12:36:13.349421+0000","last_unstale":"2024-03-04T13:00:36.796520+0000","last_undegraded":"2024-03-04T13:00:36.796520+0000","last_fullsized":"2024-03-04T13:00:36.796520+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'535","last_scrub_stamp":"2024-03-04T13:00:36.796431+0000","last_deep_scrub":"256'535","last_deep_scrub_stamp":"2024-03-04T13:00:36.796431+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.796431+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:02.418373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"256'96","reported_seq":574,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.623554+0000","last_change":"2024-03-04T13:00:35.623597+0000","last_active":"2024-03-04T13:00:35.623554+0000","last_peered":"2024-03-04T13:00:35.623554+0000","last_clean":"2024-03-04T13:00:35.623554+0000","last_became_active":"2024-03-04T12:36:15.356192+0000","last_became_peered":"2024-03-04T12:36:15.356192+0000","last_unstale":"2024-03-04T13:00:35.623554+0000","last_undegraded":"2024-03-04T13:00:35.623554+0000","last_fullsized":"2024-03-04T13:00:35.623554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'96","last_scrub_stamp":"2024-03-04T13:00:35.623431+0000","last_deep_scrub":"256'96","last_deep_scrub_stamp":"2024-03-04T13:00:35.623431+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.623431+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:27.378174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":232,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"256'390","reported_seq":1912,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.033233+0000","last_change":"2024-03-04T12:36:07.299701+0000","last_active":"2024-03-04T12:59:54.033233+0000","last_peered":"2024-03-04T12:59:54.033233+0000","last_clean":"2024-03-04T12:59:54.033233+0000","last_became_active":"2024-03-04T12:36:07.298963+0000","last_became_peered":"2024-03-04T12:36:07.298963+0000","last_unstale":"2024-03-04T12:59:54.033233+0000","last_undegraded":"2024-03-04T12:59:54.033233+0000","last_fullsized":"2024-03-04T12:59:54.033233+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2139,"num_write":463,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"256'321","reported_seq":932,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.103880+0000","last_change":"2024-03-04T12:36:05.282071+0000","last_active":"2024-03-04T13:00:17.103880+0000","last_peered":"2024-03-04T13:00:17.103880+0000","last_clean":"2024-03-04T13:00:17.103880+0000","last_became_active":"2024-03-04T12:36:05.281790+0000","last_became_peered":"2024-03-04T12:36:05.281790+0000","last_unstale":"2024-03-04T13:00:17.103880+0000","last_undegraded":"2024-03-04T13:00:17.103880+0000","last_fullsized":"2024-03-04T13:00:17.103880+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1778947,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":33441,"num_write":1185,"num_write_kb":31732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:46.007681+0000","last_change":"2024-03-04T12:35:54.239095+0000","last_active":"2024-03-04T12:59:46.007681+0000","last_peered":"2024-03-04T12:59:46.007681+0000","last_clean":"2024-03-04T12:59:46.007681+0000","last_became_active":"2024-03-04T12:35:54.238580+0000","last_became_peered":"2024-03-04T12:35:54.238580+0000","last_unstale":"2024-03-04T12:59:46.007681+0000","last_undegraded":"2024-03-04T12:59:46.007681+0000","last_fullsized":"2024-03-04T12:59:46.007681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:11.002635+0000","last_change":"2024-03-04T12:36:09.308483+0000","last_active":"2024-03-04T13:00:11.002635+0000","last_peered":"2024-03-04T13:00:11.002635+0000","last_clean":"2024-03-04T13:00:11.002635+0000","last_became_active":"2024-03-04T12:36:09.308162+0000","last_became_peered":"2024-03-04T12:36:09.308162+0000","last_unstale":"2024-03-04T13:00:11.002635+0000","last_undegraded":"2024-03-04T13:00:11.002635+0000","last_fullsized":"2024-03-04T13:00:11.002635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"256'704","reported_seq":1392,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.094639+0000","last_change":"2024-03-04T12:36:11.955174+0000","last_active":"2024-03-04T13:00:17.094639+0000","last_peered":"2024-03-04T13:00:17.094639+0000","last_clean":"2024-03-04T13:00:17.094639+0000","last_became_active":"2024-03-04T12:36:11.954569+0000","last_became_peered":"2024-03-04T12:36:11.954569+0000","last_unstale":"2024-03-04T13:00:17.094639+0000","last_undegraded":"2024-03-04T13:00:17.094639+0000","last_fullsized":"2024-03-04T13:00:17.094639+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140875,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1277,"num_read_kb":3093,"num_write":1046,"num_write_kb":893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.718909+0000","last_change":"2024-03-04T13:00:40.718951+0000","last_active":"2024-03-04T13:00:40.718909+0000","last_peered":"2024-03-04T13:00:40.718909+0000","last_clean":"2024-03-04T13:00:40.718909+0000","last_became_active":"2024-03-04T12:36:13.345919+0000","last_became_peered":"2024-03-04T12:36:13.345919+0000","last_unstale":"2024-03-04T13:00:40.718909+0000","last_undegraded":"2024-03-04T13:00:40.718909+0000","last_fullsized":"2024-03-04T13:00:40.718909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.718799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.718799+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.718799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:41.971577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"256'130","reported_seq":602,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.410188+0000","last_change":"2024-03-04T13:00:34.410237+0000","last_active":"2024-03-04T13:00:34.410188+0000","last_peered":"2024-03-04T13:00:34.410188+0000","last_clean":"2024-03-04T13:00:34.410188+0000","last_became_active":"2024-03-04T12:36:15.362710+0000","last_became_peered":"2024-03-04T12:36:15.362710+0000","last_unstale":"2024-03-04T13:00:34.410188+0000","last_undegraded":"2024-03-04T13:00:34.410188+0000","last_fullsized":"2024-03-04T13:00:34.410188+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'130","last_scrub_stamp":"2024-03-04T13:00:34.410088+0000","last_deep_scrub":"256'130","last_deep_scrub_stamp":"2024-03-04T13:00:34.410088+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.410088+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:38.504413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"256'110","reported_seq":580,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.566187+0000","last_change":"2024-03-04T13:00:31.566210+0000","last_active":"2024-03-04T13:00:31.566187+0000","last_peered":"2024-03-04T13:00:31.566187+0000","last_clean":"2024-03-04T13:00:31.566187+0000","last_became_active":"2024-03-04T12:36:15.363057+0000","last_became_peered":"2024-03-04T12:36:15.363057+0000","last_unstale":"2024-03-04T13:00:31.566187+0000","last_undegraded":"2024-03-04T13:00:31.566187+0000","last_fullsized":"2024-03-04T13:00:31.566187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'110","last_scrub_stamp":"2024-03-04T13:00:31.566095+0000","last_deep_scrub":"256'110","last_deep_scrub_stamp":"2024-03-04T13:00:31.566095+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.566095+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:05:38.612505+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":263,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"256'521","reported_seq":2071,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:45.915111+0000","last_change":"2024-03-04T12:36:07.294876+0000","last_active":"2024-03-04T12:59:45.915111+0000","last_peered":"2024-03-04T12:59:45.915111+0000","last_clean":"2024-03-04T12:59:45.915111+0000","last_became_active":"2024-03-04T12:36:07.292930+0000","last_became_peered":"2024-03-04T12:36:07.292930+0000","last_unstale":"2024-03-04T12:59:45.915111+0000","last_undegraded":"2024-03-04T12:59:45.915111+0000","last_fullsized":"2024-03-04T12:59:45.915111+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2723,"num_read_kb":2502,"num_write":698,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"256'323","reported_seq":960,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.109541+0000","last_change":"2024-03-04T12:36:05.287586+0000","last_active":"2024-03-04T13:00:17.109541+0000","last_peered":"2024-03-04T13:00:17.109541+0000","last_clean":"2024-03-04T13:00:17.109541+0000","last_became_active":"2024-03-04T12:36:05.287299+0000","last_became_peered":"2024-03-04T12:36:05.287299+0000","last_unstale":"2024-03-04T13:00:17.109541+0000","last_undegraded":"2024-03-04T13:00:17.109541+0000","last_fullsized":"2024-03-04T13:00:17.109541+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2779056,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":31884,"num_write":1263,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"32'3","reported_seq":789,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.230837+0000","last_change":"2024-03-04T12:36:09.315302+0000","last_active":"2024-03-04T13:00:15.230837+0000","last_peered":"2024-03-04T13:00:15.230837+0000","last_clean":"2024-03-04T13:00:15.230837+0000","last_became_active":"2024-03-04T12:36:09.314810+0000","last_became_peered":"2024-03-04T12:36:09.314810+0000","last_unstale":"2024-03-04T13:00:15.230837+0000","last_undegraded":"2024-03-04T13:00:15.230837+0000","last_fullsized":"2024-03-04T13:00:15.230837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"256'245","reported_seq":790,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.365401+0000","last_change":"2024-03-04T12:36:11.324996+0000","last_active":"2024-03-04T13:00:16.365401+0000","last_peered":"2024-03-04T13:00:16.365401+0000","last_clean":"2024-03-04T13:00:16.365401+0000","last_became_active":"2024-03-04T12:36:11.323046+0000","last_became_peered":"2024-03-04T12:36:11.323046+0000","last_unstale":"2024-03-04T13:00:16.365401+0000","last_undegraded":"2024-03-04T13:00:16.365401+0000","last_fullsized":"2024-03-04T13:00:16.365401+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51487,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":943,"num_write":330,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.767813+0000","last_change":"2024-03-04T13:00:37.767846+0000","last_active":"2024-03-04T13:00:37.767813+0000","last_peered":"2024-03-04T13:00:37.767813+0000","last_clean":"2024-03-04T13:00:37.767813+0000","last_became_active":"2024-03-04T12:36:13.348696+0000","last_became_peered":"2024-03-04T12:36:13.348696+0000","last_unstale":"2024-03-04T13:00:37.767813+0000","last_undegraded":"2024-03-04T13:00:37.767813+0000","last_fullsized":"2024-03-04T13:00:37.767813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.767716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.767716+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.767716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:39.879058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"256'83","reported_seq":563,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.806585+0000","last_change":"2024-03-04T13:00:32.806636+0000","last_active":"2024-03-04T13:00:32.806585+0000","last_peered":"2024-03-04T13:00:32.806585+0000","last_clean":"2024-03-04T13:00:32.806585+0000","last_became_active":"2024-03-04T12:36:15.354258+0000","last_became_peered":"2024-03-04T12:36:15.354258+0000","last_unstale":"2024-03-04T13:00:32.806585+0000","last_undegraded":"2024-03-04T13:00:32.806585+0000","last_fullsized":"2024-03-04T13:00:32.806585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'83","last_scrub_stamp":"2024-03-04T13:00:32.806479+0000","last_deep_scrub":"256'83","last_deep_scrub_stamp":"2024-03-04T13:00:32.806479+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.806479+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:51:22.735435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":75,"num_write":188,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"256'355","reported_seq":1705,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.959743+0000","last_change":"2024-03-04T12:36:07.296187+0000","last_active":"2024-03-04T13:00:06.959743+0000","last_peered":"2024-03-04T13:00:06.959743+0000","last_clean":"2024-03-04T13:00:06.959743+0000","last_became_active":"2024-03-04T12:36:07.295803+0000","last_became_peered":"2024-03-04T12:36:07.295803+0000","last_unstale":"2024-03-04T13:00:06.959743+0000","last_undegraded":"2024-03-04T13:00:06.959743+0000","last_fullsized":"2024-03-04T13:00:06.959743+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1867,"num_read_kb":1777,"num_write":399,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"256'333","reported_seq":949,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.112716+0000","last_change":"2024-03-04T12:36:05.296316+0000","last_active":"2024-03-04T13:00:17.112716+0000","last_peered":"2024-03-04T13:00:17.112716+0000","last_clean":"2024-03-04T13:00:17.112716+0000","last_became_active":"2024-03-04T12:36:05.296032+0000","last_became_peered":"2024-03-04T12:36:05.296032+0000","last_unstale":"2024-03-04T13:00:17.112716+0000","last_undegraded":"2024-03-04T13:00:17.112716+0000","last_fullsized":"2024-03-04T13:00:17.112716+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2492708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":28471,"num_write":1139,"num_write_kb":37420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.998013+0000","last_change":"2024-03-04T12:36:09.312289+0000","last_active":"2024-03-04T12:59:30.998013+0000","last_peered":"2024-03-04T12:59:30.998013+0000","last_clean":"2024-03-04T12:59:30.998013+0000","last_became_active":"2024-03-04T12:36:09.311953+0000","last_became_peered":"2024-03-04T12:36:09.311953+0000","last_unstale":"2024-03-04T12:59:30.998013+0000","last_undegraded":"2024-03-04T12:59:30.998013+0000","last_fullsized":"2024-03-04T12:59:30.998013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"256'31","reported_seq":505,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:31.014739+0000","last_change":"2024-03-04T12:36:11.326600+0000","last_active":"2024-03-04T12:59:31.014739+0000","last_peered":"2024-03-04T12:59:31.014739+0000","last_clean":"2024-03-04T12:59:31.014739+0000","last_became_active":"2024-03-04T12:36:11.326313+0000","last_became_peered":"2024-03-04T12:36:11.326313+0000","last_unstale":"2024-03-04T12:59:31.014739+0000","last_undegraded":"2024-03-04T12:59:31.014739+0000","last_fullsized":"2024-03-04T12:59:31.014739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.235834+0000","last_change":"2024-03-04T13:00:37.235857+0000","last_active":"2024-03-04T13:00:37.235834+0000","last_peered":"2024-03-04T13:00:37.235834+0000","last_clean":"2024-03-04T13:00:37.235834+0000","last_became_active":"2024-03-04T12:36:13.340203+0000","last_became_peered":"2024-03-04T12:36:13.340203+0000","last_unstale":"2024-03-04T13:00:37.235834+0000","last_undegraded":"2024-03-04T13:00:37.235834+0000","last_fullsized":"2024-03-04T13:00:37.235834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.235747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.235747+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.235747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:37.493747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"256'90","reported_seq":573,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.583553+0000","last_change":"2024-03-04T13:00:36.583607+0000","last_active":"2024-03-04T13:00:36.583553+0000","last_peered":"2024-03-04T13:00:36.583553+0000","last_clean":"2024-03-04T13:00:36.583553+0000","last_became_active":"2024-03-04T12:36:15.353545+0000","last_became_peered":"2024-03-04T12:36:15.353545+0000","last_unstale":"2024-03-04T13:00:36.583553+0000","last_undegraded":"2024-03-04T13:00:36.583553+0000","last_fullsized":"2024-03-04T13:00:36.583553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'90","last_scrub_stamp":"2024-03-04T13:00:36.583455+0000","last_deep_scrub":"256'90","last_deep_scrub_stamp":"2024-03-04T13:00:36.583455+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.583455+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:57:03.167360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":106,"num_write":213,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"256'994","reported_seq":2544,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.913685+0000","last_change":"2024-03-04T12:36:07.300137+0000","last_active":"2024-03-04T12:59:54.913685+0000","last_peered":"2024-03-04T12:59:54.913685+0000","last_clean":"2024-03-04T12:59:54.913685+0000","last_became_active":"2024-03-04T12:36:07.299326+0000","last_became_peered":"2024-03-04T12:36:07.299326+0000","last_unstale":"2024-03-04T12:59:54.913685+0000","last_undegraded":"2024-03-04T12:59:54.913685+0000","last_fullsized":"2024-03-04T12:59:54.913685+0000","mapping_epoch":22,"log_start":"256'900","ondisk_log_start":"256'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4343,"num_read_kb":3801,"num_write":1436,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"256'322","reported_seq":961,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.115316+0000","last_change":"2024-03-04T12:36:05.287491+0000","last_active":"2024-03-04T13:00:17.115316+0000","last_peered":"2024-03-04T13:00:17.115316+0000","last_clean":"2024-03-04T13:00:17.115316+0000","last_became_active":"2024-03-04T12:36:05.287185+0000","last_became_peered":"2024-03-04T12:36:05.287185+0000","last_unstale":"2024-03-04T13:00:17.115316+0000","last_undegraded":"2024-03-04T13:00:17.115316+0000","last_fullsized":"2024-03-04T13:00:17.115316+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730133,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":528,"num_read_kb":7345,"num_write":1182,"num_write_kb":36636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.898792+0000","last_change":"2024-03-04T12:36:09.305577+0000","last_active":"2024-03-04T12:59:30.898792+0000","last_peered":"2024-03-04T12:59:30.898792+0000","last_clean":"2024-03-04T12:59:30.898792+0000","last_became_active":"2024-03-04T12:36:09.305288+0000","last_became_peered":"2024-03-04T12:36:09.305288+0000","last_unstale":"2024-03-04T12:59:30.898792+0000","last_undegraded":"2024-03-04T12:59:30.898792+0000","last_fullsized":"2024-03-04T12:59:30.898792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"256'291","reported_seq":851,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.686967+0000","last_change":"2024-03-04T12:36:11.325238+0000","last_active":"2024-03-04T13:00:15.686967+0000","last_peered":"2024-03-04T13:00:15.686967+0000","last_clean":"2024-03-04T13:00:15.686967+0000","last_became_active":"2024-03-04T12:36:11.324758+0000","last_became_peered":"2024-03-04T12:36:11.324758+0000","last_unstale":"2024-03-04T13:00:15.686967+0000","last_undegraded":"2024-03-04T13:00:15.686967+0000","last_fullsized":"2024-03-04T13:00:15.686967+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":483,"num_read_kb":1065,"num_write":390,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.725145+0000","last_change":"2024-03-04T13:00:38.725169+0000","last_active":"2024-03-04T13:00:38.725145+0000","last_peered":"2024-03-04T13:00:38.725145+0000","last_clean":"2024-03-04T13:00:38.725145+0000","last_became_active":"2024-03-04T12:36:13.345556+0000","last_became_peered":"2024-03-04T12:36:13.345556+0000","last_unstale":"2024-03-04T13:00:38.725145+0000","last_undegraded":"2024-03-04T13:00:38.725145+0000","last_fullsized":"2024-03-04T13:00:38.725145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:38.725031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:38.725031+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.725031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:46.207626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"256'172","reported_seq":667,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.459248+0000","last_change":"2024-03-04T13:00:30.459299+0000","last_active":"2024-03-04T13:00:30.459248+0000","last_peered":"2024-03-04T13:00:30.459248+0000","last_clean":"2024-03-04T13:00:30.459248+0000","last_became_active":"2024-03-04T12:36:15.363544+0000","last_became_peered":"2024-03-04T12:36:15.363544+0000","last_unstale":"2024-03-04T13:00:30.459248+0000","last_undegraded":"2024-03-04T13:00:30.459248+0000","last_fullsized":"2024-03-04T13:00:30.459248+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'172","last_scrub_stamp":"2024-03-04T13:00:30.459143+0000","last_deep_scrub":"256'172","last_deep_scrub_stamp":"2024-03-04T13:00:30.459143+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.459143+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:00:31.537557+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":198,"num_write":386,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"256'401","reported_seq":1834,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.685614+0000","last_change":"2024-03-04T12:36:07.293124+0000","last_active":"2024-03-04T13:00:06.685614+0000","last_peered":"2024-03-04T13:00:06.685614+0000","last_clean":"2024-03-04T13:00:06.685614+0000","last_became_active":"2024-03-04T12:36:07.292814+0000","last_became_peered":"2024-03-04T12:36:07.292814+0000","last_unstale":"2024-03-04T13:00:06.685614+0000","last_undegraded":"2024-03-04T13:00:06.685614+0000","last_fullsized":"2024-03-04T13:00:06.685614+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2067,"num_read_kb":1953,"num_write":480,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"256'310","reported_seq":913,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.561357+0000","last_change":"2024-03-04T13:00:28.561406+0000","last_active":"2024-03-04T13:00:28.561357+0000","last_peered":"2024-03-04T13:00:28.561357+0000","last_clean":"2024-03-04T13:00:28.561357+0000","last_became_active":"2024-03-04T12:36:40.964989+0000","last_became_peered":"2024-03-04T12:36:40.964989+0000","last_unstale":"2024-03-04T13:00:28.561357+0000","last_undegraded":"2024-03-04T13:00:28.561357+0000","last_fullsized":"2024-03-04T13:00:28.561357+0000","mapping_epoch":33,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'310","last_scrub_stamp":"2024-03-04T13:00:28.561273+0000","last_deep_scrub":"256'310","last_deep_scrub_stamp":"2024-03-04T13:00:28.561273+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.561273+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:45:32.752696+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":22171,"num_write":1178,"num_write_kb":35457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.720495+0000","last_change":"2024-03-04T13:00:37.720522+0000","last_active":"2024-03-04T13:00:37.720495+0000","last_peered":"2024-03-04T13:00:37.720495+0000","last_clean":"2024-03-04T13:00:37.720495+0000","last_became_active":"2024-03-04T12:36:09.309883+0000","last_became_peered":"2024-03-04T12:36:09.309883+0000","last_unstale":"2024-03-04T13:00:37.720495+0000","last_undegraded":"2024-03-04T13:00:37.720495+0000","last_fullsized":"2024-03-04T13:00:37.720495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.720405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.720405+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.720405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:04.234972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"256'252","reported_seq":796,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.483819+0000","last_change":"2024-03-04T12:36:11.325094+0000","last_active":"2024-03-04T13:00:15.483819+0000","last_peered":"2024-03-04T13:00:15.483819+0000","last_clean":"2024-03-04T13:00:15.483819+0000","last_became_active":"2024-03-04T12:36:11.324784+0000","last_became_peered":"2024-03-04T12:36:11.324784+0000","last_unstale":"2024-03-04T13:00:15.483819+0000","last_undegraded":"2024-03-04T13:00:15.483819+0000","last_fullsized":"2024-03-04T13:00:15.483819+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54138,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":1067,"num_write":352,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.556862+0000","last_change":"2024-03-04T13:00:40.556902+0000","last_active":"2024-03-04T13:00:40.556862+0000","last_peered":"2024-03-04T13:00:40.556862+0000","last_clean":"2024-03-04T13:00:40.556862+0000","last_became_active":"2024-03-04T12:36:13.343030+0000","last_became_peered":"2024-03-04T12:36:13.343030+0000","last_unstale":"2024-03-04T13:00:40.556862+0000","last_undegraded":"2024-03-04T13:00:40.556862+0000","last_fullsized":"2024-03-04T13:00:40.556862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.556715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.556715+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.556715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:11:37.035294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"256'687","reported_seq":2135,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.028048+0000","last_change":"2024-03-04T12:36:07.298429+0000","last_active":"2024-03-04T12:59:56.028048+0000","last_peered":"2024-03-04T12:59:56.028048+0000","last_clean":"2024-03-04T12:59:56.028048+0000","last_became_active":"2024-03-04T12:36:07.298154+0000","last_became_peered":"2024-03-04T12:36:07.298154+0000","last_unstale":"2024-03-04T12:59:56.028048+0000","last_undegraded":"2024-03-04T12:59:56.028048+0000","last_fullsized":"2024-03-04T12:59:56.028048+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":600,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3209,"num_read_kb":2902,"num_write":904,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"256'315","reported_seq":1018,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.114973+0000","last_change":"2024-03-04T12:36:05.287614+0000","last_active":"2024-03-04T13:00:17.114973+0000","last_peered":"2024-03-04T13:00:17.114973+0000","last_clean":"2024-03-04T13:00:17.114973+0000","last_became_active":"2024-03-04T12:36:05.287329+0000","last_became_peered":"2024-03-04T12:36:05.287329+0000","last_unstale":"2024-03-04T13:00:17.114973+0000","last_undegraded":"2024-03-04T13:00:17.114973+0000","last_fullsized":"2024-03-04T13:00:17.114973+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":51334,"num_write":1200,"num_write_kb":22699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:11.019371+0000","last_change":"2024-03-04T12:36:09.307589+0000","last_active":"2024-03-04T13:00:11.019371+0000","last_peered":"2024-03-04T13:00:11.019371+0000","last_clean":"2024-03-04T13:00:11.019371+0000","last_became_active":"2024-03-04T12:36:09.307329+0000","last_became_peered":"2024-03-04T12:36:09.307329+0000","last_unstale":"2024-03-04T13:00:11.019371+0000","last_undegraded":"2024-03-04T13:00:11.019371+0000","last_fullsized":"2024-03-04T13:00:11.019371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"256'413","reported_seq":1018,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.782236+0000","last_change":"2024-03-04T12:36:11.323790+0000","last_active":"2024-03-04T13:00:16.782236+0000","last_peered":"2024-03-04T13:00:16.782236+0000","last_clean":"2024-03-04T13:00:16.782236+0000","last_became_active":"2024-03-04T12:36:11.323506+0000","last_became_peered":"2024-03-04T12:36:11.323506+0000","last_unstale":"2024-03-04T13:00:16.782236+0000","last_undegraded":"2024-03-04T13:00:16.782236+0000","last_fullsized":"2024-03-04T13:00:16.782236+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114357,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":734,"num_read_kb":1796,"num_write":592,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.405098+0000","last_change":"2024-03-04T13:00:37.405124+0000","last_active":"2024-03-04T13:00:37.405098+0000","last_peered":"2024-03-04T13:00:37.405098+0000","last_clean":"2024-03-04T13:00:37.405098+0000","last_became_active":"2024-03-04T12:36:13.346628+0000","last_became_peered":"2024-03-04T12:36:13.346628+0000","last_unstale":"2024-03-04T13:00:37.405098+0000","last_undegraded":"2024-03-04T13:00:37.405098+0000","last_fullsized":"2024-03-04T13:00:37.405098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.404992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.404992+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.404992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:53:15.725542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"256'167","reported_seq":654,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.777427+0000","last_change":"2024-03-04T13:00:31.777458+0000","last_active":"2024-03-04T13:00:31.777427+0000","last_peered":"2024-03-04T13:00:31.777427+0000","last_clean":"2024-03-04T13:00:31.777427+0000","last_became_active":"2024-03-04T12:36:15.354125+0000","last_became_peered":"2024-03-04T12:36:15.354125+0000","last_unstale":"2024-03-04T13:00:31.777427+0000","last_undegraded":"2024-03-04T13:00:31.777427+0000","last_fullsized":"2024-03-04T13:00:31.777427+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'167","last_scrub_stamp":"2024-03-04T13:00:31.777324+0000","last_deep_scrub":"256'167","last_deep_scrub_stamp":"2024-03-04T13:00:31.777324+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.777324+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:56:57.666876+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":203,"num_write":373,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"256'1141","reported_seq":2715,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:11.019358+0000","last_change":"2024-03-04T12:36:07.298750+0000","last_active":"2024-03-04T13:00:11.019358+0000","last_peered":"2024-03-04T13:00:11.019358+0000","last_clean":"2024-03-04T13:00:11.019358+0000","last_became_active":"2024-03-04T12:36:07.298434+0000","last_became_peered":"2024-03-04T12:36:07.298434+0000","last_unstale":"2024-03-04T13:00:11.019358+0000","last_undegraded":"2024-03-04T13:00:11.019358+0000","last_fullsized":"2024-03-04T13:00:11.019358+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4934,"num_read_kb":4324,"num_write":1585,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"256'396","reported_seq":1040,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.121662+0000","last_change":"2024-03-04T12:36:05.287853+0000","last_active":"2024-03-04T13:00:17.121662+0000","last_peered":"2024-03-04T13:00:17.121662+0000","last_clean":"2024-03-04T13:00:17.121662+0000","last_became_active":"2024-03-04T12:36:05.287506+0000","last_became_peered":"2024-03-04T12:36:05.287506+0000","last_unstale":"2024-03-04T13:00:17.121662+0000","last_undegraded":"2024-03-04T13:00:17.121662+0000","last_fullsized":"2024-03-04T13:00:17.121662+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6658491,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":603,"num_read_kb":47023,"num_write":1149,"num_write_kb":33887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.716178+0000","last_change":"2024-03-04T13:00:39.716223+0000","last_active":"2024-03-04T13:00:39.716178+0000","last_peered":"2024-03-04T13:00:39.716178+0000","last_clean":"2024-03-04T13:00:39.716178+0000","last_became_active":"2024-03-04T12:36:09.309155+0000","last_became_peered":"2024-03-04T12:36:09.309155+0000","last_unstale":"2024-03-04T13:00:39.716178+0000","last_undegraded":"2024-03-04T13:00:39.716178+0000","last_fullsized":"2024-03-04T13:00:39.716178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.716073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.716073+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.716073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:43.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"256'274","reported_seq":826,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.553036+0000","last_change":"2024-03-04T12:36:11.323679+0000","last_active":"2024-03-04T13:00:15.553036+0000","last_peered":"2024-03-04T13:00:15.553036+0000","last_clean":"2024-03-04T13:00:15.553036+0000","last_became_active":"2024-03-04T12:36:11.323320+0000","last_became_peered":"2024-03-04T12:36:11.323320+0000","last_unstale":"2024-03-04T13:00:15.553036+0000","last_undegraded":"2024-03-04T13:00:15.553036+0000","last_fullsized":"2024-03-04T13:00:15.553036+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44965,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":1036,"num_write":392,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":470,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:45.992002+0000","last_change":"2024-03-04T12:36:13.340810+0000","last_active":"2024-03-04T12:58:45.992002+0000","last_peered":"2024-03-04T12:58:45.992002+0000","last_clean":"2024-03-04T12:58:45.992002+0000","last_became_active":"2024-03-04T12:36:13.340525+0000","last_became_peered":"2024-03-04T12:36:13.340525+0000","last_unstale":"2024-03-04T12:58:45.992002+0000","last_undegraded":"2024-03-04T12:58:45.992002+0000","last_fullsized":"2024-03-04T12:58:45.992002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"256'155","reported_seq":981,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:07.731887+0000","last_change":"2024-03-04T12:36:15.363212+0000","last_active":"2024-03-04T13:00:07.731887+0000","last_peered":"2024-03-04T13:00:07.731887+0000","last_clean":"2024-03-04T13:00:07.731887+0000","last_became_active":"2024-03-04T12:36:15.362749+0000","last_became_peered":"2024-03-04T12:36:15.362749+0000","last_unstale":"2024-03-04T13:00:07.731887+0000","last_undegraded":"2024-03-04T13:00:07.731887+0000","last_fullsized":"2024-03-04T13:00:07.731887+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:14.323569+0000","last_clean_scrub_stamp":"2024-03-04T12:36:14.323569+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":549,"num_write":456,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"256'352","reported_seq":1697,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.295578+0000","last_change":"2024-03-04T12:36:07.293117+0000","last_active":"2024-03-04T12:59:48.295578+0000","last_peered":"2024-03-04T12:59:48.295578+0000","last_clean":"2024-03-04T12:59:48.295578+0000","last_became_active":"2024-03-04T12:36:07.292806+0000","last_became_peered":"2024-03-04T12:36:07.292806+0000","last_unstale":"2024-03-04T12:59:48.295578+0000","last_undegraded":"2024-03-04T12:59:48.295578+0000","last_fullsized":"2024-03-04T12:59:48.295578+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1929,"num_read_kb":1816,"num_write":430,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"256'316","reported_seq":953,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.126160+0000","last_change":"2024-03-04T12:36:05.289335+0000","last_active":"2024-03-04T13:00:17.126160+0000","last_peered":"2024-03-04T13:00:17.126160+0000","last_clean":"2024-03-04T13:00:17.126160+0000","last_became_active":"2024-03-04T12:36:05.289053+0000","last_became_peered":"2024-03-04T12:36:05.289053+0000","last_unstale":"2024-03-04T13:00:17.126160+0000","last_undegraded":"2024-03-04T13:00:17.126160+0000","last_fullsized":"2024-03-04T13:00:17.126160+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2688993,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":60644,"num_write":1189,"num_write_kb":49301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:41.007450+0000","last_change":"2024-03-04T12:36:09.308491+0000","last_active":"2024-03-04T12:58:41.007450+0000","last_peered":"2024-03-04T12:58:41.007450+0000","last_clean":"2024-03-04T12:58:41.007450+0000","last_became_active":"2024-03-04T12:36:09.308231+0000","last_became_peered":"2024-03-04T12:36:09.308231+0000","last_unstale":"2024-03-04T12:58:41.007450+0000","last_undegraded":"2024-03-04T12:58:41.007450+0000","last_fullsized":"2024-03-04T12:58:41.007450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"256'276","reported_seq":822,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.608127+0000","last_change":"2024-03-04T12:36:11.954917+0000","last_active":"2024-03-04T13:00:16.608127+0000","last_peered":"2024-03-04T13:00:16.608127+0000","last_clean":"2024-03-04T13:00:16.608127+0000","last_became_active":"2024-03-04T12:36:11.954568+0000","last_became_peered":"2024-03-04T12:36:11.954568+0000","last_unstale":"2024-03-04T13:00:16.608127+0000","last_undegraded":"2024-03-04T13:00:16.608127+0000","last_fullsized":"2024-03-04T13:00:16.608127+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47143,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":469,"num_read_kb":1144,"num_write":392,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.352755+0000","last_change":"2024-03-04T13:00:35.352796+0000","last_active":"2024-03-04T13:00:35.352755+0000","last_peered":"2024-03-04T13:00:35.352755+0000","last_clean":"2024-03-04T13:00:35.352755+0000","last_became_active":"2024-03-04T12:36:13.346665+0000","last_became_peered":"2024-03-04T12:36:13.346665+0000","last_unstale":"2024-03-04T13:00:35.352755+0000","last_undegraded":"2024-03-04T13:00:35.352755+0000","last_fullsized":"2024-03-04T13:00:35.352755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:35.352646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:35.352646+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.352646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:01.849654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'106","reported_seq":579,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.473585+0000","last_change":"2024-03-04T13:00:29.473616+0000","last_active":"2024-03-04T13:00:29.473585+0000","last_peered":"2024-03-04T13:00:29.473585+0000","last_clean":"2024-03-04T13:00:29.473585+0000","last_became_active":"2024-03-04T12:36:15.363269+0000","last_became_peered":"2024-03-04T12:36:15.363269+0000","last_unstale":"2024-03-04T13:00:29.473585+0000","last_undegraded":"2024-03-04T13:00:29.473585+0000","last_fullsized":"2024-03-04T13:00:29.473585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'106","last_scrub_stamp":"2024-03-04T13:00:29.473497+0000","last_deep_scrub":"256'106","last_deep_scrub_stamp":"2024-03-04T13:00:29.473497+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.473497+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:09.775009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"256'427","reported_seq":1937,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.693373+0000","last_change":"2024-03-04T12:36:07.296189+0000","last_active":"2024-03-04T13:00:06.693373+0000","last_peered":"2024-03-04T13:00:06.693373+0000","last_clean":"2024-03-04T13:00:06.693373+0000","last_became_active":"2024-03-04T12:36:07.295353+0000","last_became_peered":"2024-03-04T12:36:07.295353+0000","last_unstale":"2024-03-04T13:00:06.693373+0000","last_undegraded":"2024-03-04T13:00:06.693373+0000","last_fullsized":"2024-03-04T13:00:06.693373+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2362,"num_read_kb":2211,"num_write":524,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"256'511","reported_seq":1158,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.129162+0000","last_change":"2024-03-04T12:36:05.293958+0000","last_active":"2024-03-04T13:00:17.129162+0000","last_peered":"2024-03-04T13:00:17.129162+0000","last_clean":"2024-03-04T13:00:17.129162+0000","last_became_active":"2024-03-04T12:36:05.293646+0000","last_became_peered":"2024-03-04T12:36:05.293646+0000","last_unstale":"2024-03-04T13:00:17.129162+0000","last_undegraded":"2024-03-04T13:00:17.129162+0000","last_fullsized":"2024-03-04T13:00:17.129162+0000","mapping_epoch":20,"log_start":"256'500","ondisk_log_start":"256'500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242951,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":853,"num_read_kb":46890,"num_write":1453,"num_write_kb":44359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":486,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.333638+0000","last_change":"2024-03-04T13:00:36.333662+0000","last_active":"2024-03-04T13:00:36.333638+0000","last_peered":"2024-03-04T13:00:36.333638+0000","last_clean":"2024-03-04T13:00:36.333638+0000","last_became_active":"2024-03-04T12:36:09.305073+0000","last_became_peered":"2024-03-04T12:36:09.305073+0000","last_unstale":"2024-03-04T13:00:36.333638+0000","last_undegraded":"2024-03-04T13:00:36.333638+0000","last_fullsized":"2024-03-04T13:00:36.333638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:36.333509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:36.333509+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.333509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:13.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"256'70","reported_seq":572,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.123546+0000","last_change":"2024-03-04T13:00:35.123593+0000","last_active":"2024-03-04T13:00:35.123546+0000","last_peered":"2024-03-04T13:00:35.123546+0000","last_clean":"2024-03-04T13:00:35.123546+0000","last_became_active":"2024-03-04T12:36:11.954563+0000","last_became_peered":"2024-03-04T12:36:11.954563+0000","last_unstale":"2024-03-04T13:00:35.123546+0000","last_undegraded":"2024-03-04T13:00:35.123546+0000","last_fullsized":"2024-03-04T13:00:35.123546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'70","last_scrub_stamp":"2024-03-04T13:00:35.123457+0000","last_deep_scrub":"256'70","last_deep_scrub_stamp":"2024-03-04T13:00:35.123457+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.123457+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:38.665714+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":71,"num_read_kb":64,"num_write":78,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"256'482","reported_seq":1816,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.719943+0000","last_change":"2024-03-04T13:00:33.719971+0000","last_active":"2024-03-04T13:00:33.719943+0000","last_peered":"2024-03-04T13:00:33.719943+0000","last_clean":"2024-03-04T13:00:33.719943+0000","last_became_active":"2024-03-04T12:36:13.340221+0000","last_became_peered":"2024-03-04T12:36:13.340221+0000","last_unstale":"2024-03-04T13:00:33.719943+0000","last_undegraded":"2024-03-04T13:00:33.719943+0000","last_fullsized":"2024-03-04T13:00:33.719943+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'482","last_scrub_stamp":"2024-03-04T13:00:33.719854+0000","last_deep_scrub":"256'482","last_deep_scrub_stamp":"2024-03-04T13:00:33.719854+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.719854+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:52.429432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"256'134","reported_seq":617,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.308023+0000","last_change":"2024-03-04T13:00:33.308076+0000","last_active":"2024-03-04T13:00:33.308023+0000","last_peered":"2024-03-04T13:00:33.308023+0000","last_clean":"2024-03-04T13:00:33.308023+0000","last_became_active":"2024-03-04T12:36:15.364688+0000","last_became_peered":"2024-03-04T12:36:15.364688+0000","last_unstale":"2024-03-04T13:00:33.308023+0000","last_undegraded":"2024-03-04T13:00:33.308023+0000","last_fullsized":"2024-03-04T13:00:33.308023+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'134","last_scrub_stamp":"2024-03-04T13:00:33.307905+0000","last_deep_scrub":"256'134","last_deep_scrub_stamp":"2024-03-04T13:00:33.307905+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.307905+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:36.869465+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":294,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"256'357","reported_seq":1821,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.914823+0000","last_change":"2024-03-04T12:36:07.291346+0000","last_active":"2024-03-04T12:59:54.914823+0000","last_peered":"2024-03-04T12:59:54.914823+0000","last_clean":"2024-03-04T12:59:54.914823+0000","last_became_active":"2024-03-04T12:36:07.290637+0000","last_became_peered":"2024-03-04T12:36:07.290637+0000","last_unstale":"2024-03-04T12:59:54.914823+0000","last_undegraded":"2024-03-04T12:59:54.914823+0000","last_fullsized":"2024-03-04T12:59:54.914823+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1998,"num_read_kb":1913,"num_write":399,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"256'421","reported_seq":1075,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.128097+0000","last_change":"2024-03-04T12:36:05.294852+0000","last_active":"2024-03-04T13:00:17.128097+0000","last_peered":"2024-03-04T13:00:17.128097+0000","last_clean":"2024-03-04T13:00:17.128097+0000","last_became_active":"2024-03-04T12:36:05.294568+0000","last_became_peered":"2024-03-04T12:36:05.294568+0000","last_unstale":"2024-03-04T13:00:17.128097+0000","last_undegraded":"2024-03-04T13:00:17.128097+0000","last_fullsized":"2024-03-04T13:00:17.128097+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6680724,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":37257,"num_write":1366,"num_write_kb":50791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:40.891066+0000","last_change":"2024-03-04T12:36:09.306310+0000","last_active":"2024-03-04T12:58:40.891066+0000","last_peered":"2024-03-04T12:58:40.891066+0000","last_clean":"2024-03-04T12:58:40.891066+0000","last_became_active":"2024-03-04T12:36:09.306005+0000","last_became_peered":"2024-03-04T12:36:09.306005+0000","last_unstale":"2024-03-04T12:58:40.891066+0000","last_undegraded":"2024-03-04T12:58:40.891066+0000","last_fullsized":"2024-03-04T12:58:40.891066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"256'272","reported_seq":822,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.024730+0000","last_change":"2024-03-04T12:36:11.325797+0000","last_active":"2024-03-04T13:00:21.024730+0000","last_peered":"2024-03-04T13:00:21.024730+0000","last_clean":"2024-03-04T13:00:21.024730+0000","last_became_active":"2024-03-04T12:36:11.325503+0000","last_became_peered":"2024-03-04T12:36:11.325503+0000","last_unstale":"2024-03-04T13:00:21.024730+0000","last_undegraded":"2024-03-04T13:00:21.024730+0000","last_fullsized":"2024-03-04T13:00:21.024730+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52232,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":458,"num_read_kb":1083,"num_write":374,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.247746+0000","last_change":"2024-03-04T12:36:13.339697+0000","last_active":"2024-03-04T13:00:21.247746+0000","last_peered":"2024-03-04T13:00:21.247746+0000","last_clean":"2024-03-04T13:00:21.247746+0000","last_became_active":"2024-03-04T12:36:13.339349+0000","last_became_peered":"2024-03-04T12:36:13.339349+0000","last_unstale":"2024-03-04T13:00:21.247746+0000","last_undegraded":"2024-03-04T13:00:21.247746+0000","last_fullsized":"2024-03-04T13:00:21.247746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"256'112","reported_seq":648,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.281626+0000","last_change":"2024-03-04T13:00:36.281667+0000","last_active":"2024-03-04T13:00:36.281626+0000","last_peered":"2024-03-04T13:00:36.281626+0000","last_clean":"2024-03-04T13:00:36.281626+0000","last_became_active":"2024-03-04T12:36:15.352383+0000","last_became_peered":"2024-03-04T12:36:15.352383+0000","last_unstale":"2024-03-04T13:00:36.281626+0000","last_undegraded":"2024-03-04T13:00:36.281626+0000","last_fullsized":"2024-03-04T13:00:36.281626+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'112","last_scrub_stamp":"2024-03-04T13:00:36.281541+0000","last_deep_scrub":"256'112","last_deep_scrub_stamp":"2024-03-04T13:00:36.281541+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.281541+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:36:25.279505+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":264,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"256'405","reported_seq":1775,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.048313+0000","last_change":"2024-03-04T12:36:07.296237+0000","last_active":"2024-03-04T12:59:56.048313+0000","last_peered":"2024-03-04T12:59:56.048313+0000","last_clean":"2024-03-04T12:59:56.048313+0000","last_became_active":"2024-03-04T12:36:07.295956+0000","last_became_peered":"2024-03-04T12:36:07.295956+0000","last_unstale":"2024-03-04T12:59:56.048313+0000","last_undegraded":"2024-03-04T12:59:56.048313+0000","last_fullsized":"2024-03-04T12:59:56.048313+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2057,"num_read_kb":1911,"num_write":497,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"256'290","reported_seq":883,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.127904+0000","last_change":"2024-03-04T12:36:05.294942+0000","last_active":"2024-03-04T13:00:17.127904+0000","last_peered":"2024-03-04T13:00:17.127904+0000","last_clean":"2024-03-04T13:00:17.127904+0000","last_became_active":"2024-03-04T12:36:05.294686+0000","last_became_peered":"2024-03-04T12:36:05.294686+0000","last_unstale":"2024-03-04T13:00:17.127904+0000","last_undegraded":"2024-03-04T13:00:17.127904+0000","last_fullsized":"2024-03-04T13:00:17.127904+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":38414,"num_write":1001,"num_write_kb":48852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:41.007352+0000","last_change":"2024-03-04T12:36:09.315306+0000","last_active":"2024-03-04T12:58:41.007352+0000","last_peered":"2024-03-04T12:58:41.007352+0000","last_clean":"2024-03-04T12:58:41.007352+0000","last_became_active":"2024-03-04T12:36:09.314912+0000","last_became_peered":"2024-03-04T12:36:09.314912+0000","last_unstale":"2024-03-04T12:58:41.007352+0000","last_undegraded":"2024-03-04T12:58:41.007352+0000","last_fullsized":"2024-03-04T12:58:41.007352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"256'265","reported_seq":803,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.020402+0000","last_change":"2024-03-04T12:36:11.325501+0000","last_active":"2024-03-04T13:00:21.020402+0000","last_peered":"2024-03-04T13:00:21.020402+0000","last_clean":"2024-03-04T13:00:21.020402+0000","last_became_active":"2024-03-04T12:36:11.325238+0000","last_became_peered":"2024-03-04T12:36:11.325238+0000","last_unstale":"2024-03-04T13:00:21.020402+0000","last_undegraded":"2024-03-04T13:00:21.020402+0000","last_fullsized":"2024-03-04T13:00:21.020402+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45924,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1039,"num_write":360,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.728346+0000","last_change":"2024-03-04T13:00:32.728368+0000","last_active":"2024-03-04T13:00:32.728346+0000","last_peered":"2024-03-04T13:00:32.728346+0000","last_clean":"2024-03-04T13:00:32.728346+0000","last_became_active":"2024-03-04T12:36:13.341689+0000","last_became_peered":"2024-03-04T12:36:13.341689+0000","last_unstale":"2024-03-04T13:00:32.728346+0000","last_undegraded":"2024-03-04T13:00:32.728346+0000","last_fullsized":"2024-03-04T13:00:32.728346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:32.728255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:32.728255+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.728255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:29.104225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"256'99","reported_seq":601,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.811874+0000","last_change":"2024-03-04T13:00:35.811925+0000","last_active":"2024-03-04T13:00:35.811874+0000","last_peered":"2024-03-04T13:00:35.811874+0000","last_clean":"2024-03-04T13:00:35.811874+0000","last_became_active":"2024-03-04T12:36:15.353418+0000","last_became_peered":"2024-03-04T12:36:15.353418+0000","last_unstale":"2024-03-04T13:00:35.811874+0000","last_undegraded":"2024-03-04T13:00:35.811874+0000","last_fullsized":"2024-03-04T13:00:35.811874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'99","last_scrub_stamp":"2024-03-04T13:00:35.811760+0000","last_deep_scrub":"256'99","last_deep_scrub_stamp":"2024-03-04T13:00:35.811760+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.811760+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:45.530873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"256'1443","reported_seq":2776,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.004084+0000","last_change":"2024-03-04T12:36:07.300609+0000","last_active":"2024-03-04T13:00:21.004084+0000","last_peered":"2024-03-04T13:00:21.004084+0000","last_clean":"2024-03-04T13:00:21.004084+0000","last_became_active":"2024-03-04T12:36:07.300067+0000","last_became_peered":"2024-03-04T12:36:07.300067+0000","last_unstale":"2024-03-04T13:00:21.004084+0000","last_undegraded":"2024-03-04T13:00:21.004084+0000","last_fullsized":"2024-03-04T13:00:21.004084+0000","mapping_epoch":22,"log_start":"256'1400","ondisk_log_start":"256'1400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5752,"num_read_kb":4912,"num_write":2067,"num_write_kb":923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"256'381","reported_seq":1038,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.114261+0000","last_change":"2024-03-04T12:36:05.284059+0000","last_active":"2024-03-04T13:00:17.114261+0000","last_peered":"2024-03-04T13:00:17.114261+0000","last_clean":"2024-03-04T13:00:17.114261+0000","last_became_active":"2024-03-04T12:36:05.283142+0000","last_became_peered":"2024-03-04T12:36:05.283142+0000","last_unstale":"2024-03-04T13:00:17.114261+0000","last_undegraded":"2024-03-04T13:00:17.114261+0000","last_fullsized":"2024-03-04T13:00:17.114261+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":1440,"num_write":1747,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.023904+0000","last_change":"2024-03-04T12:36:09.305585+0000","last_active":"2024-03-04T13:00:21.023904+0000","last_peered":"2024-03-04T13:00:21.023904+0000","last_clean":"2024-03-04T13:00:21.023904+0000","last_became_active":"2024-03-04T12:36:09.305182+0000","last_became_peered":"2024-03-04T12:36:09.305182+0000","last_unstale":"2024-03-04T13:00:21.023904+0000","last_undegraded":"2024-03-04T13:00:21.023904+0000","last_fullsized":"2024-03-04T13:00:21.023904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"256'238","reported_seq":773,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.490543+0000","last_change":"2024-03-04T12:36:11.324706+0000","last_active":"2024-03-04T13:00:16.490543+0000","last_peered":"2024-03-04T13:00:16.490543+0000","last_clean":"2024-03-04T13:00:16.490543+0000","last_became_active":"2024-03-04T12:36:11.324394+0000","last_became_peered":"2024-03-04T12:36:11.324394+0000","last_unstale":"2024-03-04T13:00:16.490543+0000","last_undegraded":"2024-03-04T13:00:16.490543+0000","last_fullsized":"2024-03-04T13:00:16.490543+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":411,"num_read_kb":1022,"num_write":344,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.121199+0000","last_change":"2024-03-04T13:00:34.121222+0000","last_active":"2024-03-04T13:00:34.121199+0000","last_peered":"2024-03-04T13:00:34.121199+0000","last_clean":"2024-03-04T13:00:34.121199+0000","last_became_active":"2024-03-04T12:36:13.340897+0000","last_became_peered":"2024-03-04T12:36:13.340897+0000","last_unstale":"2024-03-04T13:00:34.121199+0000","last_undegraded":"2024-03-04T13:00:34.121199+0000","last_fullsized":"2024-03-04T13:00:34.121199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:34.121113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:34.121113+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.121113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:37.532912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"256'172","reported_seq":1180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.324441+0000","last_change":"2024-03-04T13:00:34.324472+0000","last_active":"2024-03-04T13:00:34.324441+0000","last_peered":"2024-03-04T13:00:34.324441+0000","last_clean":"2024-03-04T13:00:34.324441+0000","last_became_active":"2024-03-04T12:36:15.357141+0000","last_became_peered":"2024-03-04T12:36:15.357141+0000","last_unstale":"2024-03-04T13:00:34.324441+0000","last_undegraded":"2024-03-04T13:00:34.324441+0000","last_fullsized":"2024-03-04T13:00:34.324441+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'172","last_scrub_stamp":"2024-03-04T13:00:34.324343+0000","last_deep_scrub":"256'172","last_deep_scrub_stamp":"2024-03-04T13:00:34.324343+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.324343+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:14:37.999688+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":655,"num_read_kb":655,"num_write":360,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"256'1105","reported_seq":2589,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.023929+0000","last_change":"2024-03-04T12:36:07.291118+0000","last_active":"2024-03-04T13:00:21.023929+0000","last_peered":"2024-03-04T13:00:21.023929+0000","last_clean":"2024-03-04T13:00:21.023929+0000","last_became_active":"2024-03-04T12:36:07.290820+0000","last_became_peered":"2024-03-04T12:36:07.290820+0000","last_unstale":"2024-03-04T13:00:21.023929+0000","last_undegraded":"2024-03-04T13:00:21.023929+0000","last_fullsized":"2024-03-04T13:00:21.023929+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4641,"num_read_kb":4049,"num_write":1526,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"256'314","reported_seq":982,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.091665+0000","last_change":"2024-03-04T12:36:05.290216+0000","last_active":"2024-03-04T13:00:17.091665+0000","last_peered":"2024-03-04T13:00:17.091665+0000","last_clean":"2024-03-04T13:00:17.091665+0000","last_became_active":"2024-03-04T12:36:05.289897+0000","last_became_peered":"2024-03-04T12:36:05.289897+0000","last_unstale":"2024-03-04T13:00:17.091665+0000","last_undegraded":"2024-03-04T13:00:17.091665+0000","last_fullsized":"2024-03-04T13:00:17.091665+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525438,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":585,"num_read_kb":14927,"num_write":1035,"num_write_kb":32177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"256'2","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.381434+0000","last_change":"2024-03-04T13:00:40.381460+0000","last_active":"2024-03-04T13:00:40.381434+0000","last_peered":"2024-03-04T13:00:40.381434+0000","last_clean":"2024-03-04T13:00:40.381434+0000","last_became_active":"2024-03-04T12:36:09.310855+0000","last_became_peered":"2024-03-04T12:36:09.310855+0000","last_unstale":"2024-03-04T13:00:40.381434+0000","last_undegraded":"2024-03-04T13:00:40.381434+0000","last_fullsized":"2024-03-04T13:00:40.381434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:40.381349+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:40.381349+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.381349+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:49.986949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"256'269","reported_seq":838,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.150055+0000","last_change":"2024-03-04T13:00:39.150096+0000","last_active":"2024-03-04T13:00:39.150055+0000","last_peered":"2024-03-04T13:00:39.150055+0000","last_clean":"2024-03-04T13:00:39.150055+0000","last_became_active":"2024-03-04T12:36:11.323352+0000","last_became_peered":"2024-03-04T12:36:11.323352+0000","last_unstale":"2024-03-04T13:00:39.150055+0000","last_undegraded":"2024-03-04T13:00:39.150055+0000","last_fullsized":"2024-03-04T13:00:39.150055+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'269","last_scrub_stamp":"2024-03-04T13:00:39.149959+0000","last_deep_scrub":"256'269","last_deep_scrub_stamp":"2024-03-04T13:00:39.149959+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.149959+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:08:10.926685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":1008,"num_write":350,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":463,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:46.008962+0000","last_change":"2024-03-04T12:36:13.343303+0000","last_active":"2024-03-04T12:58:46.008962+0000","last_peered":"2024-03-04T12:58:46.008962+0000","last_clean":"2024-03-04T12:58:46.008962+0000","last_became_active":"2024-03-04T12:36:13.342656+0000","last_became_peered":"2024-03-04T12:36:13.342656+0000","last_unstale":"2024-03-04T12:58:46.008962+0000","last_undegraded":"2024-03-04T12:58:46.008962+0000","last_fullsized":"2024-03-04T12:58:46.008962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:12.308254+0000","last_clean_scrub_stamp":"2024-03-04T12:36:12.308254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"256'104","reported_seq":586,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.145696+0000","last_change":"2024-03-04T13:00:30.145729+0000","last_active":"2024-03-04T13:00:30.145696+0000","last_peered":"2024-03-04T13:00:30.145696+0000","last_clean":"2024-03-04T13:00:30.145696+0000","last_became_active":"2024-03-04T12:36:15.352333+0000","last_became_peered":"2024-03-04T12:36:15.352333+0000","last_unstale":"2024-03-04T13:00:30.145696+0000","last_undegraded":"2024-03-04T13:00:30.145696+0000","last_fullsized":"2024-03-04T13:00:30.145696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'104","last_scrub_stamp":"2024-03-04T13:00:30.145579+0000","last_deep_scrub":"256'104","last_deep_scrub_stamp":"2024-03-04T13:00:30.145579+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.145579+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:30.216312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":93,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"256'392","reported_seq":1888,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.000971+0000","last_change":"2024-03-04T12:36:07.298617+0000","last_active":"2024-03-04T13:00:01.000971+0000","last_peered":"2024-03-04T13:00:01.000971+0000","last_clean":"2024-03-04T13:00:01.000971+0000","last_became_active":"2024-03-04T12:36:07.297660+0000","last_became_peered":"2024-03-04T12:36:07.297660+0000","last_unstale":"2024-03-04T13:00:01.000971+0000","last_undegraded":"2024-03-04T13:00:01.000971+0000","last_fullsized":"2024-03-04T13:00:01.000971+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":478,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"256'271","reported_seq":857,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.127245+0000","last_change":"2024-03-04T12:36:05.279913+0000","last_active":"2024-03-04T13:00:17.127245+0000","last_peered":"2024-03-04T13:00:17.127245+0000","last_clean":"2024-03-04T13:00:17.127245+0000","last_became_active":"2024-03-04T12:36:05.279576+0000","last_became_peered":"2024-03-04T12:36:05.279576+0000","last_unstale":"2024-03-04T13:00:17.127245+0000","last_undegraded":"2024-03-04T13:00:17.127245+0000","last_fullsized":"2024-03-04T13:00:17.127245+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5591378,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":375,"num_read_kb":32300,"num_write":1079,"num_write_kb":15765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"256'425","reported_seq":1851,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.000946+0000","last_change":"2024-03-04T12:36:07.300437+0000","last_active":"2024-03-04T13:00:01.000946+0000","last_peered":"2024-03-04T13:00:01.000946+0000","last_clean":"2024-03-04T13:00:01.000946+0000","last_became_active":"2024-03-04T12:36:07.300168+0000","last_became_peered":"2024-03-04T12:36:07.300168+0000","last_unstale":"2024-03-04T13:00:01.000946+0000","last_undegraded":"2024-03-04T13:00:01.000946+0000","last_fullsized":"2024-03-04T13:00:01.000946+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2082,"num_write":535,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"256'307","reported_seq":924,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.124831+0000","last_change":"2024-03-04T12:36:05.287650+0000","last_active":"2024-03-04T13:00:17.124831+0000","last_peered":"2024-03-04T13:00:17.124831+0000","last_clean":"2024-03-04T13:00:17.124831+0000","last_became_active":"2024-03-04T12:36:05.287233+0000","last_became_peered":"2024-03-04T12:36:05.287233+0000","last_unstale":"2024-03-04T13:00:17.124831+0000","last_undegraded":"2024-03-04T13:00:17.124831+0000","last_fullsized":"2024-03-04T13:00:17.124831+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1355534,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":467,"num_read_kb":46552,"num_write":1196,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"256'338","reported_seq":1831,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.021308+0000","last_change":"2024-03-04T12:36:07.296382+0000","last_active":"2024-03-04T13:00:01.021308+0000","last_peered":"2024-03-04T13:00:01.021308+0000","last_clean":"2024-03-04T13:00:01.021308+0000","last_became_active":"2024-03-04T12:36:07.296104+0000","last_became_peered":"2024-03-04T12:36:07.296104+0000","last_unstale":"2024-03-04T13:00:01.021308+0000","last_undegraded":"2024-03-04T13:00:01.021308+0000","last_fullsized":"2024-03-04T13:00:01.021308+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1942,"num_read_kb":1888,"num_write":368,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"256'349","reported_seq":978,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.296780+0000","last_change":"2024-03-04T13:00:29.296873+0000","last_active":"2024-03-04T13:00:29.296780+0000","last_peered":"2024-03-04T13:00:29.296780+0000","last_clean":"2024-03-04T13:00:29.296780+0000","last_became_active":"2024-03-04T12:36:41.075381+0000","last_became_peered":"2024-03-04T12:36:41.075381+0000","last_unstale":"2024-03-04T13:00:29.296780+0000","last_undegraded":"2024-03-04T13:00:29.296780+0000","last_fullsized":"2024-03-04T13:00:29.296780+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'349","last_scrub_stamp":"2024-03-04T13:00:29.296681+0000","last_deep_scrub":"256'349","last_deep_scrub_stamp":"2024-03-04T13:00:29.296681+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.296681+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:14.010604+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8448064,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":52899,"num_write":1289,"num_write_kb":57282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"256'1024","reported_seq":2574,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.000910+0000","last_change":"2024-03-04T12:36:07.299735+0000","last_active":"2024-03-04T13:00:01.000910+0000","last_peered":"2024-03-04T13:00:01.000910+0000","last_clean":"2024-03-04T13:00:01.000910+0000","last_became_active":"2024-03-04T12:36:07.299282+0000","last_became_peered":"2024-03-04T12:36:07.299282+0000","last_unstale":"2024-03-04T13:00:01.000910+0000","last_undegraded":"2024-03-04T13:00:01.000910+0000","last_fullsized":"2024-03-04T13:00:01.000910+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4484,"num_read_kb":3892,"num_write":1521,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"256'291","reported_seq":944,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.105709+0000","last_change":"2024-03-04T12:36:05.283738+0000","last_active":"2024-03-04T13:00:17.105709+0000","last_peered":"2024-03-04T13:00:17.105709+0000","last_clean":"2024-03-04T13:00:17.105709+0000","last_became_active":"2024-03-04T12:36:05.283327+0000","last_became_peered":"2024-03-04T12:36:05.283327+0000","last_unstale":"2024-03-04T13:00:17.105709+0000","last_undegraded":"2024-03-04T13:00:17.105709+0000","last_fullsized":"2024-03-04T13:00:17.105709+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6002849,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":66598,"num_write":994,"num_write_kb":37083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"256'426","reported_seq":1881,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.686139+0000","last_change":"2024-03-04T12:36:07.293252+0000","last_active":"2024-03-04T13:00:06.686139+0000","last_peered":"2024-03-04T13:00:06.686139+0000","last_clean":"2024-03-04T13:00:06.686139+0000","last_became_active":"2024-03-04T12:36:07.292950+0000","last_became_peered":"2024-03-04T12:36:07.292950+0000","last_unstale":"2024-03-04T13:00:06.686139+0000","last_undegraded":"2024-03-04T13:00:06.686139+0000","last_fullsized":"2024-03-04T13:00:06.686139+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2086,"num_write":515,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"256'283","reported_seq":898,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.121186+0000","last_change":"2024-03-04T12:36:05.287013+0000","last_active":"2024-03-04T13:00:17.121186+0000","last_peered":"2024-03-04T13:00:17.121186+0000","last_clean":"2024-03-04T13:00:17.121186+0000","last_became_active":"2024-03-04T12:36:05.286745+0000","last_became_peered":"2024-03-04T12:36:05.286745+0000","last_unstale":"2024-03-04T13:00:17.121186+0000","last_undegraded":"2024-03-04T13:00:17.121186+0000","last_fullsized":"2024-03-04T13:00:17.121186+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":38207,"num_write":1041,"num_write_kb":19360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"256'355","reported_seq":1890,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.844852+0000","last_change":"2024-03-04T12:36:07.291981+0000","last_active":"2024-03-04T12:59:48.844852+0000","last_peered":"2024-03-04T12:59:48.844852+0000","last_clean":"2024-03-04T12:59:48.844852+0000","last_became_active":"2024-03-04T12:36:07.291690+0000","last_became_peered":"2024-03-04T12:36:07.291690+0000","last_unstale":"2024-03-04T12:59:48.844852+0000","last_undegraded":"2024-03-04T12:59:48.844852+0000","last_fullsized":"2024-03-04T12:59:48.844852+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2163,"num_read_kb":2091,"num_write":400,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"256'296","reported_seq":914,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.121593+0000","last_change":"2024-03-04T12:36:05.287869+0000","last_active":"2024-03-04T13:00:17.121593+0000","last_peered":"2024-03-04T13:00:17.121593+0000","last_clean":"2024-03-04T13:00:17.121593+0000","last_became_active":"2024-03-04T12:36:05.287529+0000","last_became_peered":"2024-03-04T12:36:05.287529+0000","last_unstale":"2024-03-04T13:00:17.121593+0000","last_undegraded":"2024-03-04T13:00:17.121593+0000","last_fullsized":"2024-03-04T13:00:17.121593+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":37296,"num_write":1090,"num_write_kb":36513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"256'739","reported_seq":2223,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.027841+0000","last_change":"2024-03-04T12:36:07.300374+0000","last_active":"2024-03-04T12:59:56.027841+0000","last_peered":"2024-03-04T12:59:56.027841+0000","last_clean":"2024-03-04T12:59:56.027841+0000","last_became_active":"2024-03-04T12:36:07.299881+0000","last_became_peered":"2024-03-04T12:36:07.299881+0000","last_unstale":"2024-03-04T12:59:56.027841+0000","last_undegraded":"2024-03-04T12:59:56.027841+0000","last_fullsized":"2024-03-04T12:59:56.027841+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3309,"num_read_kb":2983,"num_write":974,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"256'324","reported_seq":949,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.103412+0000","last_change":"2024-03-04T12:36:05.286690+0000","last_active":"2024-03-04T13:00:17.103412+0000","last_peered":"2024-03-04T13:00:17.103412+0000","last_clean":"2024-03-04T13:00:17.103412+0000","last_became_active":"2024-03-04T12:36:05.286397+0000","last_became_peered":"2024-03-04T12:36:05.286397+0000","last_unstale":"2024-03-04T13:00:17.103412+0000","last_undegraded":"2024-03-04T13:00:17.103412+0000","last_fullsized":"2024-03-04T13:00:17.103412+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472549,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":459,"num_read_kb":103287,"num_write":1220,"num_write_kb":47023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"256'475","reported_seq":2072,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:47.620034+0000","last_change":"2024-03-04T12:36:07.292858+0000","last_active":"2024-03-04T12:59:47.620034+0000","last_peered":"2024-03-04T12:59:47.620034+0000","last_clean":"2024-03-04T12:59:47.620034+0000","last_became_active":"2024-03-04T12:36:07.292501+0000","last_became_peered":"2024-03-04T12:36:07.292501+0000","last_unstale":"2024-03-04T12:59:47.620034+0000","last_undegraded":"2024-03-04T12:59:47.620034+0000","last_fullsized":"2024-03-04T12:59:47.620034+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2330,"num_write":558,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"256'323","reported_seq":921,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.055639+0000","last_change":"2024-03-04T12:36:05.294285+0000","last_active":"2024-03-04T13:00:17.055639+0000","last_peered":"2024-03-04T13:00:17.055639+0000","last_clean":"2024-03-04T13:00:17.055639+0000","last_became_active":"2024-03-04T12:36:05.294007+0000","last_became_peered":"2024-03-04T12:36:05.294007+0000","last_unstale":"2024-03-04T13:00:17.055639+0000","last_undegraded":"2024-03-04T13:00:17.055639+0000","last_fullsized":"2024-03-04T13:00:17.055639+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":23598,"num_write":1193,"num_write_kb":28139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"256'446","reported_seq":1958,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.480046+0000","last_change":"2024-03-04T12:36:07.294584+0000","last_active":"2024-03-04T12:59:55.480046+0000","last_peered":"2024-03-04T12:59:55.480046+0000","last_clean":"2024-03-04T12:59:55.480046+0000","last_became_active":"2024-03-04T12:36:07.294283+0000","last_became_peered":"2024-03-04T12:36:07.294283+0000","last_unstale":"2024-03-04T12:59:55.480046+0000","last_undegraded":"2024-03-04T12:59:55.480046+0000","last_fullsized":"2024-03-04T12:59:55.480046+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2476,"num_read_kb":2316,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"256'339","reported_seq":953,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.124132+0000","last_change":"2024-03-04T12:36:05.290249+0000","last_active":"2024-03-04T13:00:17.124132+0000","last_peered":"2024-03-04T13:00:17.124132+0000","last_clean":"2024-03-04T13:00:17.124132+0000","last_became_active":"2024-03-04T12:36:05.289882+0000","last_became_peered":"2024-03-04T12:36:05.289882+0000","last_unstale":"2024-03-04T13:00:17.124132+0000","last_undegraded":"2024-03-04T13:00:17.124132+0000","last_fullsized":"2024-03-04T13:00:17.124132+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":35092,"num_write":1098,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"256'454","reported_seq":1938,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:06.694248+0000","last_change":"2024-03-04T12:36:07.294765+0000","last_active":"2024-03-04T13:00:06.694248+0000","last_peered":"2024-03-04T13:00:06.694248+0000","last_clean":"2024-03-04T13:00:06.694248+0000","last_became_active":"2024-03-04T12:36:07.292904+0000","last_became_peered":"2024-03-04T12:36:07.292904+0000","last_unstale":"2024-03-04T13:00:06.694248+0000","last_undegraded":"2024-03-04T13:00:06.694248+0000","last_fullsized":"2024-03-04T13:00:06.694248+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2160,"num_write":550,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"256'305","reported_seq":892,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.098298+0000","last_change":"2024-03-04T12:36:05.294662+0000","last_active":"2024-03-04T13:00:17.098298+0000","last_peered":"2024-03-04T13:00:17.098298+0000","last_clean":"2024-03-04T13:00:17.098298+0000","last_became_active":"2024-03-04T12:36:05.294338+0000","last_became_peered":"2024-03-04T12:36:05.294338+0000","last_unstale":"2024-03-04T13:00:17.098298+0000","last_undegraded":"2024-03-04T13:00:17.098298+0000","last_fullsized":"2024-03-04T13:00:17.098298+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263242,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":434,"num_read_kb":2630,"num_write":1136,"num_write_kb":25999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"256'1251","reported_seq":2838,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.478911+0000","last_change":"2024-03-04T12:36:07.292610+0000","last_active":"2024-03-04T12:59:55.478911+0000","last_peered":"2024-03-04T12:59:55.478911+0000","last_clean":"2024-03-04T12:59:55.478911+0000","last_became_active":"2024-03-04T12:36:07.292294+0000","last_became_peered":"2024-03-04T12:36:07.292294+0000","last_unstale":"2024-03-04T12:59:55.478911+0000","last_undegraded":"2024-03-04T12:59:55.478911+0000","last_fullsized":"2024-03-04T12:59:55.478911+0000","mapping_epoch":22,"log_start":"256'1200","ondisk_log_start":"256'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5403,"num_read_kb":4680,"num_write":1785,"num_write_kb":760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"256'323","reported_seq":925,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.108074+0000","last_change":"2024-03-04T12:36:05.290703+0000","last_active":"2024-03-04T13:00:17.108074+0000","last_peered":"2024-03-04T13:00:17.108074+0000","last_clean":"2024-03-04T13:00:17.108074+0000","last_became_active":"2024-03-04T12:36:05.290410+0000","last_became_peered":"2024-03-04T12:36:05.290410+0000","last_unstale":"2024-03-04T13:00:17.108074+0000","last_undegraded":"2024-03-04T13:00:17.108074+0000","last_fullsized":"2024-03-04T13:00:17.108074+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2168155,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":19682,"num_write":1207,"num_write_kb":25111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"256'274","reported_seq":1516,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:52.129919+0000","last_change":"2024-03-04T12:36:07.293973+0000","last_active":"2024-03-04T12:59:52.129919+0000","last_peered":"2024-03-04T12:59:52.129919+0000","last_clean":"2024-03-04T12:59:52.129919+0000","last_became_active":"2024-03-04T12:36:07.291583+0000","last_became_peered":"2024-03-04T12:36:07.291583+0000","last_unstale":"2024-03-04T12:59:52.129919+0000","last_undegraded":"2024-03-04T12:59:52.129919+0000","last_fullsized":"2024-03-04T12:59:52.129919+0000","mapping_epoch":22,"log_start":"256'200","ondisk_log_start":"256'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1552,"num_read_kb":1496,"num_write":324,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"256'389","reported_seq":1006,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.121267+0000","last_change":"2024-03-04T12:36:05.290812+0000","last_active":"2024-03-04T13:00:17.121267+0000","last_peered":"2024-03-04T13:00:17.121267+0000","last_clean":"2024-03-04T13:00:17.121267+0000","last_became_active":"2024-03-04T12:36:05.290522+0000","last_became_peered":"2024-03-04T12:36:05.290522+0000","last_unstale":"2024-03-04T13:00:17.121267+0000","last_undegraded":"2024-03-04T13:00:17.121267+0000","last_fullsized":"2024-03-04T13:00:17.121267+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11113900,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":595,"num_read_kb":8197,"num_write":1190,"num_write_kb":30951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"256'1119","reported_seq":2697,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.026869+0000","last_change":"2024-03-04T12:36:07.294845+0000","last_active":"2024-03-04T12:59:56.026869+0000","last_peered":"2024-03-04T12:59:56.026869+0000","last_clean":"2024-03-04T12:59:56.026869+0000","last_became_active":"2024-03-04T12:36:07.294536+0000","last_became_peered":"2024-03-04T12:36:07.294536+0000","last_unstale":"2024-03-04T12:59:56.026869+0000","last_undegraded":"2024-03-04T12:59:56.026869+0000","last_fullsized":"2024-03-04T12:59:56.026869+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4737,"num_read_kb":4156,"num_write":1530,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"256'316","reported_seq":930,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.083748+0000","last_change":"2024-03-04T12:36:05.286225+0000","last_active":"2024-03-04T13:00:17.083748+0000","last_peered":"2024-03-04T13:00:17.083748+0000","last_clean":"2024-03-04T13:00:17.083748+0000","last_became_active":"2024-03-04T12:36:05.285924+0000","last_became_peered":"2024-03-04T12:36:05.285924+0000","last_unstale":"2024-03-04T13:00:17.083748+0000","last_undegraded":"2024-03-04T13:00:17.083748+0000","last_fullsized":"2024-03-04T13:00:17.083748+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671806,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":413,"num_read_kb":22814,"num_write":1062,"num_write_kb":24147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"256'331","reported_seq":1638,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.913739+0000","last_change":"2024-03-04T12:36:07.302695+0000","last_active":"2024-03-04T12:59:54.913739+0000","last_peered":"2024-03-04T12:59:54.913739+0000","last_clean":"2024-03-04T12:59:54.913739+0000","last_became_active":"2024-03-04T12:36:07.302371+0000","last_became_peered":"2024-03-04T12:36:07.302371+0000","last_unstale":"2024-03-04T12:59:54.913739+0000","last_undegraded":"2024-03-04T12:59:54.913739+0000","last_fullsized":"2024-03-04T12:59:54.913739+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1728,"num_read_kb":1642,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"256'317","reported_seq":912,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.124391+0000","last_change":"2024-03-04T12:36:05.290406+0000","last_active":"2024-03-04T13:00:17.124391+0000","last_peered":"2024-03-04T13:00:17.124391+0000","last_clean":"2024-03-04T13:00:17.124391+0000","last_became_active":"2024-03-04T12:36:05.290032+0000","last_became_peered":"2024-03-04T12:36:05.290032+0000","last_unstale":"2024-03-04T13:00:17.124391+0000","last_undegraded":"2024-03-04T13:00:17.124391+0000","last_fullsized":"2024-03-04T13:00:17.124391+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489519,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":31102,"num_write":1081,"num_write_kb":33345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"256'416","reported_seq":1943,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.913786+0000","last_change":"2024-03-04T12:36:07.300654+0000","last_active":"2024-03-04T12:59:54.913786+0000","last_peered":"2024-03-04T12:59:54.913786+0000","last_clean":"2024-03-04T12:59:54.913786+0000","last_became_active":"2024-03-04T12:36:07.299718+0000","last_became_peered":"2024-03-04T12:36:07.299718+0000","last_unstale":"2024-03-04T12:59:54.913786+0000","last_undegraded":"2024-03-04T12:59:54.913786+0000","last_fullsized":"2024-03-04T12:59:54.913786+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2289,"num_read_kb":2179,"num_write":520,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"256'395","reported_seq":1062,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.207499+0000","last_change":"2024-03-04T13:00:40.207554+0000","last_active":"2024-03-04T13:00:40.207499+0000","last_peered":"2024-03-04T13:00:40.207499+0000","last_clean":"2024-03-04T13:00:40.207499+0000","last_became_active":"2024-03-04T12:36:05.279538+0000","last_became_peered":"2024-03-04T12:36:05.279538+0000","last_unstale":"2024-03-04T13:00:40.207499+0000","last_undegraded":"2024-03-04T13:00:40.207499+0000","last_fullsized":"2024-03-04T13:00:40.207499+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'395","last_scrub_stamp":"2024-03-04T13:00:40.207418+0000","last_deep_scrub":"256'395","last_deep_scrub_stamp":"2024-03-04T13:00:40.207418+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.207418+0000","objects_scrubbed":12,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:25.317833+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4781240,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":615,"num_read_kb":6803,"num_write":1512,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"256'748","reported_seq":2147,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:05.903942+0000","last_change":"2024-03-04T12:36:07.294946+0000","last_active":"2024-03-04T13:00:05.903942+0000","last_peered":"2024-03-04T13:00:05.903942+0000","last_clean":"2024-03-04T13:00:05.903942+0000","last_became_active":"2024-03-04T12:36:07.294274+0000","last_became_peered":"2024-03-04T12:36:07.294274+0000","last_unstale":"2024-03-04T13:00:05.903942+0000","last_undegraded":"2024-03-04T13:00:05.903942+0000","last_fullsized":"2024-03-04T13:00:05.903942+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3445,"num_read_kb":3067,"num_write":1017,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"256'369","reported_seq":960,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.246173+0000","last_change":"2024-03-04T13:00:25.246235+0000","last_active":"2024-03-04T13:00:25.246173+0000","last_peered":"2024-03-04T13:00:25.246173+0000","last_clean":"2024-03-04T13:00:25.246173+0000","last_became_active":"2024-03-04T12:36:40.391325+0000","last_became_peered":"2024-03-04T12:36:40.391325+0000","last_unstale":"2024-03-04T13:00:25.246173+0000","last_undegraded":"2024-03-04T13:00:25.246173+0000","last_fullsized":"2024-03-04T13:00:25.246173+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'369","last_scrub_stamp":"2024-03-04T13:00:25.246095+0000","last_deep_scrub":"256'369","last_deep_scrub_stamp":"2024-03-04T13:00:25.246095+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.246095+0000","objects_scrubbed":6,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:52.565129+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2969477,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":505,"num_read_kb":41621,"num_write":1246,"num_write_kb":38740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"256'363","reported_seq":1074,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.115608+0000","last_change":"2024-03-04T12:36:05.288067+0000","last_active":"2024-03-04T13:00:17.115608+0000","last_peered":"2024-03-04T13:00:17.115608+0000","last_clean":"2024-03-04T13:00:17.115608+0000","last_became_active":"2024-03-04T12:36:05.287744+0000","last_became_peered":"2024-03-04T12:36:05.287744+0000","last_unstale":"2024-03-04T13:00:17.115608+0000","last_undegraded":"2024-03-04T13:00:17.115608+0000","last_fullsized":"2024-03-04T13:00:17.115608+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984340,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":791,"num_read_kb":29804,"num_write":1288,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"256'537","reported_seq":2093,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.020504+0000","last_change":"2024-03-04T12:36:07.302554+0000","last_active":"2024-03-04T13:00:21.020504+0000","last_peered":"2024-03-04T13:00:21.020504+0000","last_clean":"2024-03-04T13:00:21.020504+0000","last_became_active":"2024-03-04T12:36:07.302290+0000","last_became_peered":"2024-03-04T12:36:07.302290+0000","last_unstale":"2024-03-04T13:00:21.020504+0000","last_undegraded":"2024-03-04T13:00:21.020504+0000","last_fullsized":"2024-03-04T13:00:21.020504+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2955,"num_read_kb":2687,"num_write":726,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"256'449","reported_seq":1224,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.103894+0000","last_change":"2024-03-04T12:36:05.284158+0000","last_active":"2024-03-04T13:00:17.103894+0000","last_peered":"2024-03-04T13:00:17.103894+0000","last_clean":"2024-03-04T13:00:17.103894+0000","last_became_active":"2024-03-04T12:36:05.283797+0000","last_became_peered":"2024-03-04T12:36:05.283797+0000","last_unstale":"2024-03-04T13:00:17.103894+0000","last_undegraded":"2024-03-04T13:00:17.103894+0000","last_fullsized":"2024-03-04T13:00:17.103894+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5417905,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1114,"num_read_kb":38636,"num_write":1666,"num_write_kb":30809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"256'783","reported_seq":2210,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.024825+0000","last_change":"2024-03-04T12:36:07.301827+0000","last_active":"2024-03-04T13:00:21.024825+0000","last_peered":"2024-03-04T13:00:21.024825+0000","last_clean":"2024-03-04T13:00:21.024825+0000","last_became_active":"2024-03-04T12:36:07.301542+0000","last_became_peered":"2024-03-04T12:36:07.301542+0000","last_unstale":"2024-03-04T13:00:21.024825+0000","last_undegraded":"2024-03-04T13:00:21.024825+0000","last_fullsized":"2024-03-04T13:00:21.024825+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3434,"num_read_kb":3044,"num_write":1054,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":164,"num_read_kb":179702,"num_write":175,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5885,"num_read_kb":4252,"num_write":2245,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8924,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1079,"ondisk_log_size":1079,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":9441,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":12014,"num_read_kb":11868,"num_write":14038,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1548,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":18882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2395,"ondisk_log_size":2395,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":486,"ondisk_log_size":486,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1548695,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":15552,"num_read_kb":34013,"num_write":13157,"num_write_kb":10848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2017,"ondisk_log_size":2017,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1552,"num_read_kb":1546,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":187094,"num_read_kb":170304,"num_write":50851,"num_write_kb":17572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":238,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3865,"ondisk_log_size":3865,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":175727187,"num_objects":435,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":0,"num_read":34803,"num_read_kb":2210949,"num_write":78480,"num_write_kb":2282182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":353116160,"data_stored":351454374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3617,"ondisk_log_size":3617,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":165,"num_read_kb":175660,"num_write":175,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575151,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333184,"kb_used_data":71544,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94038656,"statfs":{"total":96636764160,"available":96295583744,"internally_reserved":0,"allocated":73261056,"data_stored":71540111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575152,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290296,"kb_used_data":38384,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94081544,"statfs":{"total":96636764160,"available":96339501056,"internally_reserved":0,"allocated":39305216,"data_stored":37695435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575152,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151020,"kb_used_data":51876,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94220820,"statfs":{"total":96636764160,"available":96482119680,"internally_reserved":0,"allocated":53121024,"data_stored":51449109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575150,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144096,"kb_used_data":72664,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94227744,"statfs":{"total":96636764160,"available":96489209856,"internally_reserved":0,"allocated":74407936,"data_stored":72693947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575150,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310816,"kb_used_data":49240,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94061024,"statfs":{"total":96636764160,"available":96318488576,"internally_reserved":0,"allocated":50421760,"data_stored":48746373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575151,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140424,"kb_used_data":51008,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94231416,"statfs":{"total":96636764160,"available":96492969984,"internally_reserved":0,"allocated":52232192,"data_stored":50704146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575154,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148484,"kb_used_data":41020,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94223356,"statfs":{"total":96636764160,"available":96484716544,"internally_reserved":0,"allocated":42004480,"data_stored":40455223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575151,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319416,"kb_used_data":63408,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":94052424,"statfs":{"total":96636764160,"available":96309682176,"internally_reserved":0,"allocated":64929792,"data_stored":63233494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45060096,"data_stored":44816819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30089216,"data_stored":29970475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42442752,"data_stored":42316441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38498304,"data_stored":38260992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62513152,"data_stored":62209723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39063552,"data_stored":38866277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31576064,"data_stored":31403645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":63873024,"data_stored":63610002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:00:45.303 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.303 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.304 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.304 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.304 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.304 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.304 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.305 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.305 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.305 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.305 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.305 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.306 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.306 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.306 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.306 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.306 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.307 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.307 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.307 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.307 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.307 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.307 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.308 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.308 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.308 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.308 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.308 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.309 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.309 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.309 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.309 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.309 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.309 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.310 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.310 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.310 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.310 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.310 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.310 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.311 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.311 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.311 INFO:tasks.ceph:pgid 64.a last_scrub_stamp 2024-03-04T12:43:26.030121+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=43, tm_sec=26, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.311 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.312 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.312 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.312 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.312 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.312 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.313 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.313 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.313 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.313 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.313 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.314 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.314 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.314 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.314 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.314 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.314 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.315 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.315 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.315 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.315 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.315 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.316 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.316 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.316 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.316 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.316 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.316 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.317 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.317 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.317 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.317 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.317 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.317 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.317 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.318 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.318 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.318 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.318 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.318 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.318 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.319 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.319 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.319 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.319 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.319 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.319 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.320 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.320 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.320 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.320 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.320 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.320 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.321 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.321 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.321 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.321 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.321 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.321 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.322 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.322 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.322 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.322 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.322 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.323 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.323 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.323 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.323 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.323 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.323 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.324 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.324 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.324 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.324 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.324 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.324 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.325 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.325 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.325 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.325 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.325 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.325 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.326 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.326 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.326 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.326 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.326 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.327 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.327 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.327 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.327 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-04T12:35:46.856449+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=46, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.327 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.327 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.328 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.328 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.328 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.328 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.328 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.328 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.329 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.329 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.329 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.329 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.329 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.330 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.330 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.330 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.330 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.330 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.330 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.331 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.331 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.331 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.331 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.331 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.331 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.332 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.332 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.332 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.332 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.332 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.332 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.333 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.333 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.333 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.333 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.333 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.333 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.334 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.334 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.334 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.334 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.334 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.334 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.334 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.335 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.335 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.335 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.335 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.335 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.335 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.336 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.336 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.336 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.336 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.336 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.337 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.337 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.337 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.337 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-04T12:36:14.323569+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=14, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.337 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.337 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.337 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.338 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.338 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.338 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.338 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.338 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.338 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.339 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.339 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.339 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.339 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.339 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.339 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.340 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.340 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.340 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.340 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.340 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.341 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.341 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-03-04T12:36:12.308254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=12, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.341 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.341 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.341 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.341 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.342 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.342 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.342 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.342 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.342 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.342 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.343 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.343 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.343 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.343 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.343 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.343 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.344 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.344 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.344 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.344 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.344 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.344 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.345 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.345 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.345 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.345 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.345 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.345 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.345 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.346 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.346 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.346 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.346 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:00:45.346 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-04T13:01:05.347 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:01:05.689 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:01:05.700 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-03-04T13:01:05.703 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":1009,"stamp":"2024-03-04T13:01:05.375455+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":211431760,"num_objects":820,"num_object_clones":0,"num_object_copies":1640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":820,"num_whiteouts":0,"num_read":257353,"num_read_kb":2788402,"num_write":159314,"num_write_kb":2552482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":667147,"num_omap_keys":1644,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13964,"ondisk_log_size":13964,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1846056,"kb_used_data":439144,"kb_used_omap":12,"kb_used_meta":1406835,"kb_avail":753128664,"statfs":{"total":773094113280,"available":771203751936,"internally_reserved":0,"allocated":449683456,"data_stored":436517838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1440599600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":493425,"num_omap_keys":1155,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004842"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.094354+0000","last_change":"2024-03-04T12:51:01.353518+0000","last_active":"2024-03-04T13:00:23.094354+0000","last_peered":"2024-03-04T13:00:23.094354+0000","last_clean":"2024-03-04T13:00:23.094354+0000","last_became_active":"2024-03-04T12:51:01.353225+0000","last_became_peered":"2024-03-04T12:51:01.353225+0000","last_unstale":"2024-03-04T13:00:23.094354+0000","last_undegraded":"2024-03-04T13:00:23.094354+0000","last_fullsized":"2024-03-04T13:00:23.094354+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"256'2","reported_seq":34,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.496410+0000","last_change":"2024-03-04T12:44:53.484600+0000","last_active":"2024-03-04T13:00:16.496410+0000","last_peered":"2024-03-04T13:00:16.496410+0000","last_clean":"2024-03-04T13:00:16.496410+0000","last_became_active":"2024-03-04T12:44:53.484341+0000","last_became_peered":"2024-03-04T12:44:53.484341+0000","last_unstale":"2024-03-04T13:00:16.496410+0000","last_undegraded":"2024-03-04T13:00:16.496410+0000","last_fullsized":"2024-03-04T13:00:16.496410+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.182971+0000","last_change":"2024-03-04T13:00:48.182971+0000","last_active":"2024-03-04T13:00:48.182971+0000","last_peered":"2024-03-04T13:00:48.182971+0000","last_clean":"2024-03-04T13:00:48.182971+0000","last_became_active":"2024-03-04T12:44:50.455509+0000","last_became_peered":"2024-03-04T12:44:50.455509+0000","last_unstale":"2024-03-04T13:00:48.182971+0000","last_undegraded":"2024-03-04T13:00:48.182971+0000","last_fullsized":"2024-03-04T13:00:48.182971+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:48.182850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:48.182850+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.182850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:46:46.844269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"256'40","reported_seq":146,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.596410+0000","last_change":"2024-03-04T13:00:27.596439+0000","last_active":"2024-03-04T13:00:27.596410+0000","last_peered":"2024-03-04T13:00:27.596410+0000","last_clean":"2024-03-04T13:00:27.596410+0000","last_became_active":"2024-03-04T12:43:27.060405+0000","last_became_peered":"2024-03-04T12:43:27.060405+0000","last_unstale":"2024-03-04T13:00:27.596410+0000","last_undegraded":"2024-03-04T13:00:27.596410+0000","last_fullsized":"2024-03-04T13:00:27.596410+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'40","last_scrub_stamp":"2024-03-04T13:00:27.596312+0000","last_deep_scrub":"256'40","last_deep_scrub_stamp":"2024-03-04T13:00:27.596312+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.596312+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:52.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":118,"num_write":66,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.560471+0000","last_change":"2024-03-04T12:51:01.358434+0000","last_active":"2024-03-04T13:00:23.560471+0000","last_peered":"2024-03-04T13:00:23.560471+0000","last_clean":"2024-03-04T13:00:23.560471+0000","last_became_active":"2024-03-04T12:51:01.358005+0000","last_became_peered":"2024-03-04T12:51:01.358005+0000","last_unstale":"2024-03-04T13:00:23.560471+0000","last_undegraded":"2024-03-04T13:00:23.560471+0000","last_fullsized":"2024-03-04T13:00:23.560471+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"256'9","reported_seq":58,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.653214+0000","last_change":"2024-03-04T13:00:46.653244+0000","last_active":"2024-03-04T13:00:46.653214+0000","last_peered":"2024-03-04T13:00:46.653214+0000","last_clean":"2024-03-04T13:00:46.653214+0000","last_became_active":"2024-03-04T12:44:53.486168+0000","last_became_peered":"2024-03-04T12:44:53.486168+0000","last_unstale":"2024-03-04T13:00:46.653214+0000","last_undegraded":"2024-03-04T13:00:46.653214+0000","last_fullsized":"2024-03-04T13:00:46.653214+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:46.653131+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:46.653131+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.653131+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:15:05.535942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":10242,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.629649+0000","last_change":"2024-03-04T13:00:22.629669+0000","last_active":"2024-03-04T13:00:22.629649+0000","last_peered":"2024-03-04T13:00:22.629649+0000","last_clean":"2024-03-04T13:00:22.629649+0000","last_became_active":"2024-03-04T12:44:50.450465+0000","last_became_peered":"2024-03-04T12:44:50.450465+0000","last_unstale":"2024-03-04T13:00:22.629649+0000","last_undegraded":"2024-03-04T13:00:22.629649+0000","last_fullsized":"2024-03-04T13:00:22.629649+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:22.629555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:22.629555+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.629555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:10.681596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"250'33","reported_seq":136,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.541479+0000","last_change":"2024-03-04T13:00:25.541501+0000","last_active":"2024-03-04T13:00:25.541479+0000","last_peered":"2024-03-04T13:00:25.541479+0000","last_clean":"2024-03-04T13:00:25.541479+0000","last_became_active":"2024-03-04T12:43:27.060562+0000","last_became_peered":"2024-03-04T12:43:27.060562+0000","last_unstale":"2024-03-04T13:00:25.541479+0000","last_undegraded":"2024-03-04T13:00:25.541479+0000","last_fullsized":"2024-03-04T13:00:25.541479+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'33","last_scrub_stamp":"2024-03-04T13:00:25.541401+0000","last_deep_scrub":"250'33","last_deep_scrub_stamp":"2024-03-04T13:00:25.541401+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.541401+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:43.219942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":113,"num_write":48,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":24,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.633971+0000","last_change":"2024-03-04T12:51:01.596745+0000","last_active":"2024-03-04T13:00:22.633971+0000","last_peered":"2024-03-04T13:00:22.633971+0000","last_clean":"2024-03-04T13:00:22.633971+0000","last_became_active":"2024-03-04T12:51:01.595776+0000","last_became_peered":"2024-03-04T12:51:01.595776+0000","last_unstale":"2024-03-04T13:00:22.633971+0000","last_undegraded":"2024-03-04T13:00:22.633971+0000","last_fullsized":"2024-03-04T13:00:22.633971+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"256'14","reported_seq":64,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.116502+0000","last_change":"2024-03-04T13:00:36.116531+0000","last_active":"2024-03-04T13:00:36.116502+0000","last_peered":"2024-03-04T13:00:36.116502+0000","last_clean":"2024-03-04T13:00:36.116502+0000","last_became_active":"2024-03-04T12:44:53.478864+0000","last_became_peered":"2024-03-04T12:44:53.478864+0000","last_unstale":"2024-03-04T13:00:36.116502+0000","last_undegraded":"2024-03-04T13:00:36.116502+0000","last_fullsized":"2024-03-04T13:00:36.116502+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'14","last_scrub_stamp":"2024-03-04T13:00:36.116377+0000","last_deep_scrub":"256'14","last_deep_scrub_stamp":"2024-03-04T13:00:36.116377+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.116377+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:25:47.800519+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":27,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.687649+0000","last_change":"2024-03-04T13:00:26.687673+0000","last_active":"2024-03-04T13:00:26.687649+0000","last_peered":"2024-03-04T13:00:26.687649+0000","last_clean":"2024-03-04T13:00:26.687649+0000","last_became_active":"2024-03-04T12:44:50.453830+0000","last_became_peered":"2024-03-04T12:44:50.453830+0000","last_unstale":"2024-03-04T13:00:26.687649+0000","last_undegraded":"2024-03-04T13:00:26.687649+0000","last_fullsized":"2024-03-04T13:00:26.687649+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:26.687563+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:26.687563+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.687563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:43.300798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"256'64","reported_seq":206,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.295688+0000","last_change":"2024-03-04T13:00:28.295688+0000","last_active":"2024-03-04T13:00:28.295688+0000","last_peered":"2024-03-04T13:00:28.295688+0000","last_clean":"2024-03-04T13:00:28.295688+0000","last_became_active":"2024-03-04T12:43:27.067330+0000","last_became_peered":"2024-03-04T12:43:27.067330+0000","last_unstale":"2024-03-04T13:00:28.295688+0000","last_undegraded":"2024-03-04T13:00:28.295688+0000","last_fullsized":"2024-03-04T13:00:28.295688+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'64","last_scrub_stamp":"2024-03-04T13:00:28.295569+0000","last_deep_scrub":"256'64","last_deep_scrub_stamp":"2024-03-04T13:00:28.295569+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.295569+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:35:07.847340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":194,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:21.013626+0000","last_change":"2024-03-04T12:51:01.596599+0000","last_active":"2024-03-04T12:59:21.013626+0000","last_peered":"2024-03-04T12:59:21.013626+0000","last_clean":"2024-03-04T12:59:21.013626+0000","last_became_active":"2024-03-04T12:51:01.596268+0000","last_became_peered":"2024-03-04T12:51:01.596268+0000","last_unstale":"2024-03-04T12:59:21.013626+0000","last_undegraded":"2024-03-04T12:59:21.013626+0000","last_fullsized":"2024-03-04T12:59:21.013626+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.223422+0000","last_change":"2024-03-04T13:00:54.223422+0000","last_active":"2024-03-04T13:00:54.223422+0000","last_peered":"2024-03-04T13:00:54.223422+0000","last_clean":"2024-03-04T13:00:54.223422+0000","last_became_active":"2024-03-04T12:44:53.481760+0000","last_became_peered":"2024-03-04T12:44:53.481760+0000","last_unstale":"2024-03-04T13:00:54.223422+0000","last_undegraded":"2024-03-04T13:00:54.223422+0000","last_fullsized":"2024-03-04T13:00:54.223422+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:54.223306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:54.223306+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.223306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:05.591529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.584224+0000","last_change":"2024-03-04T13:00:34.584252+0000","last_active":"2024-03-04T13:00:34.584224+0000","last_peered":"2024-03-04T13:00:34.584224+0000","last_clean":"2024-03-04T13:00:34.584224+0000","last_became_active":"2024-03-04T12:44:50.455723+0000","last_became_peered":"2024-03-04T12:44:50.455723+0000","last_unstale":"2024-03-04T13:00:34.584224+0000","last_undegraded":"2024-03-04T13:00:34.584224+0000","last_fullsized":"2024-03-04T13:00:34.584224+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:34.584103+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:34.584103+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.584103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:47.957581+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"256'151","reported_seq":510,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.376916+0000","last_change":"2024-03-04T13:00:23.376916+0000","last_active":"2024-03-04T13:00:23.376916+0000","last_peered":"2024-03-04T13:00:23.376916+0000","last_clean":"2024-03-04T13:00:23.376916+0000","last_became_active":"2024-03-04T12:43:27.067228+0000","last_became_peered":"2024-03-04T12:43:27.067228+0000","last_unstale":"2024-03-04T13:00:23.376916+0000","last_undegraded":"2024-03-04T13:00:23.376916+0000","last_fullsized":"2024-03-04T13:00:23.376916+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'151","last_scrub_stamp":"2024-03-04T13:00:23.376811+0000","last_deep_scrub":"256'151","last_deep_scrub_stamp":"2024-03-04T13:00:23.376811+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.376811+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:55:13.549907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":889,"num_read_kb":655,"num_write":189,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4940,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.023677+0000","last_change":"2024-03-04T12:51:01.356736+0000","last_active":"2024-03-04T13:00:24.023677+0000","last_peered":"2024-03-04T13:00:24.023677+0000","last_clean":"2024-03-04T13:00:24.023677+0000","last_became_active":"2024-03-04T12:51:01.356572+0000","last_became_peered":"2024-03-04T12:51:01.356572+0000","last_unstale":"2024-03-04T13:00:24.023677+0000","last_undegraded":"2024-03-04T13:00:24.023677+0000","last_fullsized":"2024-03-04T13:00:24.023677+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"256'4","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.151000+0000","last_change":"2024-03-04T13:00:32.151061+0000","last_active":"2024-03-04T13:00:32.151000+0000","last_peered":"2024-03-04T13:00:32.151000+0000","last_clean":"2024-03-04T13:00:32.151000+0000","last_became_active":"2024-03-04T12:44:53.477386+0000","last_became_peered":"2024-03-04T12:44:53.477386+0000","last_unstale":"2024-03-04T13:00:32.151000+0000","last_undegraded":"2024-03-04T13:00:32.151000+0000","last_fullsized":"2024-03-04T13:00:32.151000+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:32.150910+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:32.150910+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.150910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:35.067029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":418,"num_write":4,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.868900+0000","last_change":"2024-03-04T13:00:25.868970+0000","last_active":"2024-03-04T13:00:25.868900+0000","last_peered":"2024-03-04T13:00:25.868900+0000","last_clean":"2024-03-04T13:00:25.868900+0000","last_became_active":"2024-03-04T12:44:50.448683+0000","last_became_peered":"2024-03-04T12:44:50.448683+0000","last_unstale":"2024-03-04T13:00:25.868900+0000","last_undegraded":"2024-03-04T13:00:25.868900+0000","last_fullsized":"2024-03-04T13:00:25.868900+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:25.868786+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:25.868786+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.868786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:06.732143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"256'38","reported_seq":138,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.367310+0000","last_change":"2024-03-04T13:00:25.367310+0000","last_active":"2024-03-04T13:00:25.367310+0000","last_peered":"2024-03-04T13:00:25.367310+0000","last_clean":"2024-03-04T13:00:25.367310+0000","last_became_active":"2024-03-04T12:43:27.062623+0000","last_became_peered":"2024-03-04T12:43:27.062623+0000","last_unstale":"2024-03-04T13:00:25.367310+0000","last_undegraded":"2024-03-04T13:00:25.367310+0000","last_fullsized":"2024-03-04T13:00:25.367310+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'38","last_scrub_stamp":"2024-03-04T13:00:25.367217+0000","last_deep_scrub":"256'38","last_deep_scrub_stamp":"2024-03-04T13:00:25.367217+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.367217+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:18:32.757230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.560461+0000","last_change":"2024-03-04T12:51:01.357400+0000","last_active":"2024-03-04T13:00:23.560461+0000","last_peered":"2024-03-04T13:00:23.560461+0000","last_clean":"2024-03-04T13:00:23.560461+0000","last_became_active":"2024-03-04T12:51:01.355578+0000","last_became_peered":"2024-03-04T12:51:01.355578+0000","last_unstale":"2024-03-04T13:00:23.560461+0000","last_undegraded":"2024-03-04T13:00:23.560461+0000","last_fullsized":"2024-03-04T13:00:23.560461+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"256'11","reported_seq":57,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.499477+0000","last_change":"2024-03-04T13:00:42.499529+0000","last_active":"2024-03-04T13:00:42.499477+0000","last_peered":"2024-03-04T13:00:42.499477+0000","last_clean":"2024-03-04T13:00:42.499477+0000","last_became_active":"2024-03-04T12:44:53.476348+0000","last_became_peered":"2024-03-04T12:44:53.476348+0000","last_unstale":"2024-03-04T13:00:42.499477+0000","last_undegraded":"2024-03-04T13:00:42.499477+0000","last_fullsized":"2024-03-04T13:00:42.499477+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'11","last_scrub_stamp":"2024-03-04T13:00:42.499379+0000","last_deep_scrub":"256'11","last_deep_scrub_stamp":"2024-03-04T13:00:42.499379+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.499379+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:06.177825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13312,"num_write":16,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'7","reported_seq":60,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.741695+0000","last_change":"2024-03-04T13:00:30.741727+0000","last_active":"2024-03-04T13:00:30.741695+0000","last_peered":"2024-03-04T13:00:30.741695+0000","last_clean":"2024-03-04T13:00:30.741695+0000","last_became_active":"2024-03-04T12:44:50.454252+0000","last_became_peered":"2024-03-04T12:44:50.454252+0000","last_unstale":"2024-03-04T13:00:30.741695+0000","last_undegraded":"2024-03-04T13:00:30.741695+0000","last_fullsized":"2024-03-04T13:00:30.741695+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:00:30.741607+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:00:30.741607+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.741607+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:27.692537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"256'25","reported_seq":106,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.237546+0000","last_change":"2024-03-04T13:00:30.237546+0000","last_active":"2024-03-04T13:00:30.237546+0000","last_peered":"2024-03-04T13:00:30.237546+0000","last_clean":"2024-03-04T13:00:30.237546+0000","last_became_active":"2024-03-04T12:43:27.061611+0000","last_became_peered":"2024-03-04T12:43:27.061611+0000","last_unstale":"2024-03-04T13:00:30.237546+0000","last_undegraded":"2024-03-04T13:00:30.237546+0000","last_fullsized":"2024-03-04T13:00:30.237546+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'25","last_scrub_stamp":"2024-03-04T13:00:30.237361+0000","last_deep_scrub":"256'25","last_deep_scrub_stamp":"2024-03-04T13:00:30.237361+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.237361+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:40.824012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.670421+0000","last_change":"2024-03-04T13:00:50.670421+0000","last_active":"2024-03-04T13:00:50.670421+0000","last_peered":"2024-03-04T13:00:50.670421+0000","last_clean":"2024-03-04T13:00:50.670421+0000","last_became_active":"2024-03-04T12:51:01.351465+0000","last_became_peered":"2024-03-04T12:51:01.351465+0000","last_unstale":"2024-03-04T13:00:50.670421+0000","last_undegraded":"2024-03-04T13:00:50.670421+0000","last_fullsized":"2024-03-04T13:00:50.670421+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:50.670255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:50.670255+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.670255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:50:29.698487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"256'4","reported_seq":37,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.325676+0000","last_change":"2024-03-04T12:44:53.483089+0000","last_active":"2024-03-04T13:00:16.325676+0000","last_peered":"2024-03-04T13:00:16.325676+0000","last_clean":"2024-03-04T13:00:16.325676+0000","last_became_active":"2024-03-04T12:44:53.482806+0000","last_became_peered":"2024-03-04T12:44:53.482806+0000","last_unstale":"2024-03-04T13:00:16.325676+0000","last_undegraded":"2024-03-04T13:00:16.325676+0000","last_fullsized":"2024-03-04T13:00:16.325676+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.377211+0000","last_change":"2024-03-04T13:00:22.377229+0000","last_active":"2024-03-04T13:00:22.377211+0000","last_peered":"2024-03-04T13:00:22.377211+0000","last_clean":"2024-03-04T13:00:22.377211+0000","last_became_active":"2024-03-04T12:44:50.457180+0000","last_became_peered":"2024-03-04T12:44:50.457180+0000","last_unstale":"2024-03-04T13:00:22.377211+0000","last_undegraded":"2024-03-04T13:00:22.377211+0000","last_fullsized":"2024-03-04T13:00:22.377211+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:22.377126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:22.377126+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.377126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:53.011158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"256'43","reported_seq":141,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.659958+0000","last_change":"2024-03-04T13:00:25.659958+0000","last_active":"2024-03-04T13:00:25.659958+0000","last_peered":"2024-03-04T13:00:25.659958+0000","last_clean":"2024-03-04T13:00:25.659958+0000","last_became_active":"2024-03-04T12:43:27.063191+0000","last_became_peered":"2024-03-04T12:43:27.063191+0000","last_unstale":"2024-03-04T13:00:25.659958+0000","last_undegraded":"2024-03-04T13:00:25.659958+0000","last_fullsized":"2024-03-04T13:00:25.659958+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'43","last_scrub_stamp":"2024-03-04T13:00:25.659791+0000","last_deep_scrub":"256'43","last_deep_scrub_stamp":"2024-03-04T13:00:25.659791+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.659791+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:44:08.536513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":76,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.634331+0000","last_change":"2024-03-04T13:01:00.634331+0000","last_active":"2024-03-04T13:01:00.634331+0000","last_peered":"2024-03-04T13:01:00.634331+0000","last_clean":"2024-03-04T13:01:00.634331+0000","last_became_active":"2024-03-04T12:51:01.353248+0000","last_became_peered":"2024-03-04T12:51:01.353248+0000","last_unstale":"2024-03-04T13:01:00.634331+0000","last_undegraded":"2024-03-04T13:01:00.634331+0000","last_fullsized":"2024-03-04T13:01:00.634331+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:00.634191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:00.634191+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.634191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:53.499135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"250'5","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:56.020336+0000","last_change":"2024-03-04T12:44:53.483754+0000","last_active":"2024-03-04T12:59:56.020336+0000","last_peered":"2024-03-04T12:59:56.020336+0000","last_clean":"2024-03-04T12:59:56.020336+0000","last_became_active":"2024-03-04T12:44:53.483210+0000","last_became_peered":"2024-03-04T12:44:53.483210+0000","last_unstale":"2024-03-04T12:59:56.020336+0000","last_undegraded":"2024-03-04T12:59:56.020336+0000","last_fullsized":"2024-03-04T12:59:56.020336+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"256'9","reported_seq":62,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.633368+0000","last_change":"2024-03-04T13:00:23.633396+0000","last_active":"2024-03-04T13:00:23.633368+0000","last_peered":"2024-03-04T13:00:23.633368+0000","last_clean":"2024-03-04T13:00:23.633368+0000","last_became_active":"2024-03-04T12:44:50.449291+0000","last_became_peered":"2024-03-04T12:44:50.449291+0000","last_unstale":"2024-03-04T13:00:23.633368+0000","last_undegraded":"2024-03-04T13:00:23.633368+0000","last_fullsized":"2024-03-04T13:00:23.633368+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:23.633297+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:23.633297+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.633297+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:09.478343+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"256'42","reported_seq":139,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.413406+0000","last_change":"2024-03-04T13:00:36.413430+0000","last_active":"2024-03-04T13:00:36.413406+0000","last_peered":"2024-03-04T13:00:36.413406+0000","last_clean":"2024-03-04T13:00:36.413406+0000","last_became_active":"2024-03-04T12:43:27.061663+0000","last_became_peered":"2024-03-04T12:43:27.061663+0000","last_unstale":"2024-03-04T13:00:36.413406+0000","last_undegraded":"2024-03-04T13:00:36.413406+0000","last_fullsized":"2024-03-04T13:00:36.413406+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'42","last_scrub_stamp":"2024-03-04T13:00:36.413321+0000","last_deep_scrub":"256'42","last_deep_scrub_stamp":"2024-03-04T13:00:36.413321+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.413321+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:53.818525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":24,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.004187+0000","last_change":"2024-03-04T12:51:01.596240+0000","last_active":"2024-03-04T13:00:21.004187+0000","last_peered":"2024-03-04T13:00:21.004187+0000","last_clean":"2024-03-04T13:00:21.004187+0000","last_became_active":"2024-03-04T12:51:01.595943+0000","last_became_peered":"2024-03-04T12:51:01.595943+0000","last_unstale":"2024-03-04T13:00:21.004187+0000","last_undegraded":"2024-03-04T13:00:21.004187+0000","last_fullsized":"2024-03-04T13:00:21.004187+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"256'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.371280+0000","last_change":"2024-03-04T12:44:53.486306+0000","last_active":"2024-03-04T13:00:16.371280+0000","last_peered":"2024-03-04T13:00:16.371280+0000","last_clean":"2024-03-04T13:00:16.371280+0000","last_became_active":"2024-03-04T12:44:53.485995+0000","last_became_peered":"2024-03-04T12:44:53.485995+0000","last_unstale":"2024-03-04T13:00:16.371280+0000","last_undegraded":"2024-03-04T13:00:16.371280+0000","last_fullsized":"2024-03-04T13:00:16.371280+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"256'4","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.794012+0000","last_change":"2024-03-04T13:00:34.794073+0000","last_active":"2024-03-04T13:00:34.794012+0000","last_peered":"2024-03-04T13:00:34.794012+0000","last_clean":"2024-03-04T13:00:34.794012+0000","last_became_active":"2024-03-04T12:44:50.454617+0000","last_became_peered":"2024-03-04T12:44:50.454617+0000","last_unstale":"2024-03-04T13:00:34.794012+0000","last_undegraded":"2024-03-04T13:00:34.794012+0000","last_fullsized":"2024-03-04T13:00:34.794012+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:34.793901+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:34.793901+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.793901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:05.781091+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"256'41","reported_seq":144,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.757303+0000","last_change":"2024-03-04T13:00:31.757332+0000","last_active":"2024-03-04T13:00:31.757303+0000","last_peered":"2024-03-04T13:00:31.757303+0000","last_clean":"2024-03-04T13:00:31.757303+0000","last_became_active":"2024-03-04T12:43:27.050088+0000","last_became_peered":"2024-03-04T12:43:27.050088+0000","last_unstale":"2024-03-04T13:00:31.757303+0000","last_undegraded":"2024-03-04T13:00:31.757303+0000","last_fullsized":"2024-03-04T13:00:31.757303+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'41","last_scrub_stamp":"2024-03-04T13:00:31.757200+0000","last_deep_scrub":"256'41","last_deep_scrub_stamp":"2024-03-04T13:00:31.757200+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.757200+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:30:26.807415+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":112,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.633949+0000","last_change":"2024-03-04T12:51:01.595890+0000","last_active":"2024-03-04T13:00:22.633949+0000","last_peered":"2024-03-04T13:00:22.633949+0000","last_clean":"2024-03-04T13:00:22.633949+0000","last_became_active":"2024-03-04T12:51:01.595530+0000","last_became_peered":"2024-03-04T12:51:01.595530+0000","last_unstale":"2024-03-04T13:00:22.633949+0000","last_undegraded":"2024-03-04T13:00:22.633949+0000","last_fullsized":"2024-03-04T13:00:22.633949+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"256'4","reported_seq":38,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.814492+0000","last_change":"2024-03-04T12:44:53.478706+0000","last_active":"2024-03-04T13:00:15.814492+0000","last_peered":"2024-03-04T13:00:15.814492+0000","last_clean":"2024-03-04T13:00:15.814492+0000","last_became_active":"2024-03-04T12:44:53.478099+0000","last_became_peered":"2024-03-04T12:44:53.478099+0000","last_unstale":"2024-03-04T13:00:15.814492+0000","last_undegraded":"2024-03-04T13:00:15.814492+0000","last_fullsized":"2024-03-04T13:00:15.814492+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.588764+0000","last_change":"2024-03-04T13:00:24.588802+0000","last_active":"2024-03-04T13:00:24.588764+0000","last_peered":"2024-03-04T13:00:24.588764+0000","last_clean":"2024-03-04T13:00:24.588764+0000","last_became_active":"2024-03-04T12:44:50.448745+0000","last_became_peered":"2024-03-04T12:44:50.448745+0000","last_unstale":"2024-03-04T13:00:24.588764+0000","last_undegraded":"2024-03-04T13:00:24.588764+0000","last_fullsized":"2024-03-04T13:00:24.588764+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:24.588654+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:24.588654+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.588654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:49:36.928946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"256'16","reported_seq":90,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.456547+0000","last_change":"2024-03-04T13:00:28.456571+0000","last_active":"2024-03-04T13:00:28.456547+0000","last_peered":"2024-03-04T13:00:28.456547+0000","last_clean":"2024-03-04T13:00:28.456547+0000","last_became_active":"2024-03-04T12:43:27.059494+0000","last_became_peered":"2024-03-04T12:43:27.059494+0000","last_unstale":"2024-03-04T13:00:28.456547+0000","last_undegraded":"2024-03-04T13:00:28.456547+0000","last_fullsized":"2024-03-04T13:00:28.456547+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'16","last_scrub_stamp":"2024-03-04T13:00:28.456461+0000","last_deep_scrub":"256'16","last_deep_scrub_stamp":"2024-03-04T13:00:28.456461+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.456461+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:06.545751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":48,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.094382+0000","last_change":"2024-03-04T12:51:01.355844+0000","last_active":"2024-03-04T13:00:23.094382+0000","last_peered":"2024-03-04T13:00:23.094382+0000","last_clean":"2024-03-04T13:00:23.094382+0000","last_became_active":"2024-03-04T12:51:01.355560+0000","last_became_peered":"2024-03-04T12:51:01.355560+0000","last_unstale":"2024-03-04T13:00:23.094382+0000","last_undegraded":"2024-03-04T13:00:23.094382+0000","last_fullsized":"2024-03-04T13:00:23.094382+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'3","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.548095+0000","last_change":"2024-03-04T13:00:38.548121+0000","last_active":"2024-03-04T13:00:38.548095+0000","last_peered":"2024-03-04T13:00:38.548095+0000","last_clean":"2024-03-04T13:00:38.548095+0000","last_became_active":"2024-03-04T12:44:53.475861+0000","last_became_peered":"2024-03-04T12:44:53.475861+0000","last_unstale":"2024-03-04T13:00:38.548095+0000","last_undegraded":"2024-03-04T13:00:38.548095+0000","last_fullsized":"2024-03-04T13:00:38.548095+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'3","last_scrub_stamp":"2024-03-04T13:00:38.548004+0000","last_deep_scrub":"250'3","last_deep_scrub_stamp":"2024-03-04T13:00:38.548004+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.548004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:54:35.955700+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"256'8","reported_seq":59,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.305336+0000","last_change":"2024-03-04T13:00:25.305365+0000","last_active":"2024-03-04T13:00:25.305336+0000","last_peered":"2024-03-04T13:00:25.305336+0000","last_clean":"2024-03-04T13:00:25.305336+0000","last_became_active":"2024-03-04T12:44:50.453541+0000","last_became_peered":"2024-03-04T12:44:50.453541+0000","last_unstale":"2024-03-04T13:00:25.305336+0000","last_undegraded":"2024-03-04T13:00:25.305336+0000","last_fullsized":"2024-03-04T13:00:25.305336+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'8","last_scrub_stamp":"2024-03-04T13:00:25.305244+0000","last_deep_scrub":"256'8","last_deep_scrub_stamp":"2024-03-04T13:00:25.305244+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.305244+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:50.904960+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"256'48","reported_seq":157,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.235467+0000","last_change":"2024-03-04T13:00:22.235467+0000","last_active":"2024-03-04T13:00:22.235467+0000","last_peered":"2024-03-04T13:00:22.235467+0000","last_clean":"2024-03-04T13:00:22.235467+0000","last_became_active":"2024-03-04T12:43:27.069664+0000","last_became_peered":"2024-03-04T12:43:27.069664+0000","last_unstale":"2024-03-04T13:00:22.235467+0000","last_undegraded":"2024-03-04T13:00:22.235467+0000","last_fullsized":"2024-03-04T13:00:22.235467+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'48","last_scrub_stamp":"2024-03-04T13:00:22.235365+0000","last_deep_scrub":"256'48","last_deep_scrub_stamp":"2024-03-04T13:00:22.235365+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.235365+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:38:42.140621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":14,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:56.010344+0000","last_change":"2024-03-04T12:51:41.753110+0000","last_active":"2024-03-04T12:58:56.010344+0000","last_peered":"2024-03-04T12:58:56.010344+0000","last_clean":"2024-03-04T12:58:56.010344+0000","last_became_active":"2024-03-04T12:51:41.752775+0000","last_became_peered":"2024-03-04T12:51:41.752775+0000","last_unstale":"2024-03-04T12:58:56.010344+0000","last_undegraded":"2024-03-04T12:58:56.010344+0000","last_fullsized":"2024-03-04T12:58:56.010344+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"256'7","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.154187+0000","last_change":"2024-03-04T13:00:51.154226+0000","last_active":"2024-03-04T13:00:51.154187+0000","last_peered":"2024-03-04T13:00:51.154187+0000","last_clean":"2024-03-04T13:00:51.154187+0000","last_became_active":"2024-03-04T12:44:53.478126+0000","last_became_peered":"2024-03-04T12:44:53.478126+0000","last_unstale":"2024-03-04T13:00:51.154187+0000","last_undegraded":"2024-03-04T13:00:51.154187+0000","last_fullsized":"2024-03-04T13:00:51.154187+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:00:51.154098+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:00:51.154098+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.154098+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:41:53.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11793,"num_write":12,"num_write_kb":7697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'2","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.220991+0000","last_change":"2024-03-04T13:00:49.221016+0000","last_active":"2024-03-04T13:00:49.220991+0000","last_peered":"2024-03-04T13:00:49.220991+0000","last_clean":"2024-03-04T13:00:49.220991+0000","last_became_active":"2024-03-04T12:44:50.455571+0000","last_became_peered":"2024-03-04T12:44:50.455571+0000","last_unstale":"2024-03-04T13:00:49.220991+0000","last_undegraded":"2024-03-04T13:00:49.220991+0000","last_fullsized":"2024-03-04T13:00:49.220991+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:49.220893+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:49.220893+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.220893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:10.521167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"256'47","reported_seq":151,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.409207+0000","last_change":"2024-03-04T13:00:27.409254+0000","last_active":"2024-03-04T13:00:27.409207+0000","last_peered":"2024-03-04T13:00:27.409207+0000","last_clean":"2024-03-04T13:00:27.409207+0000","last_became_active":"2024-03-04T12:43:27.060225+0000","last_became_peered":"2024-03-04T12:43:27.060225+0000","last_unstale":"2024-03-04T13:00:27.409207+0000","last_undegraded":"2024-03-04T13:00:27.409207+0000","last_fullsized":"2024-03-04T13:00:27.409207+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'47","last_scrub_stamp":"2024-03-04T13:00:27.409102+0000","last_deep_scrub":"256'47","last_deep_scrub_stamp":"2024-03-04T13:00:27.409102+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.409102+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:54:12.358389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":112,"num_write":82,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.003461+0000","last_change":"2024-03-04T12:51:01.353480+0000","last_active":"2024-03-04T13:00:21.003461+0000","last_peered":"2024-03-04T13:00:21.003461+0000","last_clean":"2024-03-04T13:00:21.003461+0000","last_became_active":"2024-03-04T12:51:01.353087+0000","last_became_peered":"2024-03-04T12:51:01.353087+0000","last_unstale":"2024-03-04T13:00:21.003461+0000","last_undegraded":"2024-03-04T13:00:21.003461+0000","last_fullsized":"2024-03-04T13:00:21.003461+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.726610+0000","last_change":"2024-03-04T13:00:42.726659+0000","last_active":"2024-03-04T13:00:42.726610+0000","last_peered":"2024-03-04T13:00:42.726610+0000","last_clean":"2024-03-04T13:00:42.726610+0000","last_became_active":"2024-03-04T12:44:53.485819+0000","last_became_peered":"2024-03-04T12:44:53.485819+0000","last_unstale":"2024-03-04T13:00:42.726610+0000","last_undegraded":"2024-03-04T13:00:42.726610+0000","last_fullsized":"2024-03-04T13:00:42.726610+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:42.726495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:42.726495+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.726495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:39:45.012364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"256'18","reported_seq":81,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.562350+0000","last_change":"2024-03-04T13:00:26.562385+0000","last_active":"2024-03-04T13:00:26.562350+0000","last_peered":"2024-03-04T13:00:26.562350+0000","last_clean":"2024-03-04T13:00:26.562350+0000","last_became_active":"2024-03-04T12:44:50.451612+0000","last_became_peered":"2024-03-04T12:44:50.451612+0000","last_unstale":"2024-03-04T13:00:26.562350+0000","last_undegraded":"2024-03-04T13:00:26.562350+0000","last_fullsized":"2024-03-04T13:00:26.562350+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'18","last_scrub_stamp":"2024-03-04T13:00:26.562265+0000","last_deep_scrub":"256'18","last_deep_scrub_stamp":"2024-03-04T13:00:26.562265+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.562265+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:30:31.690140+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":29700,"num_write":24,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"256'29","reported_seq":118,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.267423+0000","last_change":"2024-03-04T13:00:37.267495+0000","last_active":"2024-03-04T13:00:37.267423+0000","last_peered":"2024-03-04T13:00:37.267423+0000","last_clean":"2024-03-04T13:00:37.267423+0000","last_became_active":"2024-03-04T12:43:27.067356+0000","last_became_peered":"2024-03-04T12:43:27.067356+0000","last_unstale":"2024-03-04T13:00:37.267423+0000","last_undegraded":"2024-03-04T13:00:37.267423+0000","last_fullsized":"2024-03-04T13:00:37.267423+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'29","last_scrub_stamp":"2024-03-04T13:00:37.267297+0000","last_deep_scrub":"256'29","last_deep_scrub_stamp":"2024-03-04T13:00:37.267297+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.267297+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:05.403189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":50,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.003502+0000","last_change":"2024-03-04T12:51:01.353135+0000","last_active":"2024-03-04T13:00:21.003502+0000","last_peered":"2024-03-04T13:00:21.003502+0000","last_clean":"2024-03-04T13:00:21.003502+0000","last_became_active":"2024-03-04T12:51:01.352205+0000","last_became_peered":"2024-03-04T12:51:01.352205+0000","last_unstale":"2024-03-04T13:00:21.003502+0000","last_undegraded":"2024-03-04T13:00:21.003502+0000","last_fullsized":"2024-03-04T13:00:21.003502+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"256'10","reported_seq":57,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.111850+0000","last_change":"2024-03-04T13:00:40.111906+0000","last_active":"2024-03-04T13:00:40.111850+0000","last_peered":"2024-03-04T13:00:40.111850+0000","last_clean":"2024-03-04T13:00:40.111850+0000","last_became_active":"2024-03-04T12:44:53.479906+0000","last_became_peered":"2024-03-04T12:44:53.479906+0000","last_unstale":"2024-03-04T13:00:40.111850+0000","last_undegraded":"2024-03-04T13:00:40.111850+0000","last_fullsized":"2024-03-04T13:00:40.111850+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'10","last_scrub_stamp":"2024-03-04T13:00:40.111726+0000","last_deep_scrub":"256'10","last_deep_scrub_stamp":"2024-03-04T13:00:40.111726+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.111726+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:53.009649+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8765,"num_write":13,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"256'2","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.233487+0000","last_change":"2024-03-04T13:00:31.233511+0000","last_active":"2024-03-04T13:00:31.233487+0000","last_peered":"2024-03-04T13:00:31.233487+0000","last_clean":"2024-03-04T13:00:31.233487+0000","last_became_active":"2024-03-04T12:44:50.455705+0000","last_became_peered":"2024-03-04T12:44:50.455705+0000","last_unstale":"2024-03-04T13:00:31.233487+0000","last_undegraded":"2024-03-04T13:00:31.233487+0000","last_fullsized":"2024-03-04T13:00:31.233487+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:31.233395+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:31.233395+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.233395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:43:28.071292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"256'37","reported_seq":138,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.483753+0000","last_change":"2024-03-04T13:00:26.483782+0000","last_active":"2024-03-04T13:00:26.483753+0000","last_peered":"2024-03-04T13:00:26.483753+0000","last_clean":"2024-03-04T13:00:26.483753+0000","last_became_active":"2024-03-04T12:43:27.049948+0000","last_became_peered":"2024-03-04T12:43:27.049948+0000","last_unstale":"2024-03-04T13:00:26.483753+0000","last_undegraded":"2024-03-04T13:00:26.483753+0000","last_fullsized":"2024-03-04T13:00:26.483753+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'37","last_scrub_stamp":"2024-03-04T13:00:26.483653+0000","last_deep_scrub":"256'37","last_deep_scrub_stamp":"2024-03-04T13:00:26.483653+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.483653+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:53:44.304398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":102,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.012716+0000","last_change":"2024-03-04T12:51:01.355931+0000","last_active":"2024-03-04T13:00:21.012716+0000","last_peered":"2024-03-04T13:00:21.012716+0000","last_clean":"2024-03-04T13:00:21.012716+0000","last_became_active":"2024-03-04T12:51:01.355460+0000","last_became_peered":"2024-03-04T12:51:01.355460+0000","last_unstale":"2024-03-04T13:00:21.012716+0000","last_undegraded":"2024-03-04T13:00:21.012716+0000","last_fullsized":"2024-03-04T13:00:21.012716+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:58:56.009864+0000","last_change":"2024-03-04T12:44:53.483084+0000","last_active":"2024-03-04T12:58:56.009864+0000","last_peered":"2024-03-04T12:58:56.009864+0000","last_clean":"2024-03-04T12:58:56.009864+0000","last_became_active":"2024-03-04T12:44:53.482573+0000","last_became_peered":"2024-03-04T12:44:53.482573+0000","last_unstale":"2024-03-04T12:58:56.009864+0000","last_undegraded":"2024-03-04T12:58:56.009864+0000","last_fullsized":"2024-03-04T12:58:56.009864+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.707467+0000","last_change":"2024-03-04T13:00:22.707500+0000","last_active":"2024-03-04T13:00:22.707467+0000","last_peered":"2024-03-04T13:00:22.707467+0000","last_clean":"2024-03-04T13:00:22.707467+0000","last_became_active":"2024-03-04T12:44:50.450815+0000","last_became_peered":"2024-03-04T12:44:50.450815+0000","last_unstale":"2024-03-04T13:00:22.707467+0000","last_undegraded":"2024-03-04T13:00:22.707467+0000","last_fullsized":"2024-03-04T13:00:22.707467+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:22.707367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:22.707367+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.707367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:12:35.310838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"256'28","reported_seq":114,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.098819+0000","last_change":"2024-03-04T13:00:25.098849+0000","last_active":"2024-03-04T13:00:25.098819+0000","last_peered":"2024-03-04T13:00:25.098819+0000","last_clean":"2024-03-04T13:00:25.098819+0000","last_became_active":"2024-03-04T12:43:27.055932+0000","last_became_peered":"2024-03-04T12:43:27.055932+0000","last_unstale":"2024-03-04T13:00:25.098819+0000","last_undegraded":"2024-03-04T13:00:25.098819+0000","last_fullsized":"2024-03-04T13:00:25.098819+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'28","last_scrub_stamp":"2024-03-04T13:00:25.098717+0000","last_deep_scrub":"256'28","last_deep_scrub_stamp":"2024-03-04T13:00:25.098717+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.098717+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:13.975808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"253'1","reported_seq":24,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.004154+0000","last_change":"2024-03-04T12:51:01.356544+0000","last_active":"2024-03-04T13:00:21.004154+0000","last_peered":"2024-03-04T13:00:21.004154+0000","last_clean":"2024-03-04T13:00:21.004154+0000","last_became_active":"2024-03-04T12:51:01.356234+0000","last_became_peered":"2024-03-04T12:51:01.356234+0000","last_unstale":"2024-03-04T13:00:21.004154+0000","last_undegraded":"2024-03-04T13:00:21.004154+0000","last_fullsized":"2024-03-04T13:00:21.004154+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":39,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.676335+0000","last_change":"2024-03-04T13:00:59.676376+0000","last_active":"2024-03-04T13:00:59.676335+0000","last_peered":"2024-03-04T13:00:59.676335+0000","last_clean":"2024-03-04T13:00:59.676335+0000","last_became_active":"2024-03-04T12:44:53.481628+0000","last_became_peered":"2024-03-04T12:44:53.481628+0000","last_unstale":"2024-03-04T13:00:59.676335+0000","last_undegraded":"2024-03-04T13:00:59.676335+0000","last_fullsized":"2024-03-04T13:00:59.676335+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:59.676240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:59.676240+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.676240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:02.512577+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.076842+0000","last_change":"2024-03-04T13:00:24.076868+0000","last_active":"2024-03-04T13:00:24.076842+0000","last_peered":"2024-03-04T13:00:24.076842+0000","last_clean":"2024-03-04T13:00:24.076842+0000","last_became_active":"2024-03-04T12:44:50.457629+0000","last_became_peered":"2024-03-04T12:44:50.457629+0000","last_unstale":"2024-03-04T13:00:24.076842+0000","last_undegraded":"2024-03-04T13:00:24.076842+0000","last_fullsized":"2024-03-04T13:00:24.076842+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:24.076745+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:24.076745+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.076745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:23:15.455149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"256'46","reported_seq":157,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.678497+0000","last_change":"2024-03-04T13:00:27.678522+0000","last_active":"2024-03-04T13:00:27.678497+0000","last_peered":"2024-03-04T13:00:27.678497+0000","last_clean":"2024-03-04T13:00:27.678497+0000","last_became_active":"2024-03-04T12:43:27.061268+0000","last_became_peered":"2024-03-04T12:43:27.061268+0000","last_unstale":"2024-03-04T13:00:27.678497+0000","last_undegraded":"2024-03-04T13:00:27.678497+0000","last_fullsized":"2024-03-04T13:00:27.678497+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'46","last_scrub_stamp":"2024-03-04T13:00:27.678408+0000","last_deep_scrub":"256'46","last_deep_scrub_stamp":"2024-03-04T13:00:27.678408+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.678408+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:22.425866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":125,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"254'1","reported_seq":24,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.001457+0000","last_change":"2024-03-04T12:51:01.352006+0000","last_active":"2024-03-04T13:00:01.001457+0000","last_peered":"2024-03-04T13:00:01.001457+0000","last_clean":"2024-03-04T13:00:01.001457+0000","last_became_active":"2024-03-04T12:51:01.351718+0000","last_became_peered":"2024-03-04T12:51:01.351718+0000","last_unstale":"2024-03-04T13:00:01.001457+0000","last_undegraded":"2024-03-04T13:00:01.001457+0000","last_fullsized":"2024-03-04T13:00:01.001457+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"256'8","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.159522+0000","last_change":"2024-03-04T13:00:52.159557+0000","last_active":"2024-03-04T13:00:52.159522+0000","last_peered":"2024-03-04T13:00:52.159522+0000","last_clean":"2024-03-04T13:00:52.159522+0000","last_became_active":"2024-03-04T12:44:53.480237+0000","last_became_peered":"2024-03-04T12:44:53.480237+0000","last_unstale":"2024-03-04T13:00:52.159522+0000","last_undegraded":"2024-03-04T13:00:52.159522+0000","last_fullsized":"2024-03-04T13:00:52.159522+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'8","last_scrub_stamp":"2024-03-04T13:00:52.159435+0000","last_deep_scrub":"256'8","last_deep_scrub_stamp":"2024-03-04T13:00:52.159435+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.159435+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:16.294942+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"256'4","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.560377+0000","last_change":"2024-03-04T12:44:50.451651+0000","last_active":"2024-03-04T13:00:23.560377+0000","last_peered":"2024-03-04T13:00:23.560377+0000","last_clean":"2024-03-04T13:00:23.560377+0000","last_became_active":"2024-03-04T12:44:50.451353+0000","last_became_peered":"2024-03-04T12:44:50.451353+0000","last_unstale":"2024-03-04T13:00:23.560377+0000","last_undegraded":"2024-03-04T13:00:23.560377+0000","last_fullsized":"2024-03-04T13:00:23.560377+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:49.431740+0000","last_clean_scrub_stamp":"2024-03-04T12:44:49.431740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"256'22","reported_seq":97,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.408305+0000","last_change":"2024-03-04T13:00:32.408351+0000","last_active":"2024-03-04T13:00:32.408305+0000","last_peered":"2024-03-04T13:00:32.408305+0000","last_clean":"2024-03-04T13:00:32.408305+0000","last_became_active":"2024-03-04T12:43:27.060626+0000","last_became_peered":"2024-03-04T12:43:27.060626+0000","last_unstale":"2024-03-04T13:00:32.408305+0000","last_undegraded":"2024-03-04T13:00:32.408305+0000","last_fullsized":"2024-03-04T13:00:32.408305+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'22","last_scrub_stamp":"2024-03-04T13:00:32.408218+0000","last_deep_scrub":"256'22","last_deep_scrub_stamp":"2024-03-04T13:00:32.408218+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.408218+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:27:11.399231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":39,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.001486+0000","last_change":"2024-03-04T12:51:01.356830+0000","last_active":"2024-03-04T13:00:01.001486+0000","last_peered":"2024-03-04T13:00:01.001486+0000","last_clean":"2024-03-04T13:00:01.001486+0000","last_became_active":"2024-03-04T12:51:01.356268+0000","last_became_peered":"2024-03-04T12:51:01.356268+0000","last_unstale":"2024-03-04T13:00:01.001486+0000","last_undegraded":"2024-03-04T13:00:01.001486+0000","last_fullsized":"2024-03-04T13:00:01.001486+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"256'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.483956+0000","last_change":"2024-03-04T12:44:53.489009+0000","last_active":"2024-03-04T13:00:24.483956+0000","last_peered":"2024-03-04T13:00:24.483956+0000","last_clean":"2024-03-04T13:00:24.483956+0000","last_became_active":"2024-03-04T12:44:53.488798+0000","last_became_peered":"2024-03-04T12:44:53.488798+0000","last_unstale":"2024-03-04T13:00:24.483956+0000","last_undegraded":"2024-03-04T13:00:24.483956+0000","last_fullsized":"2024-03-04T13:00:24.483956+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'9","reported_seq":61,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.712653+0000","last_change":"2024-03-04T13:00:23.712653+0000","last_active":"2024-03-04T13:00:23.712653+0000","last_peered":"2024-03-04T13:00:23.712653+0000","last_clean":"2024-03-04T13:00:23.712653+0000","last_became_active":"2024-03-04T12:44:50.449555+0000","last_became_peered":"2024-03-04T12:44:50.449555+0000","last_unstale":"2024-03-04T13:00:23.712653+0000","last_undegraded":"2024-03-04T13:00:23.712653+0000","last_fullsized":"2024-03-04T13:00:23.712653+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:23.712551+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:23.712551+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.712551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:19.679050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9220,"num_write":14,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"256'38","reported_seq":140,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.809948+0000","last_change":"2024-03-04T13:00:27.809977+0000","last_active":"2024-03-04T13:00:27.809948+0000","last_peered":"2024-03-04T13:00:27.809948+0000","last_clean":"2024-03-04T13:00:27.809948+0000","last_became_active":"2024-03-04T12:43:27.062618+0000","last_became_peered":"2024-03-04T12:43:27.062618+0000","last_unstale":"2024-03-04T13:00:27.809948+0000","last_undegraded":"2024-03-04T13:00:27.809948+0000","last_fullsized":"2024-03-04T13:00:27.809948+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'38","last_scrub_stamp":"2024-03-04T13:00:27.809856+0000","last_deep_scrub":"256'38","last_deep_scrub_stamp":"2024-03-04T13:00:27.809856+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.809856+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:07.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":110,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.001507+0000","last_change":"2024-03-04T12:51:01.358213+0000","last_active":"2024-03-04T13:00:01.001507+0000","last_peered":"2024-03-04T13:00:01.001507+0000","last_clean":"2024-03-04T13:00:01.001507+0000","last_became_active":"2024-03-04T12:51:01.357842+0000","last_became_peered":"2024-03-04T12:51:01.357842+0000","last_unstale":"2024-03-04T13:00:01.001507+0000","last_undegraded":"2024-03-04T13:00:01.001507+0000","last_fullsized":"2024-03-04T13:00:01.001507+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"256'2","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.389682+0000","last_change":"2024-03-04T13:00:30.389682+0000","last_active":"2024-03-04T13:00:30.389682+0000","last_peered":"2024-03-04T13:00:30.389682+0000","last_clean":"2024-03-04T13:00:30.389682+0000","last_became_active":"2024-03-04T12:44:53.483209+0000","last_became_peered":"2024-03-04T12:44:53.483209+0000","last_unstale":"2024-03-04T13:00:30.389682+0000","last_undegraded":"2024-03-04T13:00:30.389682+0000","last_fullsized":"2024-03-04T13:00:30.389682+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:30.389535+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:30.389535+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.389535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:42:25.469104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"256'6","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.198335+0000","last_change":"2024-03-04T13:00:50.198364+0000","last_active":"2024-03-04T13:00:50.198335+0000","last_peered":"2024-03-04T13:00:50.198335+0000","last_clean":"2024-03-04T13:00:50.198335+0000","last_became_active":"2024-03-04T12:44:50.458158+0000","last_became_peered":"2024-03-04T12:44:50.458158+0000","last_unstale":"2024-03-04T13:00:50.198335+0000","last_undegraded":"2024-03-04T13:00:50.198335+0000","last_fullsized":"2024-03-04T13:00:50.198335+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:50.198234+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:50.198234+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.198234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:43.249845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"256'48","reported_seq":159,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.106713+0000","last_change":"2024-03-04T13:00:23.106771+0000","last_active":"2024-03-04T13:00:23.106713+0000","last_peered":"2024-03-04T13:00:23.106713+0000","last_clean":"2024-03-04T13:00:23.106713+0000","last_became_active":"2024-03-04T12:43:27.058410+0000","last_became_peered":"2024-03-04T12:43:27.058410+0000","last_unstale":"2024-03-04T13:00:23.106713+0000","last_undegraded":"2024-03-04T13:00:23.106713+0000","last_fullsized":"2024-03-04T13:00:23.106713+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'48","last_scrub_stamp":"2024-03-04T13:00:23.106608+0000","last_deep_scrub":"256'48","last_deep_scrub_stamp":"2024-03-04T13:00:23.106608+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.106608+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:14:06.376944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":132,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.000985+0000","last_change":"2024-03-04T12:51:01.597461+0000","last_active":"2024-03-04T13:00:01.000985+0000","last_peered":"2024-03-04T13:00:01.000985+0000","last_clean":"2024-03-04T13:00:01.000985+0000","last_became_active":"2024-03-04T12:51:01.597162+0000","last_became_peered":"2024-03-04T12:51:01.597162+0000","last_unstale":"2024-03-04T13:00:01.000985+0000","last_undegraded":"2024-03-04T13:00:01.000985+0000","last_fullsized":"2024-03-04T13:00:01.000985+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.248049+0000","last_change":"2024-03-04T12:44:53.478668+0000","last_active":"2024-03-04T13:00:21.248049+0000","last_peered":"2024-03-04T13:00:21.248049+0000","last_clean":"2024-03-04T13:00:21.248049+0000","last_became_active":"2024-03-04T12:44:53.478352+0000","last_became_peered":"2024-03-04T12:44:53.478352+0000","last_unstale":"2024-03-04T13:00:21.248049+0000","last_undegraded":"2024-03-04T13:00:21.248049+0000","last_fullsized":"2024-03-04T13:00:21.248049+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"256'2","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.853284+0000","last_change":"2024-03-04T13:00:26.853284+0000","last_active":"2024-03-04T13:00:26.853284+0000","last_peered":"2024-03-04T13:00:26.853284+0000","last_clean":"2024-03-04T13:00:26.853284+0000","last_became_active":"2024-03-04T12:44:50.449627+0000","last_became_peered":"2024-03-04T12:44:50.449627+0000","last_unstale":"2024-03-04T13:00:26.853284+0000","last_undegraded":"2024-03-04T13:00:26.853284+0000","last_fullsized":"2024-03-04T13:00:26.853284+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:26.853152+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:26.853152+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.853152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:58:13.931570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"244'9","reported_seq":74,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.490326+0000","last_change":"2024-03-04T13:00:24.490356+0000","last_active":"2024-03-04T13:00:24.490326+0000","last_peered":"2024-03-04T13:00:24.490326+0000","last_clean":"2024-03-04T13:00:24.490326+0000","last_became_active":"2024-03-04T12:43:27.057074+0000","last_became_peered":"2024-03-04T12:43:27.057074+0000","last_unstale":"2024-03-04T13:00:24.490326+0000","last_undegraded":"2024-03-04T13:00:24.490326+0000","last_fullsized":"2024-03-04T13:00:24.490326+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'9","last_scrub_stamp":"2024-03-04T13:00:24.490225+0000","last_deep_scrub":"244'9","last_deep_scrub_stamp":"2024-03-04T13:00:24.490225+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.490225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:02:04.720591+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:40.900296+0000","last_change":"2024-03-04T12:51:01.595664+0000","last_active":"2024-03-04T12:59:40.900296+0000","last_peered":"2024-03-04T12:59:40.900296+0000","last_clean":"2024-03-04T12:59:40.900296+0000","last_became_active":"2024-03-04T12:51:01.595390+0000","last_became_peered":"2024-03-04T12:51:01.595390+0000","last_unstale":"2024-03-04T12:59:40.900296+0000","last_undegraded":"2024-03-04T12:59:40.900296+0000","last_fullsized":"2024-03-04T12:59:40.900296+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"256'8","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.388528+0000","last_change":"2024-03-04T13:00:34.388557+0000","last_active":"2024-03-04T13:00:34.388528+0000","last_peered":"2024-03-04T13:00:34.388528+0000","last_clean":"2024-03-04T13:00:34.388528+0000","last_became_active":"2024-03-04T12:44:53.482800+0000","last_became_peered":"2024-03-04T12:44:53.482800+0000","last_unstale":"2024-03-04T13:00:34.388528+0000","last_undegraded":"2024-03-04T13:00:34.388528+0000","last_fullsized":"2024-03-04T13:00:34.388528+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'8","last_scrub_stamp":"2024-03-04T13:00:34.388440+0000","last_deep_scrub":"256'8","last_deep_scrub_stamp":"2024-03-04T13:00:34.388440+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.388440+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:24.212679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'9","reported_seq":61,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.307581+0000","last_change":"2024-03-04T13:00:35.307629+0000","last_active":"2024-03-04T13:00:35.307581+0000","last_peered":"2024-03-04T13:00:35.307581+0000","last_clean":"2024-03-04T13:00:35.307581+0000","last_became_active":"2024-03-04T12:44:50.455937+0000","last_became_peered":"2024-03-04T12:44:50.455937+0000","last_unstale":"2024-03-04T13:00:35.307581+0000","last_undegraded":"2024-03-04T13:00:35.307581+0000","last_fullsized":"2024-03-04T13:00:35.307581+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:35.307447+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:35.307447+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.307447+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:52:38.354029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":7,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"256'148","reported_seq":399,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.394377+0000","last_change":"2024-03-04T13:00:24.394420+0000","last_active":"2024-03-04T13:00:24.394377+0000","last_peered":"2024-03-04T13:00:24.394377+0000","last_clean":"2024-03-04T13:00:24.394377+0000","last_became_active":"2024-03-04T12:43:27.065085+0000","last_became_peered":"2024-03-04T12:43:27.065085+0000","last_unstale":"2024-03-04T13:00:24.394377+0000","last_undegraded":"2024-03-04T13:00:24.394377+0000","last_fullsized":"2024-03-04T13:00:24.394377+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'148","last_scrub_stamp":"2024-03-04T13:00:24.394285+0000","last_deep_scrub":"256'148","last_deep_scrub_stamp":"2024-03-04T13:00:24.394285+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.394285+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:09:50.870191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":610,"num_read_kb":432,"num_write":236,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:41.017706+0000","last_change":"2024-03-04T12:51:01.353357+0000","last_active":"2024-03-04T12:59:41.017706+0000","last_peered":"2024-03-04T12:59:41.017706+0000","last_clean":"2024-03-04T12:59:41.017706+0000","last_became_active":"2024-03-04T12:51:01.353012+0000","last_became_peered":"2024-03-04T12:51:01.353012+0000","last_unstale":"2024-03-04T12:59:41.017706+0000","last_undegraded":"2024-03-04T12:59:41.017706+0000","last_fullsized":"2024-03-04T12:59:41.017706+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"256'6","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.371098+0000","last_change":"2024-03-04T12:44:53.484778+0000","last_active":"2024-03-04T13:00:16.371098+0000","last_peered":"2024-03-04T13:00:16.371098+0000","last_clean":"2024-03-04T13:00:16.371098+0000","last_became_active":"2024-03-04T12:44:53.484514+0000","last_became_peered":"2024-03-04T12:44:53.484514+0000","last_unstale":"2024-03-04T13:00:16.371098+0000","last_undegraded":"2024-03-04T13:00:16.371098+0000","last_fullsized":"2024-03-04T13:00:16.371098+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4138,"num_write":5,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"256'5","reported_seq":55,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.650563+0000","last_change":"2024-03-04T13:00:21.650563+0000","last_active":"2024-03-04T13:00:21.650563+0000","last_peered":"2024-03-04T13:00:21.650563+0000","last_clean":"2024-03-04T13:00:21.650563+0000","last_became_active":"2024-03-04T12:44:50.450101+0000","last_became_peered":"2024-03-04T12:44:50.450101+0000","last_unstale":"2024-03-04T13:00:21.650563+0000","last_undegraded":"2024-03-04T13:00:21.650563+0000","last_fullsized":"2024-03-04T13:00:21.650563+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'5","last_scrub_stamp":"2024-03-04T13:00:21.650477+0000","last_deep_scrub":"256'5","last_deep_scrub_stamp":"2024-03-04T13:00:21.650477+0000","last_clean_scrub_stamp":"2024-03-04T13:00:21.650477+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:03.543521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"256'27","reported_seq":108,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.162439+0000","last_change":"2024-03-04T13:00:47.162439+0000","last_active":"2024-03-04T13:00:47.162439+0000","last_peered":"2024-03-04T13:00:47.162439+0000","last_clean":"2024-03-04T13:00:47.162439+0000","last_became_active":"2024-03-04T12:43:27.067391+0000","last_became_peered":"2024-03-04T12:43:27.067391+0000","last_unstale":"2024-03-04T13:00:47.162439+0000","last_undegraded":"2024-03-04T13:00:47.162439+0000","last_fullsized":"2024-03-04T13:00:47.162439+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'27","last_scrub_stamp":"2024-03-04T13:00:47.162283+0000","last_deep_scrub":"256'27","last_deep_scrub_stamp":"2024-03-04T13:00:47.162283+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.162283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:34:22.350283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:45.901089+0000","last_change":"2024-03-04T12:51:01.352487+0000","last_active":"2024-03-04T12:59:45.901089+0000","last_peered":"2024-03-04T12:59:45.901089+0000","last_clean":"2024-03-04T12:59:45.901089+0000","last_became_active":"2024-03-04T12:51:01.352191+0000","last_became_peered":"2024-03-04T12:51:01.352191+0000","last_unstale":"2024-03-04T12:59:45.901089+0000","last_undegraded":"2024-03-04T12:59:45.901089+0000","last_fullsized":"2024-03-04T12:59:45.901089+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"256'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.094241+0000","last_change":"2024-03-04T12:44:53.482531+0000","last_active":"2024-03-04T13:00:23.094241+0000","last_peered":"2024-03-04T13:00:23.094241+0000","last_clean":"2024-03-04T13:00:23.094241+0000","last_became_active":"2024-03-04T12:44:53.482253+0000","last_became_peered":"2024-03-04T12:44:53.482253+0000","last_unstale":"2024-03-04T13:00:23.094241+0000","last_undegraded":"2024-03-04T13:00:23.094241+0000","last_fullsized":"2024-03-04T13:00:23.094241+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.881073+0000","last_change":"2024-03-04T13:00:24.881117+0000","last_active":"2024-03-04T13:00:24.881073+0000","last_peered":"2024-03-04T13:00:24.881073+0000","last_clean":"2024-03-04T13:00:24.881073+0000","last_became_active":"2024-03-04T12:44:50.449070+0000","last_became_peered":"2024-03-04T12:44:50.449070+0000","last_unstale":"2024-03-04T13:00:24.881073+0000","last_undegraded":"2024-03-04T13:00:24.881073+0000","last_fullsized":"2024-03-04T13:00:24.881073+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:24.880951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:24.880951+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.880951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:20:20.554220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"256'13","reported_seq":81,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.330260+0000","last_change":"2024-03-04T13:00:33.330260+0000","last_active":"2024-03-04T13:00:33.330260+0000","last_peered":"2024-03-04T13:00:33.330260+0000","last_clean":"2024-03-04T13:00:33.330260+0000","last_became_active":"2024-03-04T12:43:27.061574+0000","last_became_peered":"2024-03-04T12:43:27.061574+0000","last_unstale":"2024-03-04T13:00:33.330260+0000","last_undegraded":"2024-03-04T13:00:33.330260+0000","last_fullsized":"2024-03-04T13:00:33.330260+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'13","last_scrub_stamp":"2024-03-04T13:00:33.330135+0000","last_deep_scrub":"256'13","last_deep_scrub_stamp":"2024-03-04T13:00:33.330135+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.330135+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:29:30.807030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:01.000860+0000","last_change":"2024-03-04T12:51:01.356675+0000","last_active":"2024-03-04T13:00:01.000860+0000","last_peered":"2024-03-04T13:00:01.000860+0000","last_clean":"2024-03-04T13:00:01.000860+0000","last_became_active":"2024-03-04T12:51:01.356286+0000","last_became_peered":"2024-03-04T12:51:01.356286+0000","last_unstale":"2024-03-04T13:00:01.000860+0000","last_undegraded":"2024-03-04T13:00:01.000860+0000","last_fullsized":"2024-03-04T13:00:01.000860+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"256'6","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.485230+0000","last_change":"2024-03-04T13:00:46.485251+0000","last_active":"2024-03-04T13:00:46.485230+0000","last_peered":"2024-03-04T13:00:46.485230+0000","last_clean":"2024-03-04T13:00:46.485230+0000","last_became_active":"2024-03-04T12:44:53.477801+0000","last_became_peered":"2024-03-04T12:44:53.477801+0000","last_unstale":"2024-03-04T13:00:46.485230+0000","last_undegraded":"2024-03-04T13:00:46.485230+0000","last_fullsized":"2024-03-04T13:00:46.485230+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:46.485153+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:46.485153+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.485153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:53:42.381117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"256'4","reported_seq":53,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.751624+0000","last_change":"2024-03-04T13:00:38.751670+0000","last_active":"2024-03-04T13:00:38.751624+0000","last_peered":"2024-03-04T13:00:38.751624+0000","last_clean":"2024-03-04T13:00:38.751624+0000","last_became_active":"2024-03-04T12:44:50.456005+0000","last_became_peered":"2024-03-04T12:44:50.456005+0000","last_unstale":"2024-03-04T13:00:38.751624+0000","last_undegraded":"2024-03-04T13:00:38.751624+0000","last_fullsized":"2024-03-04T13:00:38.751624+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:38.751516+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:38.751516+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.751516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:09.546730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"256'19","reported_seq":94,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.842089+0000","last_change":"2024-03-04T13:00:29.842089+0000","last_active":"2024-03-04T13:00:29.842089+0000","last_peered":"2024-03-04T13:00:29.842089+0000","last_clean":"2024-03-04T13:00:29.842089+0000","last_became_active":"2024-03-04T12:43:27.054951+0000","last_became_peered":"2024-03-04T12:43:27.054951+0000","last_unstale":"2024-03-04T13:00:29.842089+0000","last_undegraded":"2024-03-04T13:00:29.842089+0000","last_fullsized":"2024-03-04T13:00:29.842089+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'19","last_scrub_stamp":"2024-03-04T13:00:29.841916+0000","last_deep_scrub":"256'19","last_deep_scrub_stamp":"2024-03-04T13:00:29.841916+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.841916+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:10.346801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":48,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:21.013563+0000","last_change":"2024-03-04T12:51:01.596612+0000","last_active":"2024-03-04T12:59:21.013563+0000","last_peered":"2024-03-04T12:59:21.013563+0000","last_clean":"2024-03-04T12:59:21.013563+0000","last_became_active":"2024-03-04T12:51:01.596248+0000","last_became_peered":"2024-03-04T12:51:01.596248+0000","last_unstale":"2024-03-04T12:59:21.013563+0000","last_undegraded":"2024-03-04T12:59:21.013563+0000","last_fullsized":"2024-03-04T12:59:21.013563+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.185690+0000","last_change":"2024-03-04T13:00:53.185713+0000","last_active":"2024-03-04T13:00:53.185690+0000","last_peered":"2024-03-04T13:00:53.185690+0000","last_clean":"2024-03-04T13:00:53.185690+0000","last_became_active":"2024-03-04T12:44:53.480987+0000","last_became_peered":"2024-03-04T12:44:53.480987+0000","last_unstale":"2024-03-04T13:00:53.185690+0000","last_undegraded":"2024-03-04T13:00:53.185690+0000","last_fullsized":"2024-03-04T13:00:53.185690+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:53.185558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:53.185558+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.185558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:25.573219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"256'4","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.644795+0000","last_change":"2024-03-04T13:00:57.644825+0000","last_active":"2024-03-04T13:00:57.644795+0000","last_peered":"2024-03-04T13:00:57.644795+0000","last_clean":"2024-03-04T13:00:57.644795+0000","last_became_active":"2024-03-04T12:44:50.455944+0000","last_became_peered":"2024-03-04T12:44:50.455944+0000","last_unstale":"2024-03-04T13:00:57.644795+0000","last_undegraded":"2024-03-04T13:00:57.644795+0000","last_fullsized":"2024-03-04T13:00:57.644795+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:57.644688+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:57.644688+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.644688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:34:47.602142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"256'15","reported_seq":88,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.306584+0000","last_change":"2024-03-04T13:00:31.306584+0000","last_active":"2024-03-04T13:00:31.306584+0000","last_peered":"2024-03-04T13:00:31.306584+0000","last_clean":"2024-03-04T13:00:31.306584+0000","last_became_active":"2024-03-04T12:43:27.060180+0000","last_became_peered":"2024-03-04T12:43:27.060180+0000","last_unstale":"2024-03-04T13:00:31.306584+0000","last_undegraded":"2024-03-04T13:00:31.306584+0000","last_fullsized":"2024-03-04T13:00:31.306584+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'15","last_scrub_stamp":"2024-03-04T13:00:31.306462+0000","last_deep_scrub":"256'15","last_deep_scrub_stamp":"2024-03-04T13:00:31.306462+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.306462+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:02.641888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:21.013593+0000","last_change":"2024-03-04T12:51:01.350629+0000","last_active":"2024-03-04T12:59:21.013593+0000","last_peered":"2024-03-04T12:59:21.013593+0000","last_clean":"2024-03-04T12:59:21.013593+0000","last_became_active":"2024-03-04T12:51:01.350349+0000","last_became_peered":"2024-03-04T12:51:01.350349+0000","last_unstale":"2024-03-04T12:59:21.013593+0000","last_undegraded":"2024-03-04T12:59:21.013593+0000","last_fullsized":"2024-03-04T12:59:21.013593+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"256'6","reported_seq":51,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.358277+0000","last_change":"2024-03-04T13:00:43.358320+0000","last_active":"2024-03-04T13:00:43.358277+0000","last_peered":"2024-03-04T13:00:43.358277+0000","last_clean":"2024-03-04T13:00:43.358277+0000","last_became_active":"2024-03-04T12:44:53.485429+0000","last_became_peered":"2024-03-04T12:44:53.485429+0000","last_unstale":"2024-03-04T13:00:43.358277+0000","last_undegraded":"2024-03-04T13:00:43.358277+0000","last_fullsized":"2024-03-04T13:00:43.358277+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:43.358174+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:43.358174+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.358174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:46.298234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"256'6","reported_seq":58,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.607925+0000","last_change":"2024-03-04T13:00:30.607966+0000","last_active":"2024-03-04T13:00:30.607925+0000","last_peered":"2024-03-04T13:00:30.607925+0000","last_clean":"2024-03-04T13:00:30.607925+0000","last_became_active":"2024-03-04T12:44:50.452611+0000","last_became_peered":"2024-03-04T12:44:50.452611+0000","last_unstale":"2024-03-04T13:00:30.607925+0000","last_undegraded":"2024-03-04T13:00:30.607925+0000","last_fullsized":"2024-03-04T13:00:30.607925+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:30.607817+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:30.607817+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.607817+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:57.889690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"256'20","reported_seq":101,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.270359+0000","last_change":"2024-03-04T13:00:29.270359+0000","last_active":"2024-03-04T13:00:29.270359+0000","last_peered":"2024-03-04T13:00:29.270359+0000","last_clean":"2024-03-04T13:00:29.270359+0000","last_became_active":"2024-03-04T12:43:27.064375+0000","last_became_peered":"2024-03-04T12:43:27.064375+0000","last_unstale":"2024-03-04T13:00:29.270359+0000","last_undegraded":"2024-03-04T13:00:29.270359+0000","last_fullsized":"2024-03-04T13:00:29.270359+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'20","last_scrub_stamp":"2024-03-04T13:00:29.270196+0000","last_deep_scrub":"256'20","last_deep_scrub_stamp":"2024-03-04T13:00:29.270196+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.270196+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:33:53.986271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":61,"num_write":47,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"252'1","reported_seq":24,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:41.017834+0000","last_change":"2024-03-04T12:51:01.350196+0000","last_active":"2024-03-04T12:59:41.017834+0000","last_peered":"2024-03-04T12:59:41.017834+0000","last_clean":"2024-03-04T12:59:41.017834+0000","last_became_active":"2024-03-04T12:51:01.349889+0000","last_became_peered":"2024-03-04T12:51:01.349889+0000","last_unstale":"2024-03-04T12:59:41.017834+0000","last_undegraded":"2024-03-04T12:59:41.017834+0000","last_fullsized":"2024-03-04T12:59:41.017834+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"256'2","reported_seq":35,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.966225+0000","last_change":"2024-03-04T12:44:53.489468+0000","last_active":"2024-03-04T13:00:16.966225+0000","last_peered":"2024-03-04T13:00:16.966225+0000","last_clean":"2024-03-04T13:00:16.966225+0000","last_became_active":"2024-03-04T12:44:53.489232+0000","last_became_peered":"2024-03-04T12:44:53.489232+0000","last_unstale":"2024-03-04T13:00:16.966225+0000","last_undegraded":"2024-03-04T13:00:16.966225+0000","last_fullsized":"2024-03-04T13:00:16.966225+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.377159+0000","last_change":"2024-03-04T13:00:26.377182+0000","last_active":"2024-03-04T13:00:26.377159+0000","last_peered":"2024-03-04T13:00:26.377159+0000","last_clean":"2024-03-04T13:00:26.377159+0000","last_became_active":"2024-03-04T12:44:50.459359+0000","last_became_peered":"2024-03-04T12:44:50.459359+0000","last_unstale":"2024-03-04T13:00:26.377159+0000","last_undegraded":"2024-03-04T13:00:26.377159+0000","last_fullsized":"2024-03-04T13:00:26.377159+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:26.377070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:26.377070+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.377070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:23.336645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"256'25","reported_seq":115,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.519803+0000","last_change":"2024-03-04T13:00:28.519828+0000","last_active":"2024-03-04T13:00:28.519803+0000","last_peered":"2024-03-04T13:00:28.519803+0000","last_clean":"2024-03-04T13:00:28.519803+0000","last_became_active":"2024-03-04T12:43:27.060115+0000","last_became_peered":"2024-03-04T12:43:27.060115+0000","last_unstale":"2024-03-04T13:00:28.519803+0000","last_undegraded":"2024-03-04T13:00:28.519803+0000","last_fullsized":"2024-03-04T13:00:28.519803+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'25","last_scrub_stamp":"2024-03-04T13:00:28.519719+0000","last_deep_scrub":"256'25","last_deep_scrub_stamp":"2024-03-04T13:00:28.519719+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.519719+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:26.466728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:40.900395+0000","last_change":"2024-03-04T12:51:01.596756+0000","last_active":"2024-03-04T12:59:40.900395+0000","last_peered":"2024-03-04T12:59:40.900395+0000","last_clean":"2024-03-04T12:59:40.900395+0000","last_became_active":"2024-03-04T12:51:01.596463+0000","last_became_peered":"2024-03-04T12:51:01.596463+0000","last_unstale":"2024-03-04T12:59:40.900395+0000","last_undegraded":"2024-03-04T12:59:40.900395+0000","last_fullsized":"2024-03-04T12:59:40.900395+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"256'6","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.373630+0000","last_change":"2024-03-04T12:44:53.479417+0000","last_active":"2024-03-04T13:00:16.373630+0000","last_peered":"2024-03-04T13:00:16.373630+0000","last_clean":"2024-03-04T13:00:16.373630+0000","last_became_active":"2024-03-04T12:44:53.479076+0000","last_became_peered":"2024-03-04T12:44:53.479076+0000","last_unstale":"2024-03-04T13:00:16.373630+0000","last_undegraded":"2024-03-04T13:00:16.373630+0000","last_fullsized":"2024-03-04T13:00:16.373630+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"256'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.266006+0000","last_change":"2024-03-04T13:00:27.266052+0000","last_active":"2024-03-04T13:00:27.266006+0000","last_peered":"2024-03-04T13:00:27.266006+0000","last_clean":"2024-03-04T13:00:27.266006+0000","last_became_active":"2024-03-04T12:44:50.454398+0000","last_became_peered":"2024-03-04T12:44:50.454398+0000","last_unstale":"2024-03-04T13:00:27.266006+0000","last_undegraded":"2024-03-04T13:00:27.266006+0000","last_fullsized":"2024-03-04T13:00:27.266006+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:27.265871+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:27.265871+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.265871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:12:37.304071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"256'33","reported_seq":126,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.266710+0000","last_change":"2024-03-04T13:00:32.266736+0000","last_active":"2024-03-04T13:00:32.266710+0000","last_peered":"2024-03-04T13:00:32.266710+0000","last_clean":"2024-03-04T13:00:32.266710+0000","last_became_active":"2024-03-04T12:43:27.060589+0000","last_became_peered":"2024-03-04T12:43:27.060589+0000","last_unstale":"2024-03-04T13:00:32.266710+0000","last_undegraded":"2024-03-04T13:00:32.266710+0000","last_fullsized":"2024-03-04T13:00:32.266710+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'33","last_scrub_stamp":"2024-03-04T13:00:32.266584+0000","last_deep_scrub":"256'33","last_deep_scrub_stamp":"2024-03-04T13:00:32.266584+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.266584+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:51:33.406291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":90,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":24,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.560446+0000","last_change":"2024-03-04T12:51:01.357439+0000","last_active":"2024-03-04T13:00:23.560446+0000","last_peered":"2024-03-04T13:00:23.560446+0000","last_clean":"2024-03-04T13:00:23.560446+0000","last_became_active":"2024-03-04T12:51:01.355416+0000","last_became_peered":"2024-03-04T12:51:01.355416+0000","last_unstale":"2024-03-04T13:00:23.560446+0000","last_undegraded":"2024-03-04T13:00:23.560446+0000","last_fullsized":"2024-03-04T13:00:23.560446+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"256'2","reported_seq":36,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:15.494462+0000","last_change":"2024-03-04T12:44:53.486527+0000","last_active":"2024-03-04T13:00:15.494462+0000","last_peered":"2024-03-04T13:00:15.494462+0000","last_clean":"2024-03-04T13:00:15.494462+0000","last_became_active":"2024-03-04T12:44:53.486235+0000","last_became_peered":"2024-03-04T12:44:53.486235+0000","last_unstale":"2024-03-04T13:00:15.494462+0000","last_undegraded":"2024-03-04T13:00:15.494462+0000","last_fullsized":"2024-03-04T13:00:15.494462+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"256'7","reported_seq":57,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.126064+0000","last_change":"2024-03-04T13:00:28.126118+0000","last_active":"2024-03-04T13:00:28.126064+0000","last_peered":"2024-03-04T13:00:28.126064+0000","last_clean":"2024-03-04T13:00:28.126064+0000","last_became_active":"2024-03-04T12:44:50.458610+0000","last_became_peered":"2024-03-04T12:44:50.458610+0000","last_unstale":"2024-03-04T13:00:28.126064+0000","last_undegraded":"2024-03-04T13:00:28.126064+0000","last_fullsized":"2024-03-04T13:00:28.126064+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:00:28.125955+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:00:28.125955+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.125955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:00.483454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7739,"num_write":12,"num_write_kb":7739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"256'17","reported_seq":88,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.665270+0000","last_change":"2024-03-04T13:00:24.665292+0000","last_active":"2024-03-04T13:00:24.665270+0000","last_peered":"2024-03-04T13:00:24.665270+0000","last_clean":"2024-03-04T13:00:24.665270+0000","last_became_active":"2024-03-04T12:43:27.067223+0000","last_became_peered":"2024-03-04T12:43:27.067223+0000","last_unstale":"2024-03-04T13:00:24.665270+0000","last_undegraded":"2024-03-04T13:00:24.665270+0000","last_fullsized":"2024-03-04T13:00:24.665270+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'17","last_scrub_stamp":"2024-03-04T13:00:24.665191+0000","last_deep_scrub":"256'17","last_deep_scrub_stamp":"2024-03-04T13:00:24.665191+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.665191+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:39.414488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":41,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:20.996344+0000","last_change":"2024-03-04T12:51:01.353788+0000","last_active":"2024-03-04T12:59:20.996344+0000","last_peered":"2024-03-04T12:59:20.996344+0000","last_clean":"2024-03-04T12:59:20.996344+0000","last_became_active":"2024-03-04T12:51:01.353432+0000","last_became_peered":"2024-03-04T12:51:01.353432+0000","last_unstale":"2024-03-04T12:59:20.996344+0000","last_undegraded":"2024-03-04T12:59:20.996344+0000","last_fullsized":"2024-03-04T12:59:20.996344+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"250'2","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.252491+0000","last_change":"2024-03-04T13:00:39.252491+0000","last_active":"2024-03-04T13:00:39.252491+0000","last_peered":"2024-03-04T13:00:39.252491+0000","last_clean":"2024-03-04T13:00:39.252491+0000","last_became_active":"2024-03-04T12:44:53.482370+0000","last_became_peered":"2024-03-04T12:44:53.482370+0000","last_unstale":"2024-03-04T13:00:39.252491+0000","last_undegraded":"2024-03-04T13:00:39.252491+0000","last_fullsized":"2024-03-04T13:00:39.252491+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:39.252370+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:39.252370+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.252370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:34.221417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"256'4","reported_seq":53,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.342117+0000","last_change":"2024-03-04T13:00:40.342144+0000","last_active":"2024-03-04T13:00:40.342117+0000","last_peered":"2024-03-04T13:00:40.342117+0000","last_clean":"2024-03-04T13:00:40.342117+0000","last_became_active":"2024-03-04T12:44:50.450681+0000","last_became_peered":"2024-03-04T12:44:50.450681+0000","last_unstale":"2024-03-04T13:00:40.342117+0000","last_undegraded":"2024-03-04T13:00:40.342117+0000","last_fullsized":"2024-03-04T13:00:40.342117+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:40.342026+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:40.342026+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.342026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:02.619334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":368,"num_write":4,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"256'61","reported_seq":205,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.795512+0000","last_change":"2024-03-04T13:00:28.795546+0000","last_active":"2024-03-04T13:00:28.795512+0000","last_peered":"2024-03-04T13:00:28.795512+0000","last_clean":"2024-03-04T13:00:28.795512+0000","last_became_active":"2024-03-04T12:43:27.056781+0000","last_became_peered":"2024-03-04T12:43:27.056781+0000","last_unstale":"2024-03-04T13:00:28.795512+0000","last_undegraded":"2024-03-04T13:00:28.795512+0000","last_fullsized":"2024-03-04T13:00:28.795512+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'61","last_scrub_stamp":"2024-03-04T13:00:28.795405+0000","last_deep_scrub":"256'61","last_deep_scrub_stamp":"2024-03-04T13:00:28.795405+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.795405+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:36.779728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":203,"num_write":94,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:21.014357+0000","last_change":"2024-03-04T12:51:01.349501+0000","last_active":"2024-03-04T12:59:21.014357+0000","last_peered":"2024-03-04T12:59:21.014357+0000","last_clean":"2024-03-04T12:59:21.014357+0000","last_became_active":"2024-03-04T12:51:01.349216+0000","last_became_peered":"2024-03-04T12:51:01.349216+0000","last_unstale":"2024-03-04T12:59:21.014357+0000","last_undegraded":"2024-03-04T12:59:21.014357+0000","last_fullsized":"2024-03-04T12:59:21.014357+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.649362+0000","last_change":"2024-03-04T13:00:58.649404+0000","last_active":"2024-03-04T13:00:58.649362+0000","last_peered":"2024-03-04T13:00:58.649362+0000","last_clean":"2024-03-04T13:00:58.649362+0000","last_became_active":"2024-03-04T12:44:53.479411+0000","last_became_peered":"2024-03-04T12:44:53.479411+0000","last_unstale":"2024-03-04T13:00:58.649362+0000","last_undegraded":"2024-03-04T13:00:58.649362+0000","last_fullsized":"2024-03-04T13:00:58.649362+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:58.649256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:58.649256+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.649256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:20.808929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'5","reported_seq":56,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.248147+0000","last_change":"2024-03-04T13:00:26.248147+0000","last_active":"2024-03-04T13:00:26.248147+0000","last_peered":"2024-03-04T13:00:26.248147+0000","last_clean":"2024-03-04T13:00:26.248147+0000","last_became_active":"2024-03-04T12:44:50.451626+0000","last_became_peered":"2024-03-04T12:44:50.451626+0000","last_unstale":"2024-03-04T13:00:26.248147+0000","last_undegraded":"2024-03-04T13:00:26.248147+0000","last_fullsized":"2024-03-04T13:00:26.248147+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'5","last_scrub_stamp":"2024-03-04T13:00:26.248033+0000","last_deep_scrub":"256'5","last_deep_scrub_stamp":"2024-03-04T13:00:26.248033+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.248033+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:13:53.495710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"256'128","reported_seq":415,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.484418+0000","last_change":"2024-03-04T13:00:25.484470+0000","last_active":"2024-03-04T13:00:25.484418+0000","last_peered":"2024-03-04T13:00:25.484418+0000","last_clean":"2024-03-04T13:00:25.484418+0000","last_became_active":"2024-03-04T12:43:27.056007+0000","last_became_peered":"2024-03-04T12:43:27.056007+0000","last_unstale":"2024-03-04T13:00:25.484418+0000","last_undegraded":"2024-03-04T13:00:25.484418+0000","last_fullsized":"2024-03-04T13:00:25.484418+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'128","last_scrub_stamp":"2024-03-04T13:00:25.484311+0000","last_deep_scrub":"256'128","last_deep_scrub_stamp":"2024-03-04T13:00:25.484311+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.484311+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:29.733934+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":540,"num_write":158,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3984,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:21.004177+0000","last_change":"2024-03-04T12:51:01.354894+0000","last_active":"2024-03-04T12:59:21.004177+0000","last_peered":"2024-03-04T12:59:21.004177+0000","last_clean":"2024-03-04T12:59:21.004177+0000","last_became_active":"2024-03-04T12:51:01.354601+0000","last_became_peered":"2024-03-04T12:51:01.354601+0000","last_unstale":"2024-03-04T12:59:21.004177+0000","last_undegraded":"2024-03-04T12:59:21.004177+0000","last_fullsized":"2024-03-04T12:59:21.004177+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.997585+0000","last_change":"2024-03-04T12:44:53.486591+0000","last_active":"2024-03-04T12:59:30.997585+0000","last_peered":"2024-03-04T12:59:30.997585+0000","last_clean":"2024-03-04T12:59:30.997585+0000","last_became_active":"2024-03-04T12:44:53.486321+0000","last_became_peered":"2024-03-04T12:44:53.486321+0000","last_unstale":"2024-03-04T12:59:30.997585+0000","last_undegraded":"2024-03-04T12:59:30.997585+0000","last_fullsized":"2024-03-04T12:59:30.997585+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:44:52.452363+0000","last_clean_scrub_stamp":"2024-03-04T12:44:52.452363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"250'2","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.800909+0000","last_change":"2024-03-04T13:00:30.800957+0000","last_active":"2024-03-04T13:00:30.800909+0000","last_peered":"2024-03-04T13:00:30.800909+0000","last_clean":"2024-03-04T13:00:30.800909+0000","last_became_active":"2024-03-04T12:44:50.456315+0000","last_became_peered":"2024-03-04T12:44:50.456315+0000","last_unstale":"2024-03-04T13:00:30.800909+0000","last_undegraded":"2024-03-04T13:00:30.800909+0000","last_fullsized":"2024-03-04T13:00:30.800909+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:30.800805+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:30.800805+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.800805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:08:28.741353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"256'28","reported_seq":113,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.336331+0000","last_change":"2024-03-04T13:00:35.336372+0000","last_active":"2024-03-04T13:00:35.336331+0000","last_peered":"2024-03-04T13:00:35.336331+0000","last_clean":"2024-03-04T13:00:35.336331+0000","last_became_active":"2024-03-04T12:43:27.064141+0000","last_became_peered":"2024-03-04T12:43:27.064141+0000","last_unstale":"2024-03-04T13:00:35.336331+0000","last_undegraded":"2024-03-04T13:00:35.336331+0000","last_fullsized":"2024-03-04T13:00:35.336331+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'28","last_scrub_stamp":"2024-03-04T13:00:35.336234+0000","last_deep_scrub":"256'28","last_deep_scrub_stamp":"2024-03-04T13:00:35.336234+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.336234+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:07.884382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"256'416","reported_seq":1071,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.315398+0000","last_change":"2024-03-04T13:00:27.315458+0000","last_active":"2024-03-04T13:00:27.315398+0000","last_peered":"2024-03-04T13:00:27.315398+0000","last_clean":"2024-03-04T13:00:27.315398+0000","last_became_active":"2024-03-04T12:36:40.392399+0000","last_became_peered":"2024-03-04T12:36:40.392399+0000","last_unstale":"2024-03-04T13:00:27.315398+0000","last_undegraded":"2024-03-04T13:00:27.315398+0000","last_fullsized":"2024-03-04T13:00:27.315398+0000","mapping_epoch":33,"log_start":"256'401","ondisk_log_start":"256'401","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'416","last_scrub_stamp":"2024-03-04T13:00:27.315312+0000","last_deep_scrub":"256'416","last_deep_scrub_stamp":"2024-03-04T13:00:27.315312+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.315312+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":401,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:33.045930+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194364,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":637,"num_read_kb":17405,"num_write":1486,"num_write_kb":42784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"256'1113","reported_seq":2705,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.276188+0000","last_change":"2024-03-04T13:00:47.276221+0000","last_active":"2024-03-04T13:00:47.276188+0000","last_peered":"2024-03-04T13:00:47.276188+0000","last_clean":"2024-03-04T13:00:47.276188+0000","last_became_active":"2024-03-04T12:36:07.295125+0000","last_became_peered":"2024-03-04T12:36:07.295125+0000","last_unstale":"2024-03-04T13:00:47.276188+0000","last_undegraded":"2024-03-04T13:00:47.276188+0000","last_fullsized":"2024-03-04T13:00:47.276188+0000","mapping_epoch":22,"log_start":"256'1101","ondisk_log_start":"256'1101","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1113","last_scrub_stamp":"2024-03-04T13:00:47.276097+0000","last_deep_scrub":"256'1113","last_deep_scrub_stamp":"2024-03-04T13:00:47.276097+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.276097+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":1101,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:52.753715+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4869,"num_read_kb":4281,"num_write":1536,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2397,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"256'322","reported_seq":926,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.398525+0000","last_change":"2024-03-04T13:00:56.398598+0000","last_active":"2024-03-04T13:00:56.398525+0000","last_peered":"2024-03-04T13:00:56.398525+0000","last_clean":"2024-03-04T13:00:56.398525+0000","last_became_active":"2024-03-04T12:36:05.280695+0000","last_became_peered":"2024-03-04T12:36:05.280695+0000","last_unstale":"2024-03-04T13:00:56.398525+0000","last_undegraded":"2024-03-04T13:00:56.398525+0000","last_fullsized":"2024-03-04T13:00:56.398525+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'322","last_scrub_stamp":"2024-03-04T13:00:56.398408+0000","last_deep_scrub":"256'322","last_deep_scrub_stamp":"2024-03-04T13:00:56.398408+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.398408+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:31:05.991675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256487,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":427,"num_read_kb":2412,"num_write":1141,"num_write_kb":20516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"256'544","reported_seq":1946,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.371759+0000","last_change":"2024-03-04T13:00:46.371823+0000","last_active":"2024-03-04T13:00:46.371759+0000","last_peered":"2024-03-04T13:00:46.371759+0000","last_clean":"2024-03-04T13:00:46.371759+0000","last_became_active":"2024-03-04T12:36:07.296651+0000","last_became_peered":"2024-03-04T12:36:07.296651+0000","last_unstale":"2024-03-04T13:00:46.371759+0000","last_undegraded":"2024-03-04T13:00:46.371759+0000","last_fullsized":"2024-03-04T13:00:46.371759+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'544","last_scrub_stamp":"2024-03-04T13:00:46.371662+0000","last_deep_scrub":"256'544","last_deep_scrub_stamp":"2024-03-04T13:00:46.371662+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.371662+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:04.839309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2661,"num_read_kb":2496,"num_write":771,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"256'328","reported_seq":932,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.123923+0000","last_change":"2024-03-04T12:36:05.285321+0000","last_active":"2024-03-04T13:00:17.123923+0000","last_peered":"2024-03-04T13:00:17.123923+0000","last_clean":"2024-03-04T13:00:17.123923+0000","last_became_active":"2024-03-04T12:36:05.285054+0000","last_became_peered":"2024-03-04T12:36:05.285054+0000","last_unstale":"2024-03-04T13:00:17.123923+0000","last_undegraded":"2024-03-04T13:00:17.123923+0000","last_fullsized":"2024-03-04T13:00:17.123923+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695847,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":27372,"num_write":1039,"num_write_kb":18696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"256'596","reported_seq":2025,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.065419+0000","last_change":"2024-03-04T13:00:44.065447+0000","last_active":"2024-03-04T13:00:44.065419+0000","last_peered":"2024-03-04T13:00:44.065419+0000","last_clean":"2024-03-04T13:00:44.065419+0000","last_became_active":"2024-03-04T12:36:07.298528+0000","last_became_peered":"2024-03-04T12:36:07.298528+0000","last_unstale":"2024-03-04T13:00:44.065419+0000","last_undegraded":"2024-03-04T13:00:44.065419+0000","last_fullsized":"2024-03-04T13:00:44.065419+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'596","last_scrub_stamp":"2024-03-04T13:00:44.065329+0000","last_deep_scrub":"256'596","last_deep_scrub_stamp":"2024-03-04T13:00:44.065329+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.065329+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:31:28.355176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2805,"num_read_kb":2500,"num_write":805,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":978,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"256'341","reported_seq":954,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.122087+0000","last_change":"2024-03-04T12:36:05.294821+0000","last_active":"2024-03-04T13:00:17.122087+0000","last_peered":"2024-03-04T13:00:17.122087+0000","last_clean":"2024-03-04T13:00:17.122087+0000","last_became_active":"2024-03-04T12:36:05.293768+0000","last_became_peered":"2024-03-04T12:36:05.293768+0000","last_unstale":"2024-03-04T13:00:17.122087+0000","last_undegraded":"2024-03-04T13:00:17.122087+0000","last_fullsized":"2024-03-04T13:00:17.122087+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436929,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":443,"num_read_kb":31950,"num_write":1089,"num_write_kb":37939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"256'778","reported_seq":2184,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.593025+0000","last_change":"2024-03-04T13:00:29.593056+0000","last_active":"2024-03-04T13:00:29.593025+0000","last_peered":"2024-03-04T13:00:29.593025+0000","last_clean":"2024-03-04T13:00:29.593025+0000","last_became_active":"2024-03-04T12:36:40.393715+0000","last_became_peered":"2024-03-04T12:36:40.393715+0000","last_unstale":"2024-03-04T13:00:29.593025+0000","last_undegraded":"2024-03-04T13:00:29.593025+0000","last_fullsized":"2024-03-04T13:00:29.593025+0000","mapping_epoch":33,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'778","last_scrub_stamp":"2024-03-04T13:00:29.592929+0000","last_deep_scrub":"256'778","last_deep_scrub_stamp":"2024-03-04T13:00:29.592929+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.592929+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:11:41.602243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3436,"num_read_kb":3037,"num_write":1058,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"256'377","reported_seq":1013,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.069712+0000","last_change":"2024-03-04T12:36:05.290798+0000","last_active":"2024-03-04T13:00:17.069712+0000","last_peered":"2024-03-04T13:00:17.069712+0000","last_clean":"2024-03-04T13:00:17.069712+0000","last_became_active":"2024-03-04T12:36:05.290178+0000","last_became_peered":"2024-03-04T12:36:05.290178+0000","last_unstale":"2024-03-04T13:00:17.069712+0000","last_undegraded":"2024-03-04T13:00:17.069712+0000","last_fullsized":"2024-03-04T13:00:17.069712+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":589,"num_read_kb":36032,"num_write":1373,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"256'376","reported_seq":1932,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.770394+0000","last_change":"2024-03-04T13:00:41.770487+0000","last_active":"2024-03-04T13:00:41.770394+0000","last_peered":"2024-03-04T13:00:41.770394+0000","last_clean":"2024-03-04T13:00:41.770394+0000","last_became_active":"2024-03-04T12:36:07.301582+0000","last_became_peered":"2024-03-04T12:36:07.301582+0000","last_unstale":"2024-03-04T13:00:41.770394+0000","last_undegraded":"2024-03-04T13:00:41.770394+0000","last_fullsized":"2024-03-04T13:00:41.770394+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'376","last_scrub_stamp":"2024-03-04T13:00:41.770289+0000","last_deep_scrub":"256'376","last_deep_scrub_stamp":"2024-03-04T13:00:41.770289+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.770289+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:23:34.715892+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2123,"num_read_kb":2049,"num_write":405,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"256'299","reported_seq":916,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.223116+0000","last_change":"2024-03-04T13:00:53.223170+0000","last_active":"2024-03-04T13:00:53.223116+0000","last_peered":"2024-03-04T13:00:53.223116+0000","last_clean":"2024-03-04T13:00:53.223116+0000","last_became_active":"2024-03-04T12:36:05.296284+0000","last_became_peered":"2024-03-04T12:36:05.296284+0000","last_unstale":"2024-03-04T13:00:53.223116+0000","last_undegraded":"2024-03-04T13:00:53.223116+0000","last_fullsized":"2024-03-04T13:00:53.223116+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'299","last_scrub_stamp":"2024-03-04T13:00:53.223035+0000","last_deep_scrub":"256'299","last_deep_scrub_stamp":"2024-03-04T13:00:53.223035+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.223035+0000","objects_scrubbed":11,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:30:50.876472+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3348453,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":381,"num_read_kb":80579,"num_write":950,"num_write_kb":32166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"256'780","reported_seq":2031,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.091732+0000","last_change":"2024-03-04T13:00:43.091761+0000","last_active":"2024-03-04T13:00:43.091732+0000","last_peered":"2024-03-04T13:00:43.091732+0000","last_clean":"2024-03-04T13:00:43.091732+0000","last_became_active":"2024-03-04T12:36:07.297953+0000","last_became_peered":"2024-03-04T12:36:07.297953+0000","last_unstale":"2024-03-04T13:00:43.091732+0000","last_undegraded":"2024-03-04T13:00:43.091732+0000","last_fullsized":"2024-03-04T13:00:43.091732+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'780","last_scrub_stamp":"2024-03-04T13:00:43.091629+0000","last_deep_scrub":"256'780","last_deep_scrub_stamp":"2024-03-04T13:00:43.091629+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.091629+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:31.459229+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3335,"num_read_kb":2888,"num_write":1111,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1185,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"256'309","reported_seq":1023,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.117581+0000","last_change":"2024-03-04T12:36:05.291622+0000","last_active":"2024-03-04T13:00:17.117581+0000","last_peered":"2024-03-04T13:00:17.117581+0000","last_clean":"2024-03-04T13:00:17.117581+0000","last_became_active":"2024-03-04T12:36:05.291041+0000","last_became_peered":"2024-03-04T12:36:05.291041+0000","last_unstale":"2024-03-04T13:00:17.117581+0000","last_undegraded":"2024-03-04T13:00:17.117581+0000","last_fullsized":"2024-03-04T13:00:17.117581+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2107533,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":775,"num_read_kb":12113,"num_write":1137,"num_write_kb":11806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"256'692","reported_seq":2100,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.378827+0000","last_change":"2024-03-04T13:00:43.378858+0000","last_active":"2024-03-04T13:00:43.378827+0000","last_peered":"2024-03-04T13:00:43.378827+0000","last_clean":"2024-03-04T13:00:43.378827+0000","last_became_active":"2024-03-04T12:36:07.296763+0000","last_became_peered":"2024-03-04T12:36:07.296763+0000","last_unstale":"2024-03-04T13:00:43.378827+0000","last_undegraded":"2024-03-04T13:00:43.378827+0000","last_fullsized":"2024-03-04T13:00:43.378827+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'692","last_scrub_stamp":"2024-03-04T13:00:43.378717+0000","last_deep_scrub":"256'692","last_deep_scrub_stamp":"2024-03-04T13:00:43.378717+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.378717+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:30.590272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3139,"num_read_kb":2812,"num_write":915,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"256'291","reported_seq":894,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.112697+0000","last_change":"2024-03-04T12:36:05.295212+0000","last_active":"2024-03-04T13:00:17.112697+0000","last_peered":"2024-03-04T13:00:17.112697+0000","last_clean":"2024-03-04T13:00:17.112697+0000","last_became_active":"2024-03-04T12:36:05.294967+0000","last_became_peered":"2024-03-04T12:36:05.294967+0000","last_unstale":"2024-03-04T13:00:17.112697+0000","last_undegraded":"2024-03-04T13:00:17.112697+0000","last_fullsized":"2024-03-04T13:00:17.112697+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1332404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":383,"num_read_kb":71068,"num_write":934,"num_write_kb":54955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"256'784","reported_seq":2205,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.145095+0000","last_change":"2024-03-04T13:00:46.145118+0000","last_active":"2024-03-04T13:00:46.145095+0000","last_peered":"2024-03-04T13:00:46.145095+0000","last_clean":"2024-03-04T13:00:46.145095+0000","last_became_active":"2024-03-04T12:36:07.295530+0000","last_became_peered":"2024-03-04T12:36:07.295530+0000","last_unstale":"2024-03-04T13:00:46.145095+0000","last_undegraded":"2024-03-04T13:00:46.145095+0000","last_fullsized":"2024-03-04T13:00:46.145095+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'784","last_scrub_stamp":"2024-03-04T13:00:46.145023+0000","last_deep_scrub":"256'784","last_deep_scrub_stamp":"2024-03-04T13:00:46.145023+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.145023+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:19.897333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3415,"num_read_kb":3026,"num_write":1069,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":949,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"256'352","reported_seq":1816,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.055009+0000","last_change":"2024-03-04T13:00:46.055064+0000","last_active":"2024-03-04T13:00:46.055009+0000","last_peered":"2024-03-04T13:00:46.055009+0000","last_clean":"2024-03-04T13:00:46.055009+0000","last_became_active":"2024-03-04T12:36:07.298539+0000","last_became_peered":"2024-03-04T12:36:07.298539+0000","last_unstale":"2024-03-04T13:00:46.055009+0000","last_undegraded":"2024-03-04T13:00:46.055009+0000","last_fullsized":"2024-03-04T13:00:46.055009+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'352","last_scrub_stamp":"2024-03-04T13:00:46.054880+0000","last_deep_scrub":"256'352","last_deep_scrub_stamp":"2024-03-04T13:00:46.054880+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.054880+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:46.051533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1997,"num_read_kb":1912,"num_write":401,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"256'351","reported_seq":1051,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.243539+0000","last_change":"2024-03-04T13:00:58.243622+0000","last_active":"2024-03-04T13:00:58.243539+0000","last_peered":"2024-03-04T13:00:58.243539+0000","last_clean":"2024-03-04T13:00:58.243539+0000","last_became_active":"2024-03-04T12:36:05.295060+0000","last_became_peered":"2024-03-04T12:36:05.295060+0000","last_unstale":"2024-03-04T13:00:58.243539+0000","last_undegraded":"2024-03-04T13:00:58.243539+0000","last_fullsized":"2024-03-04T13:00:58.243539+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'351","last_scrub_stamp":"2024-03-04T13:00:58.243436+0000","last_deep_scrub":"256'351","last_deep_scrub_stamp":"2024-03-04T13:00:58.243436+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.243436+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:50:36.386385+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2255527,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":26330,"num_write":1306,"num_write_kb":36495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"256'328","reported_seq":1798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.335909+0000","last_change":"2024-03-04T13:00:45.335937+0000","last_active":"2024-03-04T13:00:45.335909+0000","last_peered":"2024-03-04T13:00:45.335909+0000","last_clean":"2024-03-04T13:00:45.335909+0000","last_became_active":"2024-03-04T12:36:07.300270+0000","last_became_peered":"2024-03-04T12:36:07.300270+0000","last_unstale":"2024-03-04T13:00:45.335909+0000","last_undegraded":"2024-03-04T13:00:45.335909+0000","last_fullsized":"2024-03-04T13:00:45.335909+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'328","last_scrub_stamp":"2024-03-04T13:00:45.335832+0000","last_deep_scrub":"256'328","last_deep_scrub_stamp":"2024-03-04T13:00:45.335832+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.335832+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:00:58.473041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2015,"num_read_kb":1950,"num_write":359,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"256'291","reported_seq":890,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.626384+0000","last_change":"2024-03-04T13:00:55.626435+0000","last_active":"2024-03-04T13:00:55.626384+0000","last_peered":"2024-03-04T13:00:55.626384+0000","last_clean":"2024-03-04T13:00:55.626384+0000","last_became_active":"2024-03-04T12:36:05.296621+0000","last_became_peered":"2024-03-04T12:36:05.296621+0000","last_unstale":"2024-03-04T13:00:55.626384+0000","last_undegraded":"2024-03-04T13:00:55.626384+0000","last_fullsized":"2024-03-04T13:00:55.626384+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'291","last_scrub_stamp":"2024-03-04T13:00:55.626282+0000","last_deep_scrub":"256'291","last_deep_scrub_stamp":"2024-03-04T13:00:55.626282+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.626282+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:06:30.482147+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":406,"num_read_kb":30709,"num_write":973,"num_write_kb":28664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"256'402","reported_seq":1893,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.197550+0000","last_change":"2024-03-04T13:00:51.197615+0000","last_active":"2024-03-04T13:00:51.197550+0000","last_peered":"2024-03-04T13:00:51.197550+0000","last_clean":"2024-03-04T13:00:51.197550+0000","last_became_active":"2024-03-04T12:36:07.293952+0000","last_became_peered":"2024-03-04T12:36:07.293952+0000","last_unstale":"2024-03-04T13:00:51.197550+0000","last_undegraded":"2024-03-04T13:00:51.197550+0000","last_fullsized":"2024-03-04T13:00:51.197550+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'402","last_scrub_stamp":"2024-03-04T13:00:51.197457+0000","last_deep_scrub":"256'402","last_deep_scrub_stamp":"2024-03-04T13:00:51.197457+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.197457+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:17.674412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2282,"num_read_kb":2164,"num_write":473,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"256'317","reported_seq":959,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.633990+0000","last_change":"2024-03-04T13:00:54.634054+0000","last_active":"2024-03-04T13:00:54.633990+0000","last_peered":"2024-03-04T13:00:54.633990+0000","last_clean":"2024-03-04T13:00:54.633990+0000","last_became_active":"2024-03-04T12:36:05.295832+0000","last_became_peered":"2024-03-04T12:36:05.295832+0000","last_unstale":"2024-03-04T13:00:54.633990+0000","last_undegraded":"2024-03-04T13:00:54.633990+0000","last_fullsized":"2024-03-04T13:00:54.633990+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'317","last_scrub_stamp":"2024-03-04T13:00:54.633894+0000","last_deep_scrub":"256'317","last_deep_scrub_stamp":"2024-03-04T13:00:54.633894+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.633894+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:47.966603+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456555,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":48295,"num_write":1243,"num_write_kb":38980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"256'624","reported_seq":2336,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.121043+0000","last_change":"2024-03-04T13:00:44.121093+0000","last_active":"2024-03-04T13:00:44.121043+0000","last_peered":"2024-03-04T13:00:44.121043+0000","last_clean":"2024-03-04T13:00:44.121043+0000","last_became_active":"2024-03-04T12:36:07.295798+0000","last_became_peered":"2024-03-04T12:36:07.295798+0000","last_unstale":"2024-03-04T13:00:44.121043+0000","last_undegraded":"2024-03-04T13:00:44.121043+0000","last_fullsized":"2024-03-04T13:00:44.121043+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'624","last_scrub_stamp":"2024-03-04T13:00:44.120934+0000","last_deep_scrub":"256'624","last_deep_scrub_stamp":"2024-03-04T13:00:44.120934+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.120934+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":600,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:42:13.736456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3253,"num_read_kb":2977,"num_write":842,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2631,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"256'344","reported_seq":952,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.110830+0000","last_change":"2024-03-04T12:36:05.292220+0000","last_active":"2024-03-04T13:00:17.110830+0000","last_peered":"2024-03-04T13:00:17.110830+0000","last_clean":"2024-03-04T13:00:17.110830+0000","last_became_active":"2024-03-04T12:36:05.291477+0000","last_became_peered":"2024-03-04T12:36:05.291477+0000","last_unstale":"2024-03-04T13:00:17.110830+0000","last_undegraded":"2024-03-04T13:00:17.110830+0000","last_fullsized":"2024-03-04T13:00:17.110830+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730225,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":474,"num_read_kb":10302,"num_write":1224,"num_write_kb":24769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"256'368","reported_seq":1772,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.124614+0000","last_change":"2024-03-04T13:00:42.124642+0000","last_active":"2024-03-04T13:00:42.124614+0000","last_peered":"2024-03-04T13:00:42.124614+0000","last_clean":"2024-03-04T13:00:42.124614+0000","last_became_active":"2024-03-04T12:36:07.290104+0000","last_became_peered":"2024-03-04T12:36:07.290104+0000","last_unstale":"2024-03-04T13:00:42.124614+0000","last_undegraded":"2024-03-04T13:00:42.124614+0000","last_fullsized":"2024-03-04T13:00:42.124614+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'368","last_scrub_stamp":"2024-03-04T13:00:42.124516+0000","last_deep_scrub":"256'368","last_deep_scrub_stamp":"2024-03-04T13:00:42.124516+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.124516+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:34:33.903099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2031,"num_read_kb":1912,"num_write":446,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"256'309","reported_seq":927,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.123420+0000","last_change":"2024-03-04T12:36:05.291422+0000","last_active":"2024-03-04T13:00:17.123420+0000","last_peered":"2024-03-04T13:00:17.123420+0000","last_clean":"2024-03-04T13:00:17.123420+0000","last_became_active":"2024-03-04T12:36:05.291096+0000","last_became_peered":"2024-03-04T12:36:05.291096+0000","last_unstale":"2024-03-04T13:00:17.123420+0000","last_undegraded":"2024-03-04T13:00:17.123420+0000","last_fullsized":"2024-03-04T13:00:17.123420+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":471,"num_read_kb":17846,"num_write":1202,"num_write_kb":33765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"256'454","reported_seq":2131,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.124043+0000","last_change":"2024-03-04T13:00:42.124112+0000","last_active":"2024-03-04T13:00:42.124043+0000","last_peered":"2024-03-04T13:00:42.124043+0000","last_clean":"2024-03-04T13:00:42.124043+0000","last_became_active":"2024-03-04T12:36:07.297989+0000","last_became_peered":"2024-03-04T12:36:07.297989+0000","last_unstale":"2024-03-04T13:00:42.124043+0000","last_undegraded":"2024-03-04T13:00:42.124043+0000","last_fullsized":"2024-03-04T13:00:42.124043+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'454","last_scrub_stamp":"2024-03-04T13:00:42.123913+0000","last_deep_scrub":"256'454","last_deep_scrub_stamp":"2024-03-04T13:00:42.123913+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.123913+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:33:43.663219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2700,"num_read_kb":2549,"num_write":550,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4300,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"256'363","reported_seq":1028,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.027612+0000","last_change":"2024-03-04T12:36:05.281235+0000","last_active":"2024-03-04T13:00:17.027612+0000","last_peered":"2024-03-04T13:00:17.027612+0000","last_clean":"2024-03-04T13:00:17.027612+0000","last_became_active":"2024-03-04T12:36:05.280944+0000","last_became_peered":"2024-03-04T12:36:05.280944+0000","last_unstale":"2024-03-04T13:00:17.027612+0000","last_undegraded":"2024-03-04T13:00:17.027612+0000","last_fullsized":"2024-03-04T13:00:17.027612+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290369,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":724,"num_read_kb":21552,"num_write":1199,"num_write_kb":33499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"256'83","reported_seq":569,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.117129+0000","last_change":"2024-03-04T13:00:27.117158+0000","last_active":"2024-03-04T13:00:27.117129+0000","last_peered":"2024-03-04T13:00:27.117129+0000","last_clean":"2024-03-04T13:00:27.117129+0000","last_became_active":"2024-03-04T12:36:15.356314+0000","last_became_peered":"2024-03-04T12:36:15.356314+0000","last_unstale":"2024-03-04T13:00:27.117129+0000","last_undegraded":"2024-03-04T13:00:27.117129+0000","last_fullsized":"2024-03-04T13:00:27.117129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'83","last_scrub_stamp":"2024-03-04T13:00:27.117037+0000","last_deep_scrub":"256'83","last_deep_scrub_stamp":"2024-03-04T13:00:27.117037+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.117037+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:45.219404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":197,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"256'1097","reported_seq":2705,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.629069+0000","last_change":"2024-03-04T13:00:52.629098+0000","last_active":"2024-03-04T13:00:52.629069+0000","last_peered":"2024-03-04T13:00:52.629069+0000","last_clean":"2024-03-04T13:00:52.629069+0000","last_became_active":"2024-03-04T12:36:07.297879+0000","last_became_peered":"2024-03-04T12:36:07.297879+0000","last_unstale":"2024-03-04T13:00:52.629069+0000","last_undegraded":"2024-03-04T13:00:52.629069+0000","last_fullsized":"2024-03-04T13:00:52.629069+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1097","last_scrub_stamp":"2024-03-04T13:00:52.628982+0000","last_deep_scrub":"256'1097","last_deep_scrub_stamp":"2024-03-04T13:00:52.628982+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.628982+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":1000,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:51.871167+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4860,"num_read_kb":4288,"num_write":1505,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"256'392","reported_seq":1009,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.323846+0000","last_change":"2024-03-04T13:00:54.323947+0000","last_active":"2024-03-04T13:00:54.323846+0000","last_peered":"2024-03-04T13:00:54.323846+0000","last_clean":"2024-03-04T13:00:54.323846+0000","last_became_active":"2024-03-04T12:36:05.296939+0000","last_became_peered":"2024-03-04T12:36:05.296939+0000","last_unstale":"2024-03-04T13:00:54.323846+0000","last_undegraded":"2024-03-04T13:00:54.323846+0000","last_fullsized":"2024-03-04T13:00:54.323846+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'392","last_scrub_stamp":"2024-03-04T13:00:54.323765+0000","last_deep_scrub":"256'392","last_deep_scrub_stamp":"2024-03-04T13:00:54.323765+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.323765+0000","objects_scrubbed":15,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:04.952080+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10962332,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":473,"num_read_kb":33218,"num_write":1212,"num_write_kb":53558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.274057+0000","last_change":"2024-03-04T13:00:46.274078+0000","last_active":"2024-03-04T13:00:46.274057+0000","last_peered":"2024-03-04T13:00:46.274057+0000","last_clean":"2024-03-04T13:00:46.274057+0000","last_became_active":"2024-03-04T12:36:09.314065+0000","last_became_peered":"2024-03-04T12:36:09.314065+0000","last_unstale":"2024-03-04T13:00:46.274057+0000","last_undegraded":"2024-03-04T13:00:46.274057+0000","last_fullsized":"2024-03-04T13:00:46.274057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:46.273949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:46.273949+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.273949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:13:31.643800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"256'288","reported_seq":866,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.434869+0000","last_change":"2024-03-04T13:00:58.434906+0000","last_active":"2024-03-04T13:00:58.434869+0000","last_peered":"2024-03-04T13:00:58.434869+0000","last_clean":"2024-03-04T13:00:58.434869+0000","last_became_active":"2024-03-04T12:36:11.325995+0000","last_became_peered":"2024-03-04T12:36:11.325995+0000","last_unstale":"2024-03-04T13:00:58.434869+0000","last_undegraded":"2024-03-04T13:00:58.434869+0000","last_fullsized":"2024-03-04T13:00:58.434869+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'288","last_scrub_stamp":"2024-03-04T13:00:58.434770+0000","last_deep_scrub":"256'288","last_deep_scrub_stamp":"2024-03-04T13:00:58.434770+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.434770+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:11.681361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43297,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1002,"num_write":366,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.250619+0000","last_change":"2024-03-04T13:00:38.250645+0000","last_active":"2024-03-04T13:00:38.250619+0000","last_peered":"2024-03-04T13:00:38.250619+0000","last_clean":"2024-03-04T13:00:38.250619+0000","last_became_active":"2024-03-04T12:36:13.339305+0000","last_became_peered":"2024-03-04T12:36:13.339305+0000","last_unstale":"2024-03-04T13:00:38.250619+0000","last_undegraded":"2024-03-04T13:00:38.250619+0000","last_fullsized":"2024-03-04T13:00:38.250619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:38.250535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:38.250535+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.250535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:52.534010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"256'2371","reported_seq":4152,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.436326+0000","last_change":"2024-03-04T13:00:35.436362+0000","last_active":"2024-03-04T13:00:35.436326+0000","last_peered":"2024-03-04T13:00:35.436326+0000","last_clean":"2024-03-04T13:00:35.436326+0000","last_became_active":"2024-03-04T12:36:15.362434+0000","last_became_peered":"2024-03-04T12:36:15.362434+0000","last_unstale":"2024-03-04T13:00:35.436326+0000","last_undegraded":"2024-03-04T13:00:35.436326+0000","last_fullsized":"2024-03-04T13:00:35.436326+0000","mapping_epoch":30,"log_start":"256'2300","ondisk_log_start":"256'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2371","last_scrub_stamp":"2024-03-04T13:00:35.436238+0000","last_deep_scrub":"256'2371","last_deep_scrub_stamp":"2024-03-04T13:00:35.436238+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.436238+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":2300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:04.019436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5876,"num_read_kb":5881,"num_write":4713,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"256'831","reported_seq":2413,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.250235+0000","last_change":"2024-03-04T13:00:49.250261+0000","last_active":"2024-03-04T13:00:49.250235+0000","last_peered":"2024-03-04T13:00:49.250235+0000","last_clean":"2024-03-04T13:00:49.250235+0000","last_became_active":"2024-03-04T12:36:07.295522+0000","last_became_peered":"2024-03-04T12:36:07.295522+0000","last_unstale":"2024-03-04T13:00:49.250235+0000","last_undegraded":"2024-03-04T13:00:49.250235+0000","last_fullsized":"2024-03-04T13:00:49.250235+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'831","last_scrub_stamp":"2024-03-04T13:00:49.250152+0000","last_deep_scrub":"256'831","last_deep_scrub_stamp":"2024-03-04T13:00:49.250152+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.250152+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:44.066625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3820,"num_read_kb":3411,"num_write":1118,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"256'363","reported_seq":979,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.110038+0000","last_change":"2024-03-04T12:36:05.288481+0000","last_active":"2024-03-04T13:00:17.110038+0000","last_peered":"2024-03-04T13:00:17.110038+0000","last_clean":"2024-03-04T13:00:17.110038+0000","last_became_active":"2024-03-04T12:36:05.288208+0000","last_became_peered":"2024-03-04T12:36:05.288208+0000","last_unstale":"2024-03-04T13:00:17.110038+0000","last_undegraded":"2024-03-04T13:00:17.110038+0000","last_fullsized":"2024-03-04T13:00:17.110038+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":34780,"num_write":1176,"num_write_kb":45508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.998047+0000","last_change":"2024-03-04T12:36:09.309834+0000","last_active":"2024-03-04T12:59:30.998047+0000","last_peered":"2024-03-04T12:59:30.998047+0000","last_clean":"2024-03-04T12:59:30.998047+0000","last_became_active":"2024-03-04T12:36:09.309583+0000","last_became_peered":"2024-03-04T12:36:09.309583+0000","last_unstale":"2024-03-04T12:59:30.998047+0000","last_undegraded":"2024-03-04T12:59:30.998047+0000","last_fullsized":"2024-03-04T12:59:30.998047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"256'74","reported_seq":583,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.107034+0000","last_change":"2024-03-04T13:00:38.107070+0000","last_active":"2024-03-04T13:00:38.107034+0000","last_peered":"2024-03-04T13:00:38.107034+0000","last_clean":"2024-03-04T13:00:38.107034+0000","last_became_active":"2024-03-04T12:36:11.324761+0000","last_became_peered":"2024-03-04T12:36:11.324761+0000","last_unstale":"2024-03-04T13:00:38.107034+0000","last_undegraded":"2024-03-04T13:00:38.107034+0000","last_fullsized":"2024-03-04T13:00:38.107034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'74","last_scrub_stamp":"2024-03-04T13:00:38.106947+0000","last_deep_scrub":"256'74","last_deep_scrub_stamp":"2024-03-04T13:00:38.106947+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.106947+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:56:51.502742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":50,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.118375+0000","last_change":"2024-03-04T13:00:33.118401+0000","last_active":"2024-03-04T13:00:33.118375+0000","last_peered":"2024-03-04T13:00:33.118375+0000","last_clean":"2024-03-04T13:00:33.118375+0000","last_became_active":"2024-03-04T12:36:13.343072+0000","last_became_peered":"2024-03-04T12:36:13.343072+0000","last_unstale":"2024-03-04T13:00:33.118375+0000","last_undegraded":"2024-03-04T13:00:33.118375+0000","last_fullsized":"2024-03-04T13:00:33.118375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:33.118287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:33.118287+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.118287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:36:41.186234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"256'104","reported_seq":599,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.614263+0000","last_change":"2024-03-04T13:00:32.614323+0000","last_active":"2024-03-04T13:00:32.614263+0000","last_peered":"2024-03-04T13:00:32.614263+0000","last_clean":"2024-03-04T13:00:32.614263+0000","last_became_active":"2024-03-04T12:36:15.362354+0000","last_became_peered":"2024-03-04T12:36:15.362354+0000","last_unstale":"2024-03-04T13:00:32.614263+0000","last_undegraded":"2024-03-04T13:00:32.614263+0000","last_fullsized":"2024-03-04T13:00:32.614263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'104","last_scrub_stamp":"2024-03-04T13:00:32.614142+0000","last_deep_scrub":"256'104","last_deep_scrub_stamp":"2024-03-04T13:00:32.614142+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.614142+0000","objects_scrubbed":6,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:02:52.498658+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":121,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"256'345","reported_seq":1734,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.405192+0000","last_change":"2024-03-04T13:00:59.405224+0000","last_active":"2024-03-04T13:00:59.405192+0000","last_peered":"2024-03-04T13:00:59.405192+0000","last_clean":"2024-03-04T13:00:59.405192+0000","last_became_active":"2024-03-04T12:36:07.294328+0000","last_became_peered":"2024-03-04T12:36:07.294328+0000","last_unstale":"2024-03-04T13:00:59.405192+0000","last_undegraded":"2024-03-04T13:00:59.405192+0000","last_fullsized":"2024-03-04T13:00:59.405192+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'345","last_scrub_stamp":"2024-03-04T13:00:59.405065+0000","last_deep_scrub":"256'345","last_deep_scrub_stamp":"2024-03-04T13:00:59.405065+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.405065+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:49.403720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1913,"num_read_kb":1818,"num_write":399,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"256'282","reported_seq":896,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.121058+0000","last_change":"2024-03-04T12:36:05.291937+0000","last_active":"2024-03-04T13:00:17.121058+0000","last_peered":"2024-03-04T13:00:17.121058+0000","last_clean":"2024-03-04T13:00:17.121058+0000","last_became_active":"2024-03-04T12:36:05.291366+0000","last_became_peered":"2024-03-04T12:36:05.291366+0000","last_unstale":"2024-03-04T13:00:17.121058+0000","last_undegraded":"2024-03-04T13:00:17.121058+0000","last_fullsized":"2024-03-04T13:00:17.121058+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":749491,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":10592,"num_write":1118,"num_write_kb":21097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.004303+0000","last_change":"2024-03-04T12:36:09.310004+0000","last_active":"2024-03-04T13:00:21.004303+0000","last_peered":"2024-03-04T13:00:21.004303+0000","last_clean":"2024-03-04T13:00:21.004303+0000","last_became_active":"2024-03-04T12:36:09.309749+0000","last_became_peered":"2024-03-04T12:36:09.309749+0000","last_unstale":"2024-03-04T13:00:21.004303+0000","last_undegraded":"2024-03-04T13:00:21.004303+0000","last_fullsized":"2024-03-04T13:00:21.004303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"256'86","reported_seq":598,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.298417+0000","last_change":"2024-03-04T13:00:28.298481+0000","last_active":"2024-03-04T13:00:28.298417+0000","last_peered":"2024-03-04T13:00:28.298417+0000","last_clean":"2024-03-04T13:00:28.298417+0000","last_became_active":"2024-03-04T12:36:11.324127+0000","last_became_peered":"2024-03-04T12:36:11.324127+0000","last_unstale":"2024-03-04T13:00:28.298417+0000","last_undegraded":"2024-03-04T13:00:28.298417+0000","last_fullsized":"2024-03-04T13:00:28.298417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'86","last_scrub_stamp":"2024-03-04T13:00:28.298332+0000","last_deep_scrub":"256'86","last_deep_scrub_stamp":"2024-03-04T13:00:28.298332+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.298332+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:29.180417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"256'510","reported_seq":1468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.298406+0000","last_change":"2024-03-04T13:00:41.298440+0000","last_active":"2024-03-04T13:00:41.298406+0000","last_peered":"2024-03-04T13:00:41.298406+0000","last_clean":"2024-03-04T13:00:41.298406+0000","last_became_active":"2024-03-04T12:36:13.338070+0000","last_became_peered":"2024-03-04T12:36:13.338070+0000","last_unstale":"2024-03-04T13:00:41.298406+0000","last_undegraded":"2024-03-04T13:00:41.298406+0000","last_fullsized":"2024-03-04T13:00:41.298406+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'510","last_scrub_stamp":"2024-03-04T13:00:41.298306+0000","last_deep_scrub":"256'510","last_deep_scrub_stamp":"2024-03-04T13:00:41.298306+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.298306+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:35.703293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"256'104","reported_seq":582,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.068360+0000","last_change":"2024-03-04T13:00:26.068390+0000","last_active":"2024-03-04T13:00:26.068360+0000","last_peered":"2024-03-04T13:00:26.068360+0000","last_clean":"2024-03-04T13:00:26.068360+0000","last_became_active":"2024-03-04T12:36:15.356417+0000","last_became_peered":"2024-03-04T12:36:15.356417+0000","last_unstale":"2024-03-04T13:00:26.068360+0000","last_undegraded":"2024-03-04T13:00:26.068360+0000","last_fullsized":"2024-03-04T13:00:26.068360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'104","last_scrub_stamp":"2024-03-04T13:00:26.068269+0000","last_deep_scrub":"256'104","last_deep_scrub_stamp":"2024-03-04T13:00:26.068269+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.068269+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:57.908639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"256'686","reported_seq":2120,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.631942+0000","last_change":"2024-03-04T13:00:53.631972+0000","last_active":"2024-03-04T13:00:53.631942+0000","last_peered":"2024-03-04T13:00:53.631942+0000","last_clean":"2024-03-04T13:00:53.631942+0000","last_became_active":"2024-03-04T12:36:07.293493+0000","last_became_peered":"2024-03-04T12:36:07.293493+0000","last_unstale":"2024-03-04T13:00:53.631942+0000","last_undegraded":"2024-03-04T13:00:53.631942+0000","last_fullsized":"2024-03-04T13:00:53.631942+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'686","last_scrub_stamp":"2024-03-04T13:00:53.631854+0000","last_deep_scrub":"256'686","last_deep_scrub_stamp":"2024-03-04T13:00:53.631854+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.631854+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:48:17.135224+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3120,"num_read_kb":2817,"num_write":901,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":556,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"256'397","reported_seq":1026,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.766966+0000","last_change":"2024-03-04T13:00:50.767009+0000","last_active":"2024-03-04T13:00:50.766966+0000","last_peered":"2024-03-04T13:00:50.766966+0000","last_clean":"2024-03-04T13:00:50.766966+0000","last_became_active":"2024-03-04T12:36:05.283477+0000","last_became_peered":"2024-03-04T12:36:05.283477+0000","last_unstale":"2024-03-04T13:00:50.766966+0000","last_undegraded":"2024-03-04T13:00:50.766966+0000","last_fullsized":"2024-03-04T13:00:50.766966+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'397","last_scrub_stamp":"2024-03-04T13:00:50.766881+0000","last_deep_scrub":"256'397","last_deep_scrub_stamp":"2024-03-04T13:00:50.766881+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.766881+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:19.484584+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048764,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":32578,"num_write":1458,"num_write_kb":46757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.266816+0000","last_change":"2024-03-04T13:00:48.266839+0000","last_active":"2024-03-04T13:00:48.266816+0000","last_peered":"2024-03-04T13:00:48.266816+0000","last_clean":"2024-03-04T13:00:48.266816+0000","last_became_active":"2024-03-04T12:36:09.314215+0000","last_became_peered":"2024-03-04T12:36:09.314215+0000","last_unstale":"2024-03-04T13:00:48.266816+0000","last_undegraded":"2024-03-04T13:00:48.266816+0000","last_fullsized":"2024-03-04T13:00:48.266816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:48.266727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:48.266727+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.266727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:37:57.215196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"256'250","reported_seq":802,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.312866+0000","last_change":"2024-03-04T13:00:42.312905+0000","last_active":"2024-03-04T13:00:42.312866+0000","last_peered":"2024-03-04T13:00:42.312866+0000","last_clean":"2024-03-04T13:00:42.312866+0000","last_became_active":"2024-03-04T12:36:11.956371+0000","last_became_peered":"2024-03-04T12:36:11.956371+0000","last_unstale":"2024-03-04T13:00:42.312866+0000","last_undegraded":"2024-03-04T13:00:42.312866+0000","last_fullsized":"2024-03-04T13:00:42.312866+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'250","last_scrub_stamp":"2024-03-04T13:00:42.312765+0000","last_deep_scrub":"256'250","last_deep_scrub_stamp":"2024-03-04T13:00:42.312765+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.312765+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:09:09.690974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44142,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1035,"num_write":354,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"256'535","reported_seq":3345,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.699751+0000","last_change":"2024-03-04T13:00:41.699839+0000","last_active":"2024-03-04T13:00:41.699751+0000","last_peered":"2024-03-04T13:00:41.699751+0000","last_clean":"2024-03-04T13:00:41.699751+0000","last_became_active":"2024-03-04T12:36:13.344498+0000","last_became_peered":"2024-03-04T12:36:13.344498+0000","last_unstale":"2024-03-04T13:00:41.699751+0000","last_undegraded":"2024-03-04T13:00:41.699751+0000","last_fullsized":"2024-03-04T13:00:41.699751+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'535","last_scrub_stamp":"2024-03-04T13:00:41.699639+0000","last_deep_scrub":"256'535","last_deep_scrub_stamp":"2024-03-04T13:00:41.699639+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.699639+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:07:21.038160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"256'769","reported_seq":2308,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.349317+0000","last_change":"2024-03-04T13:00:42.349344+0000","last_active":"2024-03-04T13:00:42.349317+0000","last_peered":"2024-03-04T13:00:42.349317+0000","last_clean":"2024-03-04T13:00:42.349317+0000","last_became_active":"2024-03-04T12:36:07.297320+0000","last_became_peered":"2024-03-04T12:36:07.297320+0000","last_unstale":"2024-03-04T13:00:42.349317+0000","last_undegraded":"2024-03-04T13:00:42.349317+0000","last_fullsized":"2024-03-04T13:00:42.349317+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'769","last_scrub_stamp":"2024-03-04T13:00:42.349233+0000","last_deep_scrub":"256'769","last_deep_scrub_stamp":"2024-03-04T13:00:42.349233+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.349233+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:41.422432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3660,"num_read_kb":3298,"num_write":1023,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"256'397","reported_seq":1069,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.269712+0000","last_change":"2024-03-04T13:01:00.269775+0000","last_active":"2024-03-04T13:01:00.269712+0000","last_peered":"2024-03-04T13:01:00.269712+0000","last_clean":"2024-03-04T13:01:00.269712+0000","last_became_active":"2024-03-04T12:36:05.293882+0000","last_became_peered":"2024-03-04T12:36:05.293882+0000","last_unstale":"2024-03-04T13:01:00.269712+0000","last_undegraded":"2024-03-04T13:01:00.269712+0000","last_fullsized":"2024-03-04T13:01:00.269712+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'397","last_scrub_stamp":"2024-03-04T13:01:00.269616+0000","last_deep_scrub":"256'397","last_deep_scrub_stamp":"2024-03-04T13:01:00.269616+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.269616+0000","objects_scrubbed":11,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:31:11.933523+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5179671,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":578,"num_read_kb":60173,"num_write":1456,"num_write_kb":40158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.289919+0000","last_change":"2024-03-04T13:00:53.289944+0000","last_active":"2024-03-04T13:00:53.289919+0000","last_peered":"2024-03-04T13:00:53.289919+0000","last_clean":"2024-03-04T13:00:53.289919+0000","last_became_active":"2024-03-04T12:36:09.308538+0000","last_became_peered":"2024-03-04T12:36:09.308538+0000","last_unstale":"2024-03-04T13:00:53.289919+0000","last_undegraded":"2024-03-04T13:00:53.289919+0000","last_fullsized":"2024-03-04T13:00:53.289919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:53.289830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:53.289830+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.289830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:33.037810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"256'321","reported_seq":901,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.391819+0000","last_change":"2024-03-04T13:00:39.391867+0000","last_active":"2024-03-04T13:00:39.391819+0000","last_peered":"2024-03-04T13:00:39.391819+0000","last_clean":"2024-03-04T13:00:39.391819+0000","last_became_active":"2024-03-04T12:36:11.954597+0000","last_became_peered":"2024-03-04T12:36:11.954597+0000","last_unstale":"2024-03-04T13:00:39.391819+0000","last_undegraded":"2024-03-04T13:00:39.391819+0000","last_fullsized":"2024-03-04T13:00:39.391819+0000","mapping_epoch":26,"log_start":"256'300","ondisk_log_start":"256'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'321","last_scrub_stamp":"2024-03-04T13:00:39.391733+0000","last_deep_scrub":"256'321","last_deep_scrub_stamp":"2024-03-04T13:00:39.391733+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.391733+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:46.694056+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51312,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":526,"num_read_kb":1169,"num_write":422,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.400019+0000","last_change":"2024-03-04T13:00:50.400019+0000","last_active":"2024-03-04T13:00:50.400019+0000","last_peered":"2024-03-04T13:00:50.400019+0000","last_clean":"2024-03-04T13:00:50.400019+0000","last_became_active":"2024-03-04T12:36:13.339890+0000","last_became_peered":"2024-03-04T12:36:13.339890+0000","last_unstale":"2024-03-04T13:00:50.400019+0000","last_undegraded":"2024-03-04T13:00:50.400019+0000","last_fullsized":"2024-03-04T13:00:50.400019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:50.399907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:50.399907+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.399907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:19:11.128424+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"256'507","reported_seq":1300,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.396141+0000","last_change":"2024-03-04T13:00:33.396173+0000","last_active":"2024-03-04T13:00:33.396141+0000","last_peered":"2024-03-04T13:00:33.396141+0000","last_clean":"2024-03-04T13:00:33.396141+0000","last_became_active":"2024-03-04T12:36:15.362355+0000","last_became_peered":"2024-03-04T12:36:15.362355+0000","last_unstale":"2024-03-04T13:00:33.396141+0000","last_undegraded":"2024-03-04T13:00:33.396141+0000","last_fullsized":"2024-03-04T13:00:33.396141+0000","mapping_epoch":30,"log_start":"250'400","ondisk_log_start":"250'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'507","last_scrub_stamp":"2024-03-04T13:00:33.396041+0000","last_deep_scrub":"256'507","last_deep_scrub_stamp":"2024-03-04T13:00:33.396041+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.396041+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:55.241746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1234,"num_read_kb":1233,"num_write":1042,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"256'407","reported_seq":1926,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.039724+0000","last_change":"2024-03-04T13:00:57.039754+0000","last_active":"2024-03-04T13:00:57.039724+0000","last_peered":"2024-03-04T13:00:57.039724+0000","last_clean":"2024-03-04T13:00:57.039724+0000","last_became_active":"2024-03-04T12:36:07.291507+0000","last_became_peered":"2024-03-04T12:36:07.291507+0000","last_unstale":"2024-03-04T13:00:57.039724+0000","last_undegraded":"2024-03-04T13:00:57.039724+0000","last_fullsized":"2024-03-04T13:00:57.039724+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'407","last_scrub_stamp":"2024-03-04T13:00:57.039631+0000","last_deep_scrub":"256'407","last_deep_scrub_stamp":"2024-03-04T13:00:57.039631+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.039631+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:22.285100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2180,"num_read_kb":2067,"num_write":478,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"256'311","reported_seq":936,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.483102+0000","last_change":"2024-03-04T12:36:05.286750+0000","last_active":"2024-03-04T13:00:24.483102+0000","last_peered":"2024-03-04T13:00:24.483102+0000","last_clean":"2024-03-04T13:00:24.483102+0000","last_became_active":"2024-03-04T12:36:05.286438+0000","last_became_peered":"2024-03-04T12:36:05.286438+0000","last_unstale":"2024-03-04T13:00:24.483102+0000","last_undegraded":"2024-03-04T13:00:24.483102+0000","last_fullsized":"2024-03-04T13:00:24.483102+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21141,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":18655,"num_write":1207,"num_write_kb":23251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.325802+0000","last_change":"2024-03-04T13:00:34.325853+0000","last_active":"2024-03-04T13:00:34.325802+0000","last_peered":"2024-03-04T13:00:34.325802+0000","last_clean":"2024-03-04T13:00:34.325802+0000","last_became_active":"2024-03-04T12:36:09.304561+0000","last_became_peered":"2024-03-04T12:36:09.304561+0000","last_unstale":"2024-03-04T13:00:34.325802+0000","last_undegraded":"2024-03-04T13:00:34.325802+0000","last_fullsized":"2024-03-04T13:00:34.325802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:34.325699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:34.325699+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.325699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:45:29.332360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"256'273","reported_seq":824,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.676860+0000","last_change":"2024-03-04T13:00:51.676860+0000","last_active":"2024-03-04T13:00:51.676860+0000","last_peered":"2024-03-04T13:00:51.676860+0000","last_clean":"2024-03-04T13:00:51.676860+0000","last_became_active":"2024-03-04T12:36:11.324147+0000","last_became_peered":"2024-03-04T12:36:11.324147+0000","last_unstale":"2024-03-04T13:00:51.676860+0000","last_undegraded":"2024-03-04T13:00:51.676860+0000","last_fullsized":"2024-03-04T13:00:51.676860+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'273","last_scrub_stamp":"2024-03-04T13:00:51.676726+0000","last_deep_scrub":"256'273","last_deep_scrub_stamp":"2024-03-04T13:00:51.676726+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.676726+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:24:30.068280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":439,"num_read_kb":1077,"num_write":366,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.746156+0000","last_change":"2024-03-04T13:00:39.746181+0000","last_active":"2024-03-04T13:00:39.746156+0000","last_peered":"2024-03-04T13:00:39.746156+0000","last_clean":"2024-03-04T13:00:39.746156+0000","last_became_active":"2024-03-04T12:36:13.346077+0000","last_became_peered":"2024-03-04T12:36:13.346077+0000","last_unstale":"2024-03-04T13:00:39.746156+0000","last_undegraded":"2024-03-04T13:00:39.746156+0000","last_fullsized":"2024-03-04T13:00:39.746156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.746057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.746057+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.746057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:38.016628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"256'124","reported_seq":612,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.742261+0000","last_change":"2024-03-04T13:00:42.742308+0000","last_active":"2024-03-04T13:00:42.742261+0000","last_peered":"2024-03-04T13:00:42.742261+0000","last_clean":"2024-03-04T13:00:42.742261+0000","last_became_active":"2024-03-04T12:36:15.359839+0000","last_became_peered":"2024-03-04T12:36:15.359839+0000","last_unstale":"2024-03-04T13:00:42.742261+0000","last_undegraded":"2024-03-04T13:00:42.742261+0000","last_fullsized":"2024-03-04T13:00:42.742261+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'124","last_scrub_stamp":"2024-03-04T13:00:42.742163+0000","last_deep_scrub":"256'124","last_deep_scrub_stamp":"2024-03-04T13:00:42.742163+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.742163+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:04.700070+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":144,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"256'819","reported_seq":2272,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.622699+0000","last_change":"2024-03-04T13:00:56.622760+0000","last_active":"2024-03-04T13:00:56.622699+0000","last_peered":"2024-03-04T13:00:56.622699+0000","last_clean":"2024-03-04T13:00:56.622699+0000","last_became_active":"2024-03-04T12:36:40.394812+0000","last_became_peered":"2024-03-04T12:36:40.394812+0000","last_unstale":"2024-03-04T13:00:56.622699+0000","last_undegraded":"2024-03-04T13:00:56.622699+0000","last_fullsized":"2024-03-04T13:00:56.622699+0000","mapping_epoch":33,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'819","last_scrub_stamp":"2024-03-04T13:00:56.622590+0000","last_deep_scrub":"256'819","last_deep_scrub_stamp":"2024-03-04T13:00:56.622590+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.622590+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:17:25.575809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3628,"num_read_kb":3191,"num_write":1140,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"256'344","reported_seq":1003,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.266767+0000","last_change":"2024-03-04T13:00:52.266813+0000","last_active":"2024-03-04T13:00:52.266767+0000","last_peered":"2024-03-04T13:00:52.266767+0000","last_clean":"2024-03-04T13:00:52.266767+0000","last_became_active":"2024-03-04T12:36:05.297486+0000","last_became_peered":"2024-03-04T12:36:05.297486+0000","last_unstale":"2024-03-04T13:00:52.266767+0000","last_undegraded":"2024-03-04T13:00:52.266767+0000","last_fullsized":"2024-03-04T13:00:52.266767+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'344","last_scrub_stamp":"2024-03-04T13:00:52.266678+0000","last_deep_scrub":"256'344","last_deep_scrub_stamp":"2024-03-04T13:00:52.266678+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.266678+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:45:26.194961+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":44586,"num_write":1373,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"256'6","reported_seq":798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.257746+0000","last_change":"2024-03-04T13:00:38.257746+0000","last_active":"2024-03-04T13:00:38.257746+0000","last_peered":"2024-03-04T13:00:38.257746+0000","last_clean":"2024-03-04T13:00:38.257746+0000","last_became_active":"2024-03-04T12:36:09.303280+0000","last_became_peered":"2024-03-04T12:36:09.303280+0000","last_unstale":"2024-03-04T13:00:38.257746+0000","last_undegraded":"2024-03-04T13:00:38.257746+0000","last_fullsized":"2024-03-04T13:00:38.257746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:38.257611+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:38.257611+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.257611+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:40.037724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":467,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"256'292","reported_seq":854,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.268985+0000","last_change":"2024-03-04T13:00:59.269045+0000","last_active":"2024-03-04T13:00:59.268985+0000","last_peered":"2024-03-04T13:00:59.268985+0000","last_clean":"2024-03-04T13:00:59.268985+0000","last_became_active":"2024-03-04T12:36:11.325109+0000","last_became_peered":"2024-03-04T12:36:11.325109+0000","last_unstale":"2024-03-04T13:00:59.268985+0000","last_undegraded":"2024-03-04T13:00:59.268985+0000","last_fullsized":"2024-03-04T13:00:59.268985+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'292","last_scrub_stamp":"2024-03-04T13:00:59.268915+0000","last_deep_scrub":"256'292","last_deep_scrub_stamp":"2024-03-04T13:00:59.268915+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.268915+0000","objects_scrubbed":8,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:10.436302+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48663,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":476,"num_read_kb":1126,"num_write":394,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"256'518","reported_seq":1831,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.480313+0000","last_change":"2024-03-04T13:00:43.480358+0000","last_active":"2024-03-04T13:00:43.480313+0000","last_peered":"2024-03-04T13:00:43.480313+0000","last_clean":"2024-03-04T13:00:43.480313+0000","last_became_active":"2024-03-04T12:36:13.342604+0000","last_became_peered":"2024-03-04T12:36:13.342604+0000","last_unstale":"2024-03-04T13:00:43.480313+0000","last_undegraded":"2024-03-04T13:00:43.480313+0000","last_fullsized":"2024-03-04T13:00:43.480313+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'518","last_scrub_stamp":"2024-03-04T13:00:43.480202+0000","last_deep_scrub":"256'518","last_deep_scrub_stamp":"2024-03-04T13:00:43.480202+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.480202+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:17.734952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"256'92","reported_seq":561,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.636159+0000","last_change":"2024-03-04T13:00:33.636203+0000","last_active":"2024-03-04T13:00:33.636159+0000","last_peered":"2024-03-04T13:00:33.636159+0000","last_clean":"2024-03-04T13:00:33.636159+0000","last_became_active":"2024-03-04T12:36:15.359959+0000","last_became_peered":"2024-03-04T12:36:15.359959+0000","last_unstale":"2024-03-04T13:00:33.636159+0000","last_undegraded":"2024-03-04T13:00:33.636159+0000","last_fullsized":"2024-03-04T13:00:33.636159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'92","last_scrub_stamp":"2024-03-04T13:00:33.636037+0000","last_deep_scrub":"256'92","last_deep_scrub_stamp":"2024-03-04T13:00:33.636037+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.636037+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:05:11.396356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"256'356","reported_seq":1809,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.498478+0000","last_change":"2024-03-04T13:00:53.498478+0000","last_active":"2024-03-04T13:00:53.498478+0000","last_peered":"2024-03-04T13:00:53.498478+0000","last_clean":"2024-03-04T13:00:53.498478+0000","last_became_active":"2024-03-04T12:36:07.301558+0000","last_became_peered":"2024-03-04T12:36:07.301558+0000","last_unstale":"2024-03-04T13:00:53.498478+0000","last_undegraded":"2024-03-04T13:00:53.498478+0000","last_fullsized":"2024-03-04T13:00:53.498478+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'356","last_scrub_stamp":"2024-03-04T13:00:53.498342+0000","last_deep_scrub":"256'356","last_deep_scrub_stamp":"2024-03-04T13:00:53.498342+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.498342+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:54.005350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1943,"num_read_kb":1867,"num_write":395,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"256'357","reported_seq":1109,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.559628+0000","last_change":"2024-03-04T12:36:05.293965+0000","last_active":"2024-03-04T13:00:23.559628+0000","last_peered":"2024-03-04T13:00:23.559628+0000","last_clean":"2024-03-04T13:00:23.559628+0000","last_became_active":"2024-03-04T12:36:05.293649+0000","last_became_peered":"2024-03-04T12:36:05.293649+0000","last_unstale":"2024-03-04T13:00:23.559628+0000","last_undegraded":"2024-03-04T13:00:23.559628+0000","last_fullsized":"2024-03-04T13:00:23.559628+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3134195,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":703,"num_read_kb":39148,"num_write":1364,"num_write_kb":31517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.312815+0000","last_change":"2024-03-04T13:00:36.312878+0000","last_active":"2024-03-04T13:00:36.312815+0000","last_peered":"2024-03-04T13:00:36.312815+0000","last_clean":"2024-03-04T13:00:36.312815+0000","last_became_active":"2024-03-04T12:36:09.303908+0000","last_became_peered":"2024-03-04T12:36:09.303908+0000","last_unstale":"2024-03-04T13:00:36.312815+0000","last_undegraded":"2024-03-04T13:00:36.312815+0000","last_fullsized":"2024-03-04T13:00:36.312815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:36.312703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:36.312703+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.312703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:24:52.339144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"256'427","reported_seq":1028,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.131473+0000","last_change":"2024-03-04T12:36:11.328487+0000","last_active":"2024-03-04T13:00:17.131473+0000","last_peered":"2024-03-04T13:00:17.131473+0000","last_clean":"2024-03-04T13:00:17.131473+0000","last_became_active":"2024-03-04T12:36:11.326014+0000","last_became_peered":"2024-03-04T12:36:11.326014+0000","last_unstale":"2024-03-04T13:00:17.131473+0000","last_undegraded":"2024-03-04T13:00:17.131473+0000","last_fullsized":"2024-03-04T13:00:17.131473+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":758,"num_read_kb":1853,"num_write":616,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.200373+0000","last_change":"2024-03-04T13:00:24.200396+0000","last_active":"2024-03-04T13:00:24.200373+0000","last_peered":"2024-03-04T13:00:24.200373+0000","last_clean":"2024-03-04T13:00:24.200373+0000","last_became_active":"2024-03-04T12:36:13.335586+0000","last_became_peered":"2024-03-04T12:36:13.335586+0000","last_unstale":"2024-03-04T13:00:24.200373+0000","last_undegraded":"2024-03-04T13:00:24.200373+0000","last_fullsized":"2024-03-04T13:00:24.200373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:24.200285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:24.200285+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.200285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:42:37.768082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"256'108","reported_seq":610,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.374380+0000","last_change":"2024-03-04T13:00:31.374407+0000","last_active":"2024-03-04T13:00:31.374380+0000","last_peered":"2024-03-04T13:00:31.374380+0000","last_clean":"2024-03-04T13:00:31.374380+0000","last_became_active":"2024-03-04T12:36:15.356270+0000","last_became_peered":"2024-03-04T12:36:15.356270+0000","last_unstale":"2024-03-04T13:00:31.374380+0000","last_undegraded":"2024-03-04T13:00:31.374380+0000","last_fullsized":"2024-03-04T13:00:31.374380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'108","last_scrub_stamp":"2024-03-04T13:00:31.374294+0000","last_deep_scrub":"256'108","last_deep_scrub_stamp":"2024-03-04T13:00:31.374294+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.374294+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:34:36.455950+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":257,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"256'399","reported_seq":1984,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.020670+0000","last_change":"2024-03-04T13:00:55.020670+0000","last_active":"2024-03-04T13:00:55.020670+0000","last_peered":"2024-03-04T13:00:55.020670+0000","last_clean":"2024-03-04T13:00:55.020670+0000","last_became_active":"2024-03-04T12:36:07.292788+0000","last_became_peered":"2024-03-04T12:36:07.292788+0000","last_unstale":"2024-03-04T13:00:55.020670+0000","last_undegraded":"2024-03-04T13:00:55.020670+0000","last_fullsized":"2024-03-04T13:00:55.020670+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'399","last_scrub_stamp":"2024-03-04T13:00:55.020485+0000","last_deep_scrub":"256'399","last_deep_scrub_stamp":"2024-03-04T13:00:55.020485+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.020485+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:02.659613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2359,"num_read_kb":2243,"num_write":467,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1436,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"256'305","reported_seq":1009,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.633115+0000","last_change":"2024-03-04T12:36:05.286316+0000","last_active":"2024-03-04T13:00:22.633115+0000","last_peered":"2024-03-04T13:00:22.633115+0000","last_clean":"2024-03-04T13:00:22.633115+0000","last_became_active":"2024-03-04T12:36:05.284594+0000","last_became_peered":"2024-03-04T12:36:05.284594+0000","last_unstale":"2024-03-04T13:00:22.633115+0000","last_undegraded":"2024-03-04T13:00:22.633115+0000","last_fullsized":"2024-03-04T13:00:22.633115+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398941,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":597,"num_read_kb":110861,"num_write":1019,"num_write_kb":39283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.286134+0000","last_change":"2024-03-04T13:00:32.286134+0000","last_active":"2024-03-04T13:00:32.286134+0000","last_peered":"2024-03-04T13:00:32.286134+0000","last_clean":"2024-03-04T13:00:32.286134+0000","last_became_active":"2024-03-04T12:36:09.305363+0000","last_became_peered":"2024-03-04T12:36:09.305363+0000","last_unstale":"2024-03-04T13:00:32.286134+0000","last_undegraded":"2024-03-04T13:00:32.286134+0000","last_fullsized":"2024-03-04T13:00:32.286134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:32.286026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:32.286026+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.286026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:59:46.692288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"256'264","reported_seq":823,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.130461+0000","last_change":"2024-03-04T13:00:41.130461+0000","last_active":"2024-03-04T13:00:41.130461+0000","last_peered":"2024-03-04T13:00:41.130461+0000","last_clean":"2024-03-04T13:00:41.130461+0000","last_became_active":"2024-03-04T12:36:11.319633+0000","last_became_peered":"2024-03-04T12:36:11.319633+0000","last_unstale":"2024-03-04T13:00:41.130461+0000","last_undegraded":"2024-03-04T13:00:41.130461+0000","last_fullsized":"2024-03-04T13:00:41.130461+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'264","last_scrub_stamp":"2024-03-04T13:00:41.130252+0000","last_deep_scrub":"256'264","last_deep_scrub_stamp":"2024-03-04T13:00:41.130252+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.130252+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:37:10.295625+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":990,"num_write":404,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.595505+0000","last_change":"2024-03-04T13:00:39.595505+0000","last_active":"2024-03-04T13:00:39.595505+0000","last_peered":"2024-03-04T13:00:39.595505+0000","last_clean":"2024-03-04T13:00:39.595505+0000","last_became_active":"2024-03-04T12:36:13.348999+0000","last_became_peered":"2024-03-04T12:36:13.348999+0000","last_unstale":"2024-03-04T13:00:39.595505+0000","last_undegraded":"2024-03-04T13:00:39.595505+0000","last_fullsized":"2024-03-04T13:00:39.595505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.595386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.595386+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.595386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:30.057599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"256'99","reported_seq":578,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.668602+0000","last_change":"2024-03-04T13:00:28.668630+0000","last_active":"2024-03-04T13:00:28.668602+0000","last_peered":"2024-03-04T13:00:28.668602+0000","last_clean":"2024-03-04T13:00:28.668602+0000","last_became_active":"2024-03-04T12:36:15.359732+0000","last_became_peered":"2024-03-04T12:36:15.359732+0000","last_unstale":"2024-03-04T13:00:28.668602+0000","last_undegraded":"2024-03-04T13:00:28.668602+0000","last_fullsized":"2024-03-04T13:00:28.668602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'99","last_scrub_stamp":"2024-03-04T13:00:28.668521+0000","last_deep_scrub":"256'99","last_deep_scrub_stamp":"2024-03-04T13:00:28.668521+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.668521+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:02:41.542443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"256'881","reported_seq":2445,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.087249+0000","last_change":"2024-03-04T13:00:48.087249+0000","last_active":"2024-03-04T13:00:48.087249+0000","last_peered":"2024-03-04T13:00:48.087249+0000","last_clean":"2024-03-04T13:00:48.087249+0000","last_became_active":"2024-03-04T12:36:07.298999+0000","last_became_peered":"2024-03-04T12:36:07.298999+0000","last_unstale":"2024-03-04T13:00:48.087249+0000","last_undegraded":"2024-03-04T13:00:48.087249+0000","last_fullsized":"2024-03-04T13:00:48.087249+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'881","last_scrub_stamp":"2024-03-04T13:00:48.087084+0000","last_deep_scrub":"256'881","last_deep_scrub_stamp":"2024-03-04T13:00:48.087084+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.087084+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:59:30.969925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4068,"num_read_kb":3596,"num_write":1224,"num_write_kb":497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2629,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"256'355","reported_seq":964,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.773041+0000","last_change":"2024-03-04T13:00:53.773128+0000","last_active":"2024-03-04T13:00:53.773041+0000","last_peered":"2024-03-04T13:00:53.773041+0000","last_clean":"2024-03-04T13:00:53.773041+0000","last_became_active":"2024-03-04T12:36:05.289486+0000","last_became_peered":"2024-03-04T12:36:05.289486+0000","last_unstale":"2024-03-04T13:00:53.773041+0000","last_undegraded":"2024-03-04T13:00:53.773041+0000","last_fullsized":"2024-03-04T13:00:53.773041+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'355","last_scrub_stamp":"2024-03-04T13:00:53.772924+0000","last_deep_scrub":"256'355","last_deep_scrub_stamp":"2024-03-04T13:00:53.772924+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.772924+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:02:41.336959+0000","scrub_duration":117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456599,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":441,"num_read_kb":48705,"num_write":1317,"num_write_kb":64123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":488,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.384771+0000","last_change":"2024-03-04T13:00:38.384771+0000","last_active":"2024-03-04T13:00:38.384771+0000","last_peered":"2024-03-04T13:00:38.384771+0000","last_clean":"2024-03-04T13:00:38.384771+0000","last_became_active":"2024-03-04T12:36:09.305880+0000","last_became_peered":"2024-03-04T12:36:09.305880+0000","last_unstale":"2024-03-04T13:00:38.384771+0000","last_undegraded":"2024-03-04T13:00:38.384771+0000","last_fullsized":"2024-03-04T13:00:38.384771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:38.384641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:38.384641+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.384641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:47.356519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"256'271","reported_seq":833,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.267303+0000","last_change":"2024-03-04T13:00:26.267303+0000","last_active":"2024-03-04T13:00:26.267303+0000","last_peered":"2024-03-04T13:00:26.267303+0000","last_clean":"2024-03-04T13:00:26.267303+0000","last_became_active":"2024-03-04T12:36:11.327499+0000","last_became_peered":"2024-03-04T12:36:11.327499+0000","last_unstale":"2024-03-04T13:00:26.267303+0000","last_undegraded":"2024-03-04T13:00:26.267303+0000","last_fullsized":"2024-03-04T13:00:26.267303+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'271","last_scrub_stamp":"2024-03-04T13:00:26.267170+0000","last_deep_scrub":"256'271","last_deep_scrub_stamp":"2024-03-04T13:00:26.267170+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.267170+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:41:13.037206+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48450,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":440,"num_read_kb":1012,"num_write":358,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"256'478","reported_seq":1636,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.208567+0000","last_change":"2024-03-04T13:00:23.208567+0000","last_active":"2024-03-04T13:00:23.208567+0000","last_peered":"2024-03-04T13:00:23.208567+0000","last_clean":"2024-03-04T13:00:23.208567+0000","last_became_active":"2024-03-04T12:36:13.337817+0000","last_became_peered":"2024-03-04T12:36:13.337817+0000","last_unstale":"2024-03-04T13:00:23.208567+0000","last_undegraded":"2024-03-04T13:00:23.208567+0000","last_fullsized":"2024-03-04T13:00:23.208567+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'478","last_scrub_stamp":"2024-03-04T13:00:23.208470+0000","last_deep_scrub":"256'478","last_deep_scrub_stamp":"2024-03-04T13:00:23.208470+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.208470+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:45.708499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"256'98","reported_seq":579,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.397842+0000","last_change":"2024-03-04T13:00:32.397876+0000","last_active":"2024-03-04T13:00:32.397842+0000","last_peered":"2024-03-04T13:00:32.397842+0000","last_clean":"2024-03-04T13:00:32.397842+0000","last_became_active":"2024-03-04T12:36:15.348869+0000","last_became_peered":"2024-03-04T12:36:15.348869+0000","last_unstale":"2024-03-04T13:00:32.397842+0000","last_undegraded":"2024-03-04T13:00:32.397842+0000","last_fullsized":"2024-03-04T13:00:32.397842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'98","last_scrub_stamp":"2024-03-04T13:00:32.397750+0000","last_deep_scrub":"256'98","last_deep_scrub_stamp":"2024-03-04T13:00:32.397750+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.397750+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:30.191883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":240,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"256'412","reported_seq":1963,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.018782+0000","last_change":"2024-03-04T13:00:53.018782+0000","last_active":"2024-03-04T13:00:53.018782+0000","last_peered":"2024-03-04T13:00:53.018782+0000","last_clean":"2024-03-04T13:00:53.018782+0000","last_became_active":"2024-03-04T12:36:07.293586+0000","last_became_peered":"2024-03-04T12:36:07.293586+0000","last_unstale":"2024-03-04T13:00:53.018782+0000","last_undegraded":"2024-03-04T13:00:53.018782+0000","last_fullsized":"2024-03-04T13:00:53.018782+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'412","last_scrub_stamp":"2024-03-04T13:00:53.018659+0000","last_deep_scrub":"256'412","last_deep_scrub_stamp":"2024-03-04T13:00:53.018659+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.018659+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:50:33.410647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2259,"num_read_kb":2143,"num_write":486,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"256'342","reported_seq":958,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.063706+0000","last_change":"2024-03-04T13:00:59.063759+0000","last_active":"2024-03-04T13:00:59.063706+0000","last_peered":"2024-03-04T13:00:59.063706+0000","last_clean":"2024-03-04T13:00:59.063706+0000","last_became_active":"2024-03-04T12:36:05.288036+0000","last_became_peered":"2024-03-04T12:36:05.288036+0000","last_unstale":"2024-03-04T13:00:59.063706+0000","last_undegraded":"2024-03-04T13:00:59.063706+0000","last_fullsized":"2024-03-04T13:00:59.063706+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'342","last_scrub_stamp":"2024-03-04T13:00:59.063618+0000","last_deep_scrub":"256'342","last_deep_scrub_stamp":"2024-03-04T13:00:59.063618+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.063618+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:00.285309+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":10713,"num_write":1310,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"256'4","reported_seq":1100,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.211260+0000","last_change":"2024-03-04T13:00:52.211260+0000","last_active":"2024-03-04T13:00:52.211260+0000","last_peered":"2024-03-04T13:00:52.211260+0000","last_clean":"2024-03-04T13:00:52.211260+0000","last_became_active":"2024-03-04T12:36:09.314474+0000","last_became_peered":"2024-03-04T12:36:09.314474+0000","last_unstale":"2024-03-04T13:00:52.211260+0000","last_undegraded":"2024-03-04T13:00:52.211260+0000","last_fullsized":"2024-03-04T13:00:52.211260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:52.211145+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:52.211145+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.211145+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:02:09.880121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":612,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"256'55","reported_seq":551,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.649548+0000","last_change":"2024-03-04T13:00:44.649548+0000","last_active":"2024-03-04T13:00:44.649548+0000","last_peered":"2024-03-04T13:00:44.649548+0000","last_clean":"2024-03-04T13:00:44.649548+0000","last_became_active":"2024-03-04T12:36:11.954508+0000","last_became_peered":"2024-03-04T12:36:11.954508+0000","last_unstale":"2024-03-04T13:00:44.649548+0000","last_undegraded":"2024-03-04T13:00:44.649548+0000","last_fullsized":"2024-03-04T13:00:44.649548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'55","last_scrub_stamp":"2024-03-04T13:00:44.649433+0000","last_deep_scrub":"256'55","last_deep_scrub_stamp":"2024-03-04T13:00:44.649433+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.649433+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:35:51.668769+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"256'482","reported_seq":1507,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.725817+0000","last_change":"2024-03-04T13:00:34.725817+0000","last_active":"2024-03-04T13:00:34.725817+0000","last_peered":"2024-03-04T13:00:34.725817+0000","last_clean":"2024-03-04T13:00:34.725817+0000","last_became_active":"2024-03-04T12:36:13.342902+0000","last_became_peered":"2024-03-04T12:36:13.342902+0000","last_unstale":"2024-03-04T13:00:34.725817+0000","last_undegraded":"2024-03-04T13:00:34.725817+0000","last_fullsized":"2024-03-04T13:00:34.725817+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'482","last_scrub_stamp":"2024-03-04T13:00:34.725632+0000","last_deep_scrub":"256'482","last_deep_scrub_stamp":"2024-03-04T13:00:34.725632+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.725632+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:32:27.798918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"256'94","reported_seq":577,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.163741+0000","last_change":"2024-03-04T13:00:29.163768+0000","last_active":"2024-03-04T13:00:29.163741+0000","last_peered":"2024-03-04T13:00:29.163741+0000","last_clean":"2024-03-04T13:00:29.163741+0000","last_became_active":"2024-03-04T12:36:15.352420+0000","last_became_peered":"2024-03-04T12:36:15.352420+0000","last_unstale":"2024-03-04T13:00:29.163741+0000","last_undegraded":"2024-03-04T13:00:29.163741+0000","last_fullsized":"2024-03-04T13:00:29.163741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'94","last_scrub_stamp":"2024-03-04T13:00:29.163620+0000","last_deep_scrub":"256'94","last_deep_scrub_stamp":"2024-03-04T13:00:29.163620+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.163620+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:10.290561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":79,"num_write":205,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"256'1080","reported_seq":2464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.358804+0000","last_change":"2024-03-04T13:00:37.358804+0000","last_active":"2024-03-04T13:00:37.358804+0000","last_peered":"2024-03-04T13:00:37.358804+0000","last_clean":"2024-03-04T13:00:37.358804+0000","last_became_active":"2024-03-04T12:36:07.304123+0000","last_became_peered":"2024-03-04T12:36:07.304123+0000","last_unstale":"2024-03-04T13:00:37.358804+0000","last_undegraded":"2024-03-04T13:00:37.358804+0000","last_fullsized":"2024-03-04T13:00:37.358804+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1080","last_scrub_stamp":"2024-03-04T13:00:37.358634+0000","last_deep_scrub":"256'1080","last_deep_scrub_stamp":"2024-03-04T13:00:37.358634+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.358634+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":1000,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:25:48.734892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4358,"num_read_kb":3794,"num_write":1486,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'366","reported_seq":991,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.104112+0000","last_change":"2024-03-04T12:36:05.286870+0000","last_active":"2024-03-04T13:00:17.104112+0000","last_peered":"2024-03-04T13:00:17.104112+0000","last_clean":"2024-03-04T13:00:17.104112+0000","last_became_active":"2024-03-04T12:36:05.286442+0000","last_became_peered":"2024-03-04T12:36:05.286442+0000","last_unstale":"2024-03-04T13:00:17.104112+0000","last_undegraded":"2024-03-04T13:00:17.104112+0000","last_fullsized":"2024-03-04T13:00:17.104112+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":497,"num_read_kb":22844,"num_write":1305,"num_write_kb":40494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.093878+0000","last_change":"2024-03-04T12:36:09.314992+0000","last_active":"2024-03-04T13:00:23.093878+0000","last_peered":"2024-03-04T13:00:23.093878+0000","last_clean":"2024-03-04T13:00:23.093878+0000","last_became_active":"2024-03-04T12:36:09.314671+0000","last_became_peered":"2024-03-04T12:36:09.314671+0000","last_unstale":"2024-03-04T13:00:23.093878+0000","last_undegraded":"2024-03-04T13:00:23.093878+0000","last_fullsized":"2024-03-04T13:00:23.093878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"256'299","reported_seq":876,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.182629+0000","last_change":"2024-03-04T13:00:56.182710+0000","last_active":"2024-03-04T13:00:56.182629+0000","last_peered":"2024-03-04T13:00:56.182629+0000","last_clean":"2024-03-04T13:00:56.182629+0000","last_became_active":"2024-03-04T12:36:11.325372+0000","last_became_peered":"2024-03-04T12:36:11.325372+0000","last_unstale":"2024-03-04T13:00:56.182629+0000","last_undegraded":"2024-03-04T13:00:56.182629+0000","last_fullsized":"2024-03-04T13:00:56.182629+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'299","last_scrub_stamp":"2024-03-04T13:00:56.182525+0000","last_deep_scrub":"256'299","last_deep_scrub_stamp":"2024-03-04T13:00:56.182525+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.182525+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:34.592405+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47142,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1045,"num_read_kb":1555,"num_write":1526,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476198,"num_omap_keys":1104,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.746192+0000","last_change":"2024-03-04T13:00:40.746192+0000","last_active":"2024-03-04T13:00:40.746192+0000","last_peered":"2024-03-04T13:00:40.746192+0000","last_clean":"2024-03-04T13:00:40.746192+0000","last_became_active":"2024-03-04T12:36:13.348998+0000","last_became_peered":"2024-03-04T12:36:13.348998+0000","last_unstale":"2024-03-04T13:00:40.746192+0000","last_undegraded":"2024-03-04T13:00:40.746192+0000","last_fullsized":"2024-03-04T13:00:40.746192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.746068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.746068+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.746068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:09.551212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"256'117","reported_seq":606,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.417321+0000","last_change":"2024-03-04T13:00:29.417352+0000","last_active":"2024-03-04T13:00:29.417321+0000","last_peered":"2024-03-04T13:00:29.417321+0000","last_clean":"2024-03-04T13:00:29.417321+0000","last_became_active":"2024-03-04T12:36:15.362792+0000","last_became_peered":"2024-03-04T12:36:15.362792+0000","last_unstale":"2024-03-04T13:00:29.417321+0000","last_undegraded":"2024-03-04T13:00:29.417321+0000","last_fullsized":"2024-03-04T13:00:29.417321+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'117","last_scrub_stamp":"2024-03-04T13:00:29.417189+0000","last_deep_scrub":"256'117","last_deep_scrub_stamp":"2024-03-04T13:00:29.417189+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.417189+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:57.741359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":132,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"256'319","reported_seq":1686,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.785830+0000","last_change":"2024-03-04T13:00:43.785872+0000","last_active":"2024-03-04T13:00:43.785830+0000","last_peered":"2024-03-04T13:00:43.785830+0000","last_clean":"2024-03-04T13:00:43.785830+0000","last_became_active":"2024-03-04T12:36:07.299952+0000","last_became_peered":"2024-03-04T12:36:07.299952+0000","last_unstale":"2024-03-04T13:00:43.785830+0000","last_undegraded":"2024-03-04T13:00:43.785830+0000","last_fullsized":"2024-03-04T13:00:43.785830+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'319","last_scrub_stamp":"2024-03-04T13:00:43.785742+0000","last_deep_scrub":"256'319","last_deep_scrub_stamp":"2024-03-04T13:00:43.785742+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.785742+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:17.256676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1855,"num_read_kb":1767,"num_write":364,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1113,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":650,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.902521+0000","last_change":"2024-03-04T12:35:47.950593+0000","last_active":"2024-03-04T12:59:55.902521+0000","last_peered":"2024-03-04T12:59:55.902521+0000","last_clean":"2024-03-04T12:59:55.902521+0000","last_became_active":"2024-03-04T12:35:47.950213+0000","last_became_peered":"2024-03-04T12:35:47.950213+0000","last_unstale":"2024-03-04T12:59:55.902521+0000","last_undegraded":"2024-03-04T12:59:55.902521+0000","last_fullsized":"2024-03-04T12:59:55.902521+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:46.856449+0000","last_clean_scrub_stamp":"2024-03-04T12:35:46.856449+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":499,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.188399+0000","last_change":"2024-03-04T13:00:58.188421+0000","last_active":"2024-03-04T13:00:58.188399+0000","last_peered":"2024-03-04T13:00:58.188399+0000","last_clean":"2024-03-04T13:00:58.188399+0000","last_became_active":"2024-03-04T12:35:54.234819+0000","last_became_peered":"2024-03-04T12:35:54.234819+0000","last_unstale":"2024-03-04T13:00:58.188399+0000","last_undegraded":"2024-03-04T13:00:58.188399+0000","last_fullsized":"2024-03-04T13:00:58.188399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:58.188275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:58.188275+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.188275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:43:54.039632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"256'312","reported_seq":922,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.128673+0000","last_change":"2024-03-04T12:36:05.297146+0000","last_active":"2024-03-04T13:00:17.128673+0000","last_peered":"2024-03-04T13:00:17.128673+0000","last_clean":"2024-03-04T13:00:17.128673+0000","last_became_active":"2024-03-04T12:36:05.296783+0000","last_became_peered":"2024-03-04T12:36:05.296783+0000","last_unstale":"2024-03-04T13:00:17.128673+0000","last_undegraded":"2024-03-04T13:00:17.128673+0000","last_fullsized":"2024-03-04T13:00:17.128673+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":460,"num_read_kb":16805,"num_write":1147,"num_write_kb":27899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.282118+0000","last_change":"2024-03-04T13:00:51.282178+0000","last_active":"2024-03-04T13:00:51.282118+0000","last_peered":"2024-03-04T13:00:51.282118+0000","last_clean":"2024-03-04T13:00:51.282118+0000","last_became_active":"2024-03-04T12:36:09.306398+0000","last_became_peered":"2024-03-04T12:36:09.306398+0000","last_unstale":"2024-03-04T13:00:51.282118+0000","last_undegraded":"2024-03-04T13:00:51.282118+0000","last_fullsized":"2024-03-04T13:00:51.282118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:51.282015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:51.282015+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.282015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:22.916364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"256'664","reported_seq":1348,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.333621+0000","last_change":"2024-03-04T13:00:41.333662+0000","last_active":"2024-03-04T13:00:41.333621+0000","last_peered":"2024-03-04T13:00:41.333621+0000","last_clean":"2024-03-04T13:00:41.333621+0000","last_became_active":"2024-03-04T12:36:11.327652+0000","last_became_peered":"2024-03-04T12:36:11.327652+0000","last_unstale":"2024-03-04T13:00:41.333621+0000","last_undegraded":"2024-03-04T13:00:41.333621+0000","last_fullsized":"2024-03-04T13:00:41.333621+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'664","last_scrub_stamp":"2024-03-04T13:00:41.333537+0000","last_deep_scrub":"256'664","last_deep_scrub_stamp":"2024-03-04T13:00:41.333537+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.333537+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:37.486661+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140555,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1295,"num_read_kb":2979,"num_write":1188,"num_write_kb":1057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89476,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.466652+0000","last_change":"2024-03-04T13:00:44.466699+0000","last_active":"2024-03-04T13:00:44.466652+0000","last_peered":"2024-03-04T13:00:44.466652+0000","last_clean":"2024-03-04T13:00:44.466652+0000","last_became_active":"2024-03-04T12:36:13.341629+0000","last_became_peered":"2024-03-04T12:36:13.341629+0000","last_unstale":"2024-03-04T13:00:44.466652+0000","last_undegraded":"2024-03-04T13:00:44.466652+0000","last_fullsized":"2024-03-04T13:00:44.466652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:44.466543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:44.466543+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.466543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:58.569289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"256'96","reported_seq":581,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.797113+0000","last_change":"2024-03-04T13:00:46.797172+0000","last_active":"2024-03-04T13:00:46.797113+0000","last_peered":"2024-03-04T13:00:46.797113+0000","last_clean":"2024-03-04T13:00:46.797113+0000","last_became_active":"2024-03-04T12:36:15.363355+0000","last_became_peered":"2024-03-04T12:36:15.363355+0000","last_unstale":"2024-03-04T13:00:46.797113+0000","last_undegraded":"2024-03-04T13:00:46.797113+0000","last_fullsized":"2024-03-04T13:00:46.797113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'96","last_scrub_stamp":"2024-03-04T13:00:46.797000+0000","last_deep_scrub":"256'96","last_deep_scrub_stamp":"2024-03-04T13:00:46.797000+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.797000+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:12:15.727811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"256'354","reported_seq":1797,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.447743+0000","last_change":"2024-03-04T13:00:51.447772+0000","last_active":"2024-03-04T13:00:51.447743+0000","last_peered":"2024-03-04T13:00:51.447743+0000","last_clean":"2024-03-04T13:00:51.447743+0000","last_became_active":"2024-03-04T12:36:07.301706+0000","last_became_peered":"2024-03-04T12:36:07.301706+0000","last_unstale":"2024-03-04T13:00:51.447743+0000","last_undegraded":"2024-03-04T13:00:51.447743+0000","last_fullsized":"2024-03-04T13:00:51.447743+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'354","last_scrub_stamp":"2024-03-04T13:00:51.447652+0000","last_deep_scrub":"256'354","last_deep_scrub_stamp":"2024-03-04T13:00:51.447652+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.447652+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:01:03.325657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2015,"num_read_kb":1927,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":494,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:00.903311+0000","last_change":"2024-03-04T12:35:54.238692+0000","last_active":"2024-03-04T13:00:00.903311+0000","last_peered":"2024-03-04T13:00:00.903311+0000","last_clean":"2024-03-04T13:00:00.903311+0000","last_became_active":"2024-03-04T12:35:54.238351+0000","last_became_peered":"2024-03-04T12:35:54.238351+0000","last_unstale":"2024-03-04T13:00:00.903311+0000","last_undegraded":"2024-03-04T13:00:00.903311+0000","last_fullsized":"2024-03-04T13:00:00.903311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"256'386","reported_seq":1051,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.120813+0000","last_change":"2024-03-04T12:36:05.285992+0000","last_active":"2024-03-04T13:00:17.120813+0000","last_peered":"2024-03-04T13:00:17.120813+0000","last_clean":"2024-03-04T13:00:17.120813+0000","last_became_active":"2024-03-04T12:36:05.285659+0000","last_became_peered":"2024-03-04T12:36:05.285659+0000","last_unstale":"2024-03-04T13:00:17.120813+0000","last_undegraded":"2024-03-04T13:00:17.120813+0000","last_fullsized":"2024-03-04T13:00:17.120813+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2160246,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":21923,"num_write":1294,"num_write_kb":32530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.208898+0000","last_change":"2024-03-04T13:00:50.208920+0000","last_active":"2024-03-04T13:00:50.208898+0000","last_peered":"2024-03-04T13:00:50.208898+0000","last_clean":"2024-03-04T13:00:50.208898+0000","last_became_active":"2024-03-04T12:36:09.314113+0000","last_became_peered":"2024-03-04T12:36:09.314113+0000","last_unstale":"2024-03-04T13:00:50.208898+0000","last_undegraded":"2024-03-04T13:00:50.208898+0000","last_fullsized":"2024-03-04T13:00:50.208898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:50.208809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:50.208809+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.208809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:28.234707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"256'1026","reported_seq":2149,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.444336+0000","last_change":"2024-03-04T13:00:46.444407+0000","last_active":"2024-03-04T13:00:46.444336+0000","last_peered":"2024-03-04T13:00:46.444336+0000","last_clean":"2024-03-04T13:00:46.444336+0000","last_became_active":"2024-03-04T12:36:11.323543+0000","last_became_peered":"2024-03-04T12:36:11.323543+0000","last_unstale":"2024-03-04T13:00:46.444336+0000","last_undegraded":"2024-03-04T13:00:46.444336+0000","last_fullsized":"2024-03-04T13:00:46.444336+0000","mapping_epoch":26,"log_start":"256'1000","ondisk_log_start":"256'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1026","last_scrub_stamp":"2024-03-04T13:00:46.444243+0000","last_deep_scrub":"256'1026","last_deep_scrub_stamp":"2024-03-04T13:00:46.444243+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.444243+0000","objects_scrubbed":11,"log_size":26,"log_dups_size":1000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:41.355661+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157019,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1614,"num_read_kb":3260,"num_write":972,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.288069+0000","last_change":"2024-03-04T13:00:40.288095+0000","last_active":"2024-03-04T13:00:40.288069+0000","last_peered":"2024-03-04T13:00:40.288069+0000","last_clean":"2024-03-04T13:00:40.288069+0000","last_became_active":"2024-03-04T12:36:13.339353+0000","last_became_peered":"2024-03-04T12:36:13.339353+0000","last_unstale":"2024-03-04T13:00:40.288069+0000","last_undegraded":"2024-03-04T13:00:40.288069+0000","last_fullsized":"2024-03-04T13:00:40.288069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.287960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.287960+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.287960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:16:46.922748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"256'147","reported_seq":643,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.399242+0000","last_change":"2024-03-04T13:00:33.399271+0000","last_active":"2024-03-04T13:00:33.399242+0000","last_peered":"2024-03-04T13:00:33.399242+0000","last_clean":"2024-03-04T13:00:33.399242+0000","last_became_active":"2024-03-04T12:36:15.346516+0000","last_became_peered":"2024-03-04T12:36:15.346516+0000","last_unstale":"2024-03-04T13:00:33.399242+0000","last_undegraded":"2024-03-04T13:00:33.399242+0000","last_fullsized":"2024-03-04T13:00:33.399242+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'147","last_scrub_stamp":"2024-03-04T13:00:33.399158+0000","last_deep_scrub":"256'147","last_deep_scrub_stamp":"2024-03-04T13:00:33.399158+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.399158+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:04.057962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":196,"num_read_kb":196,"num_write":318,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"256'399","reported_seq":1877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.414666+0000","last_change":"2024-03-04T13:00:39.414706+0000","last_active":"2024-03-04T13:00:39.414666+0000","last_peered":"2024-03-04T13:00:39.414666+0000","last_clean":"2024-03-04T13:00:39.414666+0000","last_became_active":"2024-03-04T12:36:07.300039+0000","last_became_peered":"2024-03-04T12:36:07.300039+0000","last_unstale":"2024-03-04T13:00:39.414666+0000","last_undegraded":"2024-03-04T13:00:39.414666+0000","last_fullsized":"2024-03-04T13:00:39.414666+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'399","last_scrub_stamp":"2024-03-04T13:00:39.414579+0000","last_deep_scrub":"256'399","last_deep_scrub_stamp":"2024-03-04T13:00:39.414579+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.414579+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:09.710256+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2349,"num_read_kb":2220,"num_write":468,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":238,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":502,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.223911+0000","last_change":"2024-03-04T13:00:39.223911+0000","last_active":"2024-03-04T13:00:39.223911+0000","last_peered":"2024-03-04T13:00:39.223911+0000","last_clean":"2024-03-04T13:00:39.223911+0000","last_became_active":"2024-03-04T12:35:54.235738+0000","last_became_peered":"2024-03-04T12:35:54.235738+0000","last_unstale":"2024-03-04T13:00:39.223911+0000","last_undegraded":"2024-03-04T13:00:39.223911+0000","last_fullsized":"2024-03-04T13:00:39.223911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.223775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.223775+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.223775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:54:59.767057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"256'383","reported_seq":1280,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.407677+0000","last_change":"2024-03-04T13:00:54.407717+0000","last_active":"2024-03-04T13:00:54.407677+0000","last_peered":"2024-03-04T13:00:54.407677+0000","last_clean":"2024-03-04T13:00:54.407677+0000","last_became_active":"2024-03-04T12:36:05.274788+0000","last_became_peered":"2024-03-04T12:36:05.274788+0000","last_unstale":"2024-03-04T13:00:54.407677+0000","last_undegraded":"2024-03-04T13:00:54.407677+0000","last_fullsized":"2024-03-04T13:00:54.407677+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'383","last_scrub_stamp":"2024-03-04T13:00:54.407587+0000","last_deep_scrub":"256'383","last_deep_scrub_stamp":"2024-03-04T13:00:54.407587+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.407587+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:09:42.717881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069328,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1100,"num_read_kb":10802,"num_write":1447,"num_write_kb":39091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"256'2","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.318641+0000","last_change":"2024-03-04T13:00:30.318672+0000","last_active":"2024-03-04T13:00:30.318641+0000","last_peered":"2024-03-04T13:00:30.318641+0000","last_clean":"2024-03-04T13:00:30.318641+0000","last_became_active":"2024-03-04T12:36:09.315023+0000","last_became_peered":"2024-03-04T12:36:09.315023+0000","last_unstale":"2024-03-04T13:00:30.318641+0000","last_undegraded":"2024-03-04T13:00:30.318641+0000","last_fullsized":"2024-03-04T13:00:30.318641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:30.318544+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:30.318544+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.318544+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:46.009625+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"256'197","reported_seq":1010,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.322539+0000","last_change":"2024-03-04T13:00:44.322586+0000","last_active":"2024-03-04T13:00:44.322539+0000","last_peered":"2024-03-04T13:00:44.322539+0000","last_clean":"2024-03-04T13:00:44.322539+0000","last_became_active":"2024-03-04T12:36:11.954554+0000","last_became_peered":"2024-03-04T12:36:11.954554+0000","last_unstale":"2024-03-04T13:00:44.322539+0000","last_undegraded":"2024-03-04T13:00:44.322539+0000","last_fullsized":"2024-03-04T13:00:44.322539+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'197","last_scrub_stamp":"2024-03-04T13:00:44.322449+0000","last_deep_scrub":"256'197","last_deep_scrub_stamp":"2024-03-04T13:00:44.322449+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.322449+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:26:55.878031+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.457479+0000","last_change":"2024-03-04T13:00:47.457507+0000","last_active":"2024-03-04T13:00:47.457479+0000","last_peered":"2024-03-04T13:00:47.457479+0000","last_clean":"2024-03-04T13:00:47.457479+0000","last_became_active":"2024-03-04T12:36:13.338388+0000","last_became_peered":"2024-03-04T12:36:13.338388+0000","last_unstale":"2024-03-04T13:00:47.457479+0000","last_undegraded":"2024-03-04T13:00:47.457479+0000","last_fullsized":"2024-03-04T13:00:47.457479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:47.457344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:47.457344+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.457344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:51.534303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'194","reported_seq":694,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.827539+0000","last_change":"2024-03-04T13:00:33.827539+0000","last_active":"2024-03-04T13:00:33.827539+0000","last_peered":"2024-03-04T13:00:33.827539+0000","last_clean":"2024-03-04T13:00:33.827539+0000","last_became_active":"2024-03-04T12:36:15.353529+0000","last_became_peered":"2024-03-04T12:36:15.353529+0000","last_unstale":"2024-03-04T13:00:33.827539+0000","last_undegraded":"2024-03-04T13:00:33.827539+0000","last_fullsized":"2024-03-04T13:00:33.827539+0000","mapping_epoch":30,"log_start":"241'100","ondisk_log_start":"241'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'194","last_scrub_stamp":"2024-03-04T13:00:33.827362+0000","last_deep_scrub":"256'194","last_deep_scrub_stamp":"2024-03-04T13:00:33.827362+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.827362+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:43.745434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":292,"num_read_kb":316,"num_write":426,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"256'397","reported_seq":1835,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.407802+0000","last_change":"2024-03-04T13:00:45.407849+0000","last_active":"2024-03-04T13:00:45.407802+0000","last_peered":"2024-03-04T13:00:45.407802+0000","last_clean":"2024-03-04T13:00:45.407802+0000","last_became_active":"2024-03-04T12:36:07.298936+0000","last_became_peered":"2024-03-04T12:36:07.298936+0000","last_unstale":"2024-03-04T13:00:45.407802+0000","last_undegraded":"2024-03-04T13:00:45.407802+0000","last_fullsized":"2024-03-04T13:00:45.407802+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'397","last_scrub_stamp":"2024-03-04T13:00:45.407700+0000","last_deep_scrub":"256'397","last_deep_scrub_stamp":"2024-03-04T13:00:45.407700+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.407700+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:39.109200+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2152,"num_read_kb":2018,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":303,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":499,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.157814+0000","last_change":"2024-03-04T13:00:59.157861+0000","last_active":"2024-03-04T13:00:59.157814+0000","last_peered":"2024-03-04T13:00:59.157814+0000","last_clean":"2024-03-04T13:00:59.157814+0000","last_became_active":"2024-03-04T12:35:54.238357+0000","last_became_peered":"2024-03-04T12:35:54.238357+0000","last_unstale":"2024-03-04T13:00:59.157814+0000","last_undegraded":"2024-03-04T13:00:59.157814+0000","last_fullsized":"2024-03-04T13:00:59.157814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:59.157718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:59.157718+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.157718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:53:58.649409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"256'334","reported_seq":991,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.980353+0000","last_change":"2024-03-04T13:01:00.980439+0000","last_active":"2024-03-04T13:01:00.980353+0000","last_peered":"2024-03-04T13:01:00.980353+0000","last_clean":"2024-03-04T13:01:00.980353+0000","last_became_active":"2024-03-04T12:36:05.289374+0000","last_became_peered":"2024-03-04T12:36:05.289374+0000","last_unstale":"2024-03-04T13:01:00.980353+0000","last_undegraded":"2024-03-04T13:01:00.980353+0000","last_fullsized":"2024-03-04T13:01:00.980353+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'334","last_scrub_stamp":"2024-03-04T13:01:00.980244+0000","last_deep_scrub":"256'334","last_deep_scrub_stamp":"2024-03-04T13:01:00.980244+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.980244+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:41:14.403992+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007111,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":531,"num_read_kb":54492,"num_write":1276,"num_write_kb":39662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.442873+0000","last_change":"2024-03-04T13:00:50.442910+0000","last_active":"2024-03-04T13:00:50.442873+0000","last_peered":"2024-03-04T13:00:50.442873+0000","last_clean":"2024-03-04T13:00:50.442873+0000","last_became_active":"2024-03-04T12:36:09.304291+0000","last_became_peered":"2024-03-04T12:36:09.304291+0000","last_unstale":"2024-03-04T13:00:50.442873+0000","last_undegraded":"2024-03-04T13:00:50.442873+0000","last_fullsized":"2024-03-04T13:00:50.442873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:50.442748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:50.442748+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.442748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:31:23.711297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"256'88","reported_seq":602,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.668262+0000","last_change":"2024-03-04T13:00:45.668289+0000","last_active":"2024-03-04T13:00:45.668262+0000","last_peered":"2024-03-04T13:00:45.668262+0000","last_clean":"2024-03-04T13:00:45.668262+0000","last_became_active":"2024-03-04T12:36:11.325957+0000","last_became_peered":"2024-03-04T12:36:11.325957+0000","last_unstale":"2024-03-04T13:00:45.668262+0000","last_undegraded":"2024-03-04T13:00:45.668262+0000","last_fullsized":"2024-03-04T13:00:45.668262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'88","last_scrub_stamp":"2024-03-04T13:00:45.668192+0000","last_deep_scrub":"256'88","last_deep_scrub_stamp":"2024-03-04T13:00:45.668192+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.668192+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:10.706687+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":66,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1504,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.754977+0000","last_change":"2024-03-04T13:00:36.755000+0000","last_active":"2024-03-04T13:00:36.754977+0000","last_peered":"2024-03-04T13:00:36.754977+0000","last_clean":"2024-03-04T13:00:36.754977+0000","last_became_active":"2024-03-04T12:36:13.345547+0000","last_became_peered":"2024-03-04T12:36:13.345547+0000","last_unstale":"2024-03-04T13:00:36.754977+0000","last_undegraded":"2024-03-04T13:00:36.754977+0000","last_fullsized":"2024-03-04T13:00:36.754977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:36.754882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:36.754882+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.754882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:11.105892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"256'111","reported_seq":607,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.437171+0000","last_change":"2024-03-04T13:00:31.437195+0000","last_active":"2024-03-04T13:00:31.437171+0000","last_peered":"2024-03-04T13:00:31.437171+0000","last_clean":"2024-03-04T13:00:31.437171+0000","last_became_active":"2024-03-04T12:36:15.363185+0000","last_became_peered":"2024-03-04T12:36:15.363185+0000","last_unstale":"2024-03-04T13:00:31.437171+0000","last_undegraded":"2024-03-04T13:00:31.437171+0000","last_fullsized":"2024-03-04T13:00:31.437171+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'111","last_scrub_stamp":"2024-03-04T13:00:31.437082+0000","last_deep_scrub":"256'111","last_deep_scrub_stamp":"2024-03-04T13:00:31.437082+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.437082+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:45.642975+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":251,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"256'468","reported_seq":2020,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.430641+0000","last_change":"2024-03-04T13:00:49.430671+0000","last_active":"2024-03-04T13:00:49.430641+0000","last_peered":"2024-03-04T13:00:49.430641+0000","last_clean":"2024-03-04T13:00:49.430641+0000","last_became_active":"2024-03-04T12:36:07.296433+0000","last_became_peered":"2024-03-04T12:36:07.296433+0000","last_unstale":"2024-03-04T13:00:49.430641+0000","last_undegraded":"2024-03-04T13:00:49.430641+0000","last_fullsized":"2024-03-04T13:00:49.430641+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'468","last_scrub_stamp":"2024-03-04T13:00:49.430550+0000","last_deep_scrub":"256'468","last_deep_scrub_stamp":"2024-03-04T13:00:49.430550+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.430550+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:47:32.639732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2396,"num_read_kb":2259,"num_write":579,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"256'399","reported_seq":1061,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.531144+0000","last_change":"2024-03-04T13:00:27.531193+0000","last_active":"2024-03-04T13:00:27.531144+0000","last_peered":"2024-03-04T13:00:27.531144+0000","last_clean":"2024-03-04T13:00:27.531144+0000","last_became_active":"2024-03-04T12:36:40.965346+0000","last_became_peered":"2024-03-04T12:36:40.965346+0000","last_unstale":"2024-03-04T13:00:27.531144+0000","last_undegraded":"2024-03-04T13:00:27.531144+0000","last_fullsized":"2024-03-04T13:00:27.531144+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'399","last_scrub_stamp":"2024-03-04T13:00:27.531051+0000","last_deep_scrub":"256'399","last_deep_scrub_stamp":"2024-03-04T13:00:27.531051+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.531051+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:45:37.677827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":48879,"num_write":1467,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":503,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.381690+0000","last_change":"2024-03-04T13:00:53.381690+0000","last_active":"2024-03-04T13:00:53.381690+0000","last_peered":"2024-03-04T13:00:53.381690+0000","last_clean":"2024-03-04T13:00:53.381690+0000","last_became_active":"2024-03-04T12:35:54.470407+0000","last_became_peered":"2024-03-04T12:35:54.470407+0000","last_unstale":"2024-03-04T13:00:53.381690+0000","last_undegraded":"2024-03-04T13:00:53.381690+0000","last_fullsized":"2024-03-04T13:00:53.381690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:53.381569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:53.381569+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.381569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:59.668953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.498163+0000","last_change":"2024-03-04T13:00:54.498186+0000","last_active":"2024-03-04T13:00:54.498163+0000","last_peered":"2024-03-04T13:00:54.498163+0000","last_clean":"2024-03-04T13:00:54.498163+0000","last_became_active":"2024-03-04T12:36:09.308360+0000","last_became_peered":"2024-03-04T12:36:09.308360+0000","last_unstale":"2024-03-04T13:00:54.498163+0000","last_undegraded":"2024-03-04T13:00:54.498163+0000","last_fullsized":"2024-03-04T13:00:54.498163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:54.498073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:54.498073+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.498073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:18.124641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"256'488","reported_seq":1113,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:16.880966+0000","last_change":"2024-03-04T12:36:11.329225+0000","last_active":"2024-03-04T13:00:16.880966+0000","last_peered":"2024-03-04T13:00:16.880966+0000","last_clean":"2024-03-04T13:00:16.880966+0000","last_became_active":"2024-03-04T12:36:11.328923+0000","last_became_peered":"2024-03-04T12:36:11.328923+0000","last_unstale":"2024-03-04T13:00:16.880966+0000","last_undegraded":"2024-03-04T13:00:16.880966+0000","last_fullsized":"2024-03-04T13:00:16.880966+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93633,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":843,"num_read_kb":1937,"num_write":680,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.115413+0000","last_change":"2024-03-04T13:00:31.115438+0000","last_active":"2024-03-04T13:00:31.115413+0000","last_peered":"2024-03-04T13:00:31.115413+0000","last_clean":"2024-03-04T13:00:31.115413+0000","last_became_active":"2024-03-04T12:36:13.346886+0000","last_became_peered":"2024-03-04T12:36:13.346886+0000","last_unstale":"2024-03-04T13:00:31.115413+0000","last_undegraded":"2024-03-04T13:00:31.115413+0000","last_fullsized":"2024-03-04T13:00:31.115413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:31.115320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:31.115320+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.115320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:25:44.557397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"256'95","reported_seq":584,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.588562+0000","last_change":"2024-03-04T13:00:37.588562+0000","last_active":"2024-03-04T13:00:37.588562+0000","last_peered":"2024-03-04T13:00:37.588562+0000","last_clean":"2024-03-04T13:00:37.588562+0000","last_became_active":"2024-03-04T12:36:15.350185+0000","last_became_peered":"2024-03-04T12:36:15.350185+0000","last_unstale":"2024-03-04T13:00:37.588562+0000","last_undegraded":"2024-03-04T13:00:37.588562+0000","last_fullsized":"2024-03-04T13:00:37.588562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'95","last_scrub_stamp":"2024-03-04T13:00:37.588450+0000","last_deep_scrub":"256'95","last_deep_scrub_stamp":"2024-03-04T13:00:37.588450+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.588450+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:31.645524+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":228,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"256'646","reported_seq":2017,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.458838+0000","last_change":"2024-03-04T13:00:57.458865+0000","last_active":"2024-03-04T13:00:57.458838+0000","last_peered":"2024-03-04T13:00:57.458838+0000","last_clean":"2024-03-04T13:00:57.458838+0000","last_became_active":"2024-03-04T12:36:07.296657+0000","last_became_peered":"2024-03-04T12:36:07.296657+0000","last_unstale":"2024-03-04T13:00:57.458838+0000","last_undegraded":"2024-03-04T13:00:57.458838+0000","last_fullsized":"2024-03-04T13:00:57.458838+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'646","last_scrub_stamp":"2024-03-04T13:00:57.458741+0000","last_deep_scrub":"256'646","last_deep_scrub_stamp":"2024-03-04T13:00:57.458741+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.458741+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":600,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:07.456998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3068,"num_read_kb":2828,"num_write":988,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"256'353","reported_seq":1035,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.432906+0000","last_change":"2024-03-04T13:00:55.432972+0000","last_active":"2024-03-04T13:00:55.432906+0000","last_peered":"2024-03-04T13:00:55.432906+0000","last_clean":"2024-03-04T13:00:55.432906+0000","last_became_active":"2024-03-04T12:36:05.275263+0000","last_became_peered":"2024-03-04T12:36:05.275263+0000","last_unstale":"2024-03-04T13:00:55.432906+0000","last_undegraded":"2024-03-04T13:00:55.432906+0000","last_fullsized":"2024-03-04T13:00:55.432906+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'353","last_scrub_stamp":"2024-03-04T13:00:55.432812+0000","last_deep_scrub":"256'353","last_deep_scrub_stamp":"2024-03-04T13:00:55.432812+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.432812+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:22:54.562917+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":637,"num_read_kb":62539,"num_write":1435,"num_write_kb":42561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":494,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.483007+0000","last_change":"2024-03-04T12:35:54.470913+0000","last_active":"2024-03-04T13:00:24.483007+0000","last_peered":"2024-03-04T13:00:24.483007+0000","last_clean":"2024-03-04T13:00:24.483007+0000","last_became_active":"2024-03-04T12:35:54.470620+0000","last_became_peered":"2024-03-04T12:35:54.470620+0000","last_unstale":"2024-03-04T13:00:24.483007+0000","last_undegraded":"2024-03-04T13:00:24.483007+0000","last_fullsized":"2024-03-04T13:00:24.483007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:35:53.217772+0000","last_clean_scrub_stamp":"2024-03-04T12:35:53.217772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.717088+0000","last_change":"2024-03-04T13:00:35.717113+0000","last_active":"2024-03-04T13:00:35.717088+0000","last_peered":"2024-03-04T13:00:35.717088+0000","last_clean":"2024-03-04T13:00:35.717088+0000","last_became_active":"2024-03-04T12:36:09.312135+0000","last_became_peered":"2024-03-04T12:36:09.312135+0000","last_unstale":"2024-03-04T13:00:35.717088+0000","last_undegraded":"2024-03-04T13:00:35.717088+0000","last_fullsized":"2024-03-04T13:00:35.717088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:35.716987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:35.716987+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.716987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:24.039129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"256'147","reported_seq":682,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.408228+0000","last_change":"2024-03-04T13:00:48.408264+0000","last_active":"2024-03-04T13:00:48.408228+0000","last_peered":"2024-03-04T13:00:48.408228+0000","last_clean":"2024-03-04T13:00:48.408228+0000","last_became_active":"2024-03-04T12:36:11.954579+0000","last_became_peered":"2024-03-04T12:36:11.954579+0000","last_unstale":"2024-03-04T13:00:48.408228+0000","last_undegraded":"2024-03-04T13:00:48.408228+0000","last_fullsized":"2024-03-04T13:00:48.408228+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'147","last_scrub_stamp":"2024-03-04T13:00:48.408112+0000","last_deep_scrub":"256'147","last_deep_scrub_stamp":"2024-03-04T13:00:48.408112+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.408112+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:32.843468+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":130,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2634,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"256'546","reported_seq":4073,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.400731+0000","last_change":"2024-03-04T13:00:38.400757+0000","last_active":"2024-03-04T13:00:38.400731+0000","last_peered":"2024-03-04T13:00:38.400731+0000","last_clean":"2024-03-04T13:00:38.400731+0000","last_became_active":"2024-03-04T12:36:13.341957+0000","last_became_peered":"2024-03-04T12:36:13.341957+0000","last_unstale":"2024-03-04T13:00:38.400731+0000","last_undegraded":"2024-03-04T13:00:38.400731+0000","last_fullsized":"2024-03-04T13:00:38.400731+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'546","last_scrub_stamp":"2024-03-04T13:00:38.400627+0000","last_deep_scrub":"256'546","last_deep_scrub_stamp":"2024-03-04T13:00:38.400627+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.400627+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:17.663169+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"256'125","reported_seq":608,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.712845+0000","last_change":"2024-03-04T13:00:29.712845+0000","last_active":"2024-03-04T13:00:29.712845+0000","last_peered":"2024-03-04T13:00:29.712845+0000","last_clean":"2024-03-04T13:00:29.712845+0000","last_became_active":"2024-03-04T12:36:15.355291+0000","last_became_peered":"2024-03-04T12:36:15.355291+0000","last_unstale":"2024-03-04T13:00:29.712845+0000","last_undegraded":"2024-03-04T13:00:29.712845+0000","last_fullsized":"2024-03-04T13:00:29.712845+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'125","last_scrub_stamp":"2024-03-04T13:00:29.712708+0000","last_deep_scrub":"256'125","last_deep_scrub_stamp":"2024-03-04T13:00:29.712708+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.712708+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:28:17.484104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"256'743","reported_seq":2162,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:11.002606+0000","last_change":"2024-03-04T12:36:07.290212+0000","last_active":"2024-03-04T13:00:11.002606+0000","last_peered":"2024-03-04T13:00:11.002606+0000","last_clean":"2024-03-04T13:00:11.002606+0000","last_became_active":"2024-03-04T12:36:07.289884+0000","last_became_peered":"2024-03-04T12:36:07.289884+0000","last_unstale":"2024-03-04T13:00:11.002606+0000","last_undegraded":"2024-03-04T13:00:11.002606+0000","last_fullsized":"2024-03-04T13:00:11.002606+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3351,"num_read_kb":2980,"num_write":997,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"256'320","reported_seq":927,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.098256+0000","last_change":"2024-03-04T12:36:05.291839+0000","last_active":"2024-03-04T13:00:17.098256+0000","last_peered":"2024-03-04T13:00:17.098256+0000","last_clean":"2024-03-04T13:00:17.098256+0000","last_became_active":"2024-03-04T12:36:05.291549+0000","last_became_peered":"2024-03-04T12:36:05.291549+0000","last_unstale":"2024-03-04T13:00:17.098256+0000","last_undegraded":"2024-03-04T13:00:17.098256+0000","last_fullsized":"2024-03-04T13:00:17.098256+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194348,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":36332,"num_write":1128,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":502,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.379640+0000","last_change":"2024-03-04T13:00:52.379665+0000","last_active":"2024-03-04T13:00:52.379640+0000","last_peered":"2024-03-04T13:00:52.379640+0000","last_clean":"2024-03-04T13:00:52.379640+0000","last_became_active":"2024-03-04T12:35:54.238802+0000","last_became_peered":"2024-03-04T12:35:54.238802+0000","last_unstale":"2024-03-04T13:00:52.379640+0000","last_undegraded":"2024-03-04T13:00:52.379640+0000","last_fullsized":"2024-03-04T13:00:52.379640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:52.379542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:52.379542+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.379542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:34.687702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":490,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.037904+0000","last_change":"2024-03-04T13:00:54.037943+0000","last_active":"2024-03-04T13:00:54.037904+0000","last_peered":"2024-03-04T13:00:54.037904+0000","last_clean":"2024-03-04T13:00:54.037904+0000","last_became_active":"2024-03-04T12:36:09.307467+0000","last_became_peered":"2024-03-04T12:36:09.307467+0000","last_unstale":"2024-03-04T13:00:54.037904+0000","last_undegraded":"2024-03-04T13:00:54.037904+0000","last_fullsized":"2024-03-04T13:00:54.037904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:54.037801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:54.037801+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.037801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:19.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"256'83","reported_seq":599,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.149562+0000","last_change":"2024-03-04T13:00:37.149599+0000","last_active":"2024-03-04T13:00:37.149562+0000","last_peered":"2024-03-04T13:00:37.149562+0000","last_clean":"2024-03-04T13:00:37.149562+0000","last_became_active":"2024-03-04T12:36:11.325955+0000","last_became_peered":"2024-03-04T12:36:11.325955+0000","last_unstale":"2024-03-04T13:00:37.149562+0000","last_undegraded":"2024-03-04T13:00:37.149562+0000","last_fullsized":"2024-03-04T13:00:37.149562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'83","last_scrub_stamp":"2024-03-04T13:00:37.149473+0000","last_deep_scrub":"256'83","last_deep_scrub_stamp":"2024-03-04T13:00:37.149473+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.149473+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:46:01.882397+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"256'535","reported_seq":1576,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.796520+0000","last_change":"2024-03-04T13:00:36.796546+0000","last_active":"2024-03-04T13:00:36.796520+0000","last_peered":"2024-03-04T13:00:36.796520+0000","last_clean":"2024-03-04T13:00:36.796520+0000","last_became_active":"2024-03-04T12:36:13.349421+0000","last_became_peered":"2024-03-04T12:36:13.349421+0000","last_unstale":"2024-03-04T13:00:36.796520+0000","last_undegraded":"2024-03-04T13:00:36.796520+0000","last_fullsized":"2024-03-04T13:00:36.796520+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'535","last_scrub_stamp":"2024-03-04T13:00:36.796431+0000","last_deep_scrub":"256'535","last_deep_scrub_stamp":"2024-03-04T13:00:36.796431+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.796431+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:02.418373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"256'96","reported_seq":575,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.623597+0000","last_change":"2024-03-04T13:00:35.623597+0000","last_active":"2024-03-04T13:00:35.623597+0000","last_peered":"2024-03-04T13:00:35.623597+0000","last_clean":"2024-03-04T13:00:35.623597+0000","last_became_active":"2024-03-04T12:36:15.356192+0000","last_became_peered":"2024-03-04T12:36:15.356192+0000","last_unstale":"2024-03-04T13:00:35.623597+0000","last_undegraded":"2024-03-04T13:00:35.623597+0000","last_fullsized":"2024-03-04T13:00:35.623597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'96","last_scrub_stamp":"2024-03-04T13:00:35.623431+0000","last_deep_scrub":"256'96","last_deep_scrub_stamp":"2024-03-04T13:00:35.623431+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.623431+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:27.378174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":232,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"256'392","reported_seq":1922,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.098469+0000","last_change":"2024-03-04T13:00:50.098548+0000","last_active":"2024-03-04T13:00:50.098469+0000","last_peered":"2024-03-04T13:00:50.098469+0000","last_clean":"2024-03-04T13:00:50.098469+0000","last_became_active":"2024-03-04T12:36:07.298963+0000","last_became_peered":"2024-03-04T12:36:07.298963+0000","last_unstale":"2024-03-04T13:00:50.098469+0000","last_undegraded":"2024-03-04T13:00:50.098469+0000","last_fullsized":"2024-03-04T13:00:50.098469+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'392","last_scrub_stamp":"2024-03-04T13:00:50.098367+0000","last_deep_scrub":"256'392","last_deep_scrub_stamp":"2024-03-04T13:00:50.098367+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.098367+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:40.850831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2139,"num_write":463,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2158,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"256'321","reported_seq":932,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.103880+0000","last_change":"2024-03-04T12:36:05.282071+0000","last_active":"2024-03-04T13:00:17.103880+0000","last_peered":"2024-03-04T13:00:17.103880+0000","last_clean":"2024-03-04T13:00:17.103880+0000","last_became_active":"2024-03-04T12:36:05.281790+0000","last_became_peered":"2024-03-04T12:36:05.281790+0000","last_unstale":"2024-03-04T13:00:17.103880+0000","last_undegraded":"2024-03-04T13:00:17.103880+0000","last_fullsized":"2024-03-04T13:00:17.103880+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1778947,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":33441,"num_write":1185,"num_write_kb":31732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":497,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.775121+0000","last_change":"2024-03-04T13:00:48.775160+0000","last_active":"2024-03-04T13:00:48.775121+0000","last_peered":"2024-03-04T13:00:48.775121+0000","last_clean":"2024-03-04T13:00:48.775121+0000","last_became_active":"2024-03-04T12:35:54.238580+0000","last_became_peered":"2024-03-04T12:35:54.238580+0000","last_unstale":"2024-03-04T13:00:48.775121+0000","last_undegraded":"2024-03-04T13:00:48.775121+0000","last_fullsized":"2024-03-04T13:00:48.775121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:48.774977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:48.774977+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.774977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:53.947435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:11.002635+0000","last_change":"2024-03-04T12:36:09.308483+0000","last_active":"2024-03-04T13:00:11.002635+0000","last_peered":"2024-03-04T13:00:11.002635+0000","last_clean":"2024-03-04T13:00:11.002635+0000","last_became_active":"2024-03-04T12:36:09.308162+0000","last_became_peered":"2024-03-04T12:36:09.308162+0000","last_unstale":"2024-03-04T13:00:11.002635+0000","last_undegraded":"2024-03-04T13:00:11.002635+0000","last_fullsized":"2024-03-04T13:00:11.002635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"256'704","reported_seq":1392,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.094639+0000","last_change":"2024-03-04T12:36:11.955174+0000","last_active":"2024-03-04T13:00:17.094639+0000","last_peered":"2024-03-04T13:00:17.094639+0000","last_clean":"2024-03-04T13:00:17.094639+0000","last_became_active":"2024-03-04T12:36:11.954569+0000","last_became_peered":"2024-03-04T12:36:11.954569+0000","last_unstale":"2024-03-04T13:00:17.094639+0000","last_undegraded":"2024-03-04T13:00:17.094639+0000","last_fullsized":"2024-03-04T13:00:17.094639+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140875,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1277,"num_read_kb":3093,"num_write":1046,"num_write_kb":893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.718909+0000","last_change":"2024-03-04T13:00:40.718951+0000","last_active":"2024-03-04T13:00:40.718909+0000","last_peered":"2024-03-04T13:00:40.718909+0000","last_clean":"2024-03-04T13:00:40.718909+0000","last_became_active":"2024-03-04T12:36:13.345919+0000","last_became_peered":"2024-03-04T12:36:13.345919+0000","last_unstale":"2024-03-04T13:00:40.718909+0000","last_undegraded":"2024-03-04T13:00:40.718909+0000","last_fullsized":"2024-03-04T13:00:40.718909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.718799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.718799+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.718799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:41.971577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"256'130","reported_seq":603,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.410237+0000","last_change":"2024-03-04T13:00:34.410237+0000","last_active":"2024-03-04T13:00:34.410237+0000","last_peered":"2024-03-04T13:00:34.410237+0000","last_clean":"2024-03-04T13:00:34.410237+0000","last_became_active":"2024-03-04T12:36:15.362710+0000","last_became_peered":"2024-03-04T12:36:15.362710+0000","last_unstale":"2024-03-04T13:00:34.410237+0000","last_undegraded":"2024-03-04T13:00:34.410237+0000","last_fullsized":"2024-03-04T13:00:34.410237+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'130","last_scrub_stamp":"2024-03-04T13:00:34.410088+0000","last_deep_scrub":"256'130","last_deep_scrub_stamp":"2024-03-04T13:00:34.410088+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.410088+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:38.504413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"256'110","reported_seq":580,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.566187+0000","last_change":"2024-03-04T13:00:31.566210+0000","last_active":"2024-03-04T13:00:31.566187+0000","last_peered":"2024-03-04T13:00:31.566187+0000","last_clean":"2024-03-04T13:00:31.566187+0000","last_became_active":"2024-03-04T12:36:15.363057+0000","last_became_peered":"2024-03-04T12:36:15.363057+0000","last_unstale":"2024-03-04T13:00:31.566187+0000","last_undegraded":"2024-03-04T13:00:31.566187+0000","last_fullsized":"2024-03-04T13:00:31.566187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'110","last_scrub_stamp":"2024-03-04T13:00:31.566095+0000","last_deep_scrub":"256'110","last_deep_scrub_stamp":"2024-03-04T13:00:31.566095+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.566095+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:05:38.612505+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":263,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"256'522","reported_seq":2080,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.055992+0000","last_change":"2024-03-04T13:00:49.056032+0000","last_active":"2024-03-04T13:00:49.055992+0000","last_peered":"2024-03-04T13:00:49.055992+0000","last_clean":"2024-03-04T13:00:49.055992+0000","last_became_active":"2024-03-04T12:36:07.292930+0000","last_became_peered":"2024-03-04T12:36:07.292930+0000","last_unstale":"2024-03-04T13:00:49.055992+0000","last_undegraded":"2024-03-04T13:00:49.055992+0000","last_fullsized":"2024-03-04T13:00:49.055992+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'522","last_scrub_stamp":"2024-03-04T13:00:49.055892+0000","last_deep_scrub":"256'522","last_deep_scrub_stamp":"2024-03-04T13:00:49.055892+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.055892+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:28.787689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2723,"num_read_kb":2502,"num_write":698,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":218,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"256'330","reported_seq":975,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.058515+0000","last_change":"2024-03-04T13:00:58.058608+0000","last_active":"2024-03-04T13:00:58.058515+0000","last_peered":"2024-03-04T13:00:58.058515+0000","last_clean":"2024-03-04T13:00:58.058515+0000","last_became_active":"2024-03-04T12:36:05.287299+0000","last_became_peered":"2024-03-04T12:36:05.287299+0000","last_unstale":"2024-03-04T13:00:58.058515+0000","last_undegraded":"2024-03-04T13:00:58.058515+0000","last_fullsized":"2024-03-04T13:00:58.058515+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'330","last_scrub_stamp":"2024-03-04T13:00:58.058418+0000","last_deep_scrub":"256'330","last_deep_scrub_stamp":"2024-03-04T13:00:58.058418+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.058418+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:53.837362+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2779056,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":31884,"num_write":1263,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"256'4","reported_seq":798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.367405+0000","last_change":"2024-03-04T13:00:42.367433+0000","last_active":"2024-03-04T13:00:42.367405+0000","last_peered":"2024-03-04T13:00:42.367405+0000","last_clean":"2024-03-04T13:00:42.367405+0000","last_became_active":"2024-03-04T12:36:09.314810+0000","last_became_peered":"2024-03-04T12:36:09.314810+0000","last_unstale":"2024-03-04T13:00:42.367405+0000","last_undegraded":"2024-03-04T13:00:42.367405+0000","last_fullsized":"2024-03-04T13:00:42.367405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:42.367302+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:42.367302+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.367302+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:56:47.240397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"256'251","reported_seq":804,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.664040+0000","last_change":"2024-03-04T13:00:48.664108+0000","last_active":"2024-03-04T13:00:48.664040+0000","last_peered":"2024-03-04T13:00:48.664040+0000","last_clean":"2024-03-04T13:00:48.664040+0000","last_became_active":"2024-03-04T12:36:11.323046+0000","last_became_peered":"2024-03-04T12:36:11.323046+0000","last_unstale":"2024-03-04T13:00:48.664040+0000","last_undegraded":"2024-03-04T13:00:48.664040+0000","last_fullsized":"2024-03-04T13:00:48.664040+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'251","last_scrub_stamp":"2024-03-04T13:00:48.663931+0000","last_deep_scrub":"256'251","last_deep_scrub_stamp":"2024-03-04T13:00:48.663931+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.663931+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:33:25.003667+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51487,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":943,"num_write":330,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.767813+0000","last_change":"2024-03-04T13:00:37.767846+0000","last_active":"2024-03-04T13:00:37.767813+0000","last_peered":"2024-03-04T13:00:37.767813+0000","last_clean":"2024-03-04T13:00:37.767813+0000","last_became_active":"2024-03-04T12:36:13.348696+0000","last_became_peered":"2024-03-04T12:36:13.348696+0000","last_unstale":"2024-03-04T13:00:37.767813+0000","last_undegraded":"2024-03-04T13:00:37.767813+0000","last_fullsized":"2024-03-04T13:00:37.767813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.767716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.767716+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.767716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:39.879058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"256'83","reported_seq":563,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.806585+0000","last_change":"2024-03-04T13:00:32.806636+0000","last_active":"2024-03-04T13:00:32.806585+0000","last_peered":"2024-03-04T13:00:32.806585+0000","last_clean":"2024-03-04T13:00:32.806585+0000","last_became_active":"2024-03-04T12:36:15.354258+0000","last_became_peered":"2024-03-04T12:36:15.354258+0000","last_unstale":"2024-03-04T13:00:32.806585+0000","last_undegraded":"2024-03-04T13:00:32.806585+0000","last_fullsized":"2024-03-04T13:00:32.806585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'83","last_scrub_stamp":"2024-03-04T13:00:32.806479+0000","last_deep_scrub":"256'83","last_deep_scrub_stamp":"2024-03-04T13:00:32.806479+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.806479+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:51:22.735435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":75,"num_write":188,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"256'356","reported_seq":1714,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.402045+0000","last_change":"2024-03-04T13:00:51.402077+0000","last_active":"2024-03-04T13:00:51.402045+0000","last_peered":"2024-03-04T13:00:51.402045+0000","last_clean":"2024-03-04T13:00:51.402045+0000","last_became_active":"2024-03-04T12:36:07.295803+0000","last_became_peered":"2024-03-04T12:36:07.295803+0000","last_unstale":"2024-03-04T13:00:51.402045+0000","last_undegraded":"2024-03-04T13:00:51.402045+0000","last_fullsized":"2024-03-04T13:00:51.402045+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'356","last_scrub_stamp":"2024-03-04T13:00:51.401953+0000","last_deep_scrub":"256'356","last_deep_scrub_stamp":"2024-03-04T13:00:51.401953+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.401953+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:06.068752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1867,"num_read_kb":1777,"num_write":399,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"256'341","reported_seq":965,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.279610+0000","last_change":"2024-03-04T13:00:56.279707+0000","last_active":"2024-03-04T13:00:56.279610+0000","last_peered":"2024-03-04T13:00:56.279610+0000","last_clean":"2024-03-04T13:00:56.279610+0000","last_became_active":"2024-03-04T12:36:05.296032+0000","last_became_peered":"2024-03-04T12:36:05.296032+0000","last_unstale":"2024-03-04T13:00:56.279610+0000","last_undegraded":"2024-03-04T13:00:56.279610+0000","last_fullsized":"2024-03-04T13:00:56.279610+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'341","last_scrub_stamp":"2024-03-04T13:00:56.279479+0000","last_deep_scrub":"256'341","last_deep_scrub_stamp":"2024-03-04T13:00:56.279479+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.279479+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:25:58.021440+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2492708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":28471,"num_write":1139,"num_write_kb":37420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:30.998013+0000","last_change":"2024-03-04T12:36:09.312289+0000","last_active":"2024-03-04T12:59:30.998013+0000","last_peered":"2024-03-04T12:59:30.998013+0000","last_clean":"2024-03-04T12:59:30.998013+0000","last_became_active":"2024-03-04T12:36:09.311953+0000","last_became_peered":"2024-03-04T12:36:09.311953+0000","last_unstale":"2024-03-04T12:59:30.998013+0000","last_undegraded":"2024-03-04T12:59:30.998013+0000","last_fullsized":"2024-03-04T12:59:30.998013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:08.290408+0000","last_clean_scrub_stamp":"2024-03-04T12:36:08.290408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"256'34","reported_seq":516,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.427415+0000","last_change":"2024-03-04T13:01:00.427455+0000","last_active":"2024-03-04T13:01:00.427415+0000","last_peered":"2024-03-04T13:01:00.427415+0000","last_clean":"2024-03-04T13:01:00.427415+0000","last_became_active":"2024-03-04T12:36:11.326313+0000","last_became_peered":"2024-03-04T12:36:11.326313+0000","last_unstale":"2024-03-04T13:01:00.427415+0000","last_undegraded":"2024-03-04T13:01:00.427415+0000","last_fullsized":"2024-03-04T13:01:00.427415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'34","last_scrub_stamp":"2024-03-04T13:01:00.427338+0000","last_deep_scrub":"256'34","last_deep_scrub_stamp":"2024-03-04T13:01:00.427338+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.427338+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:33:09.282435+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.235834+0000","last_change":"2024-03-04T13:00:37.235857+0000","last_active":"2024-03-04T13:00:37.235834+0000","last_peered":"2024-03-04T13:00:37.235834+0000","last_clean":"2024-03-04T13:00:37.235834+0000","last_became_active":"2024-03-04T12:36:13.340203+0000","last_became_peered":"2024-03-04T12:36:13.340203+0000","last_unstale":"2024-03-04T13:00:37.235834+0000","last_undegraded":"2024-03-04T13:00:37.235834+0000","last_fullsized":"2024-03-04T13:00:37.235834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.235747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.235747+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.235747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:37.493747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"256'90","reported_seq":573,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.583553+0000","last_change":"2024-03-04T13:00:36.583607+0000","last_active":"2024-03-04T13:00:36.583553+0000","last_peered":"2024-03-04T13:00:36.583553+0000","last_clean":"2024-03-04T13:00:36.583553+0000","last_became_active":"2024-03-04T12:36:15.353545+0000","last_became_peered":"2024-03-04T12:36:15.353545+0000","last_unstale":"2024-03-04T13:00:36.583553+0000","last_undegraded":"2024-03-04T13:00:36.583553+0000","last_fullsized":"2024-03-04T13:00:36.583553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'90","last_scrub_stamp":"2024-03-04T13:00:36.583455+0000","last_deep_scrub":"256'90","last_deep_scrub_stamp":"2024-03-04T13:00:36.583455+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.583455+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:57:03.167360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":106,"num_write":213,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"256'994","reported_seq":2552,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.661437+0000","last_change":"2024-03-04T13:00:54.661462+0000","last_active":"2024-03-04T13:00:54.661437+0000","last_peered":"2024-03-04T13:00:54.661437+0000","last_clean":"2024-03-04T13:00:54.661437+0000","last_became_active":"2024-03-04T12:36:07.299326+0000","last_became_peered":"2024-03-04T12:36:07.299326+0000","last_unstale":"2024-03-04T13:00:54.661437+0000","last_undegraded":"2024-03-04T13:00:54.661437+0000","last_fullsized":"2024-03-04T13:00:54.661437+0000","mapping_epoch":22,"log_start":"256'900","ondisk_log_start":"256'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'994","last_scrub_stamp":"2024-03-04T13:00:54.661340+0000","last_deep_scrub":"256'994","last_deep_scrub_stamp":"2024-03-04T13:00:54.661340+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.661340+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:21.655756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4343,"num_read_kb":3801,"num_write":1436,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"256'329","reported_seq":976,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.205823+0000","last_change":"2024-03-04T13:01:00.205887+0000","last_active":"2024-03-04T13:01:00.205823+0000","last_peered":"2024-03-04T13:01:00.205823+0000","last_clean":"2024-03-04T13:01:00.205823+0000","last_became_active":"2024-03-04T12:36:05.287185+0000","last_became_peered":"2024-03-04T12:36:05.287185+0000","last_unstale":"2024-03-04T13:01:00.205823+0000","last_undegraded":"2024-03-04T13:01:00.205823+0000","last_fullsized":"2024-03-04T13:01:00.205823+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'329","last_scrub_stamp":"2024-03-04T13:01:00.205728+0000","last_deep_scrub":"256'329","last_deep_scrub_stamp":"2024-03-04T13:01:00.205728+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.205728+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:01:05.983210+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730133,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":528,"num_read_kb":7345,"num_write":1182,"num_write_kb":36636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":486,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.339216+0000","last_change":"2024-03-04T13:00:47.339239+0000","last_active":"2024-03-04T13:00:47.339216+0000","last_peered":"2024-03-04T13:00:47.339216+0000","last_clean":"2024-03-04T13:00:47.339216+0000","last_became_active":"2024-03-04T12:36:09.305288+0000","last_became_peered":"2024-03-04T12:36:09.305288+0000","last_unstale":"2024-03-04T13:00:47.339216+0000","last_undegraded":"2024-03-04T13:00:47.339216+0000","last_fullsized":"2024-03-04T13:00:47.339216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:47.339124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:47.339124+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.339124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:03:14.121891+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"256'296","reported_seq":864,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.653476+0000","last_change":"2024-03-04T13:00:47.653514+0000","last_active":"2024-03-04T13:00:47.653476+0000","last_peered":"2024-03-04T13:00:47.653476+0000","last_clean":"2024-03-04T13:00:47.653476+0000","last_became_active":"2024-03-04T12:36:11.324758+0000","last_became_peered":"2024-03-04T12:36:11.324758+0000","last_unstale":"2024-03-04T13:00:47.653476+0000","last_undegraded":"2024-03-04T13:00:47.653476+0000","last_fullsized":"2024-03-04T13:00:47.653476+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'296","last_scrub_stamp":"2024-03-04T13:00:47.653383+0000","last_deep_scrub":"256'296","last_deep_scrub_stamp":"2024-03-04T13:00:47.653383+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.653383+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:52.144236+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":483,"num_read_kb":1065,"num_write":390,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.725145+0000","last_change":"2024-03-04T13:00:38.725169+0000","last_active":"2024-03-04T13:00:38.725145+0000","last_peered":"2024-03-04T13:00:38.725145+0000","last_clean":"2024-03-04T13:00:38.725145+0000","last_became_active":"2024-03-04T12:36:13.345556+0000","last_became_peered":"2024-03-04T12:36:13.345556+0000","last_unstale":"2024-03-04T13:00:38.725145+0000","last_undegraded":"2024-03-04T13:00:38.725145+0000","last_fullsized":"2024-03-04T13:00:38.725145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:38.725031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:38.725031+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.725031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:46.207626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"256'172","reported_seq":667,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.459248+0000","last_change":"2024-03-04T13:00:30.459299+0000","last_active":"2024-03-04T13:00:30.459248+0000","last_peered":"2024-03-04T13:00:30.459248+0000","last_clean":"2024-03-04T13:00:30.459248+0000","last_became_active":"2024-03-04T12:36:15.363544+0000","last_became_peered":"2024-03-04T12:36:15.363544+0000","last_unstale":"2024-03-04T13:00:30.459248+0000","last_undegraded":"2024-03-04T13:00:30.459248+0000","last_fullsized":"2024-03-04T13:00:30.459248+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'172","last_scrub_stamp":"2024-03-04T13:00:30.459143+0000","last_deep_scrub":"256'172","last_deep_scrub_stamp":"2024-03-04T13:00:30.459143+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.459143+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:00:31.537557+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":198,"num_write":386,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"256'403","reported_seq":1844,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.635123+0000","last_change":"2024-03-04T13:00:55.635173+0000","last_active":"2024-03-04T13:00:55.635123+0000","last_peered":"2024-03-04T13:00:55.635123+0000","last_clean":"2024-03-04T13:00:55.635123+0000","last_became_active":"2024-03-04T12:36:07.292814+0000","last_became_peered":"2024-03-04T12:36:07.292814+0000","last_unstale":"2024-03-04T13:00:55.635123+0000","last_undegraded":"2024-03-04T13:00:55.635123+0000","last_fullsized":"2024-03-04T13:00:55.635123+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'403","last_scrub_stamp":"2024-03-04T13:00:55.635023+0000","last_deep_scrub":"256'403","last_deep_scrub_stamp":"2024-03-04T13:00:55.635023+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.635023+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:57:31.355683+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2067,"num_read_kb":1953,"num_write":480,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"256'310","reported_seq":913,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.561357+0000","last_change":"2024-03-04T13:00:28.561406+0000","last_active":"2024-03-04T13:00:28.561357+0000","last_peered":"2024-03-04T13:00:28.561357+0000","last_clean":"2024-03-04T13:00:28.561357+0000","last_became_active":"2024-03-04T12:36:40.964989+0000","last_became_peered":"2024-03-04T12:36:40.964989+0000","last_unstale":"2024-03-04T13:00:28.561357+0000","last_undegraded":"2024-03-04T13:00:28.561357+0000","last_fullsized":"2024-03-04T13:00:28.561357+0000","mapping_epoch":33,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'310","last_scrub_stamp":"2024-03-04T13:00:28.561273+0000","last_deep_scrub":"256'310","last_deep_scrub_stamp":"2024-03-04T13:00:28.561273+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.561273+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:45:32.752696+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":22171,"num_write":1178,"num_write_kb":35457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.720495+0000","last_change":"2024-03-04T13:00:37.720522+0000","last_active":"2024-03-04T13:00:37.720495+0000","last_peered":"2024-03-04T13:00:37.720495+0000","last_clean":"2024-03-04T13:00:37.720495+0000","last_became_active":"2024-03-04T12:36:09.309883+0000","last_became_peered":"2024-03-04T12:36:09.309883+0000","last_unstale":"2024-03-04T13:00:37.720495+0000","last_undegraded":"2024-03-04T13:00:37.720495+0000","last_fullsized":"2024-03-04T13:00:37.720495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.720405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.720405+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.720405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:04.234972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"256'256","reported_seq":808,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.287654+0000","last_change":"2024-03-04T13:00:57.287688+0000","last_active":"2024-03-04T13:00:57.287654+0000","last_peered":"2024-03-04T13:00:57.287654+0000","last_clean":"2024-03-04T13:00:57.287654+0000","last_became_active":"2024-03-04T12:36:11.324784+0000","last_became_peered":"2024-03-04T12:36:11.324784+0000","last_unstale":"2024-03-04T13:00:57.287654+0000","last_undegraded":"2024-03-04T13:00:57.287654+0000","last_fullsized":"2024-03-04T13:00:57.287654+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'256","last_scrub_stamp":"2024-03-04T13:00:57.287531+0000","last_deep_scrub":"256'256","last_deep_scrub_stamp":"2024-03-04T13:00:57.287531+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.287531+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:25:13.049620+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54138,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":1067,"num_write":352,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.556862+0000","last_change":"2024-03-04T13:00:40.556902+0000","last_active":"2024-03-04T13:00:40.556862+0000","last_peered":"2024-03-04T13:00:40.556862+0000","last_clean":"2024-03-04T13:00:40.556862+0000","last_became_active":"2024-03-04T12:36:13.343030+0000","last_became_peered":"2024-03-04T12:36:13.343030+0000","last_unstale":"2024-03-04T13:00:40.556862+0000","last_undegraded":"2024-03-04T13:00:40.556862+0000","last_fullsized":"2024-03-04T13:00:40.556862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.556715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.556715+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.556715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:11:37.035294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"256'689","reported_seq":2145,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.766544+0000","last_change":"2024-03-04T13:00:45.766580+0000","last_active":"2024-03-04T13:00:45.766544+0000","last_peered":"2024-03-04T13:00:45.766544+0000","last_clean":"2024-03-04T13:00:45.766544+0000","last_became_active":"2024-03-04T12:36:07.298154+0000","last_became_peered":"2024-03-04T12:36:07.298154+0000","last_unstale":"2024-03-04T13:00:45.766544+0000","last_undegraded":"2024-03-04T13:00:45.766544+0000","last_fullsized":"2024-03-04T13:00:45.766544+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'689","last_scrub_stamp":"2024-03-04T13:00:45.766448+0000","last_deep_scrub":"256'689","last_deep_scrub_stamp":"2024-03-04T13:00:45.766448+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.766448+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":600,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:58.758338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3209,"num_read_kb":2902,"num_write":904,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1913,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"256'315","reported_seq":1018,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.114973+0000","last_change":"2024-03-04T12:36:05.287614+0000","last_active":"2024-03-04T13:00:17.114973+0000","last_peered":"2024-03-04T13:00:17.114973+0000","last_clean":"2024-03-04T13:00:17.114973+0000","last_became_active":"2024-03-04T12:36:05.287329+0000","last_became_peered":"2024-03-04T12:36:05.287329+0000","last_unstale":"2024-03-04T13:00:17.114973+0000","last_undegraded":"2024-03-04T13:00:17.114973+0000","last_fullsized":"2024-03-04T13:00:17.114973+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":51334,"num_write":1200,"num_write_kb":22699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.493036+0000","last_change":"2024-03-04T13:00:52.493071+0000","last_active":"2024-03-04T13:00:52.493036+0000","last_peered":"2024-03-04T13:00:52.493036+0000","last_clean":"2024-03-04T13:00:52.493036+0000","last_became_active":"2024-03-04T12:36:09.307329+0000","last_became_peered":"2024-03-04T12:36:09.307329+0000","last_unstale":"2024-03-04T13:00:52.493036+0000","last_undegraded":"2024-03-04T13:00:52.493036+0000","last_fullsized":"2024-03-04T13:00:52.493036+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:52.492916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:52.492916+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.492916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:14:55.192962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"256'416","reported_seq":1029,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.373611+0000","last_change":"2024-03-04T13:00:44.373675+0000","last_active":"2024-03-04T13:00:44.373611+0000","last_peered":"2024-03-04T13:00:44.373611+0000","last_clean":"2024-03-04T13:00:44.373611+0000","last_became_active":"2024-03-04T12:36:11.323506+0000","last_became_peered":"2024-03-04T12:36:11.323506+0000","last_unstale":"2024-03-04T13:00:44.373611+0000","last_undegraded":"2024-03-04T13:00:44.373611+0000","last_fullsized":"2024-03-04T13:00:44.373611+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'416","last_scrub_stamp":"2024-03-04T13:00:44.373504+0000","last_deep_scrub":"256'416","last_deep_scrub_stamp":"2024-03-04T13:00:44.373504+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.373504+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:17.615777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114357,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":734,"num_read_kb":1796,"num_write":592,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.405098+0000","last_change":"2024-03-04T13:00:37.405124+0000","last_active":"2024-03-04T13:00:37.405098+0000","last_peered":"2024-03-04T13:00:37.405098+0000","last_clean":"2024-03-04T13:00:37.405098+0000","last_became_active":"2024-03-04T12:36:13.346628+0000","last_became_peered":"2024-03-04T12:36:13.346628+0000","last_unstale":"2024-03-04T13:00:37.405098+0000","last_undegraded":"2024-03-04T13:00:37.405098+0000","last_fullsized":"2024-03-04T13:00:37.405098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.404992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.404992+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.404992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:53:15.725542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"256'167","reported_seq":654,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.777427+0000","last_change":"2024-03-04T13:00:31.777458+0000","last_active":"2024-03-04T13:00:31.777427+0000","last_peered":"2024-03-04T13:00:31.777427+0000","last_clean":"2024-03-04T13:00:31.777427+0000","last_became_active":"2024-03-04T12:36:15.354125+0000","last_became_peered":"2024-03-04T12:36:15.354125+0000","last_unstale":"2024-03-04T13:00:31.777427+0000","last_undegraded":"2024-03-04T13:00:31.777427+0000","last_fullsized":"2024-03-04T13:00:31.777427+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'167","last_scrub_stamp":"2024-03-04T13:00:31.777324+0000","last_deep_scrub":"256'167","last_deep_scrub_stamp":"2024-03-04T13:00:31.777324+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.777324+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:56:57.666876+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":203,"num_write":373,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"256'1142","reported_seq":2724,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.484360+0000","last_change":"2024-03-04T13:00:55.484393+0000","last_active":"2024-03-04T13:00:55.484360+0000","last_peered":"2024-03-04T13:00:55.484360+0000","last_clean":"2024-03-04T13:00:55.484360+0000","last_became_active":"2024-03-04T12:36:07.298434+0000","last_became_peered":"2024-03-04T12:36:07.298434+0000","last_unstale":"2024-03-04T13:00:55.484360+0000","last_undegraded":"2024-03-04T13:00:55.484360+0000","last_fullsized":"2024-03-04T13:00:55.484360+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1142","last_scrub_stamp":"2024-03-04T13:00:55.484270+0000","last_deep_scrub":"256'1142","last_deep_scrub_stamp":"2024-03-04T13:00:55.484270+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.484270+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:45.148303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4934,"num_read_kb":4324,"num_write":1585,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"256'406","reported_seq":1058,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.377065+0000","last_change":"2024-03-04T13:00:58.377161+0000","last_active":"2024-03-04T13:00:58.377065+0000","last_peered":"2024-03-04T13:00:58.377065+0000","last_clean":"2024-03-04T13:00:58.377065+0000","last_became_active":"2024-03-04T12:36:05.287506+0000","last_became_peered":"2024-03-04T12:36:05.287506+0000","last_unstale":"2024-03-04T13:00:58.377065+0000","last_undegraded":"2024-03-04T13:00:58.377065+0000","last_fullsized":"2024-03-04T13:00:58.377065+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'406","last_scrub_stamp":"2024-03-04T13:00:58.376966+0000","last_deep_scrub":"256'406","last_deep_scrub_stamp":"2024-03-04T13:00:58.376966+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.376966+0000","objects_scrubbed":10,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:41.393895+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6658491,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":603,"num_read_kb":47023,"num_write":1149,"num_write_kb":33887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.716178+0000","last_change":"2024-03-04T13:00:39.716223+0000","last_active":"2024-03-04T13:00:39.716178+0000","last_peered":"2024-03-04T13:00:39.716178+0000","last_clean":"2024-03-04T13:00:39.716178+0000","last_became_active":"2024-03-04T12:36:09.309155+0000","last_became_peered":"2024-03-04T12:36:09.309155+0000","last_unstale":"2024-03-04T13:00:39.716178+0000","last_undegraded":"2024-03-04T13:00:39.716178+0000","last_fullsized":"2024-03-04T13:00:39.716178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.716073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.716073+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.716073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:43.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"256'282","reported_seq":842,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.268399+0000","last_change":"2024-03-04T13:00:55.268458+0000","last_active":"2024-03-04T13:00:55.268399+0000","last_peered":"2024-03-04T13:00:55.268399+0000","last_clean":"2024-03-04T13:00:55.268399+0000","last_became_active":"2024-03-04T12:36:11.323320+0000","last_became_peered":"2024-03-04T12:36:11.323320+0000","last_unstale":"2024-03-04T13:00:55.268399+0000","last_undegraded":"2024-03-04T13:00:55.268399+0000","last_fullsized":"2024-03-04T13:00:55.268399+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'282","last_scrub_stamp":"2024-03-04T13:00:55.268308+0000","last_deep_scrub":"256'282","last_deep_scrub_stamp":"2024-03-04T13:00:55.268308+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.268308+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:00:22.716350+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44965,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":1036,"num_write":392,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.394100+0000","last_change":"2024-03-04T13:01:00.394123+0000","last_active":"2024-03-04T13:01:00.394100+0000","last_peered":"2024-03-04T13:01:00.394100+0000","last_clean":"2024-03-04T13:01:00.394100+0000","last_became_active":"2024-03-04T12:36:13.340525+0000","last_became_peered":"2024-03-04T12:36:13.340525+0000","last_unstale":"2024-03-04T13:01:00.394100+0000","last_undegraded":"2024-03-04T13:01:00.394100+0000","last_fullsized":"2024-03-04T13:01:00.394100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:00.393973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:00.393973+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.393973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:26:20.188259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"256'159","reported_seq":993,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.793826+0000","last_change":"2024-03-04T13:00:44.793864+0000","last_active":"2024-03-04T13:00:44.793826+0000","last_peered":"2024-03-04T13:00:44.793826+0000","last_clean":"2024-03-04T13:00:44.793826+0000","last_became_active":"2024-03-04T12:36:15.362749+0000","last_became_peered":"2024-03-04T12:36:15.362749+0000","last_unstale":"2024-03-04T13:00:44.793826+0000","last_undegraded":"2024-03-04T13:00:44.793826+0000","last_fullsized":"2024-03-04T13:00:44.793826+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'159","last_scrub_stamp":"2024-03-04T13:00:44.793731+0000","last_deep_scrub":"256'159","last_deep_scrub_stamp":"2024-03-04T13:00:44.793731+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.793731+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:46:09.922195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":549,"num_write":456,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"256'355","reported_seq":1708,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.596031+0000","last_change":"2024-03-04T13:00:59.596079+0000","last_active":"2024-03-04T13:00:59.596031+0000","last_peered":"2024-03-04T13:00:59.596031+0000","last_clean":"2024-03-04T13:00:59.596031+0000","last_became_active":"2024-03-04T12:36:07.292806+0000","last_became_peered":"2024-03-04T12:36:07.292806+0000","last_unstale":"2024-03-04T13:00:59.596031+0000","last_undegraded":"2024-03-04T13:00:59.596031+0000","last_fullsized":"2024-03-04T13:00:59.596031+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'355","last_scrub_stamp":"2024-03-04T13:00:59.595934+0000","last_deep_scrub":"256'355","last_deep_scrub_stamp":"2024-03-04T13:00:59.595934+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.595934+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:05.865984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1929,"num_read_kb":1816,"num_write":430,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"256'322","reported_seq":967,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.027146+0000","last_change":"2024-03-04T13:01:00.027192+0000","last_active":"2024-03-04T13:01:00.027146+0000","last_peered":"2024-03-04T13:01:00.027146+0000","last_clean":"2024-03-04T13:01:00.027146+0000","last_became_active":"2024-03-04T12:36:05.289053+0000","last_became_peered":"2024-03-04T12:36:05.289053+0000","last_unstale":"2024-03-04T13:01:00.027146+0000","last_undegraded":"2024-03-04T13:01:00.027146+0000","last_fullsized":"2024-03-04T13:01:00.027146+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'322","last_scrub_stamp":"2024-03-04T13:01:00.027054+0000","last_deep_scrub":"256'322","last_deep_scrub_stamp":"2024-03-04T13:01:00.027054+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.027054+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:43.626153+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2688993,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":60644,"num_write":1189,"num_write_kb":49301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":488,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.060336+0000","last_change":"2024-03-04T13:00:56.060387+0000","last_active":"2024-03-04T13:00:56.060336+0000","last_peered":"2024-03-04T13:00:56.060336+0000","last_clean":"2024-03-04T13:00:56.060336+0000","last_became_active":"2024-03-04T12:36:09.308231+0000","last_became_peered":"2024-03-04T12:36:09.308231+0000","last_unstale":"2024-03-04T13:00:56.060336+0000","last_undegraded":"2024-03-04T13:00:56.060336+0000","last_fullsized":"2024-03-04T13:00:56.060336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:56.060200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:56.060200+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.060200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:48:33.656726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"256'281","reported_seq":835,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.683310+0000","last_change":"2024-03-04T13:00:43.683361+0000","last_active":"2024-03-04T13:00:43.683310+0000","last_peered":"2024-03-04T13:00:43.683310+0000","last_clean":"2024-03-04T13:00:43.683310+0000","last_became_active":"2024-03-04T12:36:11.954568+0000","last_became_peered":"2024-03-04T12:36:11.954568+0000","last_unstale":"2024-03-04T13:00:43.683310+0000","last_undegraded":"2024-03-04T13:00:43.683310+0000","last_fullsized":"2024-03-04T13:00:43.683310+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'281","last_scrub_stamp":"2024-03-04T13:00:43.683206+0000","last_deep_scrub":"256'281","last_deep_scrub_stamp":"2024-03-04T13:00:43.683206+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.683206+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:03.087502+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47143,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":469,"num_read_kb":1144,"num_write":392,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.352755+0000","last_change":"2024-03-04T13:00:35.352796+0000","last_active":"2024-03-04T13:00:35.352755+0000","last_peered":"2024-03-04T13:00:35.352755+0000","last_clean":"2024-03-04T13:00:35.352755+0000","last_became_active":"2024-03-04T12:36:13.346665+0000","last_became_peered":"2024-03-04T12:36:13.346665+0000","last_unstale":"2024-03-04T13:00:35.352755+0000","last_undegraded":"2024-03-04T13:00:35.352755+0000","last_fullsized":"2024-03-04T13:00:35.352755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:35.352646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:35.352646+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.352646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:01.849654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'106","reported_seq":579,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.473585+0000","last_change":"2024-03-04T13:00:29.473616+0000","last_active":"2024-03-04T13:00:29.473585+0000","last_peered":"2024-03-04T13:00:29.473585+0000","last_clean":"2024-03-04T13:00:29.473585+0000","last_became_active":"2024-03-04T12:36:15.363269+0000","last_became_peered":"2024-03-04T12:36:15.363269+0000","last_unstale":"2024-03-04T13:00:29.473585+0000","last_undegraded":"2024-03-04T13:00:29.473585+0000","last_fullsized":"2024-03-04T13:00:29.473585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'106","last_scrub_stamp":"2024-03-04T13:00:29.473497+0000","last_deep_scrub":"256'106","last_deep_scrub_stamp":"2024-03-04T13:00:29.473497+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.473497+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:09.775009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"256'431","reported_seq":1949,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.119779+0000","last_change":"2024-03-04T13:00:45.119811+0000","last_active":"2024-03-04T13:00:45.119779+0000","last_peered":"2024-03-04T13:00:45.119779+0000","last_clean":"2024-03-04T13:00:45.119779+0000","last_became_active":"2024-03-04T12:36:07.295353+0000","last_became_peered":"2024-03-04T12:36:07.295353+0000","last_unstale":"2024-03-04T13:00:45.119779+0000","last_undegraded":"2024-03-04T13:00:45.119779+0000","last_fullsized":"2024-03-04T13:00:45.119779+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'431","last_scrub_stamp":"2024-03-04T13:00:45.119711+0000","last_deep_scrub":"256'431","last_deep_scrub_stamp":"2024-03-04T13:00:45.119711+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.119711+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:51.239371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2362,"num_read_kb":2211,"num_write":524,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"256'511","reported_seq":1158,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.129162+0000","last_change":"2024-03-04T12:36:05.293958+0000","last_active":"2024-03-04T13:00:17.129162+0000","last_peered":"2024-03-04T13:00:17.129162+0000","last_clean":"2024-03-04T13:00:17.129162+0000","last_became_active":"2024-03-04T12:36:05.293646+0000","last_became_peered":"2024-03-04T12:36:05.293646+0000","last_unstale":"2024-03-04T13:00:17.129162+0000","last_undegraded":"2024-03-04T13:00:17.129162+0000","last_fullsized":"2024-03-04T13:00:17.129162+0000","mapping_epoch":20,"log_start":"256'500","ondisk_log_start":"256'500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242951,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":853,"num_read_kb":46890,"num_write":1453,"num_write_kb":44359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":486,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.333638+0000","last_change":"2024-03-04T13:00:36.333662+0000","last_active":"2024-03-04T13:00:36.333638+0000","last_peered":"2024-03-04T13:00:36.333638+0000","last_clean":"2024-03-04T13:00:36.333638+0000","last_became_active":"2024-03-04T12:36:09.305073+0000","last_became_peered":"2024-03-04T12:36:09.305073+0000","last_unstale":"2024-03-04T13:00:36.333638+0000","last_undegraded":"2024-03-04T13:00:36.333638+0000","last_fullsized":"2024-03-04T13:00:36.333638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:36.333509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:36.333509+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.333509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:13.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"256'70","reported_seq":572,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.123546+0000","last_change":"2024-03-04T13:00:35.123593+0000","last_active":"2024-03-04T13:00:35.123546+0000","last_peered":"2024-03-04T13:00:35.123546+0000","last_clean":"2024-03-04T13:00:35.123546+0000","last_became_active":"2024-03-04T12:36:11.954563+0000","last_became_peered":"2024-03-04T12:36:11.954563+0000","last_unstale":"2024-03-04T13:00:35.123546+0000","last_undegraded":"2024-03-04T13:00:35.123546+0000","last_fullsized":"2024-03-04T13:00:35.123546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'70","last_scrub_stamp":"2024-03-04T13:00:35.123457+0000","last_deep_scrub":"256'70","last_deep_scrub_stamp":"2024-03-04T13:00:35.123457+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.123457+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:38.665714+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":71,"num_read_kb":64,"num_write":78,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"256'482","reported_seq":1816,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.719943+0000","last_change":"2024-03-04T13:00:33.719971+0000","last_active":"2024-03-04T13:00:33.719943+0000","last_peered":"2024-03-04T13:00:33.719943+0000","last_clean":"2024-03-04T13:00:33.719943+0000","last_became_active":"2024-03-04T12:36:13.340221+0000","last_became_peered":"2024-03-04T12:36:13.340221+0000","last_unstale":"2024-03-04T13:00:33.719943+0000","last_undegraded":"2024-03-04T13:00:33.719943+0000","last_fullsized":"2024-03-04T13:00:33.719943+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'482","last_scrub_stamp":"2024-03-04T13:00:33.719854+0000","last_deep_scrub":"256'482","last_deep_scrub_stamp":"2024-03-04T13:00:33.719854+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.719854+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:52.429432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"256'134","reported_seq":617,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.308023+0000","last_change":"2024-03-04T13:00:33.308076+0000","last_active":"2024-03-04T13:00:33.308023+0000","last_peered":"2024-03-04T13:00:33.308023+0000","last_clean":"2024-03-04T13:00:33.308023+0000","last_became_active":"2024-03-04T12:36:15.364688+0000","last_became_peered":"2024-03-04T12:36:15.364688+0000","last_unstale":"2024-03-04T13:00:33.308023+0000","last_undegraded":"2024-03-04T13:00:33.308023+0000","last_fullsized":"2024-03-04T13:00:33.308023+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'134","last_scrub_stamp":"2024-03-04T13:00:33.307905+0000","last_deep_scrub":"256'134","last_deep_scrub_stamp":"2024-03-04T13:00:33.307905+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.307905+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:36.869465+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":294,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"256'357","reported_seq":1821,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:54.914823+0000","last_change":"2024-03-04T12:36:07.291346+0000","last_active":"2024-03-04T12:59:54.914823+0000","last_peered":"2024-03-04T12:59:54.914823+0000","last_clean":"2024-03-04T12:59:54.914823+0000","last_became_active":"2024-03-04T12:36:07.290637+0000","last_became_peered":"2024-03-04T12:36:07.290637+0000","last_unstale":"2024-03-04T12:59:54.914823+0000","last_undegraded":"2024-03-04T12:59:54.914823+0000","last_fullsized":"2024-03-04T12:59:54.914823+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1998,"num_read_kb":1913,"num_write":399,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"256'431","reported_seq":1093,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.216587+0000","last_change":"2024-03-04T13:00:57.216670+0000","last_active":"2024-03-04T13:00:57.216587+0000","last_peered":"2024-03-04T13:00:57.216587+0000","last_clean":"2024-03-04T13:00:57.216587+0000","last_became_active":"2024-03-04T12:36:05.294568+0000","last_became_peered":"2024-03-04T12:36:05.294568+0000","last_unstale":"2024-03-04T13:00:57.216587+0000","last_undegraded":"2024-03-04T13:00:57.216587+0000","last_fullsized":"2024-03-04T13:00:57.216587+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'431","last_scrub_stamp":"2024-03-04T13:00:57.216499+0000","last_deep_scrub":"256'431","last_deep_scrub_stamp":"2024-03-04T13:00:57.216499+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.216499+0000","objects_scrubbed":10,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:52.566960+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6680724,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":37257,"num_write":1366,"num_write_kb":50791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.292232+0000","last_change":"2024-03-04T13:00:49.292255+0000","last_active":"2024-03-04T13:00:49.292232+0000","last_peered":"2024-03-04T13:00:49.292232+0000","last_clean":"2024-03-04T13:00:49.292232+0000","last_became_active":"2024-03-04T12:36:09.306005+0000","last_became_peered":"2024-03-04T12:36:09.306005+0000","last_unstale":"2024-03-04T13:00:49.292232+0000","last_undegraded":"2024-03-04T13:00:49.292232+0000","last_fullsized":"2024-03-04T13:00:49.292232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:49.292136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:49.292136+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.292136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:16:56.573532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"256'272","reported_seq":822,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.024730+0000","last_change":"2024-03-04T12:36:11.325797+0000","last_active":"2024-03-04T13:00:21.024730+0000","last_peered":"2024-03-04T13:00:21.024730+0000","last_clean":"2024-03-04T13:00:21.024730+0000","last_became_active":"2024-03-04T12:36:11.325503+0000","last_became_peered":"2024-03-04T12:36:11.325503+0000","last_unstale":"2024-03-04T13:00:21.024730+0000","last_undegraded":"2024-03-04T13:00:21.024730+0000","last_fullsized":"2024-03-04T13:00:21.024730+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:10.304328+0000","last_clean_scrub_stamp":"2024-03-04T12:36:10.304328+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52232,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":458,"num_read_kb":1083,"num_write":374,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.438680+0000","last_change":"2024-03-04T13:00:45.438699+0000","last_active":"2024-03-04T13:00:45.438680+0000","last_peered":"2024-03-04T13:00:45.438680+0000","last_clean":"2024-03-04T13:00:45.438680+0000","last_became_active":"2024-03-04T12:36:13.339349+0000","last_became_peered":"2024-03-04T12:36:13.339349+0000","last_unstale":"2024-03-04T13:00:45.438680+0000","last_undegraded":"2024-03-04T13:00:45.438680+0000","last_fullsized":"2024-03-04T13:00:45.438680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:45.438606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:45.438606+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.438606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:36.229715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"256'112","reported_seq":648,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.281626+0000","last_change":"2024-03-04T13:00:36.281667+0000","last_active":"2024-03-04T13:00:36.281626+0000","last_peered":"2024-03-04T13:00:36.281626+0000","last_clean":"2024-03-04T13:00:36.281626+0000","last_became_active":"2024-03-04T12:36:15.352383+0000","last_became_peered":"2024-03-04T12:36:15.352383+0000","last_unstale":"2024-03-04T13:00:36.281626+0000","last_undegraded":"2024-03-04T13:00:36.281626+0000","last_fullsized":"2024-03-04T13:00:36.281626+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'112","last_scrub_stamp":"2024-03-04T13:00:36.281541+0000","last_deep_scrub":"256'112","last_deep_scrub_stamp":"2024-03-04T13:00:36.281541+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.281541+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:36:25.279505+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":264,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"256'407","reported_seq":1785,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.063163+0000","last_change":"2024-03-04T13:00:45.063218+0000","last_active":"2024-03-04T13:00:45.063163+0000","last_peered":"2024-03-04T13:00:45.063163+0000","last_clean":"2024-03-04T13:00:45.063163+0000","last_became_active":"2024-03-04T12:36:07.295956+0000","last_became_peered":"2024-03-04T12:36:07.295956+0000","last_unstale":"2024-03-04T13:00:45.063163+0000","last_undegraded":"2024-03-04T13:00:45.063163+0000","last_fullsized":"2024-03-04T13:00:45.063163+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'407","last_scrub_stamp":"2024-03-04T13:00:45.063058+0000","last_deep_scrub":"256'407","last_deep_scrub_stamp":"2024-03-04T13:00:45.063058+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.063058+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:45.236704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2057,"num_read_kb":1911,"num_write":497,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1661,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"256'294","reported_seq":895,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.156114+0000","last_change":"2024-03-04T13:00:55.156169+0000","last_active":"2024-03-04T13:00:55.156114+0000","last_peered":"2024-03-04T13:00:55.156114+0000","last_clean":"2024-03-04T13:00:55.156114+0000","last_became_active":"2024-03-04T12:36:05.294686+0000","last_became_peered":"2024-03-04T12:36:05.294686+0000","last_unstale":"2024-03-04T13:00:55.156114+0000","last_undegraded":"2024-03-04T13:00:55.156114+0000","last_fullsized":"2024-03-04T13:00:55.156114+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'294","last_scrub_stamp":"2024-03-04T13:00:55.156012+0000","last_deep_scrub":"256'294","last_deep_scrub_stamp":"2024-03-04T13:00:55.156012+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.156012+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:38:18.762691+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":38414,"num_write":1001,"num_write_kb":48852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.184651+0000","last_change":"2024-03-04T13:00:54.184676+0000","last_active":"2024-03-04T13:00:54.184651+0000","last_peered":"2024-03-04T13:00:54.184651+0000","last_clean":"2024-03-04T13:00:54.184651+0000","last_became_active":"2024-03-04T12:36:09.314912+0000","last_became_peered":"2024-03-04T12:36:09.314912+0000","last_unstale":"2024-03-04T13:00:54.184651+0000","last_undegraded":"2024-03-04T13:00:54.184651+0000","last_fullsized":"2024-03-04T13:00:54.184651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:54.184558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:54.184558+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.184558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:06.693943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"256'269","reported_seq":815,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.483058+0000","last_change":"2024-03-04T13:00:56.483127+0000","last_active":"2024-03-04T13:00:56.483058+0000","last_peered":"2024-03-04T13:00:56.483058+0000","last_clean":"2024-03-04T13:00:56.483058+0000","last_became_active":"2024-03-04T12:36:11.325238+0000","last_became_peered":"2024-03-04T12:36:11.325238+0000","last_unstale":"2024-03-04T13:00:56.483058+0000","last_undegraded":"2024-03-04T13:00:56.483058+0000","last_fullsized":"2024-03-04T13:00:56.483058+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'269","last_scrub_stamp":"2024-03-04T13:00:56.482960+0000","last_deep_scrub":"256'269","last_deep_scrub_stamp":"2024-03-04T13:00:56.482960+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.482960+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:36:12.707737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45924,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1039,"num_write":360,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.728346+0000","last_change":"2024-03-04T13:00:32.728368+0000","last_active":"2024-03-04T13:00:32.728346+0000","last_peered":"2024-03-04T13:00:32.728346+0000","last_clean":"2024-03-04T13:00:32.728346+0000","last_became_active":"2024-03-04T12:36:13.341689+0000","last_became_peered":"2024-03-04T12:36:13.341689+0000","last_unstale":"2024-03-04T13:00:32.728346+0000","last_undegraded":"2024-03-04T13:00:32.728346+0000","last_fullsized":"2024-03-04T13:00:32.728346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:32.728255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:32.728255+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.728255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:29.104225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"256'99","reported_seq":601,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.811874+0000","last_change":"2024-03-04T13:00:35.811925+0000","last_active":"2024-03-04T13:00:35.811874+0000","last_peered":"2024-03-04T13:00:35.811874+0000","last_clean":"2024-03-04T13:00:35.811874+0000","last_became_active":"2024-03-04T12:36:15.353418+0000","last_became_peered":"2024-03-04T12:36:15.353418+0000","last_unstale":"2024-03-04T13:00:35.811874+0000","last_undegraded":"2024-03-04T13:00:35.811874+0000","last_fullsized":"2024-03-04T13:00:35.811874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'99","last_scrub_stamp":"2024-03-04T13:00:35.811760+0000","last_deep_scrub":"256'99","last_deep_scrub_stamp":"2024-03-04T13:00:35.811760+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.811760+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:45.530873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"256'1444","reported_seq":2785,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.627556+0000","last_change":"2024-03-04T13:00:58.627585+0000","last_active":"2024-03-04T13:00:58.627556+0000","last_peered":"2024-03-04T13:00:58.627556+0000","last_clean":"2024-03-04T13:00:58.627556+0000","last_became_active":"2024-03-04T12:36:07.300067+0000","last_became_peered":"2024-03-04T12:36:07.300067+0000","last_unstale":"2024-03-04T13:00:58.627556+0000","last_undegraded":"2024-03-04T13:00:58.627556+0000","last_fullsized":"2024-03-04T13:00:58.627556+0000","mapping_epoch":22,"log_start":"256'1400","ondisk_log_start":"256'1400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1444","last_scrub_stamp":"2024-03-04T13:00:58.627462+0000","last_deep_scrub":"256'1444","last_deep_scrub_stamp":"2024-03-04T13:00:58.627462+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.627462+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":1400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:24.866811+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5752,"num_read_kb":4912,"num_write":2067,"num_write_kb":923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"256'381","reported_seq":1038,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.114261+0000","last_change":"2024-03-04T12:36:05.284059+0000","last_active":"2024-03-04T13:00:17.114261+0000","last_peered":"2024-03-04T13:00:17.114261+0000","last_clean":"2024-03-04T13:00:17.114261+0000","last_became_active":"2024-03-04T12:36:05.283142+0000","last_became_peered":"2024-03-04T12:36:05.283142+0000","last_unstale":"2024-03-04T13:00:17.114261+0000","last_undegraded":"2024-03-04T13:00:17.114261+0000","last_fullsized":"2024-03-04T13:00:17.114261+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":1440,"num_write":1747,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.032882+0000","last_change":"2024-03-04T13:00:52.032906+0000","last_active":"2024-03-04T13:00:52.032882+0000","last_peered":"2024-03-04T13:00:52.032882+0000","last_clean":"2024-03-04T13:00:52.032882+0000","last_became_active":"2024-03-04T12:36:09.305182+0000","last_became_peered":"2024-03-04T12:36:09.305182+0000","last_unstale":"2024-03-04T13:00:52.032882+0000","last_undegraded":"2024-03-04T13:00:52.032882+0000","last_fullsized":"2024-03-04T13:00:52.032882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:52.032789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:52.032789+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.032789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:52:57.003068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"256'241","reported_seq":784,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.648043+0000","last_change":"2024-03-04T13:00:49.648093+0000","last_active":"2024-03-04T13:00:49.648043+0000","last_peered":"2024-03-04T13:00:49.648043+0000","last_clean":"2024-03-04T13:00:49.648043+0000","last_became_active":"2024-03-04T12:36:11.324394+0000","last_became_peered":"2024-03-04T12:36:11.324394+0000","last_unstale":"2024-03-04T13:00:49.648043+0000","last_undegraded":"2024-03-04T13:00:49.648043+0000","last_fullsized":"2024-03-04T13:00:49.648043+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'241","last_scrub_stamp":"2024-03-04T13:00:49.647937+0000","last_deep_scrub":"256'241","last_deep_scrub_stamp":"2024-03-04T13:00:49.647937+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.647937+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:42.725177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":411,"num_read_kb":1022,"num_write":344,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.121199+0000","last_change":"2024-03-04T13:00:34.121222+0000","last_active":"2024-03-04T13:00:34.121199+0000","last_peered":"2024-03-04T13:00:34.121199+0000","last_clean":"2024-03-04T13:00:34.121199+0000","last_became_active":"2024-03-04T12:36:13.340897+0000","last_became_peered":"2024-03-04T12:36:13.340897+0000","last_unstale":"2024-03-04T13:00:34.121199+0000","last_undegraded":"2024-03-04T13:00:34.121199+0000","last_fullsized":"2024-03-04T13:00:34.121199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:34.121113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:34.121113+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.121113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:37.532912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"256'172","reported_seq":1180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.324441+0000","last_change":"2024-03-04T13:00:34.324472+0000","last_active":"2024-03-04T13:00:34.324441+0000","last_peered":"2024-03-04T13:00:34.324441+0000","last_clean":"2024-03-04T13:00:34.324441+0000","last_became_active":"2024-03-04T12:36:15.357141+0000","last_became_peered":"2024-03-04T12:36:15.357141+0000","last_unstale":"2024-03-04T13:00:34.324441+0000","last_undegraded":"2024-03-04T13:00:34.324441+0000","last_fullsized":"2024-03-04T13:00:34.324441+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'172","last_scrub_stamp":"2024-03-04T13:00:34.324343+0000","last_deep_scrub":"256'172","last_deep_scrub_stamp":"2024-03-04T13:00:34.324343+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.324343+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:14:37.999688+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":655,"num_read_kb":655,"num_write":360,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"256'1105","reported_seq":2589,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.023929+0000","last_change":"2024-03-04T12:36:07.291118+0000","last_active":"2024-03-04T13:00:21.023929+0000","last_peered":"2024-03-04T13:00:21.023929+0000","last_clean":"2024-03-04T13:00:21.023929+0000","last_became_active":"2024-03-04T12:36:07.290820+0000","last_became_peered":"2024-03-04T12:36:07.290820+0000","last_unstale":"2024-03-04T13:00:21.023929+0000","last_undegraded":"2024-03-04T13:00:21.023929+0000","last_fullsized":"2024-03-04T13:00:21.023929+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4641,"num_read_kb":4049,"num_write":1526,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"256'314","reported_seq":982,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.091665+0000","last_change":"2024-03-04T12:36:05.290216+0000","last_active":"2024-03-04T13:00:17.091665+0000","last_peered":"2024-03-04T13:00:17.091665+0000","last_clean":"2024-03-04T13:00:17.091665+0000","last_became_active":"2024-03-04T12:36:05.289897+0000","last_became_peered":"2024-03-04T12:36:05.289897+0000","last_unstale":"2024-03-04T13:00:17.091665+0000","last_undegraded":"2024-03-04T13:00:17.091665+0000","last_fullsized":"2024-03-04T13:00:17.091665+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525438,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":585,"num_read_kb":14927,"num_write":1035,"num_write_kb":32177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"256'2","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.381434+0000","last_change":"2024-03-04T13:00:40.381460+0000","last_active":"2024-03-04T13:00:40.381434+0000","last_peered":"2024-03-04T13:00:40.381434+0000","last_clean":"2024-03-04T13:00:40.381434+0000","last_became_active":"2024-03-04T12:36:09.310855+0000","last_became_peered":"2024-03-04T12:36:09.310855+0000","last_unstale":"2024-03-04T13:00:40.381434+0000","last_undegraded":"2024-03-04T13:00:40.381434+0000","last_fullsized":"2024-03-04T13:00:40.381434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:40.381349+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:40.381349+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.381349+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:49.986949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"256'269","reported_seq":838,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.150055+0000","last_change":"2024-03-04T13:00:39.150096+0000","last_active":"2024-03-04T13:00:39.150055+0000","last_peered":"2024-03-04T13:00:39.150055+0000","last_clean":"2024-03-04T13:00:39.150055+0000","last_became_active":"2024-03-04T12:36:11.323352+0000","last_became_peered":"2024-03-04T12:36:11.323352+0000","last_unstale":"2024-03-04T13:00:39.150055+0000","last_undegraded":"2024-03-04T13:00:39.150055+0000","last_fullsized":"2024-03-04T13:00:39.150055+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'269","last_scrub_stamp":"2024-03-04T13:00:39.149959+0000","last_deep_scrub":"256'269","last_deep_scrub_stamp":"2024-03-04T13:00:39.149959+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.149959+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:08:10.926685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":1008,"num_write":350,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":471,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.533751+0000","last_change":"2024-03-04T13:00:41.533773+0000","last_active":"2024-03-04T13:00:41.533751+0000","last_peered":"2024-03-04T13:00:41.533751+0000","last_clean":"2024-03-04T13:00:41.533751+0000","last_became_active":"2024-03-04T12:36:13.342656+0000","last_became_peered":"2024-03-04T12:36:13.342656+0000","last_unstale":"2024-03-04T13:00:41.533751+0000","last_undegraded":"2024-03-04T13:00:41.533751+0000","last_fullsized":"2024-03-04T13:00:41.533751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:41.533655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:41.533655+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.533655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:57.620759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"256'104","reported_seq":586,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.145696+0000","last_change":"2024-03-04T13:00:30.145729+0000","last_active":"2024-03-04T13:00:30.145696+0000","last_peered":"2024-03-04T13:00:30.145696+0000","last_clean":"2024-03-04T13:00:30.145696+0000","last_became_active":"2024-03-04T12:36:15.352333+0000","last_became_peered":"2024-03-04T12:36:15.352333+0000","last_unstale":"2024-03-04T13:00:30.145696+0000","last_undegraded":"2024-03-04T13:00:30.145696+0000","last_fullsized":"2024-03-04T13:00:30.145696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'104","last_scrub_stamp":"2024-03-04T13:00:30.145579+0000","last_deep_scrub":"256'104","last_deep_scrub_stamp":"2024-03-04T13:00:30.145579+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.145579+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:30.216312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":93,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"256'394","reported_seq":1898,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.413355+0000","last_change":"2024-03-04T13:00:47.413399+0000","last_active":"2024-03-04T13:00:47.413355+0000","last_peered":"2024-03-04T13:00:47.413355+0000","last_clean":"2024-03-04T13:00:47.413355+0000","last_became_active":"2024-03-04T12:36:07.297660+0000","last_became_peered":"2024-03-04T12:36:07.297660+0000","last_unstale":"2024-03-04T13:00:47.413355+0000","last_undegraded":"2024-03-04T13:00:47.413355+0000","last_fullsized":"2024-03-04T13:00:47.413355+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'394","last_scrub_stamp":"2024-03-04T13:00:47.413268+0000","last_deep_scrub":"256'394","last_deep_scrub_stamp":"2024-03-04T13:00:47.413268+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.413268+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:01.581295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":478,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2632,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"256'280","reported_seq":874,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.768551+0000","last_change":"2024-03-04T13:00:49.768622+0000","last_active":"2024-03-04T13:00:49.768551+0000","last_peered":"2024-03-04T13:00:49.768551+0000","last_clean":"2024-03-04T13:00:49.768551+0000","last_became_active":"2024-03-04T12:36:05.279576+0000","last_became_peered":"2024-03-04T12:36:05.279576+0000","last_unstale":"2024-03-04T13:00:49.768551+0000","last_undegraded":"2024-03-04T13:00:49.768551+0000","last_fullsized":"2024-03-04T13:00:49.768551+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'280","last_scrub_stamp":"2024-03-04T13:00:49.768467+0000","last_deep_scrub":"256'280","last_deep_scrub_stamp":"2024-03-04T13:00:49.768467+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.768467+0000","objects_scrubbed":9,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:06:40.516533+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5591378,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":375,"num_read_kb":32300,"num_write":1079,"num_write_kb":15765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"256'426","reported_seq":1860,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.396310+0000","last_change":"2024-03-04T13:00:41.396339+0000","last_active":"2024-03-04T13:00:41.396310+0000","last_peered":"2024-03-04T13:00:41.396310+0000","last_clean":"2024-03-04T13:00:41.396310+0000","last_became_active":"2024-03-04T12:36:07.300168+0000","last_became_peered":"2024-03-04T12:36:07.300168+0000","last_unstale":"2024-03-04T13:00:41.396310+0000","last_undegraded":"2024-03-04T13:00:41.396310+0000","last_fullsized":"2024-03-04T13:00:41.396310+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'426","last_scrub_stamp":"2024-03-04T13:00:41.396226+0000","last_deep_scrub":"256'426","last_deep_scrub_stamp":"2024-03-04T13:00:41.396226+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.396226+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.864579+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2082,"num_write":535,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":964,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"256'314","reported_seq":939,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.179643+0000","last_change":"2024-03-04T13:00:41.179727+0000","last_active":"2024-03-04T13:00:41.179643+0000","last_peered":"2024-03-04T13:00:41.179643+0000","last_clean":"2024-03-04T13:00:41.179643+0000","last_became_active":"2024-03-04T12:36:05.287233+0000","last_became_peered":"2024-03-04T12:36:05.287233+0000","last_unstale":"2024-03-04T13:00:41.179643+0000","last_undegraded":"2024-03-04T13:00:41.179643+0000","last_fullsized":"2024-03-04T13:00:41.179643+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'314","last_scrub_stamp":"2024-03-04T13:00:41.179534+0000","last_deep_scrub":"256'314","last_deep_scrub_stamp":"2024-03-04T13:00:41.179534+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.179534+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:17:16.905623+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1355534,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":467,"num_read_kb":46552,"num_write":1196,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"256'339","reported_seq":1840,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.320057+0000","last_change":"2024-03-04T13:00:45.320086+0000","last_active":"2024-03-04T13:00:45.320057+0000","last_peered":"2024-03-04T13:00:45.320057+0000","last_clean":"2024-03-04T13:00:45.320057+0000","last_became_active":"2024-03-04T12:36:07.296104+0000","last_became_peered":"2024-03-04T12:36:07.296104+0000","last_unstale":"2024-03-04T13:00:45.320057+0000","last_undegraded":"2024-03-04T13:00:45.320057+0000","last_fullsized":"2024-03-04T13:00:45.320057+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'339","last_scrub_stamp":"2024-03-04T13:00:45.319962+0000","last_deep_scrub":"256'339","last_deep_scrub_stamp":"2024-03-04T13:00:45.319962+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.319962+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:39:45.319778+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1942,"num_read_kb":1888,"num_write":368,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"256'349","reported_seq":978,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.296780+0000","last_change":"2024-03-04T13:00:29.296873+0000","last_active":"2024-03-04T13:00:29.296780+0000","last_peered":"2024-03-04T13:00:29.296780+0000","last_clean":"2024-03-04T13:00:29.296780+0000","last_became_active":"2024-03-04T12:36:41.075381+0000","last_became_peered":"2024-03-04T12:36:41.075381+0000","last_unstale":"2024-03-04T13:00:29.296780+0000","last_undegraded":"2024-03-04T13:00:29.296780+0000","last_fullsized":"2024-03-04T13:00:29.296780+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'349","last_scrub_stamp":"2024-03-04T13:00:29.296681+0000","last_deep_scrub":"256'349","last_deep_scrub_stamp":"2024-03-04T13:00:29.296681+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.296681+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:14.010604+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8448064,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":52899,"num_write":1289,"num_write_kb":57282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"256'1028","reported_seq":2586,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.339309+0000","last_change":"2024-03-04T13:00:43.339356+0000","last_active":"2024-03-04T13:00:43.339309+0000","last_peered":"2024-03-04T13:00:43.339309+0000","last_clean":"2024-03-04T13:00:43.339309+0000","last_became_active":"2024-03-04T12:36:07.299282+0000","last_became_peered":"2024-03-04T12:36:07.299282+0000","last_unstale":"2024-03-04T13:00:43.339309+0000","last_undegraded":"2024-03-04T13:00:43.339309+0000","last_fullsized":"2024-03-04T13:00:43.339309+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1028","last_scrub_stamp":"2024-03-04T13:00:43.339218+0000","last_deep_scrub":"256'1028","last_deep_scrub_stamp":"2024-03-04T13:00:43.339218+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.339218+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":1000,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:14:07.769583+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4484,"num_read_kb":3892,"num_write":1521,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"256'291","reported_seq":944,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.105709+0000","last_change":"2024-03-04T12:36:05.283738+0000","last_active":"2024-03-04T13:00:17.105709+0000","last_peered":"2024-03-04T13:00:17.105709+0000","last_clean":"2024-03-04T13:00:17.105709+0000","last_became_active":"2024-03-04T12:36:05.283327+0000","last_became_peered":"2024-03-04T12:36:05.283327+0000","last_unstale":"2024-03-04T13:00:17.105709+0000","last_undegraded":"2024-03-04T13:00:17.105709+0000","last_fullsized":"2024-03-04T13:00:17.105709+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6002849,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":66598,"num_write":994,"num_write_kb":37083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"256'427","reported_seq":1890,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.644134+0000","last_change":"2024-03-04T13:00:57.644183+0000","last_active":"2024-03-04T13:00:57.644134+0000","last_peered":"2024-03-04T13:00:57.644134+0000","last_clean":"2024-03-04T13:00:57.644134+0000","last_became_active":"2024-03-04T12:36:07.292950+0000","last_became_peered":"2024-03-04T12:36:07.292950+0000","last_unstale":"2024-03-04T13:00:57.644134+0000","last_undegraded":"2024-03-04T13:00:57.644134+0000","last_fullsized":"2024-03-04T13:00:57.644134+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'427","last_scrub_stamp":"2024-03-04T13:00:57.644027+0000","last_deep_scrub":"256'427","last_deep_scrub_stamp":"2024-03-04T13:00:57.644027+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.644027+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:20:44.730407+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2086,"num_write":515,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"256'283","reported_seq":898,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.121186+0000","last_change":"2024-03-04T12:36:05.287013+0000","last_active":"2024-03-04T13:00:17.121186+0000","last_peered":"2024-03-04T13:00:17.121186+0000","last_clean":"2024-03-04T13:00:17.121186+0000","last_became_active":"2024-03-04T12:36:05.286745+0000","last_became_peered":"2024-03-04T12:36:05.286745+0000","last_unstale":"2024-03-04T13:00:17.121186+0000","last_undegraded":"2024-03-04T13:00:17.121186+0000","last_fullsized":"2024-03-04T13:00:17.121186+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":38207,"num_write":1041,"num_write_kb":19360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"256'355","reported_seq":1890,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:48.844852+0000","last_change":"2024-03-04T12:36:07.291981+0000","last_active":"2024-03-04T12:59:48.844852+0000","last_peered":"2024-03-04T12:59:48.844852+0000","last_clean":"2024-03-04T12:59:48.844852+0000","last_became_active":"2024-03-04T12:36:07.291690+0000","last_became_peered":"2024-03-04T12:36:07.291690+0000","last_unstale":"2024-03-04T12:59:48.844852+0000","last_undegraded":"2024-03-04T12:59:48.844852+0000","last_fullsized":"2024-03-04T12:59:48.844852+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2163,"num_read_kb":2091,"num_write":400,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"256'300","reported_seq":926,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.389712+0000","last_change":"2024-03-04T13:00:59.389753+0000","last_active":"2024-03-04T13:00:59.389712+0000","last_peered":"2024-03-04T13:00:59.389712+0000","last_clean":"2024-03-04T13:00:59.389712+0000","last_became_active":"2024-03-04T12:36:05.287529+0000","last_became_peered":"2024-03-04T12:36:05.287529+0000","last_unstale":"2024-03-04T13:00:59.389712+0000","last_undegraded":"2024-03-04T13:00:59.389712+0000","last_fullsized":"2024-03-04T13:00:59.389712+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'300","last_scrub_stamp":"2024-03-04T13:00:59.389613+0000","last_deep_scrub":"256'300","last_deep_scrub_stamp":"2024-03-04T13:00:59.389613+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.389613+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:18:58.734299+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":37296,"num_write":1090,"num_write_kb":36513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"256'739","reported_seq":2231,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.662002+0000","last_change":"2024-03-04T13:00:56.662029+0000","last_active":"2024-03-04T13:00:56.662002+0000","last_peered":"2024-03-04T13:00:56.662002+0000","last_clean":"2024-03-04T13:00:56.662002+0000","last_became_active":"2024-03-04T12:36:07.299881+0000","last_became_peered":"2024-03-04T12:36:07.299881+0000","last_unstale":"2024-03-04T13:00:56.662002+0000","last_undegraded":"2024-03-04T13:00:56.662002+0000","last_fullsized":"2024-03-04T13:00:56.662002+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'739","last_scrub_stamp":"2024-03-04T13:00:56.661911+0000","last_deep_scrub":"256'739","last_deep_scrub_stamp":"2024-03-04T13:00:56.661911+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.661911+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:41:05.923331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3309,"num_read_kb":2983,"num_write":974,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"256'330","reported_seq":963,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.705064+0000","last_change":"2024-03-04T13:00:52.705124+0000","last_active":"2024-03-04T13:00:52.705064+0000","last_peered":"2024-03-04T13:00:52.705064+0000","last_clean":"2024-03-04T13:00:52.705064+0000","last_became_active":"2024-03-04T12:36:05.286397+0000","last_became_peered":"2024-03-04T12:36:05.286397+0000","last_unstale":"2024-03-04T13:00:52.705064+0000","last_undegraded":"2024-03-04T13:00:52.705064+0000","last_fullsized":"2024-03-04T13:00:52.705064+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'330","last_scrub_stamp":"2024-03-04T13:00:52.704955+0000","last_deep_scrub":"256'330","last_deep_scrub_stamp":"2024-03-04T13:00:52.704955+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.704955+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:27:08.892935+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472549,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":459,"num_read_kb":103287,"num_write":1220,"num_write_kb":47023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"256'477","reported_seq":2082,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.756315+0000","last_change":"2024-03-04T13:00:47.756343+0000","last_active":"2024-03-04T13:00:47.756315+0000","last_peered":"2024-03-04T13:00:47.756315+0000","last_clean":"2024-03-04T13:00:47.756315+0000","last_became_active":"2024-03-04T12:36:07.292501+0000","last_became_peered":"2024-03-04T12:36:07.292501+0000","last_unstale":"2024-03-04T13:00:47.756315+0000","last_undegraded":"2024-03-04T13:00:47.756315+0000","last_fullsized":"2024-03-04T13:00:47.756315+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'477","last_scrub_stamp":"2024-03-04T13:00:47.756208+0000","last_deep_scrub":"256'477","last_deep_scrub_stamp":"2024-03-04T13:00:47.756208+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.756208+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:29:15.876341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2330,"num_write":558,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"256'323","reported_seq":921,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.055639+0000","last_change":"2024-03-04T12:36:05.294285+0000","last_active":"2024-03-04T13:00:17.055639+0000","last_peered":"2024-03-04T13:00:17.055639+0000","last_clean":"2024-03-04T13:00:17.055639+0000","last_became_active":"2024-03-04T12:36:05.294007+0000","last_became_peered":"2024-03-04T12:36:05.294007+0000","last_unstale":"2024-03-04T13:00:17.055639+0000","last_undegraded":"2024-03-04T13:00:17.055639+0000","last_fullsized":"2024-03-04T13:00:17.055639+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":23598,"num_write":1193,"num_write_kb":28139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"256'446","reported_seq":1958,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T12:59:55.480046+0000","last_change":"2024-03-04T12:36:07.294584+0000","last_active":"2024-03-04T12:59:55.480046+0000","last_peered":"2024-03-04T12:59:55.480046+0000","last_clean":"2024-03-04T12:59:55.480046+0000","last_became_active":"2024-03-04T12:36:07.294283+0000","last_became_peered":"2024-03-04T12:36:07.294283+0000","last_unstale":"2024-03-04T12:59:55.480046+0000","last_undegraded":"2024-03-04T12:59:55.480046+0000","last_fullsized":"2024-03-04T12:59:55.480046+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:06.269609+0000","last_clean_scrub_stamp":"2024-03-04T12:36:06.269609+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2476,"num_read_kb":2316,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"256'339","reported_seq":953,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.124132+0000","last_change":"2024-03-04T12:36:05.290249+0000","last_active":"2024-03-04T13:00:17.124132+0000","last_peered":"2024-03-04T13:00:17.124132+0000","last_clean":"2024-03-04T13:00:17.124132+0000","last_became_active":"2024-03-04T12:36:05.289882+0000","last_became_peered":"2024-03-04T12:36:05.289882+0000","last_unstale":"2024-03-04T13:00:17.124132+0000","last_undegraded":"2024-03-04T13:00:17.124132+0000","last_fullsized":"2024-03-04T13:00:17.124132+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":35092,"num_write":1098,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"256'455","reported_seq":1947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.067211+0000","last_change":"2024-03-04T13:00:51.067257+0000","last_active":"2024-03-04T13:00:51.067211+0000","last_peered":"2024-03-04T13:00:51.067211+0000","last_clean":"2024-03-04T13:00:51.067211+0000","last_became_active":"2024-03-04T12:36:07.292904+0000","last_became_peered":"2024-03-04T12:36:07.292904+0000","last_unstale":"2024-03-04T13:00:51.067211+0000","last_undegraded":"2024-03-04T13:00:51.067211+0000","last_fullsized":"2024-03-04T13:00:51.067211+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'455","last_scrub_stamp":"2024-03-04T13:00:51.067100+0000","last_deep_scrub":"256'455","last_deep_scrub_stamp":"2024-03-04T13:00:51.067100+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.067100+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:31:42.315352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2160,"num_write":550,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":241,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"256'305","reported_seq":893,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.633227+0000","last_change":"2024-03-04T12:36:05.294662+0000","last_active":"2024-03-04T13:00:22.633227+0000","last_peered":"2024-03-04T13:00:22.633227+0000","last_clean":"2024-03-04T13:00:22.633227+0000","last_became_active":"2024-03-04T12:36:05.294338+0000","last_became_peered":"2024-03-04T12:36:05.294338+0000","last_unstale":"2024-03-04T13:00:22.633227+0000","last_undegraded":"2024-03-04T13:00:22.633227+0000","last_fullsized":"2024-03-04T13:00:22.633227+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263242,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":434,"num_read_kb":2630,"num_write":1136,"num_write_kb":25999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"256'1256","reported_seq":2852,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.111171+0000","last_change":"2024-03-04T13:00:43.111171+0000","last_active":"2024-03-04T13:00:43.111171+0000","last_peered":"2024-03-04T13:00:43.111171+0000","last_clean":"2024-03-04T13:00:43.111171+0000","last_became_active":"2024-03-04T12:36:07.292294+0000","last_became_peered":"2024-03-04T12:36:07.292294+0000","last_unstale":"2024-03-04T13:00:43.111171+0000","last_undegraded":"2024-03-04T13:00:43.111171+0000","last_fullsized":"2024-03-04T13:00:43.111171+0000","mapping_epoch":22,"log_start":"256'1200","ondisk_log_start":"256'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1256","last_scrub_stamp":"2024-03-04T13:00:43.111042+0000","last_deep_scrub":"256'1256","last_deep_scrub_stamp":"2024-03-04T13:00:43.111042+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.111042+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":1200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:59.468907+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5403,"num_read_kb":4680,"num_write":1785,"num_write_kb":760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2067,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"256'323","reported_seq":926,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.559751+0000","last_change":"2024-03-04T12:36:05.290703+0000","last_active":"2024-03-04T13:00:23.559751+0000","last_peered":"2024-03-04T13:00:23.559751+0000","last_clean":"2024-03-04T13:00:23.559751+0000","last_became_active":"2024-03-04T12:36:05.290410+0000","last_became_peered":"2024-03-04T12:36:05.290410+0000","last_unstale":"2024-03-04T13:00:23.559751+0000","last_undegraded":"2024-03-04T13:00:23.559751+0000","last_fullsized":"2024-03-04T13:00:23.559751+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2168155,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":19682,"num_write":1207,"num_write_kb":25111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"256'275","reported_seq":1526,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.035923+0000","last_change":"2024-03-04T13:00:47.035923+0000","last_active":"2024-03-04T13:00:47.035923+0000","last_peered":"2024-03-04T13:00:47.035923+0000","last_clean":"2024-03-04T13:00:47.035923+0000","last_became_active":"2024-03-04T12:36:07.291583+0000","last_became_peered":"2024-03-04T12:36:07.291583+0000","last_unstale":"2024-03-04T13:00:47.035923+0000","last_undegraded":"2024-03-04T13:00:47.035923+0000","last_fullsized":"2024-03-04T13:00:47.035923+0000","mapping_epoch":22,"log_start":"256'200","ondisk_log_start":"256'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'275","last_scrub_stamp":"2024-03-04T13:00:47.035802+0000","last_deep_scrub":"256'275","last_deep_scrub_stamp":"2024-03-04T13:00:47.035802+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.035802+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:54:35.976960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1552,"num_read_kb":1496,"num_write":324,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"256'389","reported_seq":1007,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.247463+0000","last_change":"2024-03-04T12:36:05.290812+0000","last_active":"2024-03-04T13:00:21.247463+0000","last_peered":"2024-03-04T13:00:21.247463+0000","last_clean":"2024-03-04T13:00:21.247463+0000","last_became_active":"2024-03-04T12:36:05.290522+0000","last_became_peered":"2024-03-04T12:36:05.290522+0000","last_unstale":"2024-03-04T13:00:21.247463+0000","last_undegraded":"2024-03-04T13:00:21.247463+0000","last_fullsized":"2024-03-04T13:00:21.247463+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11113900,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":595,"num_read_kb":8197,"num_write":1190,"num_write_kb":30951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"256'1119","reported_seq":2706,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.244677+0000","last_change":"2024-03-04T13:00:50.244677+0000","last_active":"2024-03-04T13:00:50.244677+0000","last_peered":"2024-03-04T13:00:50.244677+0000","last_clean":"2024-03-04T13:00:50.244677+0000","last_became_active":"2024-03-04T12:36:07.294536+0000","last_became_peered":"2024-03-04T12:36:07.294536+0000","last_unstale":"2024-03-04T13:00:50.244677+0000","last_undegraded":"2024-03-04T13:00:50.244677+0000","last_fullsized":"2024-03-04T13:00:50.244677+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1119","last_scrub_stamp":"2024-03-04T13:00:50.244566+0000","last_deep_scrub":"256'1119","last_deep_scrub_stamp":"2024-03-04T13:00:50.244566+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.244566+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:22.669433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4737,"num_read_kb":4156,"num_write":1530,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"256'326","reported_seq":949,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.725027+0000","last_change":"2024-03-04T13:00:51.725087+0000","last_active":"2024-03-04T13:00:51.725027+0000","last_peered":"2024-03-04T13:00:51.725027+0000","last_clean":"2024-03-04T13:00:51.725027+0000","last_became_active":"2024-03-04T12:36:05.285924+0000","last_became_peered":"2024-03-04T12:36:05.285924+0000","last_unstale":"2024-03-04T13:00:51.725027+0000","last_undegraded":"2024-03-04T13:00:51.725027+0000","last_fullsized":"2024-03-04T13:00:51.725027+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'326","last_scrub_stamp":"2024-03-04T13:00:51.724916+0000","last_deep_scrub":"256'326","last_deep_scrub_stamp":"2024-03-04T13:00:51.724916+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.724916+0000","objects_scrubbed":10,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:44.286917+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671806,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":413,"num_read_kb":22814,"num_write":1062,"num_write_kb":24147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"256'331","reported_seq":1647,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.482546+0000","last_change":"2024-03-04T13:00:48.482546+0000","last_active":"2024-03-04T13:00:48.482546+0000","last_peered":"2024-03-04T13:00:48.482546+0000","last_clean":"2024-03-04T13:00:48.482546+0000","last_became_active":"2024-03-04T12:36:07.302371+0000","last_became_peered":"2024-03-04T12:36:07.302371+0000","last_unstale":"2024-03-04T13:00:48.482546+0000","last_undegraded":"2024-03-04T13:00:48.482546+0000","last_fullsized":"2024-03-04T13:00:48.482546+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'331","last_scrub_stamp":"2024-03-04T13:00:48.482398+0000","last_deep_scrub":"256'331","last_deep_scrub_stamp":"2024-03-04T13:00:48.482398+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.482398+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:36.170349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1728,"num_read_kb":1642,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"256'317","reported_seq":913,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.483266+0000","last_change":"2024-03-04T12:36:05.290406+0000","last_active":"2024-03-04T13:00:24.483266+0000","last_peered":"2024-03-04T13:00:24.483266+0000","last_clean":"2024-03-04T13:00:24.483266+0000","last_became_active":"2024-03-04T12:36:05.290032+0000","last_became_peered":"2024-03-04T12:36:05.290032+0000","last_unstale":"2024-03-04T13:00:24.483266+0000","last_undegraded":"2024-03-04T13:00:24.483266+0000","last_fullsized":"2024-03-04T13:00:24.483266+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489519,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":31102,"num_write":1081,"num_write_kb":33345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"256'418","reported_seq":1954,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.578731+0000","last_change":"2024-03-04T13:01:00.578797+0000","last_active":"2024-03-04T13:01:00.578731+0000","last_peered":"2024-03-04T13:01:00.578731+0000","last_clean":"2024-03-04T13:01:00.578731+0000","last_became_active":"2024-03-04T12:36:07.299718+0000","last_became_peered":"2024-03-04T12:36:07.299718+0000","last_unstale":"2024-03-04T13:01:00.578731+0000","last_undegraded":"2024-03-04T13:01:00.578731+0000","last_fullsized":"2024-03-04T13:01:00.578731+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'418","last_scrub_stamp":"2024-03-04T13:01:00.578634+0000","last_deep_scrub":"256'418","last_deep_scrub_stamp":"2024-03-04T13:01:00.578634+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.578634+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:37.681539+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2289,"num_read_kb":2179,"num_write":520,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"256'395","reported_seq":1062,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.207499+0000","last_change":"2024-03-04T13:00:40.207554+0000","last_active":"2024-03-04T13:00:40.207499+0000","last_peered":"2024-03-04T13:00:40.207499+0000","last_clean":"2024-03-04T13:00:40.207499+0000","last_became_active":"2024-03-04T12:36:05.279538+0000","last_became_peered":"2024-03-04T12:36:05.279538+0000","last_unstale":"2024-03-04T13:00:40.207499+0000","last_undegraded":"2024-03-04T13:00:40.207499+0000","last_fullsized":"2024-03-04T13:00:40.207499+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'395","last_scrub_stamp":"2024-03-04T13:00:40.207418+0000","last_deep_scrub":"256'395","last_deep_scrub_stamp":"2024-03-04T13:00:40.207418+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.207418+0000","objects_scrubbed":12,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:25.317833+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4781240,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":615,"num_read_kb":6803,"num_write":1512,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"256'749","reported_seq":2156,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.343025+0000","last_change":"2024-03-04T13:00:48.343052+0000","last_active":"2024-03-04T13:00:48.343025+0000","last_peered":"2024-03-04T13:00:48.343025+0000","last_clean":"2024-03-04T13:00:48.343025+0000","last_became_active":"2024-03-04T12:36:07.294274+0000","last_became_peered":"2024-03-04T12:36:07.294274+0000","last_unstale":"2024-03-04T13:00:48.343025+0000","last_undegraded":"2024-03-04T13:00:48.343025+0000","last_fullsized":"2024-03-04T13:00:48.343025+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'749","last_scrub_stamp":"2024-03-04T13:00:48.342929+0000","last_deep_scrub":"256'749","last_deep_scrub_stamp":"2024-03-04T13:00:48.342929+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.342929+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:34:20.672996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3445,"num_read_kb":3067,"num_write":1017,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"256'369","reported_seq":960,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.246173+0000","last_change":"2024-03-04T13:00:25.246235+0000","last_active":"2024-03-04T13:00:25.246173+0000","last_peered":"2024-03-04T13:00:25.246173+0000","last_clean":"2024-03-04T13:00:25.246173+0000","last_became_active":"2024-03-04T12:36:40.391325+0000","last_became_peered":"2024-03-04T12:36:40.391325+0000","last_unstale":"2024-03-04T13:00:25.246173+0000","last_undegraded":"2024-03-04T13:00:25.246173+0000","last_fullsized":"2024-03-04T13:00:25.246173+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'369","last_scrub_stamp":"2024-03-04T13:00:25.246095+0000","last_deep_scrub":"256'369","last_deep_scrub_stamp":"2024-03-04T13:00:25.246095+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.246095+0000","objects_scrubbed":6,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:52.565129+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2969477,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":505,"num_read_kb":41621,"num_write":1246,"num_write_kb":38740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"256'363","reported_seq":1074,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:17.115608+0000","last_change":"2024-03-04T12:36:05.288067+0000","last_active":"2024-03-04T13:00:17.115608+0000","last_peered":"2024-03-04T13:00:17.115608+0000","last_clean":"2024-03-04T13:00:17.115608+0000","last_became_active":"2024-03-04T12:36:05.287744+0000","last_became_peered":"2024-03-04T12:36:05.287744+0000","last_unstale":"2024-03-04T13:00:17.115608+0000","last_undegraded":"2024-03-04T13:00:17.115608+0000","last_fullsized":"2024-03-04T13:00:17.115608+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:36:04.255396+0000","last_clean_scrub_stamp":"2024-03-04T12:36:04.255396+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984340,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":791,"num_read_kb":29804,"num_write":1288,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"256'538","reported_seq":2102,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.480245+0000","last_change":"2024-03-04T13:00:49.480278+0000","last_active":"2024-03-04T13:00:49.480245+0000","last_peered":"2024-03-04T13:00:49.480245+0000","last_clean":"2024-03-04T13:00:49.480245+0000","last_became_active":"2024-03-04T12:36:07.302290+0000","last_became_peered":"2024-03-04T12:36:07.302290+0000","last_unstale":"2024-03-04T13:00:49.480245+0000","last_undegraded":"2024-03-04T13:00:49.480245+0000","last_fullsized":"2024-03-04T13:00:49.480245+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'538","last_scrub_stamp":"2024-03-04T13:00:49.480150+0000","last_deep_scrub":"256'538","last_deep_scrub_stamp":"2024-03-04T13:00:49.480150+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.480150+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:45:14.990775+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2955,"num_read_kb":2687,"num_write":726,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"256'457","reported_seq":1240,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.355914+0000","last_change":"2024-03-04T13:00:57.355957+0000","last_active":"2024-03-04T13:00:57.355914+0000","last_peered":"2024-03-04T13:00:57.355914+0000","last_clean":"2024-03-04T13:00:57.355914+0000","last_became_active":"2024-03-04T12:36:05.283797+0000","last_became_peered":"2024-03-04T12:36:05.283797+0000","last_unstale":"2024-03-04T13:00:57.355914+0000","last_undegraded":"2024-03-04T13:00:57.355914+0000","last_fullsized":"2024-03-04T13:00:57.355914+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'457","last_scrub_stamp":"2024-03-04T13:00:57.355821+0000","last_deep_scrub":"256'457","last_deep_scrub_stamp":"2024-03-04T13:00:57.355821+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.355821+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:36.376522+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5417905,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1114,"num_read_kb":38636,"num_write":1666,"num_write_kb":30809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"256'787","reported_seq":2222,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.367298+0000","last_change":"2024-03-04T13:00:44.367329+0000","last_active":"2024-03-04T13:00:44.367298+0000","last_peered":"2024-03-04T13:00:44.367298+0000","last_clean":"2024-03-04T13:00:44.367298+0000","last_became_active":"2024-03-04T12:36:07.301542+0000","last_became_peered":"2024-03-04T12:36:07.301542+0000","last_unstale":"2024-03-04T13:00:44.367298+0000","last_undegraded":"2024-03-04T13:00:44.367298+0000","last_fullsized":"2024-03-04T13:00:44.367298+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'787","last_scrub_stamp":"2024-03-04T13:00:44.367203+0000","last_deep_scrub":"256'787","last_deep_scrub_stamp":"2024-03-04T13:00:44.367203+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.367203+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:32.262672+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3434,"num_read_kb":3044,"num_write":1054,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":164,"num_read_kb":179702,"num_write":175,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5885,"num_read_kb":4252,"num_write":2245,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8924,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1079,"ondisk_log_size":1079,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":9441,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":12014,"num_read_kb":11868,"num_write":14038,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1548,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":18882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2403,"ondisk_log_size":2403,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":486,"ondisk_log_size":486,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1548695,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":15552,"num_read_kb":34013,"num_write":13157,"num_write_kb":10848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":618572,"num_omap_keys":1452,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2134,"ondisk_log_size":2134,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1552,"num_read_kb":1546,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":187094,"num_read_kb":170304,"num_write":50851,"num_write_kb":17572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":38103,"num_omap_keys":165,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3854,"ondisk_log_size":3854,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":175727187,"num_objects":435,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":0,"num_read":34803,"num_read_kb":2210949,"num_write":78480,"num_write_kb":2282182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":353116160,"data_stored":351454374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3713,"ondisk_log_size":3713,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":165,"num_read_kb":175660,"num_write":175,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575155,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333184,"kb_used_data":71544,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94038656,"statfs":{"total":96636764160,"available":96295583744,"internally_reserved":0,"allocated":73261056,"data_stored":71540111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575156,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290296,"kb_used_data":38384,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94081544,"statfs":{"total":96636764160,"available":96339501056,"internally_reserved":0,"allocated":39305216,"data_stored":37695435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575156,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151020,"kb_used_data":51876,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94220820,"statfs":{"total":96636764160,"available":96482119680,"internally_reserved":0,"allocated":53121024,"data_stored":51449109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575154,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144096,"kb_used_data":72664,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94227744,"statfs":{"total":96636764160,"available":96489209856,"internally_reserved":0,"allocated":74407936,"data_stored":72693947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575154,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310816,"kb_used_data":49240,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94061024,"statfs":{"total":96636764160,"available":96318488576,"internally_reserved":0,"allocated":50421760,"data_stored":48746373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575155,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140424,"kb_used_data":51008,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94231416,"statfs":{"total":96636764160,"available":96492969984,"internally_reserved":0,"allocated":52232192,"data_stored":50704146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575158,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152644,"kb_used_data":41020,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94219196,"statfs":{"total":96636764160,"available":96480456704,"internally_reserved":0,"allocated":42004480,"data_stored":40455223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575155,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323576,"kb_used_data":63408,"kb_used_omap":1,"kb_used_meta":260158,"kb_avail":94048264,"statfs":{"total":96636764160,"available":96305422336,"internally_reserved":0,"allocated":64929792,"data_stored":63233494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":266402245},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45060096,"data_stored":44816819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30089216,"data_stored":29970475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42442752,"data_stored":42316441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38498304,"data_stored":38260992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62513152,"data_stored":62209723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39063552,"data_stored":38866277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31576064,"data_stored":31403645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":63873024,"data_stored":63610002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:01:05.718 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.719 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.719 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.719 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.719 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.720 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.720 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.720 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.720 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.721 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.721 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.721 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.721 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.721 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.721 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.722 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.722 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.722 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.722 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.722 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.723 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.723 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-03-04T12:44:49.431740+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=49, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.723 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.723 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.723 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.723 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.724 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.724 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.724 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.724 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.724 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.725 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.725 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.725 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.725 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.725 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.726 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.726 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.726 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.726 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.726 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.726 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.727 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.727 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.727 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-03-04T12:44:52.452363+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=44, tm_sec=52, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.727 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.727 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.728 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.728 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.728 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.728 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.728 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.729 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.729 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.729 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.729 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.729 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.730 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.730 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.730 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.730 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.731 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.731 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.731 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-04T12:35:46.856449+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=46, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.731 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.731 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.732 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.732 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.732 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-04T12:35:53.217772+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=35, tm_sec=53, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.732 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.733 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.733 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.733 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.733 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.733 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-04T12:36:08.290408+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=8, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.734 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.734 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.734 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.734 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-04T12:36:10.304328+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=10, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.735 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.735 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.735 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.735 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.735 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.736 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.736 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.736 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-04T12:36:06.269609+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=6, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.736 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.736 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.736 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.737 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.737 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.737 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-04T12:36:04.255396+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=36, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:05.737 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-04T13:01:25.738 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:01:26.077 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:01:26.090 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-03-04T13:01:26.092 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":1019,"stamp":"2024-03-04T13:01:25.383713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":211431760,"num_objects":820,"num_object_clones":0,"num_object_copies":1640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":820,"num_whiteouts":0,"num_read":257353,"num_read_kb":2788402,"num_write":159314,"num_write_kb":2552482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":668421,"num_omap_keys":1653,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13803,"ondisk_log_size":13803,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1829416,"kb_used_data":439144,"kb_used_omap":12,"kb_used_meta":1390195,"kb_avail":753145304,"statfs":{"total":773094113280,"available":771220791296,"internally_reserved":0,"allocated":449683456,"data_stored":436517838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1423560240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004741"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:11.893525+0000","last_change":"2024-03-04T13:01:11.893552+0000","last_active":"2024-03-04T13:01:11.893525+0000","last_peered":"2024-03-04T13:01:11.893525+0000","last_clean":"2024-03-04T13:01:11.893525+0000","last_became_active":"2024-03-04T12:51:01.353225+0000","last_became_peered":"2024-03-04T12:51:01.353225+0000","last_unstale":"2024-03-04T13:01:11.893525+0000","last_undegraded":"2024-03-04T13:01:11.893525+0000","last_fullsized":"2024-03-04T13:01:11.893525+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:11.893429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:11.893429+0000","last_clean_scrub_stamp":"2024-03-04T13:01:11.893429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:25:26.204998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"256'2","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.383613+0000","last_change":"2024-03-04T13:01:01.383640+0000","last_active":"2024-03-04T13:01:01.383613+0000","last_peered":"2024-03-04T13:01:01.383613+0000","last_clean":"2024-03-04T13:01:01.383613+0000","last_became_active":"2024-03-04T12:44:53.484341+0000","last_became_peered":"2024-03-04T12:44:53.484341+0000","last_unstale":"2024-03-04T13:01:01.383613+0000","last_undegraded":"2024-03-04T13:01:01.383613+0000","last_fullsized":"2024-03-04T13:01:01.383613+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:01.383525+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:01.383525+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.383525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:50:29.949251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.182971+0000","last_change":"2024-03-04T13:00:48.182971+0000","last_active":"2024-03-04T13:00:48.182971+0000","last_peered":"2024-03-04T13:00:48.182971+0000","last_clean":"2024-03-04T13:00:48.182971+0000","last_became_active":"2024-03-04T12:44:50.455509+0000","last_became_peered":"2024-03-04T12:44:50.455509+0000","last_unstale":"2024-03-04T13:00:48.182971+0000","last_undegraded":"2024-03-04T13:00:48.182971+0000","last_fullsized":"2024-03-04T13:00:48.182971+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:48.182850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:48.182850+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.182850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:46:46.844269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"256'40","reported_seq":146,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.596410+0000","last_change":"2024-03-04T13:00:27.596439+0000","last_active":"2024-03-04T13:00:27.596410+0000","last_peered":"2024-03-04T13:00:27.596410+0000","last_clean":"2024-03-04T13:00:27.596410+0000","last_became_active":"2024-03-04T12:43:27.060405+0000","last_became_peered":"2024-03-04T12:43:27.060405+0000","last_unstale":"2024-03-04T13:00:27.596410+0000","last_undegraded":"2024-03-04T13:00:27.596410+0000","last_fullsized":"2024-03-04T13:00:27.596410+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'40","last_scrub_stamp":"2024-03-04T13:00:27.596312+0000","last_deep_scrub":"256'40","last_deep_scrub_stamp":"2024-03-04T13:00:27.596312+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.596312+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:52.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":118,"num_write":66,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:13.097749+0000","last_change":"2024-03-04T13:01:13.097772+0000","last_active":"2024-03-04T13:01:13.097749+0000","last_peered":"2024-03-04T13:01:13.097749+0000","last_clean":"2024-03-04T13:01:13.097749+0000","last_became_active":"2024-03-04T12:51:01.358005+0000","last_became_peered":"2024-03-04T12:51:01.358005+0000","last_unstale":"2024-03-04T13:01:13.097749+0000","last_undegraded":"2024-03-04T13:01:13.097749+0000","last_fullsized":"2024-03-04T13:01:13.097749+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:13.097663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:13.097663+0000","last_clean_scrub_stamp":"2024-03-04T13:01:13.097663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:14.564101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"256'9","reported_seq":58,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.653214+0000","last_change":"2024-03-04T13:00:46.653244+0000","last_active":"2024-03-04T13:00:46.653214+0000","last_peered":"2024-03-04T13:00:46.653214+0000","last_clean":"2024-03-04T13:00:46.653214+0000","last_became_active":"2024-03-04T12:44:53.486168+0000","last_became_peered":"2024-03-04T12:44:53.486168+0000","last_unstale":"2024-03-04T13:00:46.653214+0000","last_undegraded":"2024-03-04T13:00:46.653214+0000","last_fullsized":"2024-03-04T13:00:46.653214+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:46.653131+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:46.653131+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.653131+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:15:05.535942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":10242,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.629649+0000","last_change":"2024-03-04T13:00:22.629669+0000","last_active":"2024-03-04T13:00:22.629649+0000","last_peered":"2024-03-04T13:00:22.629649+0000","last_clean":"2024-03-04T13:00:22.629649+0000","last_became_active":"2024-03-04T12:44:50.450465+0000","last_became_peered":"2024-03-04T12:44:50.450465+0000","last_unstale":"2024-03-04T13:00:22.629649+0000","last_undegraded":"2024-03-04T13:00:22.629649+0000","last_fullsized":"2024-03-04T13:00:22.629649+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:22.629555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:22.629555+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.629555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:10.681596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"250'33","reported_seq":136,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.541479+0000","last_change":"2024-03-04T13:00:25.541501+0000","last_active":"2024-03-04T13:00:25.541479+0000","last_peered":"2024-03-04T13:00:25.541479+0000","last_clean":"2024-03-04T13:00:25.541479+0000","last_became_active":"2024-03-04T12:43:27.060562+0000","last_became_peered":"2024-03-04T12:43:27.060562+0000","last_unstale":"2024-03-04T13:00:25.541479+0000","last_undegraded":"2024-03-04T13:00:25.541479+0000","last_fullsized":"2024-03-04T13:00:25.541479+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'33","last_scrub_stamp":"2024-03-04T13:00:25.541401+0000","last_deep_scrub":"250'33","last_deep_scrub_stamp":"2024-03-04T13:00:25.541401+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.541401+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:43.219942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":113,"num_write":48,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":24,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.633971+0000","last_change":"2024-03-04T12:51:01.596745+0000","last_active":"2024-03-04T13:00:22.633971+0000","last_peered":"2024-03-04T13:00:22.633971+0000","last_clean":"2024-03-04T13:00:22.633971+0000","last_became_active":"2024-03-04T12:51:01.595776+0000","last_became_peered":"2024-03-04T12:51:01.595776+0000","last_unstale":"2024-03-04T13:00:22.633971+0000","last_undegraded":"2024-03-04T13:00:22.633971+0000","last_fullsized":"2024-03-04T13:00:22.633971+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"256'14","reported_seq":64,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.116502+0000","last_change":"2024-03-04T13:00:36.116531+0000","last_active":"2024-03-04T13:00:36.116502+0000","last_peered":"2024-03-04T13:00:36.116502+0000","last_clean":"2024-03-04T13:00:36.116502+0000","last_became_active":"2024-03-04T12:44:53.478864+0000","last_became_peered":"2024-03-04T12:44:53.478864+0000","last_unstale":"2024-03-04T13:00:36.116502+0000","last_undegraded":"2024-03-04T13:00:36.116502+0000","last_fullsized":"2024-03-04T13:00:36.116502+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'14","last_scrub_stamp":"2024-03-04T13:00:36.116377+0000","last_deep_scrub":"256'14","last_deep_scrub_stamp":"2024-03-04T13:00:36.116377+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.116377+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:25:47.800519+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":27,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.687649+0000","last_change":"2024-03-04T13:00:26.687673+0000","last_active":"2024-03-04T13:00:26.687649+0000","last_peered":"2024-03-04T13:00:26.687649+0000","last_clean":"2024-03-04T13:00:26.687649+0000","last_became_active":"2024-03-04T12:44:50.453830+0000","last_became_peered":"2024-03-04T12:44:50.453830+0000","last_unstale":"2024-03-04T13:00:26.687649+0000","last_undegraded":"2024-03-04T13:00:26.687649+0000","last_fullsized":"2024-03-04T13:00:26.687649+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:26.687563+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:26.687563+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.687563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:43.300798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"256'64","reported_seq":206,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.295688+0000","last_change":"2024-03-04T13:00:28.295688+0000","last_active":"2024-03-04T13:00:28.295688+0000","last_peered":"2024-03-04T13:00:28.295688+0000","last_clean":"2024-03-04T13:00:28.295688+0000","last_became_active":"2024-03-04T12:43:27.067330+0000","last_became_peered":"2024-03-04T12:43:27.067330+0000","last_unstale":"2024-03-04T13:00:28.295688+0000","last_undegraded":"2024-03-04T13:00:28.295688+0000","last_fullsized":"2024-03-04T13:00:28.295688+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'64","last_scrub_stamp":"2024-03-04T13:00:28.295569+0000","last_deep_scrub":"256'64","last_deep_scrub_stamp":"2024-03-04T13:00:28.295569+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.295569+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:35:07.847340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":194,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:18.387736+0000","last_change":"2024-03-04T13:01:18.387786+0000","last_active":"2024-03-04T13:01:18.387736+0000","last_peered":"2024-03-04T13:01:18.387736+0000","last_clean":"2024-03-04T13:01:18.387736+0000","last_became_active":"2024-03-04T12:51:01.596268+0000","last_became_peered":"2024-03-04T12:51:01.596268+0000","last_unstale":"2024-03-04T13:01:18.387736+0000","last_undegraded":"2024-03-04T13:01:18.387736+0000","last_fullsized":"2024-03-04T13:01:18.387736+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:18.387625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:18.387625+0000","last_clean_scrub_stamp":"2024-03-04T13:01:18.387625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:56:02.811314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.223422+0000","last_change":"2024-03-04T13:00:54.223422+0000","last_active":"2024-03-04T13:00:54.223422+0000","last_peered":"2024-03-04T13:00:54.223422+0000","last_clean":"2024-03-04T13:00:54.223422+0000","last_became_active":"2024-03-04T12:44:53.481760+0000","last_became_peered":"2024-03-04T12:44:53.481760+0000","last_unstale":"2024-03-04T13:00:54.223422+0000","last_undegraded":"2024-03-04T13:00:54.223422+0000","last_fullsized":"2024-03-04T13:00:54.223422+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:54.223306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:54.223306+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.223306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:05.591529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.584224+0000","last_change":"2024-03-04T13:00:34.584252+0000","last_active":"2024-03-04T13:00:34.584224+0000","last_peered":"2024-03-04T13:00:34.584224+0000","last_clean":"2024-03-04T13:00:34.584224+0000","last_became_active":"2024-03-04T12:44:50.455723+0000","last_became_peered":"2024-03-04T12:44:50.455723+0000","last_unstale":"2024-03-04T13:00:34.584224+0000","last_undegraded":"2024-03-04T13:00:34.584224+0000","last_fullsized":"2024-03-04T13:00:34.584224+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:34.584103+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:34.584103+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.584103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:47.957581+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"256'151","reported_seq":510,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.376916+0000","last_change":"2024-03-04T13:00:23.376916+0000","last_active":"2024-03-04T13:00:23.376916+0000","last_peered":"2024-03-04T13:00:23.376916+0000","last_clean":"2024-03-04T13:00:23.376916+0000","last_became_active":"2024-03-04T12:43:27.067228+0000","last_became_peered":"2024-03-04T12:43:27.067228+0000","last_unstale":"2024-03-04T13:00:23.376916+0000","last_undegraded":"2024-03-04T13:00:23.376916+0000","last_fullsized":"2024-03-04T13:00:23.376916+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'151","last_scrub_stamp":"2024-03-04T13:00:23.376811+0000","last_deep_scrub":"256'151","last_deep_scrub_stamp":"2024-03-04T13:00:23.376811+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.376811+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:55:13.549907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":889,"num_read_kb":655,"num_write":189,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4940,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.591332+0000","last_change":"2024-03-04T13:01:03.591370+0000","last_active":"2024-03-04T13:01:03.591332+0000","last_peered":"2024-03-04T13:01:03.591332+0000","last_clean":"2024-03-04T13:01:03.591332+0000","last_became_active":"2024-03-04T12:51:01.356572+0000","last_became_peered":"2024-03-04T12:51:01.356572+0000","last_unstale":"2024-03-04T13:01:03.591332+0000","last_undegraded":"2024-03-04T13:01:03.591332+0000","last_fullsized":"2024-03-04T13:01:03.591332+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:03.591250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:03.591250+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.591250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:46.975750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"256'4","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.151000+0000","last_change":"2024-03-04T13:00:32.151061+0000","last_active":"2024-03-04T13:00:32.151000+0000","last_peered":"2024-03-04T13:00:32.151000+0000","last_clean":"2024-03-04T13:00:32.151000+0000","last_became_active":"2024-03-04T12:44:53.477386+0000","last_became_peered":"2024-03-04T12:44:53.477386+0000","last_unstale":"2024-03-04T13:00:32.151000+0000","last_undegraded":"2024-03-04T13:00:32.151000+0000","last_fullsized":"2024-03-04T13:00:32.151000+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:32.150910+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:32.150910+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.150910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:35.067029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":418,"num_write":4,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.868900+0000","last_change":"2024-03-04T13:00:25.868970+0000","last_active":"2024-03-04T13:00:25.868900+0000","last_peered":"2024-03-04T13:00:25.868900+0000","last_clean":"2024-03-04T13:00:25.868900+0000","last_became_active":"2024-03-04T12:44:50.448683+0000","last_became_peered":"2024-03-04T12:44:50.448683+0000","last_unstale":"2024-03-04T13:00:25.868900+0000","last_undegraded":"2024-03-04T13:00:25.868900+0000","last_fullsized":"2024-03-04T13:00:25.868900+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:25.868786+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:25.868786+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.868786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:06.732143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"256'38","reported_seq":138,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.367310+0000","last_change":"2024-03-04T13:00:25.367310+0000","last_active":"2024-03-04T13:00:25.367310+0000","last_peered":"2024-03-04T13:00:25.367310+0000","last_clean":"2024-03-04T13:00:25.367310+0000","last_became_active":"2024-03-04T12:43:27.062623+0000","last_became_peered":"2024-03-04T12:43:27.062623+0000","last_unstale":"2024-03-04T13:00:25.367310+0000","last_undegraded":"2024-03-04T13:00:25.367310+0000","last_fullsized":"2024-03-04T13:00:25.367310+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'38","last_scrub_stamp":"2024-03-04T13:00:25.367217+0000","last_deep_scrub":"256'38","last_deep_scrub_stamp":"2024-03-04T13:00:25.367217+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.367217+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:18:32.757230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:11.159729+0000","last_change":"2024-03-04T13:01:11.159754+0000","last_active":"2024-03-04T13:01:11.159729+0000","last_peered":"2024-03-04T13:01:11.159729+0000","last_clean":"2024-03-04T13:01:11.159729+0000","last_became_active":"2024-03-04T12:51:01.355578+0000","last_became_peered":"2024-03-04T12:51:01.355578+0000","last_unstale":"2024-03-04T13:01:11.159729+0000","last_undegraded":"2024-03-04T13:01:11.159729+0000","last_fullsized":"2024-03-04T13:01:11.159729+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:11.159635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:11.159635+0000","last_clean_scrub_stamp":"2024-03-04T13:01:11.159635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:39.530309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"256'11","reported_seq":57,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.499477+0000","last_change":"2024-03-04T13:00:42.499529+0000","last_active":"2024-03-04T13:00:42.499477+0000","last_peered":"2024-03-04T13:00:42.499477+0000","last_clean":"2024-03-04T13:00:42.499477+0000","last_became_active":"2024-03-04T12:44:53.476348+0000","last_became_peered":"2024-03-04T12:44:53.476348+0000","last_unstale":"2024-03-04T13:00:42.499477+0000","last_undegraded":"2024-03-04T13:00:42.499477+0000","last_fullsized":"2024-03-04T13:00:42.499477+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'11","last_scrub_stamp":"2024-03-04T13:00:42.499379+0000","last_deep_scrub":"256'11","last_deep_scrub_stamp":"2024-03-04T13:00:42.499379+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.499379+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:06.177825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13312,"num_write":16,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'7","reported_seq":60,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.741695+0000","last_change":"2024-03-04T13:00:30.741727+0000","last_active":"2024-03-04T13:00:30.741695+0000","last_peered":"2024-03-04T13:00:30.741695+0000","last_clean":"2024-03-04T13:00:30.741695+0000","last_became_active":"2024-03-04T12:44:50.454252+0000","last_became_peered":"2024-03-04T12:44:50.454252+0000","last_unstale":"2024-03-04T13:00:30.741695+0000","last_undegraded":"2024-03-04T13:00:30.741695+0000","last_fullsized":"2024-03-04T13:00:30.741695+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:00:30.741607+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:00:30.741607+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.741607+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:27.692537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"256'25","reported_seq":106,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.237546+0000","last_change":"2024-03-04T13:00:30.237546+0000","last_active":"2024-03-04T13:00:30.237546+0000","last_peered":"2024-03-04T13:00:30.237546+0000","last_clean":"2024-03-04T13:00:30.237546+0000","last_became_active":"2024-03-04T12:43:27.061611+0000","last_became_peered":"2024-03-04T12:43:27.061611+0000","last_unstale":"2024-03-04T13:00:30.237546+0000","last_undegraded":"2024-03-04T13:00:30.237546+0000","last_fullsized":"2024-03-04T13:00:30.237546+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'25","last_scrub_stamp":"2024-03-04T13:00:30.237361+0000","last_deep_scrub":"256'25","last_deep_scrub_stamp":"2024-03-04T13:00:30.237361+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.237361+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:40.824012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.670421+0000","last_change":"2024-03-04T13:00:50.670421+0000","last_active":"2024-03-04T13:00:50.670421+0000","last_peered":"2024-03-04T13:00:50.670421+0000","last_clean":"2024-03-04T13:00:50.670421+0000","last_became_active":"2024-03-04T12:51:01.351465+0000","last_became_peered":"2024-03-04T12:51:01.351465+0000","last_unstale":"2024-03-04T13:00:50.670421+0000","last_undegraded":"2024-03-04T13:00:50.670421+0000","last_fullsized":"2024-03-04T13:00:50.670421+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:50.670255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:50.670255+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.670255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:50:29.698487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"256'4","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:14.377978+0000","last_change":"2024-03-04T13:01:14.378005+0000","last_active":"2024-03-04T13:01:14.377978+0000","last_peered":"2024-03-04T13:01:14.377978+0000","last_clean":"2024-03-04T13:01:14.377978+0000","last_became_active":"2024-03-04T12:44:53.482806+0000","last_became_peered":"2024-03-04T12:44:53.482806+0000","last_unstale":"2024-03-04T13:01:14.377978+0000","last_undegraded":"2024-03-04T13:01:14.377978+0000","last_fullsized":"2024-03-04T13:01:14.377978+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:01:14.377884+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:01:14.377884+0000","last_clean_scrub_stamp":"2024-03-04T13:01:14.377884+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:00.007646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.377211+0000","last_change":"2024-03-04T13:00:22.377229+0000","last_active":"2024-03-04T13:00:22.377211+0000","last_peered":"2024-03-04T13:00:22.377211+0000","last_clean":"2024-03-04T13:00:22.377211+0000","last_became_active":"2024-03-04T12:44:50.457180+0000","last_became_peered":"2024-03-04T12:44:50.457180+0000","last_unstale":"2024-03-04T13:00:22.377211+0000","last_undegraded":"2024-03-04T13:00:22.377211+0000","last_fullsized":"2024-03-04T13:00:22.377211+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:22.377126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:22.377126+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.377126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:53.011158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"256'43","reported_seq":141,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.659958+0000","last_change":"2024-03-04T13:00:25.659958+0000","last_active":"2024-03-04T13:00:25.659958+0000","last_peered":"2024-03-04T13:00:25.659958+0000","last_clean":"2024-03-04T13:00:25.659958+0000","last_became_active":"2024-03-04T12:43:27.063191+0000","last_became_peered":"2024-03-04T12:43:27.063191+0000","last_unstale":"2024-03-04T13:00:25.659958+0000","last_undegraded":"2024-03-04T13:00:25.659958+0000","last_fullsized":"2024-03-04T13:00:25.659958+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'43","last_scrub_stamp":"2024-03-04T13:00:25.659791+0000","last_deep_scrub":"256'43","last_deep_scrub_stamp":"2024-03-04T13:00:25.659791+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.659791+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:44:08.536513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":76,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.634331+0000","last_change":"2024-03-04T13:01:00.634331+0000","last_active":"2024-03-04T13:01:00.634331+0000","last_peered":"2024-03-04T13:01:00.634331+0000","last_clean":"2024-03-04T13:01:00.634331+0000","last_became_active":"2024-03-04T12:51:01.353248+0000","last_became_peered":"2024-03-04T12:51:01.353248+0000","last_unstale":"2024-03-04T13:01:00.634331+0000","last_undegraded":"2024-03-04T13:01:00.634331+0000","last_fullsized":"2024-03-04T13:01:00.634331+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:00.634191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:00.634191+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.634191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:53.499135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"256'6","reported_seq":51,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:07.889808+0000","last_change":"2024-03-04T13:01:07.889869+0000","last_active":"2024-03-04T13:01:07.889808+0000","last_peered":"2024-03-04T13:01:07.889808+0000","last_clean":"2024-03-04T13:01:07.889808+0000","last_became_active":"2024-03-04T12:44:53.483210+0000","last_became_peered":"2024-03-04T12:44:53.483210+0000","last_unstale":"2024-03-04T13:01:07.889808+0000","last_undegraded":"2024-03-04T13:01:07.889808+0000","last_fullsized":"2024-03-04T13:01:07.889808+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:01:07.889700+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:01:07.889700+0000","last_clean_scrub_stamp":"2024-03-04T13:01:07.889700+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:50.606393+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"256'9","reported_seq":62,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.633368+0000","last_change":"2024-03-04T13:00:23.633396+0000","last_active":"2024-03-04T13:00:23.633368+0000","last_peered":"2024-03-04T13:00:23.633368+0000","last_clean":"2024-03-04T13:00:23.633368+0000","last_became_active":"2024-03-04T12:44:50.449291+0000","last_became_peered":"2024-03-04T12:44:50.449291+0000","last_unstale":"2024-03-04T13:00:23.633368+0000","last_undegraded":"2024-03-04T13:00:23.633368+0000","last_fullsized":"2024-03-04T13:00:23.633368+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:23.633297+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:23.633297+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.633297+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:09.478343+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"256'42","reported_seq":139,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.413406+0000","last_change":"2024-03-04T13:00:36.413430+0000","last_active":"2024-03-04T13:00:36.413406+0000","last_peered":"2024-03-04T13:00:36.413406+0000","last_clean":"2024-03-04T13:00:36.413406+0000","last_became_active":"2024-03-04T12:43:27.061663+0000","last_became_peered":"2024-03-04T12:43:27.061663+0000","last_unstale":"2024-03-04T13:00:36.413406+0000","last_undegraded":"2024-03-04T13:00:36.413406+0000","last_fullsized":"2024-03-04T13:00:36.413406+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'42","last_scrub_stamp":"2024-03-04T13:00:36.413321+0000","last_deep_scrub":"256'42","last_deep_scrub_stamp":"2024-03-04T13:00:36.413321+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.413321+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:53.818525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":24,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.004187+0000","last_change":"2024-03-04T12:51:01.596240+0000","last_active":"2024-03-04T13:00:21.004187+0000","last_peered":"2024-03-04T13:00:21.004187+0000","last_clean":"2024-03-04T13:00:21.004187+0000","last_became_active":"2024-03-04T12:51:01.595943+0000","last_became_peered":"2024-03-04T12:51:01.595943+0000","last_unstale":"2024-03-04T13:00:21.004187+0000","last_undegraded":"2024-03-04T13:00:21.004187+0000","last_fullsized":"2024-03-04T13:00:21.004187+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"256'2","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:10.198954+0000","last_change":"2024-03-04T13:01:10.198980+0000","last_active":"2024-03-04T13:01:10.198954+0000","last_peered":"2024-03-04T13:01:10.198954+0000","last_clean":"2024-03-04T13:01:10.198954+0000","last_became_active":"2024-03-04T12:44:53.485995+0000","last_became_peered":"2024-03-04T12:44:53.485995+0000","last_unstale":"2024-03-04T13:01:10.198954+0000","last_undegraded":"2024-03-04T13:01:10.198954+0000","last_fullsized":"2024-03-04T13:01:10.198954+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:10.198865+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:10.198865+0000","last_clean_scrub_stamp":"2024-03-04T13:01:10.198865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:47:54.926710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"256'4","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.794012+0000","last_change":"2024-03-04T13:00:34.794073+0000","last_active":"2024-03-04T13:00:34.794012+0000","last_peered":"2024-03-04T13:00:34.794012+0000","last_clean":"2024-03-04T13:00:34.794012+0000","last_became_active":"2024-03-04T12:44:50.454617+0000","last_became_peered":"2024-03-04T12:44:50.454617+0000","last_unstale":"2024-03-04T13:00:34.794012+0000","last_undegraded":"2024-03-04T13:00:34.794012+0000","last_fullsized":"2024-03-04T13:00:34.794012+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:34.793901+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:34.793901+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.793901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:05.781091+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"256'41","reported_seq":144,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.757303+0000","last_change":"2024-03-04T13:00:31.757332+0000","last_active":"2024-03-04T13:00:31.757303+0000","last_peered":"2024-03-04T13:00:31.757303+0000","last_clean":"2024-03-04T13:00:31.757303+0000","last_became_active":"2024-03-04T12:43:27.050088+0000","last_became_peered":"2024-03-04T12:43:27.050088+0000","last_unstale":"2024-03-04T13:00:31.757303+0000","last_undegraded":"2024-03-04T13:00:31.757303+0000","last_fullsized":"2024-03-04T13:00:31.757303+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'41","last_scrub_stamp":"2024-03-04T13:00:31.757200+0000","last_deep_scrub":"256'41","last_deep_scrub_stamp":"2024-03-04T13:00:31.757200+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.757200+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:30:26.807415+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":112,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.633949+0000","last_change":"2024-03-04T12:51:01.595890+0000","last_active":"2024-03-04T13:00:22.633949+0000","last_peered":"2024-03-04T13:00:22.633949+0000","last_clean":"2024-03-04T13:00:22.633949+0000","last_became_active":"2024-03-04T12:51:01.595530+0000","last_became_peered":"2024-03-04T12:51:01.595530+0000","last_unstale":"2024-03-04T13:00:22.633949+0000","last_undegraded":"2024-03-04T13:00:22.633949+0000","last_fullsized":"2024-03-04T13:00:22.633949+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:51:00.328234+0000","last_clean_scrub_stamp":"2024-03-04T12:51:00.328234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"256'4","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:08.244533+0000","last_change":"2024-03-04T13:01:08.244533+0000","last_active":"2024-03-04T13:01:08.244533+0000","last_peered":"2024-03-04T13:01:08.244533+0000","last_clean":"2024-03-04T13:01:08.244533+0000","last_became_active":"2024-03-04T12:44:53.478099+0000","last_became_peered":"2024-03-04T12:44:53.478099+0000","last_unstale":"2024-03-04T13:01:08.244533+0000","last_undegraded":"2024-03-04T13:01:08.244533+0000","last_fullsized":"2024-03-04T13:01:08.244533+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:01:08.244374+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:01:08.244374+0000","last_clean_scrub_stamp":"2024-03-04T13:01:08.244374+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:38.953358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.588764+0000","last_change":"2024-03-04T13:00:24.588802+0000","last_active":"2024-03-04T13:00:24.588764+0000","last_peered":"2024-03-04T13:00:24.588764+0000","last_clean":"2024-03-04T13:00:24.588764+0000","last_became_active":"2024-03-04T12:44:50.448745+0000","last_became_peered":"2024-03-04T12:44:50.448745+0000","last_unstale":"2024-03-04T13:00:24.588764+0000","last_undegraded":"2024-03-04T13:00:24.588764+0000","last_fullsized":"2024-03-04T13:00:24.588764+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:24.588654+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:24.588654+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.588654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:49:36.928946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"256'16","reported_seq":90,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.456547+0000","last_change":"2024-03-04T13:00:28.456571+0000","last_active":"2024-03-04T13:00:28.456547+0000","last_peered":"2024-03-04T13:00:28.456547+0000","last_clean":"2024-03-04T13:00:28.456547+0000","last_became_active":"2024-03-04T12:43:27.059494+0000","last_became_peered":"2024-03-04T12:43:27.059494+0000","last_unstale":"2024-03-04T13:00:28.456547+0000","last_undegraded":"2024-03-04T13:00:28.456547+0000","last_fullsized":"2024-03-04T13:00:28.456547+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'16","last_scrub_stamp":"2024-03-04T13:00:28.456461+0000","last_deep_scrub":"256'16","last_deep_scrub_stamp":"2024-03-04T13:00:28.456461+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.456461+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:06.545751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":48,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:12.929077+0000","last_change":"2024-03-04T13:01:12.929100+0000","last_active":"2024-03-04T13:01:12.929077+0000","last_peered":"2024-03-04T13:01:12.929077+0000","last_clean":"2024-03-04T13:01:12.929077+0000","last_became_active":"2024-03-04T12:51:01.355560+0000","last_became_peered":"2024-03-04T12:51:01.355560+0000","last_unstale":"2024-03-04T13:01:12.929077+0000","last_undegraded":"2024-03-04T13:01:12.929077+0000","last_fullsized":"2024-03-04T13:01:12.929077+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:12.928983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:12.928983+0000","last_clean_scrub_stamp":"2024-03-04T13:01:12.928983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:32:12.513685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'3","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.548095+0000","last_change":"2024-03-04T13:00:38.548121+0000","last_active":"2024-03-04T13:00:38.548095+0000","last_peered":"2024-03-04T13:00:38.548095+0000","last_clean":"2024-03-04T13:00:38.548095+0000","last_became_active":"2024-03-04T12:44:53.475861+0000","last_became_peered":"2024-03-04T12:44:53.475861+0000","last_unstale":"2024-03-04T13:00:38.548095+0000","last_undegraded":"2024-03-04T13:00:38.548095+0000","last_fullsized":"2024-03-04T13:00:38.548095+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'3","last_scrub_stamp":"2024-03-04T13:00:38.548004+0000","last_deep_scrub":"250'3","last_deep_scrub_stamp":"2024-03-04T13:00:38.548004+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.548004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:54:35.955700+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"256'8","reported_seq":60,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.305365+0000","last_change":"2024-03-04T13:00:25.305365+0000","last_active":"2024-03-04T13:00:25.305365+0000","last_peered":"2024-03-04T13:00:25.305365+0000","last_clean":"2024-03-04T13:00:25.305365+0000","last_became_active":"2024-03-04T12:44:50.453541+0000","last_became_peered":"2024-03-04T12:44:50.453541+0000","last_unstale":"2024-03-04T13:00:25.305365+0000","last_undegraded":"2024-03-04T13:00:25.305365+0000","last_fullsized":"2024-03-04T13:00:25.305365+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'8","last_scrub_stamp":"2024-03-04T13:00:25.305244+0000","last_deep_scrub":"256'8","last_deep_scrub_stamp":"2024-03-04T13:00:25.305244+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.305244+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:50.904960+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"256'48","reported_seq":157,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.235467+0000","last_change":"2024-03-04T13:00:22.235467+0000","last_active":"2024-03-04T13:00:22.235467+0000","last_peered":"2024-03-04T13:00:22.235467+0000","last_clean":"2024-03-04T13:00:22.235467+0000","last_became_active":"2024-03-04T12:43:27.069664+0000","last_became_peered":"2024-03-04T12:43:27.069664+0000","last_unstale":"2024-03-04T13:00:22.235467+0000","last_undegraded":"2024-03-04T13:00:22.235467+0000","last_fullsized":"2024-03-04T13:00:22.235467+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'48","last_scrub_stamp":"2024-03-04T13:00:22.235365+0000","last_deep_scrub":"256'48","last_deep_scrub_stamp":"2024-03-04T13:00:22.235365+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.235365+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:38:42.140621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:19.383097+0000","last_change":"2024-03-04T13:01:19.383097+0000","last_active":"2024-03-04T13:01:19.383097+0000","last_peered":"2024-03-04T13:01:19.383097+0000","last_clean":"2024-03-04T13:01:19.383097+0000","last_became_active":"2024-03-04T12:51:41.752775+0000","last_became_peered":"2024-03-04T12:51:41.752775+0000","last_unstale":"2024-03-04T13:01:19.383097+0000","last_undegraded":"2024-03-04T13:01:19.383097+0000","last_fullsized":"2024-03-04T13:01:19.383097+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:19.382922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:19.382922+0000","last_clean_scrub_stamp":"2024-03-04T13:01:19.382922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:09.220261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"256'7","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.154187+0000","last_change":"2024-03-04T13:00:51.154226+0000","last_active":"2024-03-04T13:00:51.154187+0000","last_peered":"2024-03-04T13:00:51.154187+0000","last_clean":"2024-03-04T13:00:51.154187+0000","last_became_active":"2024-03-04T12:44:53.478126+0000","last_became_peered":"2024-03-04T12:44:53.478126+0000","last_unstale":"2024-03-04T13:00:51.154187+0000","last_undegraded":"2024-03-04T13:00:51.154187+0000","last_fullsized":"2024-03-04T13:00:51.154187+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:00:51.154098+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:00:51.154098+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.154098+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:41:53.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11793,"num_write":12,"num_write_kb":7697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'2","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.220991+0000","last_change":"2024-03-04T13:00:49.221016+0000","last_active":"2024-03-04T13:00:49.220991+0000","last_peered":"2024-03-04T13:00:49.220991+0000","last_clean":"2024-03-04T13:00:49.220991+0000","last_became_active":"2024-03-04T12:44:50.455571+0000","last_became_peered":"2024-03-04T12:44:50.455571+0000","last_unstale":"2024-03-04T13:00:49.220991+0000","last_undegraded":"2024-03-04T13:00:49.220991+0000","last_fullsized":"2024-03-04T13:00:49.220991+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:49.220893+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:49.220893+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.220893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:10.521167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"256'47","reported_seq":151,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.409207+0000","last_change":"2024-03-04T13:00:27.409254+0000","last_active":"2024-03-04T13:00:27.409207+0000","last_peered":"2024-03-04T13:00:27.409207+0000","last_clean":"2024-03-04T13:00:27.409207+0000","last_became_active":"2024-03-04T12:43:27.060225+0000","last_became_peered":"2024-03-04T12:43:27.060225+0000","last_unstale":"2024-03-04T13:00:27.409207+0000","last_undegraded":"2024-03-04T13:00:27.409207+0000","last_fullsized":"2024-03-04T13:00:27.409207+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'47","last_scrub_stamp":"2024-03-04T13:00:27.409102+0000","last_deep_scrub":"256'47","last_deep_scrub_stamp":"2024-03-04T13:00:27.409102+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.409102+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:54:12.358389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":112,"num_write":82,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:04.314727+0000","last_change":"2024-03-04T13:01:04.314750+0000","last_active":"2024-03-04T13:01:04.314727+0000","last_peered":"2024-03-04T13:01:04.314727+0000","last_clean":"2024-03-04T13:01:04.314727+0000","last_became_active":"2024-03-04T12:51:01.353087+0000","last_became_peered":"2024-03-04T12:51:01.353087+0000","last_unstale":"2024-03-04T13:01:04.314727+0000","last_undegraded":"2024-03-04T13:01:04.314727+0000","last_fullsized":"2024-03-04T13:01:04.314727+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:04.314637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:04.314637+0000","last_clean_scrub_stamp":"2024-03-04T13:01:04.314637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:38.913395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.726659+0000","last_change":"2024-03-04T13:00:42.726659+0000","last_active":"2024-03-04T13:00:42.726659+0000","last_peered":"2024-03-04T13:00:42.726659+0000","last_clean":"2024-03-04T13:00:42.726659+0000","last_became_active":"2024-03-04T12:44:53.485819+0000","last_became_peered":"2024-03-04T12:44:53.485819+0000","last_unstale":"2024-03-04T13:00:42.726659+0000","last_undegraded":"2024-03-04T13:00:42.726659+0000","last_fullsized":"2024-03-04T13:00:42.726659+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:42.726495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:42.726495+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.726495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:39:45.012364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"256'18","reported_seq":82,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.562385+0000","last_change":"2024-03-04T13:00:26.562385+0000","last_active":"2024-03-04T13:00:26.562385+0000","last_peered":"2024-03-04T13:00:26.562385+0000","last_clean":"2024-03-04T13:00:26.562385+0000","last_became_active":"2024-03-04T12:44:50.451612+0000","last_became_peered":"2024-03-04T12:44:50.451612+0000","last_unstale":"2024-03-04T13:00:26.562385+0000","last_undegraded":"2024-03-04T13:00:26.562385+0000","last_fullsized":"2024-03-04T13:00:26.562385+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'18","last_scrub_stamp":"2024-03-04T13:00:26.562265+0000","last_deep_scrub":"256'18","last_deep_scrub_stamp":"2024-03-04T13:00:26.562265+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.562265+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:30:31.690140+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":29700,"num_write":24,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"256'29","reported_seq":118,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.267423+0000","last_change":"2024-03-04T13:00:37.267495+0000","last_active":"2024-03-04T13:00:37.267423+0000","last_peered":"2024-03-04T13:00:37.267423+0000","last_clean":"2024-03-04T13:00:37.267423+0000","last_became_active":"2024-03-04T12:43:27.067356+0000","last_became_peered":"2024-03-04T12:43:27.067356+0000","last_unstale":"2024-03-04T13:00:37.267423+0000","last_undegraded":"2024-03-04T13:00:37.267423+0000","last_fullsized":"2024-03-04T13:00:37.267423+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'29","last_scrub_stamp":"2024-03-04T13:00:37.267297+0000","last_deep_scrub":"256'29","last_deep_scrub_stamp":"2024-03-04T13:00:37.267297+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.267297+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:05.403189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":50,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.352311+0000","last_change":"2024-03-04T13:01:03.352333+0000","last_active":"2024-03-04T13:01:03.352311+0000","last_peered":"2024-03-04T13:01:03.352311+0000","last_clean":"2024-03-04T13:01:03.352311+0000","last_became_active":"2024-03-04T12:51:01.352205+0000","last_became_peered":"2024-03-04T12:51:01.352205+0000","last_unstale":"2024-03-04T13:01:03.352311+0000","last_undegraded":"2024-03-04T13:01:03.352311+0000","last_fullsized":"2024-03-04T13:01:03.352311+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:03.352212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:03.352212+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.352212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:28.995763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"256'10","reported_seq":58,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.111906+0000","last_change":"2024-03-04T13:00:40.111906+0000","last_active":"2024-03-04T13:00:40.111906+0000","last_peered":"2024-03-04T13:00:40.111906+0000","last_clean":"2024-03-04T13:00:40.111906+0000","last_became_active":"2024-03-04T12:44:53.479906+0000","last_became_peered":"2024-03-04T12:44:53.479906+0000","last_unstale":"2024-03-04T13:00:40.111906+0000","last_undegraded":"2024-03-04T13:00:40.111906+0000","last_fullsized":"2024-03-04T13:00:40.111906+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'10","last_scrub_stamp":"2024-03-04T13:00:40.111726+0000","last_deep_scrub":"256'10","last_deep_scrub_stamp":"2024-03-04T13:00:40.111726+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.111726+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:53.009649+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8765,"num_write":13,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"256'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.233511+0000","last_change":"2024-03-04T13:00:31.233511+0000","last_active":"2024-03-04T13:00:31.233511+0000","last_peered":"2024-03-04T13:00:31.233511+0000","last_clean":"2024-03-04T13:00:31.233511+0000","last_became_active":"2024-03-04T12:44:50.455705+0000","last_became_peered":"2024-03-04T12:44:50.455705+0000","last_unstale":"2024-03-04T13:00:31.233511+0000","last_undegraded":"2024-03-04T13:00:31.233511+0000","last_fullsized":"2024-03-04T13:00:31.233511+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:31.233395+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:31.233395+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.233395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:43:28.071292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"256'37","reported_seq":138,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.483753+0000","last_change":"2024-03-04T13:00:26.483782+0000","last_active":"2024-03-04T13:00:26.483753+0000","last_peered":"2024-03-04T13:00:26.483753+0000","last_clean":"2024-03-04T13:00:26.483753+0000","last_became_active":"2024-03-04T12:43:27.049948+0000","last_became_peered":"2024-03-04T12:43:27.049948+0000","last_unstale":"2024-03-04T13:00:26.483753+0000","last_undegraded":"2024-03-04T13:00:26.483753+0000","last_fullsized":"2024-03-04T13:00:26.483753+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'37","last_scrub_stamp":"2024-03-04T13:00:26.483653+0000","last_deep_scrub":"256'37","last_deep_scrub_stamp":"2024-03-04T13:00:26.483653+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.483653+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:53:44.304398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":102,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.624783+0000","last_change":"2024-03-04T13:01:02.624803+0000","last_active":"2024-03-04T13:01:02.624783+0000","last_peered":"2024-03-04T13:01:02.624783+0000","last_clean":"2024-03-04T13:01:02.624783+0000","last_became_active":"2024-03-04T12:51:01.355460+0000","last_became_peered":"2024-03-04T12:51:01.355460+0000","last_unstale":"2024-03-04T13:01:02.624783+0000","last_undegraded":"2024-03-04T13:01:02.624783+0000","last_fullsized":"2024-03-04T13:01:02.624783+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:02.624706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:02.624706+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.624706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:27:33.304907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:10.174187+0000","last_change":"2024-03-04T13:01:10.174187+0000","last_active":"2024-03-04T13:01:10.174187+0000","last_peered":"2024-03-04T13:01:10.174187+0000","last_clean":"2024-03-04T13:01:10.174187+0000","last_became_active":"2024-03-04T12:44:53.482573+0000","last_became_peered":"2024-03-04T12:44:53.482573+0000","last_unstale":"2024-03-04T13:01:10.174187+0000","last_undegraded":"2024-03-04T13:01:10.174187+0000","last_fullsized":"2024-03-04T13:01:10.174187+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:10.174055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:10.174055+0000","last_clean_scrub_stamp":"2024-03-04T13:01:10.174055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:16.592097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.707500+0000","last_change":"2024-03-04T13:00:22.707500+0000","last_active":"2024-03-04T13:00:22.707500+0000","last_peered":"2024-03-04T13:00:22.707500+0000","last_clean":"2024-03-04T13:00:22.707500+0000","last_became_active":"2024-03-04T12:44:50.450815+0000","last_became_peered":"2024-03-04T12:44:50.450815+0000","last_unstale":"2024-03-04T13:00:22.707500+0000","last_undegraded":"2024-03-04T13:00:22.707500+0000","last_fullsized":"2024-03-04T13:00:22.707500+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:22.707367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:22.707367+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.707367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:12:35.310838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"256'28","reported_seq":114,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.098819+0000","last_change":"2024-03-04T13:00:25.098849+0000","last_active":"2024-03-04T13:00:25.098819+0000","last_peered":"2024-03-04T13:00:25.098819+0000","last_clean":"2024-03-04T13:00:25.098819+0000","last_became_active":"2024-03-04T12:43:27.055932+0000","last_became_peered":"2024-03-04T12:43:27.055932+0000","last_unstale":"2024-03-04T13:00:25.098819+0000","last_undegraded":"2024-03-04T13:00:25.098819+0000","last_fullsized":"2024-03-04T13:00:25.098819+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'28","last_scrub_stamp":"2024-03-04T13:00:25.098717+0000","last_deep_scrub":"256'28","last_deep_scrub_stamp":"2024-03-04T13:00:25.098717+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.098717+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:13.975808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:18.475442+0000","last_change":"2024-03-04T13:01:18.475471+0000","last_active":"2024-03-04T13:01:18.475442+0000","last_peered":"2024-03-04T13:01:18.475442+0000","last_clean":"2024-03-04T13:01:18.475442+0000","last_became_active":"2024-03-04T12:51:01.356234+0000","last_became_peered":"2024-03-04T12:51:01.356234+0000","last_unstale":"2024-03-04T13:01:18.475442+0000","last_undegraded":"2024-03-04T13:01:18.475442+0000","last_fullsized":"2024-03-04T13:01:18.475442+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:18.475342+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:18.475342+0000","last_clean_scrub_stamp":"2024-03-04T13:01:18.475342+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:44.768302+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.676376+0000","last_change":"2024-03-04T13:00:59.676376+0000","last_active":"2024-03-04T13:00:59.676376+0000","last_peered":"2024-03-04T13:00:59.676376+0000","last_clean":"2024-03-04T13:00:59.676376+0000","last_became_active":"2024-03-04T12:44:53.481628+0000","last_became_peered":"2024-03-04T12:44:53.481628+0000","last_unstale":"2024-03-04T13:00:59.676376+0000","last_undegraded":"2024-03-04T13:00:59.676376+0000","last_fullsized":"2024-03-04T13:00:59.676376+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:59.676240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:59.676240+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.676240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:02.512577+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"250'2","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.076868+0000","last_change":"2024-03-04T13:00:24.076868+0000","last_active":"2024-03-04T13:00:24.076868+0000","last_peered":"2024-03-04T13:00:24.076868+0000","last_clean":"2024-03-04T13:00:24.076868+0000","last_became_active":"2024-03-04T12:44:50.457629+0000","last_became_peered":"2024-03-04T12:44:50.457629+0000","last_unstale":"2024-03-04T13:00:24.076868+0000","last_undegraded":"2024-03-04T13:00:24.076868+0000","last_fullsized":"2024-03-04T13:00:24.076868+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:24.076745+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:24.076745+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.076745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:23:15.455149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"256'46","reported_seq":157,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.678497+0000","last_change":"2024-03-04T13:00:27.678522+0000","last_active":"2024-03-04T13:00:27.678497+0000","last_peered":"2024-03-04T13:00:27.678497+0000","last_clean":"2024-03-04T13:00:27.678497+0000","last_became_active":"2024-03-04T12:43:27.061268+0000","last_became_peered":"2024-03-04T12:43:27.061268+0000","last_unstale":"2024-03-04T13:00:27.678497+0000","last_undegraded":"2024-03-04T13:00:27.678497+0000","last_fullsized":"2024-03-04T13:00:27.678497+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'46","last_scrub_stamp":"2024-03-04T13:00:27.678408+0000","last_deep_scrub":"256'46","last_deep_scrub_stamp":"2024-03-04T13:00:27.678408+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.678408+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:22.425866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":125,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:17.490494+0000","last_change":"2024-03-04T13:01:17.490540+0000","last_active":"2024-03-04T13:01:17.490494+0000","last_peered":"2024-03-04T13:01:17.490494+0000","last_clean":"2024-03-04T13:01:17.490494+0000","last_became_active":"2024-03-04T12:51:01.351718+0000","last_became_peered":"2024-03-04T12:51:01.351718+0000","last_unstale":"2024-03-04T13:01:17.490494+0000","last_undegraded":"2024-03-04T13:01:17.490494+0000","last_fullsized":"2024-03-04T13:01:17.490494+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:17.490369+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:17.490369+0000","last_clean_scrub_stamp":"2024-03-04T13:01:17.490369+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:26.344184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"256'8","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.159522+0000","last_change":"2024-03-04T13:00:52.159557+0000","last_active":"2024-03-04T13:00:52.159522+0000","last_peered":"2024-03-04T13:00:52.159522+0000","last_clean":"2024-03-04T13:00:52.159522+0000","last_became_active":"2024-03-04T12:44:53.480237+0000","last_became_peered":"2024-03-04T12:44:53.480237+0000","last_unstale":"2024-03-04T13:00:52.159522+0000","last_undegraded":"2024-03-04T13:00:52.159522+0000","last_fullsized":"2024-03-04T13:00:52.159522+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'8","last_scrub_stamp":"2024-03-04T13:00:52.159435+0000","last_deep_scrub":"256'8","last_deep_scrub_stamp":"2024-03-04T13:00:52.159435+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.159435+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:16.294942+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"256'4","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:07.261130+0000","last_change":"2024-03-04T13:01:07.261189+0000","last_active":"2024-03-04T13:01:07.261130+0000","last_peered":"2024-03-04T13:01:07.261130+0000","last_clean":"2024-03-04T13:01:07.261130+0000","last_became_active":"2024-03-04T12:44:50.451353+0000","last_became_peered":"2024-03-04T12:44:50.451353+0000","last_unstale":"2024-03-04T13:01:07.261130+0000","last_undegraded":"2024-03-04T13:01:07.261130+0000","last_fullsized":"2024-03-04T13:01:07.261130+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:01:07.261029+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:01:07.261029+0000","last_clean_scrub_stamp":"2024-03-04T13:01:07.261029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:12:24.880595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"256'22","reported_seq":97,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.408305+0000","last_change":"2024-03-04T13:00:32.408351+0000","last_active":"2024-03-04T13:00:32.408305+0000","last_peered":"2024-03-04T13:00:32.408305+0000","last_clean":"2024-03-04T13:00:32.408305+0000","last_became_active":"2024-03-04T12:43:27.060626+0000","last_became_peered":"2024-03-04T12:43:27.060626+0000","last_unstale":"2024-03-04T13:00:32.408305+0000","last_undegraded":"2024-03-04T13:00:32.408305+0000","last_fullsized":"2024-03-04T13:00:32.408305+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'22","last_scrub_stamp":"2024-03-04T13:00:32.408218+0000","last_deep_scrub":"256'22","last_deep_scrub_stamp":"2024-03-04T13:00:32.408218+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.408218+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:27:11.399231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":39,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:19.449236+0000","last_change":"2024-03-04T13:01:19.449261+0000","last_active":"2024-03-04T13:01:19.449236+0000","last_peered":"2024-03-04T13:01:19.449236+0000","last_clean":"2024-03-04T13:01:19.449236+0000","last_became_active":"2024-03-04T12:51:01.356268+0000","last_became_peered":"2024-03-04T12:51:01.356268+0000","last_unstale":"2024-03-04T13:01:19.449236+0000","last_undegraded":"2024-03-04T13:01:19.449236+0000","last_fullsized":"2024-03-04T13:01:19.449236+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:19.449133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:19.449133+0000","last_clean_scrub_stamp":"2024-03-04T13:01:19.449133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:27:19.072853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"256'2","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:12.228966+0000","last_change":"2024-03-04T13:01:12.229044+0000","last_active":"2024-03-04T13:01:12.228966+0000","last_peered":"2024-03-04T13:01:12.228966+0000","last_clean":"2024-03-04T13:01:12.228966+0000","last_became_active":"2024-03-04T12:44:53.488798+0000","last_became_peered":"2024-03-04T12:44:53.488798+0000","last_unstale":"2024-03-04T13:01:12.228966+0000","last_undegraded":"2024-03-04T13:01:12.228966+0000","last_fullsized":"2024-03-04T13:01:12.228966+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:12.228867+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:12.228867+0000","last_clean_scrub_stamp":"2024-03-04T13:01:12.228867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:24.894921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'9","reported_seq":61,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.712653+0000","last_change":"2024-03-04T13:00:23.712653+0000","last_active":"2024-03-04T13:00:23.712653+0000","last_peered":"2024-03-04T13:00:23.712653+0000","last_clean":"2024-03-04T13:00:23.712653+0000","last_became_active":"2024-03-04T12:44:50.449555+0000","last_became_peered":"2024-03-04T12:44:50.449555+0000","last_unstale":"2024-03-04T13:00:23.712653+0000","last_undegraded":"2024-03-04T13:00:23.712653+0000","last_fullsized":"2024-03-04T13:00:23.712653+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:23.712551+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:23.712551+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.712551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:19.679050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9220,"num_write":14,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"256'38","reported_seq":140,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.809948+0000","last_change":"2024-03-04T13:00:27.809977+0000","last_active":"2024-03-04T13:00:27.809948+0000","last_peered":"2024-03-04T13:00:27.809948+0000","last_clean":"2024-03-04T13:00:27.809948+0000","last_became_active":"2024-03-04T12:43:27.062618+0000","last_became_peered":"2024-03-04T12:43:27.062618+0000","last_unstale":"2024-03-04T13:00:27.809948+0000","last_undegraded":"2024-03-04T13:00:27.809948+0000","last_fullsized":"2024-03-04T13:00:27.809948+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'38","last_scrub_stamp":"2024-03-04T13:00:27.809856+0000","last_deep_scrub":"256'38","last_deep_scrub_stamp":"2024-03-04T13:00:27.809856+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.809856+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:07.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":110,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:20.407980+0000","last_change":"2024-03-04T13:01:20.408004+0000","last_active":"2024-03-04T13:01:20.407980+0000","last_peered":"2024-03-04T13:01:20.407980+0000","last_clean":"2024-03-04T13:01:20.407980+0000","last_became_active":"2024-03-04T12:51:01.357842+0000","last_became_peered":"2024-03-04T12:51:01.357842+0000","last_unstale":"2024-03-04T13:01:20.407980+0000","last_undegraded":"2024-03-04T13:01:20.407980+0000","last_fullsized":"2024-03-04T13:01:20.407980+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:20.407884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:20.407884+0000","last_clean_scrub_stamp":"2024-03-04T13:01:20.407884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:55.058129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"256'2","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.389682+0000","last_change":"2024-03-04T13:00:30.389682+0000","last_active":"2024-03-04T13:00:30.389682+0000","last_peered":"2024-03-04T13:00:30.389682+0000","last_clean":"2024-03-04T13:00:30.389682+0000","last_became_active":"2024-03-04T12:44:53.483209+0000","last_became_peered":"2024-03-04T12:44:53.483209+0000","last_unstale":"2024-03-04T13:00:30.389682+0000","last_undegraded":"2024-03-04T13:00:30.389682+0000","last_fullsized":"2024-03-04T13:00:30.389682+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:30.389535+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:30.389535+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.389535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:42:25.469104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"256'6","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.198335+0000","last_change":"2024-03-04T13:00:50.198364+0000","last_active":"2024-03-04T13:00:50.198335+0000","last_peered":"2024-03-04T13:00:50.198335+0000","last_clean":"2024-03-04T13:00:50.198335+0000","last_became_active":"2024-03-04T12:44:50.458158+0000","last_became_peered":"2024-03-04T12:44:50.458158+0000","last_unstale":"2024-03-04T13:00:50.198335+0000","last_undegraded":"2024-03-04T13:00:50.198335+0000","last_fullsized":"2024-03-04T13:00:50.198335+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:50.198234+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:50.198234+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.198234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:43.249845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"256'48","reported_seq":159,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.106713+0000","last_change":"2024-03-04T13:00:23.106771+0000","last_active":"2024-03-04T13:00:23.106713+0000","last_peered":"2024-03-04T13:00:23.106713+0000","last_clean":"2024-03-04T13:00:23.106713+0000","last_became_active":"2024-03-04T12:43:27.058410+0000","last_became_peered":"2024-03-04T12:43:27.058410+0000","last_unstale":"2024-03-04T13:00:23.106713+0000","last_undegraded":"2024-03-04T13:00:23.106713+0000","last_fullsized":"2024-03-04T13:00:23.106713+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'48","last_scrub_stamp":"2024-03-04T13:00:23.106608+0000","last_deep_scrub":"256'48","last_deep_scrub_stamp":"2024-03-04T13:00:23.106608+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.106608+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:14:06.376944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":132,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:07.390132+0000","last_change":"2024-03-04T13:01:07.390172+0000","last_active":"2024-03-04T13:01:07.390132+0000","last_peered":"2024-03-04T13:01:07.390132+0000","last_clean":"2024-03-04T13:01:07.390132+0000","last_became_active":"2024-03-04T12:51:01.597162+0000","last_became_peered":"2024-03-04T12:51:01.597162+0000","last_unstale":"2024-03-04T13:01:07.390132+0000","last_undegraded":"2024-03-04T13:01:07.390132+0000","last_fullsized":"2024-03-04T13:01:07.390132+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:07.390037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:07.390037+0000","last_clean_scrub_stamp":"2024-03-04T13:01:07.390037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:23.311348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:13.411728+0000","last_change":"2024-03-04T13:01:13.411755+0000","last_active":"2024-03-04T13:01:13.411728+0000","last_peered":"2024-03-04T13:01:13.411728+0000","last_clean":"2024-03-04T13:01:13.411728+0000","last_became_active":"2024-03-04T12:44:53.478352+0000","last_became_peered":"2024-03-04T12:44:53.478352+0000","last_unstale":"2024-03-04T13:01:13.411728+0000","last_undegraded":"2024-03-04T13:01:13.411728+0000","last_fullsized":"2024-03-04T13:01:13.411728+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:13.411595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:13.411595+0000","last_clean_scrub_stamp":"2024-03-04T13:01:13.411595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:09.843683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"256'2","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.853284+0000","last_change":"2024-03-04T13:00:26.853284+0000","last_active":"2024-03-04T13:00:26.853284+0000","last_peered":"2024-03-04T13:00:26.853284+0000","last_clean":"2024-03-04T13:00:26.853284+0000","last_became_active":"2024-03-04T12:44:50.449627+0000","last_became_peered":"2024-03-04T12:44:50.449627+0000","last_unstale":"2024-03-04T13:00:26.853284+0000","last_undegraded":"2024-03-04T13:00:26.853284+0000","last_fullsized":"2024-03-04T13:00:26.853284+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:26.853152+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:26.853152+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.853152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:58:13.931570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"244'9","reported_seq":74,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.490326+0000","last_change":"2024-03-04T13:00:24.490356+0000","last_active":"2024-03-04T13:00:24.490326+0000","last_peered":"2024-03-04T13:00:24.490326+0000","last_clean":"2024-03-04T13:00:24.490326+0000","last_became_active":"2024-03-04T12:43:27.057074+0000","last_became_peered":"2024-03-04T12:43:27.057074+0000","last_unstale":"2024-03-04T13:00:24.490326+0000","last_undegraded":"2024-03-04T13:00:24.490326+0000","last_fullsized":"2024-03-04T13:00:24.490326+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'9","last_scrub_stamp":"2024-03-04T13:00:24.490225+0000","last_deep_scrub":"244'9","last_deep_scrub_stamp":"2024-03-04T13:00:24.490225+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.490225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:02:04.720591+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:15.205853+0000","last_change":"2024-03-04T13:01:15.205909+0000","last_active":"2024-03-04T13:01:15.205853+0000","last_peered":"2024-03-04T13:01:15.205853+0000","last_clean":"2024-03-04T13:01:15.205853+0000","last_became_active":"2024-03-04T12:51:01.595390+0000","last_became_peered":"2024-03-04T12:51:01.595390+0000","last_unstale":"2024-03-04T13:01:15.205853+0000","last_undegraded":"2024-03-04T13:01:15.205853+0000","last_fullsized":"2024-03-04T13:01:15.205853+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:15.205749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:15.205749+0000","last_clean_scrub_stamp":"2024-03-04T13:01:15.205749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:01.931926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"256'8","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.388528+0000","last_change":"2024-03-04T13:00:34.388557+0000","last_active":"2024-03-04T13:00:34.388528+0000","last_peered":"2024-03-04T13:00:34.388528+0000","last_clean":"2024-03-04T13:00:34.388528+0000","last_became_active":"2024-03-04T12:44:53.482800+0000","last_became_peered":"2024-03-04T12:44:53.482800+0000","last_unstale":"2024-03-04T13:00:34.388528+0000","last_undegraded":"2024-03-04T13:00:34.388528+0000","last_fullsized":"2024-03-04T13:00:34.388528+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'8","last_scrub_stamp":"2024-03-04T13:00:34.388440+0000","last_deep_scrub":"256'8","last_deep_scrub_stamp":"2024-03-04T13:00:34.388440+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.388440+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:24.212679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'9","reported_seq":61,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.307581+0000","last_change":"2024-03-04T13:00:35.307629+0000","last_active":"2024-03-04T13:00:35.307581+0000","last_peered":"2024-03-04T13:00:35.307581+0000","last_clean":"2024-03-04T13:00:35.307581+0000","last_became_active":"2024-03-04T12:44:50.455937+0000","last_became_peered":"2024-03-04T12:44:50.455937+0000","last_unstale":"2024-03-04T13:00:35.307581+0000","last_undegraded":"2024-03-04T13:00:35.307581+0000","last_fullsized":"2024-03-04T13:00:35.307581+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:35.307447+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:35.307447+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.307447+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:52:38.354029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":7,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"256'148","reported_seq":399,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.394377+0000","last_change":"2024-03-04T13:00:24.394420+0000","last_active":"2024-03-04T13:00:24.394377+0000","last_peered":"2024-03-04T13:00:24.394377+0000","last_clean":"2024-03-04T13:00:24.394377+0000","last_became_active":"2024-03-04T12:43:27.065085+0000","last_became_peered":"2024-03-04T12:43:27.065085+0000","last_unstale":"2024-03-04T13:00:24.394377+0000","last_undegraded":"2024-03-04T13:00:24.394377+0000","last_fullsized":"2024-03-04T13:00:24.394377+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'148","last_scrub_stamp":"2024-03-04T13:00:24.394285+0000","last_deep_scrub":"256'148","last_deep_scrub_stamp":"2024-03-04T13:00:24.394285+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.394285+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:09:50.870191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":610,"num_read_kb":432,"num_write":236,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:10.853854+0000","last_change":"2024-03-04T13:01:10.853880+0000","last_active":"2024-03-04T13:01:10.853854+0000","last_peered":"2024-03-04T13:01:10.853854+0000","last_clean":"2024-03-04T13:01:10.853854+0000","last_became_active":"2024-03-04T12:51:01.353012+0000","last_became_peered":"2024-03-04T12:51:01.353012+0000","last_unstale":"2024-03-04T13:01:10.853854+0000","last_undegraded":"2024-03-04T13:01:10.853854+0000","last_fullsized":"2024-03-04T13:01:10.853854+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:10.853757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:10.853757+0000","last_clean_scrub_stamp":"2024-03-04T13:01:10.853757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:14.212214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"256'7","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:15.369318+0000","last_change":"2024-03-04T13:01:15.369349+0000","last_active":"2024-03-04T13:01:15.369318+0000","last_peered":"2024-03-04T13:01:15.369318+0000","last_clean":"2024-03-04T13:01:15.369318+0000","last_became_active":"2024-03-04T12:44:53.484514+0000","last_became_peered":"2024-03-04T12:44:53.484514+0000","last_unstale":"2024-03-04T13:01:15.369318+0000","last_undegraded":"2024-03-04T13:01:15.369318+0000","last_fullsized":"2024-03-04T13:01:15.369318+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:01:15.369224+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:01:15.369224+0000","last_clean_scrub_stamp":"2024-03-04T13:01:15.369224+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:40:21.428742+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4138,"num_write":5,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"256'5","reported_seq":55,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.650563+0000","last_change":"2024-03-04T13:00:21.650563+0000","last_active":"2024-03-04T13:00:21.650563+0000","last_peered":"2024-03-04T13:00:21.650563+0000","last_clean":"2024-03-04T13:00:21.650563+0000","last_became_active":"2024-03-04T12:44:50.450101+0000","last_became_peered":"2024-03-04T12:44:50.450101+0000","last_unstale":"2024-03-04T13:00:21.650563+0000","last_undegraded":"2024-03-04T13:00:21.650563+0000","last_fullsized":"2024-03-04T13:00:21.650563+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'5","last_scrub_stamp":"2024-03-04T13:00:21.650477+0000","last_deep_scrub":"256'5","last_deep_scrub_stamp":"2024-03-04T13:00:21.650477+0000","last_clean_scrub_stamp":"2024-03-04T13:00:21.650477+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:03.543521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"256'27","reported_seq":108,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.162439+0000","last_change":"2024-03-04T13:00:47.162439+0000","last_active":"2024-03-04T13:00:47.162439+0000","last_peered":"2024-03-04T13:00:47.162439+0000","last_clean":"2024-03-04T13:00:47.162439+0000","last_became_active":"2024-03-04T12:43:27.067391+0000","last_became_peered":"2024-03-04T12:43:27.067391+0000","last_unstale":"2024-03-04T13:00:47.162439+0000","last_undegraded":"2024-03-04T13:00:47.162439+0000","last_fullsized":"2024-03-04T13:00:47.162439+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'27","last_scrub_stamp":"2024-03-04T13:00:47.162283+0000","last_deep_scrub":"256'27","last_deep_scrub_stamp":"2024-03-04T13:00:47.162283+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.162283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:34:22.350283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:14.222483+0000","last_change":"2024-03-04T13:01:14.222510+0000","last_active":"2024-03-04T13:01:14.222483+0000","last_peered":"2024-03-04T13:01:14.222483+0000","last_clean":"2024-03-04T13:01:14.222483+0000","last_became_active":"2024-03-04T12:51:01.352191+0000","last_became_peered":"2024-03-04T12:51:01.352191+0000","last_unstale":"2024-03-04T13:01:14.222483+0000","last_undegraded":"2024-03-04T13:01:14.222483+0000","last_fullsized":"2024-03-04T13:01:14.222483+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:14.222390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:14.222390+0000","last_clean_scrub_stamp":"2024-03-04T13:01:14.222390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:28:41.703586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"256'2","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:06.913200+0000","last_change":"2024-03-04T13:01:06.913228+0000","last_active":"2024-03-04T13:01:06.913200+0000","last_peered":"2024-03-04T13:01:06.913200+0000","last_clean":"2024-03-04T13:01:06.913200+0000","last_became_active":"2024-03-04T12:44:53.482253+0000","last_became_peered":"2024-03-04T12:44:53.482253+0000","last_unstale":"2024-03-04T13:01:06.913200+0000","last_undegraded":"2024-03-04T13:01:06.913200+0000","last_fullsized":"2024-03-04T13:01:06.913200+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:06.913106+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:06.913106+0000","last_clean_scrub_stamp":"2024-03-04T13:01:06.913106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:55:47.477526+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.881073+0000","last_change":"2024-03-04T13:00:24.881117+0000","last_active":"2024-03-04T13:00:24.881073+0000","last_peered":"2024-03-04T13:00:24.881073+0000","last_clean":"2024-03-04T13:00:24.881073+0000","last_became_active":"2024-03-04T12:44:50.449070+0000","last_became_peered":"2024-03-04T12:44:50.449070+0000","last_unstale":"2024-03-04T13:00:24.881073+0000","last_undegraded":"2024-03-04T13:00:24.881073+0000","last_fullsized":"2024-03-04T13:00:24.881073+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:24.880951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:24.880951+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.880951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:20:20.554220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"256'13","reported_seq":81,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.330260+0000","last_change":"2024-03-04T13:00:33.330260+0000","last_active":"2024-03-04T13:00:33.330260+0000","last_peered":"2024-03-04T13:00:33.330260+0000","last_clean":"2024-03-04T13:00:33.330260+0000","last_became_active":"2024-03-04T12:43:27.061574+0000","last_became_peered":"2024-03-04T12:43:27.061574+0000","last_unstale":"2024-03-04T13:00:33.330260+0000","last_undegraded":"2024-03-04T13:00:33.330260+0000","last_fullsized":"2024-03-04T13:00:33.330260+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'13","last_scrub_stamp":"2024-03-04T13:00:33.330135+0000","last_deep_scrub":"256'13","last_deep_scrub_stamp":"2024-03-04T13:00:33.330135+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.330135+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:29:30.807030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:06.386961+0000","last_change":"2024-03-04T13:01:06.386984+0000","last_active":"2024-03-04T13:01:06.386961+0000","last_peered":"2024-03-04T13:01:06.386961+0000","last_clean":"2024-03-04T13:01:06.386961+0000","last_became_active":"2024-03-04T12:51:01.356286+0000","last_became_peered":"2024-03-04T12:51:01.356286+0000","last_unstale":"2024-03-04T13:01:06.386961+0000","last_undegraded":"2024-03-04T13:01:06.386961+0000","last_fullsized":"2024-03-04T13:01:06.386961+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:06.386884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:06.386884+0000","last_clean_scrub_stamp":"2024-03-04T13:01:06.386884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:54.282353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"256'6","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.485230+0000","last_change":"2024-03-04T13:00:46.485251+0000","last_active":"2024-03-04T13:00:46.485230+0000","last_peered":"2024-03-04T13:00:46.485230+0000","last_clean":"2024-03-04T13:00:46.485230+0000","last_became_active":"2024-03-04T12:44:53.477801+0000","last_became_peered":"2024-03-04T12:44:53.477801+0000","last_unstale":"2024-03-04T13:00:46.485230+0000","last_undegraded":"2024-03-04T13:00:46.485230+0000","last_fullsized":"2024-03-04T13:00:46.485230+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:46.485153+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:46.485153+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.485153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:53:42.381117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"256'4","reported_seq":53,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.751624+0000","last_change":"2024-03-04T13:00:38.751670+0000","last_active":"2024-03-04T13:00:38.751624+0000","last_peered":"2024-03-04T13:00:38.751624+0000","last_clean":"2024-03-04T13:00:38.751624+0000","last_became_active":"2024-03-04T12:44:50.456005+0000","last_became_peered":"2024-03-04T12:44:50.456005+0000","last_unstale":"2024-03-04T13:00:38.751624+0000","last_undegraded":"2024-03-04T13:00:38.751624+0000","last_fullsized":"2024-03-04T13:00:38.751624+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:38.751516+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:38.751516+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.751516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:09.546730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"256'19","reported_seq":94,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.842089+0000","last_change":"2024-03-04T13:00:29.842089+0000","last_active":"2024-03-04T13:00:29.842089+0000","last_peered":"2024-03-04T13:00:29.842089+0000","last_clean":"2024-03-04T13:00:29.842089+0000","last_became_active":"2024-03-04T12:43:27.054951+0000","last_became_peered":"2024-03-04T12:43:27.054951+0000","last_unstale":"2024-03-04T13:00:29.842089+0000","last_undegraded":"2024-03-04T13:00:29.842089+0000","last_fullsized":"2024-03-04T13:00:29.842089+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'19","last_scrub_stamp":"2024-03-04T13:00:29.841916+0000","last_deep_scrub":"256'19","last_deep_scrub_stamp":"2024-03-04T13:00:29.841916+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.841916+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:10.346801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":48,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:17.402054+0000","last_change":"2024-03-04T13:01:17.402077+0000","last_active":"2024-03-04T13:01:17.402054+0000","last_peered":"2024-03-04T13:01:17.402054+0000","last_clean":"2024-03-04T13:01:17.402054+0000","last_became_active":"2024-03-04T12:51:01.596248+0000","last_became_peered":"2024-03-04T12:51:01.596248+0000","last_unstale":"2024-03-04T13:01:17.402054+0000","last_undegraded":"2024-03-04T13:01:17.402054+0000","last_fullsized":"2024-03-04T13:01:17.402054+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:17.401959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:17.401959+0000","last_clean_scrub_stamp":"2024-03-04T13:01:17.401959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:17.535427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.185690+0000","last_change":"2024-03-04T13:00:53.185713+0000","last_active":"2024-03-04T13:00:53.185690+0000","last_peered":"2024-03-04T13:00:53.185690+0000","last_clean":"2024-03-04T13:00:53.185690+0000","last_became_active":"2024-03-04T12:44:53.480987+0000","last_became_peered":"2024-03-04T12:44:53.480987+0000","last_unstale":"2024-03-04T13:00:53.185690+0000","last_undegraded":"2024-03-04T13:00:53.185690+0000","last_fullsized":"2024-03-04T13:00:53.185690+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:53.185558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:53.185558+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.185558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:25.573219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"256'4","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.644795+0000","last_change":"2024-03-04T13:00:57.644825+0000","last_active":"2024-03-04T13:00:57.644795+0000","last_peered":"2024-03-04T13:00:57.644795+0000","last_clean":"2024-03-04T13:00:57.644795+0000","last_became_active":"2024-03-04T12:44:50.455944+0000","last_became_peered":"2024-03-04T12:44:50.455944+0000","last_unstale":"2024-03-04T13:00:57.644795+0000","last_undegraded":"2024-03-04T13:00:57.644795+0000","last_fullsized":"2024-03-04T13:00:57.644795+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:57.644688+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:57.644688+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.644688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:34:47.602142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"256'15","reported_seq":88,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.306584+0000","last_change":"2024-03-04T13:00:31.306584+0000","last_active":"2024-03-04T13:00:31.306584+0000","last_peered":"2024-03-04T13:00:31.306584+0000","last_clean":"2024-03-04T13:00:31.306584+0000","last_became_active":"2024-03-04T12:43:27.060180+0000","last_became_peered":"2024-03-04T12:43:27.060180+0000","last_unstale":"2024-03-04T13:00:31.306584+0000","last_undegraded":"2024-03-04T13:00:31.306584+0000","last_fullsized":"2024-03-04T13:00:31.306584+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'15","last_scrub_stamp":"2024-03-04T13:00:31.306462+0000","last_deep_scrub":"256'15","last_deep_scrub_stamp":"2024-03-04T13:00:31.306462+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.306462+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:02.641888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:16.415935+0000","last_change":"2024-03-04T13:01:16.415960+0000","last_active":"2024-03-04T13:01:16.415935+0000","last_peered":"2024-03-04T13:01:16.415935+0000","last_clean":"2024-03-04T13:01:16.415935+0000","last_became_active":"2024-03-04T12:51:01.350349+0000","last_became_peered":"2024-03-04T12:51:01.350349+0000","last_unstale":"2024-03-04T13:01:16.415935+0000","last_undegraded":"2024-03-04T13:01:16.415935+0000","last_fullsized":"2024-03-04T13:01:16.415935+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:16.415837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:16.415837+0000","last_clean_scrub_stamp":"2024-03-04T13:01:16.415837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:24:49.222447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"256'6","reported_seq":51,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.358277+0000","last_change":"2024-03-04T13:00:43.358320+0000","last_active":"2024-03-04T13:00:43.358277+0000","last_peered":"2024-03-04T13:00:43.358277+0000","last_clean":"2024-03-04T13:00:43.358277+0000","last_became_active":"2024-03-04T12:44:53.485429+0000","last_became_peered":"2024-03-04T12:44:53.485429+0000","last_unstale":"2024-03-04T13:00:43.358277+0000","last_undegraded":"2024-03-04T13:00:43.358277+0000","last_fullsized":"2024-03-04T13:00:43.358277+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:43.358174+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:43.358174+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.358174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:46.298234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"256'6","reported_seq":58,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.607925+0000","last_change":"2024-03-04T13:00:30.607966+0000","last_active":"2024-03-04T13:00:30.607925+0000","last_peered":"2024-03-04T13:00:30.607925+0000","last_clean":"2024-03-04T13:00:30.607925+0000","last_became_active":"2024-03-04T12:44:50.452611+0000","last_became_peered":"2024-03-04T12:44:50.452611+0000","last_unstale":"2024-03-04T13:00:30.607925+0000","last_undegraded":"2024-03-04T13:00:30.607925+0000","last_fullsized":"2024-03-04T13:00:30.607925+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:30.607817+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:30.607817+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.607817+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:57.889690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"256'20","reported_seq":101,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.270359+0000","last_change":"2024-03-04T13:00:29.270359+0000","last_active":"2024-03-04T13:00:29.270359+0000","last_peered":"2024-03-04T13:00:29.270359+0000","last_clean":"2024-03-04T13:00:29.270359+0000","last_became_active":"2024-03-04T12:43:27.064375+0000","last_became_peered":"2024-03-04T12:43:27.064375+0000","last_unstale":"2024-03-04T13:00:29.270359+0000","last_undegraded":"2024-03-04T13:00:29.270359+0000","last_fullsized":"2024-03-04T13:00:29.270359+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'20","last_scrub_stamp":"2024-03-04T13:00:29.270196+0000","last_deep_scrub":"256'20","last_deep_scrub_stamp":"2024-03-04T13:00:29.270196+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.270196+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:33:53.986271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":61,"num_write":47,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:09.864852+0000","last_change":"2024-03-04T13:01:09.864882+0000","last_active":"2024-03-04T13:01:09.864852+0000","last_peered":"2024-03-04T13:01:09.864852+0000","last_clean":"2024-03-04T13:01:09.864852+0000","last_became_active":"2024-03-04T12:51:01.349889+0000","last_became_peered":"2024-03-04T12:51:01.349889+0000","last_unstale":"2024-03-04T13:01:09.864852+0000","last_undegraded":"2024-03-04T13:01:09.864852+0000","last_fullsized":"2024-03-04T13:01:09.864852+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:09.864765+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:09.864765+0000","last_clean_scrub_stamp":"2024-03-04T13:01:09.864765+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:23:18.220762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"256'2","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:13.195014+0000","last_change":"2024-03-04T13:01:13.195053+0000","last_active":"2024-03-04T13:01:13.195014+0000","last_peered":"2024-03-04T13:01:13.195014+0000","last_clean":"2024-03-04T13:01:13.195014+0000","last_became_active":"2024-03-04T12:44:53.489232+0000","last_became_peered":"2024-03-04T12:44:53.489232+0000","last_unstale":"2024-03-04T13:01:13.195014+0000","last_undegraded":"2024-03-04T13:01:13.195014+0000","last_fullsized":"2024-03-04T13:01:13.195014+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:13.194928+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:13.194928+0000","last_clean_scrub_stamp":"2024-03-04T13:01:13.194928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:09:31.721673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.377159+0000","last_change":"2024-03-04T13:00:26.377182+0000","last_active":"2024-03-04T13:00:26.377159+0000","last_peered":"2024-03-04T13:00:26.377159+0000","last_clean":"2024-03-04T13:00:26.377159+0000","last_became_active":"2024-03-04T12:44:50.459359+0000","last_became_peered":"2024-03-04T12:44:50.459359+0000","last_unstale":"2024-03-04T13:00:26.377159+0000","last_undegraded":"2024-03-04T13:00:26.377159+0000","last_fullsized":"2024-03-04T13:00:26.377159+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:26.377070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:26.377070+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.377070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:23.336645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"256'25","reported_seq":115,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.519803+0000","last_change":"2024-03-04T13:00:28.519828+0000","last_active":"2024-03-04T13:00:28.519803+0000","last_peered":"2024-03-04T13:00:28.519803+0000","last_clean":"2024-03-04T13:00:28.519803+0000","last_became_active":"2024-03-04T12:43:27.060115+0000","last_became_peered":"2024-03-04T12:43:27.060115+0000","last_unstale":"2024-03-04T13:00:28.519803+0000","last_undegraded":"2024-03-04T13:00:28.519803+0000","last_fullsized":"2024-03-04T13:00:28.519803+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'25","last_scrub_stamp":"2024-03-04T13:00:28.519719+0000","last_deep_scrub":"256'25","last_deep_scrub_stamp":"2024-03-04T13:00:28.519719+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.519719+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:26.466728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:16.222306+0000","last_change":"2024-03-04T13:01:16.222334+0000","last_active":"2024-03-04T13:01:16.222306+0000","last_peered":"2024-03-04T13:01:16.222306+0000","last_clean":"2024-03-04T13:01:16.222306+0000","last_became_active":"2024-03-04T12:51:01.596463+0000","last_became_peered":"2024-03-04T12:51:01.596463+0000","last_unstale":"2024-03-04T13:01:16.222306+0000","last_undegraded":"2024-03-04T13:01:16.222306+0000","last_fullsized":"2024-03-04T13:01:16.222306+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:16.222200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:16.222200+0000","last_clean_scrub_stamp":"2024-03-04T13:01:16.222200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:33:06.029259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"256'6","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:09.199390+0000","last_change":"2024-03-04T13:01:09.199419+0000","last_active":"2024-03-04T13:01:09.199390+0000","last_peered":"2024-03-04T13:01:09.199390+0000","last_clean":"2024-03-04T13:01:09.199390+0000","last_became_active":"2024-03-04T12:44:53.479076+0000","last_became_peered":"2024-03-04T12:44:53.479076+0000","last_unstale":"2024-03-04T13:01:09.199390+0000","last_undegraded":"2024-03-04T13:01:09.199390+0000","last_fullsized":"2024-03-04T13:01:09.199390+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:01:09.199302+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:01:09.199302+0000","last_clean_scrub_stamp":"2024-03-04T13:01:09.199302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:46.820391+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"256'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.266006+0000","last_change":"2024-03-04T13:00:27.266052+0000","last_active":"2024-03-04T13:00:27.266006+0000","last_peered":"2024-03-04T13:00:27.266006+0000","last_clean":"2024-03-04T13:00:27.266006+0000","last_became_active":"2024-03-04T12:44:50.454398+0000","last_became_peered":"2024-03-04T12:44:50.454398+0000","last_unstale":"2024-03-04T13:00:27.266006+0000","last_undegraded":"2024-03-04T13:00:27.266006+0000","last_fullsized":"2024-03-04T13:00:27.266006+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:27.265871+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:27.265871+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.265871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:12:37.304071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"256'33","reported_seq":126,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.266710+0000","last_change":"2024-03-04T13:00:32.266736+0000","last_active":"2024-03-04T13:00:32.266710+0000","last_peered":"2024-03-04T13:00:32.266710+0000","last_clean":"2024-03-04T13:00:32.266710+0000","last_became_active":"2024-03-04T12:43:27.060589+0000","last_became_peered":"2024-03-04T12:43:27.060589+0000","last_unstale":"2024-03-04T13:00:32.266710+0000","last_undegraded":"2024-03-04T13:00:32.266710+0000","last_fullsized":"2024-03-04T13:00:32.266710+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'33","last_scrub_stamp":"2024-03-04T13:00:32.266584+0000","last_deep_scrub":"256'33","last_deep_scrub_stamp":"2024-03-04T13:00:32.266584+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.266584+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:51:33.406291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":90,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:12.135436+0000","last_change":"2024-03-04T13:01:12.135463+0000","last_active":"2024-03-04T13:01:12.135436+0000","last_peered":"2024-03-04T13:01:12.135436+0000","last_clean":"2024-03-04T13:01:12.135436+0000","last_became_active":"2024-03-04T12:51:01.355416+0000","last_became_peered":"2024-03-04T12:51:01.355416+0000","last_unstale":"2024-03-04T13:01:12.135436+0000","last_undegraded":"2024-03-04T13:01:12.135436+0000","last_fullsized":"2024-03-04T13:01:12.135436+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:12.135326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:12.135326+0000","last_clean_scrub_stamp":"2024-03-04T13:01:12.135326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:37.794765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"256'2","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:11.238084+0000","last_change":"2024-03-04T13:01:11.238108+0000","last_active":"2024-03-04T13:01:11.238084+0000","last_peered":"2024-03-04T13:01:11.238084+0000","last_clean":"2024-03-04T13:01:11.238084+0000","last_became_active":"2024-03-04T12:44:53.486235+0000","last_became_peered":"2024-03-04T12:44:53.486235+0000","last_unstale":"2024-03-04T13:01:11.238084+0000","last_undegraded":"2024-03-04T13:01:11.238084+0000","last_fullsized":"2024-03-04T13:01:11.238084+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:11.237975+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:11.237975+0000","last_clean_scrub_stamp":"2024-03-04T13:01:11.237975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:24:31.516917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"256'7","reported_seq":57,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.126064+0000","last_change":"2024-03-04T13:00:28.126118+0000","last_active":"2024-03-04T13:00:28.126064+0000","last_peered":"2024-03-04T13:00:28.126064+0000","last_clean":"2024-03-04T13:00:28.126064+0000","last_became_active":"2024-03-04T12:44:50.458610+0000","last_became_peered":"2024-03-04T12:44:50.458610+0000","last_unstale":"2024-03-04T13:00:28.126064+0000","last_undegraded":"2024-03-04T13:00:28.126064+0000","last_fullsized":"2024-03-04T13:00:28.126064+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:00:28.125955+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:00:28.125955+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.125955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:00.483454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7739,"num_write":12,"num_write_kb":7739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"256'17","reported_seq":88,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.665270+0000","last_change":"2024-03-04T13:00:24.665292+0000","last_active":"2024-03-04T13:00:24.665270+0000","last_peered":"2024-03-04T13:00:24.665270+0000","last_clean":"2024-03-04T13:00:24.665270+0000","last_became_active":"2024-03-04T12:43:27.067223+0000","last_became_peered":"2024-03-04T12:43:27.067223+0000","last_unstale":"2024-03-04T13:00:24.665270+0000","last_undegraded":"2024-03-04T13:00:24.665270+0000","last_fullsized":"2024-03-04T13:00:24.665270+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'17","last_scrub_stamp":"2024-03-04T13:00:24.665191+0000","last_deep_scrub":"256'17","last_deep_scrub_stamp":"2024-03-04T13:00:24.665191+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.665191+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:39.414488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":41,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:05.337476+0000","last_change":"2024-03-04T13:01:05.337499+0000","last_active":"2024-03-04T13:01:05.337476+0000","last_peered":"2024-03-04T13:01:05.337476+0000","last_clean":"2024-03-04T13:01:05.337476+0000","last_became_active":"2024-03-04T12:51:01.353432+0000","last_became_peered":"2024-03-04T12:51:01.353432+0000","last_unstale":"2024-03-04T13:01:05.337476+0000","last_undegraded":"2024-03-04T13:01:05.337476+0000","last_fullsized":"2024-03-04T13:01:05.337476+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:05.337385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:05.337385+0000","last_clean_scrub_stamp":"2024-03-04T13:01:05.337385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:14:42.921495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"250'2","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.252491+0000","last_change":"2024-03-04T13:00:39.252491+0000","last_active":"2024-03-04T13:00:39.252491+0000","last_peered":"2024-03-04T13:00:39.252491+0000","last_clean":"2024-03-04T13:00:39.252491+0000","last_became_active":"2024-03-04T12:44:53.482370+0000","last_became_peered":"2024-03-04T12:44:53.482370+0000","last_unstale":"2024-03-04T13:00:39.252491+0000","last_undegraded":"2024-03-04T13:00:39.252491+0000","last_fullsized":"2024-03-04T13:00:39.252491+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:39.252370+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:39.252370+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.252370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:34.221417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"256'4","reported_seq":53,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.342117+0000","last_change":"2024-03-04T13:00:40.342144+0000","last_active":"2024-03-04T13:00:40.342117+0000","last_peered":"2024-03-04T13:00:40.342117+0000","last_clean":"2024-03-04T13:00:40.342117+0000","last_became_active":"2024-03-04T12:44:50.450681+0000","last_became_peered":"2024-03-04T12:44:50.450681+0000","last_unstale":"2024-03-04T13:00:40.342117+0000","last_undegraded":"2024-03-04T13:00:40.342117+0000","last_fullsized":"2024-03-04T13:00:40.342117+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:40.342026+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:40.342026+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.342026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:02.619334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":368,"num_write":4,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"256'61","reported_seq":205,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.795512+0000","last_change":"2024-03-04T13:00:28.795546+0000","last_active":"2024-03-04T13:00:28.795512+0000","last_peered":"2024-03-04T13:00:28.795512+0000","last_clean":"2024-03-04T13:00:28.795512+0000","last_became_active":"2024-03-04T12:43:27.056781+0000","last_became_peered":"2024-03-04T12:43:27.056781+0000","last_unstale":"2024-03-04T13:00:28.795512+0000","last_undegraded":"2024-03-04T13:00:28.795512+0000","last_fullsized":"2024-03-04T13:00:28.795512+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'61","last_scrub_stamp":"2024-03-04T13:00:28.795405+0000","last_deep_scrub":"256'61","last_deep_scrub_stamp":"2024-03-04T13:00:28.795405+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.795405+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:36.779728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":203,"num_write":94,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:08.856937+0000","last_change":"2024-03-04T13:01:08.856960+0000","last_active":"2024-03-04T13:01:08.856937+0000","last_peered":"2024-03-04T13:01:08.856937+0000","last_clean":"2024-03-04T13:01:08.856937+0000","last_became_active":"2024-03-04T12:51:01.349216+0000","last_became_peered":"2024-03-04T12:51:01.349216+0000","last_unstale":"2024-03-04T13:01:08.856937+0000","last_undegraded":"2024-03-04T13:01:08.856937+0000","last_fullsized":"2024-03-04T13:01:08.856937+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:08.856809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:08.856809+0000","last_clean_scrub_stamp":"2024-03-04T13:01:08.856809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:51:29.275126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.649362+0000","last_change":"2024-03-04T13:00:58.649404+0000","last_active":"2024-03-04T13:00:58.649362+0000","last_peered":"2024-03-04T13:00:58.649362+0000","last_clean":"2024-03-04T13:00:58.649362+0000","last_became_active":"2024-03-04T12:44:53.479411+0000","last_became_peered":"2024-03-04T12:44:53.479411+0000","last_unstale":"2024-03-04T13:00:58.649362+0000","last_undegraded":"2024-03-04T13:00:58.649362+0000","last_fullsized":"2024-03-04T13:00:58.649362+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:58.649256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:58.649256+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.649256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:20.808929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'5","reported_seq":56,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.248147+0000","last_change":"2024-03-04T13:00:26.248147+0000","last_active":"2024-03-04T13:00:26.248147+0000","last_peered":"2024-03-04T13:00:26.248147+0000","last_clean":"2024-03-04T13:00:26.248147+0000","last_became_active":"2024-03-04T12:44:50.451626+0000","last_became_peered":"2024-03-04T12:44:50.451626+0000","last_unstale":"2024-03-04T13:00:26.248147+0000","last_undegraded":"2024-03-04T13:00:26.248147+0000","last_fullsized":"2024-03-04T13:00:26.248147+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'5","last_scrub_stamp":"2024-03-04T13:00:26.248033+0000","last_deep_scrub":"256'5","last_deep_scrub_stamp":"2024-03-04T13:00:26.248033+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.248033+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:13:53.495710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"256'128","reported_seq":415,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.484418+0000","last_change":"2024-03-04T13:00:25.484470+0000","last_active":"2024-03-04T13:00:25.484418+0000","last_peered":"2024-03-04T13:00:25.484418+0000","last_clean":"2024-03-04T13:00:25.484418+0000","last_became_active":"2024-03-04T12:43:27.056007+0000","last_became_peered":"2024-03-04T12:43:27.056007+0000","last_unstale":"2024-03-04T13:00:25.484418+0000","last_undegraded":"2024-03-04T13:00:25.484418+0000","last_fullsized":"2024-03-04T13:00:25.484418+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'128","last_scrub_stamp":"2024-03-04T13:00:25.484311+0000","last_deep_scrub":"256'128","last_deep_scrub_stamp":"2024-03-04T13:00:25.484311+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.484311+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:29.733934+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":540,"num_write":158,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3984,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.634458+0000","last_change":"2024-03-04T13:01:01.634477+0000","last_active":"2024-03-04T13:01:01.634458+0000","last_peered":"2024-03-04T13:01:01.634458+0000","last_clean":"2024-03-04T13:01:01.634458+0000","last_became_active":"2024-03-04T12:51:01.354601+0000","last_became_peered":"2024-03-04T12:51:01.354601+0000","last_unstale":"2024-03-04T13:01:01.634458+0000","last_undegraded":"2024-03-04T13:01:01.634458+0000","last_fullsized":"2024-03-04T13:01:01.634458+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:01.634386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:01.634386+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.634386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:37.580048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.357366+0000","last_change":"2024-03-04T13:01:02.357410+0000","last_active":"2024-03-04T13:01:02.357366+0000","last_peered":"2024-03-04T13:01:02.357366+0000","last_clean":"2024-03-04T13:01:02.357366+0000","last_became_active":"2024-03-04T12:44:53.486321+0000","last_became_peered":"2024-03-04T12:44:53.486321+0000","last_unstale":"2024-03-04T13:01:02.357366+0000","last_undegraded":"2024-03-04T13:01:02.357366+0000","last_fullsized":"2024-03-04T13:01:02.357366+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:02.357265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:02.357265+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.357265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:02.225136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"250'2","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.800909+0000","last_change":"2024-03-04T13:00:30.800957+0000","last_active":"2024-03-04T13:00:30.800909+0000","last_peered":"2024-03-04T13:00:30.800909+0000","last_clean":"2024-03-04T13:00:30.800909+0000","last_became_active":"2024-03-04T12:44:50.456315+0000","last_became_peered":"2024-03-04T12:44:50.456315+0000","last_unstale":"2024-03-04T13:00:30.800909+0000","last_undegraded":"2024-03-04T13:00:30.800909+0000","last_fullsized":"2024-03-04T13:00:30.800909+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:30.800805+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:30.800805+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.800805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:08:28.741353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"256'28","reported_seq":113,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.336331+0000","last_change":"2024-03-04T13:00:35.336372+0000","last_active":"2024-03-04T13:00:35.336331+0000","last_peered":"2024-03-04T13:00:35.336331+0000","last_clean":"2024-03-04T13:00:35.336331+0000","last_became_active":"2024-03-04T12:43:27.064141+0000","last_became_peered":"2024-03-04T12:43:27.064141+0000","last_unstale":"2024-03-04T13:00:35.336331+0000","last_undegraded":"2024-03-04T13:00:35.336331+0000","last_fullsized":"2024-03-04T13:00:35.336331+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'28","last_scrub_stamp":"2024-03-04T13:00:35.336234+0000","last_deep_scrub":"256'28","last_deep_scrub_stamp":"2024-03-04T13:00:35.336234+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.336234+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:07.884382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"256'416","reported_seq":1071,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.315398+0000","last_change":"2024-03-04T13:00:27.315458+0000","last_active":"2024-03-04T13:00:27.315398+0000","last_peered":"2024-03-04T13:00:27.315398+0000","last_clean":"2024-03-04T13:00:27.315398+0000","last_became_active":"2024-03-04T12:36:40.392399+0000","last_became_peered":"2024-03-04T12:36:40.392399+0000","last_unstale":"2024-03-04T13:00:27.315398+0000","last_undegraded":"2024-03-04T13:00:27.315398+0000","last_fullsized":"2024-03-04T13:00:27.315398+0000","mapping_epoch":33,"log_start":"256'401","ondisk_log_start":"256'401","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'416","last_scrub_stamp":"2024-03-04T13:00:27.315312+0000","last_deep_scrub":"256'416","last_deep_scrub_stamp":"2024-03-04T13:00:27.315312+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.315312+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":401,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:33.045930+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194364,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":637,"num_read_kb":17405,"num_write":1486,"num_write_kb":42784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"256'1113","reported_seq":2706,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.276221+0000","last_change":"2024-03-04T13:00:47.276221+0000","last_active":"2024-03-04T13:00:47.276221+0000","last_peered":"2024-03-04T13:00:47.276221+0000","last_clean":"2024-03-04T13:00:47.276221+0000","last_became_active":"2024-03-04T12:36:07.295125+0000","last_became_peered":"2024-03-04T12:36:07.295125+0000","last_unstale":"2024-03-04T13:00:47.276221+0000","last_undegraded":"2024-03-04T13:00:47.276221+0000","last_fullsized":"2024-03-04T13:00:47.276221+0000","mapping_epoch":22,"log_start":"256'1101","ondisk_log_start":"256'1101","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1113","last_scrub_stamp":"2024-03-04T13:00:47.276097+0000","last_deep_scrub":"256'1113","last_deep_scrub_stamp":"2024-03-04T13:00:47.276097+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.276097+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":1101,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:52.753715+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4869,"num_read_kb":4281,"num_write":1536,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2397,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"256'322","reported_seq":927,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.398598+0000","last_change":"2024-03-04T13:00:56.398598+0000","last_active":"2024-03-04T13:00:56.398598+0000","last_peered":"2024-03-04T13:00:56.398598+0000","last_clean":"2024-03-04T13:00:56.398598+0000","last_became_active":"2024-03-04T12:36:05.280695+0000","last_became_peered":"2024-03-04T12:36:05.280695+0000","last_unstale":"2024-03-04T13:00:56.398598+0000","last_undegraded":"2024-03-04T13:00:56.398598+0000","last_fullsized":"2024-03-04T13:00:56.398598+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'322","last_scrub_stamp":"2024-03-04T13:00:56.398408+0000","last_deep_scrub":"256'322","last_deep_scrub_stamp":"2024-03-04T13:00:56.398408+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.398408+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:31:05.991675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256487,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":427,"num_read_kb":2412,"num_write":1141,"num_write_kb":20516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"256'544","reported_seq":1947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.371823+0000","last_change":"2024-03-04T13:00:46.371823+0000","last_active":"2024-03-04T13:00:46.371823+0000","last_peered":"2024-03-04T13:00:46.371823+0000","last_clean":"2024-03-04T13:00:46.371823+0000","last_became_active":"2024-03-04T12:36:07.296651+0000","last_became_peered":"2024-03-04T12:36:07.296651+0000","last_unstale":"2024-03-04T13:00:46.371823+0000","last_undegraded":"2024-03-04T13:00:46.371823+0000","last_fullsized":"2024-03-04T13:00:46.371823+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'544","last_scrub_stamp":"2024-03-04T13:00:46.371662+0000","last_deep_scrub":"256'544","last_deep_scrub_stamp":"2024-03-04T13:00:46.371662+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.371662+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:04.839309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2661,"num_read_kb":2496,"num_write":771,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"256'334","reported_seq":947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:07.460426+0000","last_change":"2024-03-04T13:01:07.460477+0000","last_active":"2024-03-04T13:01:07.460426+0000","last_peered":"2024-03-04T13:01:07.460426+0000","last_clean":"2024-03-04T13:01:07.460426+0000","last_became_active":"2024-03-04T12:36:05.285054+0000","last_became_peered":"2024-03-04T12:36:05.285054+0000","last_unstale":"2024-03-04T13:01:07.460426+0000","last_undegraded":"2024-03-04T13:01:07.460426+0000","last_fullsized":"2024-03-04T13:01:07.460426+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'334","last_scrub_stamp":"2024-03-04T13:01:07.460318+0000","last_deep_scrub":"256'334","last_deep_scrub_stamp":"2024-03-04T13:01:07.460318+0000","last_clean_scrub_stamp":"2024-03-04T13:01:07.460318+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:57:34.892491+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695847,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":27372,"num_write":1039,"num_write_kb":18696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"256'596","reported_seq":2026,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.065447+0000","last_change":"2024-03-04T13:00:44.065447+0000","last_active":"2024-03-04T13:00:44.065447+0000","last_peered":"2024-03-04T13:00:44.065447+0000","last_clean":"2024-03-04T13:00:44.065447+0000","last_became_active":"2024-03-04T12:36:07.298528+0000","last_became_peered":"2024-03-04T12:36:07.298528+0000","last_unstale":"2024-03-04T13:00:44.065447+0000","last_undegraded":"2024-03-04T13:00:44.065447+0000","last_fullsized":"2024-03-04T13:00:44.065447+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'596","last_scrub_stamp":"2024-03-04T13:00:44.065329+0000","last_deep_scrub":"256'596","last_deep_scrub_stamp":"2024-03-04T13:00:44.065329+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.065329+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:31:28.355176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2805,"num_read_kb":2500,"num_write":805,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":978,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"256'349","reported_seq":970,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:05.343824+0000","last_change":"2024-03-04T13:01:05.343894+0000","last_active":"2024-03-04T13:01:05.343824+0000","last_peered":"2024-03-04T13:01:05.343824+0000","last_clean":"2024-03-04T13:01:05.343824+0000","last_became_active":"2024-03-04T12:36:05.293768+0000","last_became_peered":"2024-03-04T12:36:05.293768+0000","last_unstale":"2024-03-04T13:01:05.343824+0000","last_undegraded":"2024-03-04T13:01:05.343824+0000","last_fullsized":"2024-03-04T13:01:05.343824+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'349","last_scrub_stamp":"2024-03-04T13:01:05.343726+0000","last_deep_scrub":"256'349","last_deep_scrub_stamp":"2024-03-04T13:01:05.343726+0000","last_clean_scrub_stamp":"2024-03-04T13:01:05.343726+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:36.287089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436929,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":443,"num_read_kb":31950,"num_write":1089,"num_write_kb":37939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"256'778","reported_seq":2185,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.593056+0000","last_change":"2024-03-04T13:00:29.593056+0000","last_active":"2024-03-04T13:00:29.593056+0000","last_peered":"2024-03-04T13:00:29.593056+0000","last_clean":"2024-03-04T13:00:29.593056+0000","last_became_active":"2024-03-04T12:36:40.393715+0000","last_became_peered":"2024-03-04T12:36:40.393715+0000","last_unstale":"2024-03-04T13:00:29.593056+0000","last_undegraded":"2024-03-04T13:00:29.593056+0000","last_fullsized":"2024-03-04T13:00:29.593056+0000","mapping_epoch":33,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'778","last_scrub_stamp":"2024-03-04T13:00:29.592929+0000","last_deep_scrub":"256'778","last_deep_scrub_stamp":"2024-03-04T13:00:29.592929+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.592929+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:11:41.602243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3436,"num_read_kb":3037,"num_write":1058,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"256'385","reported_seq":1030,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:06.252828+0000","last_change":"2024-03-04T13:01:06.252884+0000","last_active":"2024-03-04T13:01:06.252828+0000","last_peered":"2024-03-04T13:01:06.252828+0000","last_clean":"2024-03-04T13:01:06.252828+0000","last_became_active":"2024-03-04T12:36:05.290178+0000","last_became_peered":"2024-03-04T12:36:05.290178+0000","last_unstale":"2024-03-04T13:01:06.252828+0000","last_undegraded":"2024-03-04T13:01:06.252828+0000","last_fullsized":"2024-03-04T13:01:06.252828+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'385","last_scrub_stamp":"2024-03-04T13:01:06.252742+0000","last_deep_scrub":"256'385","last_deep_scrub_stamp":"2024-03-04T13:01:06.252742+0000","last_clean_scrub_stamp":"2024-03-04T13:01:06.252742+0000","objects_scrubbed":8,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:53.889948+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":589,"num_read_kb":36032,"num_write":1373,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"256'376","reported_seq":1932,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.770394+0000","last_change":"2024-03-04T13:00:41.770487+0000","last_active":"2024-03-04T13:00:41.770394+0000","last_peered":"2024-03-04T13:00:41.770394+0000","last_clean":"2024-03-04T13:00:41.770394+0000","last_became_active":"2024-03-04T12:36:07.301582+0000","last_became_peered":"2024-03-04T12:36:07.301582+0000","last_unstale":"2024-03-04T13:00:41.770394+0000","last_undegraded":"2024-03-04T13:00:41.770394+0000","last_fullsized":"2024-03-04T13:00:41.770394+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'376","last_scrub_stamp":"2024-03-04T13:00:41.770289+0000","last_deep_scrub":"256'376","last_deep_scrub_stamp":"2024-03-04T13:00:41.770289+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.770289+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:23:34.715892+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2123,"num_read_kb":2049,"num_write":405,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"256'299","reported_seq":917,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.223170+0000","last_change":"2024-03-04T13:00:53.223170+0000","last_active":"2024-03-04T13:00:53.223170+0000","last_peered":"2024-03-04T13:00:53.223170+0000","last_clean":"2024-03-04T13:00:53.223170+0000","last_became_active":"2024-03-04T12:36:05.296284+0000","last_became_peered":"2024-03-04T12:36:05.296284+0000","last_unstale":"2024-03-04T13:00:53.223170+0000","last_undegraded":"2024-03-04T13:00:53.223170+0000","last_fullsized":"2024-03-04T13:00:53.223170+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'299","last_scrub_stamp":"2024-03-04T13:00:53.223035+0000","last_deep_scrub":"256'299","last_deep_scrub_stamp":"2024-03-04T13:00:53.223035+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.223035+0000","objects_scrubbed":11,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:30:50.876472+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3348453,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":381,"num_read_kb":80579,"num_write":950,"num_write_kb":32166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"256'780","reported_seq":2032,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.091761+0000","last_change":"2024-03-04T13:00:43.091761+0000","last_active":"2024-03-04T13:00:43.091761+0000","last_peered":"2024-03-04T13:00:43.091761+0000","last_clean":"2024-03-04T13:00:43.091761+0000","last_became_active":"2024-03-04T12:36:07.297953+0000","last_became_peered":"2024-03-04T12:36:07.297953+0000","last_unstale":"2024-03-04T13:00:43.091761+0000","last_undegraded":"2024-03-04T13:00:43.091761+0000","last_fullsized":"2024-03-04T13:00:43.091761+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'780","last_scrub_stamp":"2024-03-04T13:00:43.091629+0000","last_deep_scrub":"256'780","last_deep_scrub_stamp":"2024-03-04T13:00:43.091629+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.091629+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:31.459229+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3335,"num_read_kb":2888,"num_write":1111,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1185,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"256'315","reported_seq":1038,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:07.228663+0000","last_change":"2024-03-04T13:01:07.228709+0000","last_active":"2024-03-04T13:01:07.228663+0000","last_peered":"2024-03-04T13:01:07.228663+0000","last_clean":"2024-03-04T13:01:07.228663+0000","last_became_active":"2024-03-04T12:36:05.291041+0000","last_became_peered":"2024-03-04T12:36:05.291041+0000","last_unstale":"2024-03-04T13:01:07.228663+0000","last_undegraded":"2024-03-04T13:01:07.228663+0000","last_fullsized":"2024-03-04T13:01:07.228663+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'315","last_scrub_stamp":"2024-03-04T13:01:07.228583+0000","last_deep_scrub":"256'315","last_deep_scrub_stamp":"2024-03-04T13:01:07.228583+0000","last_clean_scrub_stamp":"2024-03-04T13:01:07.228583+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:16:40.804013+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2107533,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":775,"num_read_kb":12113,"num_write":1137,"num_write_kb":11806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"256'692","reported_seq":2101,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.378858+0000","last_change":"2024-03-04T13:00:43.378858+0000","last_active":"2024-03-04T13:00:43.378858+0000","last_peered":"2024-03-04T13:00:43.378858+0000","last_clean":"2024-03-04T13:00:43.378858+0000","last_became_active":"2024-03-04T12:36:07.296763+0000","last_became_peered":"2024-03-04T12:36:07.296763+0000","last_unstale":"2024-03-04T13:00:43.378858+0000","last_undegraded":"2024-03-04T13:00:43.378858+0000","last_fullsized":"2024-03-04T13:00:43.378858+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'692","last_scrub_stamp":"2024-03-04T13:00:43.378717+0000","last_deep_scrub":"256'692","last_deep_scrub_stamp":"2024-03-04T13:00:43.378717+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.378717+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:30.590272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3139,"num_read_kb":2812,"num_write":915,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"256'295","reported_seq":907,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:05.499145+0000","last_change":"2024-03-04T13:01:05.499145+0000","last_active":"2024-03-04T13:01:05.499145+0000","last_peered":"2024-03-04T13:01:05.499145+0000","last_clean":"2024-03-04T13:01:05.499145+0000","last_became_active":"2024-03-04T12:36:05.294967+0000","last_became_peered":"2024-03-04T12:36:05.294967+0000","last_unstale":"2024-03-04T13:01:05.499145+0000","last_undegraded":"2024-03-04T13:01:05.499145+0000","last_fullsized":"2024-03-04T13:01:05.499145+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'295","last_scrub_stamp":"2024-03-04T13:01:05.499048+0000","last_deep_scrub":"256'295","last_deep_scrub_stamp":"2024-03-04T13:01:05.499048+0000","last_clean_scrub_stamp":"2024-03-04T13:01:05.499048+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:30.788727+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1332404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":383,"num_read_kb":71068,"num_write":934,"num_write_kb":54955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"256'784","reported_seq":2206,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.145118+0000","last_change":"2024-03-04T13:00:46.145118+0000","last_active":"2024-03-04T13:00:46.145118+0000","last_peered":"2024-03-04T13:00:46.145118+0000","last_clean":"2024-03-04T13:00:46.145118+0000","last_became_active":"2024-03-04T12:36:07.295530+0000","last_became_peered":"2024-03-04T12:36:07.295530+0000","last_unstale":"2024-03-04T13:00:46.145118+0000","last_undegraded":"2024-03-04T13:00:46.145118+0000","last_fullsized":"2024-03-04T13:00:46.145118+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'784","last_scrub_stamp":"2024-03-04T13:00:46.145023+0000","last_deep_scrub":"256'784","last_deep_scrub_stamp":"2024-03-04T13:00:46.145023+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.145023+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:19.897333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3415,"num_read_kb":3026,"num_write":1069,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":949,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"256'352","reported_seq":1816,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.055009+0000","last_change":"2024-03-04T13:00:46.055064+0000","last_active":"2024-03-04T13:00:46.055009+0000","last_peered":"2024-03-04T13:00:46.055009+0000","last_clean":"2024-03-04T13:00:46.055009+0000","last_became_active":"2024-03-04T12:36:07.298539+0000","last_became_peered":"2024-03-04T12:36:07.298539+0000","last_unstale":"2024-03-04T13:00:46.055009+0000","last_undegraded":"2024-03-04T13:00:46.055009+0000","last_fullsized":"2024-03-04T13:00:46.055009+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'352","last_scrub_stamp":"2024-03-04T13:00:46.054880+0000","last_deep_scrub":"256'352","last_deep_scrub_stamp":"2024-03-04T13:00:46.054880+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.054880+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:46.051533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1997,"num_read_kb":1912,"num_write":401,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"256'351","reported_seq":1051,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.243539+0000","last_change":"2024-03-04T13:00:58.243622+0000","last_active":"2024-03-04T13:00:58.243539+0000","last_peered":"2024-03-04T13:00:58.243539+0000","last_clean":"2024-03-04T13:00:58.243539+0000","last_became_active":"2024-03-04T12:36:05.295060+0000","last_became_peered":"2024-03-04T12:36:05.295060+0000","last_unstale":"2024-03-04T13:00:58.243539+0000","last_undegraded":"2024-03-04T13:00:58.243539+0000","last_fullsized":"2024-03-04T13:00:58.243539+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'351","last_scrub_stamp":"2024-03-04T13:00:58.243436+0000","last_deep_scrub":"256'351","last_deep_scrub_stamp":"2024-03-04T13:00:58.243436+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.243436+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:50:36.386385+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2255527,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":26330,"num_write":1306,"num_write_kb":36495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"256'328","reported_seq":1798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.335909+0000","last_change":"2024-03-04T13:00:45.335937+0000","last_active":"2024-03-04T13:00:45.335909+0000","last_peered":"2024-03-04T13:00:45.335909+0000","last_clean":"2024-03-04T13:00:45.335909+0000","last_became_active":"2024-03-04T12:36:07.300270+0000","last_became_peered":"2024-03-04T12:36:07.300270+0000","last_unstale":"2024-03-04T13:00:45.335909+0000","last_undegraded":"2024-03-04T13:00:45.335909+0000","last_fullsized":"2024-03-04T13:00:45.335909+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'328","last_scrub_stamp":"2024-03-04T13:00:45.335832+0000","last_deep_scrub":"256'328","last_deep_scrub_stamp":"2024-03-04T13:00:45.335832+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.335832+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:00:58.473041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2015,"num_read_kb":1950,"num_write":359,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"256'291","reported_seq":890,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.626384+0000","last_change":"2024-03-04T13:00:55.626435+0000","last_active":"2024-03-04T13:00:55.626384+0000","last_peered":"2024-03-04T13:00:55.626384+0000","last_clean":"2024-03-04T13:00:55.626384+0000","last_became_active":"2024-03-04T12:36:05.296621+0000","last_became_peered":"2024-03-04T12:36:05.296621+0000","last_unstale":"2024-03-04T13:00:55.626384+0000","last_undegraded":"2024-03-04T13:00:55.626384+0000","last_fullsized":"2024-03-04T13:00:55.626384+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'291","last_scrub_stamp":"2024-03-04T13:00:55.626282+0000","last_deep_scrub":"256'291","last_deep_scrub_stamp":"2024-03-04T13:00:55.626282+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.626282+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:06:30.482147+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":406,"num_read_kb":30709,"num_write":973,"num_write_kb":28664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"256'402","reported_seq":1893,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.197550+0000","last_change":"2024-03-04T13:00:51.197615+0000","last_active":"2024-03-04T13:00:51.197550+0000","last_peered":"2024-03-04T13:00:51.197550+0000","last_clean":"2024-03-04T13:00:51.197550+0000","last_became_active":"2024-03-04T12:36:07.293952+0000","last_became_peered":"2024-03-04T12:36:07.293952+0000","last_unstale":"2024-03-04T13:00:51.197550+0000","last_undegraded":"2024-03-04T13:00:51.197550+0000","last_fullsized":"2024-03-04T13:00:51.197550+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'402","last_scrub_stamp":"2024-03-04T13:00:51.197457+0000","last_deep_scrub":"256'402","last_deep_scrub_stamp":"2024-03-04T13:00:51.197457+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.197457+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:17.674412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2282,"num_read_kb":2164,"num_write":473,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"256'317","reported_seq":959,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.633990+0000","last_change":"2024-03-04T13:00:54.634054+0000","last_active":"2024-03-04T13:00:54.633990+0000","last_peered":"2024-03-04T13:00:54.633990+0000","last_clean":"2024-03-04T13:00:54.633990+0000","last_became_active":"2024-03-04T12:36:05.295832+0000","last_became_peered":"2024-03-04T12:36:05.295832+0000","last_unstale":"2024-03-04T13:00:54.633990+0000","last_undegraded":"2024-03-04T13:00:54.633990+0000","last_fullsized":"2024-03-04T13:00:54.633990+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'317","last_scrub_stamp":"2024-03-04T13:00:54.633894+0000","last_deep_scrub":"256'317","last_deep_scrub_stamp":"2024-03-04T13:00:54.633894+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.633894+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:47.966603+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456555,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":48295,"num_write":1243,"num_write_kb":38980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"256'624","reported_seq":2336,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.121043+0000","last_change":"2024-03-04T13:00:44.121093+0000","last_active":"2024-03-04T13:00:44.121043+0000","last_peered":"2024-03-04T13:00:44.121043+0000","last_clean":"2024-03-04T13:00:44.121043+0000","last_became_active":"2024-03-04T12:36:07.295798+0000","last_became_peered":"2024-03-04T12:36:07.295798+0000","last_unstale":"2024-03-04T13:00:44.121043+0000","last_undegraded":"2024-03-04T13:00:44.121043+0000","last_fullsized":"2024-03-04T13:00:44.121043+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'624","last_scrub_stamp":"2024-03-04T13:00:44.120934+0000","last_deep_scrub":"256'624","last_deep_scrub_stamp":"2024-03-04T13:00:44.120934+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.120934+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":600,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:42:13.736456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3253,"num_read_kb":2977,"num_write":842,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2631,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"256'354","reported_seq":970,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.931804+0000","last_change":"2024-03-04T13:01:01.931851+0000","last_active":"2024-03-04T13:01:01.931804+0000","last_peered":"2024-03-04T13:01:01.931804+0000","last_clean":"2024-03-04T13:01:01.931804+0000","last_became_active":"2024-03-04T12:36:05.291477+0000","last_became_peered":"2024-03-04T12:36:05.291477+0000","last_unstale":"2024-03-04T13:01:01.931804+0000","last_undegraded":"2024-03-04T13:01:01.931804+0000","last_fullsized":"2024-03-04T13:01:01.931804+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'354","last_scrub_stamp":"2024-03-04T13:01:01.931733+0000","last_deep_scrub":"256'354","last_deep_scrub_stamp":"2024-03-04T13:01:01.931733+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.931733+0000","objects_scrubbed":10,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:19:34.106272+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730225,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":474,"num_read_kb":10302,"num_write":1224,"num_write_kb":24769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"256'368","reported_seq":1772,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.124614+0000","last_change":"2024-03-04T13:00:42.124642+0000","last_active":"2024-03-04T13:00:42.124614+0000","last_peered":"2024-03-04T13:00:42.124614+0000","last_clean":"2024-03-04T13:00:42.124614+0000","last_became_active":"2024-03-04T12:36:07.290104+0000","last_became_peered":"2024-03-04T12:36:07.290104+0000","last_unstale":"2024-03-04T13:00:42.124614+0000","last_undegraded":"2024-03-04T13:00:42.124614+0000","last_fullsized":"2024-03-04T13:00:42.124614+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'368","last_scrub_stamp":"2024-03-04T13:00:42.124516+0000","last_deep_scrub":"256'368","last_deep_scrub_stamp":"2024-03-04T13:00:42.124516+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.124516+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:34:33.903099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2031,"num_read_kb":1912,"num_write":446,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"256'321","reported_seq":947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:13.426871+0000","last_change":"2024-03-04T13:01:13.426949+0000","last_active":"2024-03-04T13:01:13.426871+0000","last_peered":"2024-03-04T13:01:13.426871+0000","last_clean":"2024-03-04T13:01:13.426871+0000","last_became_active":"2024-03-04T12:36:05.291096+0000","last_became_peered":"2024-03-04T12:36:05.291096+0000","last_unstale":"2024-03-04T13:01:13.426871+0000","last_undegraded":"2024-03-04T13:01:13.426871+0000","last_fullsized":"2024-03-04T13:01:13.426871+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'321","last_scrub_stamp":"2024-03-04T13:01:13.426757+0000","last_deep_scrub":"256'321","last_deep_scrub_stamp":"2024-03-04T13:01:13.426757+0000","last_clean_scrub_stamp":"2024-03-04T13:01:13.426757+0000","objects_scrubbed":12,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:52.328863+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":471,"num_read_kb":17846,"num_write":1202,"num_write_kb":33765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"256'454","reported_seq":2131,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.124043+0000","last_change":"2024-03-04T13:00:42.124112+0000","last_active":"2024-03-04T13:00:42.124043+0000","last_peered":"2024-03-04T13:00:42.124043+0000","last_clean":"2024-03-04T13:00:42.124043+0000","last_became_active":"2024-03-04T12:36:07.297989+0000","last_became_peered":"2024-03-04T12:36:07.297989+0000","last_unstale":"2024-03-04T13:00:42.124043+0000","last_undegraded":"2024-03-04T13:00:42.124043+0000","last_fullsized":"2024-03-04T13:00:42.124043+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'454","last_scrub_stamp":"2024-03-04T13:00:42.123913+0000","last_deep_scrub":"256'454","last_deep_scrub_stamp":"2024-03-04T13:00:42.123913+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.123913+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:33:43.663219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2700,"num_read_kb":2549,"num_write":550,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4300,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"256'370","reported_seq":1043,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:04.469462+0000","last_change":"2024-03-04T13:01:04.469538+0000","last_active":"2024-03-04T13:01:04.469462+0000","last_peered":"2024-03-04T13:01:04.469462+0000","last_clean":"2024-03-04T13:01:04.469462+0000","last_became_active":"2024-03-04T12:36:05.280944+0000","last_became_peered":"2024-03-04T12:36:05.280944+0000","last_unstale":"2024-03-04T13:01:04.469462+0000","last_undegraded":"2024-03-04T13:01:04.469462+0000","last_fullsized":"2024-03-04T13:01:04.469462+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'370","last_scrub_stamp":"2024-03-04T13:01:04.469352+0000","last_deep_scrub":"256'370","last_deep_scrub_stamp":"2024-03-04T13:01:04.469352+0000","last_clean_scrub_stamp":"2024-03-04T13:01:04.469352+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:44.577427+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290369,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":724,"num_read_kb":21552,"num_write":1199,"num_write_kb":33499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"256'83","reported_seq":569,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.117129+0000","last_change":"2024-03-04T13:00:27.117158+0000","last_active":"2024-03-04T13:00:27.117129+0000","last_peered":"2024-03-04T13:00:27.117129+0000","last_clean":"2024-03-04T13:00:27.117129+0000","last_became_active":"2024-03-04T12:36:15.356314+0000","last_became_peered":"2024-03-04T12:36:15.356314+0000","last_unstale":"2024-03-04T13:00:27.117129+0000","last_undegraded":"2024-03-04T13:00:27.117129+0000","last_fullsized":"2024-03-04T13:00:27.117129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'83","last_scrub_stamp":"2024-03-04T13:00:27.117037+0000","last_deep_scrub":"256'83","last_deep_scrub_stamp":"2024-03-04T13:00:27.117037+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.117037+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:45.219404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":197,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"256'1097","reported_seq":2705,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.629069+0000","last_change":"2024-03-04T13:00:52.629098+0000","last_active":"2024-03-04T13:00:52.629069+0000","last_peered":"2024-03-04T13:00:52.629069+0000","last_clean":"2024-03-04T13:00:52.629069+0000","last_became_active":"2024-03-04T12:36:07.297879+0000","last_became_peered":"2024-03-04T12:36:07.297879+0000","last_unstale":"2024-03-04T13:00:52.629069+0000","last_undegraded":"2024-03-04T13:00:52.629069+0000","last_fullsized":"2024-03-04T13:00:52.629069+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1097","last_scrub_stamp":"2024-03-04T13:00:52.628982+0000","last_deep_scrub":"256'1097","last_deep_scrub_stamp":"2024-03-04T13:00:52.628982+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.628982+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":1000,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:51.871167+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4860,"num_read_kb":4288,"num_write":1505,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"256'392","reported_seq":1009,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.323846+0000","last_change":"2024-03-04T13:00:54.323947+0000","last_active":"2024-03-04T13:00:54.323846+0000","last_peered":"2024-03-04T13:00:54.323846+0000","last_clean":"2024-03-04T13:00:54.323846+0000","last_became_active":"2024-03-04T12:36:05.296939+0000","last_became_peered":"2024-03-04T12:36:05.296939+0000","last_unstale":"2024-03-04T13:00:54.323846+0000","last_undegraded":"2024-03-04T13:00:54.323846+0000","last_fullsized":"2024-03-04T13:00:54.323846+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'392","last_scrub_stamp":"2024-03-04T13:00:54.323765+0000","last_deep_scrub":"256'392","last_deep_scrub_stamp":"2024-03-04T13:00:54.323765+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.323765+0000","objects_scrubbed":15,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:04.952080+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10962332,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":473,"num_read_kb":33218,"num_write":1212,"num_write_kb":53558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.274057+0000","last_change":"2024-03-04T13:00:46.274078+0000","last_active":"2024-03-04T13:00:46.274057+0000","last_peered":"2024-03-04T13:00:46.274057+0000","last_clean":"2024-03-04T13:00:46.274057+0000","last_became_active":"2024-03-04T12:36:09.314065+0000","last_became_peered":"2024-03-04T12:36:09.314065+0000","last_unstale":"2024-03-04T13:00:46.274057+0000","last_undegraded":"2024-03-04T13:00:46.274057+0000","last_fullsized":"2024-03-04T13:00:46.274057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:46.273949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:46.273949+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.273949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:13:31.643800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"256'288","reported_seq":866,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.434869+0000","last_change":"2024-03-04T13:00:58.434906+0000","last_active":"2024-03-04T13:00:58.434869+0000","last_peered":"2024-03-04T13:00:58.434869+0000","last_clean":"2024-03-04T13:00:58.434869+0000","last_became_active":"2024-03-04T12:36:11.325995+0000","last_became_peered":"2024-03-04T12:36:11.325995+0000","last_unstale":"2024-03-04T13:00:58.434869+0000","last_undegraded":"2024-03-04T13:00:58.434869+0000","last_fullsized":"2024-03-04T13:00:58.434869+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'288","last_scrub_stamp":"2024-03-04T13:00:58.434770+0000","last_deep_scrub":"256'288","last_deep_scrub_stamp":"2024-03-04T13:00:58.434770+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.434770+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:11.681361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43297,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1002,"num_write":366,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.250619+0000","last_change":"2024-03-04T13:00:38.250645+0000","last_active":"2024-03-04T13:00:38.250619+0000","last_peered":"2024-03-04T13:00:38.250619+0000","last_clean":"2024-03-04T13:00:38.250619+0000","last_became_active":"2024-03-04T12:36:13.339305+0000","last_became_peered":"2024-03-04T12:36:13.339305+0000","last_unstale":"2024-03-04T13:00:38.250619+0000","last_undegraded":"2024-03-04T13:00:38.250619+0000","last_fullsized":"2024-03-04T13:00:38.250619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:38.250535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:38.250535+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.250535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:52.534010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"256'2371","reported_seq":4152,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.436326+0000","last_change":"2024-03-04T13:00:35.436362+0000","last_active":"2024-03-04T13:00:35.436326+0000","last_peered":"2024-03-04T13:00:35.436326+0000","last_clean":"2024-03-04T13:00:35.436326+0000","last_became_active":"2024-03-04T12:36:15.362434+0000","last_became_peered":"2024-03-04T12:36:15.362434+0000","last_unstale":"2024-03-04T13:00:35.436326+0000","last_undegraded":"2024-03-04T13:00:35.436326+0000","last_fullsized":"2024-03-04T13:00:35.436326+0000","mapping_epoch":30,"log_start":"256'2300","ondisk_log_start":"256'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2371","last_scrub_stamp":"2024-03-04T13:00:35.436238+0000","last_deep_scrub":"256'2371","last_deep_scrub_stamp":"2024-03-04T13:00:35.436238+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.436238+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":2300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:04.019436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5876,"num_read_kb":5881,"num_write":4713,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"256'831","reported_seq":2413,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.250235+0000","last_change":"2024-03-04T13:00:49.250261+0000","last_active":"2024-03-04T13:00:49.250235+0000","last_peered":"2024-03-04T13:00:49.250235+0000","last_clean":"2024-03-04T13:00:49.250235+0000","last_became_active":"2024-03-04T12:36:07.295522+0000","last_became_peered":"2024-03-04T12:36:07.295522+0000","last_unstale":"2024-03-04T13:00:49.250235+0000","last_undegraded":"2024-03-04T13:00:49.250235+0000","last_fullsized":"2024-03-04T13:00:49.250235+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'831","last_scrub_stamp":"2024-03-04T13:00:49.250152+0000","last_deep_scrub":"256'831","last_deep_scrub_stamp":"2024-03-04T13:00:49.250152+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.250152+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:44.066625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3820,"num_read_kb":3411,"num_write":1118,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"256'365","reported_seq":989,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:09.387831+0000","last_change":"2024-03-04T13:01:09.387882+0000","last_active":"2024-03-04T13:01:09.387831+0000","last_peered":"2024-03-04T13:01:09.387831+0000","last_clean":"2024-03-04T13:01:09.387831+0000","last_became_active":"2024-03-04T12:36:05.288208+0000","last_became_peered":"2024-03-04T12:36:05.288208+0000","last_unstale":"2024-03-04T13:01:09.387831+0000","last_undegraded":"2024-03-04T13:01:09.387831+0000","last_fullsized":"2024-03-04T13:01:09.387831+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'365","last_scrub_stamp":"2024-03-04T13:01:09.387728+0000","last_deep_scrub":"256'365","last_deep_scrub_stamp":"2024-03-04T13:01:09.387728+0000","last_clean_scrub_stamp":"2024-03-04T13:01:09.387728+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:32:00.304925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":34780,"num_write":1176,"num_write_kb":45508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:04.538773+0000","last_change":"2024-03-04T13:01:04.538810+0000","last_active":"2024-03-04T13:01:04.538773+0000","last_peered":"2024-03-04T13:01:04.538773+0000","last_clean":"2024-03-04T13:01:04.538773+0000","last_became_active":"2024-03-04T12:36:09.309583+0000","last_became_peered":"2024-03-04T12:36:09.309583+0000","last_unstale":"2024-03-04T13:01:04.538773+0000","last_undegraded":"2024-03-04T13:01:04.538773+0000","last_fullsized":"2024-03-04T13:01:04.538773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:04.538653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:04.538653+0000","last_clean_scrub_stamp":"2024-03-04T13:01:04.538653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:28:41.302153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"256'74","reported_seq":583,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.107034+0000","last_change":"2024-03-04T13:00:38.107070+0000","last_active":"2024-03-04T13:00:38.107034+0000","last_peered":"2024-03-04T13:00:38.107034+0000","last_clean":"2024-03-04T13:00:38.107034+0000","last_became_active":"2024-03-04T12:36:11.324761+0000","last_became_peered":"2024-03-04T12:36:11.324761+0000","last_unstale":"2024-03-04T13:00:38.107034+0000","last_undegraded":"2024-03-04T13:00:38.107034+0000","last_fullsized":"2024-03-04T13:00:38.107034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'74","last_scrub_stamp":"2024-03-04T13:00:38.106947+0000","last_deep_scrub":"256'74","last_deep_scrub_stamp":"2024-03-04T13:00:38.106947+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.106947+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:56:51.502742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":50,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.118375+0000","last_change":"2024-03-04T13:00:33.118401+0000","last_active":"2024-03-04T13:00:33.118375+0000","last_peered":"2024-03-04T13:00:33.118375+0000","last_clean":"2024-03-04T13:00:33.118375+0000","last_became_active":"2024-03-04T12:36:13.343072+0000","last_became_peered":"2024-03-04T12:36:13.343072+0000","last_unstale":"2024-03-04T13:00:33.118375+0000","last_undegraded":"2024-03-04T13:00:33.118375+0000","last_fullsized":"2024-03-04T13:00:33.118375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:33.118287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:33.118287+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.118287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:36:41.186234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"256'104","reported_seq":600,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.614323+0000","last_change":"2024-03-04T13:00:32.614323+0000","last_active":"2024-03-04T13:00:32.614323+0000","last_peered":"2024-03-04T13:00:32.614323+0000","last_clean":"2024-03-04T13:00:32.614323+0000","last_became_active":"2024-03-04T12:36:15.362354+0000","last_became_peered":"2024-03-04T12:36:15.362354+0000","last_unstale":"2024-03-04T13:00:32.614323+0000","last_undegraded":"2024-03-04T13:00:32.614323+0000","last_fullsized":"2024-03-04T13:00:32.614323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'104","last_scrub_stamp":"2024-03-04T13:00:32.614142+0000","last_deep_scrub":"256'104","last_deep_scrub_stamp":"2024-03-04T13:00:32.614142+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.614142+0000","objects_scrubbed":6,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:02:52.498658+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":121,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"256'345","reported_seq":1734,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.405192+0000","last_change":"2024-03-04T13:00:59.405224+0000","last_active":"2024-03-04T13:00:59.405192+0000","last_peered":"2024-03-04T13:00:59.405192+0000","last_clean":"2024-03-04T13:00:59.405192+0000","last_became_active":"2024-03-04T12:36:07.294328+0000","last_became_peered":"2024-03-04T12:36:07.294328+0000","last_unstale":"2024-03-04T13:00:59.405192+0000","last_undegraded":"2024-03-04T13:00:59.405192+0000","last_fullsized":"2024-03-04T13:00:59.405192+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'345","last_scrub_stamp":"2024-03-04T13:00:59.405065+0000","last_deep_scrub":"256'345","last_deep_scrub_stamp":"2024-03-04T13:00:59.405065+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.405065+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:49.403720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1913,"num_read_kb":1818,"num_write":399,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"256'289","reported_seq":911,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:08.261198+0000","last_change":"2024-03-04T13:01:08.261256+0000","last_active":"2024-03-04T13:01:08.261198+0000","last_peered":"2024-03-04T13:01:08.261198+0000","last_clean":"2024-03-04T13:01:08.261198+0000","last_became_active":"2024-03-04T12:36:05.291366+0000","last_became_peered":"2024-03-04T12:36:05.291366+0000","last_unstale":"2024-03-04T13:01:08.261198+0000","last_undegraded":"2024-03-04T13:01:08.261198+0000","last_fullsized":"2024-03-04T13:01:08.261198+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'289","last_scrub_stamp":"2024-03-04T13:01:08.261112+0000","last_deep_scrub":"256'289","last_deep_scrub_stamp":"2024-03-04T13:01:08.261112+0000","last_clean_scrub_stamp":"2024-03-04T13:01:08.261112+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:04:46.708458+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":749491,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":10592,"num_write":1118,"num_write_kb":21097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:06.492503+0000","last_change":"2024-03-04T13:01:06.492544+0000","last_active":"2024-03-04T13:01:06.492503+0000","last_peered":"2024-03-04T13:01:06.492503+0000","last_clean":"2024-03-04T13:01:06.492503+0000","last_became_active":"2024-03-04T12:36:09.309749+0000","last_became_peered":"2024-03-04T12:36:09.309749+0000","last_unstale":"2024-03-04T13:01:06.492503+0000","last_undegraded":"2024-03-04T13:01:06.492503+0000","last_fullsized":"2024-03-04T13:01:06.492503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:06.492410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:06.492410+0000","last_clean_scrub_stamp":"2024-03-04T13:01:06.492410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:06:12.874216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"256'86","reported_seq":598,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.298417+0000","last_change":"2024-03-04T13:00:28.298481+0000","last_active":"2024-03-04T13:00:28.298417+0000","last_peered":"2024-03-04T13:00:28.298417+0000","last_clean":"2024-03-04T13:00:28.298417+0000","last_became_active":"2024-03-04T12:36:11.324127+0000","last_became_peered":"2024-03-04T12:36:11.324127+0000","last_unstale":"2024-03-04T13:00:28.298417+0000","last_undegraded":"2024-03-04T13:00:28.298417+0000","last_fullsized":"2024-03-04T13:00:28.298417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'86","last_scrub_stamp":"2024-03-04T13:00:28.298332+0000","last_deep_scrub":"256'86","last_deep_scrub_stamp":"2024-03-04T13:00:28.298332+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.298332+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:29.180417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"256'510","reported_seq":1468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.298406+0000","last_change":"2024-03-04T13:00:41.298440+0000","last_active":"2024-03-04T13:00:41.298406+0000","last_peered":"2024-03-04T13:00:41.298406+0000","last_clean":"2024-03-04T13:00:41.298406+0000","last_became_active":"2024-03-04T12:36:13.338070+0000","last_became_peered":"2024-03-04T12:36:13.338070+0000","last_unstale":"2024-03-04T13:00:41.298406+0000","last_undegraded":"2024-03-04T13:00:41.298406+0000","last_fullsized":"2024-03-04T13:00:41.298406+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'510","last_scrub_stamp":"2024-03-04T13:00:41.298306+0000","last_deep_scrub":"256'510","last_deep_scrub_stamp":"2024-03-04T13:00:41.298306+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.298306+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:35.703293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"256'104","reported_seq":583,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.068390+0000","last_change":"2024-03-04T13:00:26.068390+0000","last_active":"2024-03-04T13:00:26.068390+0000","last_peered":"2024-03-04T13:00:26.068390+0000","last_clean":"2024-03-04T13:00:26.068390+0000","last_became_active":"2024-03-04T12:36:15.356417+0000","last_became_peered":"2024-03-04T12:36:15.356417+0000","last_unstale":"2024-03-04T13:00:26.068390+0000","last_undegraded":"2024-03-04T13:00:26.068390+0000","last_fullsized":"2024-03-04T13:00:26.068390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'104","last_scrub_stamp":"2024-03-04T13:00:26.068269+0000","last_deep_scrub":"256'104","last_deep_scrub_stamp":"2024-03-04T13:00:26.068269+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.068269+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:57.908639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"256'686","reported_seq":2120,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.631942+0000","last_change":"2024-03-04T13:00:53.631972+0000","last_active":"2024-03-04T13:00:53.631942+0000","last_peered":"2024-03-04T13:00:53.631942+0000","last_clean":"2024-03-04T13:00:53.631942+0000","last_became_active":"2024-03-04T12:36:07.293493+0000","last_became_peered":"2024-03-04T12:36:07.293493+0000","last_unstale":"2024-03-04T13:00:53.631942+0000","last_undegraded":"2024-03-04T13:00:53.631942+0000","last_fullsized":"2024-03-04T13:00:53.631942+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'686","last_scrub_stamp":"2024-03-04T13:00:53.631854+0000","last_deep_scrub":"256'686","last_deep_scrub_stamp":"2024-03-04T13:00:53.631854+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.631854+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:48:17.135224+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3120,"num_read_kb":2817,"num_write":901,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":556,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"256'397","reported_seq":1026,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.766966+0000","last_change":"2024-03-04T13:00:50.767009+0000","last_active":"2024-03-04T13:00:50.766966+0000","last_peered":"2024-03-04T13:00:50.766966+0000","last_clean":"2024-03-04T13:00:50.766966+0000","last_became_active":"2024-03-04T12:36:05.283477+0000","last_became_peered":"2024-03-04T12:36:05.283477+0000","last_unstale":"2024-03-04T13:00:50.766966+0000","last_undegraded":"2024-03-04T13:00:50.766966+0000","last_fullsized":"2024-03-04T13:00:50.766966+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'397","last_scrub_stamp":"2024-03-04T13:00:50.766881+0000","last_deep_scrub":"256'397","last_deep_scrub_stamp":"2024-03-04T13:00:50.766881+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.766881+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:19.484584+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048764,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":32578,"num_write":1458,"num_write_kb":46757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.266816+0000","last_change":"2024-03-04T13:00:48.266839+0000","last_active":"2024-03-04T13:00:48.266816+0000","last_peered":"2024-03-04T13:00:48.266816+0000","last_clean":"2024-03-04T13:00:48.266816+0000","last_became_active":"2024-03-04T12:36:09.314215+0000","last_became_peered":"2024-03-04T12:36:09.314215+0000","last_unstale":"2024-03-04T13:00:48.266816+0000","last_undegraded":"2024-03-04T13:00:48.266816+0000","last_fullsized":"2024-03-04T13:00:48.266816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:48.266727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:48.266727+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.266727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:37:57.215196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"256'250","reported_seq":802,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.312866+0000","last_change":"2024-03-04T13:00:42.312905+0000","last_active":"2024-03-04T13:00:42.312866+0000","last_peered":"2024-03-04T13:00:42.312866+0000","last_clean":"2024-03-04T13:00:42.312866+0000","last_became_active":"2024-03-04T12:36:11.956371+0000","last_became_peered":"2024-03-04T12:36:11.956371+0000","last_unstale":"2024-03-04T13:00:42.312866+0000","last_undegraded":"2024-03-04T13:00:42.312866+0000","last_fullsized":"2024-03-04T13:00:42.312866+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'250","last_scrub_stamp":"2024-03-04T13:00:42.312765+0000","last_deep_scrub":"256'250","last_deep_scrub_stamp":"2024-03-04T13:00:42.312765+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.312765+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:09:09.690974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44142,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1035,"num_write":354,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"256'535","reported_seq":3345,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.699751+0000","last_change":"2024-03-04T13:00:41.699839+0000","last_active":"2024-03-04T13:00:41.699751+0000","last_peered":"2024-03-04T13:00:41.699751+0000","last_clean":"2024-03-04T13:00:41.699751+0000","last_became_active":"2024-03-04T12:36:13.344498+0000","last_became_peered":"2024-03-04T12:36:13.344498+0000","last_unstale":"2024-03-04T13:00:41.699751+0000","last_undegraded":"2024-03-04T13:00:41.699751+0000","last_fullsized":"2024-03-04T13:00:41.699751+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'535","last_scrub_stamp":"2024-03-04T13:00:41.699639+0000","last_deep_scrub":"256'535","last_deep_scrub_stamp":"2024-03-04T13:00:41.699639+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.699639+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:07:21.038160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"256'769","reported_seq":2308,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.349317+0000","last_change":"2024-03-04T13:00:42.349344+0000","last_active":"2024-03-04T13:00:42.349317+0000","last_peered":"2024-03-04T13:00:42.349317+0000","last_clean":"2024-03-04T13:00:42.349317+0000","last_became_active":"2024-03-04T12:36:07.297320+0000","last_became_peered":"2024-03-04T12:36:07.297320+0000","last_unstale":"2024-03-04T13:00:42.349317+0000","last_undegraded":"2024-03-04T13:00:42.349317+0000","last_fullsized":"2024-03-04T13:00:42.349317+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'769","last_scrub_stamp":"2024-03-04T13:00:42.349233+0000","last_deep_scrub":"256'769","last_deep_scrub_stamp":"2024-03-04T13:00:42.349233+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.349233+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:41.422432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3660,"num_read_kb":3298,"num_write":1023,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"256'397","reported_seq":1069,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.269712+0000","last_change":"2024-03-04T13:01:00.269775+0000","last_active":"2024-03-04T13:01:00.269712+0000","last_peered":"2024-03-04T13:01:00.269712+0000","last_clean":"2024-03-04T13:01:00.269712+0000","last_became_active":"2024-03-04T12:36:05.293882+0000","last_became_peered":"2024-03-04T12:36:05.293882+0000","last_unstale":"2024-03-04T13:01:00.269712+0000","last_undegraded":"2024-03-04T13:01:00.269712+0000","last_fullsized":"2024-03-04T13:01:00.269712+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'397","last_scrub_stamp":"2024-03-04T13:01:00.269616+0000","last_deep_scrub":"256'397","last_deep_scrub_stamp":"2024-03-04T13:01:00.269616+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.269616+0000","objects_scrubbed":11,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:31:11.933523+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5179671,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":578,"num_read_kb":60173,"num_write":1456,"num_write_kb":40158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.289919+0000","last_change":"2024-03-04T13:00:53.289944+0000","last_active":"2024-03-04T13:00:53.289919+0000","last_peered":"2024-03-04T13:00:53.289919+0000","last_clean":"2024-03-04T13:00:53.289919+0000","last_became_active":"2024-03-04T12:36:09.308538+0000","last_became_peered":"2024-03-04T12:36:09.308538+0000","last_unstale":"2024-03-04T13:00:53.289919+0000","last_undegraded":"2024-03-04T13:00:53.289919+0000","last_fullsized":"2024-03-04T13:00:53.289919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:53.289830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:53.289830+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.289830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:33.037810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"256'321","reported_seq":901,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.391819+0000","last_change":"2024-03-04T13:00:39.391867+0000","last_active":"2024-03-04T13:00:39.391819+0000","last_peered":"2024-03-04T13:00:39.391819+0000","last_clean":"2024-03-04T13:00:39.391819+0000","last_became_active":"2024-03-04T12:36:11.954597+0000","last_became_peered":"2024-03-04T12:36:11.954597+0000","last_unstale":"2024-03-04T13:00:39.391819+0000","last_undegraded":"2024-03-04T13:00:39.391819+0000","last_fullsized":"2024-03-04T13:00:39.391819+0000","mapping_epoch":26,"log_start":"256'300","ondisk_log_start":"256'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'321","last_scrub_stamp":"2024-03-04T13:00:39.391733+0000","last_deep_scrub":"256'321","last_deep_scrub_stamp":"2024-03-04T13:00:39.391733+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.391733+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:46.694056+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51312,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":526,"num_read_kb":1169,"num_write":422,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.400019+0000","last_change":"2024-03-04T13:00:50.400019+0000","last_active":"2024-03-04T13:00:50.400019+0000","last_peered":"2024-03-04T13:00:50.400019+0000","last_clean":"2024-03-04T13:00:50.400019+0000","last_became_active":"2024-03-04T12:36:13.339890+0000","last_became_peered":"2024-03-04T12:36:13.339890+0000","last_unstale":"2024-03-04T13:00:50.400019+0000","last_undegraded":"2024-03-04T13:00:50.400019+0000","last_fullsized":"2024-03-04T13:00:50.400019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:50.399907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:50.399907+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.399907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:19:11.128424+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"256'507","reported_seq":1301,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.396173+0000","last_change":"2024-03-04T13:00:33.396173+0000","last_active":"2024-03-04T13:00:33.396173+0000","last_peered":"2024-03-04T13:00:33.396173+0000","last_clean":"2024-03-04T13:00:33.396173+0000","last_became_active":"2024-03-04T12:36:15.362355+0000","last_became_peered":"2024-03-04T12:36:15.362355+0000","last_unstale":"2024-03-04T13:00:33.396173+0000","last_undegraded":"2024-03-04T13:00:33.396173+0000","last_fullsized":"2024-03-04T13:00:33.396173+0000","mapping_epoch":30,"log_start":"250'400","ondisk_log_start":"250'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'507","last_scrub_stamp":"2024-03-04T13:00:33.396041+0000","last_deep_scrub":"256'507","last_deep_scrub_stamp":"2024-03-04T13:00:33.396041+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.396041+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:55.241746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1234,"num_read_kb":1233,"num_write":1042,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"256'407","reported_seq":1926,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.039724+0000","last_change":"2024-03-04T13:00:57.039754+0000","last_active":"2024-03-04T13:00:57.039724+0000","last_peered":"2024-03-04T13:00:57.039724+0000","last_clean":"2024-03-04T13:00:57.039724+0000","last_became_active":"2024-03-04T12:36:07.291507+0000","last_became_peered":"2024-03-04T12:36:07.291507+0000","last_unstale":"2024-03-04T13:00:57.039724+0000","last_undegraded":"2024-03-04T13:00:57.039724+0000","last_fullsized":"2024-03-04T13:00:57.039724+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'407","last_scrub_stamp":"2024-03-04T13:00:57.039631+0000","last_deep_scrub":"256'407","last_deep_scrub_stamp":"2024-03-04T13:00:57.039631+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.039631+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:22.285100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2180,"num_read_kb":2067,"num_write":478,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"256'317","reported_seq":950,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:04.210002+0000","last_change":"2024-03-04T13:01:04.210048+0000","last_active":"2024-03-04T13:01:04.210002+0000","last_peered":"2024-03-04T13:01:04.210002+0000","last_clean":"2024-03-04T13:01:04.210002+0000","last_became_active":"2024-03-04T12:36:05.286438+0000","last_became_peered":"2024-03-04T12:36:05.286438+0000","last_unstale":"2024-03-04T13:01:04.210002+0000","last_undegraded":"2024-03-04T13:01:04.210002+0000","last_fullsized":"2024-03-04T13:01:04.210002+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'317","last_scrub_stamp":"2024-03-04T13:01:04.209926+0000","last_deep_scrub":"256'317","last_deep_scrub_stamp":"2024-03-04T13:01:04.209926+0000","last_clean_scrub_stamp":"2024-03-04T13:01:04.209926+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:29.114168+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21141,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":18655,"num_write":1207,"num_write_kb":23251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.325802+0000","last_change":"2024-03-04T13:00:34.325853+0000","last_active":"2024-03-04T13:00:34.325802+0000","last_peered":"2024-03-04T13:00:34.325802+0000","last_clean":"2024-03-04T13:00:34.325802+0000","last_became_active":"2024-03-04T12:36:09.304561+0000","last_became_peered":"2024-03-04T12:36:09.304561+0000","last_unstale":"2024-03-04T13:00:34.325802+0000","last_undegraded":"2024-03-04T13:00:34.325802+0000","last_fullsized":"2024-03-04T13:00:34.325802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:34.325699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:34.325699+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.325699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:45:29.332360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"256'273","reported_seq":824,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.676860+0000","last_change":"2024-03-04T13:00:51.676860+0000","last_active":"2024-03-04T13:00:51.676860+0000","last_peered":"2024-03-04T13:00:51.676860+0000","last_clean":"2024-03-04T13:00:51.676860+0000","last_became_active":"2024-03-04T12:36:11.324147+0000","last_became_peered":"2024-03-04T12:36:11.324147+0000","last_unstale":"2024-03-04T13:00:51.676860+0000","last_undegraded":"2024-03-04T13:00:51.676860+0000","last_fullsized":"2024-03-04T13:00:51.676860+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'273","last_scrub_stamp":"2024-03-04T13:00:51.676726+0000","last_deep_scrub":"256'273","last_deep_scrub_stamp":"2024-03-04T13:00:51.676726+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.676726+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:24:30.068280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":439,"num_read_kb":1077,"num_write":366,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.746156+0000","last_change":"2024-03-04T13:00:39.746181+0000","last_active":"2024-03-04T13:00:39.746156+0000","last_peered":"2024-03-04T13:00:39.746156+0000","last_clean":"2024-03-04T13:00:39.746156+0000","last_became_active":"2024-03-04T12:36:13.346077+0000","last_became_peered":"2024-03-04T12:36:13.346077+0000","last_unstale":"2024-03-04T13:00:39.746156+0000","last_undegraded":"2024-03-04T13:00:39.746156+0000","last_fullsized":"2024-03-04T13:00:39.746156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.746057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.746057+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.746057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:38.016628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"256'124","reported_seq":613,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.742308+0000","last_change":"2024-03-04T13:00:42.742308+0000","last_active":"2024-03-04T13:00:42.742308+0000","last_peered":"2024-03-04T13:00:42.742308+0000","last_clean":"2024-03-04T13:00:42.742308+0000","last_became_active":"2024-03-04T12:36:15.359839+0000","last_became_peered":"2024-03-04T12:36:15.359839+0000","last_unstale":"2024-03-04T13:00:42.742308+0000","last_undegraded":"2024-03-04T13:00:42.742308+0000","last_fullsized":"2024-03-04T13:00:42.742308+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'124","last_scrub_stamp":"2024-03-04T13:00:42.742163+0000","last_deep_scrub":"256'124","last_deep_scrub_stamp":"2024-03-04T13:00:42.742163+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.742163+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:04.700070+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":144,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"256'819","reported_seq":2272,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.622699+0000","last_change":"2024-03-04T13:00:56.622760+0000","last_active":"2024-03-04T13:00:56.622699+0000","last_peered":"2024-03-04T13:00:56.622699+0000","last_clean":"2024-03-04T13:00:56.622699+0000","last_became_active":"2024-03-04T12:36:40.394812+0000","last_became_peered":"2024-03-04T12:36:40.394812+0000","last_unstale":"2024-03-04T13:00:56.622699+0000","last_undegraded":"2024-03-04T13:00:56.622699+0000","last_fullsized":"2024-03-04T13:00:56.622699+0000","mapping_epoch":33,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'819","last_scrub_stamp":"2024-03-04T13:00:56.622590+0000","last_deep_scrub":"256'819","last_deep_scrub_stamp":"2024-03-04T13:00:56.622590+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.622590+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:17:25.575809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3628,"num_read_kb":3191,"num_write":1140,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"256'344","reported_seq":1003,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.266767+0000","last_change":"2024-03-04T13:00:52.266813+0000","last_active":"2024-03-04T13:00:52.266767+0000","last_peered":"2024-03-04T13:00:52.266767+0000","last_clean":"2024-03-04T13:00:52.266767+0000","last_became_active":"2024-03-04T12:36:05.297486+0000","last_became_peered":"2024-03-04T12:36:05.297486+0000","last_unstale":"2024-03-04T13:00:52.266767+0000","last_undegraded":"2024-03-04T13:00:52.266767+0000","last_fullsized":"2024-03-04T13:00:52.266767+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'344","last_scrub_stamp":"2024-03-04T13:00:52.266678+0000","last_deep_scrub":"256'344","last_deep_scrub_stamp":"2024-03-04T13:00:52.266678+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.266678+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:45:26.194961+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":44586,"num_write":1373,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"256'6","reported_seq":798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.257746+0000","last_change":"2024-03-04T13:00:38.257746+0000","last_active":"2024-03-04T13:00:38.257746+0000","last_peered":"2024-03-04T13:00:38.257746+0000","last_clean":"2024-03-04T13:00:38.257746+0000","last_became_active":"2024-03-04T12:36:09.303280+0000","last_became_peered":"2024-03-04T12:36:09.303280+0000","last_unstale":"2024-03-04T13:00:38.257746+0000","last_undegraded":"2024-03-04T13:00:38.257746+0000","last_fullsized":"2024-03-04T13:00:38.257746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:38.257611+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:38.257611+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.257611+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:40.037724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":467,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"256'292","reported_seq":854,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.268985+0000","last_change":"2024-03-04T13:00:59.269045+0000","last_active":"2024-03-04T13:00:59.268985+0000","last_peered":"2024-03-04T13:00:59.268985+0000","last_clean":"2024-03-04T13:00:59.268985+0000","last_became_active":"2024-03-04T12:36:11.325109+0000","last_became_peered":"2024-03-04T12:36:11.325109+0000","last_unstale":"2024-03-04T13:00:59.268985+0000","last_undegraded":"2024-03-04T13:00:59.268985+0000","last_fullsized":"2024-03-04T13:00:59.268985+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'292","last_scrub_stamp":"2024-03-04T13:00:59.268915+0000","last_deep_scrub":"256'292","last_deep_scrub_stamp":"2024-03-04T13:00:59.268915+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.268915+0000","objects_scrubbed":8,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:10.436302+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48663,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":476,"num_read_kb":1126,"num_write":394,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"256'518","reported_seq":1831,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.480313+0000","last_change":"2024-03-04T13:00:43.480358+0000","last_active":"2024-03-04T13:00:43.480313+0000","last_peered":"2024-03-04T13:00:43.480313+0000","last_clean":"2024-03-04T13:00:43.480313+0000","last_became_active":"2024-03-04T12:36:13.342604+0000","last_became_peered":"2024-03-04T12:36:13.342604+0000","last_unstale":"2024-03-04T13:00:43.480313+0000","last_undegraded":"2024-03-04T13:00:43.480313+0000","last_fullsized":"2024-03-04T13:00:43.480313+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'518","last_scrub_stamp":"2024-03-04T13:00:43.480202+0000","last_deep_scrub":"256'518","last_deep_scrub_stamp":"2024-03-04T13:00:43.480202+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.480202+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:17.734952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"256'92","reported_seq":561,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.636159+0000","last_change":"2024-03-04T13:00:33.636203+0000","last_active":"2024-03-04T13:00:33.636159+0000","last_peered":"2024-03-04T13:00:33.636159+0000","last_clean":"2024-03-04T13:00:33.636159+0000","last_became_active":"2024-03-04T12:36:15.359959+0000","last_became_peered":"2024-03-04T12:36:15.359959+0000","last_unstale":"2024-03-04T13:00:33.636159+0000","last_undegraded":"2024-03-04T13:00:33.636159+0000","last_fullsized":"2024-03-04T13:00:33.636159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'92","last_scrub_stamp":"2024-03-04T13:00:33.636037+0000","last_deep_scrub":"256'92","last_deep_scrub_stamp":"2024-03-04T13:00:33.636037+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.636037+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:05:11.396356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"256'356","reported_seq":1809,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.498478+0000","last_change":"2024-03-04T13:00:53.498478+0000","last_active":"2024-03-04T13:00:53.498478+0000","last_peered":"2024-03-04T13:00:53.498478+0000","last_clean":"2024-03-04T13:00:53.498478+0000","last_became_active":"2024-03-04T12:36:07.301558+0000","last_became_peered":"2024-03-04T12:36:07.301558+0000","last_unstale":"2024-03-04T13:00:53.498478+0000","last_undegraded":"2024-03-04T13:00:53.498478+0000","last_fullsized":"2024-03-04T13:00:53.498478+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'356","last_scrub_stamp":"2024-03-04T13:00:53.498342+0000","last_deep_scrub":"256'356","last_deep_scrub_stamp":"2024-03-04T13:00:53.498342+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.498342+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:54.005350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1943,"num_read_kb":1867,"num_write":395,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"256'366","reported_seq":1126,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:04.311629+0000","last_change":"2024-03-04T13:01:04.311672+0000","last_active":"2024-03-04T13:01:04.311629+0000","last_peered":"2024-03-04T13:01:04.311629+0000","last_clean":"2024-03-04T13:01:04.311629+0000","last_became_active":"2024-03-04T12:36:05.293649+0000","last_became_peered":"2024-03-04T12:36:05.293649+0000","last_unstale":"2024-03-04T13:01:04.311629+0000","last_undegraded":"2024-03-04T13:01:04.311629+0000","last_fullsized":"2024-03-04T13:01:04.311629+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'366","last_scrub_stamp":"2024-03-04T13:01:04.311548+0000","last_deep_scrub":"256'366","last_deep_scrub_stamp":"2024-03-04T13:01:04.311548+0000","last_clean_scrub_stamp":"2024-03-04T13:01:04.311548+0000","objects_scrubbed":9,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:35:18.138816+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3134195,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":703,"num_read_kb":39148,"num_write":1364,"num_write_kb":31517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.312815+0000","last_change":"2024-03-04T13:00:36.312878+0000","last_active":"2024-03-04T13:00:36.312815+0000","last_peered":"2024-03-04T13:00:36.312815+0000","last_clean":"2024-03-04T13:00:36.312815+0000","last_became_active":"2024-03-04T12:36:09.303908+0000","last_became_peered":"2024-03-04T12:36:09.303908+0000","last_unstale":"2024-03-04T13:00:36.312815+0000","last_undegraded":"2024-03-04T13:00:36.312815+0000","last_fullsized":"2024-03-04T13:00:36.312815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:36.312703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:36.312703+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.312703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:24:52.339144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"256'432","reported_seq":1041,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.491838+0000","last_change":"2024-03-04T13:01:02.491901+0000","last_active":"2024-03-04T13:01:02.491838+0000","last_peered":"2024-03-04T13:01:02.491838+0000","last_clean":"2024-03-04T13:01:02.491838+0000","last_became_active":"2024-03-04T12:36:11.326014+0000","last_became_peered":"2024-03-04T12:36:11.326014+0000","last_unstale":"2024-03-04T13:01:02.491838+0000","last_undegraded":"2024-03-04T13:01:02.491838+0000","last_fullsized":"2024-03-04T13:01:02.491838+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'432","last_scrub_stamp":"2024-03-04T13:01:02.491730+0000","last_deep_scrub":"256'432","last_deep_scrub_stamp":"2024-03-04T13:01:02.491730+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.491730+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:55:47.581140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":758,"num_read_kb":1853,"num_write":616,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.200373+0000","last_change":"2024-03-04T13:00:24.200396+0000","last_active":"2024-03-04T13:00:24.200373+0000","last_peered":"2024-03-04T13:00:24.200373+0000","last_clean":"2024-03-04T13:00:24.200373+0000","last_became_active":"2024-03-04T12:36:13.335586+0000","last_became_peered":"2024-03-04T12:36:13.335586+0000","last_unstale":"2024-03-04T13:00:24.200373+0000","last_undegraded":"2024-03-04T13:00:24.200373+0000","last_fullsized":"2024-03-04T13:00:24.200373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:24.200285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:24.200285+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.200285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:42:37.768082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"256'108","reported_seq":610,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.374380+0000","last_change":"2024-03-04T13:00:31.374407+0000","last_active":"2024-03-04T13:00:31.374380+0000","last_peered":"2024-03-04T13:00:31.374380+0000","last_clean":"2024-03-04T13:00:31.374380+0000","last_became_active":"2024-03-04T12:36:15.356270+0000","last_became_peered":"2024-03-04T12:36:15.356270+0000","last_unstale":"2024-03-04T13:00:31.374380+0000","last_undegraded":"2024-03-04T13:00:31.374380+0000","last_fullsized":"2024-03-04T13:00:31.374380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'108","last_scrub_stamp":"2024-03-04T13:00:31.374294+0000","last_deep_scrub":"256'108","last_deep_scrub_stamp":"2024-03-04T13:00:31.374294+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.374294+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:34:36.455950+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":257,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"256'399","reported_seq":1984,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.020670+0000","last_change":"2024-03-04T13:00:55.020670+0000","last_active":"2024-03-04T13:00:55.020670+0000","last_peered":"2024-03-04T13:00:55.020670+0000","last_clean":"2024-03-04T13:00:55.020670+0000","last_became_active":"2024-03-04T12:36:07.292788+0000","last_became_peered":"2024-03-04T12:36:07.292788+0000","last_unstale":"2024-03-04T13:00:55.020670+0000","last_undegraded":"2024-03-04T13:00:55.020670+0000","last_fullsized":"2024-03-04T13:00:55.020670+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'399","last_scrub_stamp":"2024-03-04T13:00:55.020485+0000","last_deep_scrub":"256'399","last_deep_scrub_stamp":"2024-03-04T13:00:55.020485+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.020485+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:02.659613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2359,"num_read_kb":2243,"num_write":467,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1436,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"256'308","reported_seq":1020,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:09.466722+0000","last_change":"2024-03-04T13:01:09.466771+0000","last_active":"2024-03-04T13:01:09.466722+0000","last_peered":"2024-03-04T13:01:09.466722+0000","last_clean":"2024-03-04T13:01:09.466722+0000","last_became_active":"2024-03-04T12:36:05.284594+0000","last_became_peered":"2024-03-04T12:36:05.284594+0000","last_unstale":"2024-03-04T13:01:09.466722+0000","last_undegraded":"2024-03-04T13:01:09.466722+0000","last_fullsized":"2024-03-04T13:01:09.466722+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'308","last_scrub_stamp":"2024-03-04T13:01:09.466636+0000","last_deep_scrub":"256'308","last_deep_scrub_stamp":"2024-03-04T13:01:09.466636+0000","last_clean_scrub_stamp":"2024-03-04T13:01:09.466636+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:53:52.259897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398941,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":597,"num_read_kb":110861,"num_write":1019,"num_write_kb":39283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.286134+0000","last_change":"2024-03-04T13:00:32.286134+0000","last_active":"2024-03-04T13:00:32.286134+0000","last_peered":"2024-03-04T13:00:32.286134+0000","last_clean":"2024-03-04T13:00:32.286134+0000","last_became_active":"2024-03-04T12:36:09.305363+0000","last_became_peered":"2024-03-04T12:36:09.305363+0000","last_unstale":"2024-03-04T13:00:32.286134+0000","last_undegraded":"2024-03-04T13:00:32.286134+0000","last_fullsized":"2024-03-04T13:00:32.286134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:32.286026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:32.286026+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.286026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:59:46.692288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"256'264","reported_seq":823,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.130461+0000","last_change":"2024-03-04T13:00:41.130461+0000","last_active":"2024-03-04T13:00:41.130461+0000","last_peered":"2024-03-04T13:00:41.130461+0000","last_clean":"2024-03-04T13:00:41.130461+0000","last_became_active":"2024-03-04T12:36:11.319633+0000","last_became_peered":"2024-03-04T12:36:11.319633+0000","last_unstale":"2024-03-04T13:00:41.130461+0000","last_undegraded":"2024-03-04T13:00:41.130461+0000","last_fullsized":"2024-03-04T13:00:41.130461+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'264","last_scrub_stamp":"2024-03-04T13:00:41.130252+0000","last_deep_scrub":"256'264","last_deep_scrub_stamp":"2024-03-04T13:00:41.130252+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.130252+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:37:10.295625+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":990,"num_write":404,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.595505+0000","last_change":"2024-03-04T13:00:39.595505+0000","last_active":"2024-03-04T13:00:39.595505+0000","last_peered":"2024-03-04T13:00:39.595505+0000","last_clean":"2024-03-04T13:00:39.595505+0000","last_became_active":"2024-03-04T12:36:13.348999+0000","last_became_peered":"2024-03-04T12:36:13.348999+0000","last_unstale":"2024-03-04T13:00:39.595505+0000","last_undegraded":"2024-03-04T13:00:39.595505+0000","last_fullsized":"2024-03-04T13:00:39.595505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.595386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.595386+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.595386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:30.057599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"256'99","reported_seq":578,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.668602+0000","last_change":"2024-03-04T13:00:28.668630+0000","last_active":"2024-03-04T13:00:28.668602+0000","last_peered":"2024-03-04T13:00:28.668602+0000","last_clean":"2024-03-04T13:00:28.668602+0000","last_became_active":"2024-03-04T12:36:15.359732+0000","last_became_peered":"2024-03-04T12:36:15.359732+0000","last_unstale":"2024-03-04T13:00:28.668602+0000","last_undegraded":"2024-03-04T13:00:28.668602+0000","last_fullsized":"2024-03-04T13:00:28.668602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'99","last_scrub_stamp":"2024-03-04T13:00:28.668521+0000","last_deep_scrub":"256'99","last_deep_scrub_stamp":"2024-03-04T13:00:28.668521+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.668521+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:02:41.542443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"256'881","reported_seq":2445,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.087249+0000","last_change":"2024-03-04T13:00:48.087249+0000","last_active":"2024-03-04T13:00:48.087249+0000","last_peered":"2024-03-04T13:00:48.087249+0000","last_clean":"2024-03-04T13:00:48.087249+0000","last_became_active":"2024-03-04T12:36:07.298999+0000","last_became_peered":"2024-03-04T12:36:07.298999+0000","last_unstale":"2024-03-04T13:00:48.087249+0000","last_undegraded":"2024-03-04T13:00:48.087249+0000","last_fullsized":"2024-03-04T13:00:48.087249+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'881","last_scrub_stamp":"2024-03-04T13:00:48.087084+0000","last_deep_scrub":"256'881","last_deep_scrub_stamp":"2024-03-04T13:00:48.087084+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.087084+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:59:30.969925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4068,"num_read_kb":3596,"num_write":1224,"num_write_kb":497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2629,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"256'355","reported_seq":964,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.773041+0000","last_change":"2024-03-04T13:00:53.773128+0000","last_active":"2024-03-04T13:00:53.773041+0000","last_peered":"2024-03-04T13:00:53.773041+0000","last_clean":"2024-03-04T13:00:53.773041+0000","last_became_active":"2024-03-04T12:36:05.289486+0000","last_became_peered":"2024-03-04T12:36:05.289486+0000","last_unstale":"2024-03-04T13:00:53.773041+0000","last_undegraded":"2024-03-04T13:00:53.773041+0000","last_fullsized":"2024-03-04T13:00:53.773041+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'355","last_scrub_stamp":"2024-03-04T13:00:53.772924+0000","last_deep_scrub":"256'355","last_deep_scrub_stamp":"2024-03-04T13:00:53.772924+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.772924+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:02:41.336959+0000","scrub_duration":117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456599,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":441,"num_read_kb":48705,"num_write":1317,"num_write_kb":64123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":488,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.384771+0000","last_change":"2024-03-04T13:00:38.384771+0000","last_active":"2024-03-04T13:00:38.384771+0000","last_peered":"2024-03-04T13:00:38.384771+0000","last_clean":"2024-03-04T13:00:38.384771+0000","last_became_active":"2024-03-04T12:36:09.305880+0000","last_became_peered":"2024-03-04T12:36:09.305880+0000","last_unstale":"2024-03-04T13:00:38.384771+0000","last_undegraded":"2024-03-04T13:00:38.384771+0000","last_fullsized":"2024-03-04T13:00:38.384771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:38.384641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:38.384641+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.384641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:47.356519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"256'271","reported_seq":833,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.267303+0000","last_change":"2024-03-04T13:00:26.267303+0000","last_active":"2024-03-04T13:00:26.267303+0000","last_peered":"2024-03-04T13:00:26.267303+0000","last_clean":"2024-03-04T13:00:26.267303+0000","last_became_active":"2024-03-04T12:36:11.327499+0000","last_became_peered":"2024-03-04T12:36:11.327499+0000","last_unstale":"2024-03-04T13:00:26.267303+0000","last_undegraded":"2024-03-04T13:00:26.267303+0000","last_fullsized":"2024-03-04T13:00:26.267303+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'271","last_scrub_stamp":"2024-03-04T13:00:26.267170+0000","last_deep_scrub":"256'271","last_deep_scrub_stamp":"2024-03-04T13:00:26.267170+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.267170+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:41:13.037206+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48450,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":440,"num_read_kb":1012,"num_write":358,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"256'478","reported_seq":1636,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.208567+0000","last_change":"2024-03-04T13:00:23.208567+0000","last_active":"2024-03-04T13:00:23.208567+0000","last_peered":"2024-03-04T13:00:23.208567+0000","last_clean":"2024-03-04T13:00:23.208567+0000","last_became_active":"2024-03-04T12:36:13.337817+0000","last_became_peered":"2024-03-04T12:36:13.337817+0000","last_unstale":"2024-03-04T13:00:23.208567+0000","last_undegraded":"2024-03-04T13:00:23.208567+0000","last_fullsized":"2024-03-04T13:00:23.208567+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'478","last_scrub_stamp":"2024-03-04T13:00:23.208470+0000","last_deep_scrub":"256'478","last_deep_scrub_stamp":"2024-03-04T13:00:23.208470+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.208470+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:45.708499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"256'98","reported_seq":580,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.397876+0000","last_change":"2024-03-04T13:00:32.397876+0000","last_active":"2024-03-04T13:00:32.397876+0000","last_peered":"2024-03-04T13:00:32.397876+0000","last_clean":"2024-03-04T13:00:32.397876+0000","last_became_active":"2024-03-04T12:36:15.348869+0000","last_became_peered":"2024-03-04T12:36:15.348869+0000","last_unstale":"2024-03-04T13:00:32.397876+0000","last_undegraded":"2024-03-04T13:00:32.397876+0000","last_fullsized":"2024-03-04T13:00:32.397876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'98","last_scrub_stamp":"2024-03-04T13:00:32.397750+0000","last_deep_scrub":"256'98","last_deep_scrub_stamp":"2024-03-04T13:00:32.397750+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.397750+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:30.191883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":240,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"256'412","reported_seq":1963,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.018782+0000","last_change":"2024-03-04T13:00:53.018782+0000","last_active":"2024-03-04T13:00:53.018782+0000","last_peered":"2024-03-04T13:00:53.018782+0000","last_clean":"2024-03-04T13:00:53.018782+0000","last_became_active":"2024-03-04T12:36:07.293586+0000","last_became_peered":"2024-03-04T12:36:07.293586+0000","last_unstale":"2024-03-04T13:00:53.018782+0000","last_undegraded":"2024-03-04T13:00:53.018782+0000","last_fullsized":"2024-03-04T13:00:53.018782+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'412","last_scrub_stamp":"2024-03-04T13:00:53.018659+0000","last_deep_scrub":"256'412","last_deep_scrub_stamp":"2024-03-04T13:00:53.018659+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.018659+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:50:33.410647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2259,"num_read_kb":2143,"num_write":486,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"256'342","reported_seq":958,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.063706+0000","last_change":"2024-03-04T13:00:59.063759+0000","last_active":"2024-03-04T13:00:59.063706+0000","last_peered":"2024-03-04T13:00:59.063706+0000","last_clean":"2024-03-04T13:00:59.063706+0000","last_became_active":"2024-03-04T12:36:05.288036+0000","last_became_peered":"2024-03-04T12:36:05.288036+0000","last_unstale":"2024-03-04T13:00:59.063706+0000","last_undegraded":"2024-03-04T13:00:59.063706+0000","last_fullsized":"2024-03-04T13:00:59.063706+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'342","last_scrub_stamp":"2024-03-04T13:00:59.063618+0000","last_deep_scrub":"256'342","last_deep_scrub_stamp":"2024-03-04T13:00:59.063618+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.063618+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:00.285309+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":10713,"num_write":1310,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"256'4","reported_seq":1100,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.211260+0000","last_change":"2024-03-04T13:00:52.211260+0000","last_active":"2024-03-04T13:00:52.211260+0000","last_peered":"2024-03-04T13:00:52.211260+0000","last_clean":"2024-03-04T13:00:52.211260+0000","last_became_active":"2024-03-04T12:36:09.314474+0000","last_became_peered":"2024-03-04T12:36:09.314474+0000","last_unstale":"2024-03-04T13:00:52.211260+0000","last_undegraded":"2024-03-04T13:00:52.211260+0000","last_fullsized":"2024-03-04T13:00:52.211260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:52.211145+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:52.211145+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.211145+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:02:09.880121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":612,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"256'55","reported_seq":551,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.649548+0000","last_change":"2024-03-04T13:00:44.649548+0000","last_active":"2024-03-04T13:00:44.649548+0000","last_peered":"2024-03-04T13:00:44.649548+0000","last_clean":"2024-03-04T13:00:44.649548+0000","last_became_active":"2024-03-04T12:36:11.954508+0000","last_became_peered":"2024-03-04T12:36:11.954508+0000","last_unstale":"2024-03-04T13:00:44.649548+0000","last_undegraded":"2024-03-04T13:00:44.649548+0000","last_fullsized":"2024-03-04T13:00:44.649548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'55","last_scrub_stamp":"2024-03-04T13:00:44.649433+0000","last_deep_scrub":"256'55","last_deep_scrub_stamp":"2024-03-04T13:00:44.649433+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.649433+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:35:51.668769+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"256'482","reported_seq":1507,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.725817+0000","last_change":"2024-03-04T13:00:34.725817+0000","last_active":"2024-03-04T13:00:34.725817+0000","last_peered":"2024-03-04T13:00:34.725817+0000","last_clean":"2024-03-04T13:00:34.725817+0000","last_became_active":"2024-03-04T12:36:13.342902+0000","last_became_peered":"2024-03-04T12:36:13.342902+0000","last_unstale":"2024-03-04T13:00:34.725817+0000","last_undegraded":"2024-03-04T13:00:34.725817+0000","last_fullsized":"2024-03-04T13:00:34.725817+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'482","last_scrub_stamp":"2024-03-04T13:00:34.725632+0000","last_deep_scrub":"256'482","last_deep_scrub_stamp":"2024-03-04T13:00:34.725632+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.725632+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:32:27.798918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"256'94","reported_seq":578,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.163768+0000","last_change":"2024-03-04T13:00:29.163768+0000","last_active":"2024-03-04T13:00:29.163768+0000","last_peered":"2024-03-04T13:00:29.163768+0000","last_clean":"2024-03-04T13:00:29.163768+0000","last_became_active":"2024-03-04T12:36:15.352420+0000","last_became_peered":"2024-03-04T12:36:15.352420+0000","last_unstale":"2024-03-04T13:00:29.163768+0000","last_undegraded":"2024-03-04T13:00:29.163768+0000","last_fullsized":"2024-03-04T13:00:29.163768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'94","last_scrub_stamp":"2024-03-04T13:00:29.163620+0000","last_deep_scrub":"256'94","last_deep_scrub_stamp":"2024-03-04T13:00:29.163620+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.163620+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:10.290561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":79,"num_write":205,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"256'1080","reported_seq":2464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.358804+0000","last_change":"2024-03-04T13:00:37.358804+0000","last_active":"2024-03-04T13:00:37.358804+0000","last_peered":"2024-03-04T13:00:37.358804+0000","last_clean":"2024-03-04T13:00:37.358804+0000","last_became_active":"2024-03-04T12:36:07.304123+0000","last_became_peered":"2024-03-04T12:36:07.304123+0000","last_unstale":"2024-03-04T13:00:37.358804+0000","last_undegraded":"2024-03-04T13:00:37.358804+0000","last_fullsized":"2024-03-04T13:00:37.358804+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1080","last_scrub_stamp":"2024-03-04T13:00:37.358634+0000","last_deep_scrub":"256'1080","last_deep_scrub_stamp":"2024-03-04T13:00:37.358634+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.358634+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":1000,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:25:48.734892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4358,"num_read_kb":3794,"num_write":1486,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'371","reported_seq":1004,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:10.439010+0000","last_change":"2024-03-04T13:01:10.439092+0000","last_active":"2024-03-04T13:01:10.439010+0000","last_peered":"2024-03-04T13:01:10.439010+0000","last_clean":"2024-03-04T13:01:10.439010+0000","last_became_active":"2024-03-04T12:36:05.286442+0000","last_became_peered":"2024-03-04T12:36:05.286442+0000","last_unstale":"2024-03-04T13:01:10.439010+0000","last_undegraded":"2024-03-04T13:01:10.439010+0000","last_fullsized":"2024-03-04T13:01:10.439010+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'371","last_scrub_stamp":"2024-03-04T13:01:10.438900+0000","last_deep_scrub":"256'371","last_deep_scrub_stamp":"2024-03-04T13:01:10.438900+0000","last_clean_scrub_stamp":"2024-03-04T13:01:10.438900+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:09:52.222245+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":497,"num_read_kb":22844,"num_write":1305,"num_write_kb":40494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:05.884930+0000","last_change":"2024-03-04T13:01:05.884961+0000","last_active":"2024-03-04T13:01:05.884930+0000","last_peered":"2024-03-04T13:01:05.884930+0000","last_clean":"2024-03-04T13:01:05.884930+0000","last_became_active":"2024-03-04T12:36:09.314671+0000","last_became_peered":"2024-03-04T12:36:09.314671+0000","last_unstale":"2024-03-04T13:01:05.884930+0000","last_undegraded":"2024-03-04T13:01:05.884930+0000","last_fullsized":"2024-03-04T13:01:05.884930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:05.884826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:05.884826+0000","last_clean_scrub_stamp":"2024-03-04T13:01:05.884826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:41:37.113803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"256'299","reported_seq":876,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.182629+0000","last_change":"2024-03-04T13:00:56.182710+0000","last_active":"2024-03-04T13:00:56.182629+0000","last_peered":"2024-03-04T13:00:56.182629+0000","last_clean":"2024-03-04T13:00:56.182629+0000","last_became_active":"2024-03-04T12:36:11.325372+0000","last_became_peered":"2024-03-04T12:36:11.325372+0000","last_unstale":"2024-03-04T13:00:56.182629+0000","last_undegraded":"2024-03-04T13:00:56.182629+0000","last_fullsized":"2024-03-04T13:00:56.182629+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'299","last_scrub_stamp":"2024-03-04T13:00:56.182525+0000","last_deep_scrub":"256'299","last_deep_scrub_stamp":"2024-03-04T13:00:56.182525+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.182525+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:34.592405+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47142,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1045,"num_read_kb":1555,"num_write":1526,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476198,"num_omap_keys":1104,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.746192+0000","last_change":"2024-03-04T13:00:40.746192+0000","last_active":"2024-03-04T13:00:40.746192+0000","last_peered":"2024-03-04T13:00:40.746192+0000","last_clean":"2024-03-04T13:00:40.746192+0000","last_became_active":"2024-03-04T12:36:13.348998+0000","last_became_peered":"2024-03-04T12:36:13.348998+0000","last_unstale":"2024-03-04T13:00:40.746192+0000","last_undegraded":"2024-03-04T13:00:40.746192+0000","last_fullsized":"2024-03-04T13:00:40.746192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.746068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.746068+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.746068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:09.551212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"256'117","reported_seq":607,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.417352+0000","last_change":"2024-03-04T13:00:29.417352+0000","last_active":"2024-03-04T13:00:29.417352+0000","last_peered":"2024-03-04T13:00:29.417352+0000","last_clean":"2024-03-04T13:00:29.417352+0000","last_became_active":"2024-03-04T12:36:15.362792+0000","last_became_peered":"2024-03-04T12:36:15.362792+0000","last_unstale":"2024-03-04T13:00:29.417352+0000","last_undegraded":"2024-03-04T13:00:29.417352+0000","last_fullsized":"2024-03-04T13:00:29.417352+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'117","last_scrub_stamp":"2024-03-04T13:00:29.417189+0000","last_deep_scrub":"256'117","last_deep_scrub_stamp":"2024-03-04T13:00:29.417189+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.417189+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:57.741359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":132,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"256'319","reported_seq":1687,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.785872+0000","last_change":"2024-03-04T13:00:43.785872+0000","last_active":"2024-03-04T13:00:43.785872+0000","last_peered":"2024-03-04T13:00:43.785872+0000","last_clean":"2024-03-04T13:00:43.785872+0000","last_became_active":"2024-03-04T12:36:07.299952+0000","last_became_peered":"2024-03-04T12:36:07.299952+0000","last_unstale":"2024-03-04T13:00:43.785872+0000","last_undegraded":"2024-03-04T13:00:43.785872+0000","last_fullsized":"2024-03-04T13:00:43.785872+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'319","last_scrub_stamp":"2024-03-04T13:00:43.785742+0000","last_deep_scrub":"256'319","last_deep_scrub_stamp":"2024-03-04T13:00:43.785742+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.785742+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:17.256676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1855,"num_read_kb":1767,"num_write":364,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1113,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"256'119","reported_seq":660,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.267408+0000","last_change":"2024-03-04T13:01:01.267485+0000","last_active":"2024-03-04T13:01:01.267408+0000","last_peered":"2024-03-04T13:01:01.267408+0000","last_clean":"2024-03-04T13:01:01.267408+0000","last_became_active":"2024-03-04T12:35:47.950213+0000","last_became_peered":"2024-03-04T12:35:47.950213+0000","last_unstale":"2024-03-04T13:01:01.267408+0000","last_undegraded":"2024-03-04T13:01:01.267408+0000","last_fullsized":"2024-03-04T13:01:01.267408+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'119","last_scrub_stamp":"2024-03-04T13:01:01.267303+0000","last_deep_scrub":"256'119","last_deep_scrub_stamp":"2024-03-04T13:01:01.267303+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.267303+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:02:38.945823+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":499,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.188399+0000","last_change":"2024-03-04T13:00:58.188421+0000","last_active":"2024-03-04T13:00:58.188399+0000","last_peered":"2024-03-04T13:00:58.188399+0000","last_clean":"2024-03-04T13:00:58.188399+0000","last_became_active":"2024-03-04T12:35:54.234819+0000","last_became_peered":"2024-03-04T12:35:54.234819+0000","last_unstale":"2024-03-04T13:00:58.188399+0000","last_undegraded":"2024-03-04T13:00:58.188399+0000","last_fullsized":"2024-03-04T13:00:58.188399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:58.188275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:58.188275+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.188275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:43:54.039632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"256'316","reported_seq":935,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.546940+0000","last_change":"2024-03-04T13:01:03.546940+0000","last_active":"2024-03-04T13:01:03.546940+0000","last_peered":"2024-03-04T13:01:03.546940+0000","last_clean":"2024-03-04T13:01:03.546940+0000","last_became_active":"2024-03-04T12:36:05.296783+0000","last_became_peered":"2024-03-04T12:36:05.296783+0000","last_unstale":"2024-03-04T13:01:03.546940+0000","last_undegraded":"2024-03-04T13:01:03.546940+0000","last_fullsized":"2024-03-04T13:01:03.546940+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'316","last_scrub_stamp":"2024-03-04T13:01:03.546803+0000","last_deep_scrub":"256'316","last_deep_scrub_stamp":"2024-03-04T13:01:03.546803+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.546803+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:27.606023+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":460,"num_read_kb":16805,"num_write":1147,"num_write_kb":27899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":488,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.282178+0000","last_change":"2024-03-04T13:00:51.282178+0000","last_active":"2024-03-04T13:00:51.282178+0000","last_peered":"2024-03-04T13:00:51.282178+0000","last_clean":"2024-03-04T13:00:51.282178+0000","last_became_active":"2024-03-04T12:36:09.306398+0000","last_became_peered":"2024-03-04T12:36:09.306398+0000","last_unstale":"2024-03-04T13:00:51.282178+0000","last_undegraded":"2024-03-04T13:00:51.282178+0000","last_fullsized":"2024-03-04T13:00:51.282178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:51.282015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:51.282015+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.282015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:22.916364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"256'664","reported_seq":1348,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.333621+0000","last_change":"2024-03-04T13:00:41.333662+0000","last_active":"2024-03-04T13:00:41.333621+0000","last_peered":"2024-03-04T13:00:41.333621+0000","last_clean":"2024-03-04T13:00:41.333621+0000","last_became_active":"2024-03-04T12:36:11.327652+0000","last_became_peered":"2024-03-04T12:36:11.327652+0000","last_unstale":"2024-03-04T13:00:41.333621+0000","last_undegraded":"2024-03-04T13:00:41.333621+0000","last_fullsized":"2024-03-04T13:00:41.333621+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'664","last_scrub_stamp":"2024-03-04T13:00:41.333537+0000","last_deep_scrub":"256'664","last_deep_scrub_stamp":"2024-03-04T13:00:41.333537+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.333537+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:37.486661+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140555,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1295,"num_read_kb":2979,"num_write":1188,"num_write_kb":1057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89476,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.466652+0000","last_change":"2024-03-04T13:00:44.466699+0000","last_active":"2024-03-04T13:00:44.466652+0000","last_peered":"2024-03-04T13:00:44.466652+0000","last_clean":"2024-03-04T13:00:44.466652+0000","last_became_active":"2024-03-04T12:36:13.341629+0000","last_became_peered":"2024-03-04T12:36:13.341629+0000","last_unstale":"2024-03-04T13:00:44.466652+0000","last_undegraded":"2024-03-04T13:00:44.466652+0000","last_fullsized":"2024-03-04T13:00:44.466652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:44.466543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:44.466543+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.466543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:58.569289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"256'96","reported_seq":581,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.797113+0000","last_change":"2024-03-04T13:00:46.797172+0000","last_active":"2024-03-04T13:00:46.797113+0000","last_peered":"2024-03-04T13:00:46.797113+0000","last_clean":"2024-03-04T13:00:46.797113+0000","last_became_active":"2024-03-04T12:36:15.363355+0000","last_became_peered":"2024-03-04T12:36:15.363355+0000","last_unstale":"2024-03-04T13:00:46.797113+0000","last_undegraded":"2024-03-04T13:00:46.797113+0000","last_fullsized":"2024-03-04T13:00:46.797113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'96","last_scrub_stamp":"2024-03-04T13:00:46.797000+0000","last_deep_scrub":"256'96","last_deep_scrub_stamp":"2024-03-04T13:00:46.797000+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.797000+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:12:15.727811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"256'354","reported_seq":1797,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.447743+0000","last_change":"2024-03-04T13:00:51.447772+0000","last_active":"2024-03-04T13:00:51.447743+0000","last_peered":"2024-03-04T13:00:51.447743+0000","last_clean":"2024-03-04T13:00:51.447743+0000","last_became_active":"2024-03-04T12:36:07.301706+0000","last_became_peered":"2024-03-04T12:36:07.301706+0000","last_unstale":"2024-03-04T13:00:51.447743+0000","last_undegraded":"2024-03-04T13:00:51.447743+0000","last_fullsized":"2024-03-04T13:00:51.447743+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'354","last_scrub_stamp":"2024-03-04T13:00:51.447652+0000","last_deep_scrub":"256'354","last_deep_scrub_stamp":"2024-03-04T13:00:51.447652+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.447652+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:01:03.325657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2015,"num_read_kb":1927,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":502,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.250193+0000","last_change":"2024-03-04T13:01:02.250239+0000","last_active":"2024-03-04T13:01:02.250193+0000","last_peered":"2024-03-04T13:01:02.250193+0000","last_clean":"2024-03-04T13:01:02.250193+0000","last_became_active":"2024-03-04T12:35:54.238351+0000","last_became_peered":"2024-03-04T12:35:54.238351+0000","last_unstale":"2024-03-04T13:01:02.250193+0000","last_undegraded":"2024-03-04T13:01:02.250193+0000","last_fullsized":"2024-03-04T13:01:02.250193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:02.250113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:02.250113+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.250113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:03:15.242833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"256'391","reported_seq":1065,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:08.434367+0000","last_change":"2024-03-04T13:01:08.434420+0000","last_active":"2024-03-04T13:01:08.434367+0000","last_peered":"2024-03-04T13:01:08.434367+0000","last_clean":"2024-03-04T13:01:08.434367+0000","last_became_active":"2024-03-04T12:36:05.285659+0000","last_became_peered":"2024-03-04T12:36:05.285659+0000","last_unstale":"2024-03-04T13:01:08.434367+0000","last_undegraded":"2024-03-04T13:01:08.434367+0000","last_fullsized":"2024-03-04T13:01:08.434367+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'391","last_scrub_stamp":"2024-03-04T13:01:08.434277+0000","last_deep_scrub":"256'391","last_deep_scrub_stamp":"2024-03-04T13:01:08.434277+0000","last_clean_scrub_stamp":"2024-03-04T13:01:08.434277+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:55.601176+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2160246,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":21923,"num_write":1294,"num_write_kb":32530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.208898+0000","last_change":"2024-03-04T13:00:50.208920+0000","last_active":"2024-03-04T13:00:50.208898+0000","last_peered":"2024-03-04T13:00:50.208898+0000","last_clean":"2024-03-04T13:00:50.208898+0000","last_became_active":"2024-03-04T12:36:09.314113+0000","last_became_peered":"2024-03-04T12:36:09.314113+0000","last_unstale":"2024-03-04T13:00:50.208898+0000","last_undegraded":"2024-03-04T13:00:50.208898+0000","last_fullsized":"2024-03-04T13:00:50.208898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:50.208809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:50.208809+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.208809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:28.234707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"256'1026","reported_seq":2150,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.444407+0000","last_change":"2024-03-04T13:00:46.444407+0000","last_active":"2024-03-04T13:00:46.444407+0000","last_peered":"2024-03-04T13:00:46.444407+0000","last_clean":"2024-03-04T13:00:46.444407+0000","last_became_active":"2024-03-04T12:36:11.323543+0000","last_became_peered":"2024-03-04T12:36:11.323543+0000","last_unstale":"2024-03-04T13:00:46.444407+0000","last_undegraded":"2024-03-04T13:00:46.444407+0000","last_fullsized":"2024-03-04T13:00:46.444407+0000","mapping_epoch":26,"log_start":"256'1000","ondisk_log_start":"256'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1026","last_scrub_stamp":"2024-03-04T13:00:46.444243+0000","last_deep_scrub":"256'1026","last_deep_scrub_stamp":"2024-03-04T13:00:46.444243+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.444243+0000","objects_scrubbed":11,"log_size":26,"log_dups_size":1000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:41.355661+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157019,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1614,"num_read_kb":3260,"num_write":972,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.288095+0000","last_change":"2024-03-04T13:00:40.288095+0000","last_active":"2024-03-04T13:00:40.288095+0000","last_peered":"2024-03-04T13:00:40.288095+0000","last_clean":"2024-03-04T13:00:40.288095+0000","last_became_active":"2024-03-04T12:36:13.339353+0000","last_became_peered":"2024-03-04T12:36:13.339353+0000","last_unstale":"2024-03-04T13:00:40.288095+0000","last_undegraded":"2024-03-04T13:00:40.288095+0000","last_fullsized":"2024-03-04T13:00:40.288095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.287960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.287960+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.287960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:16:46.922748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"256'147","reported_seq":643,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.399242+0000","last_change":"2024-03-04T13:00:33.399271+0000","last_active":"2024-03-04T13:00:33.399242+0000","last_peered":"2024-03-04T13:00:33.399242+0000","last_clean":"2024-03-04T13:00:33.399242+0000","last_became_active":"2024-03-04T12:36:15.346516+0000","last_became_peered":"2024-03-04T12:36:15.346516+0000","last_unstale":"2024-03-04T13:00:33.399242+0000","last_undegraded":"2024-03-04T13:00:33.399242+0000","last_fullsized":"2024-03-04T13:00:33.399242+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'147","last_scrub_stamp":"2024-03-04T13:00:33.399158+0000","last_deep_scrub":"256'147","last_deep_scrub_stamp":"2024-03-04T13:00:33.399158+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.399158+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:04.057962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":196,"num_read_kb":196,"num_write":318,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"256'399","reported_seq":1877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.414666+0000","last_change":"2024-03-04T13:00:39.414706+0000","last_active":"2024-03-04T13:00:39.414666+0000","last_peered":"2024-03-04T13:00:39.414666+0000","last_clean":"2024-03-04T13:00:39.414666+0000","last_became_active":"2024-03-04T12:36:07.300039+0000","last_became_peered":"2024-03-04T12:36:07.300039+0000","last_unstale":"2024-03-04T13:00:39.414666+0000","last_undegraded":"2024-03-04T13:00:39.414666+0000","last_fullsized":"2024-03-04T13:00:39.414666+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'399","last_scrub_stamp":"2024-03-04T13:00:39.414579+0000","last_deep_scrub":"256'399","last_deep_scrub_stamp":"2024-03-04T13:00:39.414579+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.414579+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:09.710256+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2349,"num_read_kb":2220,"num_write":468,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":238,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":502,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.223911+0000","last_change":"2024-03-04T13:00:39.223911+0000","last_active":"2024-03-04T13:00:39.223911+0000","last_peered":"2024-03-04T13:00:39.223911+0000","last_clean":"2024-03-04T13:00:39.223911+0000","last_became_active":"2024-03-04T12:35:54.235738+0000","last_became_peered":"2024-03-04T12:35:54.235738+0000","last_unstale":"2024-03-04T13:00:39.223911+0000","last_undegraded":"2024-03-04T13:00:39.223911+0000","last_fullsized":"2024-03-04T13:00:39.223911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.223775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.223775+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.223775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:54:59.767057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"256'383","reported_seq":1280,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.407677+0000","last_change":"2024-03-04T13:00:54.407717+0000","last_active":"2024-03-04T13:00:54.407677+0000","last_peered":"2024-03-04T13:00:54.407677+0000","last_clean":"2024-03-04T13:00:54.407677+0000","last_became_active":"2024-03-04T12:36:05.274788+0000","last_became_peered":"2024-03-04T12:36:05.274788+0000","last_unstale":"2024-03-04T13:00:54.407677+0000","last_undegraded":"2024-03-04T13:00:54.407677+0000","last_fullsized":"2024-03-04T13:00:54.407677+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'383","last_scrub_stamp":"2024-03-04T13:00:54.407587+0000","last_deep_scrub":"256'383","last_deep_scrub_stamp":"2024-03-04T13:00:54.407587+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.407587+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:09:42.717881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069328,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1100,"num_read_kb":10802,"num_write":1447,"num_write_kb":39091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"256'2","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.318641+0000","last_change":"2024-03-04T13:00:30.318672+0000","last_active":"2024-03-04T13:00:30.318641+0000","last_peered":"2024-03-04T13:00:30.318641+0000","last_clean":"2024-03-04T13:00:30.318641+0000","last_became_active":"2024-03-04T12:36:09.315023+0000","last_became_peered":"2024-03-04T12:36:09.315023+0000","last_unstale":"2024-03-04T13:00:30.318641+0000","last_undegraded":"2024-03-04T13:00:30.318641+0000","last_fullsized":"2024-03-04T13:00:30.318641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:30.318544+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:30.318544+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.318544+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:46.009625+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"256'197","reported_seq":1011,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.322586+0000","last_change":"2024-03-04T13:00:44.322586+0000","last_active":"2024-03-04T13:00:44.322586+0000","last_peered":"2024-03-04T13:00:44.322586+0000","last_clean":"2024-03-04T13:00:44.322586+0000","last_became_active":"2024-03-04T12:36:11.954554+0000","last_became_peered":"2024-03-04T12:36:11.954554+0000","last_unstale":"2024-03-04T13:00:44.322586+0000","last_undegraded":"2024-03-04T13:00:44.322586+0000","last_fullsized":"2024-03-04T13:00:44.322586+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'197","last_scrub_stamp":"2024-03-04T13:00:44.322449+0000","last_deep_scrub":"256'197","last_deep_scrub_stamp":"2024-03-04T13:00:44.322449+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.322449+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:26:55.878031+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.457507+0000","last_change":"2024-03-04T13:00:47.457507+0000","last_active":"2024-03-04T13:00:47.457507+0000","last_peered":"2024-03-04T13:00:47.457507+0000","last_clean":"2024-03-04T13:00:47.457507+0000","last_became_active":"2024-03-04T12:36:13.338388+0000","last_became_peered":"2024-03-04T12:36:13.338388+0000","last_unstale":"2024-03-04T13:00:47.457507+0000","last_undegraded":"2024-03-04T13:00:47.457507+0000","last_fullsized":"2024-03-04T13:00:47.457507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:47.457344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:47.457344+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.457344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:51.534303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'194","reported_seq":694,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.827539+0000","last_change":"2024-03-04T13:00:33.827539+0000","last_active":"2024-03-04T13:00:33.827539+0000","last_peered":"2024-03-04T13:00:33.827539+0000","last_clean":"2024-03-04T13:00:33.827539+0000","last_became_active":"2024-03-04T12:36:15.353529+0000","last_became_peered":"2024-03-04T12:36:15.353529+0000","last_unstale":"2024-03-04T13:00:33.827539+0000","last_undegraded":"2024-03-04T13:00:33.827539+0000","last_fullsized":"2024-03-04T13:00:33.827539+0000","mapping_epoch":30,"log_start":"241'100","ondisk_log_start":"241'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'194","last_scrub_stamp":"2024-03-04T13:00:33.827362+0000","last_deep_scrub":"256'194","last_deep_scrub_stamp":"2024-03-04T13:00:33.827362+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.827362+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:43.745434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":292,"num_read_kb":316,"num_write":426,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"256'397","reported_seq":1836,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.407849+0000","last_change":"2024-03-04T13:00:45.407849+0000","last_active":"2024-03-04T13:00:45.407849+0000","last_peered":"2024-03-04T13:00:45.407849+0000","last_clean":"2024-03-04T13:00:45.407849+0000","last_became_active":"2024-03-04T12:36:07.298936+0000","last_became_peered":"2024-03-04T12:36:07.298936+0000","last_unstale":"2024-03-04T13:00:45.407849+0000","last_undegraded":"2024-03-04T13:00:45.407849+0000","last_fullsized":"2024-03-04T13:00:45.407849+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'397","last_scrub_stamp":"2024-03-04T13:00:45.407700+0000","last_deep_scrub":"256'397","last_deep_scrub_stamp":"2024-03-04T13:00:45.407700+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.407700+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:39.109200+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2152,"num_read_kb":2018,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":303,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":499,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.157814+0000","last_change":"2024-03-04T13:00:59.157861+0000","last_active":"2024-03-04T13:00:59.157814+0000","last_peered":"2024-03-04T13:00:59.157814+0000","last_clean":"2024-03-04T13:00:59.157814+0000","last_became_active":"2024-03-04T12:35:54.238357+0000","last_became_peered":"2024-03-04T12:35:54.238357+0000","last_unstale":"2024-03-04T13:00:59.157814+0000","last_undegraded":"2024-03-04T13:00:59.157814+0000","last_fullsized":"2024-03-04T13:00:59.157814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:59.157718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:59.157718+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.157718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:53:58.649409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"256'334","reported_seq":992,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.980439+0000","last_change":"2024-03-04T13:01:00.980439+0000","last_active":"2024-03-04T13:01:00.980439+0000","last_peered":"2024-03-04T13:01:00.980439+0000","last_clean":"2024-03-04T13:01:00.980439+0000","last_became_active":"2024-03-04T12:36:05.289374+0000","last_became_peered":"2024-03-04T12:36:05.289374+0000","last_unstale":"2024-03-04T13:01:00.980439+0000","last_undegraded":"2024-03-04T13:01:00.980439+0000","last_fullsized":"2024-03-04T13:01:00.980439+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'334","last_scrub_stamp":"2024-03-04T13:01:00.980244+0000","last_deep_scrub":"256'334","last_deep_scrub_stamp":"2024-03-04T13:01:00.980244+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.980244+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:41:14.403992+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007111,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":531,"num_read_kb":54492,"num_write":1276,"num_write_kb":39662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.442910+0000","last_change":"2024-03-04T13:00:50.442910+0000","last_active":"2024-03-04T13:00:50.442910+0000","last_peered":"2024-03-04T13:00:50.442910+0000","last_clean":"2024-03-04T13:00:50.442910+0000","last_became_active":"2024-03-04T12:36:09.304291+0000","last_became_peered":"2024-03-04T12:36:09.304291+0000","last_unstale":"2024-03-04T13:00:50.442910+0000","last_undegraded":"2024-03-04T13:00:50.442910+0000","last_fullsized":"2024-03-04T13:00:50.442910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:50.442748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:50.442748+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.442748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:31:23.711297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"256'88","reported_seq":602,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.668262+0000","last_change":"2024-03-04T13:00:45.668289+0000","last_active":"2024-03-04T13:00:45.668262+0000","last_peered":"2024-03-04T13:00:45.668262+0000","last_clean":"2024-03-04T13:00:45.668262+0000","last_became_active":"2024-03-04T12:36:11.325957+0000","last_became_peered":"2024-03-04T12:36:11.325957+0000","last_unstale":"2024-03-04T13:00:45.668262+0000","last_undegraded":"2024-03-04T13:00:45.668262+0000","last_fullsized":"2024-03-04T13:00:45.668262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'88","last_scrub_stamp":"2024-03-04T13:00:45.668192+0000","last_deep_scrub":"256'88","last_deep_scrub_stamp":"2024-03-04T13:00:45.668192+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.668192+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:10.706687+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":66,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1504,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.754977+0000","last_change":"2024-03-04T13:00:36.755000+0000","last_active":"2024-03-04T13:00:36.754977+0000","last_peered":"2024-03-04T13:00:36.754977+0000","last_clean":"2024-03-04T13:00:36.754977+0000","last_became_active":"2024-03-04T12:36:13.345547+0000","last_became_peered":"2024-03-04T12:36:13.345547+0000","last_unstale":"2024-03-04T13:00:36.754977+0000","last_undegraded":"2024-03-04T13:00:36.754977+0000","last_fullsized":"2024-03-04T13:00:36.754977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:36.754882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:36.754882+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.754882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:11.105892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"256'111","reported_seq":607,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.437171+0000","last_change":"2024-03-04T13:00:31.437195+0000","last_active":"2024-03-04T13:00:31.437171+0000","last_peered":"2024-03-04T13:00:31.437171+0000","last_clean":"2024-03-04T13:00:31.437171+0000","last_became_active":"2024-03-04T12:36:15.363185+0000","last_became_peered":"2024-03-04T12:36:15.363185+0000","last_unstale":"2024-03-04T13:00:31.437171+0000","last_undegraded":"2024-03-04T13:00:31.437171+0000","last_fullsized":"2024-03-04T13:00:31.437171+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'111","last_scrub_stamp":"2024-03-04T13:00:31.437082+0000","last_deep_scrub":"256'111","last_deep_scrub_stamp":"2024-03-04T13:00:31.437082+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.437082+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:45.642975+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":251,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"256'468","reported_seq":2021,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.430671+0000","last_change":"2024-03-04T13:00:49.430671+0000","last_active":"2024-03-04T13:00:49.430671+0000","last_peered":"2024-03-04T13:00:49.430671+0000","last_clean":"2024-03-04T13:00:49.430671+0000","last_became_active":"2024-03-04T12:36:07.296433+0000","last_became_peered":"2024-03-04T12:36:07.296433+0000","last_unstale":"2024-03-04T13:00:49.430671+0000","last_undegraded":"2024-03-04T13:00:49.430671+0000","last_fullsized":"2024-03-04T13:00:49.430671+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'468","last_scrub_stamp":"2024-03-04T13:00:49.430550+0000","last_deep_scrub":"256'468","last_deep_scrub_stamp":"2024-03-04T13:00:49.430550+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.430550+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:47:32.639732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2396,"num_read_kb":2259,"num_write":579,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"256'399","reported_seq":1062,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.531193+0000","last_change":"2024-03-04T13:00:27.531193+0000","last_active":"2024-03-04T13:00:27.531193+0000","last_peered":"2024-03-04T13:00:27.531193+0000","last_clean":"2024-03-04T13:00:27.531193+0000","last_became_active":"2024-03-04T12:36:40.965346+0000","last_became_peered":"2024-03-04T12:36:40.965346+0000","last_unstale":"2024-03-04T13:00:27.531193+0000","last_undegraded":"2024-03-04T13:00:27.531193+0000","last_fullsized":"2024-03-04T13:00:27.531193+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'399","last_scrub_stamp":"2024-03-04T13:00:27.531051+0000","last_deep_scrub":"256'399","last_deep_scrub_stamp":"2024-03-04T13:00:27.531051+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.531051+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:45:37.677827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":48879,"num_write":1467,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":503,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.381690+0000","last_change":"2024-03-04T13:00:53.381690+0000","last_active":"2024-03-04T13:00:53.381690+0000","last_peered":"2024-03-04T13:00:53.381690+0000","last_clean":"2024-03-04T13:00:53.381690+0000","last_became_active":"2024-03-04T12:35:54.470407+0000","last_became_peered":"2024-03-04T12:35:54.470407+0000","last_unstale":"2024-03-04T13:00:53.381690+0000","last_undegraded":"2024-03-04T13:00:53.381690+0000","last_fullsized":"2024-03-04T13:00:53.381690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:53.381569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:53.381569+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.381569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:59.668953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.498186+0000","last_change":"2024-03-04T13:00:54.498186+0000","last_active":"2024-03-04T13:00:54.498186+0000","last_peered":"2024-03-04T13:00:54.498186+0000","last_clean":"2024-03-04T13:00:54.498186+0000","last_became_active":"2024-03-04T12:36:09.308360+0000","last_became_peered":"2024-03-04T12:36:09.308360+0000","last_unstale":"2024-03-04T13:00:54.498186+0000","last_undegraded":"2024-03-04T13:00:54.498186+0000","last_fullsized":"2024-03-04T13:00:54.498186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:54.498073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:54.498073+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.498073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:18.124641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"256'497","reported_seq":1130,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:12.414640+0000","last_change":"2024-03-04T13:01:12.414688+0000","last_active":"2024-03-04T13:01:12.414640+0000","last_peered":"2024-03-04T13:01:12.414640+0000","last_clean":"2024-03-04T13:01:12.414640+0000","last_became_active":"2024-03-04T12:36:11.328923+0000","last_became_peered":"2024-03-04T12:36:11.328923+0000","last_unstale":"2024-03-04T13:01:12.414640+0000","last_undegraded":"2024-03-04T13:01:12.414640+0000","last_fullsized":"2024-03-04T13:01:12.414640+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'497","last_scrub_stamp":"2024-03-04T13:01:12.414550+0000","last_deep_scrub":"256'497","last_deep_scrub_stamp":"2024-03-04T13:01:12.414550+0000","last_clean_scrub_stamp":"2024-03-04T13:01:12.414550+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:28.858780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93633,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":843,"num_read_kb":1937,"num_write":680,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.115438+0000","last_change":"2024-03-04T13:00:31.115438+0000","last_active":"2024-03-04T13:00:31.115438+0000","last_peered":"2024-03-04T13:00:31.115438+0000","last_clean":"2024-03-04T13:00:31.115438+0000","last_became_active":"2024-03-04T12:36:13.346886+0000","last_became_peered":"2024-03-04T12:36:13.346886+0000","last_unstale":"2024-03-04T13:00:31.115438+0000","last_undegraded":"2024-03-04T13:00:31.115438+0000","last_fullsized":"2024-03-04T13:00:31.115438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:31.115320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:31.115320+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.115320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:25:44.557397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"256'95","reported_seq":584,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.588562+0000","last_change":"2024-03-04T13:00:37.588562+0000","last_active":"2024-03-04T13:00:37.588562+0000","last_peered":"2024-03-04T13:00:37.588562+0000","last_clean":"2024-03-04T13:00:37.588562+0000","last_became_active":"2024-03-04T12:36:15.350185+0000","last_became_peered":"2024-03-04T12:36:15.350185+0000","last_unstale":"2024-03-04T13:00:37.588562+0000","last_undegraded":"2024-03-04T13:00:37.588562+0000","last_fullsized":"2024-03-04T13:00:37.588562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'95","last_scrub_stamp":"2024-03-04T13:00:37.588450+0000","last_deep_scrub":"256'95","last_deep_scrub_stamp":"2024-03-04T13:00:37.588450+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.588450+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:31.645524+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":228,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"256'646","reported_seq":2018,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.458865+0000","last_change":"2024-03-04T13:00:57.458865+0000","last_active":"2024-03-04T13:00:57.458865+0000","last_peered":"2024-03-04T13:00:57.458865+0000","last_clean":"2024-03-04T13:00:57.458865+0000","last_became_active":"2024-03-04T12:36:07.296657+0000","last_became_peered":"2024-03-04T12:36:07.296657+0000","last_unstale":"2024-03-04T13:00:57.458865+0000","last_undegraded":"2024-03-04T13:00:57.458865+0000","last_fullsized":"2024-03-04T13:00:57.458865+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'646","last_scrub_stamp":"2024-03-04T13:00:57.458741+0000","last_deep_scrub":"256'646","last_deep_scrub_stamp":"2024-03-04T13:00:57.458741+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.458741+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":600,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:07.456998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3068,"num_read_kb":2828,"num_write":988,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"256'353","reported_seq":1036,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.432972+0000","last_change":"2024-03-04T13:00:55.432972+0000","last_active":"2024-03-04T13:00:55.432972+0000","last_peered":"2024-03-04T13:00:55.432972+0000","last_clean":"2024-03-04T13:00:55.432972+0000","last_became_active":"2024-03-04T12:36:05.275263+0000","last_became_peered":"2024-03-04T12:36:05.275263+0000","last_unstale":"2024-03-04T13:00:55.432972+0000","last_undegraded":"2024-03-04T13:00:55.432972+0000","last_fullsized":"2024-03-04T13:00:55.432972+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'353","last_scrub_stamp":"2024-03-04T13:00:55.432812+0000","last_deep_scrub":"256'353","last_deep_scrub_stamp":"2024-03-04T13:00:55.432812+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.432812+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:22:54.562917+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":637,"num_read_kb":62539,"num_write":1435,"num_write_kb":42561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":502,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.225563+0000","last_change":"2024-03-04T13:01:03.225581+0000","last_active":"2024-03-04T13:01:03.225563+0000","last_peered":"2024-03-04T13:01:03.225563+0000","last_clean":"2024-03-04T13:01:03.225563+0000","last_became_active":"2024-03-04T12:35:54.470620+0000","last_became_peered":"2024-03-04T12:35:54.470620+0000","last_unstale":"2024-03-04T13:01:03.225563+0000","last_undegraded":"2024-03-04T13:01:03.225563+0000","last_fullsized":"2024-03-04T13:01:03.225563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:03.225495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:03.225495+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.225495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:53.187584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.717113+0000","last_change":"2024-03-04T13:00:35.717113+0000","last_active":"2024-03-04T13:00:35.717113+0000","last_peered":"2024-03-04T13:00:35.717113+0000","last_clean":"2024-03-04T13:00:35.717113+0000","last_became_active":"2024-03-04T12:36:09.312135+0000","last_became_peered":"2024-03-04T12:36:09.312135+0000","last_unstale":"2024-03-04T13:00:35.717113+0000","last_undegraded":"2024-03-04T13:00:35.717113+0000","last_fullsized":"2024-03-04T13:00:35.717113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:35.716987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:35.716987+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.716987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:24.039129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"256'147","reported_seq":683,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.408264+0000","last_change":"2024-03-04T13:00:48.408264+0000","last_active":"2024-03-04T13:00:48.408264+0000","last_peered":"2024-03-04T13:00:48.408264+0000","last_clean":"2024-03-04T13:00:48.408264+0000","last_became_active":"2024-03-04T12:36:11.954579+0000","last_became_peered":"2024-03-04T12:36:11.954579+0000","last_unstale":"2024-03-04T13:00:48.408264+0000","last_undegraded":"2024-03-04T13:00:48.408264+0000","last_fullsized":"2024-03-04T13:00:48.408264+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'147","last_scrub_stamp":"2024-03-04T13:00:48.408112+0000","last_deep_scrub":"256'147","last_deep_scrub_stamp":"2024-03-04T13:00:48.408112+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.408112+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:32.843468+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":130,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2634,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"256'546","reported_seq":4073,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.400731+0000","last_change":"2024-03-04T13:00:38.400757+0000","last_active":"2024-03-04T13:00:38.400731+0000","last_peered":"2024-03-04T13:00:38.400731+0000","last_clean":"2024-03-04T13:00:38.400731+0000","last_became_active":"2024-03-04T12:36:13.341957+0000","last_became_peered":"2024-03-04T12:36:13.341957+0000","last_unstale":"2024-03-04T13:00:38.400731+0000","last_undegraded":"2024-03-04T13:00:38.400731+0000","last_fullsized":"2024-03-04T13:00:38.400731+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'546","last_scrub_stamp":"2024-03-04T13:00:38.400627+0000","last_deep_scrub":"256'546","last_deep_scrub_stamp":"2024-03-04T13:00:38.400627+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.400627+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:17.663169+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"256'125","reported_seq":608,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.712845+0000","last_change":"2024-03-04T13:00:29.712845+0000","last_active":"2024-03-04T13:00:29.712845+0000","last_peered":"2024-03-04T13:00:29.712845+0000","last_clean":"2024-03-04T13:00:29.712845+0000","last_became_active":"2024-03-04T12:36:15.355291+0000","last_became_peered":"2024-03-04T12:36:15.355291+0000","last_unstale":"2024-03-04T13:00:29.712845+0000","last_undegraded":"2024-03-04T13:00:29.712845+0000","last_fullsized":"2024-03-04T13:00:29.712845+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'125","last_scrub_stamp":"2024-03-04T13:00:29.712708+0000","last_deep_scrub":"256'125","last_deep_scrub_stamp":"2024-03-04T13:00:29.712708+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.712708+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:28:17.484104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"256'744","reported_seq":2171,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.599131+0000","last_change":"2024-03-04T13:01:01.599160+0000","last_active":"2024-03-04T13:01:01.599131+0000","last_peered":"2024-03-04T13:01:01.599131+0000","last_clean":"2024-03-04T13:01:01.599131+0000","last_became_active":"2024-03-04T12:36:07.289884+0000","last_became_peered":"2024-03-04T12:36:07.289884+0000","last_unstale":"2024-03-04T13:01:01.599131+0000","last_undegraded":"2024-03-04T13:01:01.599131+0000","last_fullsized":"2024-03-04T13:01:01.599131+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'744","last_scrub_stamp":"2024-03-04T13:01:01.599044+0000","last_deep_scrub":"256'744","last_deep_scrub_stamp":"2024-03-04T13:01:01.599044+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.599044+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:41:58.842864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3351,"num_read_kb":2980,"num_write":997,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"256'325","reported_seq":940,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:14.393058+0000","last_change":"2024-03-04T13:01:14.393099+0000","last_active":"2024-03-04T13:01:14.393058+0000","last_peered":"2024-03-04T13:01:14.393058+0000","last_clean":"2024-03-04T13:01:14.393058+0000","last_became_active":"2024-03-04T12:36:05.291549+0000","last_became_peered":"2024-03-04T12:36:05.291549+0000","last_unstale":"2024-03-04T13:01:14.393058+0000","last_undegraded":"2024-03-04T13:01:14.393058+0000","last_fullsized":"2024-03-04T13:01:14.393058+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'325","last_scrub_stamp":"2024-03-04T13:01:14.392974+0000","last_deep_scrub":"256'325","last_deep_scrub_stamp":"2024-03-04T13:01:14.392974+0000","last_clean_scrub_stamp":"2024-03-04T13:01:14.392974+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:15:11.976004+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194348,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":36332,"num_write":1128,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":502,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.379640+0000","last_change":"2024-03-04T13:00:52.379665+0000","last_active":"2024-03-04T13:00:52.379640+0000","last_peered":"2024-03-04T13:00:52.379640+0000","last_clean":"2024-03-04T13:00:52.379640+0000","last_became_active":"2024-03-04T12:35:54.238802+0000","last_became_peered":"2024-03-04T12:35:54.238802+0000","last_unstale":"2024-03-04T13:00:52.379640+0000","last_undegraded":"2024-03-04T13:00:52.379640+0000","last_fullsized":"2024-03-04T13:00:52.379640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:52.379542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:52.379542+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.379542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:34.687702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.037943+0000","last_change":"2024-03-04T13:00:54.037943+0000","last_active":"2024-03-04T13:00:54.037943+0000","last_peered":"2024-03-04T13:00:54.037943+0000","last_clean":"2024-03-04T13:00:54.037943+0000","last_became_active":"2024-03-04T12:36:09.307467+0000","last_became_peered":"2024-03-04T12:36:09.307467+0000","last_unstale":"2024-03-04T13:00:54.037943+0000","last_undegraded":"2024-03-04T13:00:54.037943+0000","last_fullsized":"2024-03-04T13:00:54.037943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:54.037801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:54.037801+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.037801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:19.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"256'83","reported_seq":600,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.149599+0000","last_change":"2024-03-04T13:00:37.149599+0000","last_active":"2024-03-04T13:00:37.149599+0000","last_peered":"2024-03-04T13:00:37.149599+0000","last_clean":"2024-03-04T13:00:37.149599+0000","last_became_active":"2024-03-04T12:36:11.325955+0000","last_became_peered":"2024-03-04T12:36:11.325955+0000","last_unstale":"2024-03-04T13:00:37.149599+0000","last_undegraded":"2024-03-04T13:00:37.149599+0000","last_fullsized":"2024-03-04T13:00:37.149599+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'83","last_scrub_stamp":"2024-03-04T13:00:37.149473+0000","last_deep_scrub":"256'83","last_deep_scrub_stamp":"2024-03-04T13:00:37.149473+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.149473+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:46:01.882397+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"256'535","reported_seq":1577,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.796546+0000","last_change":"2024-03-04T13:00:36.796546+0000","last_active":"2024-03-04T13:00:36.796546+0000","last_peered":"2024-03-04T13:00:36.796546+0000","last_clean":"2024-03-04T13:00:36.796546+0000","last_became_active":"2024-03-04T12:36:13.349421+0000","last_became_peered":"2024-03-04T12:36:13.349421+0000","last_unstale":"2024-03-04T13:00:36.796546+0000","last_undegraded":"2024-03-04T13:00:36.796546+0000","last_fullsized":"2024-03-04T13:00:36.796546+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'535","last_scrub_stamp":"2024-03-04T13:00:36.796431+0000","last_deep_scrub":"256'535","last_deep_scrub_stamp":"2024-03-04T13:00:36.796431+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.796431+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:02.418373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"256'96","reported_seq":575,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.623597+0000","last_change":"2024-03-04T13:00:35.623597+0000","last_active":"2024-03-04T13:00:35.623597+0000","last_peered":"2024-03-04T13:00:35.623597+0000","last_clean":"2024-03-04T13:00:35.623597+0000","last_became_active":"2024-03-04T12:36:15.356192+0000","last_became_peered":"2024-03-04T12:36:15.356192+0000","last_unstale":"2024-03-04T13:00:35.623597+0000","last_undegraded":"2024-03-04T13:00:35.623597+0000","last_fullsized":"2024-03-04T13:00:35.623597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'96","last_scrub_stamp":"2024-03-04T13:00:35.623431+0000","last_deep_scrub":"256'96","last_deep_scrub_stamp":"2024-03-04T13:00:35.623431+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.623431+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:27.378174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":232,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"256'392","reported_seq":1923,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.098548+0000","last_change":"2024-03-04T13:00:50.098548+0000","last_active":"2024-03-04T13:00:50.098548+0000","last_peered":"2024-03-04T13:00:50.098548+0000","last_clean":"2024-03-04T13:00:50.098548+0000","last_became_active":"2024-03-04T12:36:07.298963+0000","last_became_peered":"2024-03-04T12:36:07.298963+0000","last_unstale":"2024-03-04T13:00:50.098548+0000","last_undegraded":"2024-03-04T13:00:50.098548+0000","last_fullsized":"2024-03-04T13:00:50.098548+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'392","last_scrub_stamp":"2024-03-04T13:00:50.098367+0000","last_deep_scrub":"256'392","last_deep_scrub_stamp":"2024-03-04T13:00:50.098367+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.098367+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:40.850831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2139,"num_write":463,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2158,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"256'326","reported_seq":945,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:05.482272+0000","last_change":"2024-03-04T13:01:05.482311+0000","last_active":"2024-03-04T13:01:05.482272+0000","last_peered":"2024-03-04T13:01:05.482272+0000","last_clean":"2024-03-04T13:01:05.482272+0000","last_became_active":"2024-03-04T12:36:05.281790+0000","last_became_peered":"2024-03-04T12:36:05.281790+0000","last_unstale":"2024-03-04T13:01:05.482272+0000","last_undegraded":"2024-03-04T13:01:05.482272+0000","last_fullsized":"2024-03-04T13:01:05.482272+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'326","last_scrub_stamp":"2024-03-04T13:01:05.482199+0000","last_deep_scrub":"256'326","last_deep_scrub_stamp":"2024-03-04T13:01:05.482199+0000","last_clean_scrub_stamp":"2024-03-04T13:01:05.482199+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:31:38.423448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1778947,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":33441,"num_write":1185,"num_write_kb":31732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":497,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.775121+0000","last_change":"2024-03-04T13:00:48.775160+0000","last_active":"2024-03-04T13:00:48.775121+0000","last_peered":"2024-03-04T13:00:48.775121+0000","last_clean":"2024-03-04T13:00:48.775121+0000","last_became_active":"2024-03-04T12:35:54.238580+0000","last_became_peered":"2024-03-04T12:35:54.238580+0000","last_unstale":"2024-03-04T13:00:48.775121+0000","last_undegraded":"2024-03-04T13:00:48.775121+0000","last_fullsized":"2024-03-04T13:00:48.775121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:48.774977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:48.774977+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.774977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:53.947435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":486,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.557863+0000","last_change":"2024-03-04T13:01:02.557885+0000","last_active":"2024-03-04T13:01:02.557863+0000","last_peered":"2024-03-04T13:01:02.557863+0000","last_clean":"2024-03-04T13:01:02.557863+0000","last_became_active":"2024-03-04T12:36:09.308162+0000","last_became_peered":"2024-03-04T12:36:09.308162+0000","last_unstale":"2024-03-04T13:01:02.557863+0000","last_undegraded":"2024-03-04T13:01:02.557863+0000","last_fullsized":"2024-03-04T13:01:02.557863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:02.557760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:02.557760+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.557760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:42.744856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"256'712","reported_seq":1409,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:09.216183+0000","last_change":"2024-03-04T13:01:09.216183+0000","last_active":"2024-03-04T13:01:09.216183+0000","last_peered":"2024-03-04T13:01:09.216183+0000","last_clean":"2024-03-04T13:01:09.216183+0000","last_became_active":"2024-03-04T12:36:11.954569+0000","last_became_peered":"2024-03-04T12:36:11.954569+0000","last_unstale":"2024-03-04T13:01:09.216183+0000","last_undegraded":"2024-03-04T13:01:09.216183+0000","last_fullsized":"2024-03-04T13:01:09.216183+0000","mapping_epoch":26,"log_start":"256'700","ondisk_log_start":"256'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'712","last_scrub_stamp":"2024-03-04T13:01:09.216044+0000","last_deep_scrub":"256'712","last_deep_scrub_stamp":"2024-03-04T13:01:09.216044+0000","last_clean_scrub_stamp":"2024-03-04T13:01:09.216044+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":700,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:23.788802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140875,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1277,"num_read_kb":3093,"num_write":1046,"num_write_kb":893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.718951+0000","last_change":"2024-03-04T13:00:40.718951+0000","last_active":"2024-03-04T13:00:40.718951+0000","last_peered":"2024-03-04T13:00:40.718951+0000","last_clean":"2024-03-04T13:00:40.718951+0000","last_became_active":"2024-03-04T12:36:13.345919+0000","last_became_peered":"2024-03-04T12:36:13.345919+0000","last_unstale":"2024-03-04T13:00:40.718951+0000","last_undegraded":"2024-03-04T13:00:40.718951+0000","last_fullsized":"2024-03-04T13:00:40.718951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.718799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.718799+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.718799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:41.971577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"256'130","reported_seq":603,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.410237+0000","last_change":"2024-03-04T13:00:34.410237+0000","last_active":"2024-03-04T13:00:34.410237+0000","last_peered":"2024-03-04T13:00:34.410237+0000","last_clean":"2024-03-04T13:00:34.410237+0000","last_became_active":"2024-03-04T12:36:15.362710+0000","last_became_peered":"2024-03-04T12:36:15.362710+0000","last_unstale":"2024-03-04T13:00:34.410237+0000","last_undegraded":"2024-03-04T13:00:34.410237+0000","last_fullsized":"2024-03-04T13:00:34.410237+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'130","last_scrub_stamp":"2024-03-04T13:00:34.410088+0000","last_deep_scrub":"256'130","last_deep_scrub_stamp":"2024-03-04T13:00:34.410088+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.410088+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:38.504413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"256'110","reported_seq":581,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.566210+0000","last_change":"2024-03-04T13:00:31.566210+0000","last_active":"2024-03-04T13:00:31.566210+0000","last_peered":"2024-03-04T13:00:31.566210+0000","last_clean":"2024-03-04T13:00:31.566210+0000","last_became_active":"2024-03-04T12:36:15.363057+0000","last_became_peered":"2024-03-04T12:36:15.363057+0000","last_unstale":"2024-03-04T13:00:31.566210+0000","last_undegraded":"2024-03-04T13:00:31.566210+0000","last_fullsized":"2024-03-04T13:00:31.566210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'110","last_scrub_stamp":"2024-03-04T13:00:31.566095+0000","last_deep_scrub":"256'110","last_deep_scrub_stamp":"2024-03-04T13:00:31.566095+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.566095+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:05:38.612505+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":263,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"256'522","reported_seq":2080,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.055992+0000","last_change":"2024-03-04T13:00:49.056032+0000","last_active":"2024-03-04T13:00:49.055992+0000","last_peered":"2024-03-04T13:00:49.055992+0000","last_clean":"2024-03-04T13:00:49.055992+0000","last_became_active":"2024-03-04T12:36:07.292930+0000","last_became_peered":"2024-03-04T12:36:07.292930+0000","last_unstale":"2024-03-04T13:00:49.055992+0000","last_undegraded":"2024-03-04T13:00:49.055992+0000","last_fullsized":"2024-03-04T13:00:49.055992+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'522","last_scrub_stamp":"2024-03-04T13:00:49.055892+0000","last_deep_scrub":"256'522","last_deep_scrub_stamp":"2024-03-04T13:00:49.055892+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.055892+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:28.787689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2723,"num_read_kb":2502,"num_write":698,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":218,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"256'330","reported_seq":975,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.058515+0000","last_change":"2024-03-04T13:00:58.058608+0000","last_active":"2024-03-04T13:00:58.058515+0000","last_peered":"2024-03-04T13:00:58.058515+0000","last_clean":"2024-03-04T13:00:58.058515+0000","last_became_active":"2024-03-04T12:36:05.287299+0000","last_became_peered":"2024-03-04T12:36:05.287299+0000","last_unstale":"2024-03-04T13:00:58.058515+0000","last_undegraded":"2024-03-04T13:00:58.058515+0000","last_fullsized":"2024-03-04T13:00:58.058515+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'330","last_scrub_stamp":"2024-03-04T13:00:58.058418+0000","last_deep_scrub":"256'330","last_deep_scrub_stamp":"2024-03-04T13:00:58.058418+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.058418+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:53.837362+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2779056,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":31884,"num_write":1263,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"256'4","reported_seq":798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.367405+0000","last_change":"2024-03-04T13:00:42.367433+0000","last_active":"2024-03-04T13:00:42.367405+0000","last_peered":"2024-03-04T13:00:42.367405+0000","last_clean":"2024-03-04T13:00:42.367405+0000","last_became_active":"2024-03-04T12:36:09.314810+0000","last_became_peered":"2024-03-04T12:36:09.314810+0000","last_unstale":"2024-03-04T13:00:42.367405+0000","last_undegraded":"2024-03-04T13:00:42.367405+0000","last_fullsized":"2024-03-04T13:00:42.367405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:42.367302+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:42.367302+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.367302+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:56:47.240397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"256'251","reported_seq":804,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.664040+0000","last_change":"2024-03-04T13:00:48.664108+0000","last_active":"2024-03-04T13:00:48.664040+0000","last_peered":"2024-03-04T13:00:48.664040+0000","last_clean":"2024-03-04T13:00:48.664040+0000","last_became_active":"2024-03-04T12:36:11.323046+0000","last_became_peered":"2024-03-04T12:36:11.323046+0000","last_unstale":"2024-03-04T13:00:48.664040+0000","last_undegraded":"2024-03-04T13:00:48.664040+0000","last_fullsized":"2024-03-04T13:00:48.664040+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'251","last_scrub_stamp":"2024-03-04T13:00:48.663931+0000","last_deep_scrub":"256'251","last_deep_scrub_stamp":"2024-03-04T13:00:48.663931+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.663931+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:33:25.003667+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51487,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":943,"num_write":330,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.767813+0000","last_change":"2024-03-04T13:00:37.767846+0000","last_active":"2024-03-04T13:00:37.767813+0000","last_peered":"2024-03-04T13:00:37.767813+0000","last_clean":"2024-03-04T13:00:37.767813+0000","last_became_active":"2024-03-04T12:36:13.348696+0000","last_became_peered":"2024-03-04T12:36:13.348696+0000","last_unstale":"2024-03-04T13:00:37.767813+0000","last_undegraded":"2024-03-04T13:00:37.767813+0000","last_fullsized":"2024-03-04T13:00:37.767813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.767716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.767716+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.767716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:39.879058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"256'83","reported_seq":563,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.806585+0000","last_change":"2024-03-04T13:00:32.806636+0000","last_active":"2024-03-04T13:00:32.806585+0000","last_peered":"2024-03-04T13:00:32.806585+0000","last_clean":"2024-03-04T13:00:32.806585+0000","last_became_active":"2024-03-04T12:36:15.354258+0000","last_became_peered":"2024-03-04T12:36:15.354258+0000","last_unstale":"2024-03-04T13:00:32.806585+0000","last_undegraded":"2024-03-04T13:00:32.806585+0000","last_fullsized":"2024-03-04T13:00:32.806585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'83","last_scrub_stamp":"2024-03-04T13:00:32.806479+0000","last_deep_scrub":"256'83","last_deep_scrub_stamp":"2024-03-04T13:00:32.806479+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.806479+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:51:22.735435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":75,"num_write":188,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"256'356","reported_seq":1714,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.402045+0000","last_change":"2024-03-04T13:00:51.402077+0000","last_active":"2024-03-04T13:00:51.402045+0000","last_peered":"2024-03-04T13:00:51.402045+0000","last_clean":"2024-03-04T13:00:51.402045+0000","last_became_active":"2024-03-04T12:36:07.295803+0000","last_became_peered":"2024-03-04T12:36:07.295803+0000","last_unstale":"2024-03-04T13:00:51.402045+0000","last_undegraded":"2024-03-04T13:00:51.402045+0000","last_fullsized":"2024-03-04T13:00:51.402045+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'356","last_scrub_stamp":"2024-03-04T13:00:51.401953+0000","last_deep_scrub":"256'356","last_deep_scrub_stamp":"2024-03-04T13:00:51.401953+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.401953+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:06.068752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1867,"num_read_kb":1777,"num_write":399,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"256'341","reported_seq":965,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.279610+0000","last_change":"2024-03-04T13:00:56.279707+0000","last_active":"2024-03-04T13:00:56.279610+0000","last_peered":"2024-03-04T13:00:56.279610+0000","last_clean":"2024-03-04T13:00:56.279610+0000","last_became_active":"2024-03-04T12:36:05.296032+0000","last_became_peered":"2024-03-04T12:36:05.296032+0000","last_unstale":"2024-03-04T13:00:56.279610+0000","last_undegraded":"2024-03-04T13:00:56.279610+0000","last_fullsized":"2024-03-04T13:00:56.279610+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'341","last_scrub_stamp":"2024-03-04T13:00:56.279479+0000","last_deep_scrub":"256'341","last_deep_scrub_stamp":"2024-03-04T13:00:56.279479+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.279479+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:25:58.021440+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2492708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":28471,"num_write":1139,"num_write_kb":37420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:16.442219+0000","last_change":"2024-03-04T13:01:16.442252+0000","last_active":"2024-03-04T13:01:16.442219+0000","last_peered":"2024-03-04T13:01:16.442219+0000","last_clean":"2024-03-04T13:01:16.442219+0000","last_became_active":"2024-03-04T12:36:09.311953+0000","last_became_peered":"2024-03-04T12:36:09.311953+0000","last_unstale":"2024-03-04T13:01:16.442219+0000","last_undegraded":"2024-03-04T13:01:16.442219+0000","last_fullsized":"2024-03-04T13:01:16.442219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:16.442129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:16.442129+0000","last_clean_scrub_stamp":"2024-03-04T13:01:16.442129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:59:43.229448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"256'34","reported_seq":516,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.427415+0000","last_change":"2024-03-04T13:01:00.427455+0000","last_active":"2024-03-04T13:01:00.427415+0000","last_peered":"2024-03-04T13:01:00.427415+0000","last_clean":"2024-03-04T13:01:00.427415+0000","last_became_active":"2024-03-04T12:36:11.326313+0000","last_became_peered":"2024-03-04T12:36:11.326313+0000","last_unstale":"2024-03-04T13:01:00.427415+0000","last_undegraded":"2024-03-04T13:01:00.427415+0000","last_fullsized":"2024-03-04T13:01:00.427415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'34","last_scrub_stamp":"2024-03-04T13:01:00.427338+0000","last_deep_scrub":"256'34","last_deep_scrub_stamp":"2024-03-04T13:01:00.427338+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.427338+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:33:09.282435+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.235834+0000","last_change":"2024-03-04T13:00:37.235857+0000","last_active":"2024-03-04T13:00:37.235834+0000","last_peered":"2024-03-04T13:00:37.235834+0000","last_clean":"2024-03-04T13:00:37.235834+0000","last_became_active":"2024-03-04T12:36:13.340203+0000","last_became_peered":"2024-03-04T12:36:13.340203+0000","last_unstale":"2024-03-04T13:00:37.235834+0000","last_undegraded":"2024-03-04T13:00:37.235834+0000","last_fullsized":"2024-03-04T13:00:37.235834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.235747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.235747+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.235747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:37.493747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"256'90","reported_seq":574,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.583607+0000","last_change":"2024-03-04T13:00:36.583607+0000","last_active":"2024-03-04T13:00:36.583607+0000","last_peered":"2024-03-04T13:00:36.583607+0000","last_clean":"2024-03-04T13:00:36.583607+0000","last_became_active":"2024-03-04T12:36:15.353545+0000","last_became_peered":"2024-03-04T12:36:15.353545+0000","last_unstale":"2024-03-04T13:00:36.583607+0000","last_undegraded":"2024-03-04T13:00:36.583607+0000","last_fullsized":"2024-03-04T13:00:36.583607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'90","last_scrub_stamp":"2024-03-04T13:00:36.583455+0000","last_deep_scrub":"256'90","last_deep_scrub_stamp":"2024-03-04T13:00:36.583455+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.583455+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:57:03.167360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":106,"num_write":213,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"256'994","reported_seq":2552,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.661437+0000","last_change":"2024-03-04T13:00:54.661462+0000","last_active":"2024-03-04T13:00:54.661437+0000","last_peered":"2024-03-04T13:00:54.661437+0000","last_clean":"2024-03-04T13:00:54.661437+0000","last_became_active":"2024-03-04T12:36:07.299326+0000","last_became_peered":"2024-03-04T12:36:07.299326+0000","last_unstale":"2024-03-04T13:00:54.661437+0000","last_undegraded":"2024-03-04T13:00:54.661437+0000","last_fullsized":"2024-03-04T13:00:54.661437+0000","mapping_epoch":22,"log_start":"256'900","ondisk_log_start":"256'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'994","last_scrub_stamp":"2024-03-04T13:00:54.661340+0000","last_deep_scrub":"256'994","last_deep_scrub_stamp":"2024-03-04T13:00:54.661340+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.661340+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:21.655756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4343,"num_read_kb":3801,"num_write":1436,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"256'329","reported_seq":976,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.205823+0000","last_change":"2024-03-04T13:01:00.205887+0000","last_active":"2024-03-04T13:01:00.205823+0000","last_peered":"2024-03-04T13:01:00.205823+0000","last_clean":"2024-03-04T13:01:00.205823+0000","last_became_active":"2024-03-04T12:36:05.287185+0000","last_became_peered":"2024-03-04T12:36:05.287185+0000","last_unstale":"2024-03-04T13:01:00.205823+0000","last_undegraded":"2024-03-04T13:01:00.205823+0000","last_fullsized":"2024-03-04T13:01:00.205823+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'329","last_scrub_stamp":"2024-03-04T13:01:00.205728+0000","last_deep_scrub":"256'329","last_deep_scrub_stamp":"2024-03-04T13:01:00.205728+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.205728+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:01:05.983210+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730133,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":528,"num_read_kb":7345,"num_write":1182,"num_write_kb":36636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":486,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.339216+0000","last_change":"2024-03-04T13:00:47.339239+0000","last_active":"2024-03-04T13:00:47.339216+0000","last_peered":"2024-03-04T13:00:47.339216+0000","last_clean":"2024-03-04T13:00:47.339216+0000","last_became_active":"2024-03-04T12:36:09.305288+0000","last_became_peered":"2024-03-04T12:36:09.305288+0000","last_unstale":"2024-03-04T13:00:47.339216+0000","last_undegraded":"2024-03-04T13:00:47.339216+0000","last_fullsized":"2024-03-04T13:00:47.339216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:47.339124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:47.339124+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.339124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:03:14.121891+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"256'296","reported_seq":864,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.653476+0000","last_change":"2024-03-04T13:00:47.653514+0000","last_active":"2024-03-04T13:00:47.653476+0000","last_peered":"2024-03-04T13:00:47.653476+0000","last_clean":"2024-03-04T13:00:47.653476+0000","last_became_active":"2024-03-04T12:36:11.324758+0000","last_became_peered":"2024-03-04T12:36:11.324758+0000","last_unstale":"2024-03-04T13:00:47.653476+0000","last_undegraded":"2024-03-04T13:00:47.653476+0000","last_fullsized":"2024-03-04T13:00:47.653476+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'296","last_scrub_stamp":"2024-03-04T13:00:47.653383+0000","last_deep_scrub":"256'296","last_deep_scrub_stamp":"2024-03-04T13:00:47.653383+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.653383+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:52.144236+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":483,"num_read_kb":1065,"num_write":390,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.725145+0000","last_change":"2024-03-04T13:00:38.725169+0000","last_active":"2024-03-04T13:00:38.725145+0000","last_peered":"2024-03-04T13:00:38.725145+0000","last_clean":"2024-03-04T13:00:38.725145+0000","last_became_active":"2024-03-04T12:36:13.345556+0000","last_became_peered":"2024-03-04T12:36:13.345556+0000","last_unstale":"2024-03-04T13:00:38.725145+0000","last_undegraded":"2024-03-04T13:00:38.725145+0000","last_fullsized":"2024-03-04T13:00:38.725145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:38.725031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:38.725031+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.725031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:46.207626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"256'172","reported_seq":668,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.459299+0000","last_change":"2024-03-04T13:00:30.459299+0000","last_active":"2024-03-04T13:00:30.459299+0000","last_peered":"2024-03-04T13:00:30.459299+0000","last_clean":"2024-03-04T13:00:30.459299+0000","last_became_active":"2024-03-04T12:36:15.363544+0000","last_became_peered":"2024-03-04T12:36:15.363544+0000","last_unstale":"2024-03-04T13:00:30.459299+0000","last_undegraded":"2024-03-04T13:00:30.459299+0000","last_fullsized":"2024-03-04T13:00:30.459299+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'172","last_scrub_stamp":"2024-03-04T13:00:30.459143+0000","last_deep_scrub":"256'172","last_deep_scrub_stamp":"2024-03-04T13:00:30.459143+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.459143+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:00:31.537557+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":198,"num_write":386,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"256'403","reported_seq":1844,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.635123+0000","last_change":"2024-03-04T13:00:55.635173+0000","last_active":"2024-03-04T13:00:55.635123+0000","last_peered":"2024-03-04T13:00:55.635123+0000","last_clean":"2024-03-04T13:00:55.635123+0000","last_became_active":"2024-03-04T12:36:07.292814+0000","last_became_peered":"2024-03-04T12:36:07.292814+0000","last_unstale":"2024-03-04T13:00:55.635123+0000","last_undegraded":"2024-03-04T13:00:55.635123+0000","last_fullsized":"2024-03-04T13:00:55.635123+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'403","last_scrub_stamp":"2024-03-04T13:00:55.635023+0000","last_deep_scrub":"256'403","last_deep_scrub_stamp":"2024-03-04T13:00:55.635023+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.635023+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:57:31.355683+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2067,"num_read_kb":1953,"num_write":480,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"256'310","reported_seq":913,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.561357+0000","last_change":"2024-03-04T13:00:28.561406+0000","last_active":"2024-03-04T13:00:28.561357+0000","last_peered":"2024-03-04T13:00:28.561357+0000","last_clean":"2024-03-04T13:00:28.561357+0000","last_became_active":"2024-03-04T12:36:40.964989+0000","last_became_peered":"2024-03-04T12:36:40.964989+0000","last_unstale":"2024-03-04T13:00:28.561357+0000","last_undegraded":"2024-03-04T13:00:28.561357+0000","last_fullsized":"2024-03-04T13:00:28.561357+0000","mapping_epoch":33,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'310","last_scrub_stamp":"2024-03-04T13:00:28.561273+0000","last_deep_scrub":"256'310","last_deep_scrub_stamp":"2024-03-04T13:00:28.561273+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.561273+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:45:32.752696+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":22171,"num_write":1178,"num_write_kb":35457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.720495+0000","last_change":"2024-03-04T13:00:37.720522+0000","last_active":"2024-03-04T13:00:37.720495+0000","last_peered":"2024-03-04T13:00:37.720495+0000","last_clean":"2024-03-04T13:00:37.720495+0000","last_became_active":"2024-03-04T12:36:09.309883+0000","last_became_peered":"2024-03-04T12:36:09.309883+0000","last_unstale":"2024-03-04T13:00:37.720495+0000","last_undegraded":"2024-03-04T13:00:37.720495+0000","last_fullsized":"2024-03-04T13:00:37.720495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.720405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.720405+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.720405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:04.234972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"256'256","reported_seq":808,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.287654+0000","last_change":"2024-03-04T13:00:57.287688+0000","last_active":"2024-03-04T13:00:57.287654+0000","last_peered":"2024-03-04T13:00:57.287654+0000","last_clean":"2024-03-04T13:00:57.287654+0000","last_became_active":"2024-03-04T12:36:11.324784+0000","last_became_peered":"2024-03-04T12:36:11.324784+0000","last_unstale":"2024-03-04T13:00:57.287654+0000","last_undegraded":"2024-03-04T13:00:57.287654+0000","last_fullsized":"2024-03-04T13:00:57.287654+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'256","last_scrub_stamp":"2024-03-04T13:00:57.287531+0000","last_deep_scrub":"256'256","last_deep_scrub_stamp":"2024-03-04T13:00:57.287531+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.287531+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:25:13.049620+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54138,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":1067,"num_write":352,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.556862+0000","last_change":"2024-03-04T13:00:40.556902+0000","last_active":"2024-03-04T13:00:40.556862+0000","last_peered":"2024-03-04T13:00:40.556862+0000","last_clean":"2024-03-04T13:00:40.556862+0000","last_became_active":"2024-03-04T12:36:13.343030+0000","last_became_peered":"2024-03-04T12:36:13.343030+0000","last_unstale":"2024-03-04T13:00:40.556862+0000","last_undegraded":"2024-03-04T13:00:40.556862+0000","last_fullsized":"2024-03-04T13:00:40.556862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.556715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.556715+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.556715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:11:37.035294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"256'689","reported_seq":2146,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.766580+0000","last_change":"2024-03-04T13:00:45.766580+0000","last_active":"2024-03-04T13:00:45.766580+0000","last_peered":"2024-03-04T13:00:45.766580+0000","last_clean":"2024-03-04T13:00:45.766580+0000","last_became_active":"2024-03-04T12:36:07.298154+0000","last_became_peered":"2024-03-04T12:36:07.298154+0000","last_unstale":"2024-03-04T13:00:45.766580+0000","last_undegraded":"2024-03-04T13:00:45.766580+0000","last_fullsized":"2024-03-04T13:00:45.766580+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'689","last_scrub_stamp":"2024-03-04T13:00:45.766448+0000","last_deep_scrub":"256'689","last_deep_scrub_stamp":"2024-03-04T13:00:45.766448+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.766448+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":600,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:58.758338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3209,"num_read_kb":2902,"num_write":904,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1913,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"256'322","reported_seq":1033,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:12.389443+0000","last_change":"2024-03-04T13:01:12.389487+0000","last_active":"2024-03-04T13:01:12.389443+0000","last_peered":"2024-03-04T13:01:12.389443+0000","last_clean":"2024-03-04T13:01:12.389443+0000","last_became_active":"2024-03-04T12:36:05.287329+0000","last_became_peered":"2024-03-04T12:36:05.287329+0000","last_unstale":"2024-03-04T13:01:12.389443+0000","last_undegraded":"2024-03-04T13:01:12.389443+0000","last_fullsized":"2024-03-04T13:01:12.389443+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'322","last_scrub_stamp":"2024-03-04T13:01:12.389344+0000","last_deep_scrub":"256'322","last_deep_scrub_stamp":"2024-03-04T13:01:12.389344+0000","last_clean_scrub_stamp":"2024-03-04T13:01:12.389344+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:50.607378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":51334,"num_write":1200,"num_write_kb":22699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.493036+0000","last_change":"2024-03-04T13:00:52.493071+0000","last_active":"2024-03-04T13:00:52.493036+0000","last_peered":"2024-03-04T13:00:52.493036+0000","last_clean":"2024-03-04T13:00:52.493036+0000","last_became_active":"2024-03-04T12:36:09.307329+0000","last_became_peered":"2024-03-04T12:36:09.307329+0000","last_unstale":"2024-03-04T13:00:52.493036+0000","last_undegraded":"2024-03-04T13:00:52.493036+0000","last_fullsized":"2024-03-04T13:00:52.493036+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:52.492916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:52.492916+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.492916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:14:55.192962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"256'416","reported_seq":1030,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.373675+0000","last_change":"2024-03-04T13:00:44.373675+0000","last_active":"2024-03-04T13:00:44.373675+0000","last_peered":"2024-03-04T13:00:44.373675+0000","last_clean":"2024-03-04T13:00:44.373675+0000","last_became_active":"2024-03-04T12:36:11.323506+0000","last_became_peered":"2024-03-04T12:36:11.323506+0000","last_unstale":"2024-03-04T13:00:44.373675+0000","last_undegraded":"2024-03-04T13:00:44.373675+0000","last_fullsized":"2024-03-04T13:00:44.373675+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'416","last_scrub_stamp":"2024-03-04T13:00:44.373504+0000","last_deep_scrub":"256'416","last_deep_scrub_stamp":"2024-03-04T13:00:44.373504+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.373504+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:17.615777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114357,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":734,"num_read_kb":1796,"num_write":592,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.405124+0000","last_change":"2024-03-04T13:00:37.405124+0000","last_active":"2024-03-04T13:00:37.405124+0000","last_peered":"2024-03-04T13:00:37.405124+0000","last_clean":"2024-03-04T13:00:37.405124+0000","last_became_active":"2024-03-04T12:36:13.346628+0000","last_became_peered":"2024-03-04T12:36:13.346628+0000","last_unstale":"2024-03-04T13:00:37.405124+0000","last_undegraded":"2024-03-04T13:00:37.405124+0000","last_fullsized":"2024-03-04T13:00:37.405124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.404992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.404992+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.404992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:53:15.725542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"256'167","reported_seq":654,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.777427+0000","last_change":"2024-03-04T13:00:31.777458+0000","last_active":"2024-03-04T13:00:31.777427+0000","last_peered":"2024-03-04T13:00:31.777427+0000","last_clean":"2024-03-04T13:00:31.777427+0000","last_became_active":"2024-03-04T12:36:15.354125+0000","last_became_peered":"2024-03-04T12:36:15.354125+0000","last_unstale":"2024-03-04T13:00:31.777427+0000","last_undegraded":"2024-03-04T13:00:31.777427+0000","last_fullsized":"2024-03-04T13:00:31.777427+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'167","last_scrub_stamp":"2024-03-04T13:00:31.777324+0000","last_deep_scrub":"256'167","last_deep_scrub_stamp":"2024-03-04T13:00:31.777324+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.777324+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:56:57.666876+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":203,"num_write":373,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"256'1142","reported_seq":2724,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.484360+0000","last_change":"2024-03-04T13:00:55.484393+0000","last_active":"2024-03-04T13:00:55.484360+0000","last_peered":"2024-03-04T13:00:55.484360+0000","last_clean":"2024-03-04T13:00:55.484360+0000","last_became_active":"2024-03-04T12:36:07.298434+0000","last_became_peered":"2024-03-04T12:36:07.298434+0000","last_unstale":"2024-03-04T13:00:55.484360+0000","last_undegraded":"2024-03-04T13:00:55.484360+0000","last_fullsized":"2024-03-04T13:00:55.484360+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1142","last_scrub_stamp":"2024-03-04T13:00:55.484270+0000","last_deep_scrub":"256'1142","last_deep_scrub_stamp":"2024-03-04T13:00:55.484270+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.484270+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:45.148303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4934,"num_read_kb":4324,"num_write":1585,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"256'406","reported_seq":1058,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.377065+0000","last_change":"2024-03-04T13:00:58.377161+0000","last_active":"2024-03-04T13:00:58.377065+0000","last_peered":"2024-03-04T13:00:58.377065+0000","last_clean":"2024-03-04T13:00:58.377065+0000","last_became_active":"2024-03-04T12:36:05.287506+0000","last_became_peered":"2024-03-04T12:36:05.287506+0000","last_unstale":"2024-03-04T13:00:58.377065+0000","last_undegraded":"2024-03-04T13:00:58.377065+0000","last_fullsized":"2024-03-04T13:00:58.377065+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'406","last_scrub_stamp":"2024-03-04T13:00:58.376966+0000","last_deep_scrub":"256'406","last_deep_scrub_stamp":"2024-03-04T13:00:58.376966+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.376966+0000","objects_scrubbed":10,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:41.393895+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6658491,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":603,"num_read_kb":47023,"num_write":1149,"num_write_kb":33887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.716223+0000","last_change":"2024-03-04T13:00:39.716223+0000","last_active":"2024-03-04T13:00:39.716223+0000","last_peered":"2024-03-04T13:00:39.716223+0000","last_clean":"2024-03-04T13:00:39.716223+0000","last_became_active":"2024-03-04T12:36:09.309155+0000","last_became_peered":"2024-03-04T12:36:09.309155+0000","last_unstale":"2024-03-04T13:00:39.716223+0000","last_undegraded":"2024-03-04T13:00:39.716223+0000","last_fullsized":"2024-03-04T13:00:39.716223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.716073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.716073+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.716073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:43.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"256'282","reported_seq":843,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.268458+0000","last_change":"2024-03-04T13:00:55.268458+0000","last_active":"2024-03-04T13:00:55.268458+0000","last_peered":"2024-03-04T13:00:55.268458+0000","last_clean":"2024-03-04T13:00:55.268458+0000","last_became_active":"2024-03-04T12:36:11.323320+0000","last_became_peered":"2024-03-04T12:36:11.323320+0000","last_unstale":"2024-03-04T13:00:55.268458+0000","last_undegraded":"2024-03-04T13:00:55.268458+0000","last_fullsized":"2024-03-04T13:00:55.268458+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'282","last_scrub_stamp":"2024-03-04T13:00:55.268308+0000","last_deep_scrub":"256'282","last_deep_scrub_stamp":"2024-03-04T13:00:55.268308+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.268308+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:00:22.716350+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44965,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":1036,"num_write":392,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.394123+0000","last_change":"2024-03-04T13:01:00.394123+0000","last_active":"2024-03-04T13:01:00.394123+0000","last_peered":"2024-03-04T13:01:00.394123+0000","last_clean":"2024-03-04T13:01:00.394123+0000","last_became_active":"2024-03-04T12:36:13.340525+0000","last_became_peered":"2024-03-04T12:36:13.340525+0000","last_unstale":"2024-03-04T13:01:00.394123+0000","last_undegraded":"2024-03-04T13:01:00.394123+0000","last_fullsized":"2024-03-04T13:01:00.394123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:00.393973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:00.393973+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.393973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:26:20.188259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"256'159","reported_seq":993,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.793826+0000","last_change":"2024-03-04T13:00:44.793864+0000","last_active":"2024-03-04T13:00:44.793826+0000","last_peered":"2024-03-04T13:00:44.793826+0000","last_clean":"2024-03-04T13:00:44.793826+0000","last_became_active":"2024-03-04T12:36:15.362749+0000","last_became_peered":"2024-03-04T12:36:15.362749+0000","last_unstale":"2024-03-04T13:00:44.793826+0000","last_undegraded":"2024-03-04T13:00:44.793826+0000","last_fullsized":"2024-03-04T13:00:44.793826+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'159","last_scrub_stamp":"2024-03-04T13:00:44.793731+0000","last_deep_scrub":"256'159","last_deep_scrub_stamp":"2024-03-04T13:00:44.793731+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.793731+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:46:09.922195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":549,"num_write":456,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"256'355","reported_seq":1709,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.596079+0000","last_change":"2024-03-04T13:00:59.596079+0000","last_active":"2024-03-04T13:00:59.596079+0000","last_peered":"2024-03-04T13:00:59.596079+0000","last_clean":"2024-03-04T13:00:59.596079+0000","last_became_active":"2024-03-04T12:36:07.292806+0000","last_became_peered":"2024-03-04T12:36:07.292806+0000","last_unstale":"2024-03-04T13:00:59.596079+0000","last_undegraded":"2024-03-04T13:00:59.596079+0000","last_fullsized":"2024-03-04T13:00:59.596079+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'355","last_scrub_stamp":"2024-03-04T13:00:59.595934+0000","last_deep_scrub":"256'355","last_deep_scrub_stamp":"2024-03-04T13:00:59.595934+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.595934+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:05.865984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1929,"num_read_kb":1816,"num_write":430,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"256'322","reported_seq":968,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.027192+0000","last_change":"2024-03-04T13:01:00.027192+0000","last_active":"2024-03-04T13:01:00.027192+0000","last_peered":"2024-03-04T13:01:00.027192+0000","last_clean":"2024-03-04T13:01:00.027192+0000","last_became_active":"2024-03-04T12:36:05.289053+0000","last_became_peered":"2024-03-04T12:36:05.289053+0000","last_unstale":"2024-03-04T13:01:00.027192+0000","last_undegraded":"2024-03-04T13:01:00.027192+0000","last_fullsized":"2024-03-04T13:01:00.027192+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'322","last_scrub_stamp":"2024-03-04T13:01:00.027054+0000","last_deep_scrub":"256'322","last_deep_scrub_stamp":"2024-03-04T13:01:00.027054+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.027054+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:43.626153+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2688993,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":60644,"num_write":1189,"num_write_kb":49301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.060387+0000","last_change":"2024-03-04T13:00:56.060387+0000","last_active":"2024-03-04T13:00:56.060387+0000","last_peered":"2024-03-04T13:00:56.060387+0000","last_clean":"2024-03-04T13:00:56.060387+0000","last_became_active":"2024-03-04T12:36:09.308231+0000","last_became_peered":"2024-03-04T12:36:09.308231+0000","last_unstale":"2024-03-04T13:00:56.060387+0000","last_undegraded":"2024-03-04T13:00:56.060387+0000","last_fullsized":"2024-03-04T13:00:56.060387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:56.060200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:56.060200+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.060200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:48:33.656726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"256'281","reported_seq":836,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.683361+0000","last_change":"2024-03-04T13:00:43.683361+0000","last_active":"2024-03-04T13:00:43.683361+0000","last_peered":"2024-03-04T13:00:43.683361+0000","last_clean":"2024-03-04T13:00:43.683361+0000","last_became_active":"2024-03-04T12:36:11.954568+0000","last_became_peered":"2024-03-04T12:36:11.954568+0000","last_unstale":"2024-03-04T13:00:43.683361+0000","last_undegraded":"2024-03-04T13:00:43.683361+0000","last_fullsized":"2024-03-04T13:00:43.683361+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'281","last_scrub_stamp":"2024-03-04T13:00:43.683206+0000","last_deep_scrub":"256'281","last_deep_scrub_stamp":"2024-03-04T13:00:43.683206+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.683206+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:03.087502+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47143,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":469,"num_read_kb":1144,"num_write":392,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.352755+0000","last_change":"2024-03-04T13:00:35.352796+0000","last_active":"2024-03-04T13:00:35.352755+0000","last_peered":"2024-03-04T13:00:35.352755+0000","last_clean":"2024-03-04T13:00:35.352755+0000","last_became_active":"2024-03-04T12:36:13.346665+0000","last_became_peered":"2024-03-04T12:36:13.346665+0000","last_unstale":"2024-03-04T13:00:35.352755+0000","last_undegraded":"2024-03-04T13:00:35.352755+0000","last_fullsized":"2024-03-04T13:00:35.352755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:35.352646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:35.352646+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.352646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:01.849654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'106","reported_seq":579,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.473585+0000","last_change":"2024-03-04T13:00:29.473616+0000","last_active":"2024-03-04T13:00:29.473585+0000","last_peered":"2024-03-04T13:00:29.473585+0000","last_clean":"2024-03-04T13:00:29.473585+0000","last_became_active":"2024-03-04T12:36:15.363269+0000","last_became_peered":"2024-03-04T12:36:15.363269+0000","last_unstale":"2024-03-04T13:00:29.473585+0000","last_undegraded":"2024-03-04T13:00:29.473585+0000","last_fullsized":"2024-03-04T13:00:29.473585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'106","last_scrub_stamp":"2024-03-04T13:00:29.473497+0000","last_deep_scrub":"256'106","last_deep_scrub_stamp":"2024-03-04T13:00:29.473497+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.473497+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:09.775009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"256'431","reported_seq":1950,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.119811+0000","last_change":"2024-03-04T13:00:45.119811+0000","last_active":"2024-03-04T13:00:45.119811+0000","last_peered":"2024-03-04T13:00:45.119811+0000","last_clean":"2024-03-04T13:00:45.119811+0000","last_became_active":"2024-03-04T12:36:07.295353+0000","last_became_peered":"2024-03-04T12:36:07.295353+0000","last_unstale":"2024-03-04T13:00:45.119811+0000","last_undegraded":"2024-03-04T13:00:45.119811+0000","last_fullsized":"2024-03-04T13:00:45.119811+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'431","last_scrub_stamp":"2024-03-04T13:00:45.119711+0000","last_deep_scrub":"256'431","last_deep_scrub_stamp":"2024-03-04T13:00:45.119711+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.119711+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:51.239371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2362,"num_read_kb":2211,"num_write":524,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"256'521","reported_seq":1177,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.517974+0000","last_change":"2024-03-04T13:01:03.517974+0000","last_active":"2024-03-04T13:01:03.517974+0000","last_peered":"2024-03-04T13:01:03.517974+0000","last_clean":"2024-03-04T13:01:03.517974+0000","last_became_active":"2024-03-04T12:36:05.293646+0000","last_became_peered":"2024-03-04T12:36:05.293646+0000","last_unstale":"2024-03-04T13:01:03.517974+0000","last_undegraded":"2024-03-04T13:01:03.517974+0000","last_fullsized":"2024-03-04T13:01:03.517974+0000","mapping_epoch":20,"log_start":"256'500","ondisk_log_start":"256'500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'521","last_scrub_stamp":"2024-03-04T13:01:03.517823+0000","last_deep_scrub":"256'521","last_deep_scrub_stamp":"2024-03-04T13:01:03.517823+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.517823+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:32:21.516935+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242951,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":853,"num_read_kb":46890,"num_write":1453,"num_write_kb":44359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.333662+0000","last_change":"2024-03-04T13:00:36.333662+0000","last_active":"2024-03-04T13:00:36.333662+0000","last_peered":"2024-03-04T13:00:36.333662+0000","last_clean":"2024-03-04T13:00:36.333662+0000","last_became_active":"2024-03-04T12:36:09.305073+0000","last_became_peered":"2024-03-04T12:36:09.305073+0000","last_unstale":"2024-03-04T13:00:36.333662+0000","last_undegraded":"2024-03-04T13:00:36.333662+0000","last_fullsized":"2024-03-04T13:00:36.333662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:36.333509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:36.333509+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.333509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:13.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"256'70","reported_seq":572,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.123546+0000","last_change":"2024-03-04T13:00:35.123593+0000","last_active":"2024-03-04T13:00:35.123546+0000","last_peered":"2024-03-04T13:00:35.123546+0000","last_clean":"2024-03-04T13:00:35.123546+0000","last_became_active":"2024-03-04T12:36:11.954563+0000","last_became_peered":"2024-03-04T12:36:11.954563+0000","last_unstale":"2024-03-04T13:00:35.123546+0000","last_undegraded":"2024-03-04T13:00:35.123546+0000","last_fullsized":"2024-03-04T13:00:35.123546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'70","last_scrub_stamp":"2024-03-04T13:00:35.123457+0000","last_deep_scrub":"256'70","last_deep_scrub_stamp":"2024-03-04T13:00:35.123457+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.123457+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:38.665714+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":71,"num_read_kb":64,"num_write":78,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"256'482","reported_seq":1817,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.719971+0000","last_change":"2024-03-04T13:00:33.719971+0000","last_active":"2024-03-04T13:00:33.719971+0000","last_peered":"2024-03-04T13:00:33.719971+0000","last_clean":"2024-03-04T13:00:33.719971+0000","last_became_active":"2024-03-04T12:36:13.340221+0000","last_became_peered":"2024-03-04T12:36:13.340221+0000","last_unstale":"2024-03-04T13:00:33.719971+0000","last_undegraded":"2024-03-04T13:00:33.719971+0000","last_fullsized":"2024-03-04T13:00:33.719971+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'482","last_scrub_stamp":"2024-03-04T13:00:33.719854+0000","last_deep_scrub":"256'482","last_deep_scrub_stamp":"2024-03-04T13:00:33.719854+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.719854+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:52.429432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"256'134","reported_seq":617,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.308023+0000","last_change":"2024-03-04T13:00:33.308076+0000","last_active":"2024-03-04T13:00:33.308023+0000","last_peered":"2024-03-04T13:00:33.308023+0000","last_clean":"2024-03-04T13:00:33.308023+0000","last_became_active":"2024-03-04T12:36:15.364688+0000","last_became_peered":"2024-03-04T12:36:15.364688+0000","last_unstale":"2024-03-04T13:00:33.308023+0000","last_undegraded":"2024-03-04T13:00:33.308023+0000","last_fullsized":"2024-03-04T13:00:33.308023+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'134","last_scrub_stamp":"2024-03-04T13:00:33.307905+0000","last_deep_scrub":"256'134","last_deep_scrub_stamp":"2024-03-04T13:00:33.307905+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.307905+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:36.869465+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":294,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"256'359","reported_seq":1832,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.976573+0000","last_change":"2024-03-04T13:01:03.976573+0000","last_active":"2024-03-04T13:01:03.976573+0000","last_peered":"2024-03-04T13:01:03.976573+0000","last_clean":"2024-03-04T13:01:03.976573+0000","last_became_active":"2024-03-04T12:36:07.290637+0000","last_became_peered":"2024-03-04T12:36:07.290637+0000","last_unstale":"2024-03-04T13:01:03.976573+0000","last_undegraded":"2024-03-04T13:01:03.976573+0000","last_fullsized":"2024-03-04T13:01:03.976573+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'359","last_scrub_stamp":"2024-03-04T13:01:03.976474+0000","last_deep_scrub":"256'359","last_deep_scrub_stamp":"2024-03-04T13:01:03.976474+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.976474+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:32:48.230833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1998,"num_read_kb":1913,"num_write":399,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"256'431","reported_seq":1094,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.216670+0000","last_change":"2024-03-04T13:00:57.216670+0000","last_active":"2024-03-04T13:00:57.216670+0000","last_peered":"2024-03-04T13:00:57.216670+0000","last_clean":"2024-03-04T13:00:57.216670+0000","last_became_active":"2024-03-04T12:36:05.294568+0000","last_became_peered":"2024-03-04T12:36:05.294568+0000","last_unstale":"2024-03-04T13:00:57.216670+0000","last_undegraded":"2024-03-04T13:00:57.216670+0000","last_fullsized":"2024-03-04T13:00:57.216670+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'431","last_scrub_stamp":"2024-03-04T13:00:57.216499+0000","last_deep_scrub":"256'431","last_deep_scrub_stamp":"2024-03-04T13:00:57.216499+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.216499+0000","objects_scrubbed":10,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:52.566960+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6680724,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":37257,"num_write":1366,"num_write_kb":50791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.292255+0000","last_change":"2024-03-04T13:00:49.292255+0000","last_active":"2024-03-04T13:00:49.292255+0000","last_peered":"2024-03-04T13:00:49.292255+0000","last_clean":"2024-03-04T13:00:49.292255+0000","last_became_active":"2024-03-04T12:36:09.306005+0000","last_became_peered":"2024-03-04T12:36:09.306005+0000","last_unstale":"2024-03-04T13:00:49.292255+0000","last_undegraded":"2024-03-04T13:00:49.292255+0000","last_fullsized":"2024-03-04T13:00:49.292255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:49.292136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:49.292136+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.292136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:16:56.573532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"256'279","reported_seq":837,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:06.291841+0000","last_change":"2024-03-04T13:01:06.291900+0000","last_active":"2024-03-04T13:01:06.291841+0000","last_peered":"2024-03-04T13:01:06.291841+0000","last_clean":"2024-03-04T13:01:06.291841+0000","last_became_active":"2024-03-04T12:36:11.325503+0000","last_became_peered":"2024-03-04T12:36:11.325503+0000","last_unstale":"2024-03-04T13:01:06.291841+0000","last_undegraded":"2024-03-04T13:01:06.291841+0000","last_fullsized":"2024-03-04T13:01:06.291841+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'279","last_scrub_stamp":"2024-03-04T13:01:06.291725+0000","last_deep_scrub":"256'279","last_deep_scrub_stamp":"2024-03-04T13:01:06.291725+0000","last_clean_scrub_stamp":"2024-03-04T13:01:06.291725+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:40:39.805289+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52232,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":458,"num_read_kb":1083,"num_write":374,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.438680+0000","last_change":"2024-03-04T13:00:45.438699+0000","last_active":"2024-03-04T13:00:45.438680+0000","last_peered":"2024-03-04T13:00:45.438680+0000","last_clean":"2024-03-04T13:00:45.438680+0000","last_became_active":"2024-03-04T12:36:13.339349+0000","last_became_peered":"2024-03-04T12:36:13.339349+0000","last_unstale":"2024-03-04T13:00:45.438680+0000","last_undegraded":"2024-03-04T13:00:45.438680+0000","last_fullsized":"2024-03-04T13:00:45.438680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:45.438606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:45.438606+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.438606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:36.229715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"256'112","reported_seq":648,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.281626+0000","last_change":"2024-03-04T13:00:36.281667+0000","last_active":"2024-03-04T13:00:36.281626+0000","last_peered":"2024-03-04T13:00:36.281626+0000","last_clean":"2024-03-04T13:00:36.281626+0000","last_became_active":"2024-03-04T12:36:15.352383+0000","last_became_peered":"2024-03-04T12:36:15.352383+0000","last_unstale":"2024-03-04T13:00:36.281626+0000","last_undegraded":"2024-03-04T13:00:36.281626+0000","last_fullsized":"2024-03-04T13:00:36.281626+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'112","last_scrub_stamp":"2024-03-04T13:00:36.281541+0000","last_deep_scrub":"256'112","last_deep_scrub_stamp":"2024-03-04T13:00:36.281541+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.281541+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:36:25.279505+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":264,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"256'407","reported_seq":1786,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.063218+0000","last_change":"2024-03-04T13:00:45.063218+0000","last_active":"2024-03-04T13:00:45.063218+0000","last_peered":"2024-03-04T13:00:45.063218+0000","last_clean":"2024-03-04T13:00:45.063218+0000","last_became_active":"2024-03-04T12:36:07.295956+0000","last_became_peered":"2024-03-04T12:36:07.295956+0000","last_unstale":"2024-03-04T13:00:45.063218+0000","last_undegraded":"2024-03-04T13:00:45.063218+0000","last_fullsized":"2024-03-04T13:00:45.063218+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'407","last_scrub_stamp":"2024-03-04T13:00:45.063058+0000","last_deep_scrub":"256'407","last_deep_scrub_stamp":"2024-03-04T13:00:45.063058+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.063058+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:45.236704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2057,"num_read_kb":1911,"num_write":497,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1661,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"256'294","reported_seq":896,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.156169+0000","last_change":"2024-03-04T13:00:55.156169+0000","last_active":"2024-03-04T13:00:55.156169+0000","last_peered":"2024-03-04T13:00:55.156169+0000","last_clean":"2024-03-04T13:00:55.156169+0000","last_became_active":"2024-03-04T12:36:05.294686+0000","last_became_peered":"2024-03-04T12:36:05.294686+0000","last_unstale":"2024-03-04T13:00:55.156169+0000","last_undegraded":"2024-03-04T13:00:55.156169+0000","last_fullsized":"2024-03-04T13:00:55.156169+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'294","last_scrub_stamp":"2024-03-04T13:00:55.156012+0000","last_deep_scrub":"256'294","last_deep_scrub_stamp":"2024-03-04T13:00:55.156012+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.156012+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:38:18.762691+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":38414,"num_write":1001,"num_write_kb":48852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.184676+0000","last_change":"2024-03-04T13:00:54.184676+0000","last_active":"2024-03-04T13:00:54.184676+0000","last_peered":"2024-03-04T13:00:54.184676+0000","last_clean":"2024-03-04T13:00:54.184676+0000","last_became_active":"2024-03-04T12:36:09.314912+0000","last_became_peered":"2024-03-04T12:36:09.314912+0000","last_unstale":"2024-03-04T13:00:54.184676+0000","last_undegraded":"2024-03-04T13:00:54.184676+0000","last_fullsized":"2024-03-04T13:00:54.184676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:54.184558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:54.184558+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.184558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:06.693943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"256'269","reported_seq":815,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.483058+0000","last_change":"2024-03-04T13:00:56.483127+0000","last_active":"2024-03-04T13:00:56.483058+0000","last_peered":"2024-03-04T13:00:56.483058+0000","last_clean":"2024-03-04T13:00:56.483058+0000","last_became_active":"2024-03-04T12:36:11.325238+0000","last_became_peered":"2024-03-04T12:36:11.325238+0000","last_unstale":"2024-03-04T13:00:56.483058+0000","last_undegraded":"2024-03-04T13:00:56.483058+0000","last_fullsized":"2024-03-04T13:00:56.483058+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'269","last_scrub_stamp":"2024-03-04T13:00:56.482960+0000","last_deep_scrub":"256'269","last_deep_scrub_stamp":"2024-03-04T13:00:56.482960+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.482960+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:36:12.707737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45924,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1039,"num_write":360,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.728346+0000","last_change":"2024-03-04T13:00:32.728368+0000","last_active":"2024-03-04T13:00:32.728346+0000","last_peered":"2024-03-04T13:00:32.728346+0000","last_clean":"2024-03-04T13:00:32.728346+0000","last_became_active":"2024-03-04T12:36:13.341689+0000","last_became_peered":"2024-03-04T12:36:13.341689+0000","last_unstale":"2024-03-04T13:00:32.728346+0000","last_undegraded":"2024-03-04T13:00:32.728346+0000","last_fullsized":"2024-03-04T13:00:32.728346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:32.728255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:32.728255+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.728255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:29.104225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"256'99","reported_seq":601,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.811874+0000","last_change":"2024-03-04T13:00:35.811925+0000","last_active":"2024-03-04T13:00:35.811874+0000","last_peered":"2024-03-04T13:00:35.811874+0000","last_clean":"2024-03-04T13:00:35.811874+0000","last_became_active":"2024-03-04T12:36:15.353418+0000","last_became_peered":"2024-03-04T12:36:15.353418+0000","last_unstale":"2024-03-04T13:00:35.811874+0000","last_undegraded":"2024-03-04T13:00:35.811874+0000","last_fullsized":"2024-03-04T13:00:35.811874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'99","last_scrub_stamp":"2024-03-04T13:00:35.811760+0000","last_deep_scrub":"256'99","last_deep_scrub_stamp":"2024-03-04T13:00:35.811760+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.811760+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:45.530873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"256'1444","reported_seq":2785,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.627556+0000","last_change":"2024-03-04T13:00:58.627585+0000","last_active":"2024-03-04T13:00:58.627556+0000","last_peered":"2024-03-04T13:00:58.627556+0000","last_clean":"2024-03-04T13:00:58.627556+0000","last_became_active":"2024-03-04T12:36:07.300067+0000","last_became_peered":"2024-03-04T12:36:07.300067+0000","last_unstale":"2024-03-04T13:00:58.627556+0000","last_undegraded":"2024-03-04T13:00:58.627556+0000","last_fullsized":"2024-03-04T13:00:58.627556+0000","mapping_epoch":22,"log_start":"256'1400","ondisk_log_start":"256'1400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1444","last_scrub_stamp":"2024-03-04T13:00:58.627462+0000","last_deep_scrub":"256'1444","last_deep_scrub_stamp":"2024-03-04T13:00:58.627462+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.627462+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":1400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:24.866811+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5752,"num_read_kb":4912,"num_write":2067,"num_write_kb":923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"256'387","reported_seq":1052,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:08.491447+0000","last_change":"2024-03-04T13:01:08.491527+0000","last_active":"2024-03-04T13:01:08.491447+0000","last_peered":"2024-03-04T13:01:08.491447+0000","last_clean":"2024-03-04T13:01:08.491447+0000","last_became_active":"2024-03-04T12:36:05.283142+0000","last_became_peered":"2024-03-04T12:36:05.283142+0000","last_unstale":"2024-03-04T13:01:08.491447+0000","last_undegraded":"2024-03-04T13:01:08.491447+0000","last_fullsized":"2024-03-04T13:01:08.491447+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'387","last_scrub_stamp":"2024-03-04T13:01:08.491322+0000","last_deep_scrub":"256'387","last_deep_scrub_stamp":"2024-03-04T13:01:08.491322+0000","last_clean_scrub_stamp":"2024-03-04T13:01:08.491322+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:25:15.039344+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":1440,"num_write":1747,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.032882+0000","last_change":"2024-03-04T13:00:52.032906+0000","last_active":"2024-03-04T13:00:52.032882+0000","last_peered":"2024-03-04T13:00:52.032882+0000","last_clean":"2024-03-04T13:00:52.032882+0000","last_became_active":"2024-03-04T12:36:09.305182+0000","last_became_peered":"2024-03-04T12:36:09.305182+0000","last_unstale":"2024-03-04T13:00:52.032882+0000","last_undegraded":"2024-03-04T13:00:52.032882+0000","last_fullsized":"2024-03-04T13:00:52.032882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:52.032789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:52.032789+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.032789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:52:57.003068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"256'241","reported_seq":785,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.648093+0000","last_change":"2024-03-04T13:00:49.648093+0000","last_active":"2024-03-04T13:00:49.648093+0000","last_peered":"2024-03-04T13:00:49.648093+0000","last_clean":"2024-03-04T13:00:49.648093+0000","last_became_active":"2024-03-04T12:36:11.324394+0000","last_became_peered":"2024-03-04T12:36:11.324394+0000","last_unstale":"2024-03-04T13:00:49.648093+0000","last_undegraded":"2024-03-04T13:00:49.648093+0000","last_fullsized":"2024-03-04T13:00:49.648093+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'241","last_scrub_stamp":"2024-03-04T13:00:49.647937+0000","last_deep_scrub":"256'241","last_deep_scrub_stamp":"2024-03-04T13:00:49.647937+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.647937+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:42.725177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":411,"num_read_kb":1022,"num_write":344,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.121222+0000","last_change":"2024-03-04T13:00:34.121222+0000","last_active":"2024-03-04T13:00:34.121222+0000","last_peered":"2024-03-04T13:00:34.121222+0000","last_clean":"2024-03-04T13:00:34.121222+0000","last_became_active":"2024-03-04T12:36:13.340897+0000","last_became_peered":"2024-03-04T12:36:13.340897+0000","last_unstale":"2024-03-04T13:00:34.121222+0000","last_undegraded":"2024-03-04T13:00:34.121222+0000","last_fullsized":"2024-03-04T13:00:34.121222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:34.121113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:34.121113+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.121113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:37.532912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"256'172","reported_seq":1180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.324441+0000","last_change":"2024-03-04T13:00:34.324472+0000","last_active":"2024-03-04T13:00:34.324441+0000","last_peered":"2024-03-04T13:00:34.324441+0000","last_clean":"2024-03-04T13:00:34.324441+0000","last_became_active":"2024-03-04T12:36:15.357141+0000","last_became_peered":"2024-03-04T12:36:15.357141+0000","last_unstale":"2024-03-04T13:00:34.324441+0000","last_undegraded":"2024-03-04T13:00:34.324441+0000","last_fullsized":"2024-03-04T13:00:34.324441+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'172","last_scrub_stamp":"2024-03-04T13:00:34.324343+0000","last_deep_scrub":"256'172","last_deep_scrub_stamp":"2024-03-04T13:00:34.324343+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.324343+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:14:37.999688+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":655,"num_read_kb":655,"num_write":360,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"256'1105","reported_seq":2597,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.937177+0000","last_change":"2024-03-04T13:01:02.937202+0000","last_active":"2024-03-04T13:01:02.937177+0000","last_peered":"2024-03-04T13:01:02.937177+0000","last_clean":"2024-03-04T13:01:02.937177+0000","last_became_active":"2024-03-04T12:36:07.290820+0000","last_became_peered":"2024-03-04T12:36:07.290820+0000","last_unstale":"2024-03-04T13:01:02.937177+0000","last_undegraded":"2024-03-04T13:01:02.937177+0000","last_fullsized":"2024-03-04T13:01:02.937177+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1105","last_scrub_stamp":"2024-03-04T13:01:02.937105+0000","last_deep_scrub":"256'1105","last_deep_scrub_stamp":"2024-03-04T13:01:02.937105+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.937105+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:07:49.432949+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4641,"num_read_kb":4049,"num_write":1526,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"256'323","reported_seq":1000,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:10.404895+0000","last_change":"2024-03-04T13:01:10.404963+0000","last_active":"2024-03-04T13:01:10.404895+0000","last_peered":"2024-03-04T13:01:10.404895+0000","last_clean":"2024-03-04T13:01:10.404895+0000","last_became_active":"2024-03-04T12:36:05.289897+0000","last_became_peered":"2024-03-04T12:36:05.289897+0000","last_unstale":"2024-03-04T13:01:10.404895+0000","last_undegraded":"2024-03-04T13:01:10.404895+0000","last_fullsized":"2024-03-04T13:01:10.404895+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'323","last_scrub_stamp":"2024-03-04T13:01:10.404788+0000","last_deep_scrub":"256'323","last_deep_scrub_stamp":"2024-03-04T13:01:10.404788+0000","last_clean_scrub_stamp":"2024-03-04T13:01:10.404788+0000","objects_scrubbed":9,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:55:29.063080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525438,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":585,"num_read_kb":14927,"num_write":1035,"num_write_kb":32177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"256'2","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.381434+0000","last_change":"2024-03-04T13:00:40.381460+0000","last_active":"2024-03-04T13:00:40.381434+0000","last_peered":"2024-03-04T13:00:40.381434+0000","last_clean":"2024-03-04T13:00:40.381434+0000","last_became_active":"2024-03-04T12:36:09.310855+0000","last_became_peered":"2024-03-04T12:36:09.310855+0000","last_unstale":"2024-03-04T13:00:40.381434+0000","last_undegraded":"2024-03-04T13:00:40.381434+0000","last_fullsized":"2024-03-04T13:00:40.381434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:40.381349+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:40.381349+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.381349+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:49.986949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"256'269","reported_seq":839,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.150096+0000","last_change":"2024-03-04T13:00:39.150096+0000","last_active":"2024-03-04T13:00:39.150096+0000","last_peered":"2024-03-04T13:00:39.150096+0000","last_clean":"2024-03-04T13:00:39.150096+0000","last_became_active":"2024-03-04T12:36:11.323352+0000","last_became_peered":"2024-03-04T12:36:11.323352+0000","last_unstale":"2024-03-04T13:00:39.150096+0000","last_undegraded":"2024-03-04T13:00:39.150096+0000","last_fullsized":"2024-03-04T13:00:39.150096+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'269","last_scrub_stamp":"2024-03-04T13:00:39.149959+0000","last_deep_scrub":"256'269","last_deep_scrub_stamp":"2024-03-04T13:00:39.149959+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.149959+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:08:10.926685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":1008,"num_write":350,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.533773+0000","last_change":"2024-03-04T13:00:41.533773+0000","last_active":"2024-03-04T13:00:41.533773+0000","last_peered":"2024-03-04T13:00:41.533773+0000","last_clean":"2024-03-04T13:00:41.533773+0000","last_became_active":"2024-03-04T12:36:13.342656+0000","last_became_peered":"2024-03-04T12:36:13.342656+0000","last_unstale":"2024-03-04T13:00:41.533773+0000","last_undegraded":"2024-03-04T13:00:41.533773+0000","last_fullsized":"2024-03-04T13:00:41.533773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:41.533655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:41.533655+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.533655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:57.620759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"256'104","reported_seq":586,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.145696+0000","last_change":"2024-03-04T13:00:30.145729+0000","last_active":"2024-03-04T13:00:30.145696+0000","last_peered":"2024-03-04T13:00:30.145696+0000","last_clean":"2024-03-04T13:00:30.145696+0000","last_became_active":"2024-03-04T12:36:15.352333+0000","last_became_peered":"2024-03-04T12:36:15.352333+0000","last_unstale":"2024-03-04T13:00:30.145696+0000","last_undegraded":"2024-03-04T13:00:30.145696+0000","last_fullsized":"2024-03-04T13:00:30.145696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'104","last_scrub_stamp":"2024-03-04T13:00:30.145579+0000","last_deep_scrub":"256'104","last_deep_scrub_stamp":"2024-03-04T13:00:30.145579+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.145579+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:30.216312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":93,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"256'394","reported_seq":1898,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.413355+0000","last_change":"2024-03-04T13:00:47.413399+0000","last_active":"2024-03-04T13:00:47.413355+0000","last_peered":"2024-03-04T13:00:47.413355+0000","last_clean":"2024-03-04T13:00:47.413355+0000","last_became_active":"2024-03-04T12:36:07.297660+0000","last_became_peered":"2024-03-04T12:36:07.297660+0000","last_unstale":"2024-03-04T13:00:47.413355+0000","last_undegraded":"2024-03-04T13:00:47.413355+0000","last_fullsized":"2024-03-04T13:00:47.413355+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'394","last_scrub_stamp":"2024-03-04T13:00:47.413268+0000","last_deep_scrub":"256'394","last_deep_scrub_stamp":"2024-03-04T13:00:47.413268+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.413268+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:01.581295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":478,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2632,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"256'280","reported_seq":875,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.768622+0000","last_change":"2024-03-04T13:00:49.768622+0000","last_active":"2024-03-04T13:00:49.768622+0000","last_peered":"2024-03-04T13:00:49.768622+0000","last_clean":"2024-03-04T13:00:49.768622+0000","last_became_active":"2024-03-04T12:36:05.279576+0000","last_became_peered":"2024-03-04T12:36:05.279576+0000","last_unstale":"2024-03-04T13:00:49.768622+0000","last_undegraded":"2024-03-04T13:00:49.768622+0000","last_fullsized":"2024-03-04T13:00:49.768622+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'280","last_scrub_stamp":"2024-03-04T13:00:49.768467+0000","last_deep_scrub":"256'280","last_deep_scrub_stamp":"2024-03-04T13:00:49.768467+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.768467+0000","objects_scrubbed":9,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:06:40.516533+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5591378,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":375,"num_read_kb":32300,"num_write":1079,"num_write_kb":15765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"256'426","reported_seq":1860,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.396310+0000","last_change":"2024-03-04T13:00:41.396339+0000","last_active":"2024-03-04T13:00:41.396310+0000","last_peered":"2024-03-04T13:00:41.396310+0000","last_clean":"2024-03-04T13:00:41.396310+0000","last_became_active":"2024-03-04T12:36:07.300168+0000","last_became_peered":"2024-03-04T12:36:07.300168+0000","last_unstale":"2024-03-04T13:00:41.396310+0000","last_undegraded":"2024-03-04T13:00:41.396310+0000","last_fullsized":"2024-03-04T13:00:41.396310+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'426","last_scrub_stamp":"2024-03-04T13:00:41.396226+0000","last_deep_scrub":"256'426","last_deep_scrub_stamp":"2024-03-04T13:00:41.396226+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.396226+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.864579+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2082,"num_write":535,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":964,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"256'314","reported_seq":940,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.179727+0000","last_change":"2024-03-04T13:00:41.179727+0000","last_active":"2024-03-04T13:00:41.179727+0000","last_peered":"2024-03-04T13:00:41.179727+0000","last_clean":"2024-03-04T13:00:41.179727+0000","last_became_active":"2024-03-04T12:36:05.287233+0000","last_became_peered":"2024-03-04T12:36:05.287233+0000","last_unstale":"2024-03-04T13:00:41.179727+0000","last_undegraded":"2024-03-04T13:00:41.179727+0000","last_fullsized":"2024-03-04T13:00:41.179727+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'314","last_scrub_stamp":"2024-03-04T13:00:41.179534+0000","last_deep_scrub":"256'314","last_deep_scrub_stamp":"2024-03-04T13:00:41.179534+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.179534+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:17:16.905623+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1355534,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":467,"num_read_kb":46552,"num_write":1196,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"256'339","reported_seq":1840,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.320057+0000","last_change":"2024-03-04T13:00:45.320086+0000","last_active":"2024-03-04T13:00:45.320057+0000","last_peered":"2024-03-04T13:00:45.320057+0000","last_clean":"2024-03-04T13:00:45.320057+0000","last_became_active":"2024-03-04T12:36:07.296104+0000","last_became_peered":"2024-03-04T12:36:07.296104+0000","last_unstale":"2024-03-04T13:00:45.320057+0000","last_undegraded":"2024-03-04T13:00:45.320057+0000","last_fullsized":"2024-03-04T13:00:45.320057+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'339","last_scrub_stamp":"2024-03-04T13:00:45.319962+0000","last_deep_scrub":"256'339","last_deep_scrub_stamp":"2024-03-04T13:00:45.319962+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.319962+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:39:45.319778+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1942,"num_read_kb":1888,"num_write":368,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"256'349","reported_seq":978,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.296780+0000","last_change":"2024-03-04T13:00:29.296873+0000","last_active":"2024-03-04T13:00:29.296780+0000","last_peered":"2024-03-04T13:00:29.296780+0000","last_clean":"2024-03-04T13:00:29.296780+0000","last_became_active":"2024-03-04T12:36:41.075381+0000","last_became_peered":"2024-03-04T12:36:41.075381+0000","last_unstale":"2024-03-04T13:00:29.296780+0000","last_undegraded":"2024-03-04T13:00:29.296780+0000","last_fullsized":"2024-03-04T13:00:29.296780+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'349","last_scrub_stamp":"2024-03-04T13:00:29.296681+0000","last_deep_scrub":"256'349","last_deep_scrub_stamp":"2024-03-04T13:00:29.296681+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.296681+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:14.010604+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8448064,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":52899,"num_write":1289,"num_write_kb":57282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"256'1028","reported_seq":2586,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.339309+0000","last_change":"2024-03-04T13:00:43.339356+0000","last_active":"2024-03-04T13:00:43.339309+0000","last_peered":"2024-03-04T13:00:43.339309+0000","last_clean":"2024-03-04T13:00:43.339309+0000","last_became_active":"2024-03-04T12:36:07.299282+0000","last_became_peered":"2024-03-04T12:36:07.299282+0000","last_unstale":"2024-03-04T13:00:43.339309+0000","last_undegraded":"2024-03-04T13:00:43.339309+0000","last_fullsized":"2024-03-04T13:00:43.339309+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1028","last_scrub_stamp":"2024-03-04T13:00:43.339218+0000","last_deep_scrub":"256'1028","last_deep_scrub_stamp":"2024-03-04T13:00:43.339218+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.339218+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":1000,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:14:07.769583+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4484,"num_read_kb":3892,"num_write":1521,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"256'296","reported_seq":958,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:06.507848+0000","last_change":"2024-03-04T13:01:06.507892+0000","last_active":"2024-03-04T13:01:06.507848+0000","last_peered":"2024-03-04T13:01:06.507848+0000","last_clean":"2024-03-04T13:01:06.507848+0000","last_became_active":"2024-03-04T12:36:05.283327+0000","last_became_peered":"2024-03-04T12:36:05.283327+0000","last_unstale":"2024-03-04T13:01:06.507848+0000","last_undegraded":"2024-03-04T13:01:06.507848+0000","last_fullsized":"2024-03-04T13:01:06.507848+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'296","last_scrub_stamp":"2024-03-04T13:01:06.507765+0000","last_deep_scrub":"256'296","last_deep_scrub_stamp":"2024-03-04T13:01:06.507765+0000","last_clean_scrub_stamp":"2024-03-04T13:01:06.507765+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:08:32.992038+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6002849,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":66598,"num_write":994,"num_write_kb":37083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"256'427","reported_seq":1891,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.644183+0000","last_change":"2024-03-04T13:00:57.644183+0000","last_active":"2024-03-04T13:00:57.644183+0000","last_peered":"2024-03-04T13:00:57.644183+0000","last_clean":"2024-03-04T13:00:57.644183+0000","last_became_active":"2024-03-04T12:36:07.292950+0000","last_became_peered":"2024-03-04T12:36:07.292950+0000","last_unstale":"2024-03-04T13:00:57.644183+0000","last_undegraded":"2024-03-04T13:00:57.644183+0000","last_fullsized":"2024-03-04T13:00:57.644183+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'427","last_scrub_stamp":"2024-03-04T13:00:57.644027+0000","last_deep_scrub":"256'427","last_deep_scrub_stamp":"2024-03-04T13:00:57.644027+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.644027+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:20:44.730407+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2086,"num_write":515,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"256'287","reported_seq":910,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:11.404626+0000","last_change":"2024-03-04T13:01:11.404669+0000","last_active":"2024-03-04T13:01:11.404626+0000","last_peered":"2024-03-04T13:01:11.404626+0000","last_clean":"2024-03-04T13:01:11.404626+0000","last_became_active":"2024-03-04T12:36:05.286745+0000","last_became_peered":"2024-03-04T12:36:05.286745+0000","last_unstale":"2024-03-04T13:01:11.404626+0000","last_undegraded":"2024-03-04T13:01:11.404626+0000","last_fullsized":"2024-03-04T13:01:11.404626+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'287","last_scrub_stamp":"2024-03-04T13:01:11.404533+0000","last_deep_scrub":"256'287","last_deep_scrub_stamp":"2024-03-04T13:01:11.404533+0000","last_clean_scrub_stamp":"2024-03-04T13:01:11.404533+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:56:56.249372+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":38207,"num_write":1041,"num_write_kb":19360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"256'356","reported_seq":1900,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:04.934536+0000","last_change":"2024-03-04T13:01:04.934536+0000","last_active":"2024-03-04T13:01:04.934536+0000","last_peered":"2024-03-04T13:01:04.934536+0000","last_clean":"2024-03-04T13:01:04.934536+0000","last_became_active":"2024-03-04T12:36:07.291690+0000","last_became_peered":"2024-03-04T12:36:07.291690+0000","last_unstale":"2024-03-04T13:01:04.934536+0000","last_undegraded":"2024-03-04T13:01:04.934536+0000","last_fullsized":"2024-03-04T13:01:04.934536+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'356","last_scrub_stamp":"2024-03-04T13:01:04.934415+0000","last_deep_scrub":"256'356","last_deep_scrub_stamp":"2024-03-04T13:01:04.934415+0000","last_clean_scrub_stamp":"2024-03-04T13:01:04.934415+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:34:50.904028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2163,"num_read_kb":2091,"num_write":400,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":475,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"256'300","reported_seq":926,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.389712+0000","last_change":"2024-03-04T13:00:59.389753+0000","last_active":"2024-03-04T13:00:59.389712+0000","last_peered":"2024-03-04T13:00:59.389712+0000","last_clean":"2024-03-04T13:00:59.389712+0000","last_became_active":"2024-03-04T12:36:05.287529+0000","last_became_peered":"2024-03-04T12:36:05.287529+0000","last_unstale":"2024-03-04T13:00:59.389712+0000","last_undegraded":"2024-03-04T13:00:59.389712+0000","last_fullsized":"2024-03-04T13:00:59.389712+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'300","last_scrub_stamp":"2024-03-04T13:00:59.389613+0000","last_deep_scrub":"256'300","last_deep_scrub_stamp":"2024-03-04T13:00:59.389613+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.389613+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:18:58.734299+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":37296,"num_write":1090,"num_write_kb":36513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"256'739","reported_seq":2232,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.662029+0000","last_change":"2024-03-04T13:00:56.662029+0000","last_active":"2024-03-04T13:00:56.662029+0000","last_peered":"2024-03-04T13:00:56.662029+0000","last_clean":"2024-03-04T13:00:56.662029+0000","last_became_active":"2024-03-04T12:36:07.299881+0000","last_became_peered":"2024-03-04T12:36:07.299881+0000","last_unstale":"2024-03-04T13:00:56.662029+0000","last_undegraded":"2024-03-04T13:00:56.662029+0000","last_fullsized":"2024-03-04T13:00:56.662029+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'739","last_scrub_stamp":"2024-03-04T13:00:56.661911+0000","last_deep_scrub":"256'739","last_deep_scrub_stamp":"2024-03-04T13:00:56.661911+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.661911+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:41:05.923331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3309,"num_read_kb":2983,"num_write":974,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"256'330","reported_seq":963,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.705064+0000","last_change":"2024-03-04T13:00:52.705124+0000","last_active":"2024-03-04T13:00:52.705064+0000","last_peered":"2024-03-04T13:00:52.705064+0000","last_clean":"2024-03-04T13:00:52.705064+0000","last_became_active":"2024-03-04T12:36:05.286397+0000","last_became_peered":"2024-03-04T12:36:05.286397+0000","last_unstale":"2024-03-04T13:00:52.705064+0000","last_undegraded":"2024-03-04T13:00:52.705064+0000","last_fullsized":"2024-03-04T13:00:52.705064+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'330","last_scrub_stamp":"2024-03-04T13:00:52.704955+0000","last_deep_scrub":"256'330","last_deep_scrub_stamp":"2024-03-04T13:00:52.704955+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.704955+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:27:08.892935+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472549,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":459,"num_read_kb":103287,"num_write":1220,"num_write_kb":47023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"256'477","reported_seq":2083,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.756343+0000","last_change":"2024-03-04T13:00:47.756343+0000","last_active":"2024-03-04T13:00:47.756343+0000","last_peered":"2024-03-04T13:00:47.756343+0000","last_clean":"2024-03-04T13:00:47.756343+0000","last_became_active":"2024-03-04T12:36:07.292501+0000","last_became_peered":"2024-03-04T12:36:07.292501+0000","last_unstale":"2024-03-04T13:00:47.756343+0000","last_undegraded":"2024-03-04T13:00:47.756343+0000","last_fullsized":"2024-03-04T13:00:47.756343+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'477","last_scrub_stamp":"2024-03-04T13:00:47.756208+0000","last_deep_scrub":"256'477","last_deep_scrub_stamp":"2024-03-04T13:00:47.756208+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.756208+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:29:15.876341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2330,"num_write":558,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"256'328","reported_seq":934,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:15.416192+0000","last_change":"2024-03-04T13:01:15.416232+0000","last_active":"2024-03-04T13:01:15.416192+0000","last_peered":"2024-03-04T13:01:15.416192+0000","last_clean":"2024-03-04T13:01:15.416192+0000","last_became_active":"2024-03-04T12:36:05.294007+0000","last_became_peered":"2024-03-04T12:36:05.294007+0000","last_unstale":"2024-03-04T13:01:15.416192+0000","last_undegraded":"2024-03-04T13:01:15.416192+0000","last_fullsized":"2024-03-04T13:01:15.416192+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'328","last_scrub_stamp":"2024-03-04T13:01:15.416107+0000","last_deep_scrub":"256'328","last_deep_scrub_stamp":"2024-03-04T13:01:15.416107+0000","last_clean_scrub_stamp":"2024-03-04T13:01:15.416107+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:07.766815+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":23598,"num_write":1193,"num_write_kb":28139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"256'447","reported_seq":1967,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.454006+0000","last_change":"2024-03-04T13:01:01.454040+0000","last_active":"2024-03-04T13:01:01.454006+0000","last_peered":"2024-03-04T13:01:01.454006+0000","last_clean":"2024-03-04T13:01:01.454006+0000","last_became_active":"2024-03-04T12:36:07.294283+0000","last_became_peered":"2024-03-04T12:36:07.294283+0000","last_unstale":"2024-03-04T13:01:01.454006+0000","last_undegraded":"2024-03-04T13:01:01.454006+0000","last_fullsized":"2024-03-04T13:01:01.454006+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'447","last_scrub_stamp":"2024-03-04T13:01:01.453910+0000","last_deep_scrub":"256'447","last_deep_scrub_stamp":"2024-03-04T13:01:01.453910+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.453910+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:10:08.932924+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2476,"num_read_kb":2316,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"256'341","reported_seq":963,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.232226+0000","last_change":"2024-03-04T13:01:02.232253+0000","last_active":"2024-03-04T13:01:02.232226+0000","last_peered":"2024-03-04T13:01:02.232226+0000","last_clean":"2024-03-04T13:01:02.232226+0000","last_became_active":"2024-03-04T12:36:05.289882+0000","last_became_peered":"2024-03-04T12:36:05.289882+0000","last_unstale":"2024-03-04T13:01:02.232226+0000","last_undegraded":"2024-03-04T13:01:02.232226+0000","last_fullsized":"2024-03-04T13:01:02.232226+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'341","last_scrub_stamp":"2024-03-04T13:01:02.232157+0000","last_deep_scrub":"256'341","last_deep_scrub_stamp":"2024-03-04T13:01:02.232157+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.232157+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:51:22.704788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":35092,"num_write":1098,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"256'455","reported_seq":1947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.067211+0000","last_change":"2024-03-04T13:00:51.067257+0000","last_active":"2024-03-04T13:00:51.067211+0000","last_peered":"2024-03-04T13:00:51.067211+0000","last_clean":"2024-03-04T13:00:51.067211+0000","last_became_active":"2024-03-04T12:36:07.292904+0000","last_became_peered":"2024-03-04T12:36:07.292904+0000","last_unstale":"2024-03-04T13:00:51.067211+0000","last_undegraded":"2024-03-04T13:00:51.067211+0000","last_fullsized":"2024-03-04T13:00:51.067211+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'455","last_scrub_stamp":"2024-03-04T13:00:51.067100+0000","last_deep_scrub":"256'455","last_deep_scrub_stamp":"2024-03-04T13:00:51.067100+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.067100+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:31:42.315352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2160,"num_write":550,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":241,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"256'311","reported_seq":907,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:07.454272+0000","last_change":"2024-03-04T13:01:07.454328+0000","last_active":"2024-03-04T13:01:07.454272+0000","last_peered":"2024-03-04T13:01:07.454272+0000","last_clean":"2024-03-04T13:01:07.454272+0000","last_became_active":"2024-03-04T12:36:05.294338+0000","last_became_peered":"2024-03-04T12:36:05.294338+0000","last_unstale":"2024-03-04T13:01:07.454272+0000","last_undegraded":"2024-03-04T13:01:07.454272+0000","last_fullsized":"2024-03-04T13:01:07.454272+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'311","last_scrub_stamp":"2024-03-04T13:01:07.454186+0000","last_deep_scrub":"256'311","last_deep_scrub_stamp":"2024-03-04T13:01:07.454186+0000","last_clean_scrub_stamp":"2024-03-04T13:01:07.454186+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:58:58.558709+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263242,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":434,"num_read_kb":2630,"num_write":1136,"num_write_kb":25999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"256'1256","reported_seq":2852,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.111171+0000","last_change":"2024-03-04T13:00:43.111171+0000","last_active":"2024-03-04T13:00:43.111171+0000","last_peered":"2024-03-04T13:00:43.111171+0000","last_clean":"2024-03-04T13:00:43.111171+0000","last_became_active":"2024-03-04T12:36:07.292294+0000","last_became_peered":"2024-03-04T12:36:07.292294+0000","last_unstale":"2024-03-04T13:00:43.111171+0000","last_undegraded":"2024-03-04T13:00:43.111171+0000","last_fullsized":"2024-03-04T13:00:43.111171+0000","mapping_epoch":22,"log_start":"256'1200","ondisk_log_start":"256'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1256","last_scrub_stamp":"2024-03-04T13:00:43.111042+0000","last_deep_scrub":"256'1256","last_deep_scrub_stamp":"2024-03-04T13:00:43.111042+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.111042+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":1200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:59.468907+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5403,"num_read_kb":4680,"num_write":1785,"num_write_kb":760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2067,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"256'329","reported_seq":940,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.281555+0000","last_change":"2024-03-04T13:01:03.281590+0000","last_active":"2024-03-04T13:01:03.281555+0000","last_peered":"2024-03-04T13:01:03.281555+0000","last_clean":"2024-03-04T13:01:03.281555+0000","last_became_active":"2024-03-04T12:36:05.290410+0000","last_became_peered":"2024-03-04T12:36:05.290410+0000","last_unstale":"2024-03-04T13:01:03.281555+0000","last_undegraded":"2024-03-04T13:01:03.281555+0000","last_fullsized":"2024-03-04T13:01:03.281555+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'329","last_scrub_stamp":"2024-03-04T13:01:03.281485+0000","last_deep_scrub":"256'329","last_deep_scrub_stamp":"2024-03-04T13:01:03.281485+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.281485+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:52.674725+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2168155,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":19682,"num_write":1207,"num_write_kb":25111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"256'275","reported_seq":1526,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.035923+0000","last_change":"2024-03-04T13:00:47.035923+0000","last_active":"2024-03-04T13:00:47.035923+0000","last_peered":"2024-03-04T13:00:47.035923+0000","last_clean":"2024-03-04T13:00:47.035923+0000","last_became_active":"2024-03-04T12:36:07.291583+0000","last_became_peered":"2024-03-04T12:36:07.291583+0000","last_unstale":"2024-03-04T13:00:47.035923+0000","last_undegraded":"2024-03-04T13:00:47.035923+0000","last_fullsized":"2024-03-04T13:00:47.035923+0000","mapping_epoch":22,"log_start":"256'200","ondisk_log_start":"256'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'275","last_scrub_stamp":"2024-03-04T13:00:47.035802+0000","last_deep_scrub":"256'275","last_deep_scrub_stamp":"2024-03-04T13:00:47.035802+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.035802+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:54:35.976960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1552,"num_read_kb":1496,"num_write":324,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"256'405","reported_seq":1031,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:11.398220+0000","last_change":"2024-03-04T13:01:11.398315+0000","last_active":"2024-03-04T13:01:11.398220+0000","last_peered":"2024-03-04T13:01:11.398220+0000","last_clean":"2024-03-04T13:01:11.398220+0000","last_became_active":"2024-03-04T12:36:05.290522+0000","last_became_peered":"2024-03-04T12:36:05.290522+0000","last_unstale":"2024-03-04T13:01:11.398220+0000","last_undegraded":"2024-03-04T13:01:11.398220+0000","last_fullsized":"2024-03-04T13:01:11.398220+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'405","last_scrub_stamp":"2024-03-04T13:01:11.398132+0000","last_deep_scrub":"256'405","last_deep_scrub_stamp":"2024-03-04T13:01:11.398132+0000","last_clean_scrub_stamp":"2024-03-04T13:01:11.398132+0000","objects_scrubbed":16,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:33.646597+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11113900,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":595,"num_read_kb":8197,"num_write":1190,"num_write_kb":30951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"256'1119","reported_seq":2706,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.244677+0000","last_change":"2024-03-04T13:00:50.244677+0000","last_active":"2024-03-04T13:00:50.244677+0000","last_peered":"2024-03-04T13:00:50.244677+0000","last_clean":"2024-03-04T13:00:50.244677+0000","last_became_active":"2024-03-04T12:36:07.294536+0000","last_became_peered":"2024-03-04T12:36:07.294536+0000","last_unstale":"2024-03-04T13:00:50.244677+0000","last_undegraded":"2024-03-04T13:00:50.244677+0000","last_fullsized":"2024-03-04T13:00:50.244677+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1119","last_scrub_stamp":"2024-03-04T13:00:50.244566+0000","last_deep_scrub":"256'1119","last_deep_scrub_stamp":"2024-03-04T13:00:50.244566+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.244566+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:22.669433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4737,"num_read_kb":4156,"num_write":1530,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"256'326","reported_seq":949,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.725027+0000","last_change":"2024-03-04T13:00:51.725087+0000","last_active":"2024-03-04T13:00:51.725027+0000","last_peered":"2024-03-04T13:00:51.725027+0000","last_clean":"2024-03-04T13:00:51.725027+0000","last_became_active":"2024-03-04T12:36:05.285924+0000","last_became_peered":"2024-03-04T12:36:05.285924+0000","last_unstale":"2024-03-04T13:00:51.725027+0000","last_undegraded":"2024-03-04T13:00:51.725027+0000","last_fullsized":"2024-03-04T13:00:51.725027+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'326","last_scrub_stamp":"2024-03-04T13:00:51.724916+0000","last_deep_scrub":"256'326","last_deep_scrub_stamp":"2024-03-04T13:00:51.724916+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.724916+0000","objects_scrubbed":10,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:44.286917+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671806,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":413,"num_read_kb":22814,"num_write":1062,"num_write_kb":24147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"256'331","reported_seq":1647,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.482546+0000","last_change":"2024-03-04T13:00:48.482546+0000","last_active":"2024-03-04T13:00:48.482546+0000","last_peered":"2024-03-04T13:00:48.482546+0000","last_clean":"2024-03-04T13:00:48.482546+0000","last_became_active":"2024-03-04T12:36:07.302371+0000","last_became_peered":"2024-03-04T12:36:07.302371+0000","last_unstale":"2024-03-04T13:00:48.482546+0000","last_undegraded":"2024-03-04T13:00:48.482546+0000","last_fullsized":"2024-03-04T13:00:48.482546+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'331","last_scrub_stamp":"2024-03-04T13:00:48.482398+0000","last_deep_scrub":"256'331","last_deep_scrub_stamp":"2024-03-04T13:00:48.482398+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.482398+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:36.170349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1728,"num_read_kb":1642,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"256'322","reported_seq":926,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:05.254182+0000","last_change":"2024-03-04T13:01:05.254249+0000","last_active":"2024-03-04T13:01:05.254182+0000","last_peered":"2024-03-04T13:01:05.254182+0000","last_clean":"2024-03-04T13:01:05.254182+0000","last_became_active":"2024-03-04T12:36:05.290032+0000","last_became_peered":"2024-03-04T12:36:05.290032+0000","last_unstale":"2024-03-04T13:01:05.254182+0000","last_undegraded":"2024-03-04T13:01:05.254182+0000","last_fullsized":"2024-03-04T13:01:05.254182+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'322","last_scrub_stamp":"2024-03-04T13:01:05.254053+0000","last_deep_scrub":"256'322","last_deep_scrub_stamp":"2024-03-04T13:01:05.254053+0000","last_clean_scrub_stamp":"2024-03-04T13:01:05.254053+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:01.230258+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489519,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":31102,"num_write":1081,"num_write_kb":33345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"256'418","reported_seq":1954,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.578731+0000","last_change":"2024-03-04T13:01:00.578797+0000","last_active":"2024-03-04T13:01:00.578731+0000","last_peered":"2024-03-04T13:01:00.578731+0000","last_clean":"2024-03-04T13:01:00.578731+0000","last_became_active":"2024-03-04T12:36:07.299718+0000","last_became_peered":"2024-03-04T12:36:07.299718+0000","last_unstale":"2024-03-04T13:01:00.578731+0000","last_undegraded":"2024-03-04T13:01:00.578731+0000","last_fullsized":"2024-03-04T13:01:00.578731+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'418","last_scrub_stamp":"2024-03-04T13:01:00.578634+0000","last_deep_scrub":"256'418","last_deep_scrub_stamp":"2024-03-04T13:01:00.578634+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.578634+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:37.681539+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2289,"num_read_kb":2179,"num_write":520,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"256'395","reported_seq":1062,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.207499+0000","last_change":"2024-03-04T13:00:40.207554+0000","last_active":"2024-03-04T13:00:40.207499+0000","last_peered":"2024-03-04T13:00:40.207499+0000","last_clean":"2024-03-04T13:00:40.207499+0000","last_became_active":"2024-03-04T12:36:05.279538+0000","last_became_peered":"2024-03-04T12:36:05.279538+0000","last_unstale":"2024-03-04T13:00:40.207499+0000","last_undegraded":"2024-03-04T13:00:40.207499+0000","last_fullsized":"2024-03-04T13:00:40.207499+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'395","last_scrub_stamp":"2024-03-04T13:00:40.207418+0000","last_deep_scrub":"256'395","last_deep_scrub_stamp":"2024-03-04T13:00:40.207418+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.207418+0000","objects_scrubbed":12,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:25.317833+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4781240,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":615,"num_read_kb":6803,"num_write":1512,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"256'749","reported_seq":2156,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.343025+0000","last_change":"2024-03-04T13:00:48.343052+0000","last_active":"2024-03-04T13:00:48.343025+0000","last_peered":"2024-03-04T13:00:48.343025+0000","last_clean":"2024-03-04T13:00:48.343025+0000","last_became_active":"2024-03-04T12:36:07.294274+0000","last_became_peered":"2024-03-04T12:36:07.294274+0000","last_unstale":"2024-03-04T13:00:48.343025+0000","last_undegraded":"2024-03-04T13:00:48.343025+0000","last_fullsized":"2024-03-04T13:00:48.343025+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'749","last_scrub_stamp":"2024-03-04T13:00:48.342929+0000","last_deep_scrub":"256'749","last_deep_scrub_stamp":"2024-03-04T13:00:48.342929+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.342929+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:34:20.672996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3445,"num_read_kb":3067,"num_write":1017,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"256'369","reported_seq":960,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.246173+0000","last_change":"2024-03-04T13:00:25.246235+0000","last_active":"2024-03-04T13:00:25.246173+0000","last_peered":"2024-03-04T13:00:25.246173+0000","last_clean":"2024-03-04T13:00:25.246173+0000","last_became_active":"2024-03-04T12:36:40.391325+0000","last_became_peered":"2024-03-04T12:36:40.391325+0000","last_unstale":"2024-03-04T13:00:25.246173+0000","last_undegraded":"2024-03-04T13:00:25.246173+0000","last_fullsized":"2024-03-04T13:00:25.246173+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'369","last_scrub_stamp":"2024-03-04T13:00:25.246095+0000","last_deep_scrub":"256'369","last_deep_scrub_stamp":"2024-03-04T13:00:25.246095+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.246095+0000","objects_scrubbed":6,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:52.565129+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2969477,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":505,"num_read_kb":41621,"num_write":1246,"num_write_kb":38740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"256'368","reported_seq":1087,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.211667+0000","last_change":"2024-03-04T13:01:01.211731+0000","last_active":"2024-03-04T13:01:01.211667+0000","last_peered":"2024-03-04T13:01:01.211667+0000","last_clean":"2024-03-04T13:01:01.211667+0000","last_became_active":"2024-03-04T12:36:05.287744+0000","last_became_peered":"2024-03-04T12:36:05.287744+0000","last_unstale":"2024-03-04T13:01:01.211667+0000","last_undegraded":"2024-03-04T13:01:01.211667+0000","last_fullsized":"2024-03-04T13:01:01.211667+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'368","last_scrub_stamp":"2024-03-04T13:01:01.211572+0000","last_deep_scrub":"256'368","last_deep_scrub_stamp":"2024-03-04T13:01:01.211572+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.211572+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:42:06.943792+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984340,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":791,"num_read_kb":29804,"num_write":1288,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"256'538","reported_seq":2102,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.480245+0000","last_change":"2024-03-04T13:00:49.480278+0000","last_active":"2024-03-04T13:00:49.480245+0000","last_peered":"2024-03-04T13:00:49.480245+0000","last_clean":"2024-03-04T13:00:49.480245+0000","last_became_active":"2024-03-04T12:36:07.302290+0000","last_became_peered":"2024-03-04T12:36:07.302290+0000","last_unstale":"2024-03-04T13:00:49.480245+0000","last_undegraded":"2024-03-04T13:00:49.480245+0000","last_fullsized":"2024-03-04T13:00:49.480245+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'538","last_scrub_stamp":"2024-03-04T13:00:49.480150+0000","last_deep_scrub":"256'538","last_deep_scrub_stamp":"2024-03-04T13:00:49.480150+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.480150+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:45:14.990775+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2955,"num_read_kb":2687,"num_write":726,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"256'457","reported_seq":1240,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.355914+0000","last_change":"2024-03-04T13:00:57.355957+0000","last_active":"2024-03-04T13:00:57.355914+0000","last_peered":"2024-03-04T13:00:57.355914+0000","last_clean":"2024-03-04T13:00:57.355914+0000","last_became_active":"2024-03-04T12:36:05.283797+0000","last_became_peered":"2024-03-04T12:36:05.283797+0000","last_unstale":"2024-03-04T13:00:57.355914+0000","last_undegraded":"2024-03-04T13:00:57.355914+0000","last_fullsized":"2024-03-04T13:00:57.355914+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'457","last_scrub_stamp":"2024-03-04T13:00:57.355821+0000","last_deep_scrub":"256'457","last_deep_scrub_stamp":"2024-03-04T13:00:57.355821+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.355821+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:36.376522+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5417905,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1114,"num_read_kb":38636,"num_write":1666,"num_write_kb":30809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"256'787","reported_seq":2222,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.367298+0000","last_change":"2024-03-04T13:00:44.367329+0000","last_active":"2024-03-04T13:00:44.367298+0000","last_peered":"2024-03-04T13:00:44.367298+0000","last_clean":"2024-03-04T13:00:44.367298+0000","last_became_active":"2024-03-04T12:36:07.301542+0000","last_became_peered":"2024-03-04T12:36:07.301542+0000","last_unstale":"2024-03-04T13:00:44.367298+0000","last_undegraded":"2024-03-04T13:00:44.367298+0000","last_fullsized":"2024-03-04T13:00:44.367298+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'787","last_scrub_stamp":"2024-03-04T13:00:44.367203+0000","last_deep_scrub":"256'787","last_deep_scrub_stamp":"2024-03-04T13:00:44.367203+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.367203+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:32.262672+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3434,"num_read_kb":3044,"num_write":1054,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":164,"num_read_kb":179702,"num_write":175,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5885,"num_read_kb":4252,"num_write":2245,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8924,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1079,"ondisk_log_size":1079,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":9441,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":12014,"num_read_kb":11868,"num_write":14038,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1548,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":18882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2403,"ondisk_log_size":2403,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":486,"ondisk_log_size":486,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1548695,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":15552,"num_read_kb":34013,"num_write":13157,"num_write_kb":10848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":618572,"num_omap_keys":1452,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2063,"ondisk_log_size":2063,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1552,"num_read_kb":1546,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":187094,"num_read_kb":170304,"num_write":50851,"num_write_kb":17572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":38813,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3859,"ondisk_log_size":3859,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":175727187,"num_objects":435,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":0,"num_read":34803,"num_read_kb":2210949,"num_write":78480,"num_write_kb":2282182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":353116160,"data_stored":351454374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3611,"ondisk_log_size":3611,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":165,"num_read_kb":175660,"num_write":175,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575159,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333184,"kb_used_data":71544,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94038656,"statfs":{"total":96636764160,"available":96295583744,"internally_reserved":0,"allocated":73261056,"data_stored":71540111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575160,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290296,"kb_used_data":38384,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94081544,"statfs":{"total":96636764160,"available":96339501056,"internally_reserved":0,"allocated":39305216,"data_stored":37695435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575160,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151020,"kb_used_data":51876,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94220820,"statfs":{"total":96636764160,"available":96482119680,"internally_reserved":0,"allocated":53121024,"data_stored":51449109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575158,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144096,"kb_used_data":72664,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94227744,"statfs":{"total":96636764160,"available":96489209856,"internally_reserved":0,"allocated":74407936,"data_stored":72693947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575158,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310816,"kb_used_data":49240,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94061024,"statfs":{"total":96636764160,"available":96318488576,"internally_reserved":0,"allocated":50421760,"data_stored":48746373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575159,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140424,"kb_used_data":51008,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94231416,"statfs":{"total":96636764160,"available":96492969984,"internally_reserved":0,"allocated":52232192,"data_stored":50704146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575162,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152644,"kb_used_data":41020,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94219196,"statfs":{"total":96636764160,"available":96480456704,"internally_reserved":0,"allocated":42004480,"data_stored":40455223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575159,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306936,"kb_used_data":63408,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94064904,"statfs":{"total":96636764160,"available":96322461696,"internally_reserved":0,"allocated":64929792,"data_stored":63233494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45060096,"data_stored":44816819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30089216,"data_stored":29970475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42442752,"data_stored":42316441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38498304,"data_stored":38260992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62513152,"data_stored":62209723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39063552,"data_stored":38866277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31576064,"data_stored":31403645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":63873024,"data_stored":63610002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:01:26.108 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:26.109 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:26.109 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-04T12:51:00.328234+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=51, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=0, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:01:26.114 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-04T13:01:46.115 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:01:46.457 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-03-04T13:01:46.468 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-03-04T13:01:46.471 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":1029,"stamp":"2024-03-04T13:01:45.391910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":211431760,"num_objects":820,"num_object_clones":0,"num_object_copies":1640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":820,"num_whiteouts":0,"num_read":257353,"num_read_kb":2788402,"num_write":159314,"num_write_kb":2552482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":668609,"num_omap_keys":1655,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13804,"ondisk_log_size":13804,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1829416,"kb_used_data":439144,"kb_used_omap":12,"kb_used_meta":1390195,"kb_avail":753145304,"statfs":{"total":773094113280,"available":771220791296,"internally_reserved":0,"allocated":449683456,"data_stored":436517838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1423560240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004738"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:11.893525+0000","last_change":"2024-03-04T13:01:11.893552+0000","last_active":"2024-03-04T13:01:11.893525+0000","last_peered":"2024-03-04T13:01:11.893525+0000","last_clean":"2024-03-04T13:01:11.893525+0000","last_became_active":"2024-03-04T12:51:01.353225+0000","last_became_peered":"2024-03-04T12:51:01.353225+0000","last_unstale":"2024-03-04T13:01:11.893525+0000","last_undegraded":"2024-03-04T13:01:11.893525+0000","last_fullsized":"2024-03-04T13:01:11.893525+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:11.893429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:11.893429+0000","last_clean_scrub_stamp":"2024-03-04T13:01:11.893429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:25:26.204998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"256'2","reported_seq":42,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.383613+0000","last_change":"2024-03-04T13:01:01.383640+0000","last_active":"2024-03-04T13:01:01.383613+0000","last_peered":"2024-03-04T13:01:01.383613+0000","last_clean":"2024-03-04T13:01:01.383613+0000","last_became_active":"2024-03-04T12:44:53.484341+0000","last_became_peered":"2024-03-04T12:44:53.484341+0000","last_unstale":"2024-03-04T13:01:01.383613+0000","last_undegraded":"2024-03-04T13:01:01.383613+0000","last_fullsized":"2024-03-04T13:01:01.383613+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:01.383525+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:01.383525+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.383525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:50:29.949251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.182971+0000","last_change":"2024-03-04T13:00:48.182971+0000","last_active":"2024-03-04T13:00:48.182971+0000","last_peered":"2024-03-04T13:00:48.182971+0000","last_clean":"2024-03-04T13:00:48.182971+0000","last_became_active":"2024-03-04T12:44:50.455509+0000","last_became_peered":"2024-03-04T12:44:50.455509+0000","last_unstale":"2024-03-04T13:00:48.182971+0000","last_undegraded":"2024-03-04T13:00:48.182971+0000","last_fullsized":"2024-03-04T13:00:48.182971+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:48.182850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:48.182850+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.182850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:46:46.844269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"256'40","reported_seq":146,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.596410+0000","last_change":"2024-03-04T13:00:27.596439+0000","last_active":"2024-03-04T13:00:27.596410+0000","last_peered":"2024-03-04T13:00:27.596410+0000","last_clean":"2024-03-04T13:00:27.596410+0000","last_became_active":"2024-03-04T12:43:27.060405+0000","last_became_peered":"2024-03-04T12:43:27.060405+0000","last_unstale":"2024-03-04T13:00:27.596410+0000","last_undegraded":"2024-03-04T13:00:27.596410+0000","last_fullsized":"2024-03-04T13:00:27.596410+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'40","last_scrub_stamp":"2024-03-04T13:00:27.596312+0000","last_deep_scrub":"256'40","last_deep_scrub_stamp":"2024-03-04T13:00:27.596312+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.596312+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:52.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":118,"num_write":66,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:13.097749+0000","last_change":"2024-03-04T13:01:13.097772+0000","last_active":"2024-03-04T13:01:13.097749+0000","last_peered":"2024-03-04T13:01:13.097749+0000","last_clean":"2024-03-04T13:01:13.097749+0000","last_became_active":"2024-03-04T12:51:01.358005+0000","last_became_peered":"2024-03-04T12:51:01.358005+0000","last_unstale":"2024-03-04T13:01:13.097749+0000","last_undegraded":"2024-03-04T13:01:13.097749+0000","last_fullsized":"2024-03-04T13:01:13.097749+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:13.097663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:13.097663+0000","last_clean_scrub_stamp":"2024-03-04T13:01:13.097663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:14.564101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"256'9","reported_seq":58,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.653214+0000","last_change":"2024-03-04T13:00:46.653244+0000","last_active":"2024-03-04T13:00:46.653214+0000","last_peered":"2024-03-04T13:00:46.653214+0000","last_clean":"2024-03-04T13:00:46.653214+0000","last_became_active":"2024-03-04T12:44:53.486168+0000","last_became_peered":"2024-03-04T12:44:53.486168+0000","last_unstale":"2024-03-04T13:00:46.653214+0000","last_undegraded":"2024-03-04T13:00:46.653214+0000","last_fullsized":"2024-03-04T13:00:46.653214+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:46.653131+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:46.653131+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.653131+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:15:05.535942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":10242,"num_write":7,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.629669+0000","last_change":"2024-03-04T13:00:22.629669+0000","last_active":"2024-03-04T13:00:22.629669+0000","last_peered":"2024-03-04T13:00:22.629669+0000","last_clean":"2024-03-04T13:00:22.629669+0000","last_became_active":"2024-03-04T12:44:50.450465+0000","last_became_peered":"2024-03-04T12:44:50.450465+0000","last_unstale":"2024-03-04T13:00:22.629669+0000","last_undegraded":"2024-03-04T13:00:22.629669+0000","last_fullsized":"2024-03-04T13:00:22.629669+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:22.629555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:22.629555+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.629555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:10.681596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"250'33","reported_seq":137,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.541501+0000","last_change":"2024-03-04T13:00:25.541501+0000","last_active":"2024-03-04T13:00:25.541501+0000","last_peered":"2024-03-04T13:00:25.541501+0000","last_clean":"2024-03-04T13:00:25.541501+0000","last_became_active":"2024-03-04T12:43:27.060562+0000","last_became_peered":"2024-03-04T12:43:27.060562+0000","last_unstale":"2024-03-04T13:00:25.541501+0000","last_undegraded":"2024-03-04T13:00:25.541501+0000","last_fullsized":"2024-03-04T13:00:25.541501+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'33","last_scrub_stamp":"2024-03-04T13:00:25.541401+0000","last_deep_scrub":"250'33","last_deep_scrub_stamp":"2024-03-04T13:00:25.541401+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.541401+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:43.219942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":113,"num_write":48,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:23.432260+0000","last_change":"2024-03-04T13:01:23.432284+0000","last_active":"2024-03-04T13:01:23.432260+0000","last_peered":"2024-03-04T13:01:23.432260+0000","last_clean":"2024-03-04T13:01:23.432260+0000","last_became_active":"2024-03-04T12:51:01.595776+0000","last_became_peered":"2024-03-04T12:51:01.595776+0000","last_unstale":"2024-03-04T13:01:23.432260+0000","last_undegraded":"2024-03-04T13:01:23.432260+0000","last_fullsized":"2024-03-04T13:01:23.432260+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:23.432163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:23.432163+0000","last_clean_scrub_stamp":"2024-03-04T13:01:23.432163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:15.834532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"256'14","reported_seq":65,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.116531+0000","last_change":"2024-03-04T13:00:36.116531+0000","last_active":"2024-03-04T13:00:36.116531+0000","last_peered":"2024-03-04T13:00:36.116531+0000","last_clean":"2024-03-04T13:00:36.116531+0000","last_became_active":"2024-03-04T12:44:53.478864+0000","last_became_peered":"2024-03-04T12:44:53.478864+0000","last_unstale":"2024-03-04T13:00:36.116531+0000","last_undegraded":"2024-03-04T13:00:36.116531+0000","last_fullsized":"2024-03-04T13:00:36.116531+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'14","last_scrub_stamp":"2024-03-04T13:00:36.116377+0000","last_deep_scrub":"256'14","last_deep_scrub_stamp":"2024-03-04T13:00:36.116377+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.116377+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:25:47.800519+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":27,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.687649+0000","last_change":"2024-03-04T13:00:26.687673+0000","last_active":"2024-03-04T13:00:26.687649+0000","last_peered":"2024-03-04T13:00:26.687649+0000","last_clean":"2024-03-04T13:00:26.687649+0000","last_became_active":"2024-03-04T12:44:50.453830+0000","last_became_peered":"2024-03-04T12:44:50.453830+0000","last_unstale":"2024-03-04T13:00:26.687649+0000","last_undegraded":"2024-03-04T13:00:26.687649+0000","last_fullsized":"2024-03-04T13:00:26.687649+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:26.687563+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:26.687563+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.687563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:43.300798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"256'64","reported_seq":206,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.295688+0000","last_change":"2024-03-04T13:00:28.295688+0000","last_active":"2024-03-04T13:00:28.295688+0000","last_peered":"2024-03-04T13:00:28.295688+0000","last_clean":"2024-03-04T13:00:28.295688+0000","last_became_active":"2024-03-04T12:43:27.067330+0000","last_became_peered":"2024-03-04T12:43:27.067330+0000","last_unstale":"2024-03-04T13:00:28.295688+0000","last_undegraded":"2024-03-04T13:00:28.295688+0000","last_fullsized":"2024-03-04T13:00:28.295688+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'64","last_scrub_stamp":"2024-03-04T13:00:28.295569+0000","last_deep_scrub":"256'64","last_deep_scrub_stamp":"2024-03-04T13:00:28.295569+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.295569+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:35:07.847340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":194,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:18.387786+0000","last_change":"2024-03-04T13:01:18.387786+0000","last_active":"2024-03-04T13:01:18.387786+0000","last_peered":"2024-03-04T13:01:18.387786+0000","last_clean":"2024-03-04T13:01:18.387786+0000","last_became_active":"2024-03-04T12:51:01.596268+0000","last_became_peered":"2024-03-04T12:51:01.596268+0000","last_unstale":"2024-03-04T13:01:18.387786+0000","last_undegraded":"2024-03-04T13:01:18.387786+0000","last_fullsized":"2024-03-04T13:01:18.387786+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:18.387625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:18.387625+0000","last_clean_scrub_stamp":"2024-03-04T13:01:18.387625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:56:02.811314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.223422+0000","last_change":"2024-03-04T13:00:54.223422+0000","last_active":"2024-03-04T13:00:54.223422+0000","last_peered":"2024-03-04T13:00:54.223422+0000","last_clean":"2024-03-04T13:00:54.223422+0000","last_became_active":"2024-03-04T12:44:53.481760+0000","last_became_peered":"2024-03-04T12:44:53.481760+0000","last_unstale":"2024-03-04T13:00:54.223422+0000","last_undegraded":"2024-03-04T13:00:54.223422+0000","last_fullsized":"2024-03-04T13:00:54.223422+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:54.223306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:54.223306+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.223306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:05.591529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.584224+0000","last_change":"2024-03-04T13:00:34.584252+0000","last_active":"2024-03-04T13:00:34.584224+0000","last_peered":"2024-03-04T13:00:34.584224+0000","last_clean":"2024-03-04T13:00:34.584224+0000","last_became_active":"2024-03-04T12:44:50.455723+0000","last_became_peered":"2024-03-04T12:44:50.455723+0000","last_unstale":"2024-03-04T13:00:34.584224+0000","last_undegraded":"2024-03-04T13:00:34.584224+0000","last_fullsized":"2024-03-04T13:00:34.584224+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:34.584103+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:34.584103+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.584103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:47.957581+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"256'151","reported_seq":510,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.376916+0000","last_change":"2024-03-04T13:00:23.376916+0000","last_active":"2024-03-04T13:00:23.376916+0000","last_peered":"2024-03-04T13:00:23.376916+0000","last_clean":"2024-03-04T13:00:23.376916+0000","last_became_active":"2024-03-04T12:43:27.067228+0000","last_became_peered":"2024-03-04T12:43:27.067228+0000","last_unstale":"2024-03-04T13:00:23.376916+0000","last_undegraded":"2024-03-04T13:00:23.376916+0000","last_fullsized":"2024-03-04T13:00:23.376916+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'151","last_scrub_stamp":"2024-03-04T13:00:23.376811+0000","last_deep_scrub":"256'151","last_deep_scrub_stamp":"2024-03-04T13:00:23.376811+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.376811+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:55:13.549907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":889,"num_read_kb":655,"num_write":189,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4940,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.591332+0000","last_change":"2024-03-04T13:01:03.591370+0000","last_active":"2024-03-04T13:01:03.591332+0000","last_peered":"2024-03-04T13:01:03.591332+0000","last_clean":"2024-03-04T13:01:03.591332+0000","last_became_active":"2024-03-04T12:51:01.356572+0000","last_became_peered":"2024-03-04T12:51:01.356572+0000","last_unstale":"2024-03-04T13:01:03.591332+0000","last_undegraded":"2024-03-04T13:01:03.591332+0000","last_fullsized":"2024-03-04T13:01:03.591332+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:03.591250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:03.591250+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.591250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:46.975750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"256'4","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.151000+0000","last_change":"2024-03-04T13:00:32.151061+0000","last_active":"2024-03-04T13:00:32.151000+0000","last_peered":"2024-03-04T13:00:32.151000+0000","last_clean":"2024-03-04T13:00:32.151000+0000","last_became_active":"2024-03-04T12:44:53.477386+0000","last_became_peered":"2024-03-04T12:44:53.477386+0000","last_unstale":"2024-03-04T13:00:32.151000+0000","last_undegraded":"2024-03-04T13:00:32.151000+0000","last_fullsized":"2024-03-04T13:00:32.151000+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:32.150910+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:32.150910+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.150910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:35.067029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":418,"num_write":4,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.868900+0000","last_change":"2024-03-04T13:00:25.868970+0000","last_active":"2024-03-04T13:00:25.868900+0000","last_peered":"2024-03-04T13:00:25.868900+0000","last_clean":"2024-03-04T13:00:25.868900+0000","last_became_active":"2024-03-04T12:44:50.448683+0000","last_became_peered":"2024-03-04T12:44:50.448683+0000","last_unstale":"2024-03-04T13:00:25.868900+0000","last_undegraded":"2024-03-04T13:00:25.868900+0000","last_fullsized":"2024-03-04T13:00:25.868900+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:25.868786+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:25.868786+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.868786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:06.732143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"256'38","reported_seq":138,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.367310+0000","last_change":"2024-03-04T13:00:25.367310+0000","last_active":"2024-03-04T13:00:25.367310+0000","last_peered":"2024-03-04T13:00:25.367310+0000","last_clean":"2024-03-04T13:00:25.367310+0000","last_became_active":"2024-03-04T12:43:27.062623+0000","last_became_peered":"2024-03-04T12:43:27.062623+0000","last_unstale":"2024-03-04T13:00:25.367310+0000","last_undegraded":"2024-03-04T13:00:25.367310+0000","last_fullsized":"2024-03-04T13:00:25.367310+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'38","last_scrub_stamp":"2024-03-04T13:00:25.367217+0000","last_deep_scrub":"256'38","last_deep_scrub_stamp":"2024-03-04T13:00:25.367217+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.367217+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:18:32.757230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":68,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:11.159729+0000","last_change":"2024-03-04T13:01:11.159754+0000","last_active":"2024-03-04T13:01:11.159729+0000","last_peered":"2024-03-04T13:01:11.159729+0000","last_clean":"2024-03-04T13:01:11.159729+0000","last_became_active":"2024-03-04T12:51:01.355578+0000","last_became_peered":"2024-03-04T12:51:01.355578+0000","last_unstale":"2024-03-04T13:01:11.159729+0000","last_undegraded":"2024-03-04T13:01:11.159729+0000","last_fullsized":"2024-03-04T13:01:11.159729+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:11.159635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:11.159635+0000","last_clean_scrub_stamp":"2024-03-04T13:01:11.159635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:39.530309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"256'11","reported_seq":57,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.499477+0000","last_change":"2024-03-04T13:00:42.499529+0000","last_active":"2024-03-04T13:00:42.499477+0000","last_peered":"2024-03-04T13:00:42.499477+0000","last_clean":"2024-03-04T13:00:42.499477+0000","last_became_active":"2024-03-04T12:44:53.476348+0000","last_became_peered":"2024-03-04T12:44:53.476348+0000","last_unstale":"2024-03-04T13:00:42.499477+0000","last_undegraded":"2024-03-04T13:00:42.499477+0000","last_fullsized":"2024-03-04T13:00:42.499477+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'11","last_scrub_stamp":"2024-03-04T13:00:42.499379+0000","last_deep_scrub":"256'11","last_deep_scrub_stamp":"2024-03-04T13:00:42.499379+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.499379+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:06.177825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13312,"num_write":16,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'7","reported_seq":60,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.741695+0000","last_change":"2024-03-04T13:00:30.741727+0000","last_active":"2024-03-04T13:00:30.741695+0000","last_peered":"2024-03-04T13:00:30.741695+0000","last_clean":"2024-03-04T13:00:30.741695+0000","last_became_active":"2024-03-04T12:44:50.454252+0000","last_became_peered":"2024-03-04T12:44:50.454252+0000","last_unstale":"2024-03-04T13:00:30.741695+0000","last_undegraded":"2024-03-04T13:00:30.741695+0000","last_fullsized":"2024-03-04T13:00:30.741695+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:00:30.741607+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:00:30.741607+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.741607+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:27.692537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"256'25","reported_seq":106,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.237546+0000","last_change":"2024-03-04T13:00:30.237546+0000","last_active":"2024-03-04T13:00:30.237546+0000","last_peered":"2024-03-04T13:00:30.237546+0000","last_clean":"2024-03-04T13:00:30.237546+0000","last_became_active":"2024-03-04T12:43:27.061611+0000","last_became_peered":"2024-03-04T12:43:27.061611+0000","last_unstale":"2024-03-04T13:00:30.237546+0000","last_undegraded":"2024-03-04T13:00:30.237546+0000","last_fullsized":"2024-03-04T13:00:30.237546+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'25","last_scrub_stamp":"2024-03-04T13:00:30.237361+0000","last_deep_scrub":"256'25","last_deep_scrub_stamp":"2024-03-04T13:00:30.237361+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.237361+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:40.824012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":64,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.670421+0000","last_change":"2024-03-04T13:00:50.670421+0000","last_active":"2024-03-04T13:00:50.670421+0000","last_peered":"2024-03-04T13:00:50.670421+0000","last_clean":"2024-03-04T13:00:50.670421+0000","last_became_active":"2024-03-04T12:51:01.351465+0000","last_became_peered":"2024-03-04T12:51:01.351465+0000","last_unstale":"2024-03-04T13:00:50.670421+0000","last_undegraded":"2024-03-04T13:00:50.670421+0000","last_fullsized":"2024-03-04T13:00:50.670421+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:50.670255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:50.670255+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.670255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:50:29.698487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"256'4","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:14.377978+0000","last_change":"2024-03-04T13:01:14.378005+0000","last_active":"2024-03-04T13:01:14.377978+0000","last_peered":"2024-03-04T13:01:14.377978+0000","last_clean":"2024-03-04T13:01:14.377978+0000","last_became_active":"2024-03-04T12:44:53.482806+0000","last_became_peered":"2024-03-04T12:44:53.482806+0000","last_unstale":"2024-03-04T13:01:14.377978+0000","last_undegraded":"2024-03-04T13:01:14.377978+0000","last_fullsized":"2024-03-04T13:01:14.377978+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:01:14.377884+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:01:14.377884+0000","last_clean_scrub_stamp":"2024-03-04T13:01:14.377884+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:00.007646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.377211+0000","last_change":"2024-03-04T13:00:22.377229+0000","last_active":"2024-03-04T13:00:22.377211+0000","last_peered":"2024-03-04T13:00:22.377211+0000","last_clean":"2024-03-04T13:00:22.377211+0000","last_became_active":"2024-03-04T12:44:50.457180+0000","last_became_peered":"2024-03-04T12:44:50.457180+0000","last_unstale":"2024-03-04T13:00:22.377211+0000","last_undegraded":"2024-03-04T13:00:22.377211+0000","last_fullsized":"2024-03-04T13:00:22.377211+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:22.377126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:22.377126+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.377126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:53.011158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"256'43","reported_seq":141,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.659958+0000","last_change":"2024-03-04T13:00:25.659958+0000","last_active":"2024-03-04T13:00:25.659958+0000","last_peered":"2024-03-04T13:00:25.659958+0000","last_clean":"2024-03-04T13:00:25.659958+0000","last_became_active":"2024-03-04T12:43:27.063191+0000","last_became_peered":"2024-03-04T12:43:27.063191+0000","last_unstale":"2024-03-04T13:00:25.659958+0000","last_undegraded":"2024-03-04T13:00:25.659958+0000","last_fullsized":"2024-03-04T13:00:25.659958+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'43","last_scrub_stamp":"2024-03-04T13:00:25.659791+0000","last_deep_scrub":"256'43","last_deep_scrub_stamp":"2024-03-04T13:00:25.659791+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.659791+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:44:08.536513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":76,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.634331+0000","last_change":"2024-03-04T13:01:00.634331+0000","last_active":"2024-03-04T13:01:00.634331+0000","last_peered":"2024-03-04T13:01:00.634331+0000","last_clean":"2024-03-04T13:01:00.634331+0000","last_became_active":"2024-03-04T12:51:01.353248+0000","last_became_peered":"2024-03-04T12:51:01.353248+0000","last_unstale":"2024-03-04T13:01:00.634331+0000","last_undegraded":"2024-03-04T13:01:00.634331+0000","last_fullsized":"2024-03-04T13:01:00.634331+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:00.634191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:00.634191+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.634191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:53.499135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"256'6","reported_seq":51,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:07.889808+0000","last_change":"2024-03-04T13:01:07.889869+0000","last_active":"2024-03-04T13:01:07.889808+0000","last_peered":"2024-03-04T13:01:07.889808+0000","last_clean":"2024-03-04T13:01:07.889808+0000","last_became_active":"2024-03-04T12:44:53.483210+0000","last_became_peered":"2024-03-04T12:44:53.483210+0000","last_unstale":"2024-03-04T13:01:07.889808+0000","last_undegraded":"2024-03-04T13:01:07.889808+0000","last_fullsized":"2024-03-04T13:01:07.889808+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:01:07.889700+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:01:07.889700+0000","last_clean_scrub_stamp":"2024-03-04T13:01:07.889700+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:50.606393+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"256'9","reported_seq":62,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.633368+0000","last_change":"2024-03-04T13:00:23.633396+0000","last_active":"2024-03-04T13:00:23.633368+0000","last_peered":"2024-03-04T13:00:23.633368+0000","last_clean":"2024-03-04T13:00:23.633368+0000","last_became_active":"2024-03-04T12:44:50.449291+0000","last_became_peered":"2024-03-04T12:44:50.449291+0000","last_unstale":"2024-03-04T13:00:23.633368+0000","last_undegraded":"2024-03-04T13:00:23.633368+0000","last_fullsized":"2024-03-04T13:00:23.633368+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:23.633297+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:23.633297+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.633297+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:09.478343+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"256'42","reported_seq":139,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.413406+0000","last_change":"2024-03-04T13:00:36.413430+0000","last_active":"2024-03-04T13:00:36.413406+0000","last_peered":"2024-03-04T13:00:36.413406+0000","last_clean":"2024-03-04T13:00:36.413406+0000","last_became_active":"2024-03-04T12:43:27.061663+0000","last_became_peered":"2024-03-04T12:43:27.061663+0000","last_unstale":"2024-03-04T13:00:36.413406+0000","last_undegraded":"2024-03-04T13:00:36.413406+0000","last_fullsized":"2024-03-04T13:00:36.413406+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'42","last_scrub_stamp":"2024-03-04T13:00:36.413321+0000","last_deep_scrub":"256'42","last_deep_scrub_stamp":"2024-03-04T13:00:36.413321+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.413321+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:53.818525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":85,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:21.404155+0000","last_change":"2024-03-04T13:01:21.404184+0000","last_active":"2024-03-04T13:01:21.404155+0000","last_peered":"2024-03-04T13:01:21.404155+0000","last_clean":"2024-03-04T13:01:21.404155+0000","last_became_active":"2024-03-04T12:51:01.595943+0000","last_became_peered":"2024-03-04T12:51:01.595943+0000","last_unstale":"2024-03-04T13:01:21.404155+0000","last_undegraded":"2024-03-04T13:01:21.404155+0000","last_fullsized":"2024-03-04T13:01:21.404155+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:21.404066+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:21.404066+0000","last_clean_scrub_stamp":"2024-03-04T13:01:21.404066+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:08:13.326421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"256'2","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:10.198954+0000","last_change":"2024-03-04T13:01:10.198980+0000","last_active":"2024-03-04T13:01:10.198954+0000","last_peered":"2024-03-04T13:01:10.198954+0000","last_clean":"2024-03-04T13:01:10.198954+0000","last_became_active":"2024-03-04T12:44:53.485995+0000","last_became_peered":"2024-03-04T12:44:53.485995+0000","last_unstale":"2024-03-04T13:01:10.198954+0000","last_undegraded":"2024-03-04T13:01:10.198954+0000","last_fullsized":"2024-03-04T13:01:10.198954+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:10.198865+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:10.198865+0000","last_clean_scrub_stamp":"2024-03-04T13:01:10.198865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:47:54.926710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"256'4","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.794012+0000","last_change":"2024-03-04T13:00:34.794073+0000","last_active":"2024-03-04T13:00:34.794012+0000","last_peered":"2024-03-04T13:00:34.794012+0000","last_clean":"2024-03-04T13:00:34.794012+0000","last_became_active":"2024-03-04T12:44:50.454617+0000","last_became_peered":"2024-03-04T12:44:50.454617+0000","last_unstale":"2024-03-04T13:00:34.794012+0000","last_undegraded":"2024-03-04T13:00:34.794012+0000","last_fullsized":"2024-03-04T13:00:34.794012+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:34.793901+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:34.793901+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.793901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:24:05.781091+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"256'41","reported_seq":144,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.757303+0000","last_change":"2024-03-04T13:00:31.757332+0000","last_active":"2024-03-04T13:00:31.757303+0000","last_peered":"2024-03-04T13:00:31.757303+0000","last_clean":"2024-03-04T13:00:31.757303+0000","last_became_active":"2024-03-04T12:43:27.050088+0000","last_became_peered":"2024-03-04T12:43:27.050088+0000","last_unstale":"2024-03-04T13:00:31.757303+0000","last_undegraded":"2024-03-04T13:00:31.757303+0000","last_fullsized":"2024-03-04T13:00:31.757303+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'41","last_scrub_stamp":"2024-03-04T13:00:31.757200+0000","last_deep_scrub":"256'41","last_deep_scrub_stamp":"2024-03-04T13:00:31.757200+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.757200+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:30:26.807415+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":112,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:22.403055+0000","last_change":"2024-03-04T13:01:22.403082+0000","last_active":"2024-03-04T13:01:22.403055+0000","last_peered":"2024-03-04T13:01:22.403055+0000","last_clean":"2024-03-04T13:01:22.403055+0000","last_became_active":"2024-03-04T12:51:01.595530+0000","last_became_peered":"2024-03-04T12:51:01.595530+0000","last_unstale":"2024-03-04T13:01:22.403055+0000","last_undegraded":"2024-03-04T13:01:22.403055+0000","last_fullsized":"2024-03-04T13:01:22.403055+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:22.402951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:22.402951+0000","last_clean_scrub_stamp":"2024-03-04T13:01:22.402951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:21:49.573954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"256'4","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:08.244533+0000","last_change":"2024-03-04T13:01:08.244533+0000","last_active":"2024-03-04T13:01:08.244533+0000","last_peered":"2024-03-04T13:01:08.244533+0000","last_clean":"2024-03-04T13:01:08.244533+0000","last_became_active":"2024-03-04T12:44:53.478099+0000","last_became_peered":"2024-03-04T12:44:53.478099+0000","last_unstale":"2024-03-04T13:01:08.244533+0000","last_undegraded":"2024-03-04T13:01:08.244533+0000","last_fullsized":"2024-03-04T13:01:08.244533+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:01:08.244374+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:01:08.244374+0000","last_clean_scrub_stamp":"2024-03-04T13:01:08.244374+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:38.953358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1032,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"250'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.588764+0000","last_change":"2024-03-04T13:00:24.588802+0000","last_active":"2024-03-04T13:00:24.588764+0000","last_peered":"2024-03-04T13:00:24.588764+0000","last_clean":"2024-03-04T13:00:24.588764+0000","last_became_active":"2024-03-04T12:44:50.448745+0000","last_became_peered":"2024-03-04T12:44:50.448745+0000","last_unstale":"2024-03-04T13:00:24.588764+0000","last_undegraded":"2024-03-04T13:00:24.588764+0000","last_fullsized":"2024-03-04T13:00:24.588764+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:24.588654+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:24.588654+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.588654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:49:36.928946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"256'16","reported_seq":90,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.456547+0000","last_change":"2024-03-04T13:00:28.456571+0000","last_active":"2024-03-04T13:00:28.456547+0000","last_peered":"2024-03-04T13:00:28.456547+0000","last_clean":"2024-03-04T13:00:28.456547+0000","last_became_active":"2024-03-04T12:43:27.059494+0000","last_became_peered":"2024-03-04T12:43:27.059494+0000","last_unstale":"2024-03-04T13:00:28.456547+0000","last_undegraded":"2024-03-04T13:00:28.456547+0000","last_fullsized":"2024-03-04T13:00:28.456547+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'16","last_scrub_stamp":"2024-03-04T13:00:28.456461+0000","last_deep_scrub":"256'16","last_deep_scrub_stamp":"2024-03-04T13:00:28.456461+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.456461+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:06.545751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":48,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:12.929077+0000","last_change":"2024-03-04T13:01:12.929100+0000","last_active":"2024-03-04T13:01:12.929077+0000","last_peered":"2024-03-04T13:01:12.929077+0000","last_clean":"2024-03-04T13:01:12.929077+0000","last_became_active":"2024-03-04T12:51:01.355560+0000","last_became_peered":"2024-03-04T12:51:01.355560+0000","last_unstale":"2024-03-04T13:01:12.929077+0000","last_undegraded":"2024-03-04T13:01:12.929077+0000","last_fullsized":"2024-03-04T13:01:12.929077+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:12.928983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:12.928983+0000","last_clean_scrub_stamp":"2024-03-04T13:01:12.928983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:32:12.513685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'3","reported_seq":44,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.548095+0000","last_change":"2024-03-04T13:00:38.548121+0000","last_active":"2024-03-04T13:00:38.548095+0000","last_peered":"2024-03-04T13:00:38.548095+0000","last_clean":"2024-03-04T13:00:38.548095+0000","last_became_active":"2024-03-04T12:44:53.475861+0000","last_became_peered":"2024-03-04T12:44:53.475861+0000","last_unstale":"2024-03-04T13:00:38.548095+0000","last_undegraded":"2024-03-04T13:00:38.548095+0000","last_fullsized":"2024-03-04T13:00:38.548095+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'3","last_scrub_stamp":"2024-03-04T13:00:38.548004+0000","last_deep_scrub":"250'3","last_deep_scrub_stamp":"2024-03-04T13:00:38.548004+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.548004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:54:35.955700+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"256'8","reported_seq":60,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.305365+0000","last_change":"2024-03-04T13:00:25.305365+0000","last_active":"2024-03-04T13:00:25.305365+0000","last_peered":"2024-03-04T13:00:25.305365+0000","last_clean":"2024-03-04T13:00:25.305365+0000","last_became_active":"2024-03-04T12:44:50.453541+0000","last_became_peered":"2024-03-04T12:44:50.453541+0000","last_unstale":"2024-03-04T13:00:25.305365+0000","last_undegraded":"2024-03-04T13:00:25.305365+0000","last_fullsized":"2024-03-04T13:00:25.305365+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'8","last_scrub_stamp":"2024-03-04T13:00:25.305244+0000","last_deep_scrub":"256'8","last_deep_scrub_stamp":"2024-03-04T13:00:25.305244+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.305244+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:50.904960+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"256'48","reported_seq":157,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.235467+0000","last_change":"2024-03-04T13:00:22.235467+0000","last_active":"2024-03-04T13:00:22.235467+0000","last_peered":"2024-03-04T13:00:22.235467+0000","last_clean":"2024-03-04T13:00:22.235467+0000","last_became_active":"2024-03-04T12:43:27.069664+0000","last_became_peered":"2024-03-04T12:43:27.069664+0000","last_unstale":"2024-03-04T13:00:22.235467+0000","last_undegraded":"2024-03-04T13:00:22.235467+0000","last_fullsized":"2024-03-04T13:00:22.235467+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'48","last_scrub_stamp":"2024-03-04T13:00:22.235365+0000","last_deep_scrub":"256'48","last_deep_scrub_stamp":"2024-03-04T13:00:22.235365+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.235365+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:38:42.140621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":23,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:19.383097+0000","last_change":"2024-03-04T13:01:19.383097+0000","last_active":"2024-03-04T13:01:19.383097+0000","last_peered":"2024-03-04T13:01:19.383097+0000","last_clean":"2024-03-04T13:01:19.383097+0000","last_became_active":"2024-03-04T12:51:41.752775+0000","last_became_peered":"2024-03-04T12:51:41.752775+0000","last_unstale":"2024-03-04T13:01:19.383097+0000","last_undegraded":"2024-03-04T13:01:19.383097+0000","last_fullsized":"2024-03-04T13:01:19.383097+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:19.382922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:19.382922+0000","last_clean_scrub_stamp":"2024-03-04T13:01:19.382922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:09.220261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"256'7","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.154187+0000","last_change":"2024-03-04T13:00:51.154226+0000","last_active":"2024-03-04T13:00:51.154187+0000","last_peered":"2024-03-04T13:00:51.154187+0000","last_clean":"2024-03-04T13:00:51.154187+0000","last_became_active":"2024-03-04T12:44:53.478126+0000","last_became_peered":"2024-03-04T12:44:53.478126+0000","last_unstale":"2024-03-04T13:00:51.154187+0000","last_undegraded":"2024-03-04T13:00:51.154187+0000","last_fullsized":"2024-03-04T13:00:51.154187+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:00:51.154098+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:00:51.154098+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.154098+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:41:53.864198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11793,"num_write":12,"num_write_kb":7697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'2","reported_seq":48,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.220991+0000","last_change":"2024-03-04T13:00:49.221016+0000","last_active":"2024-03-04T13:00:49.220991+0000","last_peered":"2024-03-04T13:00:49.220991+0000","last_clean":"2024-03-04T13:00:49.220991+0000","last_became_active":"2024-03-04T12:44:50.455571+0000","last_became_peered":"2024-03-04T12:44:50.455571+0000","last_unstale":"2024-03-04T13:00:49.220991+0000","last_undegraded":"2024-03-04T13:00:49.220991+0000","last_fullsized":"2024-03-04T13:00:49.220991+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:49.220893+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:49.220893+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.220893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:10.521167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"256'47","reported_seq":151,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.409207+0000","last_change":"2024-03-04T13:00:27.409254+0000","last_active":"2024-03-04T13:00:27.409207+0000","last_peered":"2024-03-04T13:00:27.409207+0000","last_clean":"2024-03-04T13:00:27.409207+0000","last_became_active":"2024-03-04T12:43:27.060225+0000","last_became_peered":"2024-03-04T12:43:27.060225+0000","last_unstale":"2024-03-04T13:00:27.409207+0000","last_undegraded":"2024-03-04T13:00:27.409207+0000","last_fullsized":"2024-03-04T13:00:27.409207+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'47","last_scrub_stamp":"2024-03-04T13:00:27.409102+0000","last_deep_scrub":"256'47","last_deep_scrub_stamp":"2024-03-04T13:00:27.409102+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.409102+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:54:12.358389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":112,"num_write":82,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:04.314727+0000","last_change":"2024-03-04T13:01:04.314750+0000","last_active":"2024-03-04T13:01:04.314727+0000","last_peered":"2024-03-04T13:01:04.314727+0000","last_clean":"2024-03-04T13:01:04.314727+0000","last_became_active":"2024-03-04T12:51:01.353087+0000","last_became_peered":"2024-03-04T12:51:01.353087+0000","last_unstale":"2024-03-04T13:01:04.314727+0000","last_undegraded":"2024-03-04T13:01:04.314727+0000","last_fullsized":"2024-03-04T13:01:04.314727+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:04.314637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:04.314637+0000","last_clean_scrub_stamp":"2024-03-04T13:01:04.314637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:38.913395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.726659+0000","last_change":"2024-03-04T13:00:42.726659+0000","last_active":"2024-03-04T13:00:42.726659+0000","last_peered":"2024-03-04T13:00:42.726659+0000","last_clean":"2024-03-04T13:00:42.726659+0000","last_became_active":"2024-03-04T12:44:53.485819+0000","last_became_peered":"2024-03-04T12:44:53.485819+0000","last_unstale":"2024-03-04T13:00:42.726659+0000","last_undegraded":"2024-03-04T13:00:42.726659+0000","last_fullsized":"2024-03-04T13:00:42.726659+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:42.726495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:42.726495+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.726495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:39:45.012364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"256'18","reported_seq":82,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.562385+0000","last_change":"2024-03-04T13:00:26.562385+0000","last_active":"2024-03-04T13:00:26.562385+0000","last_peered":"2024-03-04T13:00:26.562385+0000","last_clean":"2024-03-04T13:00:26.562385+0000","last_became_active":"2024-03-04T12:44:50.451612+0000","last_became_peered":"2024-03-04T12:44:50.451612+0000","last_unstale":"2024-03-04T13:00:26.562385+0000","last_undegraded":"2024-03-04T13:00:26.562385+0000","last_fullsized":"2024-03-04T13:00:26.562385+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'18","last_scrub_stamp":"2024-03-04T13:00:26.562265+0000","last_deep_scrub":"256'18","last_deep_scrub_stamp":"2024-03-04T13:00:26.562265+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.562265+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:30:31.690140+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":29700,"num_write":24,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"256'29","reported_seq":118,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.267423+0000","last_change":"2024-03-04T13:00:37.267495+0000","last_active":"2024-03-04T13:00:37.267423+0000","last_peered":"2024-03-04T13:00:37.267423+0000","last_clean":"2024-03-04T13:00:37.267423+0000","last_became_active":"2024-03-04T12:43:27.067356+0000","last_became_peered":"2024-03-04T12:43:27.067356+0000","last_unstale":"2024-03-04T13:00:37.267423+0000","last_undegraded":"2024-03-04T13:00:37.267423+0000","last_fullsized":"2024-03-04T13:00:37.267423+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'29","last_scrub_stamp":"2024-03-04T13:00:37.267297+0000","last_deep_scrub":"256'29","last_deep_scrub_stamp":"2024-03-04T13:00:37.267297+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.267297+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:05.403189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":50,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.352311+0000","last_change":"2024-03-04T13:01:03.352333+0000","last_active":"2024-03-04T13:01:03.352311+0000","last_peered":"2024-03-04T13:01:03.352311+0000","last_clean":"2024-03-04T13:01:03.352311+0000","last_became_active":"2024-03-04T12:51:01.352205+0000","last_became_peered":"2024-03-04T12:51:01.352205+0000","last_unstale":"2024-03-04T13:01:03.352311+0000","last_undegraded":"2024-03-04T13:01:03.352311+0000","last_fullsized":"2024-03-04T13:01:03.352311+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:03.352212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:03.352212+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.352212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:28.995763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"256'10","reported_seq":58,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.111906+0000","last_change":"2024-03-04T13:00:40.111906+0000","last_active":"2024-03-04T13:00:40.111906+0000","last_peered":"2024-03-04T13:00:40.111906+0000","last_clean":"2024-03-04T13:00:40.111906+0000","last_became_active":"2024-03-04T12:44:53.479906+0000","last_became_peered":"2024-03-04T12:44:53.479906+0000","last_unstale":"2024-03-04T13:00:40.111906+0000","last_undegraded":"2024-03-04T13:00:40.111906+0000","last_fullsized":"2024-03-04T13:00:40.111906+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'10","last_scrub_stamp":"2024-03-04T13:00:40.111726+0000","last_deep_scrub":"256'10","last_deep_scrub_stamp":"2024-03-04T13:00:40.111726+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.111726+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:53.009649+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8765,"num_write":13,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"256'2","reported_seq":49,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.233511+0000","last_change":"2024-03-04T13:00:31.233511+0000","last_active":"2024-03-04T13:00:31.233511+0000","last_peered":"2024-03-04T13:00:31.233511+0000","last_clean":"2024-03-04T13:00:31.233511+0000","last_became_active":"2024-03-04T12:44:50.455705+0000","last_became_peered":"2024-03-04T12:44:50.455705+0000","last_unstale":"2024-03-04T13:00:31.233511+0000","last_undegraded":"2024-03-04T13:00:31.233511+0000","last_fullsized":"2024-03-04T13:00:31.233511+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:31.233395+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:31.233395+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.233395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:43:28.071292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"256'37","reported_seq":138,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.483753+0000","last_change":"2024-03-04T13:00:26.483782+0000","last_active":"2024-03-04T13:00:26.483753+0000","last_peered":"2024-03-04T13:00:26.483753+0000","last_clean":"2024-03-04T13:00:26.483753+0000","last_became_active":"2024-03-04T12:43:27.049948+0000","last_became_peered":"2024-03-04T12:43:27.049948+0000","last_unstale":"2024-03-04T13:00:26.483753+0000","last_undegraded":"2024-03-04T13:00:26.483753+0000","last_fullsized":"2024-03-04T13:00:26.483753+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'37","last_scrub_stamp":"2024-03-04T13:00:26.483653+0000","last_deep_scrub":"256'37","last_deep_scrub_stamp":"2024-03-04T13:00:26.483653+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.483653+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:53:44.304398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":102,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.624783+0000","last_change":"2024-03-04T13:01:02.624803+0000","last_active":"2024-03-04T13:01:02.624783+0000","last_peered":"2024-03-04T13:01:02.624783+0000","last_clean":"2024-03-04T13:01:02.624783+0000","last_became_active":"2024-03-04T12:51:01.355460+0000","last_became_peered":"2024-03-04T12:51:01.355460+0000","last_unstale":"2024-03-04T13:01:02.624783+0000","last_undegraded":"2024-03-04T13:01:02.624783+0000","last_fullsized":"2024-03-04T13:01:02.624783+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:02.624706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:02.624706+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.624706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:27:33.304907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:10.174187+0000","last_change":"2024-03-04T13:01:10.174187+0000","last_active":"2024-03-04T13:01:10.174187+0000","last_peered":"2024-03-04T13:01:10.174187+0000","last_clean":"2024-03-04T13:01:10.174187+0000","last_became_active":"2024-03-04T12:44:53.482573+0000","last_became_peered":"2024-03-04T12:44:53.482573+0000","last_unstale":"2024-03-04T13:01:10.174187+0000","last_undegraded":"2024-03-04T13:01:10.174187+0000","last_fullsized":"2024-03-04T13:01:10.174187+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:10.174055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:10.174055+0000","last_clean_scrub_stamp":"2024-03-04T13:01:10.174055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:16.592097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:22.707500+0000","last_change":"2024-03-04T13:00:22.707500+0000","last_active":"2024-03-04T13:00:22.707500+0000","last_peered":"2024-03-04T13:00:22.707500+0000","last_clean":"2024-03-04T13:00:22.707500+0000","last_became_active":"2024-03-04T12:44:50.450815+0000","last_became_peered":"2024-03-04T12:44:50.450815+0000","last_unstale":"2024-03-04T13:00:22.707500+0000","last_undegraded":"2024-03-04T13:00:22.707500+0000","last_fullsized":"2024-03-04T13:00:22.707500+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:22.707367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:22.707367+0000","last_clean_scrub_stamp":"2024-03-04T13:00:22.707367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:12:35.310838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"256'28","reported_seq":114,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.098819+0000","last_change":"2024-03-04T13:00:25.098849+0000","last_active":"2024-03-04T13:00:25.098819+0000","last_peered":"2024-03-04T13:00:25.098819+0000","last_clean":"2024-03-04T13:00:25.098819+0000","last_became_active":"2024-03-04T12:43:27.055932+0000","last_became_peered":"2024-03-04T12:43:27.055932+0000","last_unstale":"2024-03-04T13:00:25.098819+0000","last_undegraded":"2024-03-04T13:00:25.098819+0000","last_fullsized":"2024-03-04T13:00:25.098819+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'28","last_scrub_stamp":"2024-03-04T13:00:25.098717+0000","last_deep_scrub":"256'28","last_deep_scrub_stamp":"2024-03-04T13:00:25.098717+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.098717+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:13.975808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:18.475442+0000","last_change":"2024-03-04T13:01:18.475471+0000","last_active":"2024-03-04T13:01:18.475442+0000","last_peered":"2024-03-04T13:01:18.475442+0000","last_clean":"2024-03-04T13:01:18.475442+0000","last_became_active":"2024-03-04T12:51:01.356234+0000","last_became_peered":"2024-03-04T12:51:01.356234+0000","last_unstale":"2024-03-04T13:01:18.475442+0000","last_undegraded":"2024-03-04T13:01:18.475442+0000","last_fullsized":"2024-03-04T13:01:18.475442+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:18.475342+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:18.475342+0000","last_clean_scrub_stamp":"2024-03-04T13:01:18.475342+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:44.768302+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.676376+0000","last_change":"2024-03-04T13:00:59.676376+0000","last_active":"2024-03-04T13:00:59.676376+0000","last_peered":"2024-03-04T13:00:59.676376+0000","last_clean":"2024-03-04T13:00:59.676376+0000","last_became_active":"2024-03-04T12:44:53.481628+0000","last_became_peered":"2024-03-04T12:44:53.481628+0000","last_unstale":"2024-03-04T13:00:59.676376+0000","last_undegraded":"2024-03-04T13:00:59.676376+0000","last_fullsized":"2024-03-04T13:00:59.676376+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:59.676240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:59.676240+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.676240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:02.512577+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"250'2","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.076868+0000","last_change":"2024-03-04T13:00:24.076868+0000","last_active":"2024-03-04T13:00:24.076868+0000","last_peered":"2024-03-04T13:00:24.076868+0000","last_clean":"2024-03-04T13:00:24.076868+0000","last_became_active":"2024-03-04T12:44:50.457629+0000","last_became_peered":"2024-03-04T12:44:50.457629+0000","last_unstale":"2024-03-04T13:00:24.076868+0000","last_undegraded":"2024-03-04T13:00:24.076868+0000","last_fullsized":"2024-03-04T13:00:24.076868+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:24.076745+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:24.076745+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.076745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:23:15.455149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"256'46","reported_seq":157,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.678497+0000","last_change":"2024-03-04T13:00:27.678522+0000","last_active":"2024-03-04T13:00:27.678497+0000","last_peered":"2024-03-04T13:00:27.678497+0000","last_clean":"2024-03-04T13:00:27.678497+0000","last_became_active":"2024-03-04T12:43:27.061268+0000","last_became_peered":"2024-03-04T12:43:27.061268+0000","last_unstale":"2024-03-04T13:00:27.678497+0000","last_undegraded":"2024-03-04T13:00:27.678497+0000","last_fullsized":"2024-03-04T13:00:27.678497+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'46","last_scrub_stamp":"2024-03-04T13:00:27.678408+0000","last_deep_scrub":"256'46","last_deep_scrub_stamp":"2024-03-04T13:00:27.678408+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.678408+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:22.425866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":125,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:17.490494+0000","last_change":"2024-03-04T13:01:17.490540+0000","last_active":"2024-03-04T13:01:17.490494+0000","last_peered":"2024-03-04T13:01:17.490494+0000","last_clean":"2024-03-04T13:01:17.490494+0000","last_became_active":"2024-03-04T12:51:01.351718+0000","last_became_peered":"2024-03-04T12:51:01.351718+0000","last_unstale":"2024-03-04T13:01:17.490494+0000","last_undegraded":"2024-03-04T13:01:17.490494+0000","last_fullsized":"2024-03-04T13:01:17.490494+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:17.490369+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:17.490369+0000","last_clean_scrub_stamp":"2024-03-04T13:01:17.490369+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:26.344184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"256'8","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.159522+0000","last_change":"2024-03-04T13:00:52.159557+0000","last_active":"2024-03-04T13:00:52.159522+0000","last_peered":"2024-03-04T13:00:52.159522+0000","last_clean":"2024-03-04T13:00:52.159522+0000","last_became_active":"2024-03-04T12:44:53.480237+0000","last_became_peered":"2024-03-04T12:44:53.480237+0000","last_unstale":"2024-03-04T13:00:52.159522+0000","last_undegraded":"2024-03-04T13:00:52.159522+0000","last_fullsized":"2024-03-04T13:00:52.159522+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'8","last_scrub_stamp":"2024-03-04T13:00:52.159435+0000","last_deep_scrub":"256'8","last_deep_scrub_stamp":"2024-03-04T13:00:52.159435+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.159435+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:16.294942+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"256'4","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:07.261130+0000","last_change":"2024-03-04T13:01:07.261189+0000","last_active":"2024-03-04T13:01:07.261130+0000","last_peered":"2024-03-04T13:01:07.261130+0000","last_clean":"2024-03-04T13:01:07.261130+0000","last_became_active":"2024-03-04T12:44:50.451353+0000","last_became_peered":"2024-03-04T12:44:50.451353+0000","last_unstale":"2024-03-04T13:01:07.261130+0000","last_undegraded":"2024-03-04T13:01:07.261130+0000","last_fullsized":"2024-03-04T13:01:07.261130+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:01:07.261029+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:01:07.261029+0000","last_clean_scrub_stamp":"2024-03-04T13:01:07.261029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:12:24.880595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"256'22","reported_seq":98,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.408351+0000","last_change":"2024-03-04T13:00:32.408351+0000","last_active":"2024-03-04T13:00:32.408351+0000","last_peered":"2024-03-04T13:00:32.408351+0000","last_clean":"2024-03-04T13:00:32.408351+0000","last_became_active":"2024-03-04T12:43:27.060626+0000","last_became_peered":"2024-03-04T12:43:27.060626+0000","last_unstale":"2024-03-04T13:00:32.408351+0000","last_undegraded":"2024-03-04T13:00:32.408351+0000","last_fullsized":"2024-03-04T13:00:32.408351+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'22","last_scrub_stamp":"2024-03-04T13:00:32.408218+0000","last_deep_scrub":"256'22","last_deep_scrub_stamp":"2024-03-04T13:00:32.408218+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.408218+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:27:11.399231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":39,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:19.449236+0000","last_change":"2024-03-04T13:01:19.449261+0000","last_active":"2024-03-04T13:01:19.449236+0000","last_peered":"2024-03-04T13:01:19.449236+0000","last_clean":"2024-03-04T13:01:19.449236+0000","last_became_active":"2024-03-04T12:51:01.356268+0000","last_became_peered":"2024-03-04T12:51:01.356268+0000","last_unstale":"2024-03-04T13:01:19.449236+0000","last_undegraded":"2024-03-04T13:01:19.449236+0000","last_fullsized":"2024-03-04T13:01:19.449236+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:19.449133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:19.449133+0000","last_clean_scrub_stamp":"2024-03-04T13:01:19.449133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:27:19.072853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"256'2","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:12.228966+0000","last_change":"2024-03-04T13:01:12.229044+0000","last_active":"2024-03-04T13:01:12.228966+0000","last_peered":"2024-03-04T13:01:12.228966+0000","last_clean":"2024-03-04T13:01:12.228966+0000","last_became_active":"2024-03-04T12:44:53.488798+0000","last_became_peered":"2024-03-04T12:44:53.488798+0000","last_unstale":"2024-03-04T13:01:12.228966+0000","last_undegraded":"2024-03-04T13:01:12.228966+0000","last_fullsized":"2024-03-04T13:01:12.228966+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:12.228867+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:12.228867+0000","last_clean_scrub_stamp":"2024-03-04T13:01:12.228867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:24.894921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'9","reported_seq":61,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.712653+0000","last_change":"2024-03-04T13:00:23.712653+0000","last_active":"2024-03-04T13:00:23.712653+0000","last_peered":"2024-03-04T13:00:23.712653+0000","last_clean":"2024-03-04T13:00:23.712653+0000","last_became_active":"2024-03-04T12:44:50.449555+0000","last_became_peered":"2024-03-04T12:44:50.449555+0000","last_unstale":"2024-03-04T13:00:23.712653+0000","last_undegraded":"2024-03-04T13:00:23.712653+0000","last_fullsized":"2024-03-04T13:00:23.712653+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:23.712551+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:23.712551+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.712551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:19.679050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9220,"num_write":14,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"256'38","reported_seq":141,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.809977+0000","last_change":"2024-03-04T13:00:27.809977+0000","last_active":"2024-03-04T13:00:27.809977+0000","last_peered":"2024-03-04T13:00:27.809977+0000","last_clean":"2024-03-04T13:00:27.809977+0000","last_became_active":"2024-03-04T12:43:27.062618+0000","last_became_peered":"2024-03-04T12:43:27.062618+0000","last_unstale":"2024-03-04T13:00:27.809977+0000","last_undegraded":"2024-03-04T13:00:27.809977+0000","last_fullsized":"2024-03-04T13:00:27.809977+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'38","last_scrub_stamp":"2024-03-04T13:00:27.809856+0000","last_deep_scrub":"256'38","last_deep_scrub_stamp":"2024-03-04T13:00:27.809856+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.809856+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:40:07.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":110,"num_write":59,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:20.407980+0000","last_change":"2024-03-04T13:01:20.408004+0000","last_active":"2024-03-04T13:01:20.407980+0000","last_peered":"2024-03-04T13:01:20.407980+0000","last_clean":"2024-03-04T13:01:20.407980+0000","last_became_active":"2024-03-04T12:51:01.357842+0000","last_became_peered":"2024-03-04T12:51:01.357842+0000","last_unstale":"2024-03-04T13:01:20.407980+0000","last_undegraded":"2024-03-04T13:01:20.407980+0000","last_fullsized":"2024-03-04T13:01:20.407980+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:20.407884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:20.407884+0000","last_clean_scrub_stamp":"2024-03-04T13:01:20.407884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:55.058129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"256'2","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.389682+0000","last_change":"2024-03-04T13:00:30.389682+0000","last_active":"2024-03-04T13:00:30.389682+0000","last_peered":"2024-03-04T13:00:30.389682+0000","last_clean":"2024-03-04T13:00:30.389682+0000","last_became_active":"2024-03-04T12:44:53.483209+0000","last_became_peered":"2024-03-04T12:44:53.483209+0000","last_unstale":"2024-03-04T13:00:30.389682+0000","last_undegraded":"2024-03-04T13:00:30.389682+0000","last_fullsized":"2024-03-04T13:00:30.389682+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:30.389535+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:30.389535+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.389535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:42:25.469104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"256'6","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.198335+0000","last_change":"2024-03-04T13:00:50.198364+0000","last_active":"2024-03-04T13:00:50.198335+0000","last_peered":"2024-03-04T13:00:50.198335+0000","last_clean":"2024-03-04T13:00:50.198335+0000","last_became_active":"2024-03-04T12:44:50.458158+0000","last_became_peered":"2024-03-04T12:44:50.458158+0000","last_unstale":"2024-03-04T13:00:50.198335+0000","last_undegraded":"2024-03-04T13:00:50.198335+0000","last_fullsized":"2024-03-04T13:00:50.198335+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:50.198234+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:50.198234+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.198234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:43.249845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"256'48","reported_seq":160,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.106771+0000","last_change":"2024-03-04T13:00:23.106771+0000","last_active":"2024-03-04T13:00:23.106771+0000","last_peered":"2024-03-04T13:00:23.106771+0000","last_clean":"2024-03-04T13:00:23.106771+0000","last_became_active":"2024-03-04T12:43:27.058410+0000","last_became_peered":"2024-03-04T12:43:27.058410+0000","last_unstale":"2024-03-04T13:00:23.106771+0000","last_undegraded":"2024-03-04T13:00:23.106771+0000","last_fullsized":"2024-03-04T13:00:23.106771+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'48","last_scrub_stamp":"2024-03-04T13:00:23.106608+0000","last_deep_scrub":"256'48","last_deep_scrub_stamp":"2024-03-04T13:00:23.106608+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.106608+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:14:06.376944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":132,"num_write":81,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:07.390132+0000","last_change":"2024-03-04T13:01:07.390172+0000","last_active":"2024-03-04T13:01:07.390132+0000","last_peered":"2024-03-04T13:01:07.390132+0000","last_clean":"2024-03-04T13:01:07.390132+0000","last_became_active":"2024-03-04T12:51:01.597162+0000","last_became_peered":"2024-03-04T12:51:01.597162+0000","last_unstale":"2024-03-04T13:01:07.390132+0000","last_undegraded":"2024-03-04T13:01:07.390132+0000","last_fullsized":"2024-03-04T13:01:07.390132+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:07.390037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:07.390037+0000","last_clean_scrub_stamp":"2024-03-04T13:01:07.390037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:23.311348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:13.411728+0000","last_change":"2024-03-04T13:01:13.411755+0000","last_active":"2024-03-04T13:01:13.411728+0000","last_peered":"2024-03-04T13:01:13.411728+0000","last_clean":"2024-03-04T13:01:13.411728+0000","last_became_active":"2024-03-04T12:44:53.478352+0000","last_became_peered":"2024-03-04T12:44:53.478352+0000","last_unstale":"2024-03-04T13:01:13.411728+0000","last_undegraded":"2024-03-04T13:01:13.411728+0000","last_fullsized":"2024-03-04T13:01:13.411728+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:13.411595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:13.411595+0000","last_clean_scrub_stamp":"2024-03-04T13:01:13.411595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:31:09.843683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"256'2","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.853284+0000","last_change":"2024-03-04T13:00:26.853284+0000","last_active":"2024-03-04T13:00:26.853284+0000","last_peered":"2024-03-04T13:00:26.853284+0000","last_clean":"2024-03-04T13:00:26.853284+0000","last_became_active":"2024-03-04T12:44:50.449627+0000","last_became_peered":"2024-03-04T12:44:50.449627+0000","last_unstale":"2024-03-04T13:00:26.853284+0000","last_undegraded":"2024-03-04T13:00:26.853284+0000","last_fullsized":"2024-03-04T13:00:26.853284+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:26.853152+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:26.853152+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.853152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:58:13.931570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"244'9","reported_seq":75,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.490356+0000","last_change":"2024-03-04T13:00:24.490356+0000","last_active":"2024-03-04T13:00:24.490356+0000","last_peered":"2024-03-04T13:00:24.490356+0000","last_clean":"2024-03-04T13:00:24.490356+0000","last_became_active":"2024-03-04T12:43:27.057074+0000","last_became_peered":"2024-03-04T12:43:27.057074+0000","last_unstale":"2024-03-04T13:00:24.490356+0000","last_undegraded":"2024-03-04T13:00:24.490356+0000","last_fullsized":"2024-03-04T13:00:24.490356+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"244'9","last_scrub_stamp":"2024-03-04T13:00:24.490225+0000","last_deep_scrub":"244'9","last_deep_scrub_stamp":"2024-03-04T13:00:24.490225+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.490225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:02:04.720591+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:15.205853+0000","last_change":"2024-03-04T13:01:15.205909+0000","last_active":"2024-03-04T13:01:15.205853+0000","last_peered":"2024-03-04T13:01:15.205853+0000","last_clean":"2024-03-04T13:01:15.205853+0000","last_became_active":"2024-03-04T12:51:01.595390+0000","last_became_peered":"2024-03-04T12:51:01.595390+0000","last_unstale":"2024-03-04T13:01:15.205853+0000","last_undegraded":"2024-03-04T13:01:15.205853+0000","last_fullsized":"2024-03-04T13:01:15.205853+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:15.205749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:15.205749+0000","last_clean_scrub_stamp":"2024-03-04T13:01:15.205749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:01.931926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"256'8","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.388528+0000","last_change":"2024-03-04T13:00:34.388557+0000","last_active":"2024-03-04T13:00:34.388528+0000","last_peered":"2024-03-04T13:00:34.388528+0000","last_clean":"2024-03-04T13:00:34.388528+0000","last_became_active":"2024-03-04T12:44:53.482800+0000","last_became_peered":"2024-03-04T12:44:53.482800+0000","last_unstale":"2024-03-04T13:00:34.388528+0000","last_undegraded":"2024-03-04T13:00:34.388528+0000","last_fullsized":"2024-03-04T13:00:34.388528+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'8","last_scrub_stamp":"2024-03-04T13:00:34.388440+0000","last_deep_scrub":"256'8","last_deep_scrub_stamp":"2024-03-04T13:00:34.388440+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.388440+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:24.212679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'9","reported_seq":61,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.307581+0000","last_change":"2024-03-04T13:00:35.307629+0000","last_active":"2024-03-04T13:00:35.307581+0000","last_peered":"2024-03-04T13:00:35.307581+0000","last_clean":"2024-03-04T13:00:35.307581+0000","last_became_active":"2024-03-04T12:44:50.455937+0000","last_became_peered":"2024-03-04T12:44:50.455937+0000","last_unstale":"2024-03-04T13:00:35.307581+0000","last_undegraded":"2024-03-04T13:00:35.307581+0000","last_fullsized":"2024-03-04T13:00:35.307581+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'9","last_scrub_stamp":"2024-03-04T13:00:35.307447+0000","last_deep_scrub":"256'9","last_deep_scrub_stamp":"2024-03-04T13:00:35.307447+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.307447+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:52:38.354029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":7,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"256'148","reported_seq":400,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.394420+0000","last_change":"2024-03-04T13:00:24.394420+0000","last_active":"2024-03-04T13:00:24.394420+0000","last_peered":"2024-03-04T13:00:24.394420+0000","last_clean":"2024-03-04T13:00:24.394420+0000","last_became_active":"2024-03-04T12:43:27.065085+0000","last_became_peered":"2024-03-04T12:43:27.065085+0000","last_unstale":"2024-03-04T13:00:24.394420+0000","last_undegraded":"2024-03-04T13:00:24.394420+0000","last_fullsized":"2024-03-04T13:00:24.394420+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'148","last_scrub_stamp":"2024-03-04T13:00:24.394285+0000","last_deep_scrub":"256'148","last_deep_scrub_stamp":"2024-03-04T13:00:24.394285+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.394285+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:09:50.870191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":610,"num_read_kb":432,"num_write":236,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:10.853854+0000","last_change":"2024-03-04T13:01:10.853880+0000","last_active":"2024-03-04T13:01:10.853854+0000","last_peered":"2024-03-04T13:01:10.853854+0000","last_clean":"2024-03-04T13:01:10.853854+0000","last_became_active":"2024-03-04T12:51:01.353012+0000","last_became_peered":"2024-03-04T12:51:01.353012+0000","last_unstale":"2024-03-04T13:01:10.853854+0000","last_undegraded":"2024-03-04T13:01:10.853854+0000","last_fullsized":"2024-03-04T13:01:10.853854+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:10.853757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:10.853757+0000","last_clean_scrub_stamp":"2024-03-04T13:01:10.853757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:14.212214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"256'7","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:15.369318+0000","last_change":"2024-03-04T13:01:15.369349+0000","last_active":"2024-03-04T13:01:15.369318+0000","last_peered":"2024-03-04T13:01:15.369318+0000","last_clean":"2024-03-04T13:01:15.369318+0000","last_became_active":"2024-03-04T12:44:53.484514+0000","last_became_peered":"2024-03-04T12:44:53.484514+0000","last_unstale":"2024-03-04T13:01:15.369318+0000","last_undegraded":"2024-03-04T13:01:15.369318+0000","last_fullsized":"2024-03-04T13:01:15.369318+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:01:15.369224+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:01:15.369224+0000","last_clean_scrub_stamp":"2024-03-04T13:01:15.369224+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:40:21.428742+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4138,"num_write":5,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"256'5","reported_seq":55,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:21.650563+0000","last_change":"2024-03-04T13:00:21.650563+0000","last_active":"2024-03-04T13:00:21.650563+0000","last_peered":"2024-03-04T13:00:21.650563+0000","last_clean":"2024-03-04T13:00:21.650563+0000","last_became_active":"2024-03-04T12:44:50.450101+0000","last_became_peered":"2024-03-04T12:44:50.450101+0000","last_unstale":"2024-03-04T13:00:21.650563+0000","last_undegraded":"2024-03-04T13:00:21.650563+0000","last_fullsized":"2024-03-04T13:00:21.650563+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'5","last_scrub_stamp":"2024-03-04T13:00:21.650477+0000","last_deep_scrub":"256'5","last_deep_scrub_stamp":"2024-03-04T13:00:21.650477+0000","last_clean_scrub_stamp":"2024-03-04T13:00:21.650477+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:03.543521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"256'27","reported_seq":108,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.162439+0000","last_change":"2024-03-04T13:00:47.162439+0000","last_active":"2024-03-04T13:00:47.162439+0000","last_peered":"2024-03-04T13:00:47.162439+0000","last_clean":"2024-03-04T13:00:47.162439+0000","last_became_active":"2024-03-04T12:43:27.067391+0000","last_became_peered":"2024-03-04T12:43:27.067391+0000","last_unstale":"2024-03-04T13:00:47.162439+0000","last_undegraded":"2024-03-04T13:00:47.162439+0000","last_fullsized":"2024-03-04T13:00:47.162439+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'27","last_scrub_stamp":"2024-03-04T13:00:47.162283+0000","last_deep_scrub":"256'27","last_deep_scrub_stamp":"2024-03-04T13:00:47.162283+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.162283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:34:22.350283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":62,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:14.222483+0000","last_change":"2024-03-04T13:01:14.222510+0000","last_active":"2024-03-04T13:01:14.222483+0000","last_peered":"2024-03-04T13:01:14.222483+0000","last_clean":"2024-03-04T13:01:14.222483+0000","last_became_active":"2024-03-04T12:51:01.352191+0000","last_became_peered":"2024-03-04T12:51:01.352191+0000","last_unstale":"2024-03-04T13:01:14.222483+0000","last_undegraded":"2024-03-04T13:01:14.222483+0000","last_fullsized":"2024-03-04T13:01:14.222483+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:14.222390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:14.222390+0000","last_clean_scrub_stamp":"2024-03-04T13:01:14.222390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:28:41.703586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"256'2","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:06.913200+0000","last_change":"2024-03-04T13:01:06.913228+0000","last_active":"2024-03-04T13:01:06.913200+0000","last_peered":"2024-03-04T13:01:06.913200+0000","last_clean":"2024-03-04T13:01:06.913200+0000","last_became_active":"2024-03-04T12:44:53.482253+0000","last_became_peered":"2024-03-04T12:44:53.482253+0000","last_unstale":"2024-03-04T13:01:06.913200+0000","last_undegraded":"2024-03-04T13:01:06.913200+0000","last_fullsized":"2024-03-04T13:01:06.913200+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:06.913106+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:06.913106+0000","last_clean_scrub_stamp":"2024-03-04T13:01:06.913106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:55:47.477526+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":46,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.881073+0000","last_change":"2024-03-04T13:00:24.881117+0000","last_active":"2024-03-04T13:00:24.881073+0000","last_peered":"2024-03-04T13:00:24.881073+0000","last_clean":"2024-03-04T13:00:24.881073+0000","last_became_active":"2024-03-04T12:44:50.449070+0000","last_became_peered":"2024-03-04T12:44:50.449070+0000","last_unstale":"2024-03-04T13:00:24.881073+0000","last_undegraded":"2024-03-04T13:00:24.881073+0000","last_fullsized":"2024-03-04T13:00:24.881073+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:24.880951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:24.880951+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.880951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:20:20.554220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"256'13","reported_seq":81,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.330260+0000","last_change":"2024-03-04T13:00:33.330260+0000","last_active":"2024-03-04T13:00:33.330260+0000","last_peered":"2024-03-04T13:00:33.330260+0000","last_clean":"2024-03-04T13:00:33.330260+0000","last_became_active":"2024-03-04T12:43:27.061574+0000","last_became_peered":"2024-03-04T12:43:27.061574+0000","last_unstale":"2024-03-04T13:00:33.330260+0000","last_undegraded":"2024-03-04T13:00:33.330260+0000","last_fullsized":"2024-03-04T13:00:33.330260+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'13","last_scrub_stamp":"2024-03-04T13:00:33.330135+0000","last_deep_scrub":"256'13","last_deep_scrub_stamp":"2024-03-04T13:00:33.330135+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.330135+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:29:30.807030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:06.386961+0000","last_change":"2024-03-04T13:01:06.386984+0000","last_active":"2024-03-04T13:01:06.386961+0000","last_peered":"2024-03-04T13:01:06.386961+0000","last_clean":"2024-03-04T13:01:06.386961+0000","last_became_active":"2024-03-04T12:51:01.356286+0000","last_became_peered":"2024-03-04T12:51:01.356286+0000","last_unstale":"2024-03-04T13:01:06.386961+0000","last_undegraded":"2024-03-04T13:01:06.386961+0000","last_fullsized":"2024-03-04T13:01:06.386961+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:06.386884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:06.386884+0000","last_clean_scrub_stamp":"2024-03-04T13:01:06.386884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:54.282353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"256'6","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.485230+0000","last_change":"2024-03-04T13:00:46.485251+0000","last_active":"2024-03-04T13:00:46.485230+0000","last_peered":"2024-03-04T13:00:46.485230+0000","last_clean":"2024-03-04T13:00:46.485230+0000","last_became_active":"2024-03-04T12:44:53.477801+0000","last_became_peered":"2024-03-04T12:44:53.477801+0000","last_unstale":"2024-03-04T13:00:46.485230+0000","last_undegraded":"2024-03-04T13:00:46.485230+0000","last_fullsized":"2024-03-04T13:00:46.485230+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:46.485153+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:46.485153+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.485153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:53:42.381117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"256'4","reported_seq":53,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.751624+0000","last_change":"2024-03-04T13:00:38.751670+0000","last_active":"2024-03-04T13:00:38.751624+0000","last_peered":"2024-03-04T13:00:38.751624+0000","last_clean":"2024-03-04T13:00:38.751624+0000","last_became_active":"2024-03-04T12:44:50.456005+0000","last_became_peered":"2024-03-04T12:44:50.456005+0000","last_unstale":"2024-03-04T13:00:38.751624+0000","last_undegraded":"2024-03-04T13:00:38.751624+0000","last_fullsized":"2024-03-04T13:00:38.751624+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:38.751516+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:38.751516+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.751516+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:09.546730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"256'19","reported_seq":94,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.842089+0000","last_change":"2024-03-04T13:00:29.842089+0000","last_active":"2024-03-04T13:00:29.842089+0000","last_peered":"2024-03-04T13:00:29.842089+0000","last_clean":"2024-03-04T13:00:29.842089+0000","last_became_active":"2024-03-04T12:43:27.054951+0000","last_became_peered":"2024-03-04T12:43:27.054951+0000","last_unstale":"2024-03-04T13:00:29.842089+0000","last_undegraded":"2024-03-04T13:00:29.842089+0000","last_fullsized":"2024-03-04T13:00:29.842089+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'19","last_scrub_stamp":"2024-03-04T13:00:29.841916+0000","last_deep_scrub":"256'19","last_deep_scrub_stamp":"2024-03-04T13:00:29.841916+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.841916+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:10.346801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":48,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:17.402077+0000","last_change":"2024-03-04T13:01:17.402077+0000","last_active":"2024-03-04T13:01:17.402077+0000","last_peered":"2024-03-04T13:01:17.402077+0000","last_clean":"2024-03-04T13:01:17.402077+0000","last_became_active":"2024-03-04T12:51:01.596248+0000","last_became_peered":"2024-03-04T12:51:01.596248+0000","last_unstale":"2024-03-04T13:01:17.402077+0000","last_undegraded":"2024-03-04T13:01:17.402077+0000","last_fullsized":"2024-03-04T13:01:17.402077+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:17.401959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:17.401959+0000","last_clean_scrub_stamp":"2024-03-04T13:01:17.401959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:17.535427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.185713+0000","last_change":"2024-03-04T13:00:53.185713+0000","last_active":"2024-03-04T13:00:53.185713+0000","last_peered":"2024-03-04T13:00:53.185713+0000","last_clean":"2024-03-04T13:00:53.185713+0000","last_became_active":"2024-03-04T12:44:53.480987+0000","last_became_peered":"2024-03-04T12:44:53.480987+0000","last_unstale":"2024-03-04T13:00:53.185713+0000","last_undegraded":"2024-03-04T13:00:53.185713+0000","last_fullsized":"2024-03-04T13:00:53.185713+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:53.185558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:53.185558+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.185558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:25.573219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"256'4","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.644795+0000","last_change":"2024-03-04T13:00:57.644825+0000","last_active":"2024-03-04T13:00:57.644795+0000","last_peered":"2024-03-04T13:00:57.644795+0000","last_clean":"2024-03-04T13:00:57.644795+0000","last_became_active":"2024-03-04T12:44:50.455944+0000","last_became_peered":"2024-03-04T12:44:50.455944+0000","last_unstale":"2024-03-04T13:00:57.644795+0000","last_undegraded":"2024-03-04T13:00:57.644795+0000","last_fullsized":"2024-03-04T13:00:57.644795+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:57.644688+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:57.644688+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.644688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:34:47.602142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"256'15","reported_seq":88,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.306584+0000","last_change":"2024-03-04T13:00:31.306584+0000","last_active":"2024-03-04T13:00:31.306584+0000","last_peered":"2024-03-04T13:00:31.306584+0000","last_clean":"2024-03-04T13:00:31.306584+0000","last_became_active":"2024-03-04T12:43:27.060180+0000","last_became_peered":"2024-03-04T12:43:27.060180+0000","last_unstale":"2024-03-04T13:00:31.306584+0000","last_undegraded":"2024-03-04T13:00:31.306584+0000","last_fullsized":"2024-03-04T13:00:31.306584+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'15","last_scrub_stamp":"2024-03-04T13:00:31.306462+0000","last_deep_scrub":"256'15","last_deep_scrub_stamp":"2024-03-04T13:00:31.306462+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.306462+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:02.641888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:16.415960+0000","last_change":"2024-03-04T13:01:16.415960+0000","last_active":"2024-03-04T13:01:16.415960+0000","last_peered":"2024-03-04T13:01:16.415960+0000","last_clean":"2024-03-04T13:01:16.415960+0000","last_became_active":"2024-03-04T12:51:01.350349+0000","last_became_peered":"2024-03-04T12:51:01.350349+0000","last_unstale":"2024-03-04T13:01:16.415960+0000","last_undegraded":"2024-03-04T13:01:16.415960+0000","last_fullsized":"2024-03-04T13:01:16.415960+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:16.415837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:16.415837+0000","last_clean_scrub_stamp":"2024-03-04T13:01:16.415837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:24:49.222447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"256'6","reported_seq":52,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.358320+0000","last_change":"2024-03-04T13:00:43.358320+0000","last_active":"2024-03-04T13:00:43.358320+0000","last_peered":"2024-03-04T13:00:43.358320+0000","last_clean":"2024-03-04T13:00:43.358320+0000","last_became_active":"2024-03-04T12:44:53.485429+0000","last_became_peered":"2024-03-04T12:44:53.485429+0000","last_unstale":"2024-03-04T13:00:43.358320+0000","last_undegraded":"2024-03-04T13:00:43.358320+0000","last_fullsized":"2024-03-04T13:00:43.358320+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:43.358174+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:43.358174+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.358174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:46.298234+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"256'6","reported_seq":58,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.607925+0000","last_change":"2024-03-04T13:00:30.607966+0000","last_active":"2024-03-04T13:00:30.607925+0000","last_peered":"2024-03-04T13:00:30.607925+0000","last_clean":"2024-03-04T13:00:30.607925+0000","last_became_active":"2024-03-04T12:44:50.452611+0000","last_became_peered":"2024-03-04T12:44:50.452611+0000","last_unstale":"2024-03-04T13:00:30.607925+0000","last_undegraded":"2024-03-04T13:00:30.607925+0000","last_fullsized":"2024-03-04T13:00:30.607925+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:30.607817+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:30.607817+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.607817+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:57.889690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"256'20","reported_seq":101,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.270359+0000","last_change":"2024-03-04T13:00:29.270359+0000","last_active":"2024-03-04T13:00:29.270359+0000","last_peered":"2024-03-04T13:00:29.270359+0000","last_clean":"2024-03-04T13:00:29.270359+0000","last_became_active":"2024-03-04T12:43:27.064375+0000","last_became_peered":"2024-03-04T12:43:27.064375+0000","last_unstale":"2024-03-04T13:00:29.270359+0000","last_undegraded":"2024-03-04T13:00:29.270359+0000","last_fullsized":"2024-03-04T13:00:29.270359+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'20","last_scrub_stamp":"2024-03-04T13:00:29.270196+0000","last_deep_scrub":"256'20","last_deep_scrub_stamp":"2024-03-04T13:00:29.270196+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.270196+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:33:53.986271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":61,"num_write":47,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"256'2","reported_seq":33,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:09.864852+0000","last_change":"2024-03-04T13:01:09.864882+0000","last_active":"2024-03-04T13:01:09.864852+0000","last_peered":"2024-03-04T13:01:09.864852+0000","last_clean":"2024-03-04T13:01:09.864852+0000","last_became_active":"2024-03-04T12:51:01.349889+0000","last_became_peered":"2024-03-04T12:51:01.349889+0000","last_unstale":"2024-03-04T13:01:09.864852+0000","last_undegraded":"2024-03-04T13:01:09.864852+0000","last_fullsized":"2024-03-04T13:01:09.864852+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:09.864765+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:09.864765+0000","last_clean_scrub_stamp":"2024-03-04T13:01:09.864765+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:23:18.220762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"256'2","reported_seq":43,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:13.195014+0000","last_change":"2024-03-04T13:01:13.195053+0000","last_active":"2024-03-04T13:01:13.195014+0000","last_peered":"2024-03-04T13:01:13.195014+0000","last_clean":"2024-03-04T13:01:13.195014+0000","last_became_active":"2024-03-04T12:44:53.489232+0000","last_became_peered":"2024-03-04T12:44:53.489232+0000","last_unstale":"2024-03-04T13:01:13.195014+0000","last_undegraded":"2024-03-04T13:01:13.195014+0000","last_fullsized":"2024-03-04T13:01:13.195014+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:13.194928+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:13.194928+0000","last_clean_scrub_stamp":"2024-03-04T13:01:13.194928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:09:31.721673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":47,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.377182+0000","last_change":"2024-03-04T13:00:26.377182+0000","last_active":"2024-03-04T13:00:26.377182+0000","last_peered":"2024-03-04T13:00:26.377182+0000","last_clean":"2024-03-04T13:00:26.377182+0000","last_became_active":"2024-03-04T12:44:50.459359+0000","last_became_peered":"2024-03-04T12:44:50.459359+0000","last_unstale":"2024-03-04T13:00:26.377182+0000","last_undegraded":"2024-03-04T13:00:26.377182+0000","last_fullsized":"2024-03-04T13:00:26.377182+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:26.377070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:26.377070+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.377070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:23.336645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"256'25","reported_seq":115,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.519803+0000","last_change":"2024-03-04T13:00:28.519828+0000","last_active":"2024-03-04T13:00:28.519803+0000","last_peered":"2024-03-04T13:00:28.519803+0000","last_clean":"2024-03-04T13:00:28.519803+0000","last_became_active":"2024-03-04T12:43:27.060115+0000","last_became_peered":"2024-03-04T12:43:27.060115+0000","last_unstale":"2024-03-04T13:00:28.519803+0000","last_undegraded":"2024-03-04T13:00:28.519803+0000","last_fullsized":"2024-03-04T13:00:28.519803+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'25","last_scrub_stamp":"2024-03-04T13:00:28.519719+0000","last_deep_scrub":"256'25","last_deep_scrub_stamp":"2024-03-04T13:00:28.519719+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.519719+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:26.466728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":31,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:16.222306+0000","last_change":"2024-03-04T13:01:16.222334+0000","last_active":"2024-03-04T13:01:16.222306+0000","last_peered":"2024-03-04T13:01:16.222306+0000","last_clean":"2024-03-04T13:01:16.222306+0000","last_became_active":"2024-03-04T12:51:01.596463+0000","last_became_peered":"2024-03-04T12:51:01.596463+0000","last_unstale":"2024-03-04T13:01:16.222306+0000","last_undegraded":"2024-03-04T13:01:16.222306+0000","last_fullsized":"2024-03-04T13:01:16.222306+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:16.222200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:16.222200+0000","last_clean_scrub_stamp":"2024-03-04T13:01:16.222200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:33:06.029259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"256'6","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:09.199390+0000","last_change":"2024-03-04T13:01:09.199419+0000","last_active":"2024-03-04T13:01:09.199390+0000","last_peered":"2024-03-04T13:01:09.199390+0000","last_clean":"2024-03-04T13:01:09.199390+0000","last_became_active":"2024-03-04T12:44:53.479076+0000","last_became_peered":"2024-03-04T12:44:53.479076+0000","last_unstale":"2024-03-04T13:01:09.199390+0000","last_undegraded":"2024-03-04T13:01:09.199390+0000","last_fullsized":"2024-03-04T13:01:09.199390+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:01:09.199302+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:01:09.199302+0000","last_clean_scrub_stamp":"2024-03-04T13:01:09.199302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:46.820391+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"256'2","reported_seq":50,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.266052+0000","last_change":"2024-03-04T13:00:27.266052+0000","last_active":"2024-03-04T13:00:27.266052+0000","last_peered":"2024-03-04T13:00:27.266052+0000","last_clean":"2024-03-04T13:00:27.266052+0000","last_became_active":"2024-03-04T12:44:50.454398+0000","last_became_peered":"2024-03-04T12:44:50.454398+0000","last_unstale":"2024-03-04T13:00:27.266052+0000","last_undegraded":"2024-03-04T13:00:27.266052+0000","last_fullsized":"2024-03-04T13:00:27.266052+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:27.265871+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:27.265871+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.265871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:12:37.304071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"256'33","reported_seq":126,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.266710+0000","last_change":"2024-03-04T13:00:32.266736+0000","last_active":"2024-03-04T13:00:32.266710+0000","last_peered":"2024-03-04T13:00:32.266710+0000","last_clean":"2024-03-04T13:00:32.266710+0000","last_became_active":"2024-03-04T12:43:27.060589+0000","last_became_peered":"2024-03-04T12:43:27.060589+0000","last_unstale":"2024-03-04T13:00:32.266710+0000","last_undegraded":"2024-03-04T13:00:32.266710+0000","last_fullsized":"2024-03-04T13:00:32.266710+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'33","last_scrub_stamp":"2024-03-04T13:00:32.266584+0000","last_deep_scrub":"256'33","last_deep_scrub_stamp":"2024-03-04T13:00:32.266584+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.266584+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:51:33.406291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":90,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:12.135436+0000","last_change":"2024-03-04T13:01:12.135463+0000","last_active":"2024-03-04T13:01:12.135436+0000","last_peered":"2024-03-04T13:01:12.135436+0000","last_clean":"2024-03-04T13:01:12.135436+0000","last_became_active":"2024-03-04T12:51:01.355416+0000","last_became_peered":"2024-03-04T12:51:01.355416+0000","last_unstale":"2024-03-04T13:01:12.135436+0000","last_undegraded":"2024-03-04T13:01:12.135436+0000","last_fullsized":"2024-03-04T13:01:12.135436+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:12.135326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:12.135326+0000","last_clean_scrub_stamp":"2024-03-04T13:01:12.135326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:37.794765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"256'2","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:11.238108+0000","last_change":"2024-03-04T13:01:11.238108+0000","last_active":"2024-03-04T13:01:11.238108+0000","last_peered":"2024-03-04T13:01:11.238108+0000","last_clean":"2024-03-04T13:01:11.238108+0000","last_became_active":"2024-03-04T12:44:53.486235+0000","last_became_peered":"2024-03-04T12:44:53.486235+0000","last_unstale":"2024-03-04T13:01:11.238108+0000","last_undegraded":"2024-03-04T13:01:11.238108+0000","last_fullsized":"2024-03-04T13:01:11.238108+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:01:11.237975+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:01:11.237975+0000","last_clean_scrub_stamp":"2024-03-04T13:01:11.237975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:24:31.516917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"256'7","reported_seq":58,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.126118+0000","last_change":"2024-03-04T13:00:28.126118+0000","last_active":"2024-03-04T13:00:28.126118+0000","last_peered":"2024-03-04T13:00:28.126118+0000","last_clean":"2024-03-04T13:00:28.126118+0000","last_became_active":"2024-03-04T12:44:50.458610+0000","last_became_peered":"2024-03-04T12:44:50.458610+0000","last_unstale":"2024-03-04T13:00:28.126118+0000","last_undegraded":"2024-03-04T13:00:28.126118+0000","last_fullsized":"2024-03-04T13:00:28.126118+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-03-04T13:00:28.125955+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-03-04T13:00:28.125955+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.125955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:00.483454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7739,"num_write":12,"num_write_kb":7739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"256'17","reported_seq":88,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.665270+0000","last_change":"2024-03-04T13:00:24.665292+0000","last_active":"2024-03-04T13:00:24.665270+0000","last_peered":"2024-03-04T13:00:24.665270+0000","last_clean":"2024-03-04T13:00:24.665270+0000","last_became_active":"2024-03-04T12:43:27.067223+0000","last_became_peered":"2024-03-04T12:43:27.067223+0000","last_unstale":"2024-03-04T13:00:24.665270+0000","last_undegraded":"2024-03-04T13:00:24.665270+0000","last_fullsized":"2024-03-04T13:00:24.665270+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'17","last_scrub_stamp":"2024-03-04T13:00:24.665191+0000","last_deep_scrub":"256'17","last_deep_scrub_stamp":"2024-03-04T13:00:24.665191+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.665191+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:39.414488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":41,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:05.337499+0000","last_change":"2024-03-04T13:01:05.337499+0000","last_active":"2024-03-04T13:01:05.337499+0000","last_peered":"2024-03-04T13:01:05.337499+0000","last_clean":"2024-03-04T13:01:05.337499+0000","last_became_active":"2024-03-04T12:51:01.353432+0000","last_became_peered":"2024-03-04T12:51:01.353432+0000","last_unstale":"2024-03-04T13:01:05.337499+0000","last_undegraded":"2024-03-04T13:01:05.337499+0000","last_fullsized":"2024-03-04T13:01:05.337499+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:05.337385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:05.337385+0000","last_clean_scrub_stamp":"2024-03-04T13:01:05.337385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:14:42.921495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"250'2","reported_seq":45,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.252491+0000","last_change":"2024-03-04T13:00:39.252491+0000","last_active":"2024-03-04T13:00:39.252491+0000","last_peered":"2024-03-04T13:00:39.252491+0000","last_clean":"2024-03-04T13:00:39.252491+0000","last_became_active":"2024-03-04T12:44:53.482370+0000","last_became_peered":"2024-03-04T12:44:53.482370+0000","last_unstale":"2024-03-04T13:00:39.252491+0000","last_undegraded":"2024-03-04T13:00:39.252491+0000","last_fullsized":"2024-03-04T13:00:39.252491+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:39.252370+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:39.252370+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.252370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:34.221417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"256'4","reported_seq":54,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.342144+0000","last_change":"2024-03-04T13:00:40.342144+0000","last_active":"2024-03-04T13:00:40.342144+0000","last_peered":"2024-03-04T13:00:40.342144+0000","last_clean":"2024-03-04T13:00:40.342144+0000","last_became_active":"2024-03-04T12:44:50.450681+0000","last_became_peered":"2024-03-04T12:44:50.450681+0000","last_unstale":"2024-03-04T13:00:40.342144+0000","last_undegraded":"2024-03-04T13:00:40.342144+0000","last_fullsized":"2024-03-04T13:00:40.342144+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:40.342026+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:40.342026+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.342026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:02.619334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":368,"num_write":4,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"256'61","reported_seq":205,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.795512+0000","last_change":"2024-03-04T13:00:28.795546+0000","last_active":"2024-03-04T13:00:28.795512+0000","last_peered":"2024-03-04T13:00:28.795512+0000","last_clean":"2024-03-04T13:00:28.795512+0000","last_became_active":"2024-03-04T12:43:27.056781+0000","last_became_peered":"2024-03-04T12:43:27.056781+0000","last_unstale":"2024-03-04T13:00:28.795512+0000","last_undegraded":"2024-03-04T13:00:28.795512+0000","last_fullsized":"2024-03-04T13:00:28.795512+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'61","last_scrub_stamp":"2024-03-04T13:00:28.795405+0000","last_deep_scrub":"256'61","last_deep_scrub_stamp":"2024-03-04T13:00:28.795405+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.795405+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:24:36.779728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":203,"num_write":94,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:08.856960+0000","last_change":"2024-03-04T13:01:08.856960+0000","last_active":"2024-03-04T13:01:08.856960+0000","last_peered":"2024-03-04T13:01:08.856960+0000","last_clean":"2024-03-04T13:01:08.856960+0000","last_became_active":"2024-03-04T12:51:01.349216+0000","last_became_peered":"2024-03-04T12:51:01.349216+0000","last_unstale":"2024-03-04T13:01:08.856960+0000","last_undegraded":"2024-03-04T13:01:08.856960+0000","last_fullsized":"2024-03-04T13:01:08.856960+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:08.856809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:08.856809+0000","last_clean_scrub_stamp":"2024-03-04T13:01:08.856809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:51:29.275126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.649404+0000","last_change":"2024-03-04T13:00:58.649404+0000","last_active":"2024-03-04T13:00:58.649404+0000","last_peered":"2024-03-04T13:00:58.649404+0000","last_clean":"2024-03-04T13:00:58.649404+0000","last_became_active":"2024-03-04T12:44:53.479411+0000","last_became_peered":"2024-03-04T12:44:53.479411+0000","last_unstale":"2024-03-04T13:00:58.649404+0000","last_undegraded":"2024-03-04T13:00:58.649404+0000","last_fullsized":"2024-03-04T13:00:58.649404+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:58.649256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:58.649256+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.649256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:20.808929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'5","reported_seq":56,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.248147+0000","last_change":"2024-03-04T13:00:26.248147+0000","last_active":"2024-03-04T13:00:26.248147+0000","last_peered":"2024-03-04T13:00:26.248147+0000","last_clean":"2024-03-04T13:00:26.248147+0000","last_became_active":"2024-03-04T12:44:50.451626+0000","last_became_peered":"2024-03-04T12:44:50.451626+0000","last_unstale":"2024-03-04T13:00:26.248147+0000","last_undegraded":"2024-03-04T13:00:26.248147+0000","last_fullsized":"2024-03-04T13:00:26.248147+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'5","last_scrub_stamp":"2024-03-04T13:00:26.248033+0000","last_deep_scrub":"256'5","last_deep_scrub_stamp":"2024-03-04T13:00:26.248033+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.248033+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:13:53.495710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"256'128","reported_seq":415,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.484418+0000","last_change":"2024-03-04T13:00:25.484470+0000","last_active":"2024-03-04T13:00:25.484418+0000","last_peered":"2024-03-04T13:00:25.484418+0000","last_clean":"2024-03-04T13:00:25.484418+0000","last_became_active":"2024-03-04T12:43:27.056007+0000","last_became_peered":"2024-03-04T12:43:27.056007+0000","last_unstale":"2024-03-04T13:00:25.484418+0000","last_undegraded":"2024-03-04T13:00:25.484418+0000","last_fullsized":"2024-03-04T13:00:25.484418+0000","mapping_epoch":242,"log_start":"250'100","ondisk_log_start":"250'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'128","last_scrub_stamp":"2024-03-04T13:00:25.484311+0000","last_deep_scrub":"256'128","last_deep_scrub_stamp":"2024-03-04T13:00:25.484311+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.484311+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:29.733934+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":540,"num_write":158,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3984,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":32,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.634477+0000","last_change":"2024-03-04T13:01:01.634477+0000","last_active":"2024-03-04T13:01:01.634477+0000","last_peered":"2024-03-04T13:01:01.634477+0000","last_clean":"2024-03-04T13:01:01.634477+0000","last_became_active":"2024-03-04T12:51:01.354601+0000","last_became_peered":"2024-03-04T12:51:01.354601+0000","last_unstale":"2024-03-04T13:01:01.634477+0000","last_undegraded":"2024-03-04T13:01:01.634477+0000","last_fullsized":"2024-03-04T13:01:01.634477+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:01.634386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:01.634386+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.634386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:37.580048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":41,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.357410+0000","last_change":"2024-03-04T13:01:02.357410+0000","last_active":"2024-03-04T13:01:02.357410+0000","last_peered":"2024-03-04T13:01:02.357410+0000","last_clean":"2024-03-04T13:01:02.357410+0000","last_became_active":"2024-03-04T12:44:53.486321+0000","last_became_peered":"2024-03-04T12:44:53.486321+0000","last_unstale":"2024-03-04T13:01:02.357410+0000","last_undegraded":"2024-03-04T13:01:02.357410+0000","last_fullsized":"2024-03-04T13:01:02.357410+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:02.357265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:02.357265+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.357265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:36:02.225136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"250'2","reported_seq":51,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.800957+0000","last_change":"2024-03-04T13:00:30.800957+0000","last_active":"2024-03-04T13:00:30.800957+0000","last_peered":"2024-03-04T13:00:30.800957+0000","last_clean":"2024-03-04T13:00:30.800957+0000","last_became_active":"2024-03-04T12:44:50.456315+0000","last_became_peered":"2024-03-04T12:44:50.456315+0000","last_unstale":"2024-03-04T13:00:30.800957+0000","last_undegraded":"2024-03-04T13:00:30.800957+0000","last_fullsized":"2024-03-04T13:00:30.800957+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:00:30.800805+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:00:30.800805+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.800805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:08:28.741353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"256'28","reported_seq":114,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.336372+0000","last_change":"2024-03-04T13:00:35.336372+0000","last_active":"2024-03-04T13:00:35.336372+0000","last_peered":"2024-03-04T13:00:35.336372+0000","last_clean":"2024-03-04T13:00:35.336372+0000","last_became_active":"2024-03-04T12:43:27.064141+0000","last_became_peered":"2024-03-04T12:43:27.064141+0000","last_unstale":"2024-03-04T13:00:35.336372+0000","last_undegraded":"2024-03-04T13:00:35.336372+0000","last_fullsized":"2024-03-04T13:00:35.336372+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'28","last_scrub_stamp":"2024-03-04T13:00:35.336234+0000","last_deep_scrub":"256'28","last_deep_scrub_stamp":"2024-03-04T13:00:35.336234+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.336234+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:07.884382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"256'416","reported_seq":1072,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.315458+0000","last_change":"2024-03-04T13:00:27.315458+0000","last_active":"2024-03-04T13:00:27.315458+0000","last_peered":"2024-03-04T13:00:27.315458+0000","last_clean":"2024-03-04T13:00:27.315458+0000","last_became_active":"2024-03-04T12:36:40.392399+0000","last_became_peered":"2024-03-04T12:36:40.392399+0000","last_unstale":"2024-03-04T13:00:27.315458+0000","last_undegraded":"2024-03-04T13:00:27.315458+0000","last_fullsized":"2024-03-04T13:00:27.315458+0000","mapping_epoch":33,"log_start":"256'401","ondisk_log_start":"256'401","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'416","last_scrub_stamp":"2024-03-04T13:00:27.315312+0000","last_deep_scrub":"256'416","last_deep_scrub_stamp":"2024-03-04T13:00:27.315312+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.315312+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":401,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:33.045930+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194364,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":637,"num_read_kb":17405,"num_write":1486,"num_write_kb":42784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"256'1113","reported_seq":2706,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.276221+0000","last_change":"2024-03-04T13:00:47.276221+0000","last_active":"2024-03-04T13:00:47.276221+0000","last_peered":"2024-03-04T13:00:47.276221+0000","last_clean":"2024-03-04T13:00:47.276221+0000","last_became_active":"2024-03-04T12:36:07.295125+0000","last_became_peered":"2024-03-04T12:36:07.295125+0000","last_unstale":"2024-03-04T13:00:47.276221+0000","last_undegraded":"2024-03-04T13:00:47.276221+0000","last_fullsized":"2024-03-04T13:00:47.276221+0000","mapping_epoch":22,"log_start":"256'1101","ondisk_log_start":"256'1101","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1113","last_scrub_stamp":"2024-03-04T13:00:47.276097+0000","last_deep_scrub":"256'1113","last_deep_scrub_stamp":"2024-03-04T13:00:47.276097+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.276097+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":1101,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:52.753715+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4869,"num_read_kb":4281,"num_write":1536,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2397,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"256'322","reported_seq":927,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.398598+0000","last_change":"2024-03-04T13:00:56.398598+0000","last_active":"2024-03-04T13:00:56.398598+0000","last_peered":"2024-03-04T13:00:56.398598+0000","last_clean":"2024-03-04T13:00:56.398598+0000","last_became_active":"2024-03-04T12:36:05.280695+0000","last_became_peered":"2024-03-04T12:36:05.280695+0000","last_unstale":"2024-03-04T13:00:56.398598+0000","last_undegraded":"2024-03-04T13:00:56.398598+0000","last_fullsized":"2024-03-04T13:00:56.398598+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'322","last_scrub_stamp":"2024-03-04T13:00:56.398408+0000","last_deep_scrub":"256'322","last_deep_scrub_stamp":"2024-03-04T13:00:56.398408+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.398408+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:31:05.991675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256487,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":427,"num_read_kb":2412,"num_write":1141,"num_write_kb":20516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"256'544","reported_seq":1947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.371823+0000","last_change":"2024-03-04T13:00:46.371823+0000","last_active":"2024-03-04T13:00:46.371823+0000","last_peered":"2024-03-04T13:00:46.371823+0000","last_clean":"2024-03-04T13:00:46.371823+0000","last_became_active":"2024-03-04T12:36:07.296651+0000","last_became_peered":"2024-03-04T12:36:07.296651+0000","last_unstale":"2024-03-04T13:00:46.371823+0000","last_undegraded":"2024-03-04T13:00:46.371823+0000","last_fullsized":"2024-03-04T13:00:46.371823+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'544","last_scrub_stamp":"2024-03-04T13:00:46.371662+0000","last_deep_scrub":"256'544","last_deep_scrub_stamp":"2024-03-04T13:00:46.371662+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.371662+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:04.839309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2661,"num_read_kb":2496,"num_write":771,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"256'334","reported_seq":947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:07.460426+0000","last_change":"2024-03-04T13:01:07.460477+0000","last_active":"2024-03-04T13:01:07.460426+0000","last_peered":"2024-03-04T13:01:07.460426+0000","last_clean":"2024-03-04T13:01:07.460426+0000","last_became_active":"2024-03-04T12:36:05.285054+0000","last_became_peered":"2024-03-04T12:36:05.285054+0000","last_unstale":"2024-03-04T13:01:07.460426+0000","last_undegraded":"2024-03-04T13:01:07.460426+0000","last_fullsized":"2024-03-04T13:01:07.460426+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'334","last_scrub_stamp":"2024-03-04T13:01:07.460318+0000","last_deep_scrub":"256'334","last_deep_scrub_stamp":"2024-03-04T13:01:07.460318+0000","last_clean_scrub_stamp":"2024-03-04T13:01:07.460318+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:57:34.892491+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695847,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":27372,"num_write":1039,"num_write_kb":18696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"256'596","reported_seq":2026,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.065447+0000","last_change":"2024-03-04T13:00:44.065447+0000","last_active":"2024-03-04T13:00:44.065447+0000","last_peered":"2024-03-04T13:00:44.065447+0000","last_clean":"2024-03-04T13:00:44.065447+0000","last_became_active":"2024-03-04T12:36:07.298528+0000","last_became_peered":"2024-03-04T12:36:07.298528+0000","last_unstale":"2024-03-04T13:00:44.065447+0000","last_undegraded":"2024-03-04T13:00:44.065447+0000","last_fullsized":"2024-03-04T13:00:44.065447+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'596","last_scrub_stamp":"2024-03-04T13:00:44.065329+0000","last_deep_scrub":"256'596","last_deep_scrub_stamp":"2024-03-04T13:00:44.065329+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.065329+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:31:28.355176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2805,"num_read_kb":2500,"num_write":805,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":978,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"256'349","reported_seq":970,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:05.343824+0000","last_change":"2024-03-04T13:01:05.343894+0000","last_active":"2024-03-04T13:01:05.343824+0000","last_peered":"2024-03-04T13:01:05.343824+0000","last_clean":"2024-03-04T13:01:05.343824+0000","last_became_active":"2024-03-04T12:36:05.293768+0000","last_became_peered":"2024-03-04T12:36:05.293768+0000","last_unstale":"2024-03-04T13:01:05.343824+0000","last_undegraded":"2024-03-04T13:01:05.343824+0000","last_fullsized":"2024-03-04T13:01:05.343824+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'349","last_scrub_stamp":"2024-03-04T13:01:05.343726+0000","last_deep_scrub":"256'349","last_deep_scrub_stamp":"2024-03-04T13:01:05.343726+0000","last_clean_scrub_stamp":"2024-03-04T13:01:05.343726+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:36.287089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436929,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":443,"num_read_kb":31950,"num_write":1089,"num_write_kb":37939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"256'778","reported_seq":2185,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.593056+0000","last_change":"2024-03-04T13:00:29.593056+0000","last_active":"2024-03-04T13:00:29.593056+0000","last_peered":"2024-03-04T13:00:29.593056+0000","last_clean":"2024-03-04T13:00:29.593056+0000","last_became_active":"2024-03-04T12:36:40.393715+0000","last_became_peered":"2024-03-04T12:36:40.393715+0000","last_unstale":"2024-03-04T13:00:29.593056+0000","last_undegraded":"2024-03-04T13:00:29.593056+0000","last_fullsized":"2024-03-04T13:00:29.593056+0000","mapping_epoch":33,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'778","last_scrub_stamp":"2024-03-04T13:00:29.592929+0000","last_deep_scrub":"256'778","last_deep_scrub_stamp":"2024-03-04T13:00:29.592929+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.592929+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:11:41.602243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3436,"num_read_kb":3037,"num_write":1058,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"256'385","reported_seq":1030,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:06.252828+0000","last_change":"2024-03-04T13:01:06.252884+0000","last_active":"2024-03-04T13:01:06.252828+0000","last_peered":"2024-03-04T13:01:06.252828+0000","last_clean":"2024-03-04T13:01:06.252828+0000","last_became_active":"2024-03-04T12:36:05.290178+0000","last_became_peered":"2024-03-04T12:36:05.290178+0000","last_unstale":"2024-03-04T13:01:06.252828+0000","last_undegraded":"2024-03-04T13:01:06.252828+0000","last_fullsized":"2024-03-04T13:01:06.252828+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'385","last_scrub_stamp":"2024-03-04T13:01:06.252742+0000","last_deep_scrub":"256'385","last_deep_scrub_stamp":"2024-03-04T13:01:06.252742+0000","last_clean_scrub_stamp":"2024-03-04T13:01:06.252742+0000","objects_scrubbed":8,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:53.889948+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":589,"num_read_kb":36032,"num_write":1373,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"256'376","reported_seq":1932,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.770394+0000","last_change":"2024-03-04T13:00:41.770487+0000","last_active":"2024-03-04T13:00:41.770394+0000","last_peered":"2024-03-04T13:00:41.770394+0000","last_clean":"2024-03-04T13:00:41.770394+0000","last_became_active":"2024-03-04T12:36:07.301582+0000","last_became_peered":"2024-03-04T12:36:07.301582+0000","last_unstale":"2024-03-04T13:00:41.770394+0000","last_undegraded":"2024-03-04T13:00:41.770394+0000","last_fullsized":"2024-03-04T13:00:41.770394+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'376","last_scrub_stamp":"2024-03-04T13:00:41.770289+0000","last_deep_scrub":"256'376","last_deep_scrub_stamp":"2024-03-04T13:00:41.770289+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.770289+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:23:34.715892+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2123,"num_read_kb":2049,"num_write":405,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"256'299","reported_seq":917,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.223170+0000","last_change":"2024-03-04T13:00:53.223170+0000","last_active":"2024-03-04T13:00:53.223170+0000","last_peered":"2024-03-04T13:00:53.223170+0000","last_clean":"2024-03-04T13:00:53.223170+0000","last_became_active":"2024-03-04T12:36:05.296284+0000","last_became_peered":"2024-03-04T12:36:05.296284+0000","last_unstale":"2024-03-04T13:00:53.223170+0000","last_undegraded":"2024-03-04T13:00:53.223170+0000","last_fullsized":"2024-03-04T13:00:53.223170+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'299","last_scrub_stamp":"2024-03-04T13:00:53.223035+0000","last_deep_scrub":"256'299","last_deep_scrub_stamp":"2024-03-04T13:00:53.223035+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.223035+0000","objects_scrubbed":11,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:30:50.876472+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3348453,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":381,"num_read_kb":80579,"num_write":950,"num_write_kb":32166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"256'780","reported_seq":2032,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.091761+0000","last_change":"2024-03-04T13:00:43.091761+0000","last_active":"2024-03-04T13:00:43.091761+0000","last_peered":"2024-03-04T13:00:43.091761+0000","last_clean":"2024-03-04T13:00:43.091761+0000","last_became_active":"2024-03-04T12:36:07.297953+0000","last_became_peered":"2024-03-04T12:36:07.297953+0000","last_unstale":"2024-03-04T13:00:43.091761+0000","last_undegraded":"2024-03-04T13:00:43.091761+0000","last_fullsized":"2024-03-04T13:00:43.091761+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'780","last_scrub_stamp":"2024-03-04T13:00:43.091629+0000","last_deep_scrub":"256'780","last_deep_scrub_stamp":"2024-03-04T13:00:43.091629+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.091629+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:31.459229+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3335,"num_read_kb":2888,"num_write":1111,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1185,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"256'315","reported_seq":1038,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:07.228663+0000","last_change":"2024-03-04T13:01:07.228709+0000","last_active":"2024-03-04T13:01:07.228663+0000","last_peered":"2024-03-04T13:01:07.228663+0000","last_clean":"2024-03-04T13:01:07.228663+0000","last_became_active":"2024-03-04T12:36:05.291041+0000","last_became_peered":"2024-03-04T12:36:05.291041+0000","last_unstale":"2024-03-04T13:01:07.228663+0000","last_undegraded":"2024-03-04T13:01:07.228663+0000","last_fullsized":"2024-03-04T13:01:07.228663+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'315","last_scrub_stamp":"2024-03-04T13:01:07.228583+0000","last_deep_scrub":"256'315","last_deep_scrub_stamp":"2024-03-04T13:01:07.228583+0000","last_clean_scrub_stamp":"2024-03-04T13:01:07.228583+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:16:40.804013+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2107533,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":775,"num_read_kb":12113,"num_write":1137,"num_write_kb":11806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"256'692","reported_seq":2101,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.378858+0000","last_change":"2024-03-04T13:00:43.378858+0000","last_active":"2024-03-04T13:00:43.378858+0000","last_peered":"2024-03-04T13:00:43.378858+0000","last_clean":"2024-03-04T13:00:43.378858+0000","last_became_active":"2024-03-04T12:36:07.296763+0000","last_became_peered":"2024-03-04T12:36:07.296763+0000","last_unstale":"2024-03-04T13:00:43.378858+0000","last_undegraded":"2024-03-04T13:00:43.378858+0000","last_fullsized":"2024-03-04T13:00:43.378858+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'692","last_scrub_stamp":"2024-03-04T13:00:43.378717+0000","last_deep_scrub":"256'692","last_deep_scrub_stamp":"2024-03-04T13:00:43.378717+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.378717+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:30.590272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3139,"num_read_kb":2812,"num_write":915,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"256'295","reported_seq":907,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:05.499145+0000","last_change":"2024-03-04T13:01:05.499145+0000","last_active":"2024-03-04T13:01:05.499145+0000","last_peered":"2024-03-04T13:01:05.499145+0000","last_clean":"2024-03-04T13:01:05.499145+0000","last_became_active":"2024-03-04T12:36:05.294967+0000","last_became_peered":"2024-03-04T12:36:05.294967+0000","last_unstale":"2024-03-04T13:01:05.499145+0000","last_undegraded":"2024-03-04T13:01:05.499145+0000","last_fullsized":"2024-03-04T13:01:05.499145+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'295","last_scrub_stamp":"2024-03-04T13:01:05.499048+0000","last_deep_scrub":"256'295","last_deep_scrub_stamp":"2024-03-04T13:01:05.499048+0000","last_clean_scrub_stamp":"2024-03-04T13:01:05.499048+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:30.788727+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1332404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":383,"num_read_kb":71068,"num_write":934,"num_write_kb":54955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"256'784","reported_seq":2206,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.145118+0000","last_change":"2024-03-04T13:00:46.145118+0000","last_active":"2024-03-04T13:00:46.145118+0000","last_peered":"2024-03-04T13:00:46.145118+0000","last_clean":"2024-03-04T13:00:46.145118+0000","last_became_active":"2024-03-04T12:36:07.295530+0000","last_became_peered":"2024-03-04T12:36:07.295530+0000","last_unstale":"2024-03-04T13:00:46.145118+0000","last_undegraded":"2024-03-04T13:00:46.145118+0000","last_fullsized":"2024-03-04T13:00:46.145118+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'784","last_scrub_stamp":"2024-03-04T13:00:46.145023+0000","last_deep_scrub":"256'784","last_deep_scrub_stamp":"2024-03-04T13:00:46.145023+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.145023+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:19.897333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3415,"num_read_kb":3026,"num_write":1069,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":949,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"256'352","reported_seq":1816,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.055009+0000","last_change":"2024-03-04T13:00:46.055064+0000","last_active":"2024-03-04T13:00:46.055009+0000","last_peered":"2024-03-04T13:00:46.055009+0000","last_clean":"2024-03-04T13:00:46.055009+0000","last_became_active":"2024-03-04T12:36:07.298539+0000","last_became_peered":"2024-03-04T12:36:07.298539+0000","last_unstale":"2024-03-04T13:00:46.055009+0000","last_undegraded":"2024-03-04T13:00:46.055009+0000","last_fullsized":"2024-03-04T13:00:46.055009+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'352","last_scrub_stamp":"2024-03-04T13:00:46.054880+0000","last_deep_scrub":"256'352","last_deep_scrub_stamp":"2024-03-04T13:00:46.054880+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.054880+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:46.051533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1997,"num_read_kb":1912,"num_write":401,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"256'351","reported_seq":1051,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.243539+0000","last_change":"2024-03-04T13:00:58.243622+0000","last_active":"2024-03-04T13:00:58.243539+0000","last_peered":"2024-03-04T13:00:58.243539+0000","last_clean":"2024-03-04T13:00:58.243539+0000","last_became_active":"2024-03-04T12:36:05.295060+0000","last_became_peered":"2024-03-04T12:36:05.295060+0000","last_unstale":"2024-03-04T13:00:58.243539+0000","last_undegraded":"2024-03-04T13:00:58.243539+0000","last_fullsized":"2024-03-04T13:00:58.243539+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'351","last_scrub_stamp":"2024-03-04T13:00:58.243436+0000","last_deep_scrub":"256'351","last_deep_scrub_stamp":"2024-03-04T13:00:58.243436+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.243436+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:50:36.386385+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2255527,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":26330,"num_write":1306,"num_write_kb":36495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"256'328","reported_seq":1798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.335909+0000","last_change":"2024-03-04T13:00:45.335937+0000","last_active":"2024-03-04T13:00:45.335909+0000","last_peered":"2024-03-04T13:00:45.335909+0000","last_clean":"2024-03-04T13:00:45.335909+0000","last_became_active":"2024-03-04T12:36:07.300270+0000","last_became_peered":"2024-03-04T12:36:07.300270+0000","last_unstale":"2024-03-04T13:00:45.335909+0000","last_undegraded":"2024-03-04T13:00:45.335909+0000","last_fullsized":"2024-03-04T13:00:45.335909+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'328","last_scrub_stamp":"2024-03-04T13:00:45.335832+0000","last_deep_scrub":"256'328","last_deep_scrub_stamp":"2024-03-04T13:00:45.335832+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.335832+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:00:58.473041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2015,"num_read_kb":1950,"num_write":359,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"256'291","reported_seq":890,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.626384+0000","last_change":"2024-03-04T13:00:55.626435+0000","last_active":"2024-03-04T13:00:55.626384+0000","last_peered":"2024-03-04T13:00:55.626384+0000","last_clean":"2024-03-04T13:00:55.626384+0000","last_became_active":"2024-03-04T12:36:05.296621+0000","last_became_peered":"2024-03-04T12:36:05.296621+0000","last_unstale":"2024-03-04T13:00:55.626384+0000","last_undegraded":"2024-03-04T13:00:55.626384+0000","last_fullsized":"2024-03-04T13:00:55.626384+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'291","last_scrub_stamp":"2024-03-04T13:00:55.626282+0000","last_deep_scrub":"256'291","last_deep_scrub_stamp":"2024-03-04T13:00:55.626282+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.626282+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:06:30.482147+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":406,"num_read_kb":30709,"num_write":973,"num_write_kb":28664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"256'402","reported_seq":1893,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.197550+0000","last_change":"2024-03-04T13:00:51.197615+0000","last_active":"2024-03-04T13:00:51.197550+0000","last_peered":"2024-03-04T13:00:51.197550+0000","last_clean":"2024-03-04T13:00:51.197550+0000","last_became_active":"2024-03-04T12:36:07.293952+0000","last_became_peered":"2024-03-04T12:36:07.293952+0000","last_unstale":"2024-03-04T13:00:51.197550+0000","last_undegraded":"2024-03-04T13:00:51.197550+0000","last_fullsized":"2024-03-04T13:00:51.197550+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'402","last_scrub_stamp":"2024-03-04T13:00:51.197457+0000","last_deep_scrub":"256'402","last_deep_scrub_stamp":"2024-03-04T13:00:51.197457+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.197457+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:17.674412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2282,"num_read_kb":2164,"num_write":473,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"256'317","reported_seq":959,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.633990+0000","last_change":"2024-03-04T13:00:54.634054+0000","last_active":"2024-03-04T13:00:54.633990+0000","last_peered":"2024-03-04T13:00:54.633990+0000","last_clean":"2024-03-04T13:00:54.633990+0000","last_became_active":"2024-03-04T12:36:05.295832+0000","last_became_peered":"2024-03-04T12:36:05.295832+0000","last_unstale":"2024-03-04T13:00:54.633990+0000","last_undegraded":"2024-03-04T13:00:54.633990+0000","last_fullsized":"2024-03-04T13:00:54.633990+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'317","last_scrub_stamp":"2024-03-04T13:00:54.633894+0000","last_deep_scrub":"256'317","last_deep_scrub_stamp":"2024-03-04T13:00:54.633894+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.633894+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:47.966603+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456555,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":48295,"num_write":1243,"num_write_kb":38980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"256'624","reported_seq":2336,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.121043+0000","last_change":"2024-03-04T13:00:44.121093+0000","last_active":"2024-03-04T13:00:44.121043+0000","last_peered":"2024-03-04T13:00:44.121043+0000","last_clean":"2024-03-04T13:00:44.121043+0000","last_became_active":"2024-03-04T12:36:07.295798+0000","last_became_peered":"2024-03-04T12:36:07.295798+0000","last_unstale":"2024-03-04T13:00:44.121043+0000","last_undegraded":"2024-03-04T13:00:44.121043+0000","last_fullsized":"2024-03-04T13:00:44.121043+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'624","last_scrub_stamp":"2024-03-04T13:00:44.120934+0000","last_deep_scrub":"256'624","last_deep_scrub_stamp":"2024-03-04T13:00:44.120934+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.120934+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":600,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:42:13.736456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3253,"num_read_kb":2977,"num_write":842,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2631,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"256'354","reported_seq":970,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.931804+0000","last_change":"2024-03-04T13:01:01.931851+0000","last_active":"2024-03-04T13:01:01.931804+0000","last_peered":"2024-03-04T13:01:01.931804+0000","last_clean":"2024-03-04T13:01:01.931804+0000","last_became_active":"2024-03-04T12:36:05.291477+0000","last_became_peered":"2024-03-04T12:36:05.291477+0000","last_unstale":"2024-03-04T13:01:01.931804+0000","last_undegraded":"2024-03-04T13:01:01.931804+0000","last_fullsized":"2024-03-04T13:01:01.931804+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'354","last_scrub_stamp":"2024-03-04T13:01:01.931733+0000","last_deep_scrub":"256'354","last_deep_scrub_stamp":"2024-03-04T13:01:01.931733+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.931733+0000","objects_scrubbed":10,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:19:34.106272+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730225,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":474,"num_read_kb":10302,"num_write":1224,"num_write_kb":24769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"256'368","reported_seq":1772,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.124614+0000","last_change":"2024-03-04T13:00:42.124642+0000","last_active":"2024-03-04T13:00:42.124614+0000","last_peered":"2024-03-04T13:00:42.124614+0000","last_clean":"2024-03-04T13:00:42.124614+0000","last_became_active":"2024-03-04T12:36:07.290104+0000","last_became_peered":"2024-03-04T12:36:07.290104+0000","last_unstale":"2024-03-04T13:00:42.124614+0000","last_undegraded":"2024-03-04T13:00:42.124614+0000","last_fullsized":"2024-03-04T13:00:42.124614+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'368","last_scrub_stamp":"2024-03-04T13:00:42.124516+0000","last_deep_scrub":"256'368","last_deep_scrub_stamp":"2024-03-04T13:00:42.124516+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.124516+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:34:33.903099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2031,"num_read_kb":1912,"num_write":446,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"256'321","reported_seq":947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:13.426871+0000","last_change":"2024-03-04T13:01:13.426949+0000","last_active":"2024-03-04T13:01:13.426871+0000","last_peered":"2024-03-04T13:01:13.426871+0000","last_clean":"2024-03-04T13:01:13.426871+0000","last_became_active":"2024-03-04T12:36:05.291096+0000","last_became_peered":"2024-03-04T12:36:05.291096+0000","last_unstale":"2024-03-04T13:01:13.426871+0000","last_undegraded":"2024-03-04T13:01:13.426871+0000","last_fullsized":"2024-03-04T13:01:13.426871+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'321","last_scrub_stamp":"2024-03-04T13:01:13.426757+0000","last_deep_scrub":"256'321","last_deep_scrub_stamp":"2024-03-04T13:01:13.426757+0000","last_clean_scrub_stamp":"2024-03-04T13:01:13.426757+0000","objects_scrubbed":12,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:52.328863+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":471,"num_read_kb":17846,"num_write":1202,"num_write_kb":33765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"256'454","reported_seq":2131,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.124043+0000","last_change":"2024-03-04T13:00:42.124112+0000","last_active":"2024-03-04T13:00:42.124043+0000","last_peered":"2024-03-04T13:00:42.124043+0000","last_clean":"2024-03-04T13:00:42.124043+0000","last_became_active":"2024-03-04T12:36:07.297989+0000","last_became_peered":"2024-03-04T12:36:07.297989+0000","last_unstale":"2024-03-04T13:00:42.124043+0000","last_undegraded":"2024-03-04T13:00:42.124043+0000","last_fullsized":"2024-03-04T13:00:42.124043+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'454","last_scrub_stamp":"2024-03-04T13:00:42.123913+0000","last_deep_scrub":"256'454","last_deep_scrub_stamp":"2024-03-04T13:00:42.123913+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.123913+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:33:43.663219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2700,"num_read_kb":2549,"num_write":550,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4300,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"256'370","reported_seq":1043,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:04.469462+0000","last_change":"2024-03-04T13:01:04.469538+0000","last_active":"2024-03-04T13:01:04.469462+0000","last_peered":"2024-03-04T13:01:04.469462+0000","last_clean":"2024-03-04T13:01:04.469462+0000","last_became_active":"2024-03-04T12:36:05.280944+0000","last_became_peered":"2024-03-04T12:36:05.280944+0000","last_unstale":"2024-03-04T13:01:04.469462+0000","last_undegraded":"2024-03-04T13:01:04.469462+0000","last_fullsized":"2024-03-04T13:01:04.469462+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'370","last_scrub_stamp":"2024-03-04T13:01:04.469352+0000","last_deep_scrub":"256'370","last_deep_scrub_stamp":"2024-03-04T13:01:04.469352+0000","last_clean_scrub_stamp":"2024-03-04T13:01:04.469352+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:44.577427+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290369,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":724,"num_read_kb":21552,"num_write":1199,"num_write_kb":33499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"256'83","reported_seq":569,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.117129+0000","last_change":"2024-03-04T13:00:27.117158+0000","last_active":"2024-03-04T13:00:27.117129+0000","last_peered":"2024-03-04T13:00:27.117129+0000","last_clean":"2024-03-04T13:00:27.117129+0000","last_became_active":"2024-03-04T12:36:15.356314+0000","last_became_peered":"2024-03-04T12:36:15.356314+0000","last_unstale":"2024-03-04T13:00:27.117129+0000","last_undegraded":"2024-03-04T13:00:27.117129+0000","last_fullsized":"2024-03-04T13:00:27.117129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'83","last_scrub_stamp":"2024-03-04T13:00:27.117037+0000","last_deep_scrub":"256'83","last_deep_scrub_stamp":"2024-03-04T13:00:27.117037+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.117037+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:45.219404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":197,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"256'1097","reported_seq":2705,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.629069+0000","last_change":"2024-03-04T13:00:52.629098+0000","last_active":"2024-03-04T13:00:52.629069+0000","last_peered":"2024-03-04T13:00:52.629069+0000","last_clean":"2024-03-04T13:00:52.629069+0000","last_became_active":"2024-03-04T12:36:07.297879+0000","last_became_peered":"2024-03-04T12:36:07.297879+0000","last_unstale":"2024-03-04T13:00:52.629069+0000","last_undegraded":"2024-03-04T13:00:52.629069+0000","last_fullsized":"2024-03-04T13:00:52.629069+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1097","last_scrub_stamp":"2024-03-04T13:00:52.628982+0000","last_deep_scrub":"256'1097","last_deep_scrub_stamp":"2024-03-04T13:00:52.628982+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.628982+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":1000,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:51.871167+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4860,"num_read_kb":4288,"num_write":1505,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"256'392","reported_seq":1009,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.323846+0000","last_change":"2024-03-04T13:00:54.323947+0000","last_active":"2024-03-04T13:00:54.323846+0000","last_peered":"2024-03-04T13:00:54.323846+0000","last_clean":"2024-03-04T13:00:54.323846+0000","last_became_active":"2024-03-04T12:36:05.296939+0000","last_became_peered":"2024-03-04T12:36:05.296939+0000","last_unstale":"2024-03-04T13:00:54.323846+0000","last_undegraded":"2024-03-04T13:00:54.323846+0000","last_fullsized":"2024-03-04T13:00:54.323846+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'392","last_scrub_stamp":"2024-03-04T13:00:54.323765+0000","last_deep_scrub":"256'392","last_deep_scrub_stamp":"2024-03-04T13:00:54.323765+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.323765+0000","objects_scrubbed":15,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:04.952080+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10962332,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":473,"num_read_kb":33218,"num_write":1212,"num_write_kb":53558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.274057+0000","last_change":"2024-03-04T13:00:46.274078+0000","last_active":"2024-03-04T13:00:46.274057+0000","last_peered":"2024-03-04T13:00:46.274057+0000","last_clean":"2024-03-04T13:00:46.274057+0000","last_became_active":"2024-03-04T12:36:09.314065+0000","last_became_peered":"2024-03-04T12:36:09.314065+0000","last_unstale":"2024-03-04T13:00:46.274057+0000","last_undegraded":"2024-03-04T13:00:46.274057+0000","last_fullsized":"2024-03-04T13:00:46.274057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:46.273949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:46.273949+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.273949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:13:31.643800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"256'288","reported_seq":866,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.434869+0000","last_change":"2024-03-04T13:00:58.434906+0000","last_active":"2024-03-04T13:00:58.434869+0000","last_peered":"2024-03-04T13:00:58.434869+0000","last_clean":"2024-03-04T13:00:58.434869+0000","last_became_active":"2024-03-04T12:36:11.325995+0000","last_became_peered":"2024-03-04T12:36:11.325995+0000","last_unstale":"2024-03-04T13:00:58.434869+0000","last_undegraded":"2024-03-04T13:00:58.434869+0000","last_fullsized":"2024-03-04T13:00:58.434869+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'288","last_scrub_stamp":"2024-03-04T13:00:58.434770+0000","last_deep_scrub":"256'288","last_deep_scrub_stamp":"2024-03-04T13:00:58.434770+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.434770+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:11.681361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43297,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1002,"num_write":366,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.250619+0000","last_change":"2024-03-04T13:00:38.250645+0000","last_active":"2024-03-04T13:00:38.250619+0000","last_peered":"2024-03-04T13:00:38.250619+0000","last_clean":"2024-03-04T13:00:38.250619+0000","last_became_active":"2024-03-04T12:36:13.339305+0000","last_became_peered":"2024-03-04T12:36:13.339305+0000","last_unstale":"2024-03-04T13:00:38.250619+0000","last_undegraded":"2024-03-04T13:00:38.250619+0000","last_fullsized":"2024-03-04T13:00:38.250619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:38.250535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:38.250535+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.250535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:52.534010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"256'2371","reported_seq":4152,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.436326+0000","last_change":"2024-03-04T13:00:35.436362+0000","last_active":"2024-03-04T13:00:35.436326+0000","last_peered":"2024-03-04T13:00:35.436326+0000","last_clean":"2024-03-04T13:00:35.436326+0000","last_became_active":"2024-03-04T12:36:15.362434+0000","last_became_peered":"2024-03-04T12:36:15.362434+0000","last_unstale":"2024-03-04T13:00:35.436326+0000","last_undegraded":"2024-03-04T13:00:35.436326+0000","last_fullsized":"2024-03-04T13:00:35.436326+0000","mapping_epoch":30,"log_start":"256'2300","ondisk_log_start":"256'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2371","last_scrub_stamp":"2024-03-04T13:00:35.436238+0000","last_deep_scrub":"256'2371","last_deep_scrub_stamp":"2024-03-04T13:00:35.436238+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.436238+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":2300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:04.019436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5876,"num_read_kb":5881,"num_write":4713,"num_write_kb":1738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"256'831","reported_seq":2413,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.250235+0000","last_change":"2024-03-04T13:00:49.250261+0000","last_active":"2024-03-04T13:00:49.250235+0000","last_peered":"2024-03-04T13:00:49.250235+0000","last_clean":"2024-03-04T13:00:49.250235+0000","last_became_active":"2024-03-04T12:36:07.295522+0000","last_became_peered":"2024-03-04T12:36:07.295522+0000","last_unstale":"2024-03-04T13:00:49.250235+0000","last_undegraded":"2024-03-04T13:00:49.250235+0000","last_fullsized":"2024-03-04T13:00:49.250235+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'831","last_scrub_stamp":"2024-03-04T13:00:49.250152+0000","last_deep_scrub":"256'831","last_deep_scrub_stamp":"2024-03-04T13:00:49.250152+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.250152+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:44.066625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3820,"num_read_kb":3411,"num_write":1118,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"256'365","reported_seq":989,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:09.387831+0000","last_change":"2024-03-04T13:01:09.387882+0000","last_active":"2024-03-04T13:01:09.387831+0000","last_peered":"2024-03-04T13:01:09.387831+0000","last_clean":"2024-03-04T13:01:09.387831+0000","last_became_active":"2024-03-04T12:36:05.288208+0000","last_became_peered":"2024-03-04T12:36:05.288208+0000","last_unstale":"2024-03-04T13:01:09.387831+0000","last_undegraded":"2024-03-04T13:01:09.387831+0000","last_fullsized":"2024-03-04T13:01:09.387831+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'365","last_scrub_stamp":"2024-03-04T13:01:09.387728+0000","last_deep_scrub":"256'365","last_deep_scrub_stamp":"2024-03-04T13:01:09.387728+0000","last_clean_scrub_stamp":"2024-03-04T13:01:09.387728+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:32:00.304925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":34780,"num_write":1176,"num_write_kb":45508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:04.538773+0000","last_change":"2024-03-04T13:01:04.538810+0000","last_active":"2024-03-04T13:01:04.538773+0000","last_peered":"2024-03-04T13:01:04.538773+0000","last_clean":"2024-03-04T13:01:04.538773+0000","last_became_active":"2024-03-04T12:36:09.309583+0000","last_became_peered":"2024-03-04T12:36:09.309583+0000","last_unstale":"2024-03-04T13:01:04.538773+0000","last_undegraded":"2024-03-04T13:01:04.538773+0000","last_fullsized":"2024-03-04T13:01:04.538773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:04.538653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:04.538653+0000","last_clean_scrub_stamp":"2024-03-04T13:01:04.538653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:28:41.302153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"256'74","reported_seq":583,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.107034+0000","last_change":"2024-03-04T13:00:38.107070+0000","last_active":"2024-03-04T13:00:38.107034+0000","last_peered":"2024-03-04T13:00:38.107034+0000","last_clean":"2024-03-04T13:00:38.107034+0000","last_became_active":"2024-03-04T12:36:11.324761+0000","last_became_peered":"2024-03-04T12:36:11.324761+0000","last_unstale":"2024-03-04T13:00:38.107034+0000","last_undegraded":"2024-03-04T13:00:38.107034+0000","last_fullsized":"2024-03-04T13:00:38.107034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'74","last_scrub_stamp":"2024-03-04T13:00:38.106947+0000","last_deep_scrub":"256'74","last_deep_scrub_stamp":"2024-03-04T13:00:38.106947+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.106947+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:56:51.502742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":50,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.118375+0000","last_change":"2024-03-04T13:00:33.118401+0000","last_active":"2024-03-04T13:00:33.118375+0000","last_peered":"2024-03-04T13:00:33.118375+0000","last_clean":"2024-03-04T13:00:33.118375+0000","last_became_active":"2024-03-04T12:36:13.343072+0000","last_became_peered":"2024-03-04T12:36:13.343072+0000","last_unstale":"2024-03-04T13:00:33.118375+0000","last_undegraded":"2024-03-04T13:00:33.118375+0000","last_fullsized":"2024-03-04T13:00:33.118375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:33.118287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:33.118287+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.118287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:36:41.186234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"256'104","reported_seq":600,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.614323+0000","last_change":"2024-03-04T13:00:32.614323+0000","last_active":"2024-03-04T13:00:32.614323+0000","last_peered":"2024-03-04T13:00:32.614323+0000","last_clean":"2024-03-04T13:00:32.614323+0000","last_became_active":"2024-03-04T12:36:15.362354+0000","last_became_peered":"2024-03-04T12:36:15.362354+0000","last_unstale":"2024-03-04T13:00:32.614323+0000","last_undegraded":"2024-03-04T13:00:32.614323+0000","last_fullsized":"2024-03-04T13:00:32.614323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'104","last_scrub_stamp":"2024-03-04T13:00:32.614142+0000","last_deep_scrub":"256'104","last_deep_scrub_stamp":"2024-03-04T13:00:32.614142+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.614142+0000","objects_scrubbed":6,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:02:52.498658+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":660,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":121,"num_write":244,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"256'345","reported_seq":1734,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.405192+0000","last_change":"2024-03-04T13:00:59.405224+0000","last_active":"2024-03-04T13:00:59.405192+0000","last_peered":"2024-03-04T13:00:59.405192+0000","last_clean":"2024-03-04T13:00:59.405192+0000","last_became_active":"2024-03-04T12:36:07.294328+0000","last_became_peered":"2024-03-04T12:36:07.294328+0000","last_unstale":"2024-03-04T13:00:59.405192+0000","last_undegraded":"2024-03-04T13:00:59.405192+0000","last_fullsized":"2024-03-04T13:00:59.405192+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'345","last_scrub_stamp":"2024-03-04T13:00:59.405065+0000","last_deep_scrub":"256'345","last_deep_scrub_stamp":"2024-03-04T13:00:59.405065+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.405065+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:49.403720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1913,"num_read_kb":1818,"num_write":399,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"256'289","reported_seq":911,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:08.261198+0000","last_change":"2024-03-04T13:01:08.261256+0000","last_active":"2024-03-04T13:01:08.261198+0000","last_peered":"2024-03-04T13:01:08.261198+0000","last_clean":"2024-03-04T13:01:08.261198+0000","last_became_active":"2024-03-04T12:36:05.291366+0000","last_became_peered":"2024-03-04T12:36:05.291366+0000","last_unstale":"2024-03-04T13:01:08.261198+0000","last_undegraded":"2024-03-04T13:01:08.261198+0000","last_fullsized":"2024-03-04T13:01:08.261198+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'289","last_scrub_stamp":"2024-03-04T13:01:08.261112+0000","last_deep_scrub":"256'289","last_deep_scrub_stamp":"2024-03-04T13:01:08.261112+0000","last_clean_scrub_stamp":"2024-03-04T13:01:08.261112+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:04:46.708458+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":749491,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":10592,"num_write":1118,"num_write_kb":21097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:06.492503+0000","last_change":"2024-03-04T13:01:06.492544+0000","last_active":"2024-03-04T13:01:06.492503+0000","last_peered":"2024-03-04T13:01:06.492503+0000","last_clean":"2024-03-04T13:01:06.492503+0000","last_became_active":"2024-03-04T12:36:09.309749+0000","last_became_peered":"2024-03-04T12:36:09.309749+0000","last_unstale":"2024-03-04T13:01:06.492503+0000","last_undegraded":"2024-03-04T13:01:06.492503+0000","last_fullsized":"2024-03-04T13:01:06.492503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:06.492410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:06.492410+0000","last_clean_scrub_stamp":"2024-03-04T13:01:06.492410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:06:12.874216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"256'86","reported_seq":598,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.298417+0000","last_change":"2024-03-04T13:00:28.298481+0000","last_active":"2024-03-04T13:00:28.298417+0000","last_peered":"2024-03-04T13:00:28.298417+0000","last_clean":"2024-03-04T13:00:28.298417+0000","last_became_active":"2024-03-04T12:36:11.324127+0000","last_became_peered":"2024-03-04T12:36:11.324127+0000","last_unstale":"2024-03-04T13:00:28.298417+0000","last_undegraded":"2024-03-04T13:00:28.298417+0000","last_fullsized":"2024-03-04T13:00:28.298417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'86","last_scrub_stamp":"2024-03-04T13:00:28.298332+0000","last_deep_scrub":"256'86","last_deep_scrub_stamp":"2024-03-04T13:00:28.298332+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.298332+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:29.180417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"256'510","reported_seq":1468,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.298406+0000","last_change":"2024-03-04T13:00:41.298440+0000","last_active":"2024-03-04T13:00:41.298406+0000","last_peered":"2024-03-04T13:00:41.298406+0000","last_clean":"2024-03-04T13:00:41.298406+0000","last_became_active":"2024-03-04T12:36:13.338070+0000","last_became_peered":"2024-03-04T12:36:13.338070+0000","last_unstale":"2024-03-04T13:00:41.298406+0000","last_undegraded":"2024-03-04T13:00:41.298406+0000","last_fullsized":"2024-03-04T13:00:41.298406+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'510","last_scrub_stamp":"2024-03-04T13:00:41.298306+0000","last_deep_scrub":"256'510","last_deep_scrub_stamp":"2024-03-04T13:00:41.298306+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.298306+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:35.703293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"256'104","reported_seq":583,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.068390+0000","last_change":"2024-03-04T13:00:26.068390+0000","last_active":"2024-03-04T13:00:26.068390+0000","last_peered":"2024-03-04T13:00:26.068390+0000","last_clean":"2024-03-04T13:00:26.068390+0000","last_became_active":"2024-03-04T12:36:15.356417+0000","last_became_peered":"2024-03-04T12:36:15.356417+0000","last_unstale":"2024-03-04T13:00:26.068390+0000","last_undegraded":"2024-03-04T13:00:26.068390+0000","last_fullsized":"2024-03-04T13:00:26.068390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'104","last_scrub_stamp":"2024-03-04T13:00:26.068269+0000","last_deep_scrub":"256'104","last_deep_scrub_stamp":"2024-03-04T13:00:26.068269+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.068269+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:57.908639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"256'686","reported_seq":2120,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.631942+0000","last_change":"2024-03-04T13:00:53.631972+0000","last_active":"2024-03-04T13:00:53.631942+0000","last_peered":"2024-03-04T13:00:53.631942+0000","last_clean":"2024-03-04T13:00:53.631942+0000","last_became_active":"2024-03-04T12:36:07.293493+0000","last_became_peered":"2024-03-04T12:36:07.293493+0000","last_unstale":"2024-03-04T13:00:53.631942+0000","last_undegraded":"2024-03-04T13:00:53.631942+0000","last_fullsized":"2024-03-04T13:00:53.631942+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'686","last_scrub_stamp":"2024-03-04T13:00:53.631854+0000","last_deep_scrub":"256'686","last_deep_scrub_stamp":"2024-03-04T13:00:53.631854+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.631854+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:48:17.135224+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3120,"num_read_kb":2817,"num_write":901,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":556,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"256'397","reported_seq":1026,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.766966+0000","last_change":"2024-03-04T13:00:50.767009+0000","last_active":"2024-03-04T13:00:50.766966+0000","last_peered":"2024-03-04T13:00:50.766966+0000","last_clean":"2024-03-04T13:00:50.766966+0000","last_became_active":"2024-03-04T12:36:05.283477+0000","last_became_peered":"2024-03-04T12:36:05.283477+0000","last_unstale":"2024-03-04T13:00:50.766966+0000","last_undegraded":"2024-03-04T13:00:50.766966+0000","last_fullsized":"2024-03-04T13:00:50.766966+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'397","last_scrub_stamp":"2024-03-04T13:00:50.766881+0000","last_deep_scrub":"256'397","last_deep_scrub_stamp":"2024-03-04T13:00:50.766881+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.766881+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:19.484584+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048764,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":32578,"num_write":1458,"num_write_kb":46757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.266816+0000","last_change":"2024-03-04T13:00:48.266839+0000","last_active":"2024-03-04T13:00:48.266816+0000","last_peered":"2024-03-04T13:00:48.266816+0000","last_clean":"2024-03-04T13:00:48.266816+0000","last_became_active":"2024-03-04T12:36:09.314215+0000","last_became_peered":"2024-03-04T12:36:09.314215+0000","last_unstale":"2024-03-04T13:00:48.266816+0000","last_undegraded":"2024-03-04T13:00:48.266816+0000","last_fullsized":"2024-03-04T13:00:48.266816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:48.266727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:48.266727+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.266727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:37:57.215196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"256'250","reported_seq":802,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.312866+0000","last_change":"2024-03-04T13:00:42.312905+0000","last_active":"2024-03-04T13:00:42.312866+0000","last_peered":"2024-03-04T13:00:42.312866+0000","last_clean":"2024-03-04T13:00:42.312866+0000","last_became_active":"2024-03-04T12:36:11.956371+0000","last_became_peered":"2024-03-04T12:36:11.956371+0000","last_unstale":"2024-03-04T13:00:42.312866+0000","last_undegraded":"2024-03-04T13:00:42.312866+0000","last_fullsized":"2024-03-04T13:00:42.312866+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'250","last_scrub_stamp":"2024-03-04T13:00:42.312765+0000","last_deep_scrub":"256'250","last_deep_scrub_stamp":"2024-03-04T13:00:42.312765+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.312765+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:09:09.690974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44142,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1035,"num_write":354,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"256'535","reported_seq":3345,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.699751+0000","last_change":"2024-03-04T13:00:41.699839+0000","last_active":"2024-03-04T13:00:41.699751+0000","last_peered":"2024-03-04T13:00:41.699751+0000","last_clean":"2024-03-04T13:00:41.699751+0000","last_became_active":"2024-03-04T12:36:13.344498+0000","last_became_peered":"2024-03-04T12:36:13.344498+0000","last_unstale":"2024-03-04T13:00:41.699751+0000","last_undegraded":"2024-03-04T13:00:41.699751+0000","last_fullsized":"2024-03-04T13:00:41.699751+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'535","last_scrub_stamp":"2024-03-04T13:00:41.699639+0000","last_deep_scrub":"256'535","last_deep_scrub_stamp":"2024-03-04T13:00:41.699639+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.699639+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:07:21.038160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"256'769","reported_seq":2308,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.349317+0000","last_change":"2024-03-04T13:00:42.349344+0000","last_active":"2024-03-04T13:00:42.349317+0000","last_peered":"2024-03-04T13:00:42.349317+0000","last_clean":"2024-03-04T13:00:42.349317+0000","last_became_active":"2024-03-04T12:36:07.297320+0000","last_became_peered":"2024-03-04T12:36:07.297320+0000","last_unstale":"2024-03-04T13:00:42.349317+0000","last_undegraded":"2024-03-04T13:00:42.349317+0000","last_fullsized":"2024-03-04T13:00:42.349317+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'769","last_scrub_stamp":"2024-03-04T13:00:42.349233+0000","last_deep_scrub":"256'769","last_deep_scrub_stamp":"2024-03-04T13:00:42.349233+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.349233+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:41.422432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3660,"num_read_kb":3298,"num_write":1023,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"256'397","reported_seq":1069,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.269712+0000","last_change":"2024-03-04T13:01:00.269775+0000","last_active":"2024-03-04T13:01:00.269712+0000","last_peered":"2024-03-04T13:01:00.269712+0000","last_clean":"2024-03-04T13:01:00.269712+0000","last_became_active":"2024-03-04T12:36:05.293882+0000","last_became_peered":"2024-03-04T12:36:05.293882+0000","last_unstale":"2024-03-04T13:01:00.269712+0000","last_undegraded":"2024-03-04T13:01:00.269712+0000","last_fullsized":"2024-03-04T13:01:00.269712+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'397","last_scrub_stamp":"2024-03-04T13:01:00.269616+0000","last_deep_scrub":"256'397","last_deep_scrub_stamp":"2024-03-04T13:01:00.269616+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.269616+0000","objects_scrubbed":11,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:31:11.933523+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5179671,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":578,"num_read_kb":60173,"num_write":1456,"num_write_kb":40158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.289919+0000","last_change":"2024-03-04T13:00:53.289944+0000","last_active":"2024-03-04T13:00:53.289919+0000","last_peered":"2024-03-04T13:00:53.289919+0000","last_clean":"2024-03-04T13:00:53.289919+0000","last_became_active":"2024-03-04T12:36:09.308538+0000","last_became_peered":"2024-03-04T12:36:09.308538+0000","last_unstale":"2024-03-04T13:00:53.289919+0000","last_undegraded":"2024-03-04T13:00:53.289919+0000","last_fullsized":"2024-03-04T13:00:53.289919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:53.289830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:53.289830+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.289830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:33.037810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"256'321","reported_seq":901,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.391819+0000","last_change":"2024-03-04T13:00:39.391867+0000","last_active":"2024-03-04T13:00:39.391819+0000","last_peered":"2024-03-04T13:00:39.391819+0000","last_clean":"2024-03-04T13:00:39.391819+0000","last_became_active":"2024-03-04T12:36:11.954597+0000","last_became_peered":"2024-03-04T12:36:11.954597+0000","last_unstale":"2024-03-04T13:00:39.391819+0000","last_undegraded":"2024-03-04T13:00:39.391819+0000","last_fullsized":"2024-03-04T13:00:39.391819+0000","mapping_epoch":26,"log_start":"256'300","ondisk_log_start":"256'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'321","last_scrub_stamp":"2024-03-04T13:00:39.391733+0000","last_deep_scrub":"256'321","last_deep_scrub_stamp":"2024-03-04T13:00:39.391733+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.391733+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:46.694056+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51312,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":526,"num_read_kb":1169,"num_write":422,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.400019+0000","last_change":"2024-03-04T13:00:50.400019+0000","last_active":"2024-03-04T13:00:50.400019+0000","last_peered":"2024-03-04T13:00:50.400019+0000","last_clean":"2024-03-04T13:00:50.400019+0000","last_became_active":"2024-03-04T12:36:13.339890+0000","last_became_peered":"2024-03-04T12:36:13.339890+0000","last_unstale":"2024-03-04T13:00:50.400019+0000","last_undegraded":"2024-03-04T13:00:50.400019+0000","last_fullsized":"2024-03-04T13:00:50.400019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:50.399907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:50.399907+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.399907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:19:11.128424+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"256'507","reported_seq":1301,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.396173+0000","last_change":"2024-03-04T13:00:33.396173+0000","last_active":"2024-03-04T13:00:33.396173+0000","last_peered":"2024-03-04T13:00:33.396173+0000","last_clean":"2024-03-04T13:00:33.396173+0000","last_became_active":"2024-03-04T12:36:15.362355+0000","last_became_peered":"2024-03-04T12:36:15.362355+0000","last_unstale":"2024-03-04T13:00:33.396173+0000","last_undegraded":"2024-03-04T13:00:33.396173+0000","last_fullsized":"2024-03-04T13:00:33.396173+0000","mapping_epoch":30,"log_start":"250'400","ondisk_log_start":"250'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'507","last_scrub_stamp":"2024-03-04T13:00:33.396041+0000","last_deep_scrub":"256'507","last_deep_scrub_stamp":"2024-03-04T13:00:33.396041+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.396041+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:55.241746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1234,"num_read_kb":1233,"num_write":1042,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"256'407","reported_seq":1926,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.039724+0000","last_change":"2024-03-04T13:00:57.039754+0000","last_active":"2024-03-04T13:00:57.039724+0000","last_peered":"2024-03-04T13:00:57.039724+0000","last_clean":"2024-03-04T13:00:57.039724+0000","last_became_active":"2024-03-04T12:36:07.291507+0000","last_became_peered":"2024-03-04T12:36:07.291507+0000","last_unstale":"2024-03-04T13:00:57.039724+0000","last_undegraded":"2024-03-04T13:00:57.039724+0000","last_fullsized":"2024-03-04T13:00:57.039724+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'407","last_scrub_stamp":"2024-03-04T13:00:57.039631+0000","last_deep_scrub":"256'407","last_deep_scrub_stamp":"2024-03-04T13:00:57.039631+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.039631+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:22.285100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2180,"num_read_kb":2067,"num_write":478,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"256'317","reported_seq":950,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:04.210002+0000","last_change":"2024-03-04T13:01:04.210048+0000","last_active":"2024-03-04T13:01:04.210002+0000","last_peered":"2024-03-04T13:01:04.210002+0000","last_clean":"2024-03-04T13:01:04.210002+0000","last_became_active":"2024-03-04T12:36:05.286438+0000","last_became_peered":"2024-03-04T12:36:05.286438+0000","last_unstale":"2024-03-04T13:01:04.210002+0000","last_undegraded":"2024-03-04T13:01:04.210002+0000","last_fullsized":"2024-03-04T13:01:04.210002+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'317","last_scrub_stamp":"2024-03-04T13:01:04.209926+0000","last_deep_scrub":"256'317","last_deep_scrub_stamp":"2024-03-04T13:01:04.209926+0000","last_clean_scrub_stamp":"2024-03-04T13:01:04.209926+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:29.114168+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21141,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":18655,"num_write":1207,"num_write_kb":23251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.325802+0000","last_change":"2024-03-04T13:00:34.325853+0000","last_active":"2024-03-04T13:00:34.325802+0000","last_peered":"2024-03-04T13:00:34.325802+0000","last_clean":"2024-03-04T13:00:34.325802+0000","last_became_active":"2024-03-04T12:36:09.304561+0000","last_became_peered":"2024-03-04T12:36:09.304561+0000","last_unstale":"2024-03-04T13:00:34.325802+0000","last_undegraded":"2024-03-04T13:00:34.325802+0000","last_fullsized":"2024-03-04T13:00:34.325802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:34.325699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:34.325699+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.325699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:45:29.332360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"256'273","reported_seq":824,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.676860+0000","last_change":"2024-03-04T13:00:51.676860+0000","last_active":"2024-03-04T13:00:51.676860+0000","last_peered":"2024-03-04T13:00:51.676860+0000","last_clean":"2024-03-04T13:00:51.676860+0000","last_became_active":"2024-03-04T12:36:11.324147+0000","last_became_peered":"2024-03-04T12:36:11.324147+0000","last_unstale":"2024-03-04T13:00:51.676860+0000","last_undegraded":"2024-03-04T13:00:51.676860+0000","last_fullsized":"2024-03-04T13:00:51.676860+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'273","last_scrub_stamp":"2024-03-04T13:00:51.676726+0000","last_deep_scrub":"256'273","last_deep_scrub_stamp":"2024-03-04T13:00:51.676726+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.676726+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:24:30.068280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":439,"num_read_kb":1077,"num_write":366,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":477,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.746156+0000","last_change":"2024-03-04T13:00:39.746181+0000","last_active":"2024-03-04T13:00:39.746156+0000","last_peered":"2024-03-04T13:00:39.746156+0000","last_clean":"2024-03-04T13:00:39.746156+0000","last_became_active":"2024-03-04T12:36:13.346077+0000","last_became_peered":"2024-03-04T12:36:13.346077+0000","last_unstale":"2024-03-04T13:00:39.746156+0000","last_undegraded":"2024-03-04T13:00:39.746156+0000","last_fullsized":"2024-03-04T13:00:39.746156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.746057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.746057+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.746057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:38.016628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"256'124","reported_seq":613,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.742308+0000","last_change":"2024-03-04T13:00:42.742308+0000","last_active":"2024-03-04T13:00:42.742308+0000","last_peered":"2024-03-04T13:00:42.742308+0000","last_clean":"2024-03-04T13:00:42.742308+0000","last_became_active":"2024-03-04T12:36:15.359839+0000","last_became_peered":"2024-03-04T12:36:15.359839+0000","last_unstale":"2024-03-04T13:00:42.742308+0000","last_undegraded":"2024-03-04T13:00:42.742308+0000","last_fullsized":"2024-03-04T13:00:42.742308+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'124","last_scrub_stamp":"2024-03-04T13:00:42.742163+0000","last_deep_scrub":"256'124","last_deep_scrub_stamp":"2024-03-04T13:00:42.742163+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.742163+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:04.700070+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":144,"num_write":306,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"256'819","reported_seq":2272,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.622699+0000","last_change":"2024-03-04T13:00:56.622760+0000","last_active":"2024-03-04T13:00:56.622699+0000","last_peered":"2024-03-04T13:00:56.622699+0000","last_clean":"2024-03-04T13:00:56.622699+0000","last_became_active":"2024-03-04T12:36:40.394812+0000","last_became_peered":"2024-03-04T12:36:40.394812+0000","last_unstale":"2024-03-04T13:00:56.622699+0000","last_undegraded":"2024-03-04T13:00:56.622699+0000","last_fullsized":"2024-03-04T13:00:56.622699+0000","mapping_epoch":33,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'819","last_scrub_stamp":"2024-03-04T13:00:56.622590+0000","last_deep_scrub":"256'819","last_deep_scrub_stamp":"2024-03-04T13:00:56.622590+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.622590+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:17:25.575809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3628,"num_read_kb":3191,"num_write":1140,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"256'344","reported_seq":1003,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.266767+0000","last_change":"2024-03-04T13:00:52.266813+0000","last_active":"2024-03-04T13:00:52.266767+0000","last_peered":"2024-03-04T13:00:52.266767+0000","last_clean":"2024-03-04T13:00:52.266767+0000","last_became_active":"2024-03-04T12:36:05.297486+0000","last_became_peered":"2024-03-04T12:36:05.297486+0000","last_unstale":"2024-03-04T13:00:52.266767+0000","last_undegraded":"2024-03-04T13:00:52.266767+0000","last_fullsized":"2024-03-04T13:00:52.266767+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'344","last_scrub_stamp":"2024-03-04T13:00:52.266678+0000","last_deep_scrub":"256'344","last_deep_scrub_stamp":"2024-03-04T13:00:52.266678+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.266678+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:45:26.194961+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":44586,"num_write":1373,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"256'6","reported_seq":798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.257746+0000","last_change":"2024-03-04T13:00:38.257746+0000","last_active":"2024-03-04T13:00:38.257746+0000","last_peered":"2024-03-04T13:00:38.257746+0000","last_clean":"2024-03-04T13:00:38.257746+0000","last_became_active":"2024-03-04T12:36:09.303280+0000","last_became_peered":"2024-03-04T12:36:09.303280+0000","last_unstale":"2024-03-04T13:00:38.257746+0000","last_undegraded":"2024-03-04T13:00:38.257746+0000","last_fullsized":"2024-03-04T13:00:38.257746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'6","last_scrub_stamp":"2024-03-04T13:00:38.257611+0000","last_deep_scrub":"256'6","last_deep_scrub_stamp":"2024-03-04T13:00:38.257611+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.257611+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:40.037724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":467,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"256'292","reported_seq":854,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.268985+0000","last_change":"2024-03-04T13:00:59.269045+0000","last_active":"2024-03-04T13:00:59.268985+0000","last_peered":"2024-03-04T13:00:59.268985+0000","last_clean":"2024-03-04T13:00:59.268985+0000","last_became_active":"2024-03-04T12:36:11.325109+0000","last_became_peered":"2024-03-04T12:36:11.325109+0000","last_unstale":"2024-03-04T13:00:59.268985+0000","last_undegraded":"2024-03-04T13:00:59.268985+0000","last_fullsized":"2024-03-04T13:00:59.268985+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'292","last_scrub_stamp":"2024-03-04T13:00:59.268915+0000","last_deep_scrub":"256'292","last_deep_scrub_stamp":"2024-03-04T13:00:59.268915+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.268915+0000","objects_scrubbed":8,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:10.436302+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48663,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":476,"num_read_kb":1126,"num_write":394,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"256'518","reported_seq":1831,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.480313+0000","last_change":"2024-03-04T13:00:43.480358+0000","last_active":"2024-03-04T13:00:43.480313+0000","last_peered":"2024-03-04T13:00:43.480313+0000","last_clean":"2024-03-04T13:00:43.480313+0000","last_became_active":"2024-03-04T12:36:13.342604+0000","last_became_peered":"2024-03-04T12:36:13.342604+0000","last_unstale":"2024-03-04T13:00:43.480313+0000","last_undegraded":"2024-03-04T13:00:43.480313+0000","last_fullsized":"2024-03-04T13:00:43.480313+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'518","last_scrub_stamp":"2024-03-04T13:00:43.480202+0000","last_deep_scrub":"256'518","last_deep_scrub_stamp":"2024-03-04T13:00:43.480202+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.480202+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:17.734952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"256'92","reported_seq":561,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.636159+0000","last_change":"2024-03-04T13:00:33.636203+0000","last_active":"2024-03-04T13:00:33.636159+0000","last_peered":"2024-03-04T13:00:33.636159+0000","last_clean":"2024-03-04T13:00:33.636159+0000","last_became_active":"2024-03-04T12:36:15.359959+0000","last_became_peered":"2024-03-04T12:36:15.359959+0000","last_unstale":"2024-03-04T13:00:33.636159+0000","last_undegraded":"2024-03-04T13:00:33.636159+0000","last_fullsized":"2024-03-04T13:00:33.636159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'92","last_scrub_stamp":"2024-03-04T13:00:33.636037+0000","last_deep_scrub":"256'92","last_deep_scrub_stamp":"2024-03-04T13:00:33.636037+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.636037+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:05:11.396356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"256'356","reported_seq":1809,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.498478+0000","last_change":"2024-03-04T13:00:53.498478+0000","last_active":"2024-03-04T13:00:53.498478+0000","last_peered":"2024-03-04T13:00:53.498478+0000","last_clean":"2024-03-04T13:00:53.498478+0000","last_became_active":"2024-03-04T12:36:07.301558+0000","last_became_peered":"2024-03-04T12:36:07.301558+0000","last_unstale":"2024-03-04T13:00:53.498478+0000","last_undegraded":"2024-03-04T13:00:53.498478+0000","last_fullsized":"2024-03-04T13:00:53.498478+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'356","last_scrub_stamp":"2024-03-04T13:00:53.498342+0000","last_deep_scrub":"256'356","last_deep_scrub_stamp":"2024-03-04T13:00:53.498342+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.498342+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:54.005350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1943,"num_read_kb":1867,"num_write":395,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"256'366","reported_seq":1126,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:04.311629+0000","last_change":"2024-03-04T13:01:04.311672+0000","last_active":"2024-03-04T13:01:04.311629+0000","last_peered":"2024-03-04T13:01:04.311629+0000","last_clean":"2024-03-04T13:01:04.311629+0000","last_became_active":"2024-03-04T12:36:05.293649+0000","last_became_peered":"2024-03-04T12:36:05.293649+0000","last_unstale":"2024-03-04T13:01:04.311629+0000","last_undegraded":"2024-03-04T13:01:04.311629+0000","last_fullsized":"2024-03-04T13:01:04.311629+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'366","last_scrub_stamp":"2024-03-04T13:01:04.311548+0000","last_deep_scrub":"256'366","last_deep_scrub_stamp":"2024-03-04T13:01:04.311548+0000","last_clean_scrub_stamp":"2024-03-04T13:01:04.311548+0000","objects_scrubbed":9,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:35:18.138816+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3134195,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":703,"num_read_kb":39148,"num_write":1364,"num_write_kb":31517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.312815+0000","last_change":"2024-03-04T13:00:36.312878+0000","last_active":"2024-03-04T13:00:36.312815+0000","last_peered":"2024-03-04T13:00:36.312815+0000","last_clean":"2024-03-04T13:00:36.312815+0000","last_became_active":"2024-03-04T12:36:09.303908+0000","last_became_peered":"2024-03-04T12:36:09.303908+0000","last_unstale":"2024-03-04T13:00:36.312815+0000","last_undegraded":"2024-03-04T13:00:36.312815+0000","last_fullsized":"2024-03-04T13:00:36.312815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:36.312703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:36.312703+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.312703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:24:52.339144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"256'432","reported_seq":1041,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.491838+0000","last_change":"2024-03-04T13:01:02.491901+0000","last_active":"2024-03-04T13:01:02.491838+0000","last_peered":"2024-03-04T13:01:02.491838+0000","last_clean":"2024-03-04T13:01:02.491838+0000","last_became_active":"2024-03-04T12:36:11.326014+0000","last_became_peered":"2024-03-04T12:36:11.326014+0000","last_unstale":"2024-03-04T13:01:02.491838+0000","last_undegraded":"2024-03-04T13:01:02.491838+0000","last_fullsized":"2024-03-04T13:01:02.491838+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'432","last_scrub_stamp":"2024-03-04T13:01:02.491730+0000","last_deep_scrub":"256'432","last_deep_scrub_stamp":"2024-03-04T13:01:02.491730+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.491730+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:55:47.581140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91979,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":758,"num_read_kb":1853,"num_write":616,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:24.200373+0000","last_change":"2024-03-04T13:00:24.200396+0000","last_active":"2024-03-04T13:00:24.200373+0000","last_peered":"2024-03-04T13:00:24.200373+0000","last_clean":"2024-03-04T13:00:24.200373+0000","last_became_active":"2024-03-04T12:36:13.335586+0000","last_became_peered":"2024-03-04T12:36:13.335586+0000","last_unstale":"2024-03-04T13:00:24.200373+0000","last_undegraded":"2024-03-04T13:00:24.200373+0000","last_fullsized":"2024-03-04T13:00:24.200373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:24.200285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:24.200285+0000","last_clean_scrub_stamp":"2024-03-04T13:00:24.200285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:42:37.768082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"256'108","reported_seq":610,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.374380+0000","last_change":"2024-03-04T13:00:31.374407+0000","last_active":"2024-03-04T13:00:31.374380+0000","last_peered":"2024-03-04T13:00:31.374380+0000","last_clean":"2024-03-04T13:00:31.374380+0000","last_became_active":"2024-03-04T12:36:15.356270+0000","last_became_peered":"2024-03-04T12:36:15.356270+0000","last_unstale":"2024-03-04T13:00:31.374380+0000","last_undegraded":"2024-03-04T13:00:31.374380+0000","last_fullsized":"2024-03-04T13:00:31.374380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'108","last_scrub_stamp":"2024-03-04T13:00:31.374294+0000","last_deep_scrub":"256'108","last_deep_scrub_stamp":"2024-03-04T13:00:31.374294+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.374294+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:34:36.455950+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":257,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"256'399","reported_seq":1984,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.020670+0000","last_change":"2024-03-04T13:00:55.020670+0000","last_active":"2024-03-04T13:00:55.020670+0000","last_peered":"2024-03-04T13:00:55.020670+0000","last_clean":"2024-03-04T13:00:55.020670+0000","last_became_active":"2024-03-04T12:36:07.292788+0000","last_became_peered":"2024-03-04T12:36:07.292788+0000","last_unstale":"2024-03-04T13:00:55.020670+0000","last_undegraded":"2024-03-04T13:00:55.020670+0000","last_fullsized":"2024-03-04T13:00:55.020670+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'399","last_scrub_stamp":"2024-03-04T13:00:55.020485+0000","last_deep_scrub":"256'399","last_deep_scrub_stamp":"2024-03-04T13:00:55.020485+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.020485+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:02.659613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2359,"num_read_kb":2243,"num_write":467,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1436,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"256'308","reported_seq":1020,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:09.466722+0000","last_change":"2024-03-04T13:01:09.466771+0000","last_active":"2024-03-04T13:01:09.466722+0000","last_peered":"2024-03-04T13:01:09.466722+0000","last_clean":"2024-03-04T13:01:09.466722+0000","last_became_active":"2024-03-04T12:36:05.284594+0000","last_became_peered":"2024-03-04T12:36:05.284594+0000","last_unstale":"2024-03-04T13:01:09.466722+0000","last_undegraded":"2024-03-04T13:01:09.466722+0000","last_fullsized":"2024-03-04T13:01:09.466722+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'308","last_scrub_stamp":"2024-03-04T13:01:09.466636+0000","last_deep_scrub":"256'308","last_deep_scrub_stamp":"2024-03-04T13:01:09.466636+0000","last_clean_scrub_stamp":"2024-03-04T13:01:09.466636+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:53:52.259897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398941,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":597,"num_read_kb":110861,"num_write":1019,"num_write_kb":39283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.286134+0000","last_change":"2024-03-04T13:00:32.286134+0000","last_active":"2024-03-04T13:00:32.286134+0000","last_peered":"2024-03-04T13:00:32.286134+0000","last_clean":"2024-03-04T13:00:32.286134+0000","last_became_active":"2024-03-04T12:36:09.305363+0000","last_became_peered":"2024-03-04T12:36:09.305363+0000","last_unstale":"2024-03-04T13:00:32.286134+0000","last_undegraded":"2024-03-04T13:00:32.286134+0000","last_fullsized":"2024-03-04T13:00:32.286134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:32.286026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:32.286026+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.286026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:59:46.692288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"256'264","reported_seq":823,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.130461+0000","last_change":"2024-03-04T13:00:41.130461+0000","last_active":"2024-03-04T13:00:41.130461+0000","last_peered":"2024-03-04T13:00:41.130461+0000","last_clean":"2024-03-04T13:00:41.130461+0000","last_became_active":"2024-03-04T12:36:11.319633+0000","last_became_peered":"2024-03-04T12:36:11.319633+0000","last_unstale":"2024-03-04T13:00:41.130461+0000","last_undegraded":"2024-03-04T13:00:41.130461+0000","last_fullsized":"2024-03-04T13:00:41.130461+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'264","last_scrub_stamp":"2024-03-04T13:00:41.130252+0000","last_deep_scrub":"256'264","last_deep_scrub_stamp":"2024-03-04T13:00:41.130252+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.130252+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:37:10.295625+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43986,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":990,"num_write":404,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.595505+0000","last_change":"2024-03-04T13:00:39.595505+0000","last_active":"2024-03-04T13:00:39.595505+0000","last_peered":"2024-03-04T13:00:39.595505+0000","last_clean":"2024-03-04T13:00:39.595505+0000","last_became_active":"2024-03-04T12:36:13.348999+0000","last_became_peered":"2024-03-04T12:36:13.348999+0000","last_unstale":"2024-03-04T13:00:39.595505+0000","last_undegraded":"2024-03-04T13:00:39.595505+0000","last_fullsized":"2024-03-04T13:00:39.595505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.595386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.595386+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.595386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:30.057599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"256'99","reported_seq":578,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.668602+0000","last_change":"2024-03-04T13:00:28.668630+0000","last_active":"2024-03-04T13:00:28.668602+0000","last_peered":"2024-03-04T13:00:28.668602+0000","last_clean":"2024-03-04T13:00:28.668602+0000","last_became_active":"2024-03-04T12:36:15.359732+0000","last_became_peered":"2024-03-04T12:36:15.359732+0000","last_unstale":"2024-03-04T13:00:28.668602+0000","last_undegraded":"2024-03-04T13:00:28.668602+0000","last_fullsized":"2024-03-04T13:00:28.668602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'99","last_scrub_stamp":"2024-03-04T13:00:28.668521+0000","last_deep_scrub":"256'99","last_deep_scrub_stamp":"2024-03-04T13:00:28.668521+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.668521+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:02:41.542443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"256'881","reported_seq":2445,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.087249+0000","last_change":"2024-03-04T13:00:48.087249+0000","last_active":"2024-03-04T13:00:48.087249+0000","last_peered":"2024-03-04T13:00:48.087249+0000","last_clean":"2024-03-04T13:00:48.087249+0000","last_became_active":"2024-03-04T12:36:07.298999+0000","last_became_peered":"2024-03-04T12:36:07.298999+0000","last_unstale":"2024-03-04T13:00:48.087249+0000","last_undegraded":"2024-03-04T13:00:48.087249+0000","last_fullsized":"2024-03-04T13:00:48.087249+0000","mapping_epoch":22,"log_start":"256'800","ondisk_log_start":"256'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'881","last_scrub_stamp":"2024-03-04T13:00:48.087084+0000","last_deep_scrub":"256'881","last_deep_scrub_stamp":"2024-03-04T13:00:48.087084+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.087084+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:59:30.969925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4068,"num_read_kb":3596,"num_write":1224,"num_write_kb":497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2629,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"256'355","reported_seq":964,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.773041+0000","last_change":"2024-03-04T13:00:53.773128+0000","last_active":"2024-03-04T13:00:53.773041+0000","last_peered":"2024-03-04T13:00:53.773041+0000","last_clean":"2024-03-04T13:00:53.773041+0000","last_became_active":"2024-03-04T12:36:05.289486+0000","last_became_peered":"2024-03-04T12:36:05.289486+0000","last_unstale":"2024-03-04T13:00:53.773041+0000","last_undegraded":"2024-03-04T13:00:53.773041+0000","last_fullsized":"2024-03-04T13:00:53.773041+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'355","last_scrub_stamp":"2024-03-04T13:00:53.772924+0000","last_deep_scrub":"256'355","last_deep_scrub_stamp":"2024-03-04T13:00:53.772924+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.772924+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:02:41.336959+0000","scrub_duration":117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456599,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":441,"num_read_kb":48705,"num_write":1317,"num_write_kb":64123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":488,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.384771+0000","last_change":"2024-03-04T13:00:38.384771+0000","last_active":"2024-03-04T13:00:38.384771+0000","last_peered":"2024-03-04T13:00:38.384771+0000","last_clean":"2024-03-04T13:00:38.384771+0000","last_became_active":"2024-03-04T12:36:09.305880+0000","last_became_peered":"2024-03-04T12:36:09.305880+0000","last_unstale":"2024-03-04T13:00:38.384771+0000","last_undegraded":"2024-03-04T13:00:38.384771+0000","last_fullsized":"2024-03-04T13:00:38.384771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:38.384641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:38.384641+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.384641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:47.356519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"256'271","reported_seq":833,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:26.267303+0000","last_change":"2024-03-04T13:00:26.267303+0000","last_active":"2024-03-04T13:00:26.267303+0000","last_peered":"2024-03-04T13:00:26.267303+0000","last_clean":"2024-03-04T13:00:26.267303+0000","last_became_active":"2024-03-04T12:36:11.327499+0000","last_became_peered":"2024-03-04T12:36:11.327499+0000","last_unstale":"2024-03-04T13:00:26.267303+0000","last_undegraded":"2024-03-04T13:00:26.267303+0000","last_fullsized":"2024-03-04T13:00:26.267303+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'271","last_scrub_stamp":"2024-03-04T13:00:26.267170+0000","last_deep_scrub":"256'271","last_deep_scrub_stamp":"2024-03-04T13:00:26.267170+0000","last_clean_scrub_stamp":"2024-03-04T13:00:26.267170+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:41:13.037206+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48450,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":440,"num_read_kb":1012,"num_write":358,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"256'478","reported_seq":1636,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:23.208567+0000","last_change":"2024-03-04T13:00:23.208567+0000","last_active":"2024-03-04T13:00:23.208567+0000","last_peered":"2024-03-04T13:00:23.208567+0000","last_clean":"2024-03-04T13:00:23.208567+0000","last_became_active":"2024-03-04T12:36:13.337817+0000","last_became_peered":"2024-03-04T12:36:13.337817+0000","last_unstale":"2024-03-04T13:00:23.208567+0000","last_undegraded":"2024-03-04T13:00:23.208567+0000","last_fullsized":"2024-03-04T13:00:23.208567+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'478","last_scrub_stamp":"2024-03-04T13:00:23.208470+0000","last_deep_scrub":"256'478","last_deep_scrub_stamp":"2024-03-04T13:00:23.208470+0000","last_clean_scrub_stamp":"2024-03-04T13:00:23.208470+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:45.708499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"256'98","reported_seq":580,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.397876+0000","last_change":"2024-03-04T13:00:32.397876+0000","last_active":"2024-03-04T13:00:32.397876+0000","last_peered":"2024-03-04T13:00:32.397876+0000","last_clean":"2024-03-04T13:00:32.397876+0000","last_became_active":"2024-03-04T12:36:15.348869+0000","last_became_peered":"2024-03-04T12:36:15.348869+0000","last_unstale":"2024-03-04T13:00:32.397876+0000","last_undegraded":"2024-03-04T13:00:32.397876+0000","last_fullsized":"2024-03-04T13:00:32.397876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'98","last_scrub_stamp":"2024-03-04T13:00:32.397750+0000","last_deep_scrub":"256'98","last_deep_scrub_stamp":"2024-03-04T13:00:32.397750+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.397750+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:30.191883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":240,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"256'412","reported_seq":1963,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.018782+0000","last_change":"2024-03-04T13:00:53.018782+0000","last_active":"2024-03-04T13:00:53.018782+0000","last_peered":"2024-03-04T13:00:53.018782+0000","last_clean":"2024-03-04T13:00:53.018782+0000","last_became_active":"2024-03-04T12:36:07.293586+0000","last_became_peered":"2024-03-04T12:36:07.293586+0000","last_unstale":"2024-03-04T13:00:53.018782+0000","last_undegraded":"2024-03-04T13:00:53.018782+0000","last_fullsized":"2024-03-04T13:00:53.018782+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'412","last_scrub_stamp":"2024-03-04T13:00:53.018659+0000","last_deep_scrub":"256'412","last_deep_scrub_stamp":"2024-03-04T13:00:53.018659+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.018659+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:50:33.410647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2259,"num_read_kb":2143,"num_write":486,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"256'342","reported_seq":958,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.063706+0000","last_change":"2024-03-04T13:00:59.063759+0000","last_active":"2024-03-04T13:00:59.063706+0000","last_peered":"2024-03-04T13:00:59.063706+0000","last_clean":"2024-03-04T13:00:59.063706+0000","last_became_active":"2024-03-04T12:36:05.288036+0000","last_became_peered":"2024-03-04T12:36:05.288036+0000","last_unstale":"2024-03-04T13:00:59.063706+0000","last_undegraded":"2024-03-04T13:00:59.063706+0000","last_fullsized":"2024-03-04T13:00:59.063706+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'342","last_scrub_stamp":"2024-03-04T13:00:59.063618+0000","last_deep_scrub":"256'342","last_deep_scrub_stamp":"2024-03-04T13:00:59.063618+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.063618+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:00.285309+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194343,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":10713,"num_write":1310,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"256'4","reported_seq":1100,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.211260+0000","last_change":"2024-03-04T13:00:52.211260+0000","last_active":"2024-03-04T13:00:52.211260+0000","last_peered":"2024-03-04T13:00:52.211260+0000","last_clean":"2024-03-04T13:00:52.211260+0000","last_became_active":"2024-03-04T12:36:09.314474+0000","last_became_peered":"2024-03-04T12:36:09.314474+0000","last_unstale":"2024-03-04T13:00:52.211260+0000","last_undegraded":"2024-03-04T13:00:52.211260+0000","last_fullsized":"2024-03-04T13:00:52.211260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:52.211145+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:52.211145+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.211145+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:02:09.880121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":612,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"256'55","reported_seq":551,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.649548+0000","last_change":"2024-03-04T13:00:44.649548+0000","last_active":"2024-03-04T13:00:44.649548+0000","last_peered":"2024-03-04T13:00:44.649548+0000","last_clean":"2024-03-04T13:00:44.649548+0000","last_became_active":"2024-03-04T12:36:11.954508+0000","last_became_peered":"2024-03-04T12:36:11.954508+0000","last_unstale":"2024-03-04T13:00:44.649548+0000","last_undegraded":"2024-03-04T13:00:44.649548+0000","last_fullsized":"2024-03-04T13:00:44.649548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'55","last_scrub_stamp":"2024-03-04T13:00:44.649433+0000","last_deep_scrub":"256'55","last_deep_scrub_stamp":"2024-03-04T13:00:44.649433+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.649433+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:35:51.668769+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"256'482","reported_seq":1507,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.725817+0000","last_change":"2024-03-04T13:00:34.725817+0000","last_active":"2024-03-04T13:00:34.725817+0000","last_peered":"2024-03-04T13:00:34.725817+0000","last_clean":"2024-03-04T13:00:34.725817+0000","last_became_active":"2024-03-04T12:36:13.342902+0000","last_became_peered":"2024-03-04T12:36:13.342902+0000","last_unstale":"2024-03-04T13:00:34.725817+0000","last_undegraded":"2024-03-04T13:00:34.725817+0000","last_fullsized":"2024-03-04T13:00:34.725817+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'482","last_scrub_stamp":"2024-03-04T13:00:34.725632+0000","last_deep_scrub":"256'482","last_deep_scrub_stamp":"2024-03-04T13:00:34.725632+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.725632+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:32:27.798918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"256'94","reported_seq":578,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.163768+0000","last_change":"2024-03-04T13:00:29.163768+0000","last_active":"2024-03-04T13:00:29.163768+0000","last_peered":"2024-03-04T13:00:29.163768+0000","last_clean":"2024-03-04T13:00:29.163768+0000","last_became_active":"2024-03-04T12:36:15.352420+0000","last_became_peered":"2024-03-04T12:36:15.352420+0000","last_unstale":"2024-03-04T13:00:29.163768+0000","last_undegraded":"2024-03-04T13:00:29.163768+0000","last_fullsized":"2024-03-04T13:00:29.163768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'94","last_scrub_stamp":"2024-03-04T13:00:29.163620+0000","last_deep_scrub":"256'94","last_deep_scrub_stamp":"2024-03-04T13:00:29.163620+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.163620+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:10.290561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":79,"num_write":205,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"256'1080","reported_seq":2464,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.358804+0000","last_change":"2024-03-04T13:00:37.358804+0000","last_active":"2024-03-04T13:00:37.358804+0000","last_peered":"2024-03-04T13:00:37.358804+0000","last_clean":"2024-03-04T13:00:37.358804+0000","last_became_active":"2024-03-04T12:36:07.304123+0000","last_became_peered":"2024-03-04T12:36:07.304123+0000","last_unstale":"2024-03-04T13:00:37.358804+0000","last_undegraded":"2024-03-04T13:00:37.358804+0000","last_fullsized":"2024-03-04T13:00:37.358804+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1080","last_scrub_stamp":"2024-03-04T13:00:37.358634+0000","last_deep_scrub":"256'1080","last_deep_scrub_stamp":"2024-03-04T13:00:37.358634+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.358634+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":1000,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:25:48.734892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4358,"num_read_kb":3794,"num_write":1486,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'371","reported_seq":1004,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:10.439010+0000","last_change":"2024-03-04T13:01:10.439092+0000","last_active":"2024-03-04T13:01:10.439010+0000","last_peered":"2024-03-04T13:01:10.439010+0000","last_clean":"2024-03-04T13:01:10.439010+0000","last_became_active":"2024-03-04T12:36:05.286442+0000","last_became_peered":"2024-03-04T12:36:05.286442+0000","last_unstale":"2024-03-04T13:01:10.439010+0000","last_undegraded":"2024-03-04T13:01:10.439010+0000","last_fullsized":"2024-03-04T13:01:10.439010+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'371","last_scrub_stamp":"2024-03-04T13:01:10.438900+0000","last_deep_scrub":"256'371","last_deep_scrub_stamp":"2024-03-04T13:01:10.438900+0000","last_clean_scrub_stamp":"2024-03-04T13:01:10.438900+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:09:52.222245+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":497,"num_read_kb":22844,"num_write":1305,"num_write_kb":40494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:05.884930+0000","last_change":"2024-03-04T13:01:05.884961+0000","last_active":"2024-03-04T13:01:05.884930+0000","last_peered":"2024-03-04T13:01:05.884930+0000","last_clean":"2024-03-04T13:01:05.884930+0000","last_became_active":"2024-03-04T12:36:09.314671+0000","last_became_peered":"2024-03-04T12:36:09.314671+0000","last_unstale":"2024-03-04T13:01:05.884930+0000","last_undegraded":"2024-03-04T13:01:05.884930+0000","last_fullsized":"2024-03-04T13:01:05.884930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:05.884826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:05.884826+0000","last_clean_scrub_stamp":"2024-03-04T13:01:05.884826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:41:37.113803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"256'299","reported_seq":876,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.182629+0000","last_change":"2024-03-04T13:00:56.182710+0000","last_active":"2024-03-04T13:00:56.182629+0000","last_peered":"2024-03-04T13:00:56.182629+0000","last_clean":"2024-03-04T13:00:56.182629+0000","last_became_active":"2024-03-04T12:36:11.325372+0000","last_became_peered":"2024-03-04T12:36:11.325372+0000","last_unstale":"2024-03-04T13:00:56.182629+0000","last_undegraded":"2024-03-04T13:00:56.182629+0000","last_fullsized":"2024-03-04T13:00:56.182629+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'299","last_scrub_stamp":"2024-03-04T13:00:56.182525+0000","last_deep_scrub":"256'299","last_deep_scrub_stamp":"2024-03-04T13:00:56.182525+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.182525+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:34.592405+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47142,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1045,"num_read_kb":1555,"num_write":1526,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476198,"num_omap_keys":1104,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.746192+0000","last_change":"2024-03-04T13:00:40.746192+0000","last_active":"2024-03-04T13:00:40.746192+0000","last_peered":"2024-03-04T13:00:40.746192+0000","last_clean":"2024-03-04T13:00:40.746192+0000","last_became_active":"2024-03-04T12:36:13.348998+0000","last_became_peered":"2024-03-04T12:36:13.348998+0000","last_unstale":"2024-03-04T13:00:40.746192+0000","last_undegraded":"2024-03-04T13:00:40.746192+0000","last_fullsized":"2024-03-04T13:00:40.746192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.746068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.746068+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.746068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:09.551212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"256'117","reported_seq":607,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.417352+0000","last_change":"2024-03-04T13:00:29.417352+0000","last_active":"2024-03-04T13:00:29.417352+0000","last_peered":"2024-03-04T13:00:29.417352+0000","last_clean":"2024-03-04T13:00:29.417352+0000","last_became_active":"2024-03-04T12:36:15.362792+0000","last_became_peered":"2024-03-04T12:36:15.362792+0000","last_unstale":"2024-03-04T13:00:29.417352+0000","last_undegraded":"2024-03-04T13:00:29.417352+0000","last_fullsized":"2024-03-04T13:00:29.417352+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'117","last_scrub_stamp":"2024-03-04T13:00:29.417189+0000","last_deep_scrub":"256'117","last_deep_scrub_stamp":"2024-03-04T13:00:29.417189+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.417189+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:57.741359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":132,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"256'319","reported_seq":1687,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.785872+0000","last_change":"2024-03-04T13:00:43.785872+0000","last_active":"2024-03-04T13:00:43.785872+0000","last_peered":"2024-03-04T13:00:43.785872+0000","last_clean":"2024-03-04T13:00:43.785872+0000","last_became_active":"2024-03-04T12:36:07.299952+0000","last_became_peered":"2024-03-04T12:36:07.299952+0000","last_unstale":"2024-03-04T13:00:43.785872+0000","last_undegraded":"2024-03-04T13:00:43.785872+0000","last_fullsized":"2024-03-04T13:00:43.785872+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'319","last_scrub_stamp":"2024-03-04T13:00:43.785742+0000","last_deep_scrub":"256'319","last_deep_scrub_stamp":"2024-03-04T13:00:43.785742+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.785742+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:17.256676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1855,"num_read_kb":1767,"num_write":364,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1113,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"256'119","reported_seq":660,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.267408+0000","last_change":"2024-03-04T13:01:01.267485+0000","last_active":"2024-03-04T13:01:01.267408+0000","last_peered":"2024-03-04T13:01:01.267408+0000","last_clean":"2024-03-04T13:01:01.267408+0000","last_became_active":"2024-03-04T12:35:47.950213+0000","last_became_peered":"2024-03-04T12:35:47.950213+0000","last_unstale":"2024-03-04T13:01:01.267408+0000","last_undegraded":"2024-03-04T13:01:01.267408+0000","last_fullsized":"2024-03-04T13:01:01.267408+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'119","last_scrub_stamp":"2024-03-04T13:01:01.267303+0000","last_deep_scrub":"256'119","last_deep_scrub_stamp":"2024-03-04T13:01:01.267303+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.267303+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:02:38.945823+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":499,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.188399+0000","last_change":"2024-03-04T13:00:58.188421+0000","last_active":"2024-03-04T13:00:58.188399+0000","last_peered":"2024-03-04T13:00:58.188399+0000","last_clean":"2024-03-04T13:00:58.188399+0000","last_became_active":"2024-03-04T12:35:54.234819+0000","last_became_peered":"2024-03-04T12:35:54.234819+0000","last_unstale":"2024-03-04T13:00:58.188399+0000","last_undegraded":"2024-03-04T13:00:58.188399+0000","last_fullsized":"2024-03-04T13:00:58.188399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:58.188275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:58.188275+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.188275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:43:54.039632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"256'316","reported_seq":935,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.546940+0000","last_change":"2024-03-04T13:01:03.546940+0000","last_active":"2024-03-04T13:01:03.546940+0000","last_peered":"2024-03-04T13:01:03.546940+0000","last_clean":"2024-03-04T13:01:03.546940+0000","last_became_active":"2024-03-04T12:36:05.296783+0000","last_became_peered":"2024-03-04T12:36:05.296783+0000","last_unstale":"2024-03-04T13:01:03.546940+0000","last_undegraded":"2024-03-04T13:01:03.546940+0000","last_fullsized":"2024-03-04T13:01:03.546940+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'316","last_scrub_stamp":"2024-03-04T13:01:03.546803+0000","last_deep_scrub":"256'316","last_deep_scrub_stamp":"2024-03-04T13:01:03.546803+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.546803+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:27.606023+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":460,"num_read_kb":16805,"num_write":1147,"num_write_kb":27899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":488,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.282178+0000","last_change":"2024-03-04T13:00:51.282178+0000","last_active":"2024-03-04T13:00:51.282178+0000","last_peered":"2024-03-04T13:00:51.282178+0000","last_clean":"2024-03-04T13:00:51.282178+0000","last_became_active":"2024-03-04T12:36:09.306398+0000","last_became_peered":"2024-03-04T12:36:09.306398+0000","last_unstale":"2024-03-04T13:00:51.282178+0000","last_undegraded":"2024-03-04T13:00:51.282178+0000","last_fullsized":"2024-03-04T13:00:51.282178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:51.282015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:51.282015+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.282015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:22.916364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"256'664","reported_seq":1348,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.333621+0000","last_change":"2024-03-04T13:00:41.333662+0000","last_active":"2024-03-04T13:00:41.333621+0000","last_peered":"2024-03-04T13:00:41.333621+0000","last_clean":"2024-03-04T13:00:41.333621+0000","last_became_active":"2024-03-04T12:36:11.327652+0000","last_became_peered":"2024-03-04T12:36:11.327652+0000","last_unstale":"2024-03-04T13:00:41.333621+0000","last_undegraded":"2024-03-04T13:00:41.333621+0000","last_fullsized":"2024-03-04T13:00:41.333621+0000","mapping_epoch":26,"log_start":"256'600","ondisk_log_start":"256'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'664","last_scrub_stamp":"2024-03-04T13:00:41.333537+0000","last_deep_scrub":"256'664","last_deep_scrub_stamp":"2024-03-04T13:00:41.333537+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.333537+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:37.486661+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140555,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1295,"num_read_kb":2979,"num_write":1188,"num_write_kb":1057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89476,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":473,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.466652+0000","last_change":"2024-03-04T13:00:44.466699+0000","last_active":"2024-03-04T13:00:44.466652+0000","last_peered":"2024-03-04T13:00:44.466652+0000","last_clean":"2024-03-04T13:00:44.466652+0000","last_became_active":"2024-03-04T12:36:13.341629+0000","last_became_peered":"2024-03-04T12:36:13.341629+0000","last_unstale":"2024-03-04T13:00:44.466652+0000","last_undegraded":"2024-03-04T13:00:44.466652+0000","last_fullsized":"2024-03-04T13:00:44.466652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:44.466543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:44.466543+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.466543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:58.569289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"256'96","reported_seq":581,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.797113+0000","last_change":"2024-03-04T13:00:46.797172+0000","last_active":"2024-03-04T13:00:46.797113+0000","last_peered":"2024-03-04T13:00:46.797113+0000","last_clean":"2024-03-04T13:00:46.797113+0000","last_became_active":"2024-03-04T12:36:15.363355+0000","last_became_peered":"2024-03-04T12:36:15.363355+0000","last_unstale":"2024-03-04T13:00:46.797113+0000","last_undegraded":"2024-03-04T13:00:46.797113+0000","last_fullsized":"2024-03-04T13:00:46.797113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'96","last_scrub_stamp":"2024-03-04T13:00:46.797000+0000","last_deep_scrub":"256'96","last_deep_scrub_stamp":"2024-03-04T13:00:46.797000+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.797000+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:12:15.727811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"256'354","reported_seq":1797,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.447743+0000","last_change":"2024-03-04T13:00:51.447772+0000","last_active":"2024-03-04T13:00:51.447743+0000","last_peered":"2024-03-04T13:00:51.447743+0000","last_clean":"2024-03-04T13:00:51.447743+0000","last_became_active":"2024-03-04T12:36:07.301706+0000","last_became_peered":"2024-03-04T12:36:07.301706+0000","last_unstale":"2024-03-04T13:00:51.447743+0000","last_undegraded":"2024-03-04T13:00:51.447743+0000","last_fullsized":"2024-03-04T13:00:51.447743+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'354","last_scrub_stamp":"2024-03-04T13:00:51.447652+0000","last_deep_scrub":"256'354","last_deep_scrub_stamp":"2024-03-04T13:00:51.447652+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.447652+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:01:03.325657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2015,"num_read_kb":1927,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":502,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.250193+0000","last_change":"2024-03-04T13:01:02.250239+0000","last_active":"2024-03-04T13:01:02.250193+0000","last_peered":"2024-03-04T13:01:02.250193+0000","last_clean":"2024-03-04T13:01:02.250193+0000","last_became_active":"2024-03-04T12:35:54.238351+0000","last_became_peered":"2024-03-04T12:35:54.238351+0000","last_unstale":"2024-03-04T13:01:02.250193+0000","last_undegraded":"2024-03-04T13:01:02.250193+0000","last_fullsized":"2024-03-04T13:01:02.250193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:02.250113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:02.250113+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.250113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:03:15.242833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"256'391","reported_seq":1065,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:08.434367+0000","last_change":"2024-03-04T13:01:08.434420+0000","last_active":"2024-03-04T13:01:08.434367+0000","last_peered":"2024-03-04T13:01:08.434367+0000","last_clean":"2024-03-04T13:01:08.434367+0000","last_became_active":"2024-03-04T12:36:05.285659+0000","last_became_peered":"2024-03-04T12:36:05.285659+0000","last_unstale":"2024-03-04T13:01:08.434367+0000","last_undegraded":"2024-03-04T13:01:08.434367+0000","last_fullsized":"2024-03-04T13:01:08.434367+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'391","last_scrub_stamp":"2024-03-04T13:01:08.434277+0000","last_deep_scrub":"256'391","last_deep_scrub_stamp":"2024-03-04T13:01:08.434277+0000","last_clean_scrub_stamp":"2024-03-04T13:01:08.434277+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:55.601176+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2160246,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":21923,"num_write":1294,"num_write_kb":32530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.208898+0000","last_change":"2024-03-04T13:00:50.208920+0000","last_active":"2024-03-04T13:00:50.208898+0000","last_peered":"2024-03-04T13:00:50.208898+0000","last_clean":"2024-03-04T13:00:50.208898+0000","last_became_active":"2024-03-04T12:36:09.314113+0000","last_became_peered":"2024-03-04T12:36:09.314113+0000","last_unstale":"2024-03-04T13:00:50.208898+0000","last_undegraded":"2024-03-04T13:00:50.208898+0000","last_fullsized":"2024-03-04T13:00:50.208898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:50.208809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:50.208809+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.208809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:28.234707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"256'1026","reported_seq":2150,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:46.444407+0000","last_change":"2024-03-04T13:00:46.444407+0000","last_active":"2024-03-04T13:00:46.444407+0000","last_peered":"2024-03-04T13:00:46.444407+0000","last_clean":"2024-03-04T13:00:46.444407+0000","last_became_active":"2024-03-04T12:36:11.323543+0000","last_became_peered":"2024-03-04T12:36:11.323543+0000","last_unstale":"2024-03-04T13:00:46.444407+0000","last_undegraded":"2024-03-04T13:00:46.444407+0000","last_fullsized":"2024-03-04T13:00:46.444407+0000","mapping_epoch":26,"log_start":"256'1000","ondisk_log_start":"256'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1026","last_scrub_stamp":"2024-03-04T13:00:46.444243+0000","last_deep_scrub":"256'1026","last_deep_scrub_stamp":"2024-03-04T13:00:46.444243+0000","last_clean_scrub_stamp":"2024-03-04T13:00:46.444243+0000","objects_scrubbed":11,"log_size":26,"log_dups_size":1000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:13:41.355661+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157019,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1614,"num_read_kb":3260,"num_write":972,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":480,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.288095+0000","last_change":"2024-03-04T13:00:40.288095+0000","last_active":"2024-03-04T13:00:40.288095+0000","last_peered":"2024-03-04T13:00:40.288095+0000","last_clean":"2024-03-04T13:00:40.288095+0000","last_became_active":"2024-03-04T12:36:13.339353+0000","last_became_peered":"2024-03-04T12:36:13.339353+0000","last_unstale":"2024-03-04T13:00:40.288095+0000","last_undegraded":"2024-03-04T13:00:40.288095+0000","last_fullsized":"2024-03-04T13:00:40.288095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.287960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.287960+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.287960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:16:46.922748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"256'147","reported_seq":643,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.399242+0000","last_change":"2024-03-04T13:00:33.399271+0000","last_active":"2024-03-04T13:00:33.399242+0000","last_peered":"2024-03-04T13:00:33.399242+0000","last_clean":"2024-03-04T13:00:33.399242+0000","last_became_active":"2024-03-04T12:36:15.346516+0000","last_became_peered":"2024-03-04T12:36:15.346516+0000","last_unstale":"2024-03-04T13:00:33.399242+0000","last_undegraded":"2024-03-04T13:00:33.399242+0000","last_fullsized":"2024-03-04T13:00:33.399242+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'147","last_scrub_stamp":"2024-03-04T13:00:33.399158+0000","last_deep_scrub":"256'147","last_deep_scrub_stamp":"2024-03-04T13:00:33.399158+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.399158+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:04.057962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":196,"num_read_kb":196,"num_write":318,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"256'399","reported_seq":1877,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.414666+0000","last_change":"2024-03-04T13:00:39.414706+0000","last_active":"2024-03-04T13:00:39.414666+0000","last_peered":"2024-03-04T13:00:39.414666+0000","last_clean":"2024-03-04T13:00:39.414666+0000","last_became_active":"2024-03-04T12:36:07.300039+0000","last_became_peered":"2024-03-04T12:36:07.300039+0000","last_unstale":"2024-03-04T13:00:39.414666+0000","last_undegraded":"2024-03-04T13:00:39.414666+0000","last_fullsized":"2024-03-04T13:00:39.414666+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'399","last_scrub_stamp":"2024-03-04T13:00:39.414579+0000","last_deep_scrub":"256'399","last_deep_scrub_stamp":"2024-03-04T13:00:39.414579+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.414579+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:09.710256+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2349,"num_read_kb":2220,"num_write":468,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":238,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":502,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.223911+0000","last_change":"2024-03-04T13:00:39.223911+0000","last_active":"2024-03-04T13:00:39.223911+0000","last_peered":"2024-03-04T13:00:39.223911+0000","last_clean":"2024-03-04T13:00:39.223911+0000","last_became_active":"2024-03-04T12:35:54.235738+0000","last_became_peered":"2024-03-04T12:35:54.235738+0000","last_unstale":"2024-03-04T13:00:39.223911+0000","last_undegraded":"2024-03-04T13:00:39.223911+0000","last_fullsized":"2024-03-04T13:00:39.223911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.223775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.223775+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.223775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:54:59.767057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"256'383","reported_seq":1280,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.407677+0000","last_change":"2024-03-04T13:00:54.407717+0000","last_active":"2024-03-04T13:00:54.407677+0000","last_peered":"2024-03-04T13:00:54.407677+0000","last_clean":"2024-03-04T13:00:54.407677+0000","last_became_active":"2024-03-04T12:36:05.274788+0000","last_became_peered":"2024-03-04T12:36:05.274788+0000","last_unstale":"2024-03-04T13:00:54.407677+0000","last_undegraded":"2024-03-04T13:00:54.407677+0000","last_fullsized":"2024-03-04T13:00:54.407677+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'383","last_scrub_stamp":"2024-03-04T13:00:54.407587+0000","last_deep_scrub":"256'383","last_deep_scrub_stamp":"2024-03-04T13:00:54.407587+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.407587+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:09:42.717881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069328,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1100,"num_read_kb":10802,"num_write":1447,"num_write_kb":39091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"256'2","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.318641+0000","last_change":"2024-03-04T13:00:30.318672+0000","last_active":"2024-03-04T13:00:30.318641+0000","last_peered":"2024-03-04T13:00:30.318641+0000","last_clean":"2024-03-04T13:00:30.318641+0000","last_became_active":"2024-03-04T12:36:09.315023+0000","last_became_peered":"2024-03-04T12:36:09.315023+0000","last_unstale":"2024-03-04T13:00:30.318641+0000","last_undegraded":"2024-03-04T13:00:30.318641+0000","last_fullsized":"2024-03-04T13:00:30.318641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:30.318544+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:30.318544+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.318544+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:46.009625+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"256'197","reported_seq":1011,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.322586+0000","last_change":"2024-03-04T13:00:44.322586+0000","last_active":"2024-03-04T13:00:44.322586+0000","last_peered":"2024-03-04T13:00:44.322586+0000","last_clean":"2024-03-04T13:00:44.322586+0000","last_became_active":"2024-03-04T12:36:11.954554+0000","last_became_peered":"2024-03-04T12:36:11.954554+0000","last_unstale":"2024-03-04T13:00:44.322586+0000","last_undegraded":"2024-03-04T13:00:44.322586+0000","last_fullsized":"2024-03-04T13:00:44.322586+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'197","last_scrub_stamp":"2024-03-04T13:00:44.322449+0000","last_deep_scrub":"256'197","last_deep_scrub_stamp":"2024-03-04T13:00:44.322449+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.322449+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:26:55.878031+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":107,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.457507+0000","last_change":"2024-03-04T13:00:47.457507+0000","last_active":"2024-03-04T13:00:47.457507+0000","last_peered":"2024-03-04T13:00:47.457507+0000","last_clean":"2024-03-04T13:00:47.457507+0000","last_became_active":"2024-03-04T12:36:13.338388+0000","last_became_peered":"2024-03-04T12:36:13.338388+0000","last_unstale":"2024-03-04T13:00:47.457507+0000","last_undegraded":"2024-03-04T13:00:47.457507+0000","last_fullsized":"2024-03-04T13:00:47.457507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:47.457344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:47.457344+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.457344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:51.534303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'194","reported_seq":694,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.827539+0000","last_change":"2024-03-04T13:00:33.827539+0000","last_active":"2024-03-04T13:00:33.827539+0000","last_peered":"2024-03-04T13:00:33.827539+0000","last_clean":"2024-03-04T13:00:33.827539+0000","last_became_active":"2024-03-04T12:36:15.353529+0000","last_became_peered":"2024-03-04T12:36:15.353529+0000","last_unstale":"2024-03-04T13:00:33.827539+0000","last_undegraded":"2024-03-04T13:00:33.827539+0000","last_fullsized":"2024-03-04T13:00:33.827539+0000","mapping_epoch":30,"log_start":"241'100","ondisk_log_start":"241'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'194","last_scrub_stamp":"2024-03-04T13:00:33.827362+0000","last_deep_scrub":"256'194","last_deep_scrub_stamp":"2024-03-04T13:00:33.827362+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.827362+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:43.745434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":292,"num_read_kb":316,"num_write":426,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"256'397","reported_seq":1836,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.407849+0000","last_change":"2024-03-04T13:00:45.407849+0000","last_active":"2024-03-04T13:00:45.407849+0000","last_peered":"2024-03-04T13:00:45.407849+0000","last_clean":"2024-03-04T13:00:45.407849+0000","last_became_active":"2024-03-04T12:36:07.298936+0000","last_became_peered":"2024-03-04T12:36:07.298936+0000","last_unstale":"2024-03-04T13:00:45.407849+0000","last_undegraded":"2024-03-04T13:00:45.407849+0000","last_fullsized":"2024-03-04T13:00:45.407849+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'397","last_scrub_stamp":"2024-03-04T13:00:45.407700+0000","last_deep_scrub":"256'397","last_deep_scrub_stamp":"2024-03-04T13:00:45.407700+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.407700+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:39.109200+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2152,"num_read_kb":2018,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":303,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":499,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.157814+0000","last_change":"2024-03-04T13:00:59.157861+0000","last_active":"2024-03-04T13:00:59.157814+0000","last_peered":"2024-03-04T13:00:59.157814+0000","last_clean":"2024-03-04T13:00:59.157814+0000","last_became_active":"2024-03-04T12:35:54.238357+0000","last_became_peered":"2024-03-04T12:35:54.238357+0000","last_unstale":"2024-03-04T13:00:59.157814+0000","last_undegraded":"2024-03-04T13:00:59.157814+0000","last_fullsized":"2024-03-04T13:00:59.157814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:59.157718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:59.157718+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.157718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:53:58.649409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"256'334","reported_seq":992,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.980439+0000","last_change":"2024-03-04T13:01:00.980439+0000","last_active":"2024-03-04T13:01:00.980439+0000","last_peered":"2024-03-04T13:01:00.980439+0000","last_clean":"2024-03-04T13:01:00.980439+0000","last_became_active":"2024-03-04T12:36:05.289374+0000","last_became_peered":"2024-03-04T12:36:05.289374+0000","last_unstale":"2024-03-04T13:01:00.980439+0000","last_undegraded":"2024-03-04T13:01:00.980439+0000","last_fullsized":"2024-03-04T13:01:00.980439+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'334","last_scrub_stamp":"2024-03-04T13:01:00.980244+0000","last_deep_scrub":"256'334","last_deep_scrub_stamp":"2024-03-04T13:01:00.980244+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.980244+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:41:14.403992+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007111,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":531,"num_read_kb":54492,"num_write":1276,"num_write_kb":39662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.442910+0000","last_change":"2024-03-04T13:00:50.442910+0000","last_active":"2024-03-04T13:00:50.442910+0000","last_peered":"2024-03-04T13:00:50.442910+0000","last_clean":"2024-03-04T13:00:50.442910+0000","last_became_active":"2024-03-04T12:36:09.304291+0000","last_became_peered":"2024-03-04T12:36:09.304291+0000","last_unstale":"2024-03-04T13:00:50.442910+0000","last_undegraded":"2024-03-04T13:00:50.442910+0000","last_fullsized":"2024-03-04T13:00:50.442910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:50.442748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:50.442748+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.442748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:31:23.711297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"256'88","reported_seq":602,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.668262+0000","last_change":"2024-03-04T13:00:45.668289+0000","last_active":"2024-03-04T13:00:45.668262+0000","last_peered":"2024-03-04T13:00:45.668262+0000","last_clean":"2024-03-04T13:00:45.668262+0000","last_became_active":"2024-03-04T12:36:11.325957+0000","last_became_peered":"2024-03-04T12:36:11.325957+0000","last_unstale":"2024-03-04T13:00:45.668262+0000","last_undegraded":"2024-03-04T13:00:45.668262+0000","last_fullsized":"2024-03-04T13:00:45.668262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'88","last_scrub_stamp":"2024-03-04T13:00:45.668192+0000","last_deep_scrub":"256'88","last_deep_scrub_stamp":"2024-03-04T13:00:45.668192+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.668192+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:10.706687+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":66,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1504,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.754977+0000","last_change":"2024-03-04T13:00:36.755000+0000","last_active":"2024-03-04T13:00:36.754977+0000","last_peered":"2024-03-04T13:00:36.754977+0000","last_clean":"2024-03-04T13:00:36.754977+0000","last_became_active":"2024-03-04T12:36:13.345547+0000","last_became_peered":"2024-03-04T12:36:13.345547+0000","last_unstale":"2024-03-04T13:00:36.754977+0000","last_undegraded":"2024-03-04T13:00:36.754977+0000","last_fullsized":"2024-03-04T13:00:36.754977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:36.754882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:36.754882+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.754882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:30:11.105892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"256'111","reported_seq":607,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.437171+0000","last_change":"2024-03-04T13:00:31.437195+0000","last_active":"2024-03-04T13:00:31.437171+0000","last_peered":"2024-03-04T13:00:31.437171+0000","last_clean":"2024-03-04T13:00:31.437171+0000","last_became_active":"2024-03-04T12:36:15.363185+0000","last_became_peered":"2024-03-04T12:36:15.363185+0000","last_unstale":"2024-03-04T13:00:31.437171+0000","last_undegraded":"2024-03-04T13:00:31.437171+0000","last_fullsized":"2024-03-04T13:00:31.437171+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'111","last_scrub_stamp":"2024-03-04T13:00:31.437082+0000","last_deep_scrub":"256'111","last_deep_scrub_stamp":"2024-03-04T13:00:31.437082+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.437082+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:45.642975+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":251,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"256'468","reported_seq":2021,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.430671+0000","last_change":"2024-03-04T13:00:49.430671+0000","last_active":"2024-03-04T13:00:49.430671+0000","last_peered":"2024-03-04T13:00:49.430671+0000","last_clean":"2024-03-04T13:00:49.430671+0000","last_became_active":"2024-03-04T12:36:07.296433+0000","last_became_peered":"2024-03-04T12:36:07.296433+0000","last_unstale":"2024-03-04T13:00:49.430671+0000","last_undegraded":"2024-03-04T13:00:49.430671+0000","last_fullsized":"2024-03-04T13:00:49.430671+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'468","last_scrub_stamp":"2024-03-04T13:00:49.430550+0000","last_deep_scrub":"256'468","last_deep_scrub_stamp":"2024-03-04T13:00:49.430550+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.430550+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:47:32.639732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2396,"num_read_kb":2259,"num_write":579,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"256'399","reported_seq":1062,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:27.531193+0000","last_change":"2024-03-04T13:00:27.531193+0000","last_active":"2024-03-04T13:00:27.531193+0000","last_peered":"2024-03-04T13:00:27.531193+0000","last_clean":"2024-03-04T13:00:27.531193+0000","last_became_active":"2024-03-04T12:36:40.965346+0000","last_became_peered":"2024-03-04T12:36:40.965346+0000","last_unstale":"2024-03-04T13:00:27.531193+0000","last_undegraded":"2024-03-04T13:00:27.531193+0000","last_fullsized":"2024-03-04T13:00:27.531193+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'399","last_scrub_stamp":"2024-03-04T13:00:27.531051+0000","last_deep_scrub":"256'399","last_deep_scrub_stamp":"2024-03-04T13:00:27.531051+0000","last_clean_scrub_stamp":"2024-03-04T13:00:27.531051+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:45:37.677827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":48879,"num_write":1467,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":503,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:53.381690+0000","last_change":"2024-03-04T13:00:53.381690+0000","last_active":"2024-03-04T13:00:53.381690+0000","last_peered":"2024-03-04T13:00:53.381690+0000","last_clean":"2024-03-04T13:00:53.381690+0000","last_became_active":"2024-03-04T12:35:54.470407+0000","last_became_peered":"2024-03-04T12:35:54.470407+0000","last_unstale":"2024-03-04T13:00:53.381690+0000","last_undegraded":"2024-03-04T13:00:53.381690+0000","last_fullsized":"2024-03-04T13:00:53.381690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:53.381569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:53.381569+0000","last_clean_scrub_stamp":"2024-03-04T13:00:53.381569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:59.668953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.498186+0000","last_change":"2024-03-04T13:00:54.498186+0000","last_active":"2024-03-04T13:00:54.498186+0000","last_peered":"2024-03-04T13:00:54.498186+0000","last_clean":"2024-03-04T13:00:54.498186+0000","last_became_active":"2024-03-04T12:36:09.308360+0000","last_became_peered":"2024-03-04T12:36:09.308360+0000","last_unstale":"2024-03-04T13:00:54.498186+0000","last_undegraded":"2024-03-04T13:00:54.498186+0000","last_fullsized":"2024-03-04T13:00:54.498186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:54.498073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:54.498073+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.498073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:18.124641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"256'497","reported_seq":1130,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:12.414640+0000","last_change":"2024-03-04T13:01:12.414688+0000","last_active":"2024-03-04T13:01:12.414640+0000","last_peered":"2024-03-04T13:01:12.414640+0000","last_clean":"2024-03-04T13:01:12.414640+0000","last_became_active":"2024-03-04T12:36:11.328923+0000","last_became_peered":"2024-03-04T12:36:11.328923+0000","last_unstale":"2024-03-04T13:01:12.414640+0000","last_undegraded":"2024-03-04T13:01:12.414640+0000","last_fullsized":"2024-03-04T13:01:12.414640+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'497","last_scrub_stamp":"2024-03-04T13:01:12.414550+0000","last_deep_scrub":"256'497","last_deep_scrub_stamp":"2024-03-04T13:01:12.414550+0000","last_clean_scrub_stamp":"2024-03-04T13:01:12.414550+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:39:28.858780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93633,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":843,"num_read_kb":1937,"num_write":680,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.115438+0000","last_change":"2024-03-04T13:00:31.115438+0000","last_active":"2024-03-04T13:00:31.115438+0000","last_peered":"2024-03-04T13:00:31.115438+0000","last_clean":"2024-03-04T13:00:31.115438+0000","last_became_active":"2024-03-04T12:36:13.346886+0000","last_became_peered":"2024-03-04T12:36:13.346886+0000","last_unstale":"2024-03-04T13:00:31.115438+0000","last_undegraded":"2024-03-04T13:00:31.115438+0000","last_fullsized":"2024-03-04T13:00:31.115438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:31.115320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:31.115320+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.115320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:25:44.557397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"256'95","reported_seq":584,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.588562+0000","last_change":"2024-03-04T13:00:37.588562+0000","last_active":"2024-03-04T13:00:37.588562+0000","last_peered":"2024-03-04T13:00:37.588562+0000","last_clean":"2024-03-04T13:00:37.588562+0000","last_became_active":"2024-03-04T12:36:15.350185+0000","last_became_peered":"2024-03-04T12:36:15.350185+0000","last_unstale":"2024-03-04T13:00:37.588562+0000","last_undegraded":"2024-03-04T13:00:37.588562+0000","last_fullsized":"2024-03-04T13:00:37.588562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'95","last_scrub_stamp":"2024-03-04T13:00:37.588450+0000","last_deep_scrub":"256'95","last_deep_scrub_stamp":"2024-03-04T13:00:37.588450+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.588450+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:31.645524+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":228,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"256'646","reported_seq":2018,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.458865+0000","last_change":"2024-03-04T13:00:57.458865+0000","last_active":"2024-03-04T13:00:57.458865+0000","last_peered":"2024-03-04T13:00:57.458865+0000","last_clean":"2024-03-04T13:00:57.458865+0000","last_became_active":"2024-03-04T12:36:07.296657+0000","last_became_peered":"2024-03-04T12:36:07.296657+0000","last_unstale":"2024-03-04T13:00:57.458865+0000","last_undegraded":"2024-03-04T13:00:57.458865+0000","last_fullsized":"2024-03-04T13:00:57.458865+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'646","last_scrub_stamp":"2024-03-04T13:00:57.458741+0000","last_deep_scrub":"256'646","last_deep_scrub_stamp":"2024-03-04T13:00:57.458741+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.458741+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":600,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:07.456998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3068,"num_read_kb":2828,"num_write":988,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"256'353","reported_seq":1036,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.432972+0000","last_change":"2024-03-04T13:00:55.432972+0000","last_active":"2024-03-04T13:00:55.432972+0000","last_peered":"2024-03-04T13:00:55.432972+0000","last_clean":"2024-03-04T13:00:55.432972+0000","last_became_active":"2024-03-04T12:36:05.275263+0000","last_became_peered":"2024-03-04T12:36:05.275263+0000","last_unstale":"2024-03-04T13:00:55.432972+0000","last_undegraded":"2024-03-04T13:00:55.432972+0000","last_fullsized":"2024-03-04T13:00:55.432972+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'353","last_scrub_stamp":"2024-03-04T13:00:55.432812+0000","last_deep_scrub":"256'353","last_deep_scrub_stamp":"2024-03-04T13:00:55.432812+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.432812+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:22:54.562917+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":637,"num_read_kb":62539,"num_write":1435,"num_write_kb":42561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":502,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.225563+0000","last_change":"2024-03-04T13:01:03.225581+0000","last_active":"2024-03-04T13:01:03.225563+0000","last_peered":"2024-03-04T13:01:03.225563+0000","last_clean":"2024-03-04T13:01:03.225563+0000","last_became_active":"2024-03-04T12:35:54.470620+0000","last_became_peered":"2024-03-04T12:35:54.470620+0000","last_unstale":"2024-03-04T13:01:03.225563+0000","last_undegraded":"2024-03-04T13:01:03.225563+0000","last_fullsized":"2024-03-04T13:01:03.225563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:03.225495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:03.225495+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.225495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:53.187584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.717113+0000","last_change":"2024-03-04T13:00:35.717113+0000","last_active":"2024-03-04T13:00:35.717113+0000","last_peered":"2024-03-04T13:00:35.717113+0000","last_clean":"2024-03-04T13:00:35.717113+0000","last_became_active":"2024-03-04T12:36:09.312135+0000","last_became_peered":"2024-03-04T12:36:09.312135+0000","last_unstale":"2024-03-04T13:00:35.717113+0000","last_undegraded":"2024-03-04T13:00:35.717113+0000","last_fullsized":"2024-03-04T13:00:35.717113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:35.716987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:35.716987+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.716987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:24.039129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"256'147","reported_seq":683,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.408264+0000","last_change":"2024-03-04T13:00:48.408264+0000","last_active":"2024-03-04T13:00:48.408264+0000","last_peered":"2024-03-04T13:00:48.408264+0000","last_clean":"2024-03-04T13:00:48.408264+0000","last_became_active":"2024-03-04T12:36:11.954579+0000","last_became_peered":"2024-03-04T12:36:11.954579+0000","last_unstale":"2024-03-04T13:00:48.408264+0000","last_undegraded":"2024-03-04T13:00:48.408264+0000","last_fullsized":"2024-03-04T13:00:48.408264+0000","mapping_epoch":26,"log_start":"256'100","ondisk_log_start":"256'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'147","last_scrub_stamp":"2024-03-04T13:00:48.408112+0000","last_deep_scrub":"256'147","last_deep_scrub_stamp":"2024-03-04T13:00:48.408112+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.408112+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:32.843468+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":130,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2634,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"256'546","reported_seq":4073,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.400731+0000","last_change":"2024-03-04T13:00:38.400757+0000","last_active":"2024-03-04T13:00:38.400731+0000","last_peered":"2024-03-04T13:00:38.400731+0000","last_clean":"2024-03-04T13:00:38.400731+0000","last_became_active":"2024-03-04T12:36:13.341957+0000","last_became_peered":"2024-03-04T12:36:13.341957+0000","last_unstale":"2024-03-04T13:00:38.400731+0000","last_undegraded":"2024-03-04T13:00:38.400731+0000","last_fullsized":"2024-03-04T13:00:38.400731+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'546","last_scrub_stamp":"2024-03-04T13:00:38.400627+0000","last_deep_scrub":"256'546","last_deep_scrub_stamp":"2024-03-04T13:00:38.400627+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.400627+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:17.663169+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"256'125","reported_seq":608,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.712845+0000","last_change":"2024-03-04T13:00:29.712845+0000","last_active":"2024-03-04T13:00:29.712845+0000","last_peered":"2024-03-04T13:00:29.712845+0000","last_clean":"2024-03-04T13:00:29.712845+0000","last_became_active":"2024-03-04T12:36:15.355291+0000","last_became_peered":"2024-03-04T12:36:15.355291+0000","last_unstale":"2024-03-04T13:00:29.712845+0000","last_undegraded":"2024-03-04T13:00:29.712845+0000","last_fullsized":"2024-03-04T13:00:29.712845+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'125","last_scrub_stamp":"2024-03-04T13:00:29.712708+0000","last_deep_scrub":"256'125","last_deep_scrub_stamp":"2024-03-04T13:00:29.712708+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.712708+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:28:17.484104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":125,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"256'744","reported_seq":2171,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.599131+0000","last_change":"2024-03-04T13:01:01.599160+0000","last_active":"2024-03-04T13:01:01.599131+0000","last_peered":"2024-03-04T13:01:01.599131+0000","last_clean":"2024-03-04T13:01:01.599131+0000","last_became_active":"2024-03-04T12:36:07.289884+0000","last_became_peered":"2024-03-04T12:36:07.289884+0000","last_unstale":"2024-03-04T13:01:01.599131+0000","last_undegraded":"2024-03-04T13:01:01.599131+0000","last_fullsized":"2024-03-04T13:01:01.599131+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'744","last_scrub_stamp":"2024-03-04T13:01:01.599044+0000","last_deep_scrub":"256'744","last_deep_scrub_stamp":"2024-03-04T13:01:01.599044+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.599044+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:41:58.842864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3351,"num_read_kb":2980,"num_write":997,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"256'325","reported_seq":940,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:14.393058+0000","last_change":"2024-03-04T13:01:14.393099+0000","last_active":"2024-03-04T13:01:14.393058+0000","last_peered":"2024-03-04T13:01:14.393058+0000","last_clean":"2024-03-04T13:01:14.393058+0000","last_became_active":"2024-03-04T12:36:05.291549+0000","last_became_peered":"2024-03-04T12:36:05.291549+0000","last_unstale":"2024-03-04T13:01:14.393058+0000","last_undegraded":"2024-03-04T13:01:14.393058+0000","last_fullsized":"2024-03-04T13:01:14.393058+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'325","last_scrub_stamp":"2024-03-04T13:01:14.392974+0000","last_deep_scrub":"256'325","last_deep_scrub_stamp":"2024-03-04T13:01:14.392974+0000","last_clean_scrub_stamp":"2024-03-04T13:01:14.392974+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:15:11.976004+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194348,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":36332,"num_write":1128,"num_write_kb":31175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":502,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.379640+0000","last_change":"2024-03-04T13:00:52.379665+0000","last_active":"2024-03-04T13:00:52.379640+0000","last_peered":"2024-03-04T13:00:52.379640+0000","last_clean":"2024-03-04T13:00:52.379640+0000","last_became_active":"2024-03-04T12:35:54.238802+0000","last_became_peered":"2024-03-04T12:35:54.238802+0000","last_unstale":"2024-03-04T13:00:52.379640+0000","last_undegraded":"2024-03-04T13:00:52.379640+0000","last_fullsized":"2024-03-04T13:00:52.379640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:52.379542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:52.379542+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.379542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:34.687702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.037943+0000","last_change":"2024-03-04T13:00:54.037943+0000","last_active":"2024-03-04T13:00:54.037943+0000","last_peered":"2024-03-04T13:00:54.037943+0000","last_clean":"2024-03-04T13:00:54.037943+0000","last_became_active":"2024-03-04T12:36:09.307467+0000","last_became_peered":"2024-03-04T12:36:09.307467+0000","last_unstale":"2024-03-04T13:00:54.037943+0000","last_undegraded":"2024-03-04T13:00:54.037943+0000","last_fullsized":"2024-03-04T13:00:54.037943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:54.037801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:54.037801+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.037801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:19.884437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"256'83","reported_seq":600,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.149599+0000","last_change":"2024-03-04T13:00:37.149599+0000","last_active":"2024-03-04T13:00:37.149599+0000","last_peered":"2024-03-04T13:00:37.149599+0000","last_clean":"2024-03-04T13:00:37.149599+0000","last_became_active":"2024-03-04T12:36:11.325955+0000","last_became_peered":"2024-03-04T12:36:11.325955+0000","last_unstale":"2024-03-04T13:00:37.149599+0000","last_undegraded":"2024-03-04T13:00:37.149599+0000","last_fullsized":"2024-03-04T13:00:37.149599+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'83","last_scrub_stamp":"2024-03-04T13:00:37.149473+0000","last_deep_scrub":"256'83","last_deep_scrub_stamp":"2024-03-04T13:00:37.149473+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.149473+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:46:01.882397+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":81,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"256'535","reported_seq":1577,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.796546+0000","last_change":"2024-03-04T13:00:36.796546+0000","last_active":"2024-03-04T13:00:36.796546+0000","last_peered":"2024-03-04T13:00:36.796546+0000","last_clean":"2024-03-04T13:00:36.796546+0000","last_became_active":"2024-03-04T12:36:13.349421+0000","last_became_peered":"2024-03-04T12:36:13.349421+0000","last_unstale":"2024-03-04T13:00:36.796546+0000","last_undegraded":"2024-03-04T13:00:36.796546+0000","last_fullsized":"2024-03-04T13:00:36.796546+0000","mapping_epoch":28,"log_start":"256'500","ondisk_log_start":"256'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'535","last_scrub_stamp":"2024-03-04T13:00:36.796431+0000","last_deep_scrub":"256'535","last_deep_scrub_stamp":"2024-03-04T13:00:36.796431+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.796431+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:02.418373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"256'96","reported_seq":575,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.623597+0000","last_change":"2024-03-04T13:00:35.623597+0000","last_active":"2024-03-04T13:00:35.623597+0000","last_peered":"2024-03-04T13:00:35.623597+0000","last_clean":"2024-03-04T13:00:35.623597+0000","last_became_active":"2024-03-04T12:36:15.356192+0000","last_became_peered":"2024-03-04T12:36:15.356192+0000","last_unstale":"2024-03-04T13:00:35.623597+0000","last_undegraded":"2024-03-04T13:00:35.623597+0000","last_fullsized":"2024-03-04T13:00:35.623597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'96","last_scrub_stamp":"2024-03-04T13:00:35.623431+0000","last_deep_scrub":"256'96","last_deep_scrub_stamp":"2024-03-04T13:00:35.623431+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.623431+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:27.378174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":232,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"256'392","reported_seq":1923,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.098548+0000","last_change":"2024-03-04T13:00:50.098548+0000","last_active":"2024-03-04T13:00:50.098548+0000","last_peered":"2024-03-04T13:00:50.098548+0000","last_clean":"2024-03-04T13:00:50.098548+0000","last_became_active":"2024-03-04T12:36:07.298963+0000","last_became_peered":"2024-03-04T12:36:07.298963+0000","last_unstale":"2024-03-04T13:00:50.098548+0000","last_undegraded":"2024-03-04T13:00:50.098548+0000","last_fullsized":"2024-03-04T13:00:50.098548+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'392","last_scrub_stamp":"2024-03-04T13:00:50.098367+0000","last_deep_scrub":"256'392","last_deep_scrub_stamp":"2024-03-04T13:00:50.098367+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.098367+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:40.850831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2258,"num_read_kb":2139,"num_write":463,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2158,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"256'326","reported_seq":945,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:05.482272+0000","last_change":"2024-03-04T13:01:05.482311+0000","last_active":"2024-03-04T13:01:05.482272+0000","last_peered":"2024-03-04T13:01:05.482272+0000","last_clean":"2024-03-04T13:01:05.482272+0000","last_became_active":"2024-03-04T12:36:05.281790+0000","last_became_peered":"2024-03-04T12:36:05.281790+0000","last_unstale":"2024-03-04T13:01:05.482272+0000","last_undegraded":"2024-03-04T13:01:05.482272+0000","last_fullsized":"2024-03-04T13:01:05.482272+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'326","last_scrub_stamp":"2024-03-04T13:01:05.482199+0000","last_deep_scrub":"256'326","last_deep_scrub_stamp":"2024-03-04T13:01:05.482199+0000","last_clean_scrub_stamp":"2024-03-04T13:01:05.482199+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:31:38.423448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1778947,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":33441,"num_write":1185,"num_write_kb":31732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":497,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.775121+0000","last_change":"2024-03-04T13:00:48.775160+0000","last_active":"2024-03-04T13:00:48.775121+0000","last_peered":"2024-03-04T13:00:48.775121+0000","last_clean":"2024-03-04T13:00:48.775121+0000","last_became_active":"2024-03-04T12:35:54.238580+0000","last_became_peered":"2024-03-04T12:35:54.238580+0000","last_unstale":"2024-03-04T13:00:48.775121+0000","last_undegraded":"2024-03-04T13:00:48.775121+0000","last_fullsized":"2024-03-04T13:00:48.775121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:48.774977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:48.774977+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.774977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:53.947435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":486,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.557863+0000","last_change":"2024-03-04T13:01:02.557885+0000","last_active":"2024-03-04T13:01:02.557863+0000","last_peered":"2024-03-04T13:01:02.557863+0000","last_clean":"2024-03-04T13:01:02.557863+0000","last_became_active":"2024-03-04T12:36:09.308162+0000","last_became_peered":"2024-03-04T12:36:09.308162+0000","last_unstale":"2024-03-04T13:01:02.557863+0000","last_undegraded":"2024-03-04T13:01:02.557863+0000","last_fullsized":"2024-03-04T13:01:02.557863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:02.557760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:02.557760+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.557760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:42.744856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"256'712","reported_seq":1409,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:09.216183+0000","last_change":"2024-03-04T13:01:09.216183+0000","last_active":"2024-03-04T13:01:09.216183+0000","last_peered":"2024-03-04T13:01:09.216183+0000","last_clean":"2024-03-04T13:01:09.216183+0000","last_became_active":"2024-03-04T12:36:11.954569+0000","last_became_peered":"2024-03-04T12:36:11.954569+0000","last_unstale":"2024-03-04T13:01:09.216183+0000","last_undegraded":"2024-03-04T13:01:09.216183+0000","last_fullsized":"2024-03-04T13:01:09.216183+0000","mapping_epoch":26,"log_start":"256'700","ondisk_log_start":"256'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'712","last_scrub_stamp":"2024-03-04T13:01:09.216044+0000","last_deep_scrub":"256'712","last_deep_scrub_stamp":"2024-03-04T13:01:09.216044+0000","last_clean_scrub_stamp":"2024-03-04T13:01:09.216044+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":700,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:23.788802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140875,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1277,"num_read_kb":3093,"num_write":1046,"num_write_kb":893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.718951+0000","last_change":"2024-03-04T13:00:40.718951+0000","last_active":"2024-03-04T13:00:40.718951+0000","last_peered":"2024-03-04T13:00:40.718951+0000","last_clean":"2024-03-04T13:00:40.718951+0000","last_became_active":"2024-03-04T12:36:13.345919+0000","last_became_peered":"2024-03-04T12:36:13.345919+0000","last_unstale":"2024-03-04T13:00:40.718951+0000","last_undegraded":"2024-03-04T13:00:40.718951+0000","last_fullsized":"2024-03-04T13:00:40.718951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.718799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.718799+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.718799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:41.971577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"256'130","reported_seq":603,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.410237+0000","last_change":"2024-03-04T13:00:34.410237+0000","last_active":"2024-03-04T13:00:34.410237+0000","last_peered":"2024-03-04T13:00:34.410237+0000","last_clean":"2024-03-04T13:00:34.410237+0000","last_became_active":"2024-03-04T12:36:15.362710+0000","last_became_peered":"2024-03-04T12:36:15.362710+0000","last_unstale":"2024-03-04T13:00:34.410237+0000","last_undegraded":"2024-03-04T13:00:34.410237+0000","last_fullsized":"2024-03-04T13:00:34.410237+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'130","last_scrub_stamp":"2024-03-04T13:00:34.410088+0000","last_deep_scrub":"256'130","last_deep_scrub_stamp":"2024-03-04T13:00:34.410088+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.410088+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:38.504413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":322,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"256'110","reported_seq":581,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.566210+0000","last_change":"2024-03-04T13:00:31.566210+0000","last_active":"2024-03-04T13:00:31.566210+0000","last_peered":"2024-03-04T13:00:31.566210+0000","last_clean":"2024-03-04T13:00:31.566210+0000","last_became_active":"2024-03-04T12:36:15.363057+0000","last_became_peered":"2024-03-04T12:36:15.363057+0000","last_unstale":"2024-03-04T13:00:31.566210+0000","last_undegraded":"2024-03-04T13:00:31.566210+0000","last_fullsized":"2024-03-04T13:00:31.566210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'110","last_scrub_stamp":"2024-03-04T13:00:31.566095+0000","last_deep_scrub":"256'110","last_deep_scrub_stamp":"2024-03-04T13:00:31.566095+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.566095+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:05:38.612505+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":263,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"256'522","reported_seq":2080,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.055992+0000","last_change":"2024-03-04T13:00:49.056032+0000","last_active":"2024-03-04T13:00:49.055992+0000","last_peered":"2024-03-04T13:00:49.055992+0000","last_clean":"2024-03-04T13:00:49.055992+0000","last_became_active":"2024-03-04T12:36:07.292930+0000","last_became_peered":"2024-03-04T12:36:07.292930+0000","last_unstale":"2024-03-04T13:00:49.055992+0000","last_undegraded":"2024-03-04T13:00:49.055992+0000","last_fullsized":"2024-03-04T13:00:49.055992+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'522","last_scrub_stamp":"2024-03-04T13:00:49.055892+0000","last_deep_scrub":"256'522","last_deep_scrub_stamp":"2024-03-04T13:00:49.055892+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.055892+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:28.787689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2723,"num_read_kb":2502,"num_write":698,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":218,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"256'330","reported_seq":975,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.058515+0000","last_change":"2024-03-04T13:00:58.058608+0000","last_active":"2024-03-04T13:00:58.058515+0000","last_peered":"2024-03-04T13:00:58.058515+0000","last_clean":"2024-03-04T13:00:58.058515+0000","last_became_active":"2024-03-04T12:36:05.287299+0000","last_became_peered":"2024-03-04T12:36:05.287299+0000","last_unstale":"2024-03-04T13:00:58.058515+0000","last_undegraded":"2024-03-04T13:00:58.058515+0000","last_fullsized":"2024-03-04T13:00:58.058515+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'330","last_scrub_stamp":"2024-03-04T13:00:58.058418+0000","last_deep_scrub":"256'330","last_deep_scrub_stamp":"2024-03-04T13:00:58.058418+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.058418+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:53.837362+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2779056,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":31884,"num_write":1263,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"256'4","reported_seq":798,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:42.367405+0000","last_change":"2024-03-04T13:00:42.367433+0000","last_active":"2024-03-04T13:00:42.367405+0000","last_peered":"2024-03-04T13:00:42.367405+0000","last_clean":"2024-03-04T13:00:42.367405+0000","last_became_active":"2024-03-04T12:36:09.314810+0000","last_became_peered":"2024-03-04T12:36:09.314810+0000","last_unstale":"2024-03-04T13:00:42.367405+0000","last_undegraded":"2024-03-04T13:00:42.367405+0000","last_fullsized":"2024-03-04T13:00:42.367405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-03-04T13:00:42.367302+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-03-04T13:00:42.367302+0000","last_clean_scrub_stamp":"2024-03-04T13:00:42.367302+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:56:47.240397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"256'251","reported_seq":804,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.664040+0000","last_change":"2024-03-04T13:00:48.664108+0000","last_active":"2024-03-04T13:00:48.664040+0000","last_peered":"2024-03-04T13:00:48.664040+0000","last_clean":"2024-03-04T13:00:48.664040+0000","last_became_active":"2024-03-04T12:36:11.323046+0000","last_became_peered":"2024-03-04T12:36:11.323046+0000","last_unstale":"2024-03-04T13:00:48.664040+0000","last_undegraded":"2024-03-04T13:00:48.664040+0000","last_fullsized":"2024-03-04T13:00:48.664040+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'251","last_scrub_stamp":"2024-03-04T13:00:48.663931+0000","last_deep_scrub":"256'251","last_deep_scrub_stamp":"2024-03-04T13:00:48.663931+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.663931+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:33:25.003667+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51487,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":943,"num_write":330,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":476,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.767813+0000","last_change":"2024-03-04T13:00:37.767846+0000","last_active":"2024-03-04T13:00:37.767813+0000","last_peered":"2024-03-04T13:00:37.767813+0000","last_clean":"2024-03-04T13:00:37.767813+0000","last_became_active":"2024-03-04T12:36:13.348696+0000","last_became_peered":"2024-03-04T12:36:13.348696+0000","last_unstale":"2024-03-04T13:00:37.767813+0000","last_undegraded":"2024-03-04T13:00:37.767813+0000","last_fullsized":"2024-03-04T13:00:37.767813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.767716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.767716+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.767716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:39.879058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"256'83","reported_seq":563,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.806585+0000","last_change":"2024-03-04T13:00:32.806636+0000","last_active":"2024-03-04T13:00:32.806585+0000","last_peered":"2024-03-04T13:00:32.806585+0000","last_clean":"2024-03-04T13:00:32.806585+0000","last_became_active":"2024-03-04T12:36:15.354258+0000","last_became_peered":"2024-03-04T12:36:15.354258+0000","last_unstale":"2024-03-04T13:00:32.806585+0000","last_undegraded":"2024-03-04T13:00:32.806585+0000","last_fullsized":"2024-03-04T13:00:32.806585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'83","last_scrub_stamp":"2024-03-04T13:00:32.806479+0000","last_deep_scrub":"256'83","last_deep_scrub_stamp":"2024-03-04T13:00:32.806479+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.806479+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:51:22.735435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":75,"num_write":188,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"256'356","reported_seq":1714,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.402045+0000","last_change":"2024-03-04T13:00:51.402077+0000","last_active":"2024-03-04T13:00:51.402045+0000","last_peered":"2024-03-04T13:00:51.402045+0000","last_clean":"2024-03-04T13:00:51.402045+0000","last_became_active":"2024-03-04T12:36:07.295803+0000","last_became_peered":"2024-03-04T12:36:07.295803+0000","last_unstale":"2024-03-04T13:00:51.402045+0000","last_undegraded":"2024-03-04T13:00:51.402045+0000","last_fullsized":"2024-03-04T13:00:51.402045+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'356","last_scrub_stamp":"2024-03-04T13:00:51.401953+0000","last_deep_scrub":"256'356","last_deep_scrub_stamp":"2024-03-04T13:00:51.401953+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.401953+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:06.068752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1867,"num_read_kb":1777,"num_write":399,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"256'341","reported_seq":965,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.279610+0000","last_change":"2024-03-04T13:00:56.279707+0000","last_active":"2024-03-04T13:00:56.279610+0000","last_peered":"2024-03-04T13:00:56.279610+0000","last_clean":"2024-03-04T13:00:56.279610+0000","last_became_active":"2024-03-04T12:36:05.296032+0000","last_became_peered":"2024-03-04T12:36:05.296032+0000","last_unstale":"2024-03-04T13:00:56.279610+0000","last_undegraded":"2024-03-04T13:00:56.279610+0000","last_fullsized":"2024-03-04T13:00:56.279610+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'341","last_scrub_stamp":"2024-03-04T13:00:56.279479+0000","last_deep_scrub":"256'341","last_deep_scrub_stamp":"2024-03-04T13:00:56.279479+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.279479+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:25:58.021440+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2492708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":28471,"num_write":1139,"num_write_kb":37420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:16.442219+0000","last_change":"2024-03-04T13:01:16.442252+0000","last_active":"2024-03-04T13:01:16.442219+0000","last_peered":"2024-03-04T13:01:16.442219+0000","last_clean":"2024-03-04T13:01:16.442219+0000","last_became_active":"2024-03-04T12:36:09.311953+0000","last_became_peered":"2024-03-04T12:36:09.311953+0000","last_unstale":"2024-03-04T13:01:16.442219+0000","last_undegraded":"2024-03-04T13:01:16.442219+0000","last_fullsized":"2024-03-04T13:01:16.442219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:16.442129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:16.442129+0000","last_clean_scrub_stamp":"2024-03-04T13:01:16.442129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:59:43.229448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"256'34","reported_seq":516,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.427415+0000","last_change":"2024-03-04T13:01:00.427455+0000","last_active":"2024-03-04T13:01:00.427415+0000","last_peered":"2024-03-04T13:01:00.427415+0000","last_clean":"2024-03-04T13:01:00.427415+0000","last_became_active":"2024-03-04T12:36:11.326313+0000","last_became_peered":"2024-03-04T12:36:11.326313+0000","last_unstale":"2024-03-04T13:01:00.427415+0000","last_undegraded":"2024-03-04T13:01:00.427415+0000","last_fullsized":"2024-03-04T13:01:00.427415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'34","last_scrub_stamp":"2024-03-04T13:01:00.427338+0000","last_deep_scrub":"256'34","last_deep_scrub_stamp":"2024-03-04T13:01:00.427338+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.427338+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:33:09.282435+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":478,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.235834+0000","last_change":"2024-03-04T13:00:37.235857+0000","last_active":"2024-03-04T13:00:37.235834+0000","last_peered":"2024-03-04T13:00:37.235834+0000","last_clean":"2024-03-04T13:00:37.235834+0000","last_became_active":"2024-03-04T12:36:13.340203+0000","last_became_peered":"2024-03-04T12:36:13.340203+0000","last_unstale":"2024-03-04T13:00:37.235834+0000","last_undegraded":"2024-03-04T13:00:37.235834+0000","last_fullsized":"2024-03-04T13:00:37.235834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.235747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.235747+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.235747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:37.493747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"256'90","reported_seq":574,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.583607+0000","last_change":"2024-03-04T13:00:36.583607+0000","last_active":"2024-03-04T13:00:36.583607+0000","last_peered":"2024-03-04T13:00:36.583607+0000","last_clean":"2024-03-04T13:00:36.583607+0000","last_became_active":"2024-03-04T12:36:15.353545+0000","last_became_peered":"2024-03-04T12:36:15.353545+0000","last_unstale":"2024-03-04T13:00:36.583607+0000","last_undegraded":"2024-03-04T13:00:36.583607+0000","last_fullsized":"2024-03-04T13:00:36.583607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'90","last_scrub_stamp":"2024-03-04T13:00:36.583455+0000","last_deep_scrub":"256'90","last_deep_scrub_stamp":"2024-03-04T13:00:36.583455+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.583455+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:57:03.167360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":106,"num_write":213,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"256'994","reported_seq":2552,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.661437+0000","last_change":"2024-03-04T13:00:54.661462+0000","last_active":"2024-03-04T13:00:54.661437+0000","last_peered":"2024-03-04T13:00:54.661437+0000","last_clean":"2024-03-04T13:00:54.661437+0000","last_became_active":"2024-03-04T12:36:07.299326+0000","last_became_peered":"2024-03-04T12:36:07.299326+0000","last_unstale":"2024-03-04T13:00:54.661437+0000","last_undegraded":"2024-03-04T13:00:54.661437+0000","last_fullsized":"2024-03-04T13:00:54.661437+0000","mapping_epoch":22,"log_start":"256'900","ondisk_log_start":"256'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'994","last_scrub_stamp":"2024-03-04T13:00:54.661340+0000","last_deep_scrub":"256'994","last_deep_scrub_stamp":"2024-03-04T13:00:54.661340+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.661340+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:21.655756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4343,"num_read_kb":3801,"num_write":1436,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"256'329","reported_seq":976,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.205823+0000","last_change":"2024-03-04T13:01:00.205887+0000","last_active":"2024-03-04T13:01:00.205823+0000","last_peered":"2024-03-04T13:01:00.205823+0000","last_clean":"2024-03-04T13:01:00.205823+0000","last_became_active":"2024-03-04T12:36:05.287185+0000","last_became_peered":"2024-03-04T12:36:05.287185+0000","last_unstale":"2024-03-04T13:01:00.205823+0000","last_undegraded":"2024-03-04T13:01:00.205823+0000","last_fullsized":"2024-03-04T13:01:00.205823+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'329","last_scrub_stamp":"2024-03-04T13:01:00.205728+0000","last_deep_scrub":"256'329","last_deep_scrub_stamp":"2024-03-04T13:01:00.205728+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.205728+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:01:05.983210+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730133,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":528,"num_read_kb":7345,"num_write":1182,"num_write_kb":36636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":486,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.339216+0000","last_change":"2024-03-04T13:00:47.339239+0000","last_active":"2024-03-04T13:00:47.339216+0000","last_peered":"2024-03-04T13:00:47.339216+0000","last_clean":"2024-03-04T13:00:47.339216+0000","last_became_active":"2024-03-04T12:36:09.305288+0000","last_became_peered":"2024-03-04T12:36:09.305288+0000","last_unstale":"2024-03-04T13:00:47.339216+0000","last_undegraded":"2024-03-04T13:00:47.339216+0000","last_fullsized":"2024-03-04T13:00:47.339216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:47.339124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:47.339124+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.339124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:03:14.121891+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"256'296","reported_seq":864,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.653476+0000","last_change":"2024-03-04T13:00:47.653514+0000","last_active":"2024-03-04T13:00:47.653476+0000","last_peered":"2024-03-04T13:00:47.653476+0000","last_clean":"2024-03-04T13:00:47.653476+0000","last_became_active":"2024-03-04T12:36:11.324758+0000","last_became_peered":"2024-03-04T12:36:11.324758+0000","last_unstale":"2024-03-04T13:00:47.653476+0000","last_undegraded":"2024-03-04T13:00:47.653476+0000","last_fullsized":"2024-03-04T13:00:47.653476+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'296","last_scrub_stamp":"2024-03-04T13:00:47.653383+0000","last_deep_scrub":"256'296","last_deep_scrub_stamp":"2024-03-04T13:00:47.653383+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.653383+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:52.144236+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":483,"num_read_kb":1065,"num_write":390,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:38.725145+0000","last_change":"2024-03-04T13:00:38.725169+0000","last_active":"2024-03-04T13:00:38.725145+0000","last_peered":"2024-03-04T13:00:38.725145+0000","last_clean":"2024-03-04T13:00:38.725145+0000","last_became_active":"2024-03-04T12:36:13.345556+0000","last_became_peered":"2024-03-04T12:36:13.345556+0000","last_unstale":"2024-03-04T13:00:38.725145+0000","last_undegraded":"2024-03-04T13:00:38.725145+0000","last_fullsized":"2024-03-04T13:00:38.725145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:38.725031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:38.725031+0000","last_clean_scrub_stamp":"2024-03-04T13:00:38.725031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:46.207626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"256'172","reported_seq":668,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.459299+0000","last_change":"2024-03-04T13:00:30.459299+0000","last_active":"2024-03-04T13:00:30.459299+0000","last_peered":"2024-03-04T13:00:30.459299+0000","last_clean":"2024-03-04T13:00:30.459299+0000","last_became_active":"2024-03-04T12:36:15.363544+0000","last_became_peered":"2024-03-04T12:36:15.363544+0000","last_unstale":"2024-03-04T13:00:30.459299+0000","last_undegraded":"2024-03-04T13:00:30.459299+0000","last_fullsized":"2024-03-04T13:00:30.459299+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'172","last_scrub_stamp":"2024-03-04T13:00:30.459143+0000","last_deep_scrub":"256'172","last_deep_scrub_stamp":"2024-03-04T13:00:30.459143+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.459143+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:00:31.537557+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":198,"num_write":386,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"256'403","reported_seq":1844,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.635123+0000","last_change":"2024-03-04T13:00:55.635173+0000","last_active":"2024-03-04T13:00:55.635123+0000","last_peered":"2024-03-04T13:00:55.635123+0000","last_clean":"2024-03-04T13:00:55.635123+0000","last_became_active":"2024-03-04T12:36:07.292814+0000","last_became_peered":"2024-03-04T12:36:07.292814+0000","last_unstale":"2024-03-04T13:00:55.635123+0000","last_undegraded":"2024-03-04T13:00:55.635123+0000","last_fullsized":"2024-03-04T13:00:55.635123+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'403","last_scrub_stamp":"2024-03-04T13:00:55.635023+0000","last_deep_scrub":"256'403","last_deep_scrub_stamp":"2024-03-04T13:00:55.635023+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.635023+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:57:31.355683+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2067,"num_read_kb":1953,"num_write":480,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"256'310","reported_seq":913,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:28.561357+0000","last_change":"2024-03-04T13:00:28.561406+0000","last_active":"2024-03-04T13:00:28.561357+0000","last_peered":"2024-03-04T13:00:28.561357+0000","last_clean":"2024-03-04T13:00:28.561357+0000","last_became_active":"2024-03-04T12:36:40.964989+0000","last_became_peered":"2024-03-04T12:36:40.964989+0000","last_unstale":"2024-03-04T13:00:28.561357+0000","last_undegraded":"2024-03-04T13:00:28.561357+0000","last_fullsized":"2024-03-04T13:00:28.561357+0000","mapping_epoch":33,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'310","last_scrub_stamp":"2024-03-04T13:00:28.561273+0000","last_deep_scrub":"256'310","last_deep_scrub_stamp":"2024-03-04T13:00:28.561273+0000","last_clean_scrub_stamp":"2024-03-04T13:00:28.561273+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:45:32.752696+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":22171,"num_write":1178,"num_write_kb":35457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.720495+0000","last_change":"2024-03-04T13:00:37.720522+0000","last_active":"2024-03-04T13:00:37.720495+0000","last_peered":"2024-03-04T13:00:37.720495+0000","last_clean":"2024-03-04T13:00:37.720495+0000","last_became_active":"2024-03-04T12:36:09.309883+0000","last_became_peered":"2024-03-04T12:36:09.309883+0000","last_unstale":"2024-03-04T13:00:37.720495+0000","last_undegraded":"2024-03-04T13:00:37.720495+0000","last_fullsized":"2024-03-04T13:00:37.720495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.720405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.720405+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.720405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:04.234972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"256'256","reported_seq":808,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.287654+0000","last_change":"2024-03-04T13:00:57.287688+0000","last_active":"2024-03-04T13:00:57.287654+0000","last_peered":"2024-03-04T13:00:57.287654+0000","last_clean":"2024-03-04T13:00:57.287654+0000","last_became_active":"2024-03-04T12:36:11.324784+0000","last_became_peered":"2024-03-04T12:36:11.324784+0000","last_unstale":"2024-03-04T13:00:57.287654+0000","last_undegraded":"2024-03-04T13:00:57.287654+0000","last_fullsized":"2024-03-04T13:00:57.287654+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'256","last_scrub_stamp":"2024-03-04T13:00:57.287531+0000","last_deep_scrub":"256'256","last_deep_scrub_stamp":"2024-03-04T13:00:57.287531+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.287531+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:25:13.049620+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54138,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":1067,"num_write":352,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.556862+0000","last_change":"2024-03-04T13:00:40.556902+0000","last_active":"2024-03-04T13:00:40.556862+0000","last_peered":"2024-03-04T13:00:40.556862+0000","last_clean":"2024-03-04T13:00:40.556862+0000","last_became_active":"2024-03-04T12:36:13.343030+0000","last_became_peered":"2024-03-04T12:36:13.343030+0000","last_unstale":"2024-03-04T13:00:40.556862+0000","last_undegraded":"2024-03-04T13:00:40.556862+0000","last_fullsized":"2024-03-04T13:00:40.556862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:40.556715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:40.556715+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.556715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:11:37.035294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"256'689","reported_seq":2146,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.766580+0000","last_change":"2024-03-04T13:00:45.766580+0000","last_active":"2024-03-04T13:00:45.766580+0000","last_peered":"2024-03-04T13:00:45.766580+0000","last_clean":"2024-03-04T13:00:45.766580+0000","last_became_active":"2024-03-04T12:36:07.298154+0000","last_became_peered":"2024-03-04T12:36:07.298154+0000","last_unstale":"2024-03-04T13:00:45.766580+0000","last_undegraded":"2024-03-04T13:00:45.766580+0000","last_fullsized":"2024-03-04T13:00:45.766580+0000","mapping_epoch":22,"log_start":"256'600","ondisk_log_start":"256'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'689","last_scrub_stamp":"2024-03-04T13:00:45.766448+0000","last_deep_scrub":"256'689","last_deep_scrub_stamp":"2024-03-04T13:00:45.766448+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.766448+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":600,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:58.758338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3209,"num_read_kb":2902,"num_write":904,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1913,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"256'322","reported_seq":1033,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:12.389443+0000","last_change":"2024-03-04T13:01:12.389487+0000","last_active":"2024-03-04T13:01:12.389443+0000","last_peered":"2024-03-04T13:01:12.389443+0000","last_clean":"2024-03-04T13:01:12.389443+0000","last_became_active":"2024-03-04T12:36:05.287329+0000","last_became_peered":"2024-03-04T12:36:05.287329+0000","last_unstale":"2024-03-04T13:01:12.389443+0000","last_undegraded":"2024-03-04T13:01:12.389443+0000","last_fullsized":"2024-03-04T13:01:12.389443+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'322","last_scrub_stamp":"2024-03-04T13:01:12.389344+0000","last_deep_scrub":"256'322","last_deep_scrub_stamp":"2024-03-04T13:01:12.389344+0000","last_clean_scrub_stamp":"2024-03-04T13:01:12.389344+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:50.607378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":51334,"num_write":1200,"num_write_kb":22699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":482,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.493036+0000","last_change":"2024-03-04T13:00:52.493071+0000","last_active":"2024-03-04T13:00:52.493036+0000","last_peered":"2024-03-04T13:00:52.493036+0000","last_clean":"2024-03-04T13:00:52.493036+0000","last_became_active":"2024-03-04T12:36:09.307329+0000","last_became_peered":"2024-03-04T12:36:09.307329+0000","last_unstale":"2024-03-04T13:00:52.493036+0000","last_undegraded":"2024-03-04T13:00:52.493036+0000","last_fullsized":"2024-03-04T13:00:52.493036+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:52.492916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:52.492916+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.492916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:14:55.192962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"256'416","reported_seq":1030,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.373675+0000","last_change":"2024-03-04T13:00:44.373675+0000","last_active":"2024-03-04T13:00:44.373675+0000","last_peered":"2024-03-04T13:00:44.373675+0000","last_clean":"2024-03-04T13:00:44.373675+0000","last_became_active":"2024-03-04T12:36:11.323506+0000","last_became_peered":"2024-03-04T12:36:11.323506+0000","last_unstale":"2024-03-04T13:00:44.373675+0000","last_undegraded":"2024-03-04T13:00:44.373675+0000","last_fullsized":"2024-03-04T13:00:44.373675+0000","mapping_epoch":26,"log_start":"256'400","ondisk_log_start":"256'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'416","last_scrub_stamp":"2024-03-04T13:00:44.373504+0000","last_deep_scrub":"256'416","last_deep_scrub_stamp":"2024-03-04T13:00:44.373504+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.373504+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:17.615777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114357,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":734,"num_read_kb":1796,"num_write":592,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":475,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:37.405124+0000","last_change":"2024-03-04T13:00:37.405124+0000","last_active":"2024-03-04T13:00:37.405124+0000","last_peered":"2024-03-04T13:00:37.405124+0000","last_clean":"2024-03-04T13:00:37.405124+0000","last_became_active":"2024-03-04T12:36:13.346628+0000","last_became_peered":"2024-03-04T12:36:13.346628+0000","last_unstale":"2024-03-04T13:00:37.405124+0000","last_undegraded":"2024-03-04T13:00:37.405124+0000","last_fullsized":"2024-03-04T13:00:37.405124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:37.404992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:37.404992+0000","last_clean_scrub_stamp":"2024-03-04T13:00:37.404992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:53:15.725542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"256'167","reported_seq":654,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:31.777427+0000","last_change":"2024-03-04T13:00:31.777458+0000","last_active":"2024-03-04T13:00:31.777427+0000","last_peered":"2024-03-04T13:00:31.777427+0000","last_clean":"2024-03-04T13:00:31.777427+0000","last_became_active":"2024-03-04T12:36:15.354125+0000","last_became_peered":"2024-03-04T12:36:15.354125+0000","last_unstale":"2024-03-04T13:00:31.777427+0000","last_undegraded":"2024-03-04T13:00:31.777427+0000","last_fullsized":"2024-03-04T13:00:31.777427+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'167","last_scrub_stamp":"2024-03-04T13:00:31.777324+0000","last_deep_scrub":"256'167","last_deep_scrub_stamp":"2024-03-04T13:00:31.777324+0000","last_clean_scrub_stamp":"2024-03-04T13:00:31.777324+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:56:57.666876+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":203,"num_write":373,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"256'1142","reported_seq":2724,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.484360+0000","last_change":"2024-03-04T13:00:55.484393+0000","last_active":"2024-03-04T13:00:55.484360+0000","last_peered":"2024-03-04T13:00:55.484360+0000","last_clean":"2024-03-04T13:00:55.484360+0000","last_became_active":"2024-03-04T12:36:07.298434+0000","last_became_peered":"2024-03-04T12:36:07.298434+0000","last_unstale":"2024-03-04T13:00:55.484360+0000","last_undegraded":"2024-03-04T13:00:55.484360+0000","last_fullsized":"2024-03-04T13:00:55.484360+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1142","last_scrub_stamp":"2024-03-04T13:00:55.484270+0000","last_deep_scrub":"256'1142","last_deep_scrub_stamp":"2024-03-04T13:00:55.484270+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.484270+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:45.148303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4934,"num_read_kb":4324,"num_write":1585,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"256'406","reported_seq":1058,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.377065+0000","last_change":"2024-03-04T13:00:58.377161+0000","last_active":"2024-03-04T13:00:58.377065+0000","last_peered":"2024-03-04T13:00:58.377065+0000","last_clean":"2024-03-04T13:00:58.377065+0000","last_became_active":"2024-03-04T12:36:05.287506+0000","last_became_peered":"2024-03-04T12:36:05.287506+0000","last_unstale":"2024-03-04T13:00:58.377065+0000","last_undegraded":"2024-03-04T13:00:58.377065+0000","last_fullsized":"2024-03-04T13:00:58.377065+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'406","last_scrub_stamp":"2024-03-04T13:00:58.376966+0000","last_deep_scrub":"256'406","last_deep_scrub_stamp":"2024-03-04T13:00:58.376966+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.376966+0000","objects_scrubbed":10,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:41.393895+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6658491,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":603,"num_read_kb":47023,"num_write":1149,"num_write_kb":33887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":484,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.716223+0000","last_change":"2024-03-04T13:00:39.716223+0000","last_active":"2024-03-04T13:00:39.716223+0000","last_peered":"2024-03-04T13:00:39.716223+0000","last_clean":"2024-03-04T13:00:39.716223+0000","last_became_active":"2024-03-04T12:36:09.309155+0000","last_became_peered":"2024-03-04T12:36:09.309155+0000","last_unstale":"2024-03-04T13:00:39.716223+0000","last_undegraded":"2024-03-04T13:00:39.716223+0000","last_fullsized":"2024-03-04T13:00:39.716223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:39.716073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:39.716073+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.716073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:43.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"256'282","reported_seq":843,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.268458+0000","last_change":"2024-03-04T13:00:55.268458+0000","last_active":"2024-03-04T13:00:55.268458+0000","last_peered":"2024-03-04T13:00:55.268458+0000","last_clean":"2024-03-04T13:00:55.268458+0000","last_became_active":"2024-03-04T12:36:11.323320+0000","last_became_peered":"2024-03-04T12:36:11.323320+0000","last_unstale":"2024-03-04T13:00:55.268458+0000","last_undegraded":"2024-03-04T13:00:55.268458+0000","last_fullsized":"2024-03-04T13:00:55.268458+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'282","last_scrub_stamp":"2024-03-04T13:00:55.268308+0000","last_deep_scrub":"256'282","last_deep_scrub_stamp":"2024-03-04T13:00:55.268308+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.268308+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:00:22.716350+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44965,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":1036,"num_write":392,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":479,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.394123+0000","last_change":"2024-03-04T13:01:00.394123+0000","last_active":"2024-03-04T13:01:00.394123+0000","last_peered":"2024-03-04T13:01:00.394123+0000","last_clean":"2024-03-04T13:01:00.394123+0000","last_became_active":"2024-03-04T12:36:13.340525+0000","last_became_peered":"2024-03-04T12:36:13.340525+0000","last_unstale":"2024-03-04T13:01:00.394123+0000","last_undegraded":"2024-03-04T13:01:00.394123+0000","last_fullsized":"2024-03-04T13:01:00.394123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:01:00.393973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:01:00.393973+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.393973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:26:20.188259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"256'159","reported_seq":993,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.793826+0000","last_change":"2024-03-04T13:00:44.793864+0000","last_active":"2024-03-04T13:00:44.793826+0000","last_peered":"2024-03-04T13:00:44.793826+0000","last_clean":"2024-03-04T13:00:44.793826+0000","last_became_active":"2024-03-04T12:36:15.362749+0000","last_became_peered":"2024-03-04T12:36:15.362749+0000","last_unstale":"2024-03-04T13:00:44.793826+0000","last_undegraded":"2024-03-04T13:00:44.793826+0000","last_fullsized":"2024-03-04T13:00:44.793826+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'159","last_scrub_stamp":"2024-03-04T13:00:44.793731+0000","last_deep_scrub":"256'159","last_deep_scrub_stamp":"2024-03-04T13:00:44.793731+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.793731+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:46:09.922195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":549,"num_write":456,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"256'355","reported_seq":1709,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.596079+0000","last_change":"2024-03-04T13:00:59.596079+0000","last_active":"2024-03-04T13:00:59.596079+0000","last_peered":"2024-03-04T13:00:59.596079+0000","last_clean":"2024-03-04T13:00:59.596079+0000","last_became_active":"2024-03-04T12:36:07.292806+0000","last_became_peered":"2024-03-04T12:36:07.292806+0000","last_unstale":"2024-03-04T13:00:59.596079+0000","last_undegraded":"2024-03-04T13:00:59.596079+0000","last_fullsized":"2024-03-04T13:00:59.596079+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'355","last_scrub_stamp":"2024-03-04T13:00:59.595934+0000","last_deep_scrub":"256'355","last_deep_scrub_stamp":"2024-03-04T13:00:59.595934+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.595934+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:05.865984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1929,"num_read_kb":1816,"num_write":430,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"256'322","reported_seq":968,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.027192+0000","last_change":"2024-03-04T13:01:00.027192+0000","last_active":"2024-03-04T13:01:00.027192+0000","last_peered":"2024-03-04T13:01:00.027192+0000","last_clean":"2024-03-04T13:01:00.027192+0000","last_became_active":"2024-03-04T12:36:05.289053+0000","last_became_peered":"2024-03-04T12:36:05.289053+0000","last_unstale":"2024-03-04T13:01:00.027192+0000","last_undegraded":"2024-03-04T13:01:00.027192+0000","last_fullsized":"2024-03-04T13:01:00.027192+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'322","last_scrub_stamp":"2024-03-04T13:01:00.027054+0000","last_deep_scrub":"256'322","last_deep_scrub_stamp":"2024-03-04T13:01:00.027054+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.027054+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:43.626153+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2688993,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":60644,"num_write":1189,"num_write_kb":49301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.060387+0000","last_change":"2024-03-04T13:00:56.060387+0000","last_active":"2024-03-04T13:00:56.060387+0000","last_peered":"2024-03-04T13:00:56.060387+0000","last_clean":"2024-03-04T13:00:56.060387+0000","last_became_active":"2024-03-04T12:36:09.308231+0000","last_became_peered":"2024-03-04T12:36:09.308231+0000","last_unstale":"2024-03-04T13:00:56.060387+0000","last_undegraded":"2024-03-04T13:00:56.060387+0000","last_fullsized":"2024-03-04T13:00:56.060387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:56.060200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:56.060200+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.060200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:48:33.656726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"256'281","reported_seq":836,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.683361+0000","last_change":"2024-03-04T13:00:43.683361+0000","last_active":"2024-03-04T13:00:43.683361+0000","last_peered":"2024-03-04T13:00:43.683361+0000","last_clean":"2024-03-04T13:00:43.683361+0000","last_became_active":"2024-03-04T12:36:11.954568+0000","last_became_peered":"2024-03-04T12:36:11.954568+0000","last_unstale":"2024-03-04T13:00:43.683361+0000","last_undegraded":"2024-03-04T13:00:43.683361+0000","last_fullsized":"2024-03-04T13:00:43.683361+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'281","last_scrub_stamp":"2024-03-04T13:00:43.683206+0000","last_deep_scrub":"256'281","last_deep_scrub_stamp":"2024-03-04T13:00:43.683206+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.683206+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:03.087502+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47143,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":469,"num_read_kb":1144,"num_write":392,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.352755+0000","last_change":"2024-03-04T13:00:35.352796+0000","last_active":"2024-03-04T13:00:35.352755+0000","last_peered":"2024-03-04T13:00:35.352755+0000","last_clean":"2024-03-04T13:00:35.352755+0000","last_became_active":"2024-03-04T12:36:13.346665+0000","last_became_peered":"2024-03-04T12:36:13.346665+0000","last_unstale":"2024-03-04T13:00:35.352755+0000","last_undegraded":"2024-03-04T13:00:35.352755+0000","last_fullsized":"2024-03-04T13:00:35.352755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:35.352646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:35.352646+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.352646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:01.849654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'106","reported_seq":579,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.473585+0000","last_change":"2024-03-04T13:00:29.473616+0000","last_active":"2024-03-04T13:00:29.473585+0000","last_peered":"2024-03-04T13:00:29.473585+0000","last_clean":"2024-03-04T13:00:29.473585+0000","last_became_active":"2024-03-04T12:36:15.363269+0000","last_became_peered":"2024-03-04T12:36:15.363269+0000","last_unstale":"2024-03-04T13:00:29.473585+0000","last_undegraded":"2024-03-04T13:00:29.473585+0000","last_fullsized":"2024-03-04T13:00:29.473585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'106","last_scrub_stamp":"2024-03-04T13:00:29.473497+0000","last_deep_scrub":"256'106","last_deep_scrub_stamp":"2024-03-04T13:00:29.473497+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.473497+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:09.775009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"256'431","reported_seq":1950,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.119811+0000","last_change":"2024-03-04T13:00:45.119811+0000","last_active":"2024-03-04T13:00:45.119811+0000","last_peered":"2024-03-04T13:00:45.119811+0000","last_clean":"2024-03-04T13:00:45.119811+0000","last_became_active":"2024-03-04T12:36:07.295353+0000","last_became_peered":"2024-03-04T12:36:07.295353+0000","last_unstale":"2024-03-04T13:00:45.119811+0000","last_undegraded":"2024-03-04T13:00:45.119811+0000","last_fullsized":"2024-03-04T13:00:45.119811+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'431","last_scrub_stamp":"2024-03-04T13:00:45.119711+0000","last_deep_scrub":"256'431","last_deep_scrub_stamp":"2024-03-04T13:00:45.119711+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.119711+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:51.239371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2362,"num_read_kb":2211,"num_write":524,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"256'521","reported_seq":1177,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.517974+0000","last_change":"2024-03-04T13:01:03.517974+0000","last_active":"2024-03-04T13:01:03.517974+0000","last_peered":"2024-03-04T13:01:03.517974+0000","last_clean":"2024-03-04T13:01:03.517974+0000","last_became_active":"2024-03-04T12:36:05.293646+0000","last_became_peered":"2024-03-04T12:36:05.293646+0000","last_unstale":"2024-03-04T13:01:03.517974+0000","last_undegraded":"2024-03-04T13:01:03.517974+0000","last_fullsized":"2024-03-04T13:01:03.517974+0000","mapping_epoch":20,"log_start":"256'500","ondisk_log_start":"256'500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'521","last_scrub_stamp":"2024-03-04T13:01:03.517823+0000","last_deep_scrub":"256'521","last_deep_scrub_stamp":"2024-03-04T13:01:03.517823+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.517823+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:32:21.516935+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242951,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":853,"num_read_kb":46890,"num_write":1453,"num_write_kb":44359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":487,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.333662+0000","last_change":"2024-03-04T13:00:36.333662+0000","last_active":"2024-03-04T13:00:36.333662+0000","last_peered":"2024-03-04T13:00:36.333662+0000","last_clean":"2024-03-04T13:00:36.333662+0000","last_became_active":"2024-03-04T12:36:09.305073+0000","last_became_peered":"2024-03-04T12:36:09.305073+0000","last_unstale":"2024-03-04T13:00:36.333662+0000","last_undegraded":"2024-03-04T13:00:36.333662+0000","last_fullsized":"2024-03-04T13:00:36.333662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:36.333509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:36.333509+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.333509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:13.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"256'70","reported_seq":572,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.123546+0000","last_change":"2024-03-04T13:00:35.123593+0000","last_active":"2024-03-04T13:00:35.123546+0000","last_peered":"2024-03-04T13:00:35.123546+0000","last_clean":"2024-03-04T13:00:35.123546+0000","last_became_active":"2024-03-04T12:36:11.954563+0000","last_became_peered":"2024-03-04T12:36:11.954563+0000","last_unstale":"2024-03-04T13:00:35.123546+0000","last_undegraded":"2024-03-04T13:00:35.123546+0000","last_fullsized":"2024-03-04T13:00:35.123546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'70","last_scrub_stamp":"2024-03-04T13:00:35.123457+0000","last_deep_scrub":"256'70","last_deep_scrub_stamp":"2024-03-04T13:00:35.123457+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.123457+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:38.665714+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":71,"num_read_kb":64,"num_write":78,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"256'482","reported_seq":1817,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.719971+0000","last_change":"2024-03-04T13:00:33.719971+0000","last_active":"2024-03-04T13:00:33.719971+0000","last_peered":"2024-03-04T13:00:33.719971+0000","last_clean":"2024-03-04T13:00:33.719971+0000","last_became_active":"2024-03-04T12:36:13.340221+0000","last_became_peered":"2024-03-04T12:36:13.340221+0000","last_unstale":"2024-03-04T13:00:33.719971+0000","last_undegraded":"2024-03-04T13:00:33.719971+0000","last_fullsized":"2024-03-04T13:00:33.719971+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'482","last_scrub_stamp":"2024-03-04T13:00:33.719854+0000","last_deep_scrub":"256'482","last_deep_scrub_stamp":"2024-03-04T13:00:33.719854+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.719854+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:52.429432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"256'134","reported_seq":617,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:33.308023+0000","last_change":"2024-03-04T13:00:33.308076+0000","last_active":"2024-03-04T13:00:33.308023+0000","last_peered":"2024-03-04T13:00:33.308023+0000","last_clean":"2024-03-04T13:00:33.308023+0000","last_became_active":"2024-03-04T12:36:15.364688+0000","last_became_peered":"2024-03-04T12:36:15.364688+0000","last_unstale":"2024-03-04T13:00:33.308023+0000","last_undegraded":"2024-03-04T13:00:33.308023+0000","last_fullsized":"2024-03-04T13:00:33.308023+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'134","last_scrub_stamp":"2024-03-04T13:00:33.307905+0000","last_deep_scrub":"256'134","last_deep_scrub_stamp":"2024-03-04T13:00:33.307905+0000","last_clean_scrub_stamp":"2024-03-04T13:00:33.307905+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:36.869465+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":294,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"256'359","reported_seq":1832,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.976573+0000","last_change":"2024-03-04T13:01:03.976573+0000","last_active":"2024-03-04T13:01:03.976573+0000","last_peered":"2024-03-04T13:01:03.976573+0000","last_clean":"2024-03-04T13:01:03.976573+0000","last_became_active":"2024-03-04T12:36:07.290637+0000","last_became_peered":"2024-03-04T12:36:07.290637+0000","last_unstale":"2024-03-04T13:01:03.976573+0000","last_undegraded":"2024-03-04T13:01:03.976573+0000","last_fullsized":"2024-03-04T13:01:03.976573+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'359","last_scrub_stamp":"2024-03-04T13:01:03.976474+0000","last_deep_scrub":"256'359","last_deep_scrub_stamp":"2024-03-04T13:01:03.976474+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.976474+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:32:48.230833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1998,"num_read_kb":1913,"num_write":399,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"256'431","reported_seq":1094,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.216670+0000","last_change":"2024-03-04T13:00:57.216670+0000","last_active":"2024-03-04T13:00:57.216670+0000","last_peered":"2024-03-04T13:00:57.216670+0000","last_clean":"2024-03-04T13:00:57.216670+0000","last_became_active":"2024-03-04T12:36:05.294568+0000","last_became_peered":"2024-03-04T12:36:05.294568+0000","last_unstale":"2024-03-04T13:00:57.216670+0000","last_undegraded":"2024-03-04T13:00:57.216670+0000","last_fullsized":"2024-03-04T13:00:57.216670+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'431","last_scrub_stamp":"2024-03-04T13:00:57.216499+0000","last_deep_scrub":"256'431","last_deep_scrub_stamp":"2024-03-04T13:00:57.216499+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.216499+0000","objects_scrubbed":10,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:52.566960+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6680724,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":37257,"num_write":1366,"num_write_kb":50791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.292255+0000","last_change":"2024-03-04T13:00:49.292255+0000","last_active":"2024-03-04T13:00:49.292255+0000","last_peered":"2024-03-04T13:00:49.292255+0000","last_clean":"2024-03-04T13:00:49.292255+0000","last_became_active":"2024-03-04T12:36:09.306005+0000","last_became_peered":"2024-03-04T12:36:09.306005+0000","last_unstale":"2024-03-04T13:00:49.292255+0000","last_undegraded":"2024-03-04T13:00:49.292255+0000","last_fullsized":"2024-03-04T13:00:49.292255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:49.292136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:49.292136+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.292136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:16:56.573532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"256'279","reported_seq":837,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:06.291841+0000","last_change":"2024-03-04T13:01:06.291900+0000","last_active":"2024-03-04T13:01:06.291841+0000","last_peered":"2024-03-04T13:01:06.291841+0000","last_clean":"2024-03-04T13:01:06.291841+0000","last_became_active":"2024-03-04T12:36:11.325503+0000","last_became_peered":"2024-03-04T12:36:11.325503+0000","last_unstale":"2024-03-04T13:01:06.291841+0000","last_undegraded":"2024-03-04T13:01:06.291841+0000","last_fullsized":"2024-03-04T13:01:06.291841+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'279","last_scrub_stamp":"2024-03-04T13:01:06.291725+0000","last_deep_scrub":"256'279","last_deep_scrub_stamp":"2024-03-04T13:01:06.291725+0000","last_clean_scrub_stamp":"2024-03-04T13:01:06.291725+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:40:39.805289+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52232,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":458,"num_read_kb":1083,"num_write":374,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.438680+0000","last_change":"2024-03-04T13:00:45.438699+0000","last_active":"2024-03-04T13:00:45.438680+0000","last_peered":"2024-03-04T13:00:45.438680+0000","last_clean":"2024-03-04T13:00:45.438680+0000","last_became_active":"2024-03-04T12:36:13.339349+0000","last_became_peered":"2024-03-04T12:36:13.339349+0000","last_unstale":"2024-03-04T13:00:45.438680+0000","last_undegraded":"2024-03-04T13:00:45.438680+0000","last_fullsized":"2024-03-04T13:00:45.438680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:45.438606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:45.438606+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.438606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:36.229715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"256'112","reported_seq":648,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:36.281626+0000","last_change":"2024-03-04T13:00:36.281667+0000","last_active":"2024-03-04T13:00:36.281626+0000","last_peered":"2024-03-04T13:00:36.281626+0000","last_clean":"2024-03-04T13:00:36.281626+0000","last_became_active":"2024-03-04T12:36:15.352383+0000","last_became_peered":"2024-03-04T12:36:15.352383+0000","last_unstale":"2024-03-04T13:00:36.281626+0000","last_undegraded":"2024-03-04T13:00:36.281626+0000","last_fullsized":"2024-03-04T13:00:36.281626+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'112","last_scrub_stamp":"2024-03-04T13:00:36.281541+0000","last_deep_scrub":"256'112","last_deep_scrub_stamp":"2024-03-04T13:00:36.281541+0000","last_clean_scrub_stamp":"2024-03-04T13:00:36.281541+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:36:25.279505+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":264,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"256'407","reported_seq":1786,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.063218+0000","last_change":"2024-03-04T13:00:45.063218+0000","last_active":"2024-03-04T13:00:45.063218+0000","last_peered":"2024-03-04T13:00:45.063218+0000","last_clean":"2024-03-04T13:00:45.063218+0000","last_became_active":"2024-03-04T12:36:07.295956+0000","last_became_peered":"2024-03-04T12:36:07.295956+0000","last_unstale":"2024-03-04T13:00:45.063218+0000","last_undegraded":"2024-03-04T13:00:45.063218+0000","last_fullsized":"2024-03-04T13:00:45.063218+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'407","last_scrub_stamp":"2024-03-04T13:00:45.063058+0000","last_deep_scrub":"256'407","last_deep_scrub_stamp":"2024-03-04T13:00:45.063058+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.063058+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:45.236704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2057,"num_read_kb":1911,"num_write":497,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1661,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"256'294","reported_seq":896,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:55.156169+0000","last_change":"2024-03-04T13:00:55.156169+0000","last_active":"2024-03-04T13:00:55.156169+0000","last_peered":"2024-03-04T13:00:55.156169+0000","last_clean":"2024-03-04T13:00:55.156169+0000","last_became_active":"2024-03-04T12:36:05.294686+0000","last_became_peered":"2024-03-04T12:36:05.294686+0000","last_unstale":"2024-03-04T13:00:55.156169+0000","last_undegraded":"2024-03-04T13:00:55.156169+0000","last_fullsized":"2024-03-04T13:00:55.156169+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'294","last_scrub_stamp":"2024-03-04T13:00:55.156012+0000","last_deep_scrub":"256'294","last_deep_scrub_stamp":"2024-03-04T13:00:55.156012+0000","last_clean_scrub_stamp":"2024-03-04T13:00:55.156012+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:38:18.762691+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263484,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":38414,"num_write":1001,"num_write_kb":48852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":483,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:54.184676+0000","last_change":"2024-03-04T13:00:54.184676+0000","last_active":"2024-03-04T13:00:54.184676+0000","last_peered":"2024-03-04T13:00:54.184676+0000","last_clean":"2024-03-04T13:00:54.184676+0000","last_became_active":"2024-03-04T12:36:09.314912+0000","last_became_peered":"2024-03-04T12:36:09.314912+0000","last_unstale":"2024-03-04T13:00:54.184676+0000","last_undegraded":"2024-03-04T13:00:54.184676+0000","last_fullsized":"2024-03-04T13:00:54.184676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:54.184558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:54.184558+0000","last_clean_scrub_stamp":"2024-03-04T13:00:54.184558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:06.693943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"256'269","reported_seq":815,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.483058+0000","last_change":"2024-03-04T13:00:56.483127+0000","last_active":"2024-03-04T13:00:56.483058+0000","last_peered":"2024-03-04T13:00:56.483058+0000","last_clean":"2024-03-04T13:00:56.483058+0000","last_became_active":"2024-03-04T12:36:11.325238+0000","last_became_peered":"2024-03-04T12:36:11.325238+0000","last_unstale":"2024-03-04T13:00:56.483058+0000","last_undegraded":"2024-03-04T13:00:56.483058+0000","last_fullsized":"2024-03-04T13:00:56.483058+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'269","last_scrub_stamp":"2024-03-04T13:00:56.482960+0000","last_deep_scrub":"256'269","last_deep_scrub_stamp":"2024-03-04T13:00:56.482960+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.482960+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:36:12.707737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45924,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1039,"num_write":360,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":474,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:32.728346+0000","last_change":"2024-03-04T13:00:32.728368+0000","last_active":"2024-03-04T13:00:32.728346+0000","last_peered":"2024-03-04T13:00:32.728346+0000","last_clean":"2024-03-04T13:00:32.728346+0000","last_became_active":"2024-03-04T12:36:13.341689+0000","last_became_peered":"2024-03-04T12:36:13.341689+0000","last_unstale":"2024-03-04T13:00:32.728346+0000","last_undegraded":"2024-03-04T13:00:32.728346+0000","last_fullsized":"2024-03-04T13:00:32.728346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:32.728255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:32.728255+0000","last_clean_scrub_stamp":"2024-03-04T13:00:32.728255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:29.104225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"256'99","reported_seq":601,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:35.811874+0000","last_change":"2024-03-04T13:00:35.811925+0000","last_active":"2024-03-04T13:00:35.811874+0000","last_peered":"2024-03-04T13:00:35.811874+0000","last_clean":"2024-03-04T13:00:35.811874+0000","last_became_active":"2024-03-04T12:36:15.353418+0000","last_became_peered":"2024-03-04T12:36:15.353418+0000","last_unstale":"2024-03-04T13:00:35.811874+0000","last_undegraded":"2024-03-04T13:00:35.811874+0000","last_fullsized":"2024-03-04T13:00:35.811874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'99","last_scrub_stamp":"2024-03-04T13:00:35.811760+0000","last_deep_scrub":"256'99","last_deep_scrub_stamp":"2024-03-04T13:00:35.811760+0000","last_clean_scrub_stamp":"2024-03-04T13:00:35.811760+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:37:45.530873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"256'1444","reported_seq":2785,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:58.627556+0000","last_change":"2024-03-04T13:00:58.627585+0000","last_active":"2024-03-04T13:00:58.627556+0000","last_peered":"2024-03-04T13:00:58.627556+0000","last_clean":"2024-03-04T13:00:58.627556+0000","last_became_active":"2024-03-04T12:36:07.300067+0000","last_became_peered":"2024-03-04T12:36:07.300067+0000","last_unstale":"2024-03-04T13:00:58.627556+0000","last_undegraded":"2024-03-04T13:00:58.627556+0000","last_fullsized":"2024-03-04T13:00:58.627556+0000","mapping_epoch":22,"log_start":"256'1400","ondisk_log_start":"256'1400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1444","last_scrub_stamp":"2024-03-04T13:00:58.627462+0000","last_deep_scrub":"256'1444","last_deep_scrub_stamp":"2024-03-04T13:00:58.627462+0000","last_clean_scrub_stamp":"2024-03-04T13:00:58.627462+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":1400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:24.866811+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5752,"num_read_kb":4912,"num_write":2067,"num_write_kb":923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"256'387","reported_seq":1052,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:08.491447+0000","last_change":"2024-03-04T13:01:08.491527+0000","last_active":"2024-03-04T13:01:08.491447+0000","last_peered":"2024-03-04T13:01:08.491447+0000","last_clean":"2024-03-04T13:01:08.491447+0000","last_became_active":"2024-03-04T12:36:05.283142+0000","last_became_peered":"2024-03-04T12:36:05.283142+0000","last_unstale":"2024-03-04T13:01:08.491447+0000","last_undegraded":"2024-03-04T13:01:08.491447+0000","last_fullsized":"2024-03-04T13:01:08.491447+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'387","last_scrub_stamp":"2024-03-04T13:01:08.491322+0000","last_deep_scrub":"256'387","last_deep_scrub_stamp":"2024-03-04T13:01:08.491322+0000","last_clean_scrub_stamp":"2024-03-04T13:01:08.491322+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:25:15.039344+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":1440,"num_write":1747,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.032882+0000","last_change":"2024-03-04T13:00:52.032906+0000","last_active":"2024-03-04T13:00:52.032882+0000","last_peered":"2024-03-04T13:00:52.032882+0000","last_clean":"2024-03-04T13:00:52.032882+0000","last_became_active":"2024-03-04T12:36:09.305182+0000","last_became_peered":"2024-03-04T12:36:09.305182+0000","last_unstale":"2024-03-04T13:00:52.032882+0000","last_undegraded":"2024-03-04T13:00:52.032882+0000","last_fullsized":"2024-03-04T13:00:52.032882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:52.032789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:52.032789+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.032789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:52:57.003068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"256'241","reported_seq":785,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.648093+0000","last_change":"2024-03-04T13:00:49.648093+0000","last_active":"2024-03-04T13:00:49.648093+0000","last_peered":"2024-03-04T13:00:49.648093+0000","last_clean":"2024-03-04T13:00:49.648093+0000","last_became_active":"2024-03-04T12:36:11.324394+0000","last_became_peered":"2024-03-04T12:36:11.324394+0000","last_unstale":"2024-03-04T13:00:49.648093+0000","last_undegraded":"2024-03-04T13:00:49.648093+0000","last_fullsized":"2024-03-04T13:00:49.648093+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'241","last_scrub_stamp":"2024-03-04T13:00:49.647937+0000","last_deep_scrub":"256'241","last_deep_scrub_stamp":"2024-03-04T13:00:49.647937+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.647937+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:42.725177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41224,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":411,"num_read_kb":1022,"num_write":344,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.121222+0000","last_change":"2024-03-04T13:00:34.121222+0000","last_active":"2024-03-04T13:00:34.121222+0000","last_peered":"2024-03-04T13:00:34.121222+0000","last_clean":"2024-03-04T13:00:34.121222+0000","last_became_active":"2024-03-04T12:36:13.340897+0000","last_became_peered":"2024-03-04T12:36:13.340897+0000","last_unstale":"2024-03-04T13:00:34.121222+0000","last_undegraded":"2024-03-04T13:00:34.121222+0000","last_fullsized":"2024-03-04T13:00:34.121222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:34.121113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:34.121113+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.121113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:17:37.532912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"256'172","reported_seq":1180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:34.324441+0000","last_change":"2024-03-04T13:00:34.324472+0000","last_active":"2024-03-04T13:00:34.324441+0000","last_peered":"2024-03-04T13:00:34.324441+0000","last_clean":"2024-03-04T13:00:34.324441+0000","last_became_active":"2024-03-04T12:36:15.357141+0000","last_became_peered":"2024-03-04T12:36:15.357141+0000","last_unstale":"2024-03-04T13:00:34.324441+0000","last_undegraded":"2024-03-04T13:00:34.324441+0000","last_fullsized":"2024-03-04T13:00:34.324441+0000","mapping_epoch":30,"log_start":"256'100","ondisk_log_start":"256'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'172","last_scrub_stamp":"2024-03-04T13:00:34.324343+0000","last_deep_scrub":"256'172","last_deep_scrub_stamp":"2024-03-04T13:00:34.324343+0000","last_clean_scrub_stamp":"2024-03-04T13:00:34.324343+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:14:37.999688+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":655,"num_read_kb":655,"num_write":360,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"256'1105","reported_seq":2597,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.937177+0000","last_change":"2024-03-04T13:01:02.937202+0000","last_active":"2024-03-04T13:01:02.937177+0000","last_peered":"2024-03-04T13:01:02.937177+0000","last_clean":"2024-03-04T13:01:02.937177+0000","last_became_active":"2024-03-04T12:36:07.290820+0000","last_became_peered":"2024-03-04T12:36:07.290820+0000","last_unstale":"2024-03-04T13:01:02.937177+0000","last_undegraded":"2024-03-04T13:01:02.937177+0000","last_fullsized":"2024-03-04T13:01:02.937177+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1105","last_scrub_stamp":"2024-03-04T13:01:02.937105+0000","last_deep_scrub":"256'1105","last_deep_scrub_stamp":"2024-03-04T13:01:02.937105+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.937105+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:07:49.432949+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4641,"num_read_kb":4049,"num_write":1526,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"256'323","reported_seq":1000,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:10.404895+0000","last_change":"2024-03-04T13:01:10.404963+0000","last_active":"2024-03-04T13:01:10.404895+0000","last_peered":"2024-03-04T13:01:10.404895+0000","last_clean":"2024-03-04T13:01:10.404895+0000","last_became_active":"2024-03-04T12:36:05.289897+0000","last_became_peered":"2024-03-04T12:36:05.289897+0000","last_unstale":"2024-03-04T13:01:10.404895+0000","last_undegraded":"2024-03-04T13:01:10.404895+0000","last_fullsized":"2024-03-04T13:01:10.404895+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'323","last_scrub_stamp":"2024-03-04T13:01:10.404788+0000","last_deep_scrub":"256'323","last_deep_scrub_stamp":"2024-03-04T13:01:10.404788+0000","last_clean_scrub_stamp":"2024-03-04T13:01:10.404788+0000","objects_scrubbed":9,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:55:29.063080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525438,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":585,"num_read_kb":14927,"num_write":1035,"num_write_kb":32177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"256'2","reported_seq":489,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.381434+0000","last_change":"2024-03-04T13:00:40.381460+0000","last_active":"2024-03-04T13:00:40.381434+0000","last_peered":"2024-03-04T13:00:40.381434+0000","last_clean":"2024-03-04T13:00:40.381434+0000","last_became_active":"2024-03-04T12:36:09.310855+0000","last_became_peered":"2024-03-04T12:36:09.310855+0000","last_unstale":"2024-03-04T13:00:40.381434+0000","last_undegraded":"2024-03-04T13:00:40.381434+0000","last_fullsized":"2024-03-04T13:00:40.381434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'2","last_scrub_stamp":"2024-03-04T13:00:40.381349+0000","last_deep_scrub":"256'2","last_deep_scrub_stamp":"2024-03-04T13:00:40.381349+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.381349+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:49.986949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"256'269","reported_seq":839,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:39.150096+0000","last_change":"2024-03-04T13:00:39.150096+0000","last_active":"2024-03-04T13:00:39.150096+0000","last_peered":"2024-03-04T13:00:39.150096+0000","last_clean":"2024-03-04T13:00:39.150096+0000","last_became_active":"2024-03-04T12:36:11.323352+0000","last_became_peered":"2024-03-04T12:36:11.323352+0000","last_unstale":"2024-03-04T13:00:39.150096+0000","last_undegraded":"2024-03-04T13:00:39.150096+0000","last_fullsized":"2024-03-04T13:00:39.150096+0000","mapping_epoch":26,"log_start":"256'200","ondisk_log_start":"256'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'269","last_scrub_stamp":"2024-03-04T13:00:39.149959+0000","last_deep_scrub":"256'269","last_deep_scrub_stamp":"2024-03-04T13:00:39.149959+0000","last_clean_scrub_stamp":"2024-03-04T13:00:39.149959+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:08:10.926685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":1008,"num_write":350,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":472,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.533773+0000","last_change":"2024-03-04T13:00:41.533773+0000","last_active":"2024-03-04T13:00:41.533773+0000","last_peered":"2024-03-04T13:00:41.533773+0000","last_clean":"2024-03-04T13:00:41.533773+0000","last_became_active":"2024-03-04T12:36:13.342656+0000","last_became_peered":"2024-03-04T12:36:13.342656+0000","last_unstale":"2024-03-04T13:00:41.533773+0000","last_undegraded":"2024-03-04T13:00:41.533773+0000","last_fullsized":"2024-03-04T13:00:41.533773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:00:41.533655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:00:41.533655+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.533655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:57.620759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"256'104","reported_seq":586,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:30.145696+0000","last_change":"2024-03-04T13:00:30.145729+0000","last_active":"2024-03-04T13:00:30.145696+0000","last_peered":"2024-03-04T13:00:30.145696+0000","last_clean":"2024-03-04T13:00:30.145696+0000","last_became_active":"2024-03-04T12:36:15.352333+0000","last_became_peered":"2024-03-04T12:36:15.352333+0000","last_unstale":"2024-03-04T13:00:30.145696+0000","last_undegraded":"2024-03-04T13:00:30.145696+0000","last_fullsized":"2024-03-04T13:00:30.145696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'104","last_scrub_stamp":"2024-03-04T13:00:30.145579+0000","last_deep_scrub":"256'104","last_deep_scrub_stamp":"2024-03-04T13:00:30.145579+0000","last_clean_scrub_stamp":"2024-03-04T13:00:30.145579+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:30.216312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":93,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"256'394","reported_seq":1898,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.413355+0000","last_change":"2024-03-04T13:00:47.413399+0000","last_active":"2024-03-04T13:00:47.413355+0000","last_peered":"2024-03-04T13:00:47.413355+0000","last_clean":"2024-03-04T13:00:47.413355+0000","last_became_active":"2024-03-04T12:36:07.297660+0000","last_became_peered":"2024-03-04T12:36:07.297660+0000","last_unstale":"2024-03-04T13:00:47.413355+0000","last_undegraded":"2024-03-04T13:00:47.413355+0000","last_fullsized":"2024-03-04T13:00:47.413355+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'394","last_scrub_stamp":"2024-03-04T13:00:47.413268+0000","last_deep_scrub":"256'394","last_deep_scrub_stamp":"2024-03-04T13:00:47.413268+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.413268+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:01.581295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":478,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2632,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"256'280","reported_seq":875,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.768622+0000","last_change":"2024-03-04T13:00:49.768622+0000","last_active":"2024-03-04T13:00:49.768622+0000","last_peered":"2024-03-04T13:00:49.768622+0000","last_clean":"2024-03-04T13:00:49.768622+0000","last_became_active":"2024-03-04T12:36:05.279576+0000","last_became_peered":"2024-03-04T12:36:05.279576+0000","last_unstale":"2024-03-04T13:00:49.768622+0000","last_undegraded":"2024-03-04T13:00:49.768622+0000","last_fullsized":"2024-03-04T13:00:49.768622+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'280","last_scrub_stamp":"2024-03-04T13:00:49.768467+0000","last_deep_scrub":"256'280","last_deep_scrub_stamp":"2024-03-04T13:00:49.768467+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.768467+0000","objects_scrubbed":9,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:06:40.516533+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5591378,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":375,"num_read_kb":32300,"num_write":1079,"num_write_kb":15765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"256'426","reported_seq":1860,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.396310+0000","last_change":"2024-03-04T13:00:41.396339+0000","last_active":"2024-03-04T13:00:41.396310+0000","last_peered":"2024-03-04T13:00:41.396310+0000","last_clean":"2024-03-04T13:00:41.396310+0000","last_became_active":"2024-03-04T12:36:07.300168+0000","last_became_peered":"2024-03-04T12:36:07.300168+0000","last_unstale":"2024-03-04T13:00:41.396310+0000","last_undegraded":"2024-03-04T13:00:41.396310+0000","last_fullsized":"2024-03-04T13:00:41.396310+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'426","last_scrub_stamp":"2024-03-04T13:00:41.396226+0000","last_deep_scrub":"256'426","last_deep_scrub_stamp":"2024-03-04T13:00:41.396226+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.396226+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:54.864579+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2082,"num_write":535,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":964,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"256'314","reported_seq":940,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:41.179727+0000","last_change":"2024-03-04T13:00:41.179727+0000","last_active":"2024-03-04T13:00:41.179727+0000","last_peered":"2024-03-04T13:00:41.179727+0000","last_clean":"2024-03-04T13:00:41.179727+0000","last_became_active":"2024-03-04T12:36:05.287233+0000","last_became_peered":"2024-03-04T12:36:05.287233+0000","last_unstale":"2024-03-04T13:00:41.179727+0000","last_undegraded":"2024-03-04T13:00:41.179727+0000","last_fullsized":"2024-03-04T13:00:41.179727+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'314","last_scrub_stamp":"2024-03-04T13:00:41.179534+0000","last_deep_scrub":"256'314","last_deep_scrub_stamp":"2024-03-04T13:00:41.179534+0000","last_clean_scrub_stamp":"2024-03-04T13:00:41.179534+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:17:16.905623+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1355534,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":467,"num_read_kb":46552,"num_write":1196,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"256'339","reported_seq":1840,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:45.320057+0000","last_change":"2024-03-04T13:00:45.320086+0000","last_active":"2024-03-04T13:00:45.320057+0000","last_peered":"2024-03-04T13:00:45.320057+0000","last_clean":"2024-03-04T13:00:45.320057+0000","last_became_active":"2024-03-04T12:36:07.296104+0000","last_became_peered":"2024-03-04T12:36:07.296104+0000","last_unstale":"2024-03-04T13:00:45.320057+0000","last_undegraded":"2024-03-04T13:00:45.320057+0000","last_fullsized":"2024-03-04T13:00:45.320057+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'339","last_scrub_stamp":"2024-03-04T13:00:45.319962+0000","last_deep_scrub":"256'339","last_deep_scrub_stamp":"2024-03-04T13:00:45.319962+0000","last_clean_scrub_stamp":"2024-03-04T13:00:45.319962+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:39:45.319778+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1942,"num_read_kb":1888,"num_write":368,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"256'349","reported_seq":979,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:29.296873+0000","last_change":"2024-03-04T13:00:29.296873+0000","last_active":"2024-03-04T13:00:29.296873+0000","last_peered":"2024-03-04T13:00:29.296873+0000","last_clean":"2024-03-04T13:00:29.296873+0000","last_became_active":"2024-03-04T12:36:41.075381+0000","last_became_peered":"2024-03-04T12:36:41.075381+0000","last_unstale":"2024-03-04T13:00:29.296873+0000","last_undegraded":"2024-03-04T13:00:29.296873+0000","last_fullsized":"2024-03-04T13:00:29.296873+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'349","last_scrub_stamp":"2024-03-04T13:00:29.296681+0000","last_deep_scrub":"256'349","last_deep_scrub_stamp":"2024-03-04T13:00:29.296681+0000","last_clean_scrub_stamp":"2024-03-04T13:00:29.296681+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:14.010604+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8448064,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":52899,"num_write":1289,"num_write_kb":57282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"256'1028","reported_seq":2586,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.339309+0000","last_change":"2024-03-04T13:00:43.339356+0000","last_active":"2024-03-04T13:00:43.339309+0000","last_peered":"2024-03-04T13:00:43.339309+0000","last_clean":"2024-03-04T13:00:43.339309+0000","last_became_active":"2024-03-04T12:36:07.299282+0000","last_became_peered":"2024-03-04T12:36:07.299282+0000","last_unstale":"2024-03-04T13:00:43.339309+0000","last_undegraded":"2024-03-04T13:00:43.339309+0000","last_fullsized":"2024-03-04T13:00:43.339309+0000","mapping_epoch":22,"log_start":"256'1000","ondisk_log_start":"256'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1028","last_scrub_stamp":"2024-03-04T13:00:43.339218+0000","last_deep_scrub":"256'1028","last_deep_scrub_stamp":"2024-03-04T13:00:43.339218+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.339218+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":1000,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:14:07.769583+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4484,"num_read_kb":3892,"num_write":1521,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"256'296","reported_seq":958,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:06.507848+0000","last_change":"2024-03-04T13:01:06.507892+0000","last_active":"2024-03-04T13:01:06.507848+0000","last_peered":"2024-03-04T13:01:06.507848+0000","last_clean":"2024-03-04T13:01:06.507848+0000","last_became_active":"2024-03-04T12:36:05.283327+0000","last_became_peered":"2024-03-04T12:36:05.283327+0000","last_unstale":"2024-03-04T13:01:06.507848+0000","last_undegraded":"2024-03-04T13:01:06.507848+0000","last_fullsized":"2024-03-04T13:01:06.507848+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'296","last_scrub_stamp":"2024-03-04T13:01:06.507765+0000","last_deep_scrub":"256'296","last_deep_scrub_stamp":"2024-03-04T13:01:06.507765+0000","last_clean_scrub_stamp":"2024-03-04T13:01:06.507765+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:08:32.992038+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6002849,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":66598,"num_write":994,"num_write_kb":37083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"256'427","reported_seq":1891,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.644183+0000","last_change":"2024-03-04T13:00:57.644183+0000","last_active":"2024-03-04T13:00:57.644183+0000","last_peered":"2024-03-04T13:00:57.644183+0000","last_clean":"2024-03-04T13:00:57.644183+0000","last_became_active":"2024-03-04T12:36:07.292950+0000","last_became_peered":"2024-03-04T12:36:07.292950+0000","last_unstale":"2024-03-04T13:00:57.644183+0000","last_undegraded":"2024-03-04T13:00:57.644183+0000","last_fullsized":"2024-03-04T13:00:57.644183+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'427","last_scrub_stamp":"2024-03-04T13:00:57.644027+0000","last_deep_scrub":"256'427","last_deep_scrub_stamp":"2024-03-04T13:00:57.644027+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.644027+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:20:44.730407+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2086,"num_write":515,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"256'287","reported_seq":910,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:11.404626+0000","last_change":"2024-03-04T13:01:11.404669+0000","last_active":"2024-03-04T13:01:11.404626+0000","last_peered":"2024-03-04T13:01:11.404626+0000","last_clean":"2024-03-04T13:01:11.404626+0000","last_became_active":"2024-03-04T12:36:05.286745+0000","last_became_peered":"2024-03-04T12:36:05.286745+0000","last_unstale":"2024-03-04T13:01:11.404626+0000","last_undegraded":"2024-03-04T13:01:11.404626+0000","last_fullsized":"2024-03-04T13:01:11.404626+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'287","last_scrub_stamp":"2024-03-04T13:01:11.404533+0000","last_deep_scrub":"256'287","last_deep_scrub_stamp":"2024-03-04T13:01:11.404533+0000","last_clean_scrub_stamp":"2024-03-04T13:01:11.404533+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:56:56.249372+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":38207,"num_write":1041,"num_write_kb":19360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"256'356","reported_seq":1900,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:04.934536+0000","last_change":"2024-03-04T13:01:04.934536+0000","last_active":"2024-03-04T13:01:04.934536+0000","last_peered":"2024-03-04T13:01:04.934536+0000","last_clean":"2024-03-04T13:01:04.934536+0000","last_became_active":"2024-03-04T12:36:07.291690+0000","last_became_peered":"2024-03-04T12:36:07.291690+0000","last_unstale":"2024-03-04T13:01:04.934536+0000","last_undegraded":"2024-03-04T13:01:04.934536+0000","last_fullsized":"2024-03-04T13:01:04.934536+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'356","last_scrub_stamp":"2024-03-04T13:01:04.934415+0000","last_deep_scrub":"256'356","last_deep_scrub_stamp":"2024-03-04T13:01:04.934415+0000","last_clean_scrub_stamp":"2024-03-04T13:01:04.934415+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:34:50.904028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2163,"num_read_kb":2091,"num_write":400,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":475,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"256'300","reported_seq":926,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:59.389712+0000","last_change":"2024-03-04T13:00:59.389753+0000","last_active":"2024-03-04T13:00:59.389712+0000","last_peered":"2024-03-04T13:00:59.389712+0000","last_clean":"2024-03-04T13:00:59.389712+0000","last_became_active":"2024-03-04T12:36:05.287529+0000","last_became_peered":"2024-03-04T12:36:05.287529+0000","last_unstale":"2024-03-04T13:00:59.389712+0000","last_undegraded":"2024-03-04T13:00:59.389712+0000","last_fullsized":"2024-03-04T13:00:59.389712+0000","mapping_epoch":20,"log_start":"256'200","ondisk_log_start":"256'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'300","last_scrub_stamp":"2024-03-04T13:00:59.389613+0000","last_deep_scrub":"256'300","last_deep_scrub_stamp":"2024-03-04T13:00:59.389613+0000","last_clean_scrub_stamp":"2024-03-04T13:00:59.389613+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:18:58.734299+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":37296,"num_write":1090,"num_write_kb":36513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"256'739","reported_seq":2232,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:56.662029+0000","last_change":"2024-03-04T13:00:56.662029+0000","last_active":"2024-03-04T13:00:56.662029+0000","last_peered":"2024-03-04T13:00:56.662029+0000","last_clean":"2024-03-04T13:00:56.662029+0000","last_became_active":"2024-03-04T12:36:07.299881+0000","last_became_peered":"2024-03-04T12:36:07.299881+0000","last_unstale":"2024-03-04T13:00:56.662029+0000","last_undegraded":"2024-03-04T13:00:56.662029+0000","last_fullsized":"2024-03-04T13:00:56.662029+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'739","last_scrub_stamp":"2024-03-04T13:00:56.661911+0000","last_deep_scrub":"256'739","last_deep_scrub_stamp":"2024-03-04T13:00:56.661911+0000","last_clean_scrub_stamp":"2024-03-04T13:00:56.661911+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:41:05.923331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3309,"num_read_kb":2983,"num_write":974,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"256'330","reported_seq":963,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:52.705064+0000","last_change":"2024-03-04T13:00:52.705124+0000","last_active":"2024-03-04T13:00:52.705064+0000","last_peered":"2024-03-04T13:00:52.705064+0000","last_clean":"2024-03-04T13:00:52.705064+0000","last_became_active":"2024-03-04T12:36:05.286397+0000","last_became_peered":"2024-03-04T12:36:05.286397+0000","last_unstale":"2024-03-04T13:00:52.705064+0000","last_undegraded":"2024-03-04T13:00:52.705064+0000","last_fullsized":"2024-03-04T13:00:52.705064+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'330","last_scrub_stamp":"2024-03-04T13:00:52.704955+0000","last_deep_scrub":"256'330","last_deep_scrub_stamp":"2024-03-04T13:00:52.704955+0000","last_clean_scrub_stamp":"2024-03-04T13:00:52.704955+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:27:08.892935+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472549,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":459,"num_read_kb":103287,"num_write":1220,"num_write_kb":47023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"256'477","reported_seq":2083,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.756343+0000","last_change":"2024-03-04T13:00:47.756343+0000","last_active":"2024-03-04T13:00:47.756343+0000","last_peered":"2024-03-04T13:00:47.756343+0000","last_clean":"2024-03-04T13:00:47.756343+0000","last_became_active":"2024-03-04T12:36:07.292501+0000","last_became_peered":"2024-03-04T12:36:07.292501+0000","last_unstale":"2024-03-04T13:00:47.756343+0000","last_undegraded":"2024-03-04T13:00:47.756343+0000","last_fullsized":"2024-03-04T13:00:47.756343+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'477","last_scrub_stamp":"2024-03-04T13:00:47.756208+0000","last_deep_scrub":"256'477","last_deep_scrub_stamp":"2024-03-04T13:00:47.756208+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.756208+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:29:15.876341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2330,"num_write":558,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"256'328","reported_seq":934,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:15.416192+0000","last_change":"2024-03-04T13:01:15.416232+0000","last_active":"2024-03-04T13:01:15.416192+0000","last_peered":"2024-03-04T13:01:15.416192+0000","last_clean":"2024-03-04T13:01:15.416192+0000","last_became_active":"2024-03-04T12:36:05.294007+0000","last_became_peered":"2024-03-04T12:36:05.294007+0000","last_unstale":"2024-03-04T13:01:15.416192+0000","last_undegraded":"2024-03-04T13:01:15.416192+0000","last_fullsized":"2024-03-04T13:01:15.416192+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'328","last_scrub_stamp":"2024-03-04T13:01:15.416107+0000","last_deep_scrub":"256'328","last_deep_scrub_stamp":"2024-03-04T13:01:15.416107+0000","last_clean_scrub_stamp":"2024-03-04T13:01:15.416107+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:07.766815+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":23598,"num_write":1193,"num_write_kb":28139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"256'447","reported_seq":1967,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.454006+0000","last_change":"2024-03-04T13:01:01.454040+0000","last_active":"2024-03-04T13:01:01.454006+0000","last_peered":"2024-03-04T13:01:01.454006+0000","last_clean":"2024-03-04T13:01:01.454006+0000","last_became_active":"2024-03-04T12:36:07.294283+0000","last_became_peered":"2024-03-04T12:36:07.294283+0000","last_unstale":"2024-03-04T13:01:01.454006+0000","last_undegraded":"2024-03-04T13:01:01.454006+0000","last_fullsized":"2024-03-04T13:01:01.454006+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'447","last_scrub_stamp":"2024-03-04T13:01:01.453910+0000","last_deep_scrub":"256'447","last_deep_scrub_stamp":"2024-03-04T13:01:01.453910+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.453910+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:10:08.932924+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2476,"num_read_kb":2316,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"256'341","reported_seq":963,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:02.232226+0000","last_change":"2024-03-04T13:01:02.232253+0000","last_active":"2024-03-04T13:01:02.232226+0000","last_peered":"2024-03-04T13:01:02.232226+0000","last_clean":"2024-03-04T13:01:02.232226+0000","last_became_active":"2024-03-04T12:36:05.289882+0000","last_became_peered":"2024-03-04T12:36:05.289882+0000","last_unstale":"2024-03-04T13:01:02.232226+0000","last_undegraded":"2024-03-04T13:01:02.232226+0000","last_fullsized":"2024-03-04T13:01:02.232226+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'341","last_scrub_stamp":"2024-03-04T13:01:02.232157+0000","last_deep_scrub":"256'341","last_deep_scrub_stamp":"2024-03-04T13:01:02.232157+0000","last_clean_scrub_stamp":"2024-03-04T13:01:02.232157+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:51:22.704788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":35092,"num_write":1098,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"256'455","reported_seq":1947,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.067211+0000","last_change":"2024-03-04T13:00:51.067257+0000","last_active":"2024-03-04T13:00:51.067211+0000","last_peered":"2024-03-04T13:00:51.067211+0000","last_clean":"2024-03-04T13:00:51.067211+0000","last_became_active":"2024-03-04T12:36:07.292904+0000","last_became_peered":"2024-03-04T12:36:07.292904+0000","last_unstale":"2024-03-04T13:00:51.067211+0000","last_undegraded":"2024-03-04T13:00:51.067211+0000","last_fullsized":"2024-03-04T13:00:51.067211+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'455","last_scrub_stamp":"2024-03-04T13:00:51.067100+0000","last_deep_scrub":"256'455","last_deep_scrub_stamp":"2024-03-04T13:00:51.067100+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.067100+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:31:42.315352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2160,"num_write":550,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":241,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"256'311","reported_seq":907,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:07.454272+0000","last_change":"2024-03-04T13:01:07.454328+0000","last_active":"2024-03-04T13:01:07.454272+0000","last_peered":"2024-03-04T13:01:07.454272+0000","last_clean":"2024-03-04T13:01:07.454272+0000","last_became_active":"2024-03-04T12:36:05.294338+0000","last_became_peered":"2024-03-04T12:36:05.294338+0000","last_unstale":"2024-03-04T13:01:07.454272+0000","last_undegraded":"2024-03-04T13:01:07.454272+0000","last_fullsized":"2024-03-04T13:01:07.454272+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'311","last_scrub_stamp":"2024-03-04T13:01:07.454186+0000","last_deep_scrub":"256'311","last_deep_scrub_stamp":"2024-03-04T13:01:07.454186+0000","last_clean_scrub_stamp":"2024-03-04T13:01:07.454186+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:58:58.558709+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263242,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":434,"num_read_kb":2630,"num_write":1136,"num_write_kb":25999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"256'1256","reported_seq":2852,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:43.111171+0000","last_change":"2024-03-04T13:00:43.111171+0000","last_active":"2024-03-04T13:00:43.111171+0000","last_peered":"2024-03-04T13:00:43.111171+0000","last_clean":"2024-03-04T13:00:43.111171+0000","last_became_active":"2024-03-04T12:36:07.292294+0000","last_became_peered":"2024-03-04T12:36:07.292294+0000","last_unstale":"2024-03-04T13:00:43.111171+0000","last_undegraded":"2024-03-04T13:00:43.111171+0000","last_fullsized":"2024-03-04T13:00:43.111171+0000","mapping_epoch":22,"log_start":"256'1200","ondisk_log_start":"256'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1256","last_scrub_stamp":"2024-03-04T13:00:43.111042+0000","last_deep_scrub":"256'1256","last_deep_scrub_stamp":"2024-03-04T13:00:43.111042+0000","last_clean_scrub_stamp":"2024-03-04T13:00:43.111042+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":1200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:59.468907+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5403,"num_read_kb":4680,"num_write":1785,"num_write_kb":760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2067,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"256'329","reported_seq":940,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:03.281555+0000","last_change":"2024-03-04T13:01:03.281590+0000","last_active":"2024-03-04T13:01:03.281555+0000","last_peered":"2024-03-04T13:01:03.281555+0000","last_clean":"2024-03-04T13:01:03.281555+0000","last_became_active":"2024-03-04T12:36:05.290410+0000","last_became_peered":"2024-03-04T12:36:05.290410+0000","last_unstale":"2024-03-04T13:01:03.281555+0000","last_undegraded":"2024-03-04T13:01:03.281555+0000","last_fullsized":"2024-03-04T13:01:03.281555+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'329","last_scrub_stamp":"2024-03-04T13:01:03.281485+0000","last_deep_scrub":"256'329","last_deep_scrub_stamp":"2024-03-04T13:01:03.281485+0000","last_clean_scrub_stamp":"2024-03-04T13:01:03.281485+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:52.674725+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2168155,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":19682,"num_write":1207,"num_write_kb":25111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"256'275","reported_seq":1526,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:47.035923+0000","last_change":"2024-03-04T13:00:47.035923+0000","last_active":"2024-03-04T13:00:47.035923+0000","last_peered":"2024-03-04T13:00:47.035923+0000","last_clean":"2024-03-04T13:00:47.035923+0000","last_became_active":"2024-03-04T12:36:07.291583+0000","last_became_peered":"2024-03-04T12:36:07.291583+0000","last_unstale":"2024-03-04T13:00:47.035923+0000","last_undegraded":"2024-03-04T13:00:47.035923+0000","last_fullsized":"2024-03-04T13:00:47.035923+0000","mapping_epoch":22,"log_start":"256'200","ondisk_log_start":"256'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'275","last_scrub_stamp":"2024-03-04T13:00:47.035802+0000","last_deep_scrub":"256'275","last_deep_scrub_stamp":"2024-03-04T13:00:47.035802+0000","last_clean_scrub_stamp":"2024-03-04T13:00:47.035802+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:54:35.976960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1552,"num_read_kb":1496,"num_write":324,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"256'405","reported_seq":1031,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:11.398220+0000","last_change":"2024-03-04T13:01:11.398315+0000","last_active":"2024-03-04T13:01:11.398220+0000","last_peered":"2024-03-04T13:01:11.398220+0000","last_clean":"2024-03-04T13:01:11.398220+0000","last_became_active":"2024-03-04T12:36:05.290522+0000","last_became_peered":"2024-03-04T12:36:05.290522+0000","last_unstale":"2024-03-04T13:01:11.398220+0000","last_undegraded":"2024-03-04T13:01:11.398220+0000","last_fullsized":"2024-03-04T13:01:11.398220+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'405","last_scrub_stamp":"2024-03-04T13:01:11.398132+0000","last_deep_scrub":"256'405","last_deep_scrub_stamp":"2024-03-04T13:01:11.398132+0000","last_clean_scrub_stamp":"2024-03-04T13:01:11.398132+0000","objects_scrubbed":16,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:17:33.646597+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11113900,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":595,"num_read_kb":8197,"num_write":1190,"num_write_kb":30951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"256'1119","reported_seq":2706,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:50.244677+0000","last_change":"2024-03-04T13:00:50.244677+0000","last_active":"2024-03-04T13:00:50.244677+0000","last_peered":"2024-03-04T13:00:50.244677+0000","last_clean":"2024-03-04T13:00:50.244677+0000","last_became_active":"2024-03-04T12:36:07.294536+0000","last_became_peered":"2024-03-04T12:36:07.294536+0000","last_unstale":"2024-03-04T13:00:50.244677+0000","last_undegraded":"2024-03-04T13:00:50.244677+0000","last_fullsized":"2024-03-04T13:00:50.244677+0000","mapping_epoch":22,"log_start":"256'1100","ondisk_log_start":"256'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'1119","last_scrub_stamp":"2024-03-04T13:00:50.244566+0000","last_deep_scrub":"256'1119","last_deep_scrub_stamp":"2024-03-04T13:00:50.244566+0000","last_clean_scrub_stamp":"2024-03-04T13:00:50.244566+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:22.669433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4737,"num_read_kb":4156,"num_write":1530,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"256'326","reported_seq":949,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:51.725027+0000","last_change":"2024-03-04T13:00:51.725087+0000","last_active":"2024-03-04T13:00:51.725027+0000","last_peered":"2024-03-04T13:00:51.725027+0000","last_clean":"2024-03-04T13:00:51.725027+0000","last_became_active":"2024-03-04T12:36:05.285924+0000","last_became_peered":"2024-03-04T12:36:05.285924+0000","last_unstale":"2024-03-04T13:00:51.725027+0000","last_undegraded":"2024-03-04T13:00:51.725027+0000","last_fullsized":"2024-03-04T13:00:51.725027+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'326","last_scrub_stamp":"2024-03-04T13:00:51.724916+0000","last_deep_scrub":"256'326","last_deep_scrub_stamp":"2024-03-04T13:00:51.724916+0000","last_clean_scrub_stamp":"2024-03-04T13:00:51.724916+0000","objects_scrubbed":10,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:44.286917+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671806,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":413,"num_read_kb":22814,"num_write":1062,"num_write_kb":24147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"256'331","reported_seq":1647,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.482546+0000","last_change":"2024-03-04T13:00:48.482546+0000","last_active":"2024-03-04T13:00:48.482546+0000","last_peered":"2024-03-04T13:00:48.482546+0000","last_clean":"2024-03-04T13:00:48.482546+0000","last_became_active":"2024-03-04T12:36:07.302371+0000","last_became_peered":"2024-03-04T12:36:07.302371+0000","last_unstale":"2024-03-04T13:00:48.482546+0000","last_undegraded":"2024-03-04T13:00:48.482546+0000","last_fullsized":"2024-03-04T13:00:48.482546+0000","mapping_epoch":22,"log_start":"256'300","ondisk_log_start":"256'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'331","last_scrub_stamp":"2024-03-04T13:00:48.482398+0000","last_deep_scrub":"256'331","last_deep_scrub_stamp":"2024-03-04T13:00:48.482398+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.482398+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:36.170349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1728,"num_read_kb":1642,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"256'322","reported_seq":926,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:05.254182+0000","last_change":"2024-03-04T13:01:05.254249+0000","last_active":"2024-03-04T13:01:05.254182+0000","last_peered":"2024-03-04T13:01:05.254182+0000","last_clean":"2024-03-04T13:01:05.254182+0000","last_became_active":"2024-03-04T12:36:05.290032+0000","last_became_peered":"2024-03-04T12:36:05.290032+0000","last_unstale":"2024-03-04T13:01:05.254182+0000","last_undegraded":"2024-03-04T13:01:05.254182+0000","last_fullsized":"2024-03-04T13:01:05.254182+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'322","last_scrub_stamp":"2024-03-04T13:01:05.254053+0000","last_deep_scrub":"256'322","last_deep_scrub_stamp":"2024-03-04T13:01:05.254053+0000","last_clean_scrub_stamp":"2024-03-04T13:01:05.254053+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:01.230258+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489519,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":31102,"num_write":1081,"num_write_kb":33345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"256'418","reported_seq":1954,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:00.578731+0000","last_change":"2024-03-04T13:01:00.578797+0000","last_active":"2024-03-04T13:01:00.578731+0000","last_peered":"2024-03-04T13:01:00.578731+0000","last_clean":"2024-03-04T13:01:00.578731+0000","last_became_active":"2024-03-04T12:36:07.299718+0000","last_became_peered":"2024-03-04T12:36:07.299718+0000","last_unstale":"2024-03-04T13:01:00.578731+0000","last_undegraded":"2024-03-04T13:01:00.578731+0000","last_fullsized":"2024-03-04T13:01:00.578731+0000","mapping_epoch":22,"log_start":"256'400","ondisk_log_start":"256'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'418","last_scrub_stamp":"2024-03-04T13:01:00.578634+0000","last_deep_scrub":"256'418","last_deep_scrub_stamp":"2024-03-04T13:01:00.578634+0000","last_clean_scrub_stamp":"2024-03-04T13:01:00.578634+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:14:37.681539+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2289,"num_read_kb":2179,"num_write":520,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"256'395","reported_seq":1062,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:40.207499+0000","last_change":"2024-03-04T13:00:40.207554+0000","last_active":"2024-03-04T13:00:40.207499+0000","last_peered":"2024-03-04T13:00:40.207499+0000","last_clean":"2024-03-04T13:00:40.207499+0000","last_became_active":"2024-03-04T12:36:05.279538+0000","last_became_peered":"2024-03-04T12:36:05.279538+0000","last_unstale":"2024-03-04T13:00:40.207499+0000","last_undegraded":"2024-03-04T13:00:40.207499+0000","last_fullsized":"2024-03-04T13:00:40.207499+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'395","last_scrub_stamp":"2024-03-04T13:00:40.207418+0000","last_deep_scrub":"256'395","last_deep_scrub_stamp":"2024-03-04T13:00:40.207418+0000","last_clean_scrub_stamp":"2024-03-04T13:00:40.207418+0000","objects_scrubbed":12,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:25.317833+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4781240,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":615,"num_read_kb":6803,"num_write":1512,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"256'749","reported_seq":2156,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:48.343025+0000","last_change":"2024-03-04T13:00:48.343052+0000","last_active":"2024-03-04T13:00:48.343025+0000","last_peered":"2024-03-04T13:00:48.343025+0000","last_clean":"2024-03-04T13:00:48.343025+0000","last_became_active":"2024-03-04T12:36:07.294274+0000","last_became_peered":"2024-03-04T12:36:07.294274+0000","last_unstale":"2024-03-04T13:00:48.343025+0000","last_undegraded":"2024-03-04T13:00:48.343025+0000","last_fullsized":"2024-03-04T13:00:48.343025+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'749","last_scrub_stamp":"2024-03-04T13:00:48.342929+0000","last_deep_scrub":"256'749","last_deep_scrub_stamp":"2024-03-04T13:00:48.342929+0000","last_clean_scrub_stamp":"2024-03-04T13:00:48.342929+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:34:20.672996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3445,"num_read_kb":3067,"num_write":1017,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"256'369","reported_seq":960,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:25.246173+0000","last_change":"2024-03-04T13:00:25.246235+0000","last_active":"2024-03-04T13:00:25.246173+0000","last_peered":"2024-03-04T13:00:25.246173+0000","last_clean":"2024-03-04T13:00:25.246173+0000","last_became_active":"2024-03-04T12:36:40.391325+0000","last_became_peered":"2024-03-04T12:36:40.391325+0000","last_unstale":"2024-03-04T13:00:25.246173+0000","last_undegraded":"2024-03-04T13:00:25.246173+0000","last_fullsized":"2024-03-04T13:00:25.246173+0000","mapping_epoch":33,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'369","last_scrub_stamp":"2024-03-04T13:00:25.246095+0000","last_deep_scrub":"256'369","last_deep_scrub_stamp":"2024-03-04T13:00:25.246095+0000","last_clean_scrub_stamp":"2024-03-04T13:00:25.246095+0000","objects_scrubbed":6,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:52.565129+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2969477,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":505,"num_read_kb":41621,"num_write":1246,"num_write_kb":38740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"256'368","reported_seq":1087,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:01:01.211667+0000","last_change":"2024-03-04T13:01:01.211731+0000","last_active":"2024-03-04T13:01:01.211667+0000","last_peered":"2024-03-04T13:01:01.211667+0000","last_clean":"2024-03-04T13:01:01.211667+0000","last_became_active":"2024-03-04T12:36:05.287744+0000","last_became_peered":"2024-03-04T12:36:05.287744+0000","last_unstale":"2024-03-04T13:01:01.211667+0000","last_undegraded":"2024-03-04T13:01:01.211667+0000","last_fullsized":"2024-03-04T13:01:01.211667+0000","mapping_epoch":20,"log_start":"256'300","ondisk_log_start":"256'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'368","last_scrub_stamp":"2024-03-04T13:01:01.211572+0000","last_deep_scrub":"256'368","last_deep_scrub_stamp":"2024-03-04T13:01:01.211572+0000","last_clean_scrub_stamp":"2024-03-04T13:01:01.211572+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:42:06.943792+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984340,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":791,"num_read_kb":29804,"num_write":1288,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"256'538","reported_seq":2102,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:49.480245+0000","last_change":"2024-03-04T13:00:49.480278+0000","last_active":"2024-03-04T13:00:49.480245+0000","last_peered":"2024-03-04T13:00:49.480245+0000","last_clean":"2024-03-04T13:00:49.480245+0000","last_became_active":"2024-03-04T12:36:07.302290+0000","last_became_peered":"2024-03-04T12:36:07.302290+0000","last_unstale":"2024-03-04T13:00:49.480245+0000","last_undegraded":"2024-03-04T13:00:49.480245+0000","last_fullsized":"2024-03-04T13:00:49.480245+0000","mapping_epoch":22,"log_start":"256'500","ondisk_log_start":"256'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'538","last_scrub_stamp":"2024-03-04T13:00:49.480150+0000","last_deep_scrub":"256'538","last_deep_scrub_stamp":"2024-03-04T13:00:49.480150+0000","last_clean_scrub_stamp":"2024-03-04T13:00:49.480150+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:45:14.990775+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2955,"num_read_kb":2687,"num_write":726,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"256'457","reported_seq":1240,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:57.355914+0000","last_change":"2024-03-04T13:00:57.355957+0000","last_active":"2024-03-04T13:00:57.355914+0000","last_peered":"2024-03-04T13:00:57.355914+0000","last_clean":"2024-03-04T13:00:57.355914+0000","last_became_active":"2024-03-04T12:36:05.283797+0000","last_became_peered":"2024-03-04T12:36:05.283797+0000","last_unstale":"2024-03-04T13:00:57.355914+0000","last_undegraded":"2024-03-04T13:00:57.355914+0000","last_fullsized":"2024-03-04T13:00:57.355914+0000","mapping_epoch":20,"log_start":"256'400","ondisk_log_start":"256'400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'457","last_scrub_stamp":"2024-03-04T13:00:57.355821+0000","last_deep_scrub":"256'457","last_deep_scrub_stamp":"2024-03-04T13:00:57.355821+0000","last_clean_scrub_stamp":"2024-03-04T13:00:57.355821+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:36.376522+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5417905,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1114,"num_read_kb":38636,"num_write":1666,"num_write_kb":30809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"256'787","reported_seq":2222,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-03-04T13:00:44.367298+0000","last_change":"2024-03-04T13:00:44.367329+0000","last_active":"2024-03-04T13:00:44.367298+0000","last_peered":"2024-03-04T13:00:44.367298+0000","last_clean":"2024-03-04T13:00:44.367298+0000","last_became_active":"2024-03-04T12:36:07.301542+0000","last_became_peered":"2024-03-04T12:36:07.301542+0000","last_unstale":"2024-03-04T13:00:44.367298+0000","last_undegraded":"2024-03-04T13:00:44.367298+0000","last_fullsized":"2024-03-04T13:00:44.367298+0000","mapping_epoch":22,"log_start":"256'700","ondisk_log_start":"256'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'787","last_scrub_stamp":"2024-03-04T13:00:44.367203+0000","last_deep_scrub":"256'787","last_deep_scrub_stamp":"2024-03-04T13:00:44.367203+0000","last_clean_scrub_stamp":"2024-03-04T13:00:44.367203+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:32.262672+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3434,"num_read_kb":3044,"num_write":1054,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":164,"num_read_kb":179702,"num_write":175,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5885,"num_read_kb":4252,"num_write":2245,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8924,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1079,"ondisk_log_size":1079,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":9441,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":12014,"num_read_kb":11868,"num_write":14038,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1548,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":18882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2403,"ondisk_log_size":2403,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":486,"ondisk_log_size":486,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1548695,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":15552,"num_read_kb":34013,"num_write":13157,"num_write_kb":10848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":618572,"num_omap_keys":1452,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2063,"ondisk_log_size":2063,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1552,"num_read_kb":1546,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":187094,"num_read_kb":170304,"num_write":50851,"num_write_kb":17572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":99,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":38813,"num_omap_keys":168,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3859,"ondisk_log_size":3859,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":175727187,"num_objects":435,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":0,"num_read":34803,"num_read_kb":2210949,"num_write":78480,"num_write_kb":2282182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":353116160,"data_stored":351454374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3611,"ondisk_log_size":3611,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":165,"num_read_kb":175660,"num_write":175,"num_write_kb":117224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575163,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333184,"kb_used_data":71544,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94038656,"statfs":{"total":96636764160,"available":96295583744,"internally_reserved":0,"allocated":73261056,"data_stored":71540111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575164,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290296,"kb_used_data":38384,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94081544,"statfs":{"total":96636764160,"available":96339501056,"internally_reserved":0,"allocated":39305216,"data_stored":37695435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575164,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151020,"kb_used_data":51876,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94220820,"statfs":{"total":96636764160,"available":96482119680,"internally_reserved":0,"allocated":53121024,"data_stored":51449109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575162,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144096,"kb_used_data":72664,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94227744,"statfs":{"total":96636764160,"available":96489209856,"internally_reserved":0,"allocated":74407936,"data_stored":72693947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575162,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310816,"kb_used_data":49240,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94061024,"statfs":{"total":96636764160,"available":96318488576,"internally_reserved":0,"allocated":50421760,"data_stored":48746373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575163,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140424,"kb_used_data":51008,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94231416,"statfs":{"total":96636764160,"available":96492969984,"internally_reserved":0,"allocated":52232192,"data_stored":50704146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575166,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152644,"kb_used_data":41020,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94219196,"statfs":{"total":96636764160,"available":96480456704,"internally_reserved":0,"allocated":42004480,"data_stored":40455223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575163,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306936,"kb_used_data":63408,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94064904,"statfs":{"total":96636764160,"available":96322461696,"internally_reserved":0,"allocated":64929792,"data_stored":63233494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45060096,"data_stored":44816819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30089216,"data_stored":29970475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42442752,"data_stored":42316441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38498304,"data_stored":38260992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62513152,"data_stored":62209723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39063552,"data_stored":38866277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31576064,"data_stored":31403645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":63873024,"data_stored":63610002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:01:46.492 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-04T13:01:46.815 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-04T13:01:46.815 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-04T13:01:46.816 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-04T13:01:46.816 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:46.862 INFO:tasks.ceph.osd.0:Stopped 2024-03-04T13:01:46.862 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-04T13:01:46.863 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:46.910 INFO:tasks.ceph.osd.1:Stopped 2024-03-04T13:01:46.911 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-04T13:01:46.911 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:46.951 INFO:tasks.ceph.osd.2:Stopped 2024-03-04T13:01:46.951 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-04T13:01:46.951 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:47.028 INFO:tasks.ceph.osd.3:Stopped 2024-03-04T13:01:47.028 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-04T13:01:47.028 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:47.073 INFO:tasks.ceph.osd.4:Stopped 2024-03-04T13:01:47.073 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-04T13:01:47.073 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:47.125 INFO:tasks.ceph.osd.5:Stopped 2024-03-04T13:01:47.125 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-04T13:01:47.125 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:47.176 INFO:tasks.ceph.osd.6:Stopped 2024-03-04T13:01:47.176 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-04T13:01:47.176 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:47.227 INFO:tasks.ceph.osd.7:Stopped 2024-03-04T13:01:47.227 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-04T13:01:47.228 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-04T13:01:47.228 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:47.252 INFO:tasks.ceph.mgr.y:Stopped 2024-03-04T13:01:47.253 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-04T13:01:47.253 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:47.282 INFO:tasks.ceph.mgr.x:Stopped 2024-03-04T13:01:47.282 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-04T13:01:47.282 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-04T13:01:47.282 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:47.306 INFO:tasks.ceph.mon.a:Stopped 2024-03-04T13:01:47.307 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-04T13:01:47.307 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:47.358 INFO:tasks.ceph.mon.c:Stopped 2024-03-04T13:01:47.359 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-04T13:01:47.359 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:01:47.370 INFO:tasks.ceph.mon.b:Stopped 2024-03-04T13:01:47.371 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-04T13:01:47.371 DEBUG:teuthology.orchestra.run.smithi090:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-03-04T13:01:47.440 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi090.front.sepia.ceph.com 2024-03-04T13:01:47.441 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-04T13:01:47.823 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com 2024-03-04T13:01:47.824 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-04T13:01:47.969 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi090.front.sepia.ceph.com 2024-03-04T13:01:47.969 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-04T13:01:48.049 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi090.front.sepia.ceph.com 2024-03-04T13:01:48.049 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-04T13:01:48.131 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi184.front.sepia.ceph.com 2024-03-04T13:01:48.132 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-04T13:01:48.354 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi184.front.sepia.ceph.com 2024-03-04T13:01:48.354 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-04T13:01:48.455 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi184.front.sepia.ceph.com 2024-03-04T13:01:48.456 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-04T13:01:48.536 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi184.front.sepia.ceph.com 2024-03-04T13:01:48.536 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-04T13:01:48.620 INFO:tasks.ceph:Archiving mon data... 2024-03-04T13:01:48.621 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079/data/mon.a.tgz 2024-03-04T13:01:48.621 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-03-04T13:01:48.649 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.en414dcWJQ 2024-03-04T13:01:48.650 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.en414dcWJQ 2024-03-04T13:01:48.871 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.en414dcWJQ 2024-03-04T13:01:48.980 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.en414dcWJQ is 442KB 2024-03-04T13:01:49.076 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.en414dcWJQ 2024-03-04T13:01:49.103 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079/data/mon.c.tgz 2024-03-04T13:01:49.103 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-03-04T13:01:49.170 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.ZJ8l9Y8wYl 2024-03-04T13:01:49.171 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ZJ8l9Y8wYl 2024-03-04T13:01:49.348 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.ZJ8l9Y8wYl 2024-03-04T13:01:49.459 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.ZJ8l9Y8wYl is 452KB 2024-03-04T13:01:49.555 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.ZJ8l9Y8wYl 2024-03-04T13:01:49.585 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079/data/mon.b.tgz 2024-03-04T13:01:49.586 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-03-04T13:01:49.619 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.JSgcMio2yE 2024-03-04T13:01:49.620 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.JSgcMio2yE 2024-03-04T13:01:49.816 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.JSgcMio2yE 2024-03-04T13:01:49.926 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.JSgcMio2yE is 452KB 2024-03-04T13:01:50.022 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.JSgcMio2yE 2024-03-04T13:01:50.049 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-04T13:01:50.049 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-04T13:01:50.051 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-04T13:01:50.156 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-04T13:01:50.195 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-04T13:01:50.196 INFO:tasks.ceph:Archiving crash dumps... 2024-03-04T13:01:50.197 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/crash to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079/remote/smithi090/crash 2024-03-04T13:01:50.198 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-04T13:01:50.237 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/crash to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079/remote/smithi184/crash 2024-03-04T13:01:50.238 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-04T13:01:50.277 INFO:tasks.ceph:Compressing logs... 2024-03-04T13:01:50.278 DEBUG:teuthology.orchestra.run.smithi090:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T13:01:50.282 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T13:01:50.374 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33715.log 2024-03-04T13:01:50.374 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-04T13:01:50.374 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33539.log 2024-03-04T13:01:50.374 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33715.log.gz 2024-03-04T13:01:50.374 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33583.log 2024-03-04T13:01:50.375 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33759.log 2024-03-04T13:01:50.375 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33539.log.gz 2024-03-04T13:01:50.375 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33583.log.gz 2024-03-04T13:01:50.375 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-04T13:01:50.375 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33759.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-04T13:01:50.375 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33759.log.gz 2024-03-04T13:01:50.375 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-04T13:01:50.375 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-04T13:01:50.375 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33803.log 2024-03-04T13:01:50.376 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-04T13:01:50.376 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33803.log: gzip -5 0.0% --verbose -- /var/log/ceph/ceph-client.admin.33847.log 2024-03-04T13:01:50.376 INFO:teuthology.orchestra.run.smithi184.stderr: 90.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-04T13:01:50.376 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33803.log.gz 2024-03-04T13:01:50.376 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33627.log 2024-03-04T13:01:50.376 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33847.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.33671.log 2024-03-04T13:01:50.376 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33847.log.gz 2024-03-04T13:01:50.376 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33627.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33627.log.gz 2024-03-04T13:01:50.377 INFO:teuthology.orchestra.run.smithi184.stderr: -5 --verbose -- /var/log/ceph/ceph.log 2024-03-04T13:01:50.377 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33671.log.gz 2024-03-04T13:01:50.377 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-04T13:01:50.377 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: 87.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-04T13:01:50.436 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100639.log 2024-03-04T13:01:50.436 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54752.log 2024-03-04T13:01:50.436 INFO:teuthology.orchestra.run.smithi090.stderr:gzip/var/log/ceph/ceph-client.admin.100639.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.114186.log 2024-03-04T13:01:50.436 INFO:teuthology.orchestra.run.smithi090.stderr: 82.0%/var/log/ceph/ceph-client.admin.54752.log: -- replaced with /var/log/ceph/ceph-client.admin.100639.log.gz 2024-03-04T13:01:50.436 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64083.log 2024-03-04T13:01:50.437 INFO:teuthology.orchestra.run.smithi090.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.54752.log.gz 2024-03-04T13:01:50.437 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.114186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40579.log 2024-03-04T13:01:50.437 INFO:teuthology.orchestra.run.smithi090.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.114186.log.gz 2024-03-04T13:01:50.437 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64083.log.gz 2024-03-04T13:01:50.437 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-04T13:01:50.437 INFO:teuthology.orchestra.run.smithi090.stderr:gzip/var/log/ceph/ceph-client.admin.40579.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66795.log 2024-03-04T13:01:50.437 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40579.log.gz 2024-03-04T13:01:50.437 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93570.log 2024-03-04T13:01:50.437 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142058.log 2024-03-04T13:01:50.438 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.93570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98871.log 2024-03-04T13:01:50.438 INFO:teuthology.orchestra.run.smithi090.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93570.log.gz 2024-03-04T13:01:50.438 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.142058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64972.log 2024-03-04T13:01:50.438 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142058.log.gz 2024-03-04T13:01:50.438 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.98871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42290.log 2024-03-04T13:01:50.438 INFO:teuthology.orchestra.run.smithi090.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.98871.log.gz 2024-03-04T13:01:50.438 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141506.log 2024-03-04T13:01:50.438 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.42290.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.64972.log.gz 2024-03-04T13:01:50.438 INFO:teuthology.orchestra.run.smithi090.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.42290.log.gz 2024-03-04T13:01:50.439 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142349.log 2024-03-04T13:01:50.439 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39905.log 2024-03-04T13:01:50.439 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141506.log.gz 2024-03-04T13:01:50.439 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.142349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142349.log.gz 2024-03-04T13:01:50.439 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40803.log 2024-03-04T13:01:50.439 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69882.log 2024-03-04T13:01:50.439 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39905.log.gz 2024-03-04T13:01:50.439 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64147.log 2024-03-04T13:01:50.439 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40803.log.gz 2024-03-04T13:01:50.440 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.69882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51759.log 2024-03-04T13:01:50.440 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142393.log 2024-03-04T13:01:50.440 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92392.log 2024-03-04T13:01:50.440 INFO:teuthology.orchestra.run.smithi090.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.51759.log.gz 2024-03-04T13:01:50.440 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.142393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115953.log 2024-03-04T13:01:50.440 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142393.log.gz 2024-03-04T13:01:50.440 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.92392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90036.log 2024-03-04T13:01:50.440 INFO:teuthology.orchestra.run.smithi090.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.92392.log.gz 2024-03-04T13:01:50.441 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.115953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61279.log 2024-03-04T13:01:50.441 INFO:teuthology.orchestra.run.smithi090.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.115953.log.gz 2024-03-04T13:01:50.441 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.90036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40975.log 2024-03-04T13:01:50.441 INFO:teuthology.orchestra.run.smithi090.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.66795.log.gz 2024-03-04T13:01:50.441 INFO:teuthology.orchestra.run.smithi090.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.90036.log.gz 2024-03-04T13:01:50.441 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85324.log 2024-03-04T13:01:50.441 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61279.log.gz 2024-03-04T13:01:50.441 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89447.log 2024-03-04T13:01:50.441 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40975.log.gz 2024-03-04T13:01:50.442 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.85324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39997.log 2024-03-04T13:01:50.442 INFO:teuthology.orchestra.run.smithi090.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.85324.log.gz 2024-03-04T13:01:50.442 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.89447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118920.log 2024-03-04T13:01:50.442 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105351.log 2024-03-04T13:01:50.442 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39997.log.gz 2024-03-04T13:01:50.442 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89447.log.gz 2024-03-04T13:01:50.442 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.118920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119509.log 2024-03-04T13:01:50.442 INFO:teuthology.orchestra.run.smithi090.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.118920.log.gz 2024-03-04T13:01:50.442 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.105351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87680.log 2024-03-04T13:01:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.119509.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.105351.log.gz 2024-03-04T13:01:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62505.log 2024-03-04T13:01:50.443 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119509.log.gz 2024-03-04T13:01:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.87680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104173.log 2024-03-04T13:01:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101817.log 2024-03-04T13:01:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.62505.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87680.log.gz 2024-03-04T13:01:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.104173.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.62505.log.gz 2024-03-04T13:01:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126823.log 2024-03-04T13:01:50.443 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.101817.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104173.log.gz 2024-03-04T13:01:50.444 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105940.log 2024-03-04T13:01:50.444 INFO:teuthology.orchestra.run.smithi090.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.101817.log.gz 2024-03-04T13:01:50.444 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.126823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142257.log 2024-03-04T13:01:50.444 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52961.log 2024-03-04T13:01:50.444 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.105940.log: /var/log/ceph/ceph-client.admin.142257.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.40844.log 2024-03-04T13:01:50.444 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.142257.log.gz 2024-03-04T13:01:50.444 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52961.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52961.log.gz 2024-03-04T13:01:50.444 INFO:teuthology.orchestra.run.smithi090.stderr: -- /var/log/ceph/ceph-client.admin.54163.log 2024-03-04T13:01:50.445 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40844.log.gz 2024-03-04T13:01:50.445 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42893.log 2024-03-04T13:01:50.445 INFO:teuthology.orchestra.run.smithi090.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.126823.log.gz 2024-03-04T13:01:50.445 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95337.log 2024-03-04T13:01:50.445 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.54163.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.105940.log.gz 2024-03-04T13:01:50.445 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.42893.log: gzip 83.9% -- replaced with /var/log/ceph/ceph-client.admin.54163.log.gz 2024-03-04T13:01:50.445 INFO:teuthology.orchestra.run.smithi090.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108296.log 2024-03-04T13:01:50.445 INFO:teuthology.orchestra.run.smithi090.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.0.42893.log.gz 2024-03-04T13:01:50.445 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.95337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40578.log 2024-03-04T13:01:50.446 INFO:teuthology.orchestra.run.smithi090.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.95337.log.gz 2024-03-04T13:01:50.446 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.108296.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.108296.log.gz 2024-03-04T13:01:50.446 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48177.log 2024-03-04T13:01:50.446 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41650.log 2024-03-04T13:01:50.446 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40578.log.gz 2024-03-04T13:01:50.446 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141276.log 2024-03-04T13:01:50.446 INFO:teuthology.orchestra.run.smithi090.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.48177.log.gz 2024-03-04T13:01:50.446 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60690.log 2024-03-04T13:01:50.446 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41650.log.gz 2024-03-04T13:01:50.447 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141552.log 2024-03-04T13:01:50.447 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141276.log.gz 2024-03-04T13:01:50.447 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86502.log 2024-03-04T13:01:50.447 INFO:teuthology.orchestra.run.smithi090.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.60690.log.gz 2024-03-04T13:01:50.447 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88858.log 2024-03-04T13:01:50.447 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141552.log.gz 2024-03-04T13:01:50.447 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.86502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114775.log 2024-03-04T13:01:50.447 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.88858.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.86502.log.gz 2024-03-04T13:01:50.447 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48766.log 2024-03-04T13:01:50.448 INFO:teuthology.orchestra.run.smithi090.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.88858.log.gz 2024-03-04T13:01:50.448 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.114775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82968.log 2024-03-04T13:01:50.448 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99460.log 2024-03-04T13:01:50.448 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48766.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114775.log.gz 2024-03-04T13:01:50.448 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.82968.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.48766.log.gz 2024-03-04T13:01:50.448 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64277.log 2024-03-04T13:01:50.448 INFO:teuthology.orchestra.run.smithi090.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.82968.log.gz 2024-03-04T13:01:50.448 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.99460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74057.log 2024-03-04T13:01:50.449 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64277.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.99460.log.gz 2024-03-04T13:01:50.449 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141644.log 2024-03-04T13:01:50.449 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.74057.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.64277.log.gz 2024-03-04T13:01:50.449 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104762.log 2024-03-04T13:01:50.449 INFO:teuthology.orchestra.run.smithi090.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.74057.log.gz 2024-03-04T13:01:50.449 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117742.log 2024-03-04T13:01:50.449 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141644.log.gz 2024-03-04T13:01:50.449 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132123.log 2024-03-04T13:01:50.449 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.104762.log: /var/log/ceph/ceph-client.admin.117742.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.104762.log.gz 2024-03-04T13:01:50.450 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40971.log 2024-03-04T13:01:50.450 INFO:teuthology.orchestra.run.smithi090.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.117742.log.gz 2024-03-04T13:01:50.450 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.132123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102995.log 2024-03-04T13:01:50.450 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109474.log 2024-03-04T13:01:50.450 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40971.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64147.log.gz 2024-03-04T13:01:50.450 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40971.log.gz 2024-03-04T13:01:50.450 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.102995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132731.log 2024-03-04T13:01:50.450 INFO:teuthology.orchestra.run.smithi090.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.102995.log.gz 2024-03-04T13:01:50.451 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.109474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125256.log 2024-03-04T13:01:50.451 INFO:teuthology.orchestra.run.smithi090.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.109474.log.gz 2024-03-04T13:01:50.451 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.136417.log 2024-03-04T13:01:50.451 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.132731.log: /var/log/ceph/ceph-client.admin.125256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65561.log 2024-03-04T13:01:50.451 INFO:teuthology.orchestra.run.smithi090.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.132731.log.gz 2024-03-04T13:01:50.451 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.136417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56519.log 2024-03-04T13:01:50.451 INFO:teuthology.orchestra.run.smithi090.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.132123.log.gz 2024-03-04T13:01:50.451 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.65561.log: 80.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75830.log 2024-03-04T13:01:50.451 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.0.136417.log.gz 2024-03-04T13:01:50.452 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.56519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141598.log 2024-03-04T13:01:50.452 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130620.log 2024-03-04T13:01:50.452 INFO:teuthology.orchestra.run.smithi090.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.56519.log.gz 2024-03-04T13:01:50.452 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.75830.log: /var/log/ceph/ceph-client.admin.141598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33744.log 2024-03-04T13:01:50.452 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141598.log.gz 2024-03-04T13:01:50.452 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.130620.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.75830.log.gz 2024-03-04T13:01:50.452 INFO:teuthology.orchestra.run.smithi090.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.69882.log.gz 2024-03-04T13:01:50.452 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141966.log 2024-03-04T13:01:50.453 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125256.log.gz 2024-03-04T13:01:50.453 INFO:teuthology.orchestra.run.smithi090.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.130620.log.gz 2024-03-04T13:01:50.453 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77925.log 2024-03-04T13:01:50.453 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.33744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33744.log.gz 2024-03-04T13:01:50.453 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141966.log.gz 2024-03-04T13:01:50.453 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141874.log 2024-03-04T13:01:50.453 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.77925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60101.log 2024-03-04T13:01:50.453 INFO:teuthology.orchestra.run.smithi090.stderr: 48.5% -- replaced with /var/log/ceph/ceph-client.admin.77925.log.gz 2024-03-04T13:01:50.453 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40211.log 2024-03-04T13:01:50.454 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141874.log.gz 2024-03-04T13:01:50.454 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.60101.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-04T13:01:50.454 INFO:teuthology.orchestra.run.smithi090.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.60101.log.gz 2024-03-04T13:01:50.454 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138244.log 2024-03-04T13:01:50.454 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40211.log.gz 2024-03-04T13:01:50.454 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121325.log 2024-03-04T13:01:50.454 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.138244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39749.log 2024-03-04T13:01:50.454 INFO:teuthology.orchestra.run.smithi090.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.138244.log.gz 2024-03-04T13:01:50.455 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.121325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63656.log 2024-03-04T13:01:50.455 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61303.log 2024-03-04T13:01:50.455 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.121325.log.gz 2024-03-04T13:01:50.455 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39749.log.gz 2024-03-04T13:01:50.455 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63382.log 2024-03-04T13:01:50.455 INFO:teuthology.orchestra.run.smithi090.stderr: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.63656.log.gz 2024-03-04T13:01:50.455 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34192.log 2024-03-04T13:01:50.455 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61303.log.gz 2024-03-04T13:01:50.455 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.63382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39859.log 2024-03-04T13:01:50.456 INFO:teuthology.orchestra.run.smithi090.stderr: 58.4% -- replaced with /var/log/ceph/ceph-client.admin.63382.log.gz 2024-03-04T13:01:50.456 INFO:teuthology.orchestra.run.smithi090.stderr: 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-04T13:01:50.456 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39813.log 2024-03-04T13:01:50.456 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34192.log.gz 2024-03-04T13:01:50.456 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58923.log 2024-03-04T13:01:50.456 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39859.log.gz 2024-03-04T13:01:50.456 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40204.log 2024-03-04T13:01:50.456 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39813.log.gz 2024-03-04T13:01:50.457 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118331.log 2024-03-04T13:01:50.457 INFO:teuthology.orchestra.run.smithi090.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.58923.log.gz 2024-03-04T13:01:50.457 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40204.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.40204.log.gz /var/log/ceph/ceph-client.admin.40576.log 2024-03-04T13:01:50.457 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-03-04T13:01:50.457 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141322.log 2024-03-04T13:01:50.457 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.118331.log: /var/log/ceph/ceph-client.admin.40576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41147.log 2024-03-04T13:01:50.457 INFO:teuthology.orchestra.run.smithi090.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.118331.log.gz 2024-03-04T13:01:50.457 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40576.log.gz 2024-03-04T13:01:50.457 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49944.log 2024-03-04T13:01:50.458 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141322.log.gz 2024-03-04T13:01:50.458 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88269.log 2024-03-04T13:01:50.458 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41147.log.gz 2024-03-04T13:01:50.458 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70499.log 2024-03-04T13:01:50.458 INFO:teuthology.orchestra.run.smithi090.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.49944.log.gz 2024-03-04T13:01:50.458 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.88269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113597.log 2024-03-04T13:01:50.458 INFO:teuthology.orchestra.run.smithi090.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.88269.log.gz 2024-03-04T13:01:50.458 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41673.log 2024-03-04T13:01:50.459 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.70499.log: /var/log/ceph/ceph-client.admin.113597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64001.log 2024-03-04T13:01:50.459 INFO:teuthology.orchestra.run.smithi090.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.113597.log.gz 2024-03-04T13:01:50.459 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.41673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77981.log 2024-03-04T13:01:50.459 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80612.log 2024-03-04T13:01:50.459 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64001.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64001.log.gz 2024-03-04T13:01:50.459 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.77981.log: 93.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120123.log 2024-03-04T13:01:50.459 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65561.log.gz 2024-03-04T13:01:50.459 INFO:teuthology.orchestra.run.smithi090.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.41673.log.gz 2024-03-04T13:01:50.459 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-04T13:01:50.460 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.80612.log: /var/log/ceph/ceph-client.admin.120123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43502.log 2024-03-04T13:01:50.460 INFO:teuthology.orchestra.run.smithi090.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.80612.log.gz 2024-03-04T13:01:50.460 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120123.log.gz 2024-03-04T13:01:50.460 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.1.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.70499.log.gz 2024-03-04T13:01:50.460 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141920.log 2024-03-04T13:01:50.460 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.43502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76601.log 2024-03-04T13:01:50.460 INFO:teuthology.orchestra.run.smithi090.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43502.log.gz 2024-03-04T13:01:50.460 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141920.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.141920.log.gz 2024-03-04T13:01:50.460 INFO:teuthology.orchestra.run.smithi090.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55930.log 2024-03-04T13:01:50.461 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74649.log 2024-03-04T13:01:50.461 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.76601.log: /var/log/ceph/ceph-client.admin.55930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49355.log 2024-03-04T13:01:50.461 INFO:teuthology.orchestra.run.smithi090.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.76601.log.gz 2024-03-04T13:01:50.461 INFO:teuthology.orchestra.run.smithi090.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.55930.log.gz 2024-03-04T13:01:50.461 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.74649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141230.log 2024-03-04T13:01:50.461 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49355.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.77981.log.gz 2024-03-04T13:01:50.461 INFO:teuthology.orchestra.run.smithi090.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.49355.log.gz 2024-03-04T13:01:50.461 INFO:teuthology.orchestra.run.smithi090.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.74649.log.gz 2024-03-04T13:01:50.462 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133370.log 2024-03-04T13:01:50.462 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111241.log 2024-03-04T13:01:50.462 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141230.log.gz 2024-03-04T13:01:50.462 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.133370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106529.log 2024-03-04T13:01:50.462 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.111241.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.133370.log.gz 2024-03-04T13:01:50.462 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.134590.log 2024-03-04T13:01:50.462 INFO:teuthology.orchestra.run.smithi090.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.111241.log.gz 2024-03-04T13:01:50.462 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.106529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121938.log 2024-03-04T13:01:50.462 INFO:teuthology.orchestra.run.smithi090.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.106529.log.gz 2024-03-04T13:01:50.463 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.134590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107707.log 2024-03-04T13:01:50.463 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.121938.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.134590.log.gz 2024-03-04T13:01:50.463 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121938.log.gz 2024-03-04T13:01:50.463 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85913.log 2024-03-04T13:01:50.463 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.107707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100049.log 2024-03-04T13:01:50.463 INFO:teuthology.orchestra.run.smithi090.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.107707.log.gz 2024-03-04T13:01:50.463 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.85913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96515.log 2024-03-04T13:01:50.463 INFO:teuthology.orchestra.run.smithi090.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.85913.log.gz 2024-03-04T13:01:50.463 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.100049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40574.log 2024-03-04T13:01:50.464 INFO:teuthology.orchestra.run.smithi090.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.100049.log.gz 2024-03-04T13:01:50.464 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.96515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127431.log 2024-03-04T13:01:50.464 INFO:teuthology.orchestra.run.smithi090.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.96515.log.gz 2024-03-04T13:01:50.464 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40574.log.gz 2024-03-04T13:01:50.464 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128647.log 2024-03-04T13:01:50.464 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.127431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129404.log 2024-03-04T13:01:50.464 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.128647.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.127431.log.gz 2024-03-04T13:01:50.464 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63774.log 2024-03-04T13:01:50.465 INFO:teuthology.orchestra.run.smithi090.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.128647.log.gz 2024-03-04T13:01:50.465 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81201.log 2024-03-04T13:01:50.465 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.129404.log: /var/log/ceph/ceph-client.admin.63774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116542.log 2024-03-04T13:01:50.465 INFO:teuthology.orchestra.run.smithi090.stderr: 53.2% -- replaced with /var/log/ceph/ceph-client.admin.63774.log.gz 2024-03-04T13:01:50.465 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.81201.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.129404.log.gz 2024-03-04T13:01:50.465 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120147.log 2024-03-04T13:01:50.465 INFO:teuthology.orchestra.run.smithi090.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.81201.log.gz 2024-03-04T13:01:50.465 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.116542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71116.log 2024-03-04T13:01:50.465 INFO:teuthology.orchestra.run.smithi090.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.116542.log.gz 2024-03-04T13:01:50.466 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.120147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40210.log 2024-03-04T13:01:50.466 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40976.log 2024-03-04T13:01:50.466 INFO:teuthology.orchestra.run.smithi090.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.120147.log.gz 2024-03-04T13:01:50.466 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.71116.log: /var/log/ceph/ceph-client.admin.40210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69265.log 2024-03-04T13:01:50.466 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40210.log.gz 2024-03-04T13:01:50.466 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52348.log 2024-03-04T13:01:50.466 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40976.log.gz 2024-03-04T13:01:50.466 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.69265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117132.log 2024-03-04T13:01:50.466 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52348.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.71116.log.gz 2024-03-04T13:01:50.467 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80023.log 85.1% 2024-03-04T13:01:50.467 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52348.log.gz 2024-03-04T13:01:50.467 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.117132.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.117132.log.gz -- 2024-03-04T13:01:50.467 INFO:teuthology.orchestra.run.smithi090.stderr: /var/log/ceph/ceph-client.admin.40202.log 2024-03-04T13:01:50.467 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.80023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141414.log 2024-03-04T13:01:50.467 INFO:teuthology.orchestra.run.smithi090.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.80023.log.gz 2024-03-04T13:01:50.467 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121962.log 2024-03-04T13:01:50.467 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69265.log.gz 2024-03-04T13:01:50.467 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40202.log.gz 2024-03-04T13:01:50.468 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130012.log 2024-03-04T13:01:50.468 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141414.log.gz 2024-03-04T13:01:50.468 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.121962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107118.log 2024-03-04T13:01:50.468 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.130012.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121962.log.gz 2024-03-04T13:01:50.468 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83557.log 2024-03-04T13:01:50.468 INFO:teuthology.orchestra.run.smithi090.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.130012.log.gz 2024-03-04T13:01:50.468 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84735.log 2024-03-04T13:01:50.468 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.107118.log: /var/log/ceph/ceph-client.admin.83557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67412.log 2024-03-04T13:01:50.469 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107118.log.gz 2024-03-04T13:01:50.469 INFO:teuthology.orchestra.run.smithi090.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.83557.log.gz 2024-03-04T13:01:50.469 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.84735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41193.log 2024-03-04T13:01:50.469 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.67412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52937.log 2024-03-04T13:01:50.469 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.84735.log.gz 2024-03-04T13:01:50.469 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41193.log.gz 2024-03-04T13:01:50.469 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141460.log 2024-03-04T13:01:50.469 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50581.log 2024-03-04T13:01:50.469 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52937.log.gz 2024-03-04T13:01:50.470 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141460.log.gz 2024-03-04T13:01:50.470 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92981.log 2024-03-04T13:01:50.470 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141368.log 2024-03-04T13:01:50.470 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50581.log: /var/log/ceph/ceph-client.admin.92981.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.50581.log.gz 2024-03-04T13:01:50.470 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131228.log 2024-03-04T13:01:50.470 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92981.log.gz 2024-03-04T13:01:50.470 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110652.log 2024-03-04T13:01:50.470 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141368.log.gz 2024-03-04T13:01:50.471 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-04T13:01:50.471 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.131228.log: /var/log/ceph/ceph-client.admin.110652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120736.log 2024-03-04T13:01:50.471 INFO:teuthology.orchestra.run.smithi090.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.110652.log.gz 2024-03-04T13:01:50.471 INFO:teuthology.orchestra.run.smithi090.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.131228.log.gz 2024-03-04T13:01:50.471 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91214.log 2024-03-04T13:01:50.471 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76421.log 2024-03-04T13:01:50.471 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.120736.log: /var/log/ceph/ceph-client.admin.91214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39951.log 2024-03-04T13:01:50.471 INFO:teuthology.orchestra.run.smithi090.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.120736.log.gz 2024-03-04T13:01:50.472 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.76421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141828.log 2024-03-04T13:01:50.472 INFO:teuthology.orchestra.run.smithi090.stderr: 23.8% -- replaced with /var/log/ceph/ceph-client.admin.76421.log.gz 2024-03-04T13:01:50.472 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78590.log 2024-03-04T13:01:50.472 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39951.log: /var/log/ceph/ceph-client.admin.141828.log: 93.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84146.log 2024-03-04T13:01:50.472 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67412.log.gz 2024-03-04T13:01:50.472 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39951.log.gz 2024-03-04T13:01:50.472 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141828.log.gz 2024-03-04T13:01:50.472 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.78590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141690.log 2024-03-04T13:01:50.473 INFO:teuthology.orchestra.run.smithi090.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.78590.log.gz 2024-03-04T13:01:50.473 INFO:teuthology.orchestra.run.smithi090.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.91214.log.gz 2024-03-04T13:01:50.473 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41514.log 2024-03-04T13:01:50.473 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.84146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64857.log 2024-03-04T13:01:50.473 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141690.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.84146.log.gz 2024-03-04T13:01:50.473 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141690.log.gz 2024-03-04T13:01:50.473 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94159.log 2024-03-04T13:01:50.473 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41514.log.gz 2024-03-04T13:01:50.473 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.64857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68648.log 2024-03-04T13:01:50.474 INFO:teuthology.orchestra.run.smithi090.stderr: 19.5% -- replaced with /var/log/ceph/ceph-client.admin.64857.log.gz 2024-03-04T13:01:50.474 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.94159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112419.log 2024-03-04T13:01:50.474 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.68648.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.94159.log.gz 2024-03-04T13:01:50.474 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97104.log 2024-03-04T13:01:50.474 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.112419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41604.log 2024-03-04T13:01:50.474 INFO:teuthology.orchestra.run.smithi090.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.112419.log.gz 2024-03-04T13:01:50.474 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.97104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50533.log 2024-03-04T13:01:50.474 INFO:teuthology.orchestra.run.smithi090.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.97104.log.gz 2024-03-04T13:01:50.474 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41604.log.gz 2024-03-04T13:01:50.475 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133979.log 2024-03-04T13:01:50.475 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68648.log.gz 2024-03-04T13:01:50.475 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58875.log 2024-03-04T13:01:50.475 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50533.log.gz 2024-03-04T13:01:50.475 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.133979.log: /var/log/ceph/ceph-client.admin.142012.log 2024-03-04T13:01:50.475 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58875.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.133979.log.gz 2024-03-04T13:01:50.475 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95926.log 2024-03-04T13:01:50.475 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58875.log.gz 2024-03-04T13:01:50.476 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.142012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111830.log 2024-03-04T13:01:50.476 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142012.log.gz 2024-03-04T13:01:50.476 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.95926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55341.log 2024-03-04T13:01:50.476 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.111830.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-03-04T13:01:50.476 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95926.log.gz 2024-03-04T13:01:50.476 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.55341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.140468.log 2024-03-04T13:01:50.476 INFO:teuthology.orchestra.run.smithi090.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.55341.log.gz 2024-03-04T13:01:50.476 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40779.log 2024-03-04T13:01:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.140468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117153.log 2024-03-04T13:01:50.477 INFO:teuthology.orchestra.run.smithi090.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.111830.log.gz 2024-03-04T13:01:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40779.log.gz 2024-03-04T13:01:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50557.log 2024-03-04T13:01:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-04T13:01:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.117153.log: /var/log/ceph/ceph-client.admin.50557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51170.log 2024-03-04T13:01:50.477 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50557.log.gz 2024-03-04T13:01:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mgr.y.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.117153.log.gz 2024-03-04T13:01:50.478 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.137026.log 2024-03-04T13:01:50.478 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141736.log 2024-03-04T13:01:50.478 INFO:teuthology.orchestra.run.smithi090.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.51170.log.gz 2024-03-04T13:01:50.478 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.137026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103584.log 2024-03-04T13:01:50.478 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141736.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.137026.log.gz 2024-03-04T13:01:50.478 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141736.log.gz 2024-03-04T13:01:50.478 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-03-04T13:01:50.478 INFO:teuthology.orchestra.run.smithi090.stderr: /var/log/ceph/ceph-client.admin.81790.log 2024-03-04T13:01:50.478 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.103584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79434.log 82.1% -- replaced with /var/log/ceph/ceph-client.admin.103584.log.gz 2024-03-04T13:01:50.479 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-03-04T13:01:50.479 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.81790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.139772.log 2024-03-04T13:01:50.479 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81790.log.gz 2024-03-04T13:01:50.479 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.79434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.135199.log 2024-03-04T13:01:50.479 INFO:teuthology.orchestra.run.smithi090.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.79434.log.gz 2024-03-04T13:01:50.479 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.139772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101228.log 2024-03-04T13:01:50.479 INFO:teuthology.orchestra.run.smithi090.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.0.139772.log.gz 2024-03-04T13:01:50.479 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.135199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138853.log 2024-03-04T13:01:50.480 INFO:teuthology.orchestra.run.smithi090.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.135199.log.gz 2024-03-04T13:01:50.480 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.101228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45317.log 2024-03-04T13:01:50.480 INFO:teuthology.orchestra.run.smithi090.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.101228.log.gz 2024-03-04T13:01:50.480 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.138853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40203.log 2024-03-04T13:01:50.480 INFO:teuthology.orchestra.run.smithi090.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.138853.log.gz 2024-03-04T13:01:50.480 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71733.log 2024-03-04T13:01:50.480 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.45317.log: /var/log/ceph/ceph-client.admin.40203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58286.log 2024-03-04T13:01:50.480 INFO:teuthology.orchestra.run.smithi090.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.45317.log.gz 2024-03-04T13:01:50.481 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40203.log.gz 2024-03-04T13:01:50.481 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.71733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108885.log 2024-03-04T13:01:50.481 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142150.log 2024-03-04T13:01:50.481 INFO:teuthology.orchestra.run.smithi090.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.58286.log.gz 2024-03-04T13:01:50.481 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.108885.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71733.log.gz 2024-03-04T13:01:50.481 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40572.log 2024-03-04T13:01:50.481 INFO:teuthology.orchestra.run.smithi090.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.108885.log.gz 2024-03-04T13:01:50.481 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.142150.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142150.log.gz 2024-03-04T13:01:50.481 INFO:teuthology.orchestra.run.smithi090.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39656.log 2024-03-04T13:01:50.482 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40572.log.gz 2024-03-04T13:01:50.482 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57108.log 2024-03-04T13:01:50.482 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5/var/log/ceph/ceph-client.admin.39656.log: --verbose -- /var/log/ceph/ceph-client.admin.128039.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39656.log.gz 2024-03-04T13:01:50.482 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-03-04T13:01:50.482 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57108.log: gzip 85.1% -- replaced with /var/log/ceph/ceph-client.admin.57108.log.gz 2024-03-04T13:01:50.482 INFO:teuthology.orchestra.run.smithi090.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-04T13:01:50.482 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.128039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58899.log 2024-03-04T13:01:50.482 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.0.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.128039.log.gz 2024-03-04T13:01:50.482 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64213.log 2024-03-04T13:01:50.483 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-03-04T13:01:50.483 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.58899.log: /var/log/ceph/ceph-client.admin.64213.log: 0.0% 54.5% -- replaced with /var/log/ceph/ceph-client.admin.64213.log.gz 2024-03-04T13:01:50.483 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58899.log.gz 2024-03-04T13:01:50.483 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142104.log 2024-03-04T13:01:50.483 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40973.log 2024-03-04T13:01:50.483 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.142104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142104.log.gz 2024-03-04T13:01:50.483 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142196.log 2024-03-04T13:01:50.483 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40973.log.gz 2024-03-04T13:01:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121914.log 2024-03-04T13:01:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.142196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142196.log.gz 2024-03-04T13:01:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124607.log 2024-03-04T13:01:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.121914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121914.log.gz 2024-03-04T13:01:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46523.log 2024-03-04T13:01:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.124607.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.124607.log.gz 2024-03-04T13:01:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75239.log 2024-03-04T13:01:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.46523.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.46523.log.gz 2024-03-04T13:01:50.484 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82379.log 2024-03-04T13:01:50.485 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.75239.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.75239.log.gz 2024-03-04T13:01:50.485 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40209.log 2024-03-04T13:01:50.485 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.82379.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.82379.log.gz 2024-03-04T13:01:50.485 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40207.log 2024-03-04T13:01:50.485 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40209.log.gz 2024-03-04T13:01:50.485 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-04T13:01:50.485 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40207.log.gz 2024-03-04T13:01:50.485 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40577.log 2024-03-04T13:01:50.486 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.log: 94.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-04T13:01:50.486 INFO:teuthology.orchestra.run.smithi090.stderr: 93.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-04T13:01:50.486 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61916.log 2024-03-04T13:01:50.486 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40577.log: 87.0% -- replaced with /var/log/ceph/ceph-client.0.140468.log.gz 2024-03-04T13:01:50.486 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72395.log 2024-03-04T13:01:50.486 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40577.log.gz 2024-03-04T13:01:50.486 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120099.log 2024-03-04T13:01:50.486 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61916.log: /var/log/ceph/ceph-client.admin.72395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113008.log 2024-03-04T13:01:50.487 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.120099.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.72395.log.gz 86.2% -- replaced with /var/log/ceph/ceph-client.admin.61916.log.gz 2024-03-04T13:01:50.487 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120099.log.gz 2024-03-04T13:01:50.487 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-03-04T13:01:50.487 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40986.log 2024-03-04T13:01:50.487 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-04T13:01:50.487 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.113008.log: /var/log/ceph/ceph-client.admin.40986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44714.log 2024-03-04T13:01:50.487 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40986.log.gz 2024-03-04T13:01:50.487 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.2.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113008.log.gz 2024-03-04T13:01:50.487 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61327.log 2024-03-04T13:01:50.488 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68031.log 2024-03-04T13:01:50.488 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.44714.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.44714.log.gz 2024-03-04T13:01:50.488 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.61327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115364.log 2024-03-04T13:01:50.488 INFO:teuthology.orchestra.run.smithi090.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.61327.log.gz 2024-03-04T13:01:50.488 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.68031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91803.log 2024-03-04T13:01:50.488 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.115364.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.115364.log.gz 2024-03-04T13:01:50.488 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122551.log 2024-03-04T13:01:50.488 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.91803.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.91803.log.gz 2024-03-04T13:01:50.489 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45920.log 2024-03-04T13:01:50.489 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.122551.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.122551.log.gz 2024-03-04T13:01:50.489 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44105.log 2024-03-04T13:01:50.489 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.45920.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.45920.log.gz 2024-03-04T13:01:50.489 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52985.log 2024-03-04T13:01:50.489 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.44105.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.44105.log.gz 2024-03-04T13:01:50.489 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73468.log 2024-03-04T13:01:50.489 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.52985.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.52985.log.gz 2024-03-04T13:01:50.489 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40575.log 2024-03-04T13:01:50.490 INFO:teuthology.orchestra.run.smithi090.stderr: 92.9%/var/log/ceph/ceph-client.admin.73468.log: -- replaced with /var/log/ceph/ceph-client.admin.68031.log.gz 2024-03-04T13:01:50.490 INFO:teuthology.orchestra.run.smithi090.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.73468.log.gz 2024-03-04T13:01:50.490 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.137635.log 2024-03-04T13:01:50.490 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-03-04T13:01:50.490 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.137635.log: /var/log/ceph/ceph-client.admin.40575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40575.log.gz 2024-03-04T13:01:50.490 INFO:teuthology.orchestra.run.smithi090.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.137635.log.gz 2024-03-04T13:01:50.490 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110063.log 2024-03-04T13:01:50.490 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57697.log 2024-03-04T13:01:50.490 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.110063.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110063.log.gz 2024-03-04T13:01:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90625.log 2024-03-04T13:01:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.57697.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.57697.log.gz 2024-03-04T13:01:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98282.log 2024-03-04T13:01:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.90625.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.90625.log.gz 2024-03-04T13:01:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125864.log 2024-03-04T13:01:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.98282.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.98282.log.gz 2024-03-04T13:01:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27635.log 2024-03-04T13:01:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.125864.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.125864.log.gz 2024-03-04T13:01:50.491 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40208.log 2024-03-04T13:01:50.492 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.tmp-client.admin.27635.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27635.log.gz 2024-03-04T13:01:50.492 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123140.log 2024-03-04T13:01:50.492 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40208.log.gz 2024-03-04T13:01:50.492 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41239.log 2024-03-04T13:01:50.492 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.123140.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.123140.log.gz 2024-03-04T13:01:50.492 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40411.log 2024-03-04T13:01:50.492 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41239.log.gz 2024-03-04T13:01:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34070.log 2024-03-04T13:01:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40411.log.gz 2024-03-04T13:01:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94748.log 2024-03-04T13:01:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34070.log.gz 2024-03-04T13:01:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97693.log 2024-03-04T13:01:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.94748.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.94748.log.gz 2024-03-04T13:01:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142303.log 2024-03-04T13:01:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.97693.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.97693.log.gz 2024-03-04T13:01:50.493 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59512.log 2024-03-04T13:01:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.142303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142303.log.gz 2024-03-04T13:01:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102406.log 2024-03-04T13:01:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.59512.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.59512.log.gz 2024-03-04T13:01:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77210.log 2024-03-04T13:01:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.102406.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102406.log.gz 2024-03-04T13:01:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141782.log 2024-03-04T13:01:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.77210.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.77210.log.gz 2024-03-04T13:01:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41560.log 2024-03-04T13:01:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.141782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141782.log.gz 2024-03-04T13:01:50.494 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53574.log 2024-03-04T13:01:50.495 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41560.log.gz 2024-03-04T13:01:50.495 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-04T13:01:50.495 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.53574.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.53574.log.gz 2024-03-04T13:01:50.495 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87091.log 2024-03-04T13:01:50.497 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66178.log 2024-03-04T13:01:50.497 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.87091.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.87091.log.gz 2024-03-04T13:01:50.498 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.135808.log 2024-03-04T13:01:50.498 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.66178.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.66178.log.gz 2024-03-04T13:01:50.498 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.135808.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.135808.log.gz 2024-03-04T13:01:50.498 INFO:teuthology.orchestra.run.smithi090.stderr: 94.7% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-03-04T13:01:50.551 INFO:teuthology.orchestra.run.smithi184.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-04T13:01:50.884 INFO:teuthology.orchestra.run.smithi184.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-04T13:01:51.020 INFO:teuthology.orchestra.run.smithi090.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-04T13:01:51.374 INFO:teuthology.orchestra.run.smithi090.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-04T13:01:53.403 INFO:teuthology.orchestra.run.smithi090.stderr: 93.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-03-04T13:01:56.023 INFO:teuthology.orchestra.run.smithi090.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-04T13:01:57.791 INFO:teuthology.orchestra.run.smithi184.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-04T13:01:58.218 INFO:teuthology.orchestra.run.smithi184.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-04T13:01:58.314 INFO:teuthology.orchestra.run.smithi090.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-04T13:01:58.771 INFO:teuthology.orchestra.run.smithi184.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-04T13:01:59.970 INFO:teuthology.orchestra.run.smithi184.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-04T13:01:59.972 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-03-04T13:01:59.972 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m9.621s 2024-03-04T13:01:59.972 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m32.739s 2024-03-04T13:01:59.972 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m1.228s 2024-03-04T13:02:01.034 INFO:teuthology.orchestra.run.smithi090.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-04T13:02:06.393 INFO:teuthology.orchestra.run.smithi090.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-04T13:02:06.394 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-03-04T13:02:06.395 INFO:teuthology.orchestra.run.smithi090.stderr:real 0m16.088s 2024-03-04T13:02:06.395 INFO:teuthology.orchestra.run.smithi090.stderr:user 0m43.543s 2024-03-04T13:02:06.395 INFO:teuthology.orchestra.run.smithi090.stderr:sys 0m1.739s 2024-03-04T13:02:06.395 INFO:tasks.ceph:Archiving logs... 2024-03-04T13:02:06.396 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/log/ceph to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079/remote/smithi090/log 2024-03-04T13:02:06.397 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T13:02:12.366 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079/remote/smithi184/log 2024-03-04T13:02:12.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T13:02:17.200 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-04T13:02:17.212 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-04T13:02:17.212 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T13:02:17.215 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T13:02:17.317 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-04T13:02:17.328 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-04T13:02:17.329 DEBUG:teuthology.orchestra.run.smithi090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T13:02:17.331 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T13:02:17.357 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-03-04T13:02:17.362 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T13:02:17.362 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-03-04T13:02:17.362 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 161 +7341us[+7244us] +/- 139ms 2024-03-04T13:02:17.362 INFO:teuthology.orchestra.run.smithi090.stdout:^* hv02.front.sepia.ceph.com 3 6 377 30 -4308us[-4360us] +/- 68ms 2024-03-04T13:02:17.362 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +234us[ +234us] +/- 66ms 2024-03-04T13:02:17.362 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T13:02:17.363 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-03-04T13:02:17.366 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T13:02:17.366 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-03-04T13:02:17.366 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 +7565us[+7571us] +/- 141ms 2024-03-04T13:02:17.366 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv02.front.sepia.ceph.com 3 6 377 30 -4019us[-4014us] +/- 68ms 2024-03-04T13:02:17.367 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +516us[ +516us] +/- 66ms 2024-03-04T13:02:17.367 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T13:02:17.367 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-04T13:02:17.378 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-04T13:02:17.378 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-04T13:02:17.418 DEBUG:teuthology.orchestra.run.smithi090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T13:02:17.500 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T13:02:17.582 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T13:02:17.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T13:02:17.625 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T13:02:17.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T13:02:17.668 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-04T13:02:17.680 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-04T13:02:17.736 INFO:teuthology.task.internal:Duration was 2037.685791 seconds 2024-03-04T13:02:17.736 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-04T13:02:17.786 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-04T13:02:17.786 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T13:02:17.789 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T13:02:17.842 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T13:02:17.846 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T13:02:18.316 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-04T13:02:18.317 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi090.front.sepia.ceph.com 2024-03-04T13:02:18.317 DEBUG:teuthology.orchestra.run.smithi090:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T13:02:18.351 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-03-04T13:02:18.351 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T13:02:18.387 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-04T13:02:18.388 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T13:02:18.393 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T13:02:18.468 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-04T13:02:18.468 DEBUG:teuthology.orchestra.run.smithi090:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T13:02:18.476 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T13:02:18.618 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-04T13:02:18.632 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-04T13:02:18.632 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T13:02:18.672 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T13:02:18.711 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-04T13:02:18.723 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T13:02:18.726 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T13:02:18.761 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = core 2024-03-04T13:02:18.789 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-03-04T13:02:18.841 DEBUG:teuthology.orchestra.run.smithi090:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T13:02:18.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T13:02:18.868 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T13:02:18.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T13:02:18.908 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-04T13:02:18.920 INFO:teuthology.task.internal:Transferring archived files... 2024-03-04T13:02:18.921 DEBUG:teuthology.misc:Transferring archived files from smithi090:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079/remote/smithi090 2024-03-04T13:02:18.921 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T13:02:18.971 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079/remote/smithi184 2024-03-04T13:02:18.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T13:02:19.020 INFO:teuthology.task.internal:Removing archive directory... 2024-03-04T13:02:19.020 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T13:02:19.022 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T13:02:19.082 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-04T13:02:19.095 INFO:teuthology.task.internal:Not uploading archives. 2024-03-04T13:02:19.096 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-04T13:02:19.137 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-04T13:02:19.137 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T13:02:19.140 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T13:02:19.164 INFO:teuthology.orchestra.run.smithi090.stdout: 265952 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 13:02 /home/ubuntu/cephtest 2024-03-04T13:02:19.167 INFO:teuthology.orchestra.run.smithi184.stdout: 265301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 13:02 /home/ubuntu/cephtest 2024-03-04T13:02:19.168 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-04T13:02:19.187 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-04T13:02:19.296 INFO:teuthology.nuke:Checking targets against current locks 2024-03-04T13:02:19.322 DEBUG:teuthology.nuke:shortname: smithi090 2024-03-04T13:02:19.322 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T13:02:19.351 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 12:18:46.746828', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNlhke6ImRwW0tRTfdJzB0qBB7FXF7tOOlUe7oehwZ4Xt/w5ZH9ocT/GFTY4nc3Ud9M3URf3bSq2zbGIyyXGKCw='} 2024-03-04T13:02:19.352 DEBUG:teuthology.nuke:shortname: smithi184 2024-03-04T13:02:19.353 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T13:02:19.377 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 12:18:46.744734', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGKwWZrWkCZxY/vImMGcz9W9FF7BM6FRmsTGM/jnEwtEWpOzNigHbATn/rXF/f2snFexK8u8oCCPWoXA57o/ao8='} 2024-03-04T13:02:19.411 INFO:teuthology.orchestra.console.smithi090:Power off 2024-03-04T13:02:19.412 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T13:02:19.437 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2024-03-04T13:02:19.437 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:02:19.456 INFO:teuthology.orchestra.console.smithi184:Power off 2024-03-04T13:02:19.456 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T13:02:19.466 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2024-03-04T13:02:19.480 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2024-03-04T13:02:19.480 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:02:19.501 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-03-04T13:02:23.468 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:02:23.503 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:02:23.579 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2024-03-04T13:02:23.616 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-03-04T13:02:27.582 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:02:27.617 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:02:27.692 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-03-04T13:02:27.727 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-03-04T13:02:27.793 INFO:teuthology.orchestra.console.smithi090:Power off completed 2024-03-04T13:02:27.828 INFO:teuthology.orchestra.console.smithi184:Power off completed 2024-03-04T13:02:27.935 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 2037.6857914924622 failure_reason: 'Command failed (s3 tests against rgw) on smithi090 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m ''not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3''"' flavor: default owner: scheduled_prsrivas@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=c6bc25fad7cd42ef97513ea9bc1600f3 status: fail success: false 2024-03-04T13:02:27.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T13:02:28.020 INFO:teuthology.run:FAIL